2024-05-10T08:28:14.654 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T08:28:14.654 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi --archive /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} --owner scheduled_dparmar@teuthology -- /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/orig.config.yaml 2024-05-10T08:28:14.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T08:28:14.798 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073 branch: wip-63896-from-wip-rishabh-testing-20240501.193033 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: null first_in_suite: false job_id: '7701073' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-63896-from-wip-rishabh-testing-20240501.193033 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: d39fa08867836ac070c47cb66c782fa559fd480b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d39fa08867836ac070c47cb66c782fa559fd480b kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63896-from-wip-rishabh-testing-20240501.193033 sha1: d39fa08867836ac070c47cb66c782fa559fd480b owner: scheduled_dparmar@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1698 sha1: d39fa08867836ac070c47cb66c782fa559fd480b sleep_before_teardown: 0 subset: 434/512 suite: fs suite_branch: wip-63896-from-wip-rishabh-testing-20240501.193033 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d39fa08867836ac070c47cb66c782fa559fd480b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOcUkZbUa+MoBbiCA6aOmMuS2Mj9ec8CbVCXdupKx+eM9fZNi1YLCK64kADA9N0O2nlR3HHbre6XsapUnxYRsI= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOe8oDvRwfdClHI9t/UpsXBfVBtq0rv0KO2+FENtP18U1VHd5hUbv5MwBhflZ2e/Scep5l5aXTlqvpjegSCarBc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_08:11:49 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T08:28:14.798 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa; will attempt to use it 2024-05-10T08:28:14.799 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa/tasks 2024-05-10T08:28:14.799 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T08:28:14.801 INFO:teuthology.task.internal:Checking packages... 2024-05-10T08:28:14.828 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd39fa08867836ac070c47cb66c782fa559fd480b' 2024-05-10T08:28:14.828 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T08:28:14.829 INFO:teuthology.packaging:ref: None 2024-05-10T08:28:14.829 INFO:teuthology.packaging:tag: None 2024-05-10T08:28:14.829 INFO:teuthology.packaging:branch: wip-63896-from-wip-rishabh-testing-20240501.193033 2024-05-10T08:28:14.829 INFO:teuthology.packaging:sha1: d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T08:28:14.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-63896-from-wip-rishabh-testing-20240501.193033 2024-05-10T08:28:14.973 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3449.gd39fa088 2024-05-10T08:28:14.974 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T08:28:14.981 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T08:28:14.981 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T08:28:14.999 INFO:teuthology.task.internal:Saving configuration 2024-05-10T08:28:15.020 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T08:28:15.026 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T08:28:15.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 08:23:17.371320', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOcUkZbUa+MoBbiCA6aOmMuS2Mj9ec8CbVCXdupKx+eM9fZNi1YLCK64kADA9N0O2nlR3HHbre6XsapUnxYRsI='} 2024-05-10T08:28:15.072 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 08:23:17.373214', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOe8oDvRwfdClHI9t/UpsXBfVBtq0rv0KO2+FENtP18U1VHd5hUbv5MwBhflZ2e/Scep5l5aXTlqvpjegSCarBc='} 2024-05-10T08:28:15.073 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T08:28:15.079 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-10T08:28:15.079 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-10T08:28:15.079 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T08:28:15.237 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c2e1f9f70>, signals=[15]) 2024-05-10T08:28:15.238 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T08:28:15.244 INFO:teuthology.task.internal:Opening connections... 2024-05-10T08:28:15.245 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:28:15.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:28:15.325 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:28:15.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:28:15.401 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T08:28:15.415 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-05-10T08:28:15.434 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-05-10T08:28:15.435 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-05-10T08:28:15.492 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T08:28:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T08:28:15.494 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-05-10T08:28:15.518 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-05-10T08:28:15.536 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-05-10T08:28:15.536 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-05-10T08:28:15.594 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T08:28:15.595 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-05-10T08:28:15.595 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T08:28:15.595 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T08:28:15.595 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T08:28:15.595 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-05-10T08:28:15.618 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T08:28:15.629 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T08:28:15.634 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T08:28:15.635 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-05-10T08:28:15.637 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-05-10T08:28:15.654 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T08:28:15.662 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T08:28:15.662 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-05-10T08:28:15.697 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-05-10T08:28:15.778 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T08:28:15.831 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T08:28:15.888 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-05-10T08:28:15.888 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-10T08:28:15.888 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-10T08:28:15.889 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T08:28:15.889 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T08:28:15.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:28:15.906 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-10T08:28:15.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:28:15.907 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-05-10T08:28:15.962 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-437.el9.x86_64 2024-05-10T08:28:15.963 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-437.el9.x86_64 2024-05-10T08:28:15.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-05-10T08:28:15.965 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-437.el9.x86_64 2024-05-10T08:28:15.965 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-437.el9.x86_64 2024-05-10T08:28:15.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-05-10T08:28:19.892 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.1 MB 00:02 2024-05-10T08:28:20.237 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.1 MB 00:02 2024-05-10T08:28:22.030 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-05-10T08:28:24.294 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 19 MB 00:03 2024-05-10T08:28:27.606 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-10T08:28:28.694 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.2 MB 00:00 2024-05-10T08:28:30.953 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-05-10T08:28:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 21 MB 00:02 2024-05-10T08:28:38.729 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-05-10T08:28:40.718 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-10T08:28:40.718 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-10T08:28:40.804 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-10T08:28:40.810 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-10T08:28:40.814 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-05-10T08:28:40.814 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-10T08:28:40.814 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-05-10T08:28:40.814 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-10T08:28:40.814 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-05-10T08:28:40.814 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:28:40.815 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 78 M 2024-05-10T08:28:40.816 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 123 M 2024-05-10T08:28:40.816 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-10T08:28:41.238 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.7 MB/s | 484 kB 00:00 2024-05-10T08:28:41.755 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 19 MB/s | 15 MB 00:00 2024-05-10T08:28:42.214 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 27 MB/s | 34 MB 00:01 2024-05-10T08:28:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 18 MB/s | 28 MB 00:01 2024-05-10T08:28:42.823 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-10T08:28:42.823 INFO:teuthology.orchestra.run.smithi082.stdout:Total 39 MB/s | 78 MB 00:02 2024-05-10T08:28:43.511 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-10T08:28:43.852 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-10T08:28:43.853 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-10T08:28:44.800 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-10T08:28:44.800 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-10T08:28:47.192 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-10T08:28:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-10T08:28:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T08:28:50.811 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T08:28:50.933 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T08:28:55.654 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T08:28:55.760 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:29:00.515 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:29:30.074 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:29:30.112 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:29:30.489 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:29:30.489 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-10T08:29:30.489 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T08:29:30.490 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T08:29:31.296 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:29:31.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:29:31.296 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-05-10T08:29:31.296 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-10T08:29:31.297 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-10T08:29:31.297 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-10T08:29:31.297 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-10T08:29:31.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:29:31.297 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-10T08:29:31.613 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T08:29:31.692 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T08:29:31.692 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T08:29:31.692 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-10T08:29:31.692 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T08:29:31.692 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T08:29:31.692 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-10T08:29:31.693 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T08:29:31.693 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T08:29:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T08:29:31.742 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T08:29:31.743 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-05-10T08:29:31.773 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-05-10T08:29:31.773 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-05-10T08:29:31.773 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-05-10T08:29:31.773 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-05-10T08:29:31.773 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-05-10T08:29:31.773 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-10T08:29:31.773 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T08:29:31.774 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T08:29:31.775 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T08:29:31.775 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-05-10T08:29:31.775 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:29:31.775 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T08:29:31.776 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T08:29:31.776 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 5.14.0-444.el9.x86_64 2024-05-10T08:29:31.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T08:29:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-05-10T08:29:33.725 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-10T08:29:33.758 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-05-10T08:29:33.760 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-05-10T08:29:33.790 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.W7eOd6Knmz 2024-05-10T08:29:33.791 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.W7eOd6Knmz 2024-05-10T08:29:33.858 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.W7eOd6Knmz 2024-05-10T08:29:33.989 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.W7eOd6Knmz is 6KB 2024-05-10T08:29:34.038 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.W7eOd6Knmz 2024-05-10T08:29:34.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T08:29:34.114 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-10T08:29:34.115 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-10T08:29:34.115 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-10T08:29:34.115 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-10T08:29:34.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-10T08:29:34.261 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-05-10T08:30:04.264 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-10T08:30:04.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T08:30:04.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:30:10.254 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 165 B/s | 16 kB 01:41 2024-05-10T08:30:11.691 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-10T08:30:16.947 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-05-10T08:30:19.020 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-10T08:30:19.020 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-10T08:30:19.109 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-10T08:30:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-10T08:30:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-10T08:30:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:30:19.121 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-05-10T08:30:19.121 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-05-10T08:30:19.121 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-05-10T08:30:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:30:19.122 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 78 M 2024-05-10T08:30:19.122 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 123 M 2024-05-10T08:30:19.122 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-05-10T08:30:19.282 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 4.1 MB/s | 484 kB 00:00 2024-05-10T08:30:19.740 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 27 MB/s | 15 MB 00:00 2024-05-10T08:30:20.290 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 28 MB/s | 28 MB 00:01 2024-05-10T08:30:20.882 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 20 MB/s | 34 MB 00:01 2024-05-10T08:30:20.883 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-05-10T08:30:20.883 INFO:teuthology.orchestra.run.smithi037.stdout:Total 44 MB/s | 78 MB 00:01 2024-05-10T08:30:21.587 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-05-10T08:30:21.989 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-05-10T08:30:21.992 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-05-10T08:30:22.952 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-05-10T08:30:22.952 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-05-10T08:30:25.502 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-05-10T08:30:26.131 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-10T08:30:26.224 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T08:30:29.066 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T08:30:29.211 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T08:30:34.283 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T08:30:34.323 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:30:39.435 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:31:04.268 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T08:31:10.456 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:31:10.494 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:31:10.828 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:31:10.828 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-10T08:31:10.828 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T08:31:10.828 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T08:31:11.659 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T08:31:11.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:31:11.659 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-05-10T08:31:11.660 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-10T08:31:11.660 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-10T08:31:11.660 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-10T08:31:11.660 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-10T08:31:11.660 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:31:11.660 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-05-10T08:31:12.007 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T08:31:12.084 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T08:31:12.084 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T08:31:12.085 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-10T08:31:12.085 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T08:31:12.085 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T08:31:12.085 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-10T08:31:12.085 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T08:31:12.085 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T08:31:12.136 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T08:31:12.136 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T08:31:12.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 68.el9 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8264254 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-05-10T08:31:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-05-10T08:31:12.173 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:31:12.174 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T08:31:12.174 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T08:31:12.174 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-444.el9.x86_64 2024-05-10T08:31:12.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T08:31:12.765 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-05-10T08:31:13.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T08:31:13.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:31:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-10T08:31:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-05-10T08:31:14.249 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-05-10T08:31:14.266 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.9IU4LOScmq 2024-05-10T08:31:14.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9IU4LOScmq 2024-05-10T08:31:14.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.9IU4LOScmq 2024-05-10T08:31:14.477 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.9IU4LOScmq is 6KB 2024-05-10T08:31:14.525 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.9IU4LOScmq 2024-05-10T08:31:14.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T08:31:14.601 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-10T08:31:14.601 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-10T08:31:14.601 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-10T08:31:14.601 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-10T08:31:14.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-10T08:31:14.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-05-10T08:31:16.611 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-10T08:31:17.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T08:31:17.074 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-444.el9.x86_64"... 2024-05-10T08:31:17.074 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-10T08:31:17.089 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-444.el9.x86_64 2024-05-10T08:31:17.089 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-10T08:31:17.089 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T08:31:17.089 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T08:31:18.090 DEBUG:teuthology.parallel:result is None 2024-05-10T08:31:44.747 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-10T08:31:44.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-10T08:31:44.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:32:03.362 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-05-10T08:32:12.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-10T08:32:12.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:32:30.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-05-10T08:32:42.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-10T08:32:42.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:32:43.402 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-05-10T08:32:43.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-10T08:32:43.778 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-10T08:32:43.778 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-05-10T08:32:43.794 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-444.el9.x86_64 2024-05-10T08:32:43.794 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-10T08:32:43.794 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T08:32:43.794 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T08:32:44.795 DEBUG:teuthology.parallel:result is None 2024-05-10T08:32:44.796 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T08:32:44.804 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T08:32:44.804 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T08:32:44.807 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T08:32:44.828 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T08:32:44.835 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T08:32:44.844 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T08:32:44.844 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T08:32:44.864 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T08:32:44.912 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T08:32:44.918 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T08:32:44.919 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T08:32:44.933 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T08:32:45.044 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T08:32:45.048 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T08:32:45.072 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T08:32:45.093 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T08:32:45.095 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T08:32:45.102 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T08:32:45.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T08:32:45.104 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T08:32:45.134 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T08:32:45.143 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T08:32:45.143 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T08:32:45.174 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T08:32:45.191 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T08:32:45.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T08:32:45.329 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T08:32:45.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T08:32:45.460 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:32:45.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T08:32:45.556 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T08:32:45.606 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T08:32:45.652 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T08:32:45.736 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T08:32:45.779 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:32:45.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T08:32:45.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-05-10T08:32:45.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-05-10T08:32:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T08:32:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T08:32:46.258 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T08:32:46.265 INFO:teuthology.task.internal:Starting timer... 2024-05-10T08:32:46.265 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T08:32:46.275 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T08:32:46.284 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-10T08:32:46.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-05-10T08:32:46.357 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-05-10T08:32:46.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-05-10T08:32:46.404 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-05-10T08:32:46.406 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T08:32:46.406 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-05-10T08:32:46.428 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-05-10T08:32:46.429 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-05-10T08:32:46.473 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-05-10T08:32:46.474 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive'} 2024-05-10T08:32:46.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T08:32:46.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:32:46.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T08:32:46.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:32:46.542 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T08:32:46.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-05-10T08:32:46.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-05-10T08:32:46.616 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T08:32:46.625 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-10T08:32:46.632 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-10T08:32:46.775 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T08:32:46.791 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T08:32:46.792 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T08:36:55.546 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2024-05-10T08:36:55.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-10T08:36:55.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:36:55.630 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-05-10T08:36:55.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-10T08:36:55.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T08:36:55.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T08:36:55.743 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-10T08:36:55.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T08:36:55.826 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T08:36:55.836 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T08:36:55.837 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T08:36:55.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T08:36:55.840 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T08:36:55.840 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T08:36:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T08:36:55.883 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T08:36:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T08:36:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-05-10T08:36:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T08:36:55.921 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-05-10T08:36:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-05-10T08:36:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T08:36:55.944 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-05-10T08:36:55.950 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T08:36:55.958 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T08:36:55.972 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T08:36:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-05-10T08:36:56.012 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T08:36:56.012 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-05-10T08:36:56.013 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.013 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.013 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.013 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.024 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-05-10T08:36:56.028 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T08:36:56.028 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-10T08:36:56.028 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.028 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.029 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.029 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:36:56.029 INFO:teuthology.run_tasks:Running task install... 2024-05-10T08:36:56.039 DEBUG:teuthology.task.install:project ceph 2024-05-10T08:36:56.039 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}} 2024-05-10T08:36:56.039 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'} 2024-05-10T08:36:56.039 INFO:teuthology.task.install:Using flavor: default 2024-05-10T08:36:56.045 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T08:36:56.045 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T08:36:56.045 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'tag': None, 'wait_for_package': False} 2024-05-10T08:36:56.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T08:36:56.048 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'tag': None, 'wait_for_package': False} 2024-05-10T08:36:56.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T08:36:56.267 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/ 2024-05-10T08:36:56.267 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3449.gd39fa088 2024-05-10T08:36:56.271 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/ 2024-05-10T08:36:56.272 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3449.gd39fa088 2024-05-10T08:36:56.377 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T08:36:56.377 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:36:56.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T08:36:56.383 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T08:36:56.384 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:36:56.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T08:36:56.405 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T08:36:56.406 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d39fa08867836ac070c47cb66c782fa559fd480b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T08:36:56.409 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T08:36:56.409 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d39fa08867836ac070c47cb66c782fa559fd480b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T08:36:56.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T08:36:56.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T08:36:56.551 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T08:36:56.552 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T08:36:56.615 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-05-10T08:36:56.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-05-10T08:36:56.618 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-05-10T08:36:56.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-05-10T08:36:56.848 INFO:teuthology.orchestra.run.smithi082.stdout:54 files removed 2024-05-10T08:36:56.861 INFO:teuthology.orchestra.run.smithi037.stdout:54 files removed 2024-05-10T08:36:56.875 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T08:36:56.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T08:36:57.610 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 181 kB/s | 84 kB 00:00 2024-05-10T08:36:57.632 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 185 kB/s | 84 kB 00:00 2024-05-10T08:36:58.016 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-05-10T08:36:58.052 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-05-10T08:36:58.400 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-05-10T08:36:58.419 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-05-10T08:36:58.975 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-10T08:36:59.453 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.1 MB 00:00 2024-05-10T08:37:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 34 MB/s | 19 MB 00:00 2024-05-10T08:37:05.663 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.2 MB 00:00 2024-05-10T08:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-05-10T08:37:08.951 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-05-10T08:37:14.073 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-05-10T08:37:14.426 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-05-10T08:37:16.382 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T08:37:16.383 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T08:37:16.393 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T08:37:16.394 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T08:37:16.395 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T08:37:16.396 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T08:37:16.397 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T08:37:16.400 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T08:37:16.400 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T08:37:16.461 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-10T08:37:16.478 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-10T08:37:16.478 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-05-10T08:37:16.478 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-10T08:37:16.478 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 6.6 k 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 890 k 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 145 k 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 1.5 M 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 142 k 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 3.5 M 2024-05-10T08:37:16.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 7.4 M 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 49 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 11 M 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 49 M 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 273 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 763 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 225 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 27 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 18 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T08:37:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 32 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 746 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 127 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 161 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 321 k 2024-05-10T08:37:16.484 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 298 k 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 99 k 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 85 k 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 170 k 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.4 M 2024-05-10T08:37:16.485 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 21 M 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 34 k 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 2.4 M 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 274 k 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 4.7 M 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 17 M 2024-05-10T08:37:16.486 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 16 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 25 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 163 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T08:37:16.487 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 500 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T08:37:16.488 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 45 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 135 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T08:37:16.489 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T08:37:16.490 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T08:37:16.491 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T08:37:16.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T08:37:16.493 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 8 Packages 2024-05-10T08:37:16.494 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:37:16.495 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 226 M 2024-05-10T08:37:16.495 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-10T08:37:17.241 INFO:teuthology.orchestra.run.smithi082.stdout:(1/156): ceph-19.0.0-3449.gd39fa088.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-05-10T08:37:17.750 INFO:teuthology.orchestra.run.smithi082.stdout:(2/156): ceph-fuse-19.0.0-3449.gd39fa088.el9.x8 1.7 MB/s | 890 kB 00:00 2024-05-10T08:37:17.850 INFO:teuthology.orchestra.run.smithi082.stdout:(3/156): ceph-immutable-object-cache-19.0.0-344 1.4 MB/s | 145 kB 00:00 2024-05-10T08:37:18.508 INFO:teuthology.orchestra.run.smithi082.stdout:(4/156): ceph-mds-19.0.0-3449.gd39fa088.el9.x86 3.6 MB/s | 2.4 MB 00:00 2024-05-10T08:37:18.760 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.2 MB 00:00 2024-05-10T08:37:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:(5/156): ceph-common-19.0.0-3449.gd39fa088.el9. 11 MB/s | 21 MB 00:01 2024-05-10T08:37:19.017 INFO:teuthology.orchestra.run.smithi082.stdout:(6/156): ceph-base-19.0.0-3449.gd39fa088.el9.x8 2.7 MB/s | 5.4 MB 00:01 2024-05-10T08:37:19.059 INFO:teuthology.orchestra.run.smithi082.stdout:(7/156): ceph-mgr-19.0.0-3449.gd39fa088.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-05-10T08:37:19.234 INFO:teuthology.orchestra.run.smithi082.stdout:(8/156): ceph-mon-19.0.0-3449.gd39fa088.el9.x86 16 MB/s | 4.7 MB 00:00 2024-05-10T08:37:19.268 INFO:teuthology.orchestra.run.smithi082.stdout:(9/156): ceph-selinux-19.0.0-3449.gd39fa088.el9 756 kB/s | 25 kB 00:00 2024-05-10T08:37:21.201 INFO:teuthology.orchestra.run.smithi082.stdout:(10/156): ceph-radosgw-19.0.0-3449.gd39fa088.el 4.9 MB/s | 11 MB 00:02 2024-05-10T08:37:21.294 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-05-10T08:37:21.304 INFO:teuthology.orchestra.run.smithi082.stdout:(11/156): cephfs-mirror-19.0.0-3449.gd39fa088.e 2.1 MB/s | 225 kB 00:00 2024-05-10T08:37:21.402 INFO:teuthology.orchestra.run.smithi082.stdout:(12/156): cephfs-shell-19.0.0-3449.gd39fa088.el 279 kB/s | 27 kB 00:00 2024-05-10T08:37:21.494 INFO:teuthology.orchestra.run.smithi082.stdout:(13/156): libcephfs-devel-19.0.0-3449.gd39fa088 346 kB/s | 32 kB 00:00 2024-05-10T08:37:22.011 INFO:teuthology.orchestra.run.smithi082.stdout:(14/156): ceph-test-19.0.0-3449.gd39fa088.el9.x 18 MB/s | 49 MB 00:02 2024-05-10T08:37:22.053 INFO:teuthology.orchestra.run.smithi082.stdout:(15/156): libcephfs2-19.0.0-3449.gd39fa088.el9. 1.3 MB/s | 746 kB 00:00 2024-05-10T08:37:22.078 INFO:teuthology.orchestra.run.smithi082.stdout:(16/156): libcephsqlite-19.0.0-3449.gd39fa088.e 2.4 MB/s | 163 kB 00:00 2024-05-10T08:37:22.120 INFO:teuthology.orchestra.run.smithi082.stdout:(17/156): librados-devel-19.0.0-3449.gd39fa088. 1.9 MB/s | 127 kB 00:00 2024-05-10T08:37:22.145 INFO:teuthology.orchestra.run.smithi082.stdout:(18/156): libradosstriper1-19.0.0-3449.gd39fa08 7.3 MB/s | 500 kB 00:00 2024-05-10T08:37:22.195 INFO:teuthology.orchestra.run.smithi082.stdout:(19/156): python3-ceph-argparse-19.0.0-3449.gd3 902 kB/s | 45 kB 00:00 2024-05-10T08:37:22.245 INFO:teuthology.orchestra.run.smithi082.stdout:(20/156): python3-ceph-common-19.0.0-3449.gd39f 2.7 MB/s | 135 kB 00:00 2024-05-10T08:37:22.313 INFO:teuthology.orchestra.run.smithi082.stdout:(21/156): python3-cephfs-19.0.0-3449.gd39fa088. 2.4 MB/s | 161 kB 00:00 2024-05-10T08:37:22.371 INFO:teuthology.orchestra.run.smithi082.stdout:(22/156): python3-rados-19.0.0-3449.gd39fa088.e 5.4 MB/s | 321 kB 00:00 2024-05-10T08:37:22.438 INFO:teuthology.orchestra.run.smithi082.stdout:(23/156): python3-rbd-19.0.0-3449.gd39fa088.el9 4.4 MB/s | 298 kB 00:00 2024-05-10T08:37:22.489 INFO:teuthology.orchestra.run.smithi082.stdout:(24/156): python3-rgw-19.0.0-3449.gd39fa088.el9 1.9 MB/s | 99 kB 00:00 2024-05-10T08:37:22.547 INFO:teuthology.orchestra.run.smithi082.stdout:(25/156): rbd-fuse-19.0.0-3449.gd39fa088.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-10T08:37:22.781 INFO:teuthology.orchestra.run.smithi082.stdout:(26/156): rbd-mirror-19.0.0-3449.gd39fa088.el9. 13 MB/s | 3.1 MB 00:00 2024-05-10T08:37:22.839 INFO:teuthology.orchestra.run.smithi082.stdout:(27/156): rbd-nbd-19.0.0-3449.gd39fa088.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-10T08:37:22.890 INFO:teuthology.orchestra.run.smithi082.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3449.g 686 kB/s | 34 kB 00:00 2024-05-10T08:37:22.965 INFO:teuthology.orchestra.run.smithi082.stdout:(29/156): librgw2-19.0.0-3449.gd39fa088.el9.x86 6.4 MB/s | 5.4 MB 00:00 2024-05-10T08:37:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3449.gd39fa08 1.4 MB/s | 142 kB 00:00 2024-05-10T08:37:23.458 INFO:teuthology.orchestra.run.smithi082.stdout:(31/156): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-05-10T08:37:23.625 INFO:teuthology.orchestra.run.smithi082.stdout:(32/156): ceph-osd-19.0.0-3449.gd39fa088.el9.x8 3.7 MB/s | 17 MB 00:04 2024-05-10T08:37:23.650 INFO:teuthology.orchestra.run.smithi082.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3449.gd3 1.4 MB/s | 274 kB 00:00 2024-05-10T08:37:23.708 INFO:teuthology.orchestra.run.smithi082.stdout:(34/156): ceph-mgr-dashboard-19.0.0-3449.gd39fa 4.8 MB/s | 3.5 MB 00:00 2024-05-10T08:37:23.725 INFO:teuthology.orchestra.run.smithi082.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3449.gd 218 kB/s | 16 kB 00:00 2024-05-10T08:37:23.742 INFO:teuthology.orchestra.run.smithi082.stdout:(36/156): ceph-mgr-rook-19.0.0-3449.gd39fa088.e 421 kB/s | 49 kB 00:00 2024-05-10T08:37:23.776 INFO:teuthology.orchestra.run.smithi082.stdout:(37/156): ceph-volume-19.0.0-3449.gd39fa088.el9 4.0 MB/s | 273 kB 00:00 2024-05-10T08:37:23.792 INFO:teuthology.orchestra.run.smithi082.stdout:(38/156): cephfs-top-19.0.0-3449.gd39fa088.el9. 363 kB/s | 18 kB 00:00 2024-05-10T08:37:23.818 INFO:teuthology.orchestra.run.smithi082.stdout:(39/156): cephadm-19.0.0-3449.gd39fa088.el9.noa 8.1 MB/s | 763 kB 00:00 2024-05-10T08:37:23.985 INFO:teuthology.orchestra.run.smithi082.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 384 kB/s | 80 kB 00:00 2024-05-10T08:37:24.110 INFO:teuthology.orchestra.run.smithi082.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 670 kB/s | 195 kB 00:00 2024-05-10T08:37:24.135 INFO:teuthology.orchestra.run.smithi082.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-05-10T08:37:24.169 INFO:teuthology.orchestra.run.smithi082.stdout:(43/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-05-10T08:37:24.203 INFO:teuthology.orchestra.run.smithi082.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-10T08:37:24.253 INFO:teuthology.orchestra.run.smithi082.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-10T08:37:24.312 INFO:teuthology.orchestra.run.smithi082.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-05-10T08:37:24.337 INFO:teuthology.orchestra.run.smithi082.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 933 kB/s | 125 kB 00:00 2024-05-10T08:37:24.362 INFO:teuthology.orchestra.run.smithi082.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-10T08:37:24.496 INFO:teuthology.orchestra.run.smithi082.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 802 kB/s | 107 kB 00:00 2024-05-10T08:37:24.538 INFO:teuthology.orchestra.run.smithi082.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 517 kB/s | 21 kB 00:00 2024-05-10T08:37:24.563 INFO:teuthology.orchestra.run.smithi082.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-05-10T08:37:24.597 INFO:teuthology.orchestra.run.smithi082.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-05-10T08:37:24.638 INFO:teuthology.orchestra.run.smithi082.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-05-10T08:37:24.672 INFO:teuthology.orchestra.run.smithi082.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-05-10T08:37:24.689 INFO:teuthology.orchestra.run.smithi082.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-05-10T08:37:24.714 INFO:teuthology.orchestra.run.smithi082.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-05-10T08:37:24.781 INFO:teuthology.orchestra.run.smithi082.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-05-10T08:37:24.798 INFO:teuthology.orchestra.run.smithi082.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-05-10T08:37:24.832 INFO:teuthology.orchestra.run.smithi082.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-05-10T08:37:24.866 INFO:teuthology.orchestra.run.smithi082.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-05-10T08:37:24.882 INFO:teuthology.orchestra.run.smithi082.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-05-10T08:37:24.908 INFO:teuthology.orchestra.run.smithi082.stdout:(62/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 733 kB/s | 160 kB 00:00 2024-05-10T08:37:24.925 INFO:teuthology.orchestra.run.smithi082.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-05-10T08:37:24.958 INFO:teuthology.orchestra.run.smithi082.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-05-10T08:37:24.975 INFO:teuthology.orchestra.run.smithi082.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-05-10T08:37:25.001 INFO:teuthology.orchestra.run.smithi082.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-10T08:37:25.118 INFO:teuthology.orchestra.run.smithi082.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-05-10T08:37:25.160 INFO:teuthology.orchestra.run.smithi082.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-10T08:37:25.193 INFO:teuthology.orchestra.run.smithi082.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-05-10T08:37:25.218 INFO:teuthology.orchestra.run.smithi082.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-10T08:37:25.310 INFO:teuthology.orchestra.run.smithi082.stdout:(71/156): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-05-10T08:37:25.344 INFO:teuthology.orchestra.run.smithi082.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-05-10T08:37:25.369 INFO:teuthology.orchestra.run.smithi082.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-10T08:37:25.453 INFO:teuthology.orchestra.run.smithi082.stdout:(74/156): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-05-10T08:37:25.478 INFO:teuthology.orchestra.run.smithi082.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-10T08:37:25.503 INFO:teuthology.orchestra.run.smithi082.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-05-10T08:37:25.529 INFO:teuthology.orchestra.run.smithi082.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-05-10T08:37:25.554 INFO:teuthology.orchestra.run.smithi082.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-05-10T08:37:25.579 INFO:teuthology.orchestra.run.smithi082.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-10T08:37:25.604 INFO:teuthology.orchestra.run.smithi082.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-05-10T08:37:25.697 INFO:teuthology.orchestra.run.smithi082.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-10T08:37:25.722 INFO:teuthology.orchestra.run.smithi082.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-05-10T08:37:25.797 INFO:teuthology.orchestra.run.smithi082.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-05-10T08:37:25.814 INFO:teuthology.orchestra.run.smithi082.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-05-10T08:37:25.839 INFO:teuthology.orchestra.run.smithi082.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-05-10T08:37:25.865 INFO:teuthology.orchestra.run.smithi082.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 541 kB/s | 77 kB 00:00 2024-05-10T08:37:25.890 INFO:teuthology.orchestra.run.smithi082.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-10T08:37:25.932 INFO:teuthology.orchestra.run.smithi082.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-05-10T08:37:25.949 INFO:teuthology.orchestra.run.smithi082.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-05-10T08:37:25.974 INFO:teuthology.orchestra.run.smithi082.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-05-10T08:37:26.017 INFO:teuthology.orchestra.run.smithi082.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-05-10T08:37:26.066 INFO:teuthology.orchestra.run.smithi082.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-05-10T08:37:26.117 INFO:teuthology.orchestra.run.smithi082.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-10T08:37:26.167 INFO:teuthology.orchestra.run.smithi082.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-05-10T08:37:26.201 INFO:teuthology.orchestra.run.smithi082.stdout:(95/156): python3-pyasn1-modules-0.4.8-6.el9.no 831 kB/s | 279 kB 00:00 2024-05-10T08:37:26.226 INFO:teuthology.orchestra.run.smithi082.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-05-10T08:37:26.251 INFO:teuthology.orchestra.run.smithi082.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-05-10T08:37:26.277 INFO:teuthology.orchestra.run.smithi082.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-10T08:37:26.444 INFO:teuthology.orchestra.run.smithi082.stdout:(99/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-05-10T08:37:26.460 INFO:teuthology.orchestra.run.smithi082.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 347 kB/s | 64 kB 00:00 2024-05-10T08:37:26.477 INFO:teuthology.orchestra.run.smithi082.stdout:(101/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 415 kB/s | 94 kB 00:00 2024-05-10T08:37:26.494 INFO:teuthology.orchestra.run.smithi082.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-05-10T08:37:26.545 INFO:teuthology.orchestra.run.smithi082.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-05-10T08:37:26.645 INFO:teuthology.orchestra.run.smithi082.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-05-10T08:37:26.787 INFO:teuthology.orchestra.run.smithi082.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 137 kB/s | 19 kB 00:00 2024-05-10T08:37:26.862 INFO:teuthology.orchestra.run.smithi082.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-05-10T08:37:26.887 INFO:teuthology.orchestra.run.smithi082.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 902 kB/s | 309 kB 00:00 2024-05-10T08:37:26.938 INFO:teuthology.orchestra.run.smithi082.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-05-10T08:37:26.963 INFO:teuthology.orchestra.run.smithi082.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-05-10T08:37:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-10T08:37:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-10T08:37:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-05-10T08:37:27.155 INFO:teuthology.orchestra.run.smithi082.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-05-10T08:37:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 743 kB/s | 43 kB 00:00 2024-05-10T08:37:27.215 INFO:teuthology.orchestra.run.smithi082.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-05-10T08:37:27.282 INFO:teuthology.orchestra.run.smithi082.stdout:(116/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-05-10T08:37:27.309 INFO:teuthology.orchestra.run.smithi082.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 127 kB/s | 15 kB 00:00 2024-05-10T08:37:27.332 INFO:teuthology.orchestra.run.smithi082.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-05-10T08:37:27.358 INFO:teuthology.orchestra.run.smithi082.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-05-10T08:37:27.383 INFO:teuthology.orchestra.run.smithi082.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-10T08:37:27.408 INFO:teuthology.orchestra.run.smithi082.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 467 kB/s | 35 kB 00:00 2024-05-10T08:37:27.433 INFO:teuthology.orchestra.run.smithi082.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-10T08:37:27.484 INFO:teuthology.orchestra.run.smithi082.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-05-10T08:37:27.509 INFO:teuthology.orchestra.run.smithi082.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-05-10T08:37:27.534 INFO:teuthology.orchestra.run.smithi082.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-05-10T08:37:27.559 INFO:teuthology.orchestra.run.smithi082.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-05-10T08:37:27.585 INFO:teuthology.orchestra.run.smithi082.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-05-10T08:37:27.610 INFO:teuthology.orchestra.run.smithi082.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-05-10T08:37:27.635 INFO:teuthology.orchestra.run.smithi082.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-05-10T08:37:27.669 INFO:teuthology.orchestra.run.smithi082.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-05-10T08:37:27.694 INFO:teuthology.orchestra.run.smithi082.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 553 kB/s | 46 kB 00:00 2024-05-10T08:37:27.721 INFO:teuthology.orchestra.run.smithi082.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 940 kB/s | 79 kB 00:00 2024-05-10T08:37:27.745 INFO:teuthology.orchestra.run.smithi082.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-05-10T08:37:27.770 INFO:teuthology.orchestra.run.smithi082.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-10T08:37:27.795 INFO:teuthology.orchestra.run.smithi082.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-05-10T08:37:27.820 INFO:teuthology.orchestra.run.smithi082.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-10T08:37:27.846 INFO:teuthology.orchestra.run.smithi082.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-05-10T08:37:27.871 INFO:teuthology.orchestra.run.smithi082.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-05-10T08:37:27.913 INFO:teuthology.orchestra.run.smithi082.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-05-10T08:37:27.930 INFO:teuthology.orchestra.run.smithi082.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 614 kB/s | 36 kB 00:00 2024-05-10T08:37:27.947 INFO:teuthology.orchestra.run.smithi082.stdout:(141/156): python3-rsa-4.9-2.el9.noarch.rpm 586 kB/s | 59 kB 00:00 2024-05-10T08:37:27.964 INFO:teuthology.orchestra.run.smithi082.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-10T08:37:27.997 INFO:teuthology.orchestra.run.smithi082.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-05-10T08:37:28.023 INFO:teuthology.orchestra.run.smithi082.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-10T08:37:28.048 INFO:teuthology.orchestra.run.smithi082.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-10T08:37:28.074 INFO:teuthology.orchestra.run.smithi082.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 263 kB/s | 20 kB 00:00 2024-05-10T08:37:28.099 INFO:teuthology.orchestra.run.smithi082.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-10T08:37:28.162 INFO:teuthology.orchestra.run.smithi082.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-05-10T08:37:28.533 INFO:teuthology.orchestra.run.smithi082.stdout:(149/156): librados2-19.0.0-3449.gd39fa088.el9. 7.4 MB/s | 3.4 MB 00:00 2024-05-10T08:37:28.666 INFO:teuthology.orchestra.run.smithi082.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 4.8 MB/s | 2.3 MB 00:00 2024-05-10T08:37:28.758 INFO:teuthology.orchestra.run.smithi082.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 456 kB/s | 42 kB 00:00 2024-05-10T08:37:28.858 INFO:teuthology.orchestra.run.smithi082.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.4 MB/s | 248 kB 00:00 2024-05-10T08:37:28.950 INFO:teuthology.orchestra.run.smithi082.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 4.4 MB/s | 1.8 MB 00:00 2024-05-10T08:37:28.992 INFO:teuthology.orchestra.run.smithi082.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 10 MB/s | 1.3 MB 00:00 2024-05-10T08:37:29.092 INFO:teuthology.orchestra.run.smithi082.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-05-10T08:37:31.009 INFO:teuthology.orchestra.run.smithi082.stdout:(156/156): librbd1-19.0.0-3449.gd39fa088.el9.x8 1.1 MB/s | 3.1 MB 00:02 2024-05-10T08:37:31.012 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-10T08:37:31.012 INFO:teuthology.orchestra.run.smithi082.stdout:Total 16 MB/s | 226 MB 00:14 2024-05-10T08:37:32.229 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-10T08:37:32.380 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-10T08:37:32.380 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-10T08:37:34.616 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-10T08:37:34.617 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-10T08:37:41.004 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-10T08:37:41.088 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T08:37:41.129 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T08:37:41.188 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T08:37:41.221 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T08:37:41.247 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T08:37:41.297 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T08:37:41.480 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:20 2024-05-10T08:37:41.627 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T08:37:41.731 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T08:37:41.853 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T08:37:41.882 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T08:37:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T08:37:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T08:37:42.173 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T08:37:42.248 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T08:37:42.278 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T08:37:42.374 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T08:37:42.396 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T08:37:42.470 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T08:37:42.497 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T08:37:42.517 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T08:37:42.658 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T08:37:42.842 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T08:37:42.969 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T08:37:43.022 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T08:37:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T08:37:43.239 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T08:37:43.456 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T08:37:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T08:37:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T08:37:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-10T08:37:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-10T08:37:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-10T08:37:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-10T08:37:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-10T08:37:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-10T08:37:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-10T08:37:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-10T08:37:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-10T08:37:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-10T08:37:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-10T08:37:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-10T08:37:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 33/164 2024-05-10T08:37:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T08:37:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 35/164 2024-05-10T08:37:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-10T08:37:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-10T08:37:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-10T08:37:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-10T08:37:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-10T08:37:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-10T08:37:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-10T08:37:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-10T08:37:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-10T08:37:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 45/164 2024-05-10T08:37:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-10T08:37:45.656 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-10T08:37:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-10T08:37:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-10T08:37:45.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T08:37:45.889 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T08:37:45.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T08:37:45.972 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T08:37:46.007 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T08:37:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T08:37:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T08:37:46.245 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T08:37:46.290 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T08:37:46.321 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T08:37:46.362 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T08:37:46.695 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T08:37:46.738 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T08:37:46.779 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T08:37:46.811 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T08:37:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-10T08:37:46.835 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T08:37:46.940 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T08:37:47.062 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T08:37:47.101 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T08:37:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T08:37:47.164 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T08:37:47.202 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T08:37:47.234 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T08:37:47.264 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T08:37:47.298 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T08:37:47.332 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T08:37:47.365 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T08:37:47.407 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T08:37:47.494 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T08:37:47.586 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T08:37:47.628 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T08:37:47.675 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T08:37:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T08:37:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T08:37:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T08:37:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T08:37:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T08:37:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T08:37:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T08:37:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T08:37:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T08:37:49.082 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T08:37:49.110 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T08:37:49.188 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T08:37:49.272 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T08:37:49.272 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T08:37:49.284 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T08:37:49.285 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T08:37:49.285 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T08:37:49.286 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T08:37:49.288 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T08:37:49.290 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T08:37:49.291 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T08:37:49.357 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 6.6 k 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 890 k 2024-05-10T08:37:49.374 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 145 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 1.5 M 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 142 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 3.5 M 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 7.4 M 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 49 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 11 M 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 49 M 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 273 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 763 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 225 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 27 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 18 k 2024-05-10T08:37:49.375 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 32 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 746 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 127 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 161 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 321 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 298 k 2024-05-10T08:37:49.376 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 99 k 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 85 k 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 170 k 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.4 M 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T08:37:49.377 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 21 M 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 34 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 2.4 M 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 274 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 4.7 M 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 17 M 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 16 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 25 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T08:37:49.378 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 163 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 500 k 2024-05-10T08:37:49.379 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T08:37:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 45 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 135 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T08:37:49.381 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T08:37:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T08:37:49.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T08:37:49.384 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T08:37:49.385 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 8 Packages 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:37:49.386 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 226 M 2024-05-10T08:37:49.387 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-05-10T08:37:49.846 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T08:37:49.958 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T08:37:50.054 INFO:teuthology.orchestra.run.smithi037.stdout:(1/156): ceph-19.0.0-3449.gd39fa088.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-05-10T08:37:50.746 INFO:teuthology.orchestra.run.smithi037.stdout:(2/156): ceph-fuse-19.0.0-3449.gd39fa088.el9.x8 1.3 MB/s | 890 kB 00:00 2024-05-10T08:37:50.913 INFO:teuthology.orchestra.run.smithi037.stdout:(3/156): ceph-immutable-object-cache-19.0.0-344 870 kB/s | 145 kB 00:00 2024-05-10T08:37:51.208 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T08:37:51.296 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T08:37:51.324 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T08:37:51.357 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T08:37:51.671 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T08:37:51.713 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T08:37:51.803 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T08:37:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 102/164 2024-05-10T08:37:51.870 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T08:37:51.997 INFO:teuthology.orchestra.run.smithi037.stdout:(4/156): ceph-mds-19.0.0-3449.gd39fa088.el9.x86 2.2 MB/s | 2.4 MB 00:01 2024-05-10T08:37:52.338 INFO:teuthology.orchestra.run.smithi037.stdout:(5/156): ceph-base-19.0.0-3449.gd39fa088.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-05-10T08:37:52.351 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T08:37:52.382 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T08:37:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T08:37:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 106/164 2024-05-10T08:37:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:(6/156): ceph-mgr-19.0.0-3449.gd39fa088.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-05-10T08:37:53.731 INFO:teuthology.orchestra.run.smithi037.stdout:(7/156): ceph-mon-19.0.0-3449.gd39fa088.el9.x86 3.4 MB/s | 4.7 MB 00:01 2024-05-10T08:37:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T08:37:54.855 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T08:37:55.402 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T08:37:55.441 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T08:37:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T08:37:55.534 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T08:37:55.534 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T08:37:55.534 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:37:55.567 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T08:37:56.289 INFO:teuthology.orchestra.run.smithi037.stdout:(8/156): ceph-radosgw-19.0.0-3449.gd39fa088.el9 4.1 MB/s | 11 MB 00:02 2024-05-10T08:37:56.389 INFO:teuthology.orchestra.run.smithi037.stdout:(9/156): ceph-selinux-19.0.0-3449.gd39fa088.el9 252 kB/s | 25 kB 00:00 2024-05-10T08:37:56.590 INFO:teuthology.orchestra.run.smithi037.stdout:(10/156): ceph-common-19.0.0-3449.gd39fa088.el9 3.1 MB/s | 21 MB 00:06 2024-05-10T08:37:56.674 INFO:teuthology.orchestra.run.smithi037.stdout:(11/156): cephfs-mirror-19.0.0-3449.gd39fa088.e 2.6 MB/s | 225 kB 00:00 2024-05-10T08:37:56.741 INFO:teuthology.orchestra.run.smithi037.stdout:(12/156): cephfs-shell-19.0.0-3449.gd39fa088.el 405 kB/s | 27 kB 00:00 2024-05-10T08:37:56.808 INFO:teuthology.orchestra.run.smithi037.stdout:(13/156): libcephfs-devel-19.0.0-3449.gd39fa088 477 kB/s | 32 kB 00:00 2024-05-10T08:37:56.999 INFO:teuthology.orchestra.run.smithi037.stdout:(14/156): libcephfs2-19.0.0-3449.gd39fa088.el9. 3.8 MB/s | 746 kB 00:00 2024-05-10T08:37:57.100 INFO:teuthology.orchestra.run.smithi037.stdout:(15/156): libcephsqlite-19.0.0-3449.gd39fa088.e 1.6 MB/s | 163 kB 00:00 2024-05-10T08:37:57.200 INFO:teuthology.orchestra.run.smithi037.stdout:(16/156): librados-devel-19.0.0-3449.gd39fa088. 1.2 MB/s | 127 kB 00:00 2024-05-10T08:37:57.342 INFO:teuthology.orchestra.run.smithi037.stdout:(17/156): libradosstriper1-19.0.0-3449.gd39fa08 3.4 MB/s | 500 kB 00:00 2024-05-10T08:37:58.134 INFO:teuthology.orchestra.run.smithi037.stdout:(18/156): ceph-osd-19.0.0-3449.gd39fa088.el9.x8 3.3 MB/s | 17 MB 00:05 2024-05-10T08:37:58.209 INFO:teuthology.orchestra.run.smithi037.stdout:(19/156): python3-ceph-argparse-19.0.0-3449.gd3 603 kB/s | 45 kB 00:00 2024-05-10T08:37:58.276 INFO:teuthology.orchestra.run.smithi037.stdout:(20/156): python3-ceph-common-19.0.0-3449.gd39f 2.0 MB/s | 135 kB 00:00 2024-05-10T08:37:58.360 INFO:teuthology.orchestra.run.smithi037.stdout:(21/156): librgw2-19.0.0-3449.gd39fa088.el9.x86 5.3 MB/s | 5.4 MB 00:01 2024-05-10T08:37:58.385 INFO:teuthology.orchestra.run.smithi037.stdout:(22/156): python3-cephfs-19.0.0-3449.gd39fa088. 1.5 MB/s | 161 kB 00:00 2024-05-10T08:37:58.462 INFO:teuthology.orchestra.run.smithi037.stdout:(23/156): python3-rados-19.0.0-3449.gd39fa088.e 3.1 MB/s | 321 kB 00:00 2024-05-10T08:37:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:(24/156): python3-rbd-19.0.0-3449.gd39fa088.el9 2.3 MB/s | 298 kB 00:00 2024-05-10T08:37:58.536 INFO:teuthology.orchestra.run.smithi037.stdout:(25/156): python3-rgw-19.0.0-3449.gd39fa088.el9 1.3 MB/s | 99 kB 00:00 2024-05-10T08:37:58.578 INFO:teuthology.orchestra.run.smithi037.stdout:(26/156): rbd-fuse-19.0.0-3449.gd39fa088.el9.x8 1.2 MB/s | 85 kB 00:00 2024-05-10T08:37:58.653 INFO:teuthology.orchestra.run.smithi037.stdout:(27/156): rbd-nbd-19.0.0-3449.gd39fa088.el9.x86 2.2 MB/s | 170 kB 00:00 2024-05-10T08:37:58.729 INFO:teuthology.orchestra.run.smithi037.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3449.g 454 kB/s | 34 kB 00:00 2024-05-10T08:37:58.796 INFO:teuthology.orchestra.run.smithi037.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3449.gd39fa08 2.1 MB/s | 142 kB 00:00 2024-05-10T08:37:59.137 INFO:teuthology.orchestra.run.smithi037.stdout:(30/156): rbd-mirror-19.0.0-3449.gd39fa088.el9. 5.1 MB/s | 3.1 MB 00:00 2024-05-10T08:37:59.813 INFO:teuthology.orchestra.run.smithi037.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3449.gd39fa 3.5 MB/s | 3.5 MB 00:01 2024-05-10T08:37:59.930 INFO:teuthology.orchestra.run.smithi037.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3449.gd3 2.3 MB/s | 274 kB 00:00 2024-05-10T08:38:00.005 INFO:teuthology.orchestra.run.smithi037.stdout:(33/156): ceph-mgr-rook-19.0.0-3449.gd39fa088.e 657 kB/s | 49 kB 00:00 2024-05-10T08:38:00.089 INFO:teuthology.orchestra.run.smithi037.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3449.gd 198 kB/s | 16 kB 00:00 2024-05-10T08:38:00.247 INFO:teuthology.orchestra.run.smithi037.stdout:(35/156): ceph-volume-19.0.0-3449.gd39fa088.el9 1.7 MB/s | 273 kB 00:00 2024-05-10T08:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:(36/156): cephadm-19.0.0-3449.gd39fa088.el9.noa 2.1 MB/s | 763 kB 00:00 2024-05-10T08:38:00.865 INFO:teuthology.orchestra.run.smithi037.stdout:(37/156): ceph-mgr-diskprediction-local-19.0.0- 4.3 MB/s | 7.4 MB 00:01 2024-05-10T08:38:00.890 INFO:teuthology.orchestra.run.smithi037.stdout:(38/156): cephfs-top-19.0.0-3449.gd39fa088.el9. 64 kB/s | 18 kB 00:00 2024-05-10T08:38:01.040 INFO:teuthology.orchestra.run.smithi037.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 460 kB/s | 80 kB 00:00 2024-05-10T08:38:01.132 INFO:teuthology.orchestra.run.smithi037.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-10T08:38:01.174 INFO:teuthology.orchestra.run.smithi037.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-05-10T08:38:01.216 INFO:teuthology.orchestra.run.smithi037.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-10T08:38:01.275 INFO:teuthology.orchestra.run.smithi037.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-10T08:38:01.325 INFO:teuthology.orchestra.run.smithi037.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-05-10T08:38:01.350 INFO:teuthology.orchestra.run.smithi037.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-05-10T08:38:01.384 INFO:teuthology.orchestra.run.smithi037.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-10T08:38:01.417 INFO:teuthology.orchestra.run.smithi037.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-05-10T08:38:02.151 INFO:teuthology.orchestra.run.smithi037.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 898 kB/s | 689 kB 00:00 2024-05-10T08:38:02.285 INFO:teuthology.orchestra.run.smithi037.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 804 kB/s | 107 kB 00:00 2024-05-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi037.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 983 kB/s | 943 kB 00:00 2024-05-10T08:38:02.410 INFO:teuthology.orchestra.run.smithi037.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 171 kB/s | 21 kB 00:00 2024-05-10T08:38:02.519 INFO:teuthology.orchestra.run.smithi037.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-05-10T08:38:02.544 INFO:teuthology.orchestra.run.smithi037.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-05-10T08:38:02.669 INFO:teuthology.orchestra.run.smithi037.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 146 kB/s | 18 kB 00:00 2024-05-10T08:38:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-05-10T08:38:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-05-10T08:38:02.979 INFO:teuthology.orchestra.run.smithi037.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.5 MB/s | 3.0 MB 00:00 2024-05-10T08:38:03.037 INFO:teuthology.orchestra.run.smithi037.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-05-10T08:38:03.088 INFO:teuthology.orchestra.run.smithi037.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-10T08:38:03.188 INFO:teuthology.orchestra.run.smithi037.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-05-10T08:38:03.230 INFO:teuthology.orchestra.run.smithi037.stdout:(61/156): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-05-10T08:38:03.289 INFO:teuthology.orchestra.run.smithi037.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-05-10T08:38:03.339 INFO:teuthology.orchestra.run.smithi037.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-10T08:38:03.414 INFO:teuthology.orchestra.run.smithi037.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-10T08:38:03.448 INFO:teuthology.orchestra.run.smithi037.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 324 kB/s | 35 kB 00:00 2024-05-10T08:38:04.265 INFO:teuthology.orchestra.run.smithi037.stdout:(66/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-05-10T08:38:05.498 INFO:teuthology.orchestra.run.smithi037.stdout:(67/156): ceph-test-19.0.0-3449.gd39fa088.el9.x 5.4 MB/s | 49 MB 00:09 2024-05-10T08:38:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 1.1 MB/s | 911 kB 00:00 2024-05-10T08:38:06.449 INFO:teuthology.orchestra.run.smithi037.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-10T08:38:06.508 INFO:teuthology.orchestra.run.smithi037.stdout:(70/156): postgresql-13.14-1.el9.x86_64.rpm 725 kB/s | 1.6 MB 00:02 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-05-10T08:38:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:07.675 INFO:teuthology.orchestra.run.smithi037.stdout:(71/156): openblas-openmp-0.3.21-2.el9.x86_64.r 1.1 MB/s | 4.7 MB 00:04 2024-05-10T08:38:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T08:38:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T08:38:07.824 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:07.824 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T08:38:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:07.833 INFO:teuthology.orchestra.run.smithi037.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.2 MB/s | 5.8 MB 00:01 2024-05-10T08:38:07.900 INFO:teuthology.orchestra.run.smithi037.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 389 kB/s | 87 kB 00:00 2024-05-10T08:38:08.092 INFO:teuthology.orchestra.run.smithi037.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 652 kB/s | 1.0 MB 00:01 2024-05-10T08:38:08.242 INFO:teuthology.orchestra.run.smithi037.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 714 kB/s | 244 kB 00:00 2024-05-10T08:38:08.342 INFO:teuthology.orchestra.run.smithi037.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-05-10T08:38:08.443 INFO:teuthology.orchestra.run.smithi037.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-05-10T08:38:08.476 INFO:teuthology.orchestra.run.smithi037.stdout:(78/156): python3-jinja2-2.11.3-5.el9.noarch.rp 645 kB/s | 248 kB 00:00 2024-05-10T08:38:08.602 INFO:teuthology.orchestra.run.smithi037.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 278 kB/s | 35 kB 00:00 2024-05-10T08:38:08.702 INFO:teuthology.orchestra.run.smithi037.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 665 kB/s | 172 kB 00:00 2024-05-10T08:38:09.044 INFO:teuthology.orchestra.run.smithi037.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 733 kB/s | 250 kB 00:00 2024-05-10T08:38:09.309 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T08:38:09.337 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T08:38:09.337 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:09.337 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T08:38:09.337 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T08:38:09.337 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T08:38:09.337 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:09.419 INFO:teuthology.orchestra.run.smithi037.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 592 kB/s | 222 kB 00:00 2024-05-10T08:38:09.560 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T08:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T08:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:09.584 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T08:38:09.584 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T08:38:09.584 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T08:38:09.584 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:09.603 INFO:teuthology.orchestra.run.smithi037.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 421 kB/s | 77 kB 00:00 2024-05-10T08:38:09.714 INFO:teuthology.orchestra.run.smithi037.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-05-10T08:38:10.027 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T08:38:10.051 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T08:38:10.051 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:10.051 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T08:38:10.052 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T08:38:10.052 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T08:38:10.052 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:10.137 INFO:teuthology.orchestra.run.smithi037.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 634 kB/s | 269 kB 00:00 2024-05-10T08:38:10.149 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T08:38:10.197 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T08:38:10.262 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T08:38:10.404 INFO:teuthology.orchestra.run.smithi037.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 595 kB/s | 159 kB 00:00 2024-05-10T08:38:10.445 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T08:38:10.486 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T08:38:10.588 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T08:38:10.687 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T08:38:10.821 INFO:teuthology.orchestra.run.smithi037.stdout:(87/156): python3-pyasn1-modules-0.4.8-6.el9.no 669 kB/s | 279 kB 00:00 2024-05-10T08:38:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T08:38:10.862 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T08:38:10.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T08:38:10.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T08:38:10.921 INFO:teuthology.orchestra.run.smithi037.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-05-10T08:38:11.022 INFO:teuthology.orchestra.run.smithi037.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 536 kB/s | 54 kB 00:00 2024-05-10T08:38:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T08:38:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T08:38:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 126/164 2024-05-10T08:38:11.454 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 127/164 2024-05-10T08:38:11.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T08:38:12.537 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T08:38:12.568 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T08:38:13.534 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T08:38:13.561 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T08:38:13.671 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T08:38:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 131/164 2024-05-10T08:38:13.871 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T08:38:13.895 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T08:38:13.895 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:13.895 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T08:38:13.895 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T08:38:13.895 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T08:38:13.895 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:13.938 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T08:38:13.950 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T08:38:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 134/164 2024-05-10T08:38:14.143 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 135/164 2024-05-10T08:38:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T08:38:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T08:38:15.089 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T08:38:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T08:38:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T08:38:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T08:38:15.089 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:15.133 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T08:38:15.156 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T08:38:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T08:38:15.156 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:15.200 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T08:38:15.223 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T08:38:15.223 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:15.223 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T08:38:15.223 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T08:38:15.223 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T08:38:15.223 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:15.526 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T08:38:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T08:38:15.549 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:15.549 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T08:38:15.549 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T08:38:15.550 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T08:38:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:15.646 INFO:teuthology.orchestra.run.smithi037.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 741 kB/s | 5.1 MB 00:07 2024-05-10T08:38:15.755 INFO:teuthology.orchestra.run.smithi037.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-05-10T08:38:15.863 INFO:teuthology.orchestra.run.smithi037.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-05-10T08:38:16.222 INFO:teuthology.orchestra.run.smithi037.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 616 kB/s | 221 kB 00:00 2024-05-10T08:38:16.297 INFO:teuthology.orchestra.run.smithi037.stdout:(94/156): python3-babel-2.9.1-2.el9.noarch.rpm 721 kB/s | 6.0 MB 00:08 2024-05-10T08:38:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-05-10T08:38:16.406 INFO:teuthology.orchestra.run.smithi037.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-05-10T08:38:16.515 INFO:teuthology.orchestra.run.smithi037.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-05-10T08:38:16.698 INFO:teuthology.orchestra.run.smithi037.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 512 kB/s | 94 kB 00:00 2024-05-10T08:38:16.899 INFO:teuthology.orchestra.run.smithi037.stdout:(99/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.8 MB/s | 16 MB 00:05 2024-05-10T08:38:16.924 INFO:teuthology.orchestra.run.smithi037.stdout:(100/156): socat-1.7.4.1-5.el9.x86_64.rpm 507 kB/s | 305 kB 00:00 2024-05-10T08:38:16.949 INFO:teuthology.orchestra.run.smithi037.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 254 kB/s | 64 kB 00:00 2024-05-10T08:38:17.000 INFO:teuthology.orchestra.run.smithi037.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 447 kB/s | 45 kB 00:00 2024-05-10T08:38:17.025 INFO:teuthology.orchestra.run.smithi037.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-05-10T08:38:17.158 INFO:teuthology.orchestra.run.smithi037.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-05-10T08:38:17.317 INFO:teuthology.orchestra.run.smithi037.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-05-10T08:38:17.342 INFO:teuthology.orchestra.run.smithi037.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 107 kB/s | 19 kB 00:00 2024-05-10T08:38:17.368 INFO:teuthology.orchestra.run.smithi037.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 902 kB/s | 309 kB 00:00 2024-05-10T08:38:17.401 INFO:teuthology.orchestra.run.smithi037.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-05-10T08:38:17.426 INFO:teuthology.orchestra.run.smithi037.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 833 kB/s | 49 kB 00:00 2024-05-10T08:38:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2024-05-10T08:38:17.519 INFO:teuthology.orchestra.run.smithi037.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-05-10T08:38:17.602 INFO:teuthology.orchestra.run.smithi037.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-10T08:38:17.645 INFO:teuthology.orchestra.run.smithi037.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-05-10T08:38:17.678 INFO:teuthology.orchestra.run.smithi037.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-05-10T08:38:17.695 INFO:teuthology.orchestra.run.smithi037.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-05-10T08:38:17.729 INFO:teuthology.orchestra.run.smithi037.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-05-10T08:38:17.745 INFO:teuthology.orchestra.run.smithi037.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 223 kB/s | 15 kB 00:00 2024-05-10T08:38:17.771 INFO:teuthology.orchestra.run.smithi037.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-10T08:38:17.796 INFO:teuthology.orchestra.run.smithi037.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-05-10T08:38:17.821 INFO:teuthology.orchestra.run.smithi037.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 704 kB/s | 35 kB 00:00 2024-05-10T08:38:17.855 INFO:teuthology.orchestra.run.smithi037.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-05-10T08:38:17.880 INFO:teuthology.orchestra.run.smithi037.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-05-10T08:38:17.906 INFO:teuthology.orchestra.run.smithi037.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-05-10T08:38:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-05-10T08:38:17.956 INFO:teuthology.orchestra.run.smithi037.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-05-10T08:38:17.981 INFO:teuthology.orchestra.run.smithi037.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-05-10T08:38:18.007 INFO:teuthology.orchestra.run.smithi037.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-05-10T08:38:18.032 INFO:teuthology.orchestra.run.smithi037.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-05-10T08:38:18.091 INFO:teuthology.orchestra.run.smithi037.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-05-10T08:38:18.116 INFO:teuthology.orchestra.run.smithi037.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 557 kB/s | 46 kB 00:00 2024-05-10T08:38:18.133 INFO:teuthology.orchestra.run.smithi037.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-05-10T08:38:18.175 INFO:teuthology.orchestra.run.smithi037.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-05-10T08:38:18.200 INFO:teuthology.orchestra.run.smithi037.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2024-05-10T08:38:18.225 INFO:teuthology.orchestra.run.smithi037.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 329 kB/s | 16 kB 00:00 2024-05-10T08:38:18.251 INFO:teuthology.orchestra.run.smithi037.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-10T08:38:18.276 INFO:teuthology.orchestra.run.smithi037.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-05-10T08:38:18.301 INFO:teuthology.orchestra.run.smithi037.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-05-10T08:38:18.326 INFO:teuthology.orchestra.run.smithi037.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-10T08:38:18.360 INFO:teuthology.orchestra.run.smithi037.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-05-10T08:38:18.385 INFO:teuthology.orchestra.run.smithi037.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-05-10T08:38:18.411 INFO:teuthology.orchestra.run.smithi037.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 425 kB/s | 36 kB 00:00 2024-05-10T08:38:18.436 INFO:teuthology.orchestra.run.smithi037.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-05-10T08:38:18.470 INFO:teuthology.orchestra.run.smithi037.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-10T08:38:18.495 INFO:teuthology.orchestra.run.smithi037.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-10T08:38:18.520 INFO:teuthology.orchestra.run.smithi037.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-10T08:38:18.546 INFO:teuthology.orchestra.run.smithi037.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-05-10T08:38:18.571 INFO:teuthology.orchestra.run.smithi037.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-10T08:38:18.638 INFO:teuthology.orchestra.run.smithi037.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-05-10T08:38:19.238 INFO:teuthology.orchestra.run.smithi037.stdout:(149/156): librbd1-19.0.0-3449.gd39fa088.el9.x8 4.7 MB/s | 3.1 MB 00:00 2024-05-10T08:38:19.380 INFO:teuthology.orchestra.run.smithi037.stdout:(150/156): librados2-19.0.0-3449.gd39fa088.el9. 4.1 MB/s | 3.4 MB 00:00 2024-05-10T08:38:19.480 INFO:teuthology.orchestra.run.smithi037.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.7 MB/s | 2.3 MB 00:00 2024-05-10T08:38:19.531 INFO:teuthology.orchestra.run.smithi037.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 278 kB/s | 42 kB 00:00 2024-05-10T08:38:19.572 INFO:teuthology.orchestra.run.smithi037.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 5.5 MB/s | 1.8 MB 00:00 2024-05-10T08:38:19.598 INFO:teuthology.orchestra.run.smithi037.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.1 MB/s | 248 kB 00:00 2024-05-10T08:38:19.748 INFO:teuthology.orchestra.run.smithi037.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-05-10T08:38:19.782 INFO:teuthology.orchestra.run.smithi037.stdout:(156/156): openssl-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 1.3 MB 00:00 2024-05-10T08:38:19.788 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-05-10T08:38:19.788 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.4 MB/s | 226 MB 00:30 2024-05-10T08:38:20.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 141/164 2024-05-10T08:38:20.194 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 142/164 2024-05-10T08:38:20.244 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 143/164 2024-05-10T08:38:20.276 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T08:38:20.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T08:38:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 146/164 2024-05-10T08:38:20.524 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T08:38:20.555 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 148/164 2024-05-10T08:38:20.584 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T08:38:20.630 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T08:38:20.993 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-05-10T08:38:21.162 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-05-10T08:38:21.162 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-05-10T08:38:21.270 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T08:38:21.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T08:38:21.322 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T08:38:22.143 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 152/164 2024-05-10T08:38:22.232 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T08:38:22.280 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T08:38:22.366 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T08:38:22.401 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T08:38:22.427 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T08:38:22.427 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T08:38:22.520 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T08:38:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T08:38:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T08:38:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T08:38:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T08:38:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T08:38:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T08:38:22.840 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T08:38:22.840 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T08:38:22.925 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T08:38:23.004 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T08:38:23.448 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-05-10T08:38:23.448 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-05-10T08:38:28.584 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 1/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 3/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 4/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 5/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 6/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 7/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 11/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 12/164 2024-05-10T08:38:28.585 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 14/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 15/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 16/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 17/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 18/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 19/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 20/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 21/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 22/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 23/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 24/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 25/164 2024-05-10T08:38:28.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 26/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 27/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 28/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 29/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 30/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 31/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 32/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 33/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 35/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 36/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 37/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 38/164 2024-05-10T08:38:28.587 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 39/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T08:38:28.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T08:38:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T08:38:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T08:38:28.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T08:38:28.592 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T08:38:28.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T08:38:28.594 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 149/164 2024-05-10T08:38:28.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 151/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T08:38:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T08:38:28.597 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T08:38:28.597 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T08:38:28.597 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T08:38:28.597 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T08:38:29.647 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-05-10T08:38:29.745 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T08:38:29.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T08:38:29.847 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T08:38:29.887 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T08:38:29.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T08:38:29.963 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T08:38:30.377 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T08:38:30.430 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T08:38:30.538 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T08:38:30.564 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T08:38:30.640 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T08:38:30.669 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T08:38:30.847 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T08:38:30.900 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T08:38:30.927 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T08:38:31.016 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T08:38:31.045 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T08:38:31.091 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T08:38:31.113 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T08:38:31.135 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T08:38:31.333 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T08:38:31.430 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T08:38:31.430 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:31.430 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-05-10T08:38:31.430 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T08:38:31.430 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T08:38:31.430 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T08:38:31.431 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T08:38:31.432 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T08:38:31.432 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T08:38:31.432 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.432 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.432 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.432 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.432 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.433 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.433 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.433 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.433 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.433 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.433 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.433 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.434 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.434 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.434 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.434 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.434 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.434 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.434 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.435 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.435 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.435 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.435 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.435 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:38:31.435 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T08:38:31.435 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T08:38:31.436 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T08:38:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T08:38:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T08:38:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T08:38:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T08:38:31.438 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T08:38:31.438 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.438 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.438 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T08:38:31.438 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.438 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T08:38:31.439 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T08:38:31.439 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T08:38:31.439 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T08:38:31.439 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T08:38:31.440 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.441 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T08:38:31.442 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T08:38:31.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T08:38:31.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T08:38:31.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T08:38:31.446 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T08:38:31.447 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T08:38:31.447 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:38:31.447 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-10T08:38:31.508 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T08:38:31.651 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T08:38:31.712 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T08:38:31.828 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T08:38:31.862 DEBUG:teuthology.parallel:result is None 2024-05-10T08:38:31.896 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T08:38:32.091 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T08:38:32.216 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T08:38:32.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T08:38:32.353 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-10T08:38:32.396 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-10T08:38:32.472 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-10T08:38:32.513 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-10T08:38:32.556 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-10T08:38:32.588 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-10T08:38:32.616 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-10T08:38:32.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-10T08:38:32.740 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-10T08:38:32.769 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-10T08:38:32.813 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-10T08:38:32.891 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-10T08:38:32.923 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 33/164 2024-05-10T08:38:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T08:38:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 35/164 2024-05-10T08:38:33.068 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-10T08:38:33.110 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-10T08:38:33.189 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-10T08:38:33.389 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-10T08:38:33.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-10T08:38:34.036 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-10T08:38:34.071 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-10T08:38:34.114 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-10T08:38:34.168 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 45/164 2024-05-10T08:38:34.203 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-10T08:38:34.359 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-10T08:38:34.405 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-10T08:38:34.461 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-10T08:38:34.535 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T08:38:34.572 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T08:38:34.610 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T08:38:34.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T08:38:34.692 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T08:38:34.735 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T08:38:34.777 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T08:38:34.921 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T08:38:34.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T08:38:34.995 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T08:38:35.037 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T08:38:35.135 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T08:38:35.171 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T08:38:35.212 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T08:38:35.244 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T08:38:35.269 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T08:38:35.360 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T08:38:35.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T08:38:35.527 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T08:38:35.555 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T08:38:35.589 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T08:38:35.629 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T08:38:35.668 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T08:38:35.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T08:38:35.724 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T08:38:35.757 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T08:38:35.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T08:38:35.833 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T08:38:35.923 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T08:38:35.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T08:38:36.003 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T08:38:36.051 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T08:38:36.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T08:38:36.214 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T08:38:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T08:38:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T08:38:37.061 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T08:38:37.164 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T08:38:37.236 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T08:38:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T08:38:37.362 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T08:38:37.546 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T08:38:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T08:38:37.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T08:38:38.356 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T08:38:38.471 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T08:38:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T08:38:39.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T08:38:39.892 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T08:38:39.925 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T08:38:40.304 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T08:38:40.396 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T08:38:40.426 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 102/164 2024-05-10T08:38:40.463 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T08:38:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T08:38:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T08:38:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T08:38:41.075 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 106/164 2024-05-10T08:38:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T08:38:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T08:38:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T08:38:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T08:38:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T08:38:44.237 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T08:38:44.237 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T08:38:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:38:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-05-10T08:38:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-05-10T08:38:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:38:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T08:38:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T08:38:56.693 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:56.694 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T08:38:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:38:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T08:38:58.265 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T08:38:58.265 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:58.266 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T08:38:58.266 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T08:38:58.266 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T08:38:58.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:38:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T08:38:58.530 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T08:38:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T08:38:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T08:38:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T08:38:58.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:38:58.989 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T08:38:59.014 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T08:38:59.014 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:38:59.014 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T08:38:59.014 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T08:38:59.014 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T08:38:59.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:38:59.120 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T08:38:59.177 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T08:38:59.241 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T08:38:59.437 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T08:38:59.490 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T08:38:59.572 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T08:38:59.669 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T08:38:59.819 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T08:38:59.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T08:38:59.906 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T08:38:59.933 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T08:39:00.405 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T08:39:00.432 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T08:39:00.465 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 126/164 2024-05-10T08:39:00.528 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 127/164 2024-05-10T08:39:00.554 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T08:39:01.645 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T08:39:01.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T08:39:02.701 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T08:39:02.750 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T08:39:02.868 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T08:39:03.025 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 131/164 2024-05-10T08:39:03.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T08:39:03.084 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T08:39:03.084 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:39:03.084 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T08:39:03.084 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T08:39:03.084 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T08:39:03.084 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:03.126 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T08:39:03.137 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T08:39:03.239 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 134/164 2024-05-10T08:39:03.302 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 135/164 2024-05-10T08:39:04.282 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T08:39:04.312 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T08:39:04.336 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T08:39:04.337 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:39:04.337 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T08:39:04.337 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T08:39:04.337 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T08:39:04.337 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:04.379 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T08:39:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T08:39:04.403 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:39:04.403 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T08:39:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:04.455 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T08:39:04.479 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T08:39:04.479 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:39:04.479 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T08:39:04.479 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T08:39:04.480 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T08:39:04.480 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:04.797 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T08:39:04.821 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T08:39:04.821 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T08:39:04.821 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T08:39:04.822 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T08:39:04.822 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T08:39:04.822 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:09.693 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 141/164 2024-05-10T08:39:09.734 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 142/164 2024-05-10T08:39:09.783 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 143/164 2024-05-10T08:39:09.815 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T08:39:09.842 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T08:39:10.038 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 146/164 2024-05-10T08:39:10.088 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T08:39:10.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 148/164 2024-05-10T08:39:10.148 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T08:39:10.186 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T08:39:10.743 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T08:39:10.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T08:39:10.804 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T08:39:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 152/164 2024-05-10T08:39:11.813 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T08:39:11.860 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T08:39:11.962 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T08:39:11.999 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T08:39:12.026 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T08:39:12.026 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T08:39:12.110 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T08:39:12.142 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T08:39:12.143 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T08:39:12.227 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T08:39:12.252 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T08:39:12.257 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T08:39:12.258 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T08:39:12.454 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T08:39:12.454 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T08:39:12.564 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T08:39:12.640 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T08:39:18.053 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 1/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 3/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 4/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 5/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 6/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 7/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T08:39:18.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 11/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 12/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 14/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 15/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 16/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 17/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 18/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 19/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 20/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 21/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 22/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 23/164 2024-05-10T08:39:18.055 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 24/164 2024-05-10T08:39:18.056 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 25/164 2024-05-10T08:39:18.056 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 26/164 2024-05-10T08:39:18.056 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 27/164 2024-05-10T08:39:18.068 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 28/164 2024-05-10T08:39:18.068 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 29/164 2024-05-10T08:39:18.068 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 30/164 2024-05-10T08:39:18.068 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 31/164 2024-05-10T08:39:18.068 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 32/164 2024-05-10T08:39:18.068 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 33/164 2024-05-10T08:39:18.068 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 35/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 36/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 37/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 38/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 39/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T08:39:18.069 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T08:39:18.070 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T08:39:18.071 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T08:39:18.072 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T08:39:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T08:39:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T08:39:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T08:39:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T08:39:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 149/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 151/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T08:39:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T08:39:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T08:39:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T08:39:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T08:39:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.581 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.582 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T08:39:20.583 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T08:39:20.584 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T08:39:20.585 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T08:39:20.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T08:39:20.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T08:39:20.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T08:39:20.590 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T08:39:20.591 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T08:39:20.592 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T08:39:20.592 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T08:39:20.592 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T08:39:20.592 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:20.592 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-05-10T08:39:20.984 DEBUG:teuthology.parallel:result is None 2024-05-10T08:39:20.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T08:39:21.207 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T08:39:21.231 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-3449.gd39fa088.el9 2024-05-10T08:39:21.232 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3449.gd39fa088.el9 2024-05-10T08:39:21.232 INFO:teuthology.task.install:The correct ceph version 19.0.0-3449.gd39fa088 is installed. 2024-05-10T08:39:21.234 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T08:39:21.373 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T08:39:21.402 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-3449.gd39fa088.el9 2024-05-10T08:39:21.403 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3449.gd39fa088.el9 2024-05-10T08:39:21.403 INFO:teuthology.task.install:The correct ceph version 19.0.0-3449.gd39fa088 is installed. 2024-05-10T08:39:21.404 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T08:39:21.405 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:21.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T08:39:21.435 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:21.435 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T08:39:21.474 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T08:39:21.474 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:21.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T08:39:21.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T08:39:21.570 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:21.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T08:39:21.598 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T08:39:21.665 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T08:39:21.665 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:21.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T08:39:21.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T08:39:21.759 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:21.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T08:39:21.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T08:39:21.853 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T08:39:21.853 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:21.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T08:39:21.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T08:39:21.946 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:21.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T08:39:21.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T08:39:22.036 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T08:39:22.116 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T08:39:22.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-05-10T08:39:22.118 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-05-10T08:39:22.143 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T08:39:22.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T08:39:22.186 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T08:39:22.218 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T08:39:22.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T08:39:22.253 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T08:39:22.290 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-10T08:39:22.290 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-10T08:39:22.291 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-10T08:39:22.291 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:22.291 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T08:39:22.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T08:39:22.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T08:39:22.474 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:22.474 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T08:39:22.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T08:39:22.602 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T08:39:22.633 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T08:39:22.633 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T08:39:22.633 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073', 'branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': None, 'first_in_suite': False, 'job_id': '7701073', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1698, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'sleep_before_teardown': 0, 'subset': '434/512', 'suite': 'fs', 'suite_branch': 'wip-63896-from-wip-rishabh-testing-20240501.193033', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOcUkZbUa+MoBbiCA6aOmMuS2Mj9ec8CbVCXdupKx+eM9fZNi1YLCK64kADA9N0O2nlR3HHbre6XsapUnxYRsI=', 'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOe8oDvRwfdClHI9t/UpsXBfVBtq0rv0KO2+FENtP18U1VHd5hUbv5MwBhflZ2e/Scep5l5aXTlqvpjegSCarBc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_08:11:49', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T08:39:22.633 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T08:39:22.636 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T08:39:22.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T08:39:22.692 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T08:39:22.748 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:22.748 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T08:39:22.772 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T08:39:22.772 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-05-10T08:39:22.828 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-10 08:39:12.993221796 +0000 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-10 08:36:34.717720256 +0000 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-10 08:36:34.717720256 +0000 2024-05-10T08:39:22.829 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-10 08:36:34.717720256 +0000 2024-05-10T08:39:22.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T08:39:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-10T08:39:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-10T08:39:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000263506 s, 1.9 MB/s 2024-05-10T08:39:22.894 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T08:39:22.951 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-05-10T08:39:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T08:39:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:23.007 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-10T08:39:23.007 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:23.007 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:23.007 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-10 08:39:12.994221782 +0000 2024-05-10T08:39:23.008 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-10 08:36:35.074715195 +0000 2024-05-10T08:39:23.008 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-10 08:36:35.074715195 +0000 2024-05-10T08:39:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-10 08:36:35.074715195 +0000 2024-05-10T08:39:23.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T08:39:23.073 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-10T08:39:23.073 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-10T08:39:23.073 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000188621 s, 2.7 MB/s 2024-05-10T08:39:23.074 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T08:39:23.131 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-05-10T08:39:23.187 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T08:39:23.187 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:23.187 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-10T08:39:23.187 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:23.188 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:23.188 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-10 08:39:12.994221782 +0000 2024-05-10T08:39:23.188 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-10 08:36:35.425710218 +0000 2024-05-10T08:39:23.188 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-10 08:36:35.425710218 +0000 2024-05-10T08:39:23.188 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-10 08:36:35.425710218 +0000 2024-05-10T08:39:23.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T08:39:23.251 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-10T08:39:23.252 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-10T08:39:23.252 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000224147 s, 2.3 MB/s 2024-05-10T08:39:23.252 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T08:39:23.309 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-05-10T08:39:23.365 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T08:39:23.365 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:23.365 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-10T08:39:23.366 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:23.366 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:23.366 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-10 08:39:12.995221768 +0000 2024-05-10T08:39:23.366 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-10 08:36:35.786705100 +0000 2024-05-10T08:39:23.366 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-10 08:36:35.786705100 +0000 2024-05-10T08:39:23.366 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-10 08:36:35.786705100 +0000 2024-05-10T08:39:23.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T08:39:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-10T08:39:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-10T08:39:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000198156 s, 2.6 MB/s 2024-05-10T08:39:23.431 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T08:39:23.488 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:23.488 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:23.488 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T08:39:23.505 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T08:39:23.505 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-05-10T08:39:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 08:38:23.352542485 +0000 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 08:36:23.989561845 +0000 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 08:36:23.989561845 +0000 2024-05-10T08:39:23.562 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 08:36:23.989561845 +0000 2024-05-10T08:39:23.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T08:39:23.627 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T08:39:23.627 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T08:39:23.627 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000219498 s, 2.3 MB/s 2024-05-10T08:39:23.628 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T08:39:23.685 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-05-10T08:39:23.740 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 08:38:23.352542485 +0000 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 08:36:24.335554786 +0000 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 08:36:24.335554786 +0000 2024-05-10T08:39:23.741 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 08:36:24.335554786 +0000 2024-05-10T08:39:23.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T08:39:23.805 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T08:39:23.805 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T08:39:23.805 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000212235 s, 2.4 MB/s 2024-05-10T08:39:23.806 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T08:39:23.862 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-05-10T08:39:23.917 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 08:38:23.353542465 +0000 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 08:36:24.679547769 +0000 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 08:36:24.679547769 +0000 2024-05-10T08:39:23.918 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 08:36:24.679547769 +0000 2024-05-10T08:39:23.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T08:39:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T08:39:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T08:39:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000167296 s, 3.1 MB/s 2024-05-10T08:39:23.982 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T08:39:24.038 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 08:38:23.353542465 +0000 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 08:36:25.048540241 +0000 2024-05-10T08:39:24.093 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 08:36:25.048540241 +0000 2024-05-10T08:39:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 08:36:25.048540241 +0000 2024-05-10T08:39:24.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T08:39:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T08:39:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T08:39:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000229303 s, 2.2 MB/s 2024-05-10T08:39:24.158 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T08:39:24.214 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:24.215 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T08:39:24.215 INFO:tasks.ceph:Generating config... 2024-05-10T08:39:24.234 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-10T08:39:24.234 INFO:tasks.ceph:[client] debug client = 20 2024-05-10T08:39:24.234 INFO:tasks.ceph:[client] debug ms = 1 2024-05-10T08:39:24.234 INFO:tasks.ceph:[client] pid file = 2024-05-10T08:39:24.235 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-10T08:39:24.235 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-10T08:39:24.235 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T08:39:24.235 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T08:39:24.236 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T08:39:24.236 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T08:39:24.236 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-10T08:39:24.236 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T08:39:24.236 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T08:39:24.237 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-10T08:39:24.237 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T08:39:24.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T08:39:24.304 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T08:39:24.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T08:39:24.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T08:39:24.381 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.82'), ('mon.c', '[v2:172.21.15.82:3301,v1:172.21.15.82:6790]')] 2024-05-10T08:39:24.382 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-10T08:39:24.384 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:24.384 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T08:39:24.438 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.82 --addv c '[v2:172.21.15.82:3301,v1:172.21.15.82:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2024-05-10T08:39:24.528676+0000 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-05-10T08:39:24.528676+0000 2024-05-10T08:39:24.527 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 17 (quincy) 2024-05-10T08:39:24.528 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2024-05-10T08:39:24.528 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-10T08:39:24.528 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-05-10T08:39:24.528 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] mon.c 2024-05-10T08:39:24.528 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T08:39:24.529 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T08:39:24.545 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa... 2024-05-10T08:39:24.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:39:24.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:39:24.631 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-05-10T08:39:24.631 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:39:24.632 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:39:24.633 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:39:24.634 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-05-10T08:39:24.635 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:39:24.636 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:39:24.637 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-05-10T08:39:24.638 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.639 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-05-10T08:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:39:24.641 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2024-05-10T08:39:24.642 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-05-10T08:39:24.643 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2024-05-10T08:39:24.643 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:39:24.643 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:39:24.643 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:39:24.644 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-10T08:39:24.644 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-05-10T08:39:24.644 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:39:24.645 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:39:24.646 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-05-10T08:39:24.647 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-05-10T08:39:24.648 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-05-10T08:39:24.649 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-05-10T08:39:24.650 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:39:24.651 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:39:24.652 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: mon down mkfs grace = 300 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:39:24.653 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T08:39:24.654 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:39:24.655 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:39:24.655 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T08:39:24.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T08:39:24.740 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T08:39:24.740 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:24.740 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T08:39:24.755 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:24.755 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T08:39:24.811 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:39:24.811 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:24.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T08:39:24.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T08:39:24.887 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:24.887 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:24.943 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:39:24.944 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:24.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T08:39:24.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T08:39:24.979 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:24.979 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:25.035 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T08:39:25.035 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T08:39:25.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T08:39:25.088 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T08:39:25.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T08:39:25.147 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T08:39:25.150 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T08:39:25.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T08:39:25.203 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T08:39:25.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-10T08:39:25.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T08:39:25.323 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T08:39:25.326 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-10T08:39:25.351 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T08:39:25.401 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T08:39:25.404 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-10T08:39:25.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T08:39:25.519 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T08:39:25.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-10T08:39:25.546 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T08:39:25.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T08:39:25.589 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T08:39:25.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-10T08:39:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-10T08:39:25.697 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T08:39:25.737 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T08:39:25.750 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-10T08:39:25.831 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-10T08:39:25.844 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T08:39:25.844 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T08:39:25.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T08:39:25.870 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:25.870 INFO:tasks.ceph:role: osd.0 2024-05-10T08:39:25.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:39:25.870 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T08:39:25.943 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:25.944 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:26.450 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-10T08:39:26.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-10T08:39:26.452 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T08:39:26.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T08:39:26.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T08:39:26.693 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:26.693 INFO:tasks.ceph:role: osd.1 2024-05-10T08:39:26.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:39:26.693 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T08:39:26.768 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:26.768 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:26.768 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:26.768 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:26.768 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:26.768 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:26.768 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:26.769 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:26.769 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:26.769 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:27.213 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-10T08:39:27.214 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-10T08:39:27.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T08:39:27.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T08:39:27.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T08:39:27.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:27.401 INFO:tasks.ceph:role: osd.2 2024-05-10T08:39:27.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:39:27.401 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T08:39:27.475 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:27.475 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:27.475 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:27.475 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:27.475 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:27.475 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:27.475 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:27.476 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:27.476 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:27.476 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:27.962 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-10T08:39:27.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-10T08:39:27.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T08:39:28.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T08:39:28.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T08:39:28.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:28.195 INFO:tasks.ceph:role: osd.3 2024-05-10T08:39:28.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:39:28.195 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:28.268 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:28.763 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-10T08:39:28.765 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-10T08:39:28.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T08:39:28.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T08:39:28.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:29.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:29.035+0000 7fa06b6d9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T08:39:29.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:29.035+0000 7fa06b6d9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T08:39:29.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:29.035+0000 7fa06b6d9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T08:39:29.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:29.035+0000 7fa06b6d9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T08:39:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:29.035+0000 7fa06b6d9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T08:39:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:29.036+0000 7fa06b6d9640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T08:39:31.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T08:39:31.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:32.017+0000 7f68f560c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:32.018+0000 7f68f560c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:32.018+0000 7f68f560c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:32.018+0000 7f68f560c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T08:39:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:32.018+0000 7f68f560c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T08:39:32.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:32.018+0000 7f68f560c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T08:39:34.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T08:39:34.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:34.995+0000 7fc4ae013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T08:39:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:34.995+0000 7fc4ae013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T08:39:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:34.995+0000 7fc4ae013640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T08:39:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:34.995+0000 7fc4ae013640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T08:39:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:34.995+0000 7fc4ae013640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T08:39:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:34.996+0000 7fc4ae013640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T08:39:37.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T08:39:37.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:37.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:37.974+0000 7fed15c16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T08:39:37.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:37.974+0000 7fed15c16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T08:39:37.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:37.974+0000 7fed15c16640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T08:39:37.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:37.974+0000 7fed15c16640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T08:39:37.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:37.974+0000 7fed15c16640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T08:39:37.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:37.975+0000 7fed15c16640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T08:39:40.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T08:39:40.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T08:39:40.892 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:40.892 INFO:tasks.ceph:role: osd.4 2024-05-10T08:39:40.892 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:39:40.892 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:40.968 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:40.969 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:40.969 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:41.478 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T08:39:41.481 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T08:39:41.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T08:39:41.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T08:39:41.653 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T08:39:41.720 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:41.720 INFO:tasks.ceph:role: osd.5 2024-05-10T08:39:41.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:39:41.720 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T08:39:41.793 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:41.793 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:42.241 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T08:39:42.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T08:39:42.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T08:39:42.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T08:39:42.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T08:39:42.435 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:42.435 INFO:tasks.ceph:role: osd.6 2024-05-10T08:39:42.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:39:42.435 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T08:39:42.508 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:42.508 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:42.508 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:42.508 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:42.508 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:42.997 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T08:39:42.999 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T08:39:42.999 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T08:39:43.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T08:39:43.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T08:39:43.251 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T08:39:43.251 INFO:tasks.ceph:role: osd.7 2024-05-10T08:39:43.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:39:43.251 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T08:39:43.325 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T08:39:43.325 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T08:39:43.326 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T08:39:43.841 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T08:39:43.843 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T08:39:43.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T08:39:43.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T08:39:44.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:44.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:44.129+0000 7f71cbd01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T08:39:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:44.130+0000 7f71cbd01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T08:39:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:44.130+0000 7f71cbd01640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T08:39:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:44.130+0000 7f71cbd01640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T08:39:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:44.130+0000 7f71cbd01640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T08:39:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:44.130+0000 7f71cbd01640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T08:39:46.984 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T08:39:47.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:47.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:47.103+0000 7fa8ff63c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T08:39:47.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:47.103+0000 7fa8ff63c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T08:39:47.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:47.103+0000 7fa8ff63c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T08:39:47.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:47.105+0000 7fa8ff63c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T08:39:47.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:47.105+0000 7fa8ff63c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T08:39:47.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:47.105+0000 7fa8ff63c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T08:39:49.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T08:39:49.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:50.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:50.071+0000 7fe86a611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T08:39:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:50.071+0000 7fe86a611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T08:39:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:50.071+0000 7fe86a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T08:39:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:50.071+0000 7fe86a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T08:39:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:50.071+0000 7fe86a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T08:39:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:50.071+0000 7fe86a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T08:39:52.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:39:52.639 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:39:52.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T08:39:52.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:53.059+0000 7f4c3c420640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T08:39:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:53.059+0000 7f4c3c420640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T08:39:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:53.059+0000 7f4c3c420640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T08:39:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:53.059+0000 7f4c3c420640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T08:39:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:53.059+0000 7f4c3c420640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T08:39:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:53.060+0000 7f4c3c420640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T08:39:55.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T08:39:55.940 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T08:39:55.940 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:55.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T08:39:55.971 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:55.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-10T08:39:56.042 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:56.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-10T08:39:56.113 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:56.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T08:39:56.183 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:56.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T08:39:56.252 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:56.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T08:39:56.321 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:56.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T08:39:56.389 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T08:39:56.419 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-10T08:39:56.487 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.487 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-10T08:39:56.555 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T08:39:56.623 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T08:39:56.691 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T08:39:56.757 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T08:39:56.824 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:56.824 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T08:39:56.844 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:56.844 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-10T08:39:56.903 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.903 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T08:39:56.920 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:56.920 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-10T08:39:56.976 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T08:39:56.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T08:39:56.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2024-05-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A== 2024-05-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg== 2024-05-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA== 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw== 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw== 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg== 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ== 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA== 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ== 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw== 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g== 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA== 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w== 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg== 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2024-05-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw== 2024-05-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2024-05-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg== 2024-05-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2024-05-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA== 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A== 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg== 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA== 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2024-05-10T08:39:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw== 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw== 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg== 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ== 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA== 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ== 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw== 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2024-05-10T08:39:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g== 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA== 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w== 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg== 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw== 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg== 2024-05-10T08:39:57.042 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2024-05-10T08:39:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA== 2024-05-10T08:39:57.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T08:39:57.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T08:39:57.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.136 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T08:39:57.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T08:39:57.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T08:39:57.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.680 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T08:39:57.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:57.838 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:57.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:57.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:57.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:57.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:58.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:58.006 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T08:39:58.059 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T08:39:58.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T08:39:58.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T08:39:58.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T08:39:58.208 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T08:39:58.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T08:39:58.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T08:39:58.354 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T08:39:58.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T08:39:58.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T08:39:58.539 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:58.542 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T08:39:58.594 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T08:39:58.595 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T08:39:58.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T08:39:58.599 INFO:tasks.ceph.mon.a:Started 2024-05-10T08:39:58.599 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T08:39:58.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T08:39:58.637 INFO:tasks.ceph.mon.b:Started 2024-05-10T08:39:58.637 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T08:39:58.637 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T08:39:58.639 INFO:tasks.ceph.mon.c:Started 2024-05-10T08:39:58.639 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T08:39:58.640 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T08:39:58.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T08:39:58.642 INFO:tasks.ceph.mgr.y:Started 2024-05-10T08:39:58.642 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T08:39:58.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T08:39:58.644 INFO:tasks.ceph.mgr.x:Started 2024-05-10T08:39:58.645 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T08:39:58.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T08:39:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.749+0000 7f5051837640 1 Processor -- start 2024-05-10T08:39:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.749+0000 7f5051837640 1 -- start start 2024-05-10T08:39:58.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.749+0000 7f5051837640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 0x7f504c0d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.749+0000 7f5051837640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 0x7f504c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f5051837640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f504c0cda40 con 0x7f504c0ce7c0 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f5051837640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f504c0d0940 con 0x7f504c15d240 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f5051837640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f504c0d0660 con 0x7f504c0d1840 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 0x7f504c0d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 0x7f504c0d0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34984/0 (socket says 172.21.15.37:34984) 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504affd640 1 -- 172.21.15.37:0/3877881486 learned_addr learned my addr 172.21.15.37:0/3877881486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:39:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504affd640 1 -- 172.21.15.37:0/3877881486 >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 msgr2=0x7f504c0d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504affd640 1 -- 172.21.15.37:0/3877881486 >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 msgr2=0x7f504c0d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504affd640 1 --2- 172.21.15.37:0/3877881486 >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 0x7f504c0d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504b7fe640 1 --2- 172.21.15.37:0/3877881486 >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 0x7f504c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504affd640 1 --2- 172.21.15.37:0/3877881486 >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 0x7f504c0d0b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504b7fe640 1 -- 172.21.15.37:0/3877881486 >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 msgr2=0x7f504c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504b7fe640 1 -- 172.21.15.37:0/3877881486 >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 msgr2=0x7f504c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504b7fe640 1 --2- 172.21.15.37:0/3877881486 >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 0x7f504c0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T08:39:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.750+0000 7f504b7fe640 1 --2- 172.21.15.37:0/3877881486 >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 0x7f504c0b23d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T08:39:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471989832 0 0) 0x7f504c0cda40 con 0x7f504c0ce7c0 2024-05-10T08:39:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5034003520 con 0x7f504c0ce7c0 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1861675677 0 0) 0x7f5034003520 con 0x7f504c0ce7c0 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 msgr2=0x7f504c0b23d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 --2- 172.21.15.37:0/3877881486 >> v2:172.21.15.82:3300/0 conn(0x7f504c0d1840 0x7f504c0b23d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 msgr2=0x7f504c0d0b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 --2- 172.21.15.37:0/3877881486 >> v2:172.21.15.37:3300/0 conn(0x7f504c15d240 0x7f504c0d0b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c0cdce0 con 0x7f504c0ce7c0 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f5040001670 con 0x7f504c0ce7c0 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 >> v1:172.21.15.82:6789/0 conn(0x7f504c0ce7c0 legacy=0x7f504c0d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f5034003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034004800 0x7f5034004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50340051c0 0x7f503400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f504c0d0940 con 0x7f50340039b0 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f504c0d0660 con 0x7f5034004800 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f503400c0c0 con 0x7f50340051c0 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f504affd640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f5034003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.911+0000 7f504a7fc640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034004800 0x7f5034004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.912+0000 7f504b7fe640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50340051c0 0x7f503400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.912+0000 7f504affd640 1 -- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50340051c0 msgr2=0x7f503400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.912+0000 7f504affd640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50340051c0 0x7f503400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.912+0000 7f504affd640 1 -- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034004800 msgr2=0x7f5034004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.912+0000 7f504affd640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034004800 0x7f5034004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.912+0000 7f504affd640 1 -- 172.21.15.37:0/3877881486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5034003520 con 0x7f50340039b0 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.912+0000 7f504b7fe640 1 -- 172.21.15.37:0/3877881486 reap_dead start 2024-05-10T08:39:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.913+0000 7f504affd640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f5034003dd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f503c009890 tx=0x7f5034005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae593cee10369eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.913+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c037070 con 0x7f50340039b0 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.913+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503c02ad00 con 0x7f50340039b0 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.913+0000 7f5049ffb640 1 -- 172.21.15.37:0/3877881486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c00f040 con 0x7f50340039b0 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.914+0000 7f5051837640 1 -- 172.21.15.37:0/3877881486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 msgr2=0x7f5034003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.914+0000 7f5051837640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f5034003dd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f503c009890 tx=0x7f5034005830 comp rx=0 tx=0).stop 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.914+0000 7f5051837640 1 -- 172.21.15.37:0/3877881486 shutdown_connections 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.914+0000 7f5051837640 1 --2- 172.21.15.37:0/3877881486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f5034003dd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.914+0000 7f5051837640 1 -- 172.21.15.37:0/3877881486 >> 172.21.15.37:0/3877881486 conn(0x7f504c0b4a40 msgr2=0x7f504c0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.914+0000 7f5051837640 1 -- 172.21.15.37:0/3877881486 shutdown_connections 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.914+0000 7f5051837640 1 -- 172.21.15.37:0/3877881486 wait complete. 2024-05-10T08:39:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.916+0000 7f5051837640 1 Processor -- start 2024-05-10T08:39:58.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.916+0000 7f5051837640 1 -- start start 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f5051837640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f504c0b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f5051837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f504c15c240 0x7f504c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f5051837640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504c15f920 0x7f504c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f5051837640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f504c0d02a0 con 0x7f50340039b0 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f5051837640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f504c0ce2a0 con 0x7f504c15c240 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f5051837640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f504c0d0420 con 0x7f504c15f920 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f504affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f504c0b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f504a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f504c15c240 0x7f504c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f504affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f504c0b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35014/0 (socket says 172.21.15.37:35014) 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f504affd640 1 -- 172.21.15.37:0/1242634785 learned_addr learned my addr 172.21.15.37:0/1242634785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.917+0000 7f504b7fe640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504c15f920 0x7f504c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f504affd640 1 -- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504c15f920 msgr2=0x7f504c0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f504affd640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504c15f920 0x7f504c0b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f504affd640 1 -- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f504c15c240 msgr2=0x7f504c151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f504affd640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f504c15c240 0x7f504c151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f504affd640 1 -- 172.21.15.37:0/1242634785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c0b8c20 con 0x7f50340039b0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f504a7fc640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f504c15c240 0x7f504c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f504affd640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f504c0b86e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f503c009980 tx=0x7f503c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f5033fff640 1 -- 172.21.15.37:0/1242634785 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c042020 con 0x7f50340039b0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f5033fff640 1 -- 172.21.15.37:0/1242634785 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503c038040 con 0x7f50340039b0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.918+0000 7f5033fff640 1 -- 172.21.15.37:0/1242634785 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c037070 con 0x7f50340039b0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.919+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f504c1517c0 con 0x7f50340039b0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.919+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f504c15eb60 con 0x7f50340039b0 2024-05-10T08:39:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.919+0000 7f5033fff640 1 -- 172.21.15.37:0/1242634785 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f503c045020 con 0x7f50340039b0 2024-05-10T08:39:58.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.919+0000 7f5033fff640 1 -- 172.21.15.37:0/1242634785 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f503c0477c0 con 0x7f50340039b0 2024-05-10T08:39:58.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.920+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f504c069b00 con 0x7f50340039b0 2024-05-10T08:39:58.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.922+0000 7f5033fff640 1 -- 172.21.15.37:0/1242634785 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f503c04c020 con 0x7f50340039b0 2024-05-10T08:39:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.989+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f504c0cf460 con 0x7f50340039b0 2024-05-10T08:39:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.991+0000 7f5033fff640 1 -- 172.21.15.37:0/1242634785 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f504c0b8c20 con 0x7f50340039b0 2024-05-10T08:39:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-05-10T08:39:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 msgr2=0x7f504c0b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f504c0b86e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f503c009980 tx=0x7f503c004730 comp rx=0 tx=0).stop 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 shutdown_connections 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f504c15f920 0x7f504c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f504c15c240 0x7f504c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 --2- 172.21.15.37:0/1242634785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50340039b0 0x7f504c0b86e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 >> 172.21.15.37:0/1242634785 conn(0x7f504c0b4a40 msgr2=0x7f504c071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 shutdown_connections 2024-05-10T08:39:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:39:58.992+0000 7f5051837640 1 -- 172.21.15.37:0/1242634785 wait complete. 2024-05-10T08:39:59.003 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T08:39:59.003 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T08:39:59.003 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:59.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T08:39:59.019 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:39:59.020+0000 7f925a52b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T08:39:59.030 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:59.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T08:39:59.033 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:39:59.033+0000 7f7f7ac13040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T08:39:59.057 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:59.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T08:39:59.123 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:39:59.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T08:39:59.181 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:39:59.182+0000 7f925a52b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T08:39:59.189 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:59.189 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T08:39:59.195 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:39:59.195+0000 7f7f7ac13040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T08:39:59.215 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:59.215 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T08:39:59.237 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:39:59.238+0000 7f925a52b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T08:39:59.251 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:39:59.252+0000 7f7f7ac13040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T08:39:59.262 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:59.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T08:39:59.327 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:39:59.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T08:39:59.392 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 0c9a4718-2633-4784-ab71-04c7aa89d0eb 0 2024-05-10T08:39:59.493 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:39:59.493+0000 7f925a52b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T08:39:59.506 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:39:59.506+0000 7f7f7ac13040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T08:39:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.533+0000 7f4030872640 1 Processor -- start 2024-05-10T08:39:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.534+0000 7f4030872640 1 -- start start 2024-05-10T08:39:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.534+0000 7f4030872640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402c152fd0 0x7f402c0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.534+0000 7f4030872640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f402c0b5640 0x7f402c0731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f4030872640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f402c0b1130 con 0x7f402c0b5aa0 2024-05-10T08:39:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f4030872640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f402c15d5d0 con 0x7f402c0b5640 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f4030872640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f402c0b0b70 con 0x7f402c152fd0 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f402a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402c152fd0 0x7f402c0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f402a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402c152fd0 0x7f402c0b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56676/0 (socket says 172.21.15.82:56676) 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f402a59c640 1 -- 172.21.15.82:0/1424353363 learned_addr learned my addr 172.21.15.82:0/1424353363 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f4029d9b640 1 --2- 172.21.15.82:0/1424353363 >> v2:172.21.15.37:3300/0 conn(0x7f402c0b5640 0x7f402c0731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f402a59c640 1 -- 172.21.15.82:0/1424353363 >> v2:172.21.15.37:3300/0 conn(0x7f402c0b5640 msgr2=0x7f402c0731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f402a59c640 1 --2- 172.21.15.82:0/1424353363 >> v2:172.21.15.37:3300/0 conn(0x7f402c0b5640 0x7f402c0731e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f402a59c640 1 -- 172.21.15.82:0/1424353363 >> v1:172.21.15.37:6789/0 conn(0x7f402c0b5aa0 legacy=0x7f402c0aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.535+0000 7f402a59c640 1 -- 172.21.15.82:0/1424353363 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c0b0e50 con 0x7f402c152fd0 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f402a59c640 1 --2- 172.21.15.82:0/1424353363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c152fd0 0x7f402c0b0460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f402c15d7b0 tx=0x7f401c02c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3da0987c7e748c00 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f402959a640 1 -- 172.21.15.82:0/1424353363 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c032790 con 0x7f402c152fd0 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f402959a640 1 -- 172.21.15.82:0/1424353363 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401c038070 con 0x7f402c152fd0 2024-05-10T08:39:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f402959a640 1 -- 172.21.15.82:0/1424353363 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c032b50 con 0x7f402c152fd0 2024-05-10T08:39:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f4030872640 1 -- 172.21.15.82:0/1424353363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c152fd0 msgr2=0x7f402c0b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f4030872640 1 --2- 172.21.15.82:0/1424353363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c152fd0 0x7f402c0b0460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f402c15d7b0 tx=0x7f401c02c890 comp rx=0 tx=0).stop 2024-05-10T08:39:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f4030872640 1 -- 172.21.15.82:0/1424353363 shutdown_connections 2024-05-10T08:39:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f4030872640 1 --2- 172.21.15.82:0/1424353363 >> v2:172.21.15.37:3300/0 conn(0x7f402c0b5640 0x7f402c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f4030872640 1 --2- 172.21.15.82:0/1424353363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c152fd0 0x7f402c0b0460 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.536+0000 7f4030872640 1 -- 172.21.15.82:0/1424353363 >> 172.21.15.82:0/1424353363 conn(0x7f402c0b39a0 msgr2=0x7f402c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.537+0000 7f4030872640 1 -- 172.21.15.82:0/1424353363 shutdown_connections 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.537+0000 7f4030872640 1 -- 172.21.15.82:0/1424353363 wait complete. 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.538+0000 7f4030872640 1 Processor -- start 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.538+0000 7f4030872640 1 -- start start 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c0b5640 0x7f402c147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f402c0b5aa0 0x7f402c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f402c152fd0 0x7f402c1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f402c153530 con 0x7f402c152fd0 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f402c1533b0 con 0x7f402c0b5640 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f402c0af490 con 0x7f402c0b5aa0 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f402a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c0b5640 0x7f402c147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f402a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c0b5640 0x7f402c147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56692/0 (socket says 172.21.15.82:56692) 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f402a59c640 1 -- 172.21.15.82:0/409567246 learned_addr learned my addr 172.21.15.82:0/409567246 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4029d9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f402c0b5aa0 0x7f402c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f402ad9d640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f402c152fd0 0x7f402c1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4029d9b640 1 -- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c0b5640 msgr2=0x7f402c147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4029d9b640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c0b5640 0x7f402c147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4029d9b640 1 -- 172.21.15.82:0/409567246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f402c152fd0 msgr2=0x7f402c1f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4029d9b640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f402c152fd0 0x7f402c1f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4029d9b640 1 -- 172.21.15.82:0/409567246 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c153f40 con 0x7f402c0b5aa0 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f402a59c640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c0b5640 0x7f402c147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4029d9b640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f402c0b5aa0 0x7f402c153880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f402000d620 tx=0x7f402000dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f401affd640 1 -- 172.21.15.82:0/409567246 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402000b620 con 0x7f402c0b5aa0 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f401affd640 1 -- 172.21.15.82:0/409567246 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4020019070 con 0x7f402c0b5aa0 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402c154220 con 0x7f402c0b5aa0 2024-05-10T08:39:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f401affd640 1 -- 172.21.15.82:0/409567246 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402000b9e0 con 0x7f402c0b5aa0 2024-05-10T08:39:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.539+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f402c1547e0 con 0x7f402c0b5aa0 2024-05-10T08:39:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.540+0000 7f401affd640 1 -- 172.21.15.82:0/409567246 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f402000bb80 con 0x7f402c0b5aa0 2024-05-10T08:39:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.540+0000 7f401affd640 1 -- 172.21.15.82:0/409567246 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4020014500 con 0x7f402c0b5aa0 2024-05-10T08:39:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.541+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402c069b00 con 0x7f402c0b5aa0 2024-05-10T08:39:59.542 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:39:59.543+0000 7f925a52b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T08:39:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.543+0000 7f401affd640 1 -- 172.21.15.82:0/409567246 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4020014750 con 0x7f402c0b5aa0 2024-05-10T08:39:59.554 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:39:59.555+0000 7f7f7ac13040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T08:39:59.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.615+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0c9a4718-2633-4784-ab71-04c7aa89d0eb", "id": 0} v 0) -- 0x7f402c147e00 con 0x7f402c0b5aa0 2024-05-10T08:39:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.618+0000 7f401affd640 1 -- 172.21.15.82:0/409567246 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c9a4718-2633-4784-ab71-04c7aa89d0eb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4020014a00 con 0x7f402c0b5aa0 2024-05-10T08:39:59.618 INFO:teuthology.orchestra.run.smithi082.stdout:0 2024-05-10T08:39:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f402c0b5aa0 msgr2=0x7f402c153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f402c0b5aa0 0x7f402c153880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f402000d620 tx=0x7f402000dae0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 shutdown_connections 2024-05-10T08:39:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f402c152fd0 0x7f402c1f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f402c0b5aa0 0x7f402c153880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 --2- 172.21.15.82:0/409567246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c0b5640 0x7f402c147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 >> 172.21.15.82:0/409567246 conn(0x7f402c0b39a0 msgr2=0x7f402c152610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:39:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 shutdown_connections 2024-05-10T08:39:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.619+0000 7f4030872640 1 -- 172.21.15.82:0/409567246 wait complete. 2024-05-10T08:39:59.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new ff9011a7-9ccc-497a-85ec-3aea18474d56 1 2024-05-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.729+0000 7f8cee2c4640 1 Processor -- start 2024-05-10T08:39:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.729+0000 7f8cee2c4640 1 -- start start 2024-05-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cee2c4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ce806c3a0 0x7f8ce815d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cee2c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ce806f5e0 0x7f8ce806c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cee2c4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce8161490 0x7f8ce815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cee2c4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce8160d20 con 0x7f8ce806c3a0 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cee2c4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce8161000 con 0x7f8ce806f5e0 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cee2c4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce806fa90 con 0x7f8ce8161490 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cec861640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce8161490 0x7f8ce815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cec861640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce8161490 0x7f8ce815eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42892/0 (socket says 172.21.15.82:42892) 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cec861640 1 -- 172.21.15.82:0/2130195754 learned_addr learned my addr 172.21.15.82:0/2130195754 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8ce77fe640 1 --2- 172.21.15.82:0/2130195754 >> v2:172.21.15.82:3300/0 conn(0x7f8ce806f5e0 0x7f8ce806c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8ce7fff640 1 --2- 172.21.15.82:0/2130195754 >> v2:172.21.15.37:3300/0 conn(0x7f8ce806c3a0 0x7f8ce815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8ce77fe640 1 -- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce8161490 msgr2=0x7f8ce815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8ce77fe640 1 --2- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce8161490 0x7f8ce815eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8ce77fe640 1 -- 172.21.15.82:0/2130195754 >> v2:172.21.15.37:3300/0 conn(0x7f8ce806c3a0 msgr2=0x7f8ce815d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8ce77fe640 1 --2- 172.21.15.82:0/2130195754 >> v2:172.21.15.37:3300/0 conn(0x7f8ce806c3a0 0x7f8ce815d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8ce77fe640 1 -- 172.21.15.82:0/2130195754 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce806ccc0 con 0x7f8ce806f5e0 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.730+0000 7f8cec861640 1 --2- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce8161490 0x7f8ce815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.731+0000 7f8ce77fe640 1 --2- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806f5e0 0x7f8ce806c780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80b7160 tx=0x7f8cd002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3581b32ed66c17d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.731+0000 7f8ce6ffd640 1 -- 172.21.15.82:0/2130195754 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0037070 con 0x7f8ce806f5e0 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.731+0000 7f8ce6ffd640 1 -- 172.21.15.82:0/2130195754 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd002ae50 con 0x7f8ce806f5e0 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.731+0000 7f8ce6ffd640 1 -- 172.21.15.82:0/2130195754 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0032660 con 0x7f8ce806f5e0 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 -- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806f5e0 msgr2=0x7f8ce806c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806f5e0 0x7f8ce806c780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80b7160 tx=0x7f8cd002a100 comp rx=0 tx=0).stop 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 -- 172.21.15.82:0/2130195754 shutdown_connections 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce8161490 0x7f8ce815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/2130195754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806f5e0 0x7f8ce806c780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/2130195754 >> v2:172.21.15.37:3300/0 conn(0x7f8ce806c3a0 0x7f8ce815d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 -- 172.21.15.82:0/2130195754 >> 172.21.15.82:0/2130195754 conn(0x7f8ce80b39a0 msgr2=0x7f8ce80b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:39:59.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 -- 172.21.15.82:0/2130195754 shutdown_connections 2024-05-10T08:39:59.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.732+0000 7f8cee2c4640 1 -- 172.21.15.82:0/2130195754 wait complete. 2024-05-10T08:39:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.733+0000 7f8cee2c4640 1 Processor -- start 2024-05-10T08:39:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.733+0000 7f8cee2c4640 1 -- start start 2024-05-10T08:39:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cee2c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806c3a0 0x7f8ce81f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cee2c4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce806f5e0 0x7f8ce81f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cee2c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce8161490 0x7f8ce80cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cee2c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce815e480 con 0x7f8ce8161490 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cee2c4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce815e1a0 con 0x7f8ce806c3a0 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cee2c4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce80d1390 con 0x7f8ce806f5e0 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806c3a0 0x7f8ce81f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806c3a0 0x7f8ce81f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56716/0 (socket says 172.21.15.82:56716) 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 -- 172.21.15.82:0/1515225622 learned_addr learned my addr 172.21.15.82:0/1515225622 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce77fe640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce806f5e0 0x7f8ce81f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cec861640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce8161490 0x7f8ce80cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 -- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce806f5e0 msgr2=0x7f8ce81f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce806f5e0 0x7f8ce81f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 -- 172.21.15.82:0/1515225622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce8161490 msgr2=0x7f8ce80cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce8161490 0x7f8ce80cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 -- 172.21.15.82:0/1515225622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce81f48b0 con 0x7f8ce806c3a0 2024-05-10T08:39:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce7fff640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806c3a0 0x7f8ce81f4370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800e9b0 tx=0x7f8cd800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce4ff9640 1 -- 172.21.15.82:0/1515225622 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8017070 con 0x7f8ce806c3a0 2024-05-10T08:39:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce4ff9640 1 -- 172.21.15.82:0/1515225622 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd800c9a0 con 0x7f8ce806c3a0 2024-05-10T08:39:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8ce4ff9640 1 -- 172.21.15.82:0/1515225622 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800cd90 con 0x7f8ce806c3a0 2024-05-10T08:39:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.734+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce81f4b50 con 0x7f8ce806c3a0 2024-05-10T08:39:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.735+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce81f5110 con 0x7f8ce806c3a0 2024-05-10T08:39:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.735+0000 7f8ce4ff9640 1 -- 172.21.15.82:0/1515225622 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8cd801a070 con 0x7f8ce806c3a0 2024-05-10T08:39:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.735+0000 7f8ce4ff9640 1 -- 172.21.15.82:0/1515225622 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8cd8013820 con 0x7f8ce806c3a0 2024-05-10T08:39:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.736+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce8069b00 con 0x7f8ce806c3a0 2024-05-10T08:39:59.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.738+0000 7f8ce4ff9640 1 -- 172.21.15.82:0/1515225622 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8cd80066b0 con 0x7f8ce806c3a0 2024-05-10T08:39:59.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.838+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff9011a7-9ccc-497a-85ec-3aea18474d56", "id": 1} v 0) -- 0x7f8ce80aee50 con 0x7f8ce806c3a0 2024-05-10T08:39:59.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.843+0000 7f8ce4ff9640 1 -- 172.21.15.82:0/1515225622 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff9011a7-9ccc-497a-85ec-3aea18474d56", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8cd8006020 con 0x7f8ce806c3a0 2024-05-10T08:39:59.843 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-10T08:39:59.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806c3a0 msgr2=0x7f8ce81f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806c3a0 0x7f8ce81f4370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800e9b0 tx=0x7f8cd800ee70 comp rx=0 tx=0).stop 2024-05-10T08:39:59.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 shutdown_connections 2024-05-10T08:39:59.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce8161490 0x7f8ce80cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ce806f5e0 0x7f8ce81f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 --2- 172.21.15.82:0/1515225622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce806c3a0 0x7f8ce81f4370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 >> 172.21.15.82:0/1515225622 conn(0x7f8ce80b39a0 msgr2=0x7f8ce815f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:39:59.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 shutdown_connections 2024-05-10T08:39:59.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.844+0000 7f8cee2c4640 1 -- 172.21.15.82:0/1515225622 wait complete. 2024-05-10T08:39:59.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 26b62cbb-3dfe-4b00-9677-5bcd1de28b97 2 2024-05-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.956+0000 7ff50c859640 1 Processor -- start 2024-05-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.956+0000 7ff50c859640 1 -- start start 2024-05-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50c859640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff50815c2d0 0x7ff50806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50c859640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080731c0 0x7ff508073630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50c859640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5080b55a0 con 0x7ff5080ce130 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50c859640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff508073b70 con 0x7ff50815c2d0 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50c859640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff5080aed80 con 0x7ff5080731c0 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff50815c2d0 0x7ff50806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff506d9d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080731c0 0x7ff508073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff506d9d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080731c0 0x7ff508073630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42910/0 (socket says 172.21.15.82:42910) 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff506d9d640 1 -- 172.21.15.82:0/3960209971 learned_addr learned my addr 172.21.15.82:0/3960209971 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff50815c2d0 0x7ff50806fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56728/0 (socket says 172.21.15.82:56728) 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50659c640 1 -- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080731c0 msgr2=0x7ff508073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50659c640 1 --2- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080731c0 0x7ff508073630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50659c640 1 -- 172.21.15.82:0/3960209971 >> v1:172.21.15.37:6789/0 conn(0x7ff5080ce130 legacy=0x7ff5080b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff50659c640 1 -- 172.21.15.82:0/3960209971 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080b5880 con 0x7ff50815c2d0 2024-05-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.957+0000 7ff506d9d640 1 --2- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080731c0 0x7ff508073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.958+0000 7ff50659c640 1 --2- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 0x7ff50806fda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0097d0 tx=0x7ff4fc02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c702a45de0ecb87 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.958+0000 7ff50559a640 1 -- 172.21.15.82:0/3960209971 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc037070 con 0x7ff50815c2d0 2024-05-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.958+0000 7ff50559a640 1 -- 172.21.15.82:0/3960209971 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc02ae40 con 0x7ff50815c2d0 2024-05-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.958+0000 7ff50559a640 1 -- 172.21.15.82:0/3960209971 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc032660 con 0x7ff50815c2d0 2024-05-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 -- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 msgr2=0x7ff50806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 --2- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 0x7ff50806fda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0097d0 tx=0x7ff4fc02a130 comp rx=0 tx=0).stop 2024-05-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 -- 172.21.15.82:0/3960209971 shutdown_connections 2024-05-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 --2- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080731c0 0x7ff508073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 --2- 172.21.15.82:0/3960209971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 0x7ff50806fda0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 -- 172.21.15.82:0/3960209971 >> 172.21.15.82:0/3960209971 conn(0x7ff5080b39a0 msgr2=0x7ff5080b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 -- 172.21.15.82:0/3960209971 shutdown_connections 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.959+0000 7ff50c859640 1 -- 172.21.15.82:0/3960209971 wait complete. 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.960+0000 7ff50c859640 1 Processor -- start 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.960+0000 7ff50c859640 1 -- start start 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff50c859640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080731c0 0x7ff5081f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff50c859640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080ce130 0x7ff5081483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff50c859640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 0x7ff508166ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff50c859640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff508165cd0 con 0x7ff5080731c0 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff50c859640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff5080b5e40 con 0x7ff50815c2d0 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff50c859640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff508165e50 con 0x7ff5080ce130 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff505d9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080ce130 0x7ff5081483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff505d9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080ce130 0x7ff5081483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42916/0 (socket says 172.21.15.82:42916) 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff506d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 0x7ff508166ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff505d9b640 1 -- 172.21.15.82:0/64798887 learned_addr learned my addr 172.21.15.82:0/64798887 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.961+0000 7ff50659c640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080731c0 0x7ff5081f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff505d9b640 1 -- 172.21.15.82:0/64798887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 msgr2=0x7ff508166ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff505d9b640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 0x7ff508166ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff505d9b640 1 -- 172.21.15.82:0/64798887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080731c0 msgr2=0x7ff5081f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff505d9b640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080731c0 0x7ff5081f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff505d9b640 1 -- 172.21.15.82:0/64798887 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff508163d70 con 0x7ff5080ce130 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff505d9b640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080ce130 0x7ff5081483d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c440 tx=0x7ff4f8001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff4f6ffd640 1 -- 172.21.15.82:0/64798887 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80052d0 con 0x7ff5080ce130 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff4f6ffd640 1 -- 172.21.15.82:0/64798887 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f8005470 con 0x7ff5080ce130 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff508167530 con 0x7ff5080ce130 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff4f6ffd640 1 -- 172.21.15.82:0/64798887 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8007260 con 0x7ff5080ce130 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff508167af0 con 0x7ff5080ce130 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff4f6ffd640 1 -- 172.21.15.82:0/64798887 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4f8007400 con 0x7ff5080ce130 2024-05-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.962+0000 7ff4f6ffd640 1 -- 172.21.15.82:0/64798887 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff4f8011590 con 0x7ff5080ce130 2024-05-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.963+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff508069b00 con 0x7ff5080ce130 2024-05-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:39:59.965+0000 7ff4f6ffd640 1 -- 172.21.15.82:0/64798887 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff4f8003650 con 0x7ff5080ce130 2024-05-10T08:40:00.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.038+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "26b62cbb-3dfe-4b00-9677-5bcd1de28b97", "id": 2} v 0) -- 0x7ff508071720 con 0x7ff5080ce130 2024-05-10T08:40:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.043+0000 7ff4f6ffd640 1 -- 172.21.15.82:0/64798887 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26b62cbb-3dfe-4b00-9677-5bcd1de28b97", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff4f8003b30 con 0x7ff5080ce130 2024-05-10T08:40:00.043 INFO:teuthology.orchestra.run.smithi082.stdout:2 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080ce130 msgr2=0x7ff5081483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080ce130 0x7ff5081483d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c440 tx=0x7ff4f8001e70 comp rx=0 tx=0).stop 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 shutdown_connections 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50815c2d0 0x7ff508166ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff5080ce130 0x7ff5081483d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 --2- 172.21.15.82:0/64798887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080731c0 0x7ff5081f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 >> 172.21.15.82:0/64798887 conn(0x7ff5080b39a0 msgr2=0x7ff508070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 shutdown_connections 2024-05-10T08:40:00.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.044+0000 7ff50c859640 1 -- 172.21.15.82:0/64798887 wait complete. 2024-05-10T08:40:00.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 63928d05-b063-47f9-81b1-4b0122a8a15c 3 2024-05-10T08:40:00.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.164+0000 7fa7d47da640 1 Processor -- start 2024-05-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.164+0000 7fa7d47da640 1 -- start start 2024-05-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d47da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa7cc1638e0 0x7fa7cc0b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d47da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc06c3a0 0x7fa7cc06c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d47da640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7cc0b14e0 con 0x7fa7cc15f0c0 2024-05-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d47da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa7cc163450 con 0x7fa7cc1638e0 2024-05-10T08:40:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d47da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc1604b0 con 0x7fa7cc06c3a0 2024-05-10T08:40:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d1d75640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa7cc1638e0 0x7fa7cc0b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d2d77640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc06c3a0 0x7fa7cc06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d1d75640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa7cc1638e0 0x7fa7cc0b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56750/0 (socket says 172.21.15.82:56750) 2024-05-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.165+0000 7fa7d1d75640 1 -- 172.21.15.82:0/610442069 learned_addr learned my addr 172.21.15.82:0/610442069 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.166+0000 7fa7d2d77640 1 -- 172.21.15.82:0/610442069 >> v2:172.21.15.82:3300/0 conn(0x7fa7cc1638e0 msgr2=0x7fa7cc0b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.166+0000 7fa7d2d77640 1 --2- 172.21.15.82:0/610442069 >> v2:172.21.15.82:3300/0 conn(0x7fa7cc1638e0 0x7fa7cc0b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.166+0000 7fa7d2d77640 1 -- 172.21.15.82:0/610442069 >> v1:172.21.15.37:6789/0 conn(0x7fa7cc15f0c0 legacy=0x7fa7cc0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.166+0000 7fa7d2d77640 1 -- 172.21.15.82:0/610442069 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc162e00 con 0x7fa7cc06c3a0 2024-05-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.166+0000 7fa7d2d77640 1 --2- 172.21.15.82:0/610442069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc06c3a0 0x7fa7cc06c830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009d90 tx=0x7fa7c402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c32d71b1ac540a80 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.166+0000 7fa7d1574640 1 -- 172.21.15.82:0/610442069 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4007740 con 0x7fa7cc06c3a0 2024-05-10T08:40:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d1574640 1 -- 172.21.15.82:0/610442069 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c40078e0 con 0x7fa7cc06c3a0 2024-05-10T08:40:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d1574640 1 -- 172.21.15.82:0/610442069 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4007cb0 con 0x7fa7cc06c3a0 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 -- 172.21.15.82:0/610442069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc06c3a0 msgr2=0x7fa7cc06c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 --2- 172.21.15.82:0/610442069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc06c3a0 0x7fa7cc06c830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009d90 tx=0x7fa7c402a660 comp rx=0 tx=0).stop 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 -- 172.21.15.82:0/610442069 shutdown_connections 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 --2- 172.21.15.82:0/610442069 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc06c3a0 0x7fa7cc06c830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 --2- 172.21.15.82:0/610442069 >> v2:172.21.15.82:3300/0 conn(0x7fa7cc1638e0 0x7fa7cc0b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 -- 172.21.15.82:0/610442069 >> 172.21.15.82:0/610442069 conn(0x7fa7cc0b3b10 msgr2=0x7fa7cc0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 -- 172.21.15.82:0/610442069 shutdown_connections 2024-05-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.167+0000 7fa7d47da640 1 -- 172.21.15.82:0/610442069 wait complete. 2024-05-10T08:40:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.168+0000 7fa7d47da640 1 Processor -- start 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d47da640 1 -- start start 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d47da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc06c3a0 0x7fa7cc1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d47da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc15f0c0 0x7fa7cc159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d47da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7cc1638e0 0x7fa7cc070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d47da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc15f4a0 con 0x7fa7cc06c3a0 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d47da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc0b17c0 con 0x7fa7cc1638e0 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d47da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc15f620 con 0x7fa7cc15f0c0 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d2d77640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7cc1638e0 0x7fa7cc070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d1d75640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc15f0c0 0x7fa7cc159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d2d77640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7cc1638e0 0x7fa7cc070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56764/0 (socket says 172.21.15.82:56764) 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d2d77640 1 -- 172.21.15.82:0/1234833518 learned_addr learned my addr 172.21.15.82:0/1234833518 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d1d75640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc15f0c0 0x7fa7cc159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42942/0 (socket says 172.21.15.82:42942) 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.169+0000 7fa7d2576640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc06c3a0 0x7fa7cc1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d2d77640 1 -- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc15f0c0 msgr2=0x7fa7cc159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d2d77640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc15f0c0 0x7fa7cc159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d2d77640 1 -- 172.21.15.82:0/1234833518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc06c3a0 msgr2=0x7fa7cc1f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d2d77640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc06c3a0 0x7fa7cc1f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d2d77640 1 -- 172.21.15.82:0/1234833518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc1f93d0 con 0x7fa7cc1638e0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d1d75640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc15f0c0 0x7fa7cc159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d2d77640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7cc1638e0 0x7fa7cc070600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009eb0 tx=0x7fa7c4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7c2ffd640 1 -- 172.21.15.82:0/1234833518 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4040070 con 0x7fa7cc1638e0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7c2ffd640 1 -- 172.21.15.82:0/1234833518 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c4031bc0 con 0x7fa7cc1638e0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc1f90f0 con 0x7fa7cc1638e0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7c2ffd640 1 -- 172.21.15.82:0/1234833518 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4009450 con 0x7fa7cc1638e0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc1f52e0 con 0x7fa7cc1638e0 2024-05-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7c2ffd640 1 -- 172.21.15.82:0/1234833518 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa7c4039040 con 0x7fa7cc1638e0 2024-05-10T08:40:00.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.170+0000 7fa7c2ffd640 1 -- 172.21.15.82:0/1234833518 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa7c4045d20 con 0x7fa7cc1638e0 2024-05-10T08:40:00.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.171+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7cc06a8f0 con 0x7fa7cc1638e0 2024-05-10T08:40:00.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.173+0000 7fa7c2ffd640 1 -- 172.21.15.82:0/1234833518 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa7c4007840 con 0x7fa7cc1638e0 2024-05-10T08:40:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.245+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "63928d05-b063-47f9-81b1-4b0122a8a15c", "id": 3} v 0) -- 0x7fa7cc0b38f0 con 0x7fa7cc1638e0 2024-05-10T08:40:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7c2ffd640 1 -- 172.21.15.82:0/1234833518 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63928d05-b063-47f9-81b1-4b0122a8a15c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa7c4045460 con 0x7fa7cc1638e0 2024-05-10T08:40:00.250 INFO:teuthology.orchestra.run.smithi082.stdout:3 2024-05-10T08:40:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7cc1638e0 msgr2=0x7fa7cc070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7cc1638e0 0x7fa7cc070600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009eb0 tx=0x7fa7c4004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 shutdown_connections 2024-05-10T08:40:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7cc1638e0 0x7fa7cc070600 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7cc15f0c0 0x7fa7cc159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 --2- 172.21.15.82:0/1234833518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc06c3a0 0x7fa7cc1f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 >> 172.21.15.82:0/1234833518 conn(0x7fa7cc0b3b10 msgr2=0x7fa7cc0b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.251+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 shutdown_connections 2024-05-10T08:40:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.252+0000 7fa7d47da640 1 -- 172.21.15.82:0/1234833518 wait complete. 2024-05-10T08:40:00.261 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 51a5fd27-b892-46cf-b930-6e3aba97c2a9 4 2024-05-10T08:40:00.329 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:00.330+0000 7f7f7ac13040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T08:40:00.360 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:00.360+0000 7f925a52b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T08:40:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.362+0000 7fc8bfc2a640 1 Processor -- start 2024-05-10T08:40:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.362+0000 7fc8bfc2a640 1 -- start start 2024-05-10T08:40:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8bfc2a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b80738d0 0x7fc8b806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8bfc2a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b80b55a0 con 0x7fc8b815c2d0 2024-05-10T08:40:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8bfc2a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b80b5880 con 0x7fc8b80ce130 2024-05-10T08:40:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8bfc2a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b80aed80 con 0x7fc8b80738d0 2024-05-10T08:40:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8be1c7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b80738d0 0x7fc8b806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8bd1c5640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc8b80ce130 0x7fc8b80731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55406/0 (socket says 172.21.15.82:55406) 2024-05-10T08:40:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8bd1c5640 1 -- 172.21.15.82:0/1685839622 learned_addr learned my addr 172.21.15.82:0/1685839622 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T08:40:00.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8bc9c4640 1 -- 172.21.15.82:0/1685839622 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750281439 0 0) 0x7fc8b80b5880 con 0x7fc8b80ce130 2024-05-10T08:40:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8be1c7640 1 -- 172.21.15.82:0/1685839622 >> v1:172.21.15.82:6789/0 conn(0x7fc8b80ce130 legacy=0x7fc8b80731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8be1c7640 1 -- 172.21.15.82:0/1685839622 >> v1:172.21.15.37:6789/0 conn(0x7fc8b815c2d0 legacy=0x7fc8b80b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.363+0000 7fc8be1c7640 1 -- 172.21.15.82:0/1685839622 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80b5b60 con 0x7fc8b80738d0 2024-05-10T08:40:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.364+0000 7fc8be1c7640 1 --2- 172.21.15.82:0/1685839622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b80738d0 0x7fc8b806fda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009dc0 tx=0x7fc8b002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54212efc4ca42762 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.364+0000 7fc8bc9c4640 1 -- 172.21.15.82:0/1685839622 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b002ae60 con 0x7fc8b80738d0 2024-05-10T08:40:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.364+0000 7fc8bc9c4640 1 -- 172.21.15.82:0/1685839622 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0007740 con 0x7fc8b80738d0 2024-05-10T08:40:00.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.364+0000 7fc8bc9c4640 1 -- 172.21.15.82:0/1685839622 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0007b10 con 0x7fc8b80738d0 2024-05-10T08:40:00.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.365+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/1685839622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b80738d0 msgr2=0x7fc8b806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.365+0000 7fc8bfc2a640 1 --2- 172.21.15.82:0/1685839622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b80738d0 0x7fc8b806fda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009dc0 tx=0x7fc8b002a640 comp rx=0 tx=0).stop 2024-05-10T08:40:00.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.365+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/1685839622 shutdown_connections 2024-05-10T08:40:00.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.365+0000 7fc8bfc2a640 1 --2- 172.21.15.82:0/1685839622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b80738d0 0x7fc8b806fda0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.365+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/1685839622 >> 172.21.15.82:0/1685839622 conn(0x7fc8b80b39a0 msgr2=0x7fc8b80b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.365+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/1685839622 shutdown_connections 2024-05-10T08:40:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.365+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/1685839622 wait complete. 2024-05-10T08:40:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.366+0000 7fc8bfc2a640 1 Processor -- start 2024-05-10T08:40:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.366+0000 7fc8bfc2a640 1 -- start start 2024-05-10T08:40:00.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b80738d0 0x7fc8b81f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b80ce130 0x7fc8b81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b815c2d0 0x7fc8b815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8166e60 con 0x7fc8b80ce130 2024-05-10T08:40:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8166ce0 con 0x7fc8b80738d0 2024-05-10T08:40:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b8166fe0 con 0x7fc8b815c2d0 2024-05-10T08:40:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bd9c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b80738d0 0x7fc8b81f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8be1c7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b815c2d0 0x7fc8b815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bd9c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b80738d0 0x7fc8b81f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56776/0 (socket says 172.21.15.82:56776) 2024-05-10T08:40:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bd9c6640 1 -- 172.21.15.82:0/4158198780 learned_addr learned my addr 172.21.15.82:0/4158198780 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:40:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bd1c5640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b80ce130 0x7fc8b81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8be1c7640 1 -- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b80738d0 msgr2=0x7fc8b81f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8be1c7640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b80738d0 0x7fc8b81f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8be1c7640 1 -- 172.21.15.82:0/4158198780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b80ce130 msgr2=0x7fc8b81499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8be1c7640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b80ce130 0x7fc8b81499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8be1c7640 1 -- 172.21.15.82:0/4158198780 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b81471f0 con 0x7fc8b815c2d0 2024-05-10T08:40:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bd9c6640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b80738d0 0x7fc8b81f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8be1c7640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b815c2d0 0x7fc8b815e8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0031000 tx=0x7fc8b0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8ae7fc640 1 -- 172.21.15.82:0/4158198780 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0040070 con 0x7fc8b815c2d0 2024-05-10T08:40:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8ae7fc640 1 -- 172.21.15.82:0/4158198780 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b002ae60 con 0x7fc8b815c2d0 2024-05-10T08:40:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8ae7fc640 1 -- 172.21.15.82:0/4158198780 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0045460 con 0x7fc8b815c2d0 2024-05-10T08:40:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b8145db0 con 0x7fc8b815c2d0 2024-05-10T08:40:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.367+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b8146370 con 0x7fc8b815c2d0 2024-05-10T08:40:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.368+0000 7fc8ae7fc640 1 -- 172.21.15.82:0/4158198780 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc8b0039040 con 0x7fc8b815c2d0 2024-05-10T08:40:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.368+0000 7fc8ae7fc640 1 -- 172.21.15.82:0/4158198780 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc8b003c930 con 0x7fc8b815c2d0 2024-05-10T08:40:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.368+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b8146ab0 con 0x7fc8b815c2d0 2024-05-10T08:40:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.370+0000 7fc8ae7fc640 1 -- 172.21.15.82:0/4158198780 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc8b003cbd0 con 0x7fc8b815c2d0 2024-05-10T08:40:00.422 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:00.422+0000 7f7f7ac13040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T08:40:00.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.442+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "51a5fd27-b892-46cf-b930-6e3aba97c2a9", "id": 4} v 0) -- 0x7fc8b8069b00 con 0x7fc8b815c2d0 2024-05-10T08:40:00.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.448+0000 7fc8ae7fc640 1 -- 172.21.15.82:0/4158198780 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51a5fd27-b892-46cf-b930-6e3aba97c2a9", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fc8b003cdb0 con 0x7fc8b815c2d0 2024-05-10T08:40:00.447 INFO:teuthology.orchestra.run.smithi082.stdout:4 2024-05-10T08:40:00.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b815c2d0 msgr2=0x7fc8b815e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b815c2d0 0x7fc8b815e8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0031000 tx=0x7fc8b0004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 shutdown_connections 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8b815c2d0 0x7fc8b815e8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b80ce130 0x7fc8b81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 --2- 172.21.15.82:0/4158198780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b80738d0 0x7fc8b81f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 >> 172.21.15.82:0/4158198780 conn(0x7fc8b80b39a0 msgr2=0x7fc8b8150b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 shutdown_connections 2024-05-10T08:40:00.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.449+0000 7fc8bfc2a640 1 -- 172.21.15.82:0/4158198780 wait complete. 2024-05-10T08:40:00.452 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:00.452+0000 7f925a52b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T08:40:00.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new de4214e4-0bc7-478d-8662-1add521cf7b4 5 2024-05-10T08:40:00.467 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:00.468+0000 7f7f7ac13040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T08:40:00.497 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:00.498+0000 7f925a52b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T08:40:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.559+0000 7f54c3c83640 1 Processor -- start 2024-05-10T08:40:00.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.559+0000 7f54c3c83640 1 -- start start 2024-05-10T08:40:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c3c83640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54bc1524f0 0x7f54bc0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c3c83640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc15bc80 0x7f54bc06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c3c83640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54bc0b4590 con 0x7f54bc06e8d0 2024-05-10T08:40:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c3c83640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc0b51a0 con 0x7f54bc1524f0 2024-05-10T08:40:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c3c83640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc073450 con 0x7f54bc15bc80 2024-05-10T08:40:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c1a1f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54bc1524f0 0x7f54bc0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c121e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc15bc80 0x7f54bc06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c1a1f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54bc1524f0 0x7f54bc0b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56784/0 (socket says 172.21.15.82:56784) 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c121e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc15bc80 0x7f54bc06e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42974/0 (socket says 172.21.15.82:42974) 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.560+0000 7f54c1a1f640 1 -- 172.21.15.82:0/1229460855 learned_addr learned my addr 172.21.15.82:0/1229460855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c121e640 1 -- 172.21.15.82:0/1229460855 >> v2:172.21.15.82:3300/0 conn(0x7f54bc1524f0 msgr2=0x7f54bc0b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c121e640 1 --2- 172.21.15.82:0/1229460855 >> v2:172.21.15.82:3300/0 conn(0x7f54bc1524f0 0x7f54bc0b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c121e640 1 -- 172.21.15.82:0/1229460855 >> v1:172.21.15.37:6789/0 conn(0x7f54bc06e8d0 legacy=0x7f54bc073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c121e640 1 -- 172.21.15.82:0/1229460855 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0b4870 con 0x7f54bc15bc80 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c1a1f640 1 --2- 172.21.15.82:0/1229460855 >> v2:172.21.15.82:3300/0 conn(0x7f54bc1524f0 0x7f54bc0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c121e640 1 --2- 172.21.15.82:0/1229460855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc15bc80 0x7f54bc06e390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097a0 tx=0x7f54b802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f46e08bdf64b8dc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c0a1d640 1 -- 172.21.15.82:0/1229460855 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8037070 con 0x7f54bc15bc80 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c0a1d640 1 -- 172.21.15.82:0/1229460855 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b8032440 con 0x7f54bc15bc80 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.561+0000 7f54c0a1d640 1 -- 172.21.15.82:0/1229460855 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8032810 con 0x7f54bc15bc80 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 -- 172.21.15.82:0/1229460855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc15bc80 msgr2=0x7f54bc06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 --2- 172.21.15.82:0/1229460855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc15bc80 0x7f54bc06e390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097a0 tx=0x7f54b802a180 comp rx=0 tx=0).stop 2024-05-10T08:40:00.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 -- 172.21.15.82:0/1229460855 shutdown_connections 2024-05-10T08:40:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 --2- 172.21.15.82:0/1229460855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc15bc80 0x7f54bc06e390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 --2- 172.21.15.82:0/1229460855 >> v2:172.21.15.82:3300/0 conn(0x7f54bc1524f0 0x7f54bc0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 -- 172.21.15.82:0/1229460855 >> 172.21.15.82:0/1229460855 conn(0x7f54bc06c3a0 msgr2=0x7f54bc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 -- 172.21.15.82:0/1229460855 shutdown_connections 2024-05-10T08:40:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.562+0000 7f54c3c83640 1 -- 172.21.15.82:0/1229460855 wait complete. 2024-05-10T08:40:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.563+0000 7f54c3c83640 1 Processor -- start 2024-05-10T08:40:00.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.563+0000 7f54c3c83640 1 -- start start 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c3c83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc06e8d0 0x7f54bc0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c3c83640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc1524f0 0x7f54bc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c3c83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54bc15bc80 0x7f54bc0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c3c83640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1528d0 con 0x7f54bc06e8d0 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c3c83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0b4e30 con 0x7f54bc15bc80 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c3c83640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0b5630 con 0x7f54bc1524f0 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c121e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc1524f0 0x7f54bc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54bc15bc80 0x7f54bc0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54bc15bc80 0x7f54bc0ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56798/0 (socket says 172.21.15.82:56798) 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 -- 172.21.15.82:0/4203152463 learned_addr learned my addr 172.21.15.82:0/4203152463 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c121e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc1524f0 0x7f54bc15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:42986/0 (socket says 172.21.15.82:42986) 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c1a1f640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc06e8d0 0x7f54bc0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 -- 172.21.15.82:0/4203152463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc1524f0 msgr2=0x7f54bc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc1524f0 0x7f54bc15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 -- 172.21.15.82:0/4203152463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc06e8d0 msgr2=0x7f54bc0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc06e8d0 0x7f54bc0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.564+0000 7f54c2220640 1 -- 172.21.15.82:0/4203152463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0cd550 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54c2220640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54bc15bc80 0x7f54bc0ae980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54b400c7a0 tx=0x7f54b400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54b27fc640 1 -- 172.21.15.82:0/4203152463 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4003b70 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54b27fc640 1 -- 172.21.15.82:0/4203152463 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b4003d30 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc16a350 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54b27fc640 1 -- 172.21.15.82:0/4203152463 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b400aa90 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc0ae180 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54b27fc640 1 -- 172.21.15.82:0/4203152463 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f54b400ac30 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.565+0000 7f54b27fc640 1 -- 172.21.15.82:0/4203152463 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f54b4012b30 con 0x7f54bc15bc80 2024-05-10T08:40:00.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.566+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc06f110 con 0x7f54bc15bc80 2024-05-10T08:40:00.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.569+0000 7f54b27fc640 1 -- 172.21.15.82:0/4203152463 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f54bc06f110 con 0x7f54bc15bc80 2024-05-10T08:40:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.642+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "de4214e4-0bc7-478d-8662-1add521cf7b4", "id": 5} v 0) -- 0x7f54bc0693f0 con 0x7f54bc15bc80 2024-05-10T08:40:00.642 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:00.643+0000 7f7f7ac13040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T08:40:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.647+0000 7f54b27fc640 1 -- 172.21.15.82:0/4203152463 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de4214e4-0bc7-478d-8662-1add521cf7b4", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f54b40050d0 con 0x7f54bc15bc80 2024-05-10T08:40:00.647 INFO:teuthology.orchestra.run.smithi082.stdout:5 2024-05-10T08:40:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54bc15bc80 msgr2=0x7f54bc0ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54bc15bc80 0x7f54bc0ae980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54b400c7a0 tx=0x7f54b400cc60 comp rx=0 tx=0).stop 2024-05-10T08:40:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 shutdown_connections 2024-05-10T08:40:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54bc15bc80 0x7f54bc0ae980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54bc1524f0 0x7f54bc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 --2- 172.21.15.82:0/4203152463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc06e8d0 0x7f54bc0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 >> 172.21.15.82:0/4203152463 conn(0x7f54bc06c3a0 msgr2=0x7f54bc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 shutdown_connections 2024-05-10T08:40:00.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.648+0000 7f54c3c83640 1 -- 172.21.15.82:0/4203152463 wait complete. 2024-05-10T08:40:00.659 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 04f4a5ee-892a-4376-a7c9-b0f1c24e7936 6 2024-05-10T08:40:00.674 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:00.674+0000 7f925a52b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T08:40:00.701 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:00.701+0000 7f7f7ac13040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T08:40:00.728 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:00.729+0000 7f925a52b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T08:40:00.756 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:00.756+0000 7f7f7ac13040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T08:40:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.774+0000 7fda747dd640 1 Processor -- start 2024-05-10T08:40:00.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.774+0000 7fda747dd640 1 -- start start 2024-05-10T08:40:00.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.775+0000 7fda747dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c0738d0 0x7fda6c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.775+0000 7fda747dd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c0b55a0 con 0x7fda6c15c2d0 2024-05-10T08:40:00.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.775+0000 7fda747dd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c0b5880 con 0x7fda6c0ce130 2024-05-10T08:40:00.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.775+0000 7fda747dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda6c0aed80 con 0x7fda6c0738d0 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.775+0000 7fda71d78640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fda6c0ce130 0x7fda6c0731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55408/0 (socket says 172.21.15.82:55408) 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.775+0000 7fda72d7a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c0738d0 0x7fda6c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.775+0000 7fda71d78640 1 -- 172.21.15.82:0/3236636322 learned_addr learned my addr 172.21.15.82:0/3236636322 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.776+0000 7fda71577640 1 -- 172.21.15.82:0/3236636322 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420216913 0 0) 0x7fda6c0b5880 con 0x7fda6c0ce130 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.776+0000 7fda71577640 1 -- 172.21.15.82:0/3236636322 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda58003520 con 0x7fda6c0ce130 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.776+0000 7fda72d7a640 1 -- 172.21.15.82:0/3236636322 >> v1:172.21.15.82:6789/0 conn(0x7fda6c0ce130 legacy=0x7fda6c0731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.776+0000 7fda72d7a640 1 -- 172.21.15.82:0/3236636322 >> v1:172.21.15.37:6789/0 conn(0x7fda6c15c2d0 legacy=0x7fda6c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.776+0000 7fda71577640 1 -- 172.21.15.82:0/3236636322 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909643905 0 0) 0x7fda6c0b55a0 con 0x7fda6c15c2d0 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.776+0000 7fda72d7a640 1 -- 172.21.15.82:0/3236636322 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c0b5b60 con 0x7fda6c0738d0 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.777+0000 7fda72d7a640 1 --2- 172.21.15.82:0/3236636322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c0738d0 0x7fda6c06fda0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fda64009dc0 tx=0x7fda6402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71959ce4648a044e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.777+0000 7fda71577640 1 -- 172.21.15.82:0/3236636322 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6402ae60 con 0x7fda6c0738d0 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.777+0000 7fda71577640 1 -- 172.21.15.82:0/3236636322 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64007740 con 0x7fda6c0738d0 2024-05-10T08:40:00.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.777+0000 7fda71577640 1 -- 172.21.15.82:0/3236636322 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64007b10 con 0x7fda6c0738d0 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.778+0000 7fda747dd640 1 -- 172.21.15.82:0/3236636322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c0738d0 msgr2=0x7fda6c06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.778+0000 7fda747dd640 1 --2- 172.21.15.82:0/3236636322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c0738d0 0x7fda6c06fda0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fda64009dc0 tx=0x7fda6402a640 comp rx=0 tx=0).stop 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.778+0000 7fda747dd640 1 -- 172.21.15.82:0/3236636322 shutdown_connections 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.778+0000 7fda747dd640 1 --2- 172.21.15.82:0/3236636322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c0738d0 0x7fda6c06fda0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.778+0000 7fda747dd640 1 -- 172.21.15.82:0/3236636322 >> 172.21.15.82:0/3236636322 conn(0x7fda6c0b39a0 msgr2=0x7fda6c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.778+0000 7fda747dd640 1 -- 172.21.15.82:0/3236636322 shutdown_connections 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.778+0000 7fda747dd640 1 -- 172.21.15.82:0/3236636322 wait complete. 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.779+0000 7fda747dd640 1 Processor -- start 2024-05-10T08:40:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.779+0000 7fda747dd640 1 -- start start 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda747dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c0738d0 0x7fda6c0d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda747dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda6c0ce130 0x7fda6c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda747dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c15c2d0 0x7fda6c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda747dd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c166e60 con 0x7fda6c0ce130 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda747dd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c166ce0 con 0x7fda6c0738d0 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda747dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda6c166fe0 con 0x7fda6c15c2d0 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c0738d0 0x7fda6c0d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72d7a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c15c2d0 0x7fda6c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c0738d0 0x7fda6c0d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56806/0 (socket says 172.21.15.82:56806) 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72d7a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c15c2d0 0x7fda6c150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:43000/0 (socket says 172.21.15.82:43000) 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 -- 172.21.15.82:0/1692894916 learned_addr learned my addr 172.21.15.82:0/1692894916 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda71d78640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda6c0ce130 0x7fda6c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 -- 172.21.15.82:0/1692894916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c15c2d0 msgr2=0x7fda6c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c15c2d0 0x7fda6c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 -- 172.21.15.82:0/1692894916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda6c0ce130 msgr2=0x7fda6c15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda6c0ce130 0x7fda6c15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 -- 172.21.15.82:0/1692894916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c0ceb40 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda72579640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c0738d0 0x7fda6c0d0570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c440 tx=0x7fda5c00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda62ffd640 1 -- 172.21.15.82:0/1692894916 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c017070 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda62ffd640 1 -- 172.21.15.82:0/1692894916 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c0035f0 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda62ffd640 1 -- 172.21.15.82:0/1692894916 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0039e0 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.780+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c0cee20 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.781+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6c0cf3e0 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.781+0000 7fda62ffd640 1 -- 172.21.15.82:0/1692894916 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda5c01a070 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.781+0000 7fda62ffd640 1 -- 172.21.15.82:0/1692894916 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fda5c0129f0 con 0x7fda6c0738d0 2024-05-10T08:40:00.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.781+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6c069b00 con 0x7fda6c0738d0 2024-05-10T08:40:00.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.783+0000 7fda62ffd640 1 -- 172.21.15.82:0/1692894916 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fda5c021020 con 0x7fda6c0738d0 2024-05-10T08:40:00.785 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:00.785+0000 7f925a52b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T08:40:00.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.856+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "04f4a5ee-892a-4376-a7c9-b0f1c24e7936", "id": 6} v 0) -- 0x7fda6c14fc50 con 0x7fda6c0738d0 2024-05-10T08:40:00.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.859+0000 7fda62ffd640 1 -- 172.21.15.82:0/1692894916 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04f4a5ee-892a-4376-a7c9-b0f1c24e7936", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fda5c003c50 con 0x7fda6c0738d0 2024-05-10T08:40:00.859 INFO:teuthology.orchestra.run.smithi082.stdout:6 2024-05-10T08:40:00.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.859+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c0738d0 msgr2=0x7fda6c0d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.859+0000 7fda747dd640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c0738d0 0x7fda6c0d0570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c440 tx=0x7fda5c00c900 comp rx=0 tx=0).stop 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.860+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 shutdown_connections 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.860+0000 7fda747dd640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda6c15c2d0 0x7fda6c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.860+0000 7fda747dd640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda6c0ce130 0x7fda6c15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.860+0000 7fda747dd640 1 --2- 172.21.15.82:0/1692894916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c0738d0 0x7fda6c0d0570 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.860+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 >> 172.21.15.82:0/1692894916 conn(0x7fda6c0b39a0 msgr2=0x7fda6c0731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.860+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 shutdown_connections 2024-05-10T08:40:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.860+0000 7fda747dd640 1 -- 172.21.15.82:0/1692894916 wait complete. 2024-05-10T08:40:00.869 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new d695235e-80d9-4065-853a-7f96a9b1dfb8 7 2024-05-10T08:40:00.875 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:00.875+0000 7f7f7ac13040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T08:40:00.903 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:00.904+0000 7f925a52b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T08:40:00.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.970+0000 7f122cd89640 1 Processor -- start 2024-05-10T08:40:00.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.970+0000 7f122cd89640 1 -- start start 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122cd89640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806c3a0 0x7f122815d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122cd89640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122806fa60 con 0x7f1228161490 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122cd89640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122815dec0 con 0x7f122806f5e0 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122cd89640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1228160d20 con 0x7f122806c3a0 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f1225d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f122806f5e0 0x7f122806c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55416/0 (socket says 172.21.15.82:55416) 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f1225d9b640 1 -- 172.21.15.82:0/4164046714 learned_addr learned my addr 172.21.15.82:0/4164046714 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122659c640 1 --2- 172.21.15.82:0/4164046714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806c3a0 0x7f122815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122559a640 1 -- 172.21.15.82:0/4164046714 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829328026 0 0) 0x7f122815dec0 con 0x7f122806f5e0 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122559a640 1 -- 172.21.15.82:0/4164046714 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1210003520 con 0x7f122806f5e0 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122659c640 1 -- 172.21.15.82:0/4164046714 >> v1:172.21.15.82:6789/0 conn(0x7f122806f5e0 legacy=0x7f122806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122659c640 1 -- 172.21.15.82:0/4164046714 >> v1:172.21.15.37:6789/0 conn(0x7f1228161490 legacy=0x7f122815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.971+0000 7f122659c640 1 -- 172.21.15.82:0/4164046714 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122815e1a0 con 0x7f122806c3a0 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.972+0000 7f122659c640 1 --2- 172.21.15.82:0/4164046714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806c3a0 0x7f122815d790 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12180097d0 tx=0x7f121802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e139491b6b215e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.972+0000 7f122559a640 1 -- 172.21.15.82:0/4164046714 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218037070 con 0x7f122806c3a0 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.972+0000 7f122559a640 1 -- 172.21.15.82:0/4164046714 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1218032440 con 0x7f122806c3a0 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.972+0000 7f122559a640 1 -- 172.21.15.82:0/4164046714 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12180327f0 con 0x7f122806c3a0 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.973+0000 7f122cd89640 1 -- 172.21.15.82:0/4164046714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806c3a0 msgr2=0x7f122815d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.973+0000 7f122cd89640 1 --2- 172.21.15.82:0/4164046714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806c3a0 0x7f122815d790 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12180097d0 tx=0x7f121802a210 comp rx=0 tx=0).stop 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.973+0000 7f122cd89640 1 -- 172.21.15.82:0/4164046714 shutdown_connections 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.973+0000 7f122cd89640 1 --2- 172.21.15.82:0/4164046714 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806c3a0 0x7f122815d790 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.973+0000 7f122cd89640 1 -- 172.21.15.82:0/4164046714 >> 172.21.15.82:0/4164046714 conn(0x7f12280b39a0 msgr2=0x7f12280b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.973+0000 7f122cd89640 1 -- 172.21.15.82:0/4164046714 shutdown_connections 2024-05-10T08:40:00.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.973+0000 7f122cd89640 1 -- 172.21.15.82:0/4164046714 wait complete. 2024-05-10T08:40:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.974+0000 7f122cd89640 1 Processor -- start 2024-05-10T08:40:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.974+0000 7f122cd89640 1 -- start start 2024-05-10T08:40:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f122cd89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f122806c3a0 0x7f122815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f122cd89640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806f5e0 0x7f122809e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f122cd89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1228161490 0x7f122809ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f122cd89640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12280d1390 con 0x7f122806c3a0 2024-05-10T08:40:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f122cd89640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1228161000 con 0x7f1228161490 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f122cd89640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f12280d1510 con 0x7f122806f5e0 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1228161490 0x7f122809ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1225d9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806f5e0 0x7f122809e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1228161490 0x7f122809ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56816/0 (socket says 172.21.15.82:56816) 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1225d9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806f5e0 0x7f122809e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:43024/0 (socket says 172.21.15.82:43024) 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 -- 172.21.15.82:0/1884318594 learned_addr learned my addr 172.21.15.82:0/1884318594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f122659c640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f122806c3a0 0x7f122815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 -- 172.21.15.82:0/1884318594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806f5e0 msgr2=0x7f122809e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806f5e0 0x7f122809e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 -- 172.21.15.82:0/1884318594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f122806c3a0 msgr2=0x7f122815cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f122806c3a0 0x7f122815cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.975+0000 7f1226d9d640 1 -- 172.21.15.82:0/1884318594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12281f3410 con 0x7f1228161490 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f1226d9d640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1228161490 0x7f122809ef20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f122000c6b0 tx=0x7f122000cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f1216ffd640 1 -- 172.21.15.82:0/1884318594 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220003b70 con 0x7f1228161490 2024-05-10T08:40:00.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f1216ffd640 1 -- 172.21.15.82:0/1884318594 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1220003d30 con 0x7f1228161490 2024-05-10T08:40:00.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122809c2f0 con 0x7f1228161490 2024-05-10T08:40:00.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f1216ffd640 1 -- 172.21.15.82:0/1884318594 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220005310 con 0x7f1228161490 2024-05-10T08:40:00.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122809c8b0 con 0x7f1228161490 2024-05-10T08:40:00.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f1216ffd640 1 -- 172.21.15.82:0/1884318594 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f12200054b0 con 0x7f1228161490 2024-05-10T08:40:00.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.976+0000 7f1216ffd640 1 -- 172.21.15.82:0/1884318594 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f1220012b70 con 0x7f1228161490 2024-05-10T08:40:00.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.977+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1228069b00 con 0x7f1228161490 2024-05-10T08:40:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:00.980+0000 7f1216ffd640 1 -- 172.21.15.82:0/1884318594 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1220012510 con 0x7f1228161490 2024-05-10T08:40:01.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.053+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d695235e-80d9-4065-853a-7f96a9b1dfb8", "id": 7} v 0) -- 0x7f122806d290 con 0x7f1228161490 2024-05-10T08:40:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.059+0000 7f1216ffd640 1 -- 172.21.15.82:0/1884318594 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d695235e-80d9-4065-853a-7f96a9b1dfb8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f12200126f0 con 0x7f1228161490 2024-05-10T08:40:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:7 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1228161490 msgr2=0x7f122809ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1228161490 0x7f122809ef20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f122000c6b0 tx=0x7f122000cb70 comp rx=0 tx=0).stop 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 shutdown_connections 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1228161490 0x7f122809ef20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f122806f5e0 0x7f122809e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 --2- 172.21.15.82:0/1884318594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f122806c3a0 0x7f122815cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 >> 172.21.15.82:0/1884318594 conn(0x7f12280b39a0 msgr2=0x7f12280d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 shutdown_connections 2024-05-10T08:40:01.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:01.060+0000 7f122cd89640 1 -- 172.21.15.82:0/1884318594 wait complete. 2024-05-10T08:40:01.070 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T08:40:01.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T08:40:01.073 INFO:tasks.ceph.osd.0:Started 2024-05-10T08:40:01.073 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T08:40:01.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T08:40:01.076 INFO:tasks.ceph.osd.1:Started 2024-05-10T08:40:01.077 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T08:40:01.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T08:40:01.079 INFO:tasks.ceph.osd.2:Started 2024-05-10T08:40:01.079 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T08:40:01.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T08:40:01.081 INFO:tasks.ceph.osd.3:Started 2024-05-10T08:40:01.081 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T08:40:01.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T08:40:01.113 INFO:tasks.ceph.osd.4:Started 2024-05-10T08:40:01.113 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T08:40:01.113 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T08:40:01.115 INFO:tasks.ceph.osd.5:Started 2024-05-10T08:40:01.115 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T08:40:01.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T08:40:01.117 INFO:tasks.ceph.osd.6:Started 2024-05-10T08:40:01.117 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T08:40:01.118 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T08:40:01.120 INFO:tasks.ceph.osd.7:Started 2024-05-10T08:40:01.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:01.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.242+0000 7f6b6f1f0640 1 Processor -- start 2024-05-10T08:40:01.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.242+0000 7f6b6f1f0640 1 -- start start 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.243+0000 7f6b6f1f0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b680d53d0 0x7f6b680d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b6f1f0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b681630b0 con 0x7f6b680d1970 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b67fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6b680d1970 0x7f6b680d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43356/0 (socket says 172.21.15.37:43356) 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b67fff640 1 -- 172.21.15.37:0/4294624889 learned_addr learned my addr 172.21.15.37:0/4294624889 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/4294624889 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b680d3e70 con 0x7f6b6815f420 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/4294624889 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680d2550 con 0x7f6b680d53d0 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b6d78d640 1 --2- 172.21.15.37:0/4294624889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b680d53d0 0x7f6b680d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b677fe640 1 -- 172.21.15.37:0/4294624889 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339586579 0 0) 0x7f6b54001110 con 0x7f6b680d1970 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b677fe640 1 -- 172.21.15.37:0/4294624889 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b58003520 con 0x7f6b680d1970 2024-05-10T08:40:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b677fe640 1 -- 172.21.15.37:0/4294624889 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230655669 0 0) 0x7f6b680d3e70 con 0x7f6b6815f420 2024-05-10T08:40:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b677fe640 1 -- 172.21.15.37:0/4294624889 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b54001110 con 0x7f6b6815f420 2024-05-10T08:40:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b6d78d640 1 -- 172.21.15.37:0/4294624889 >> v1:172.21.15.82:6789/0 conn(0x7f6b6815f420 legacy=0x7f6b680d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b6d78d640 1 -- 172.21.15.37:0/4294624889 >> v1:172.21.15.37:6789/0 conn(0x7f6b680d1970 legacy=0x7f6b680d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.244+0000 7f6b6d78d640 1 -- 172.21.15.37:0/4294624889 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680d2c80 con 0x7f6b680d53d0 2024-05-10T08:40:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.245+0000 7f6b6d78d640 1 --2- 172.21.15.37:0/4294624889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b680d53d0 0x7f6b680d1e20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009dc0 tx=0x7f6b6002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e3ede3549f900a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.245+0000 7f6b677fe640 1 -- 172.21.15.37:0/4294624889 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60007740 con 0x7f6b680d53d0 2024-05-10T08:40:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.245+0000 7f6b677fe640 1 -- 172.21.15.37:0/4294624889 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b600078e0 con 0x7f6b680d53d0 2024-05-10T08:40:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.245+0000 7f6b677fe640 1 -- 172.21.15.37:0/4294624889 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60007cb0 con 0x7f6b680d53d0 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.246+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/4294624889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b680d53d0 msgr2=0x7f6b680d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.246+0000 7f6b6f1f0640 1 --2- 172.21.15.37:0/4294624889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b680d53d0 0x7f6b680d1e20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009dc0 tx=0x7f6b6002a6d0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.246+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/4294624889 shutdown_connections 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.246+0000 7f6b6f1f0640 1 --2- 172.21.15.37:0/4294624889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b680d53d0 0x7f6b680d1e20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.246+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/4294624889 >> 172.21.15.37:0/4294624889 conn(0x7f6b6808eac0 msgr2=0x7f6b6809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.246+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/4294624889 shutdown_connections 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.246+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/4294624889 wait complete. 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.247+0000 7f6b6f1f0640 1 Processor -- start 2024-05-10T08:40:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.247+0000 7f6b6f1f0640 1 -- start start 2024-05-10T08:40:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6f1f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b680d1970 0x7f6b68160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6f1f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b680d53d0 0x7f6b680cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6f1f0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c0d0 0x7f6b680cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6f1f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d2830 con 0x7f6b680d1970 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6f1f0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d3240 con 0x7f6b680d53d0 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6f1f0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680cfb20 con 0x7f6b6815c0d0 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b680d1970 0x7f6b68160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b680d1970 0x7f6b68160860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35044/0 (socket says 172.21.15.37:35044) 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 -- 172.21.15.37:0/3587192236 learned_addr learned my addr 172.21.15.37:0/3587192236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b67fff640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b680d53d0 0x7f6b680cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6d78d640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c0d0 0x7f6b680cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 -- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c0d0 msgr2=0x7f6b680cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c0d0 0x7f6b680cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 -- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b680d53d0 msgr2=0x7f6b680cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b680d53d0 0x7f6b680cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 -- 172.21.15.37:0/3587192236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68160da0 con 0x7f6b680d1970 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.248+0000 7f6b6cf8c640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b680d1970 0x7f6b68160860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c430 tx=0x7f6b5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.249+0000 7f6b657fa640 1 -- 172.21.15.37:0/3587192236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c017070 con 0x7f6b680d1970 2024-05-10T08:40:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.249+0000 7f6b657fa640 1 -- 172.21.15.37:0/3587192236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0052f0 con 0x7f6b680d1970 2024-05-10T08:40:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.249+0000 7f6b657fa640 1 -- 172.21.15.37:0/3587192236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c003830 con 0x7f6b680d1970 2024-05-10T08:40:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.249+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b680cb720 con 0x7f6b680d1970 2024-05-10T08:40:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.249+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b680b86d0 con 0x7f6b680d1970 2024-05-10T08:40:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.249+0000 7f6b657fa640 1 -- 172.21.15.37:0/3587192236 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b5c01a070 con 0x7f6b680d1970 2024-05-10T08:40:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.249+0000 7f6b657fa640 1 -- 172.21.15.37:0/3587192236 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6b5c011ca0 con 0x7f6b680d1970 2024-05-10T08:40:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.250+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b680693f0 con 0x7f6b680d1970 2024-05-10T08:40:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.252+0000 7f6b657fa640 1 -- 172.21.15.37:0/3587192236 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6b5c021020 con 0x7f6b680d1970 2024-05-10T08:40:01.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.314+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b680d4ed0 con 0x7f6b680d1970 2024-05-10T08:40:01.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.315+0000 7f6b657fa640 1 -- 172.21.15.37:0/3587192236 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6b5c011590 con 0x7f6b680d1970 2024-05-10T08:40:01.315 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:01.315 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:01.055251+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b680d1970 msgr2=0x7f6b68160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b680d1970 0x7f6b68160860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c430 tx=0x7f6b5c00c8f0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 shutdown_connections 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c0d0 0x7f6b680cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b680d53d0 0x7f6b680cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 --2- 172.21.15.37:0/3587192236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b680d1970 0x7f6b68160860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 >> 172.21.15.37:0/3587192236 conn(0x7f6b6808eac0 msgr2=0x7f6b6806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 shutdown_connections 2024-05-10T08:40:01.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f6b6f1f0640 1 -- 172.21.15.37:0/3587192236 wait complete. 2024-05-10T08:40:01.317 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:01.316+0000 7f7f7ac13040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T08:40:01.327 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T08:40:01.327 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T08:40:01.331 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:01.332+0000 7f925a52b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T08:40:01.463 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:01.464+0000 7f7f7ac13040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T08:40:01.471 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:01.471+0000 7f925a52b040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T08:40:01.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-10T08:40:01.689+0000 7f55983c4640 -1 Falling back to public interface 2024-05-10T08:40:01.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-10T08:40:01.697+0000 7f7be3a3d640 -1 Falling back to public interface 2024-05-10T08:40:01.696 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-10T08:40:01.697+0000 7f4bcac0f640 -1 Falling back to public interface 2024-05-10T08:40:01.716 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-10T08:40:01.716+0000 7fc30e80c640 -1 Falling back to public interface 2024-05-10T08:40:01.716 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-05-10T08:40:01.717+0000 7f4ee74b5640 -1 Falling back to public interface 2024-05-10T08:40:01.721 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-05-10T08:40:01.722+0000 7fb39c9a5640 -1 Falling back to public interface 2024-05-10T08:40:01.725 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-05-10T08:40:01.726+0000 7f95a0953640 -1 Falling back to public interface 2024-05-10T08:40:01.734 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:01.734+0000 7f925a52b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T08:40:01.738 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:01.739+0000 7f7f7ac13040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T08:40:01.742 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-05-10T08:40:01.743+0000 7f7ca8b68640 -1 Falling back to public interface 2024-05-10T08:40:01.790 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:01.791+0000 7f925a52b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T08:40:01.794 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:01.794+0000 7f7f7ac13040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T08:40:01.905 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:01.905+0000 7f925a52b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T08:40:01.917 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:01.918+0000 7f7f7ac13040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T08:40:02.132 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:02.202 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:02.203+0000 7f925a52b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T08:40:02.222 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:02.223+0000 7f7f7ac13040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T08:40:02.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.227+0000 7f85c71c1640 1 Processor -- start 2024-05-10T08:40:02.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.227+0000 7f85c71c1640 1 -- start start 2024-05-10T08:40:02.228 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85c71c1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85c015d0f0 0x7f85c0160b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:02.228 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85c71c1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c0161460 con 0x7f85c00d0b20 2024-05-10T08:40:02.228 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85c71c1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c0161740 con 0x7f85c00d33d0 2024-05-10T08:40:02.228 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85c71c1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f85c0161a20 con 0x7f85c015d0f0 2024-05-10T08:40:02.228 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85c4f5d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85c015d0f0 0x7f85c0160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:02.228 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85bffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85c00d0b20 0x7f85c00d2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43358/0 (socket says 172.21.15.37:43358) 2024-05-10T08:40:02.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85c4f5d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85c015d0f0 0x7f85c0160b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35046/0 (socket says 172.21.15.37:35046) 2024-05-10T08:40:02.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.228+0000 7f85bffff640 1 -- 172.21.15.37:0/946247329 learned_addr learned my addr 172.21.15.37:0/946247329 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:02.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85c4f5d640 1 -- 172.21.15.37:0/946247329 >> v1:172.21.15.82:6789/0 conn(0x7f85c00d33d0 legacy=0x7f85c00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:02.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85c4f5d640 1 -- 172.21.15.37:0/946247329 >> v1:172.21.15.37:6789/0 conn(0x7f85c00d0b20 legacy=0x7f85c00d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:02.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85c4f5d640 1 -- 172.21.15.37:0/946247329 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c00afcb0 con 0x7f85c015d0f0 2024-05-10T08:40:02.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85bf7fe640 1 -- 172.21.15.37:0/946247329 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174199688 0 0) 0x7f85c0161460 con 0x7f85c00d0b20 2024-05-10T08:40:02.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85c4f5d640 1 --2- 172.21.15.37:0/946247329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c0160b60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85b40097a0 tx=0x7f85b402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b50a5beca42290 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85bf7fe640 1 -- 172.21.15.37:0/946247329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4037070 con 0x7f85c015d0f0 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85bf7fe640 1 -- 172.21.15.37:0/946247329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b4032440 con 0x7f85c015d0f0 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.229+0000 7f85bf7fe640 1 -- 172.21.15.37:0/946247329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4032810 con 0x7f85c015d0f0 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.230+0000 7f85c71c1640 1 -- 172.21.15.37:0/946247329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 msgr2=0x7f85c0160b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.230+0000 7f85c71c1640 1 --2- 172.21.15.37:0/946247329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c0160b60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85b40097a0 tx=0x7f85b402a230 comp rx=0 tx=0).stop 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.230+0000 7f85c71c1640 1 -- 172.21.15.37:0/946247329 shutdown_connections 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.230+0000 7f85c71c1640 1 --2- 172.21.15.37:0/946247329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c0160b60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.230+0000 7f85c71c1640 1 -- 172.21.15.37:0/946247329 >> 172.21.15.37:0/946247329 conn(0x7f85c009ba10 msgr2=0x7f85c009be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.230+0000 7f85c71c1640 1 -- 172.21.15.37:0/946247329 shutdown_connections 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.230+0000 7f85c71c1640 1 -- 172.21.15.37:0/946247329 wait complete. 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.231+0000 7f85c71c1640 1 Processor -- start 2024-05-10T08:40:02.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.231+0000 7f85c71c1640 1 -- start start 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c71c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85c00d0b20 0x7f85c00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c71c1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c00d33d0 0x7f85c015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c71c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c71c1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85c0161220 con 0x7f85c015d0f0 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c71c1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85c01610a0 con 0x7f85c00d33d0 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c71c1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f85c00b14c0 con 0x7f85c00d0b20 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c575e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:02.234 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c4f5d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85c00d0b20 0x7f85c00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c575e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35054/0 (socket says 172.21.15.37:35054) 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85c575e640 1 -- 172.21.15.37:0/3826112099 learned_addr learned my addr 172.21.15.37:0/3826112099 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.232+0000 7f85bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c00d33d0 0x7f85c015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c575e640 1 -- 172.21.15.37:0/3826112099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85c00d0b20 msgr2=0x7f85c00cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c575e640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85c00d0b20 0x7f85c00cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c575e640 1 -- 172.21.15.37:0/3826112099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c00d33d0 msgr2=0x7f85c015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c575e640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c00d33d0 0x7f85c015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c575e640 1 -- 172.21.15.37:0/3826112099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c01f6610 con 0x7f85c015d0f0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85bffff640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c00d33d0 0x7f85c015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c575e640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c015da10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c7a0 tx=0x7f85b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85bd7fa640 1 -- 172.21.15.37:0/3826112099 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b8003b70 con 0x7f85c015d0f0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85bd7fa640 1 -- 172.21.15.37:0/3826112099 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b8003d30 con 0x7f85c015d0f0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c006f420 con 0x7f85c015d0f0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85bd7fa640 1 -- 172.21.15.37:0/3826112099 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b800aa90 con 0x7f85c015d0f0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c006f140 con 0x7f85c015d0f0 2024-05-10T08:40:02.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85bd7fa640 1 -- 172.21.15.37:0/3826112099 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f85b800ac30 con 0x7f85c015d0f0 2024-05-10T08:40:02.236 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.233+0000 7f85bd7fa640 1 -- 172.21.15.37:0/3826112099 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f85b8012cd0 con 0x7f85c015d0f0 2024-05-10T08:40:02.236 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.234+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c0069af0 con 0x7f85c015d0f0 2024-05-10T08:40:02.236 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.237+0000 7f85bd7fa640 1 -- 172.21.15.37:0/3826112099 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f85c01f6610 con 0x7f85c015d0f0 2024-05-10T08:40:02.251 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:02.252+0000 7f925a52b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T08:40:02.275 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:02.275+0000 7f7f7ac13040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T08:40:02.298 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.299+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85c015e600 con 0x7f85c015d0f0 2024-05-10T08:40:02.299 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.300+0000 7f85bd7fa640 1 -- 172.21.15.37:0/3826112099 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f85b8012600 con 0x7f85c015d0f0 2024-05-10T08:40:02.299 INFO:teuthology.misc.health.smithi037.stdout: 2024-05-10T08:40:02.299 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:01.055251+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:02.300 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.300+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 msgr2=0x7f85c015da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:02.300 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.300+0000 7f85c71c1640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c015da10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c7a0 tx=0x7f85b800cc60 comp rx=0 tx=0).stop 2024-05-10T08:40:02.300 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.301+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 shutdown_connections 2024-05-10T08:40:02.300 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.301+0000 7f85c71c1640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c015d0f0 0x7f85c015da10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:02.300 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.301+0000 7f85c71c1640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c00d33d0 0x7f85c015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:02.301 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.301+0000 7f85c71c1640 1 --2- 172.21.15.37:0/3826112099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85c00d0b20 0x7f85c00cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:02.301 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.301+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 >> 172.21.15.37:0/3826112099 conn(0x7f85c009ba10 msgr2=0x7f85c00b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:02.301 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.301+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 shutdown_connections 2024-05-10T08:40:02.301 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:02.301+0000 7f85c71c1640 1 -- 172.21.15.37:0/3826112099 wait complete. 2024-05-10T08:40:02.310 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T08:40:02.410 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:02.410+0000 7f925a52b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T08:40:02.441 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:02.442+0000 7f7f7ac13040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T08:40:02.547 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:02.548+0000 7f925a52b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T08:40:02.586 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:02.587+0000 7f7f7ac13040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T08:40:02.598 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:02.599+0000 7f925a52b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T08:40:02.639 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:02.639+0000 7f7f7ac13040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T08:40:02.668 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:02.669+0000 7f925a52b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T08:40:02.712 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:02.713+0000 7f7f7ac13040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T08:40:02.713 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:02.714+0000 7f925a52b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T08:40:02.760 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:02.761+0000 7f7f7ac13040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T08:40:03.194 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:03.195+0000 7f925a52b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T08:40:03.266 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:03.266+0000 7f7f7ac13040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T08:40:03.310 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:03.310+0000 7f925a52b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T08:40:03.391 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-10T08:40:03.391+0000 7f7f7ac13040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T08:40:04.329 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:04.330+0000 7f91f9e7a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T08:40:04.330 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-05-10T08:40:04.330+0000 7f91f9e7a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T08:40:05.173 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-05-10T08:40:05.173+0000 7f4ee74b5640 -1 osd.5 0 log_to_monitors true 2024-05-10T08:40:05.183 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-10T08:40:05.183+0000 7fc30e80c640 -1 osd.3 0 log_to_monitors true 2024-05-10T08:40:05.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-10T08:40:05.210+0000 7f7be3a3d640 -1 osd.2 0 log_to_monitors true 2024-05-10T08:40:05.217 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-05-10T08:40:05.218+0000 7fb39c9a5640 -1 osd.4 0 log_to_monitors true 2024-05-10T08:40:05.225 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-10T08:40:05.226+0000 7f4bcac0f640 -1 osd.0 0 log_to_monitors true 2024-05-10T08:40:05.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-10T08:40:05.227+0000 7f55983c4640 -1 osd.1 0 log_to_monitors true 2024-05-10T08:40:05.257 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-05-10T08:40:05.258+0000 7f95a0953640 -1 osd.7 0 log_to_monitors true 2024-05-10T08:40:05.279 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-05-10T08:40:05.280+0000 7f7ca8b68640 -1 osd.6 0 log_to_monitors true 2024-05-10T08:40:08.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-10T08:40:08.392+0000 7f7be01e7640 -1 osd.2 0 waiting for initial osdmap 2024-05-10T08:40:08.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-10T08:40:08.408+0000 7f7bd77f3640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:08.416 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-10T08:40:08.416+0000 7f4bc65ff640 -1 osd.0 0 waiting for initial osdmap 2024-05-10T08:40:08.428 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-10T08:40:08.429+0000 7f4bbe41f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:08.447 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-10T08:40:08.447+0000 7fc30a9f3640 -1 osd.3 0 waiting for initial osdmap 2024-05-10T08:40:08.457 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-10T08:40:08.458+0000 7fc301fff640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:08.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-10T08:40:08.459+0000 7f559435a640 -1 osd.1 0 waiting for initial osdmap 2024-05-10T08:40:08.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-10T08:40:08.470+0000 7f558c17a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:08.476 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-05-10T08:40:08.476+0000 7f4ee344b640 -1 osd.5 0 waiting for initial osdmap 2024-05-10T08:40:08.491 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-05-10T08:40:08.492+0000 7fb39893b640 -1 osd.4 0 waiting for initial osdmap 2024-05-10T08:40:08.494 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-05-10T08:40:08.495+0000 7f4edb26b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:08.497 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-05-10T08:40:08.498+0000 7f7ca4afe640 -1 osd.6 0 waiting for initial osdmap 2024-05-10T08:40:08.498 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-05-10T08:40:08.499+0000 7f959c8e9640 -1 osd.7 0 waiting for initial osdmap 2024-05-10T08:40:08.504 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-05-10T08:40:08.505+0000 7fb39075b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:08.517 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-05-10T08:40:08.518+0000 7f7c9c91e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:08.517 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-05-10T08:40:08.518+0000 7f9594709640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T08:40:09.116 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:09.223 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.223+0000 7ff6c1e54640 1 Processor -- start 2024-05-10T08:40:09.223 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.223+0000 7ff6c1e54640 1 -- start start 2024-05-10T08:40:09.224 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6c1e54640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.224 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6c1e54640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6bc0d20f0 0x7ff6bc0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.224 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6c1e54640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6bc0d07c0 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.224 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6c1e54640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff6bc0d2e10 con 0x7ff6bc0d20f0 2024-05-10T08:40:09.224 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6c1e54640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc0d0aa0 con 0x7ff6bc1629a0 2024-05-10T08:40:09.224 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6bbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6bc0d20f0 0x7ff6bc0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6baffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff6bc0b7f60 0x7ff6bc0d19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36196/0 (socket says 172.21.15.37:36196) 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6baffd640 1 -- 172.21.15.37:0/769118629 learned_addr learned my addr 172.21.15.37:0/769118629 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6bb7fe640 1 --2- 172.21.15.37:0/769118629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6bbfff640 1 -- 172.21.15.37:0/769118629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 msgr2=0x7ff6bc0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6bbfff640 1 --2- 172.21.15.37:0/769118629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6bbfff640 1 -- 172.21.15.37:0/769118629 >> v1:172.21.15.37:6789/0 conn(0x7ff6bc0b7f60 legacy=0x7ff6bc0d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6bbfff640 1 -- 172.21.15.37:0/769118629 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc0d0d80 con 0x7ff6bc0d20f0 2024-05-10T08:40:09.225 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.224+0000 7ff6ba7fc640 1 -- 172.21.15.37:0/769118629 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430652246 0 0) 0x7ff6bc0d07c0 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.226 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.225+0000 7ff6bbfff640 1 --2- 172.21.15.37:0/769118629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc0d32a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009d90 tx=0x7ff6b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90038bed71a35a6b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:09.226 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.225+0000 7ff6ba7fc640 1 -- 172.21.15.37:0/769118629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4007740 con 0x7ff6bc0d20f0 2024-05-10T08:40:09.226 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.225+0000 7ff6ba7fc640 1 -- 172.21.15.37:0/769118629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b40078e0 con 0x7ff6bc0d20f0 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.225+0000 7ff6ba7fc640 1 -- 172.21.15.37:0/769118629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4007cb0 con 0x7ff6bc0d20f0 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 -- 172.21.15.37:0/769118629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0d20f0 msgr2=0x7ff6bc0d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/769118629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc0d32a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009d90 tx=0x7ff6b402a660 comp rx=0 tx=0).stop 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 -- 172.21.15.37:0/769118629 shutdown_connections 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/769118629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc0d32a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/769118629 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 -- 172.21.15.37:0/769118629 >> 172.21.15.37:0/769118629 conn(0x7ff6bc09e400 msgr2=0x7ff6bc0d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 -- 172.21.15.37:0/769118629 shutdown_connections 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.226+0000 7ff6c1e54640 1 -- 172.21.15.37:0/769118629 wait complete. 2024-05-10T08:40:09.227 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.227+0000 7ff6c1e54640 1 Processor -- start 2024-05-10T08:40:09.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.227+0000 7ff6c1e54640 1 -- start start 2024-05-10T08:40:09.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6c1e54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0b7f60 0x7ff6bc154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6c1e54640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.229 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6c1e54640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0ba170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6c1e54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc162f00 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6c1e54640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc162d80 con 0x7ff6bc0d20f0 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6c1e54640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc0b64b0 con 0x7ff6bc1629a0 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0b7f60 0x7ff6bc154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0b7f60 0x7ff6bc154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51626/0 (socket says 172.21.15.37:51626) 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6bb7fe640 1 -- 172.21.15.37:0/4210220257 learned_addr learned my addr 172.21.15.37:0/4210220257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6bbfff640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0ba170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6bb7fe640 1 -- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 msgr2=0x7ff6bc0ba170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6baffd640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6bb7fe640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0ba170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.228+0000 7ff6bb7fe640 1 -- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6bc0d20f0 msgr2=0x7ff6bc15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6bb7fe640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc15b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.230 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6bb7fe640 1 -- 172.21.15.37:0/4210220257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc1f57d0 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6baffd640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:09.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6bb7fe640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0b7f60 0x7ff6bc154580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00d5f0 tx=0x7ff6ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:09.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6a3fff640 1 -- 172.21.15.37:0/4210220257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0125f0 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6a3fff640 1 -- 172.21.15.37:0/4210220257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ac019070 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6a3fff640 1 -- 172.21.15.37:0/4210220257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0129d0 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6bc1f5ab0 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.231 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.229+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6bc1f6070 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.232 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.230+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6bc0693e0 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.232 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.231+0000 7ff6a3fff640 1 -- 172.21.15.37:0/4210220257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7ff6ac012b70 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.232 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.231+0000 7ff6a3fff640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6a8076270 0x7ff6a8078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.232 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.231+0000 7ff6a3fff640 1 -- 172.21.15.37:0/4210220257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7ff6ac096c00 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.232 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.232+0000 7ff6baffd640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6a8076270 0x7ff6a8078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.232 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.232+0000 7ff6baffd640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6a8076270 0x7ff6a8078730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc08f1b0 tx=0x7ff6b0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:09.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.236+0000 7ff6a3fff640 1 -- 172.21.15.37:0/4210220257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff6ac061330 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.433 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.434+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6bc0d2790 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.434 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.434+0000 7ff6a3fff640 1 -- 172.21.15.37:0/4210220257 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10849 (secure 0 0 0) 0x7ff6ac060c30 con 0x7ff6bc0b7f60 2024-05-10T08:40:09.434 INFO:teuthology.misc.health.smithi037.stdout: 2024-05-10T08:40:09.434 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":13,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:09.395056+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:09.437 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6a8076270 msgr2=0x7ff6a8078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.437 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6a8076270 0x7ff6a8078730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc08f1b0 tx=0x7ff6b0009040 comp rx=0 tx=0).stop 2024-05-10T08:40:09.437 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0b7f60 msgr2=0x7ff6bc154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.437 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0b7f60 0x7ff6bc154580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00d5f0 tx=0x7ff6ac00dab0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.437 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 shutdown_connections 2024-05-10T08:40:09.438 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6a8076270 0x7ff6a8078730 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.438 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6bc1629a0 0x7ff6bc0ba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.438 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6bc0d20f0 0x7ff6bc15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.438 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 --2- 172.21.15.37:0/4210220257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc0b7f60 0x7ff6bc154580 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.438 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 >> 172.21.15.37:0/4210220257 conn(0x7ff6bc09e400 msgr2=0x7ff6bc0b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:09.438 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 shutdown_connections 2024-05-10T08:40:09.438 INFO:teuthology.misc.health.smithi037.stderr:2024-05-10T08:40:09.436+0000 7ff6c1e54640 1 -- 172.21.15.37:0/4210220257 wait complete. 2024-05-10T08:40:09.446 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T08:40:09.446 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T08:40:09.446 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:40:09.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:40:09.448 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:40:09.448 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:40:09.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:40:09.451 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:40:09.451 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:40:09.451 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:40:09.454 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:40:09.454 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:40:09.455 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:40:09.457 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:40:09.457 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-10T08:40:09.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:09.527 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:40:09.527 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:40:09.538 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:40:09.538 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:40:09.539 INFO:tasks.ceph.mds.b.smithi082.stderr:2024-05-10T08:40:09.540+0000 7fef8c2a4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T08:40:09.539 INFO:tasks.ceph.mds.d.smithi082.stderr:2024-05-10T08:40:09.540+0000 7f6f8cf4c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T08:40:09.539 INFO:tasks.ceph.mds.b.smithi082.stderr:2024-05-10T08:40:09.540+0000 7fef8c2a4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6835/0: (98) Address already in use 2024-05-10T08:40:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.567+0000 7fd9f5571640 1 Processor -- start 2024-05-10T08:40:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.567+0000 7fd9f5571640 1 -- start start 2024-05-10T08:40:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9f5571640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9f0162f50 0x7fd9f01633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9f5571640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f00d0500 con 0x7fd9f00b21f0 2024-05-10T08:40:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9f5571640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f006da60 con 0x7fd9f00cf790 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9f5571640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd9f006d810 con 0x7fd9f0162f50 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9eeffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd9f00b21f0 0x7fd9f006e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36208/0 (socket says 172.21.15.37:36208) 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9eeffd640 1 -- 172.21.15.37:0/3260566420 learned_addr learned my addr 172.21.15.37:0/3260566420 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9ee7fc640 1 --2- 172.21.15.37:0/3260566420 >> v2:172.21.15.82:3300/0 conn(0x7fd9f0162f50 0x7fd9f01633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9edffb640 1 -- 172.21.15.37:0/3260566420 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281980655 0 0) 0x7fd9f00d0500 con 0x7fd9f00b21f0 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9edffb640 1 -- 172.21.15.37:0/3260566420 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d8003520 con 0x7fd9f00b21f0 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9edffb640 1 -- 172.21.15.37:0/3260566420 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786510428 0 0) 0x7fd9f006da60 con 0x7fd9f00cf790 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9edffb640 1 -- 172.21.15.37:0/3260566420 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f00d0500 con 0x7fd9f00cf790 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9ee7fc640 1 -- 172.21.15.37:0/3260566420 >> v1:172.21.15.82:6789/0 conn(0x7fd9f00cf790 legacy=0x7fd9f00cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9ee7fc640 1 -- 172.21.15.37:0/3260566420 >> v1:172.21.15.37:6789/0 conn(0x7fd9f00b21f0 legacy=0x7fd9f006e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.568+0000 7fd9ee7fc640 1 -- 172.21.15.37:0/3260566420 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f006dd40 con 0x7fd9f0162f50 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.569+0000 7fd9ee7fc640 1 --2- 172.21.15.37:0/3260566420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f0162f50 0x7fd9f01633e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40097a0 tx=0x7fd9e402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff7df4334e686de server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.569+0000 7fd9edffb640 1 -- 172.21.15.37:0/3260566420 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4037070 con 0x7fd9f0162f50 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.569+0000 7fd9edffb640 1 -- 172.21.15.37:0/3260566420 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e4032440 con 0x7fd9f0162f50 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.569+0000 7fd9edffb640 1 -- 172.21.15.37:0/3260566420 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e402ae60 con 0x7fd9f0162f50 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.570+0000 7fd9f5571640 1 -- 172.21.15.37:0/3260566420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f0162f50 msgr2=0x7fd9f01633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.570+0000 7fd9f5571640 1 --2- 172.21.15.37:0/3260566420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f0162f50 0x7fd9f01633e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40097a0 tx=0x7fd9e402a110 comp rx=0 tx=0).stop 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.570+0000 7fd9f5571640 1 -- 172.21.15.37:0/3260566420 shutdown_connections 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.570+0000 7fd9f5571640 1 --2- 172.21.15.37:0/3260566420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f0162f50 0x7fd9f01633e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.570+0000 7fd9f5571640 1 -- 172.21.15.37:0/3260566420 >> 172.21.15.37:0/3260566420 conn(0x7fd9f009ba40 msgr2=0x7fd9f009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.570+0000 7fd9f5571640 1 -- 172.21.15.37:0/3260566420 shutdown_connections 2024-05-10T08:40:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.570+0000 7fd9f5571640 1 -- 172.21.15.37:0/3260566420 wait complete. 2024-05-10T08:40:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.571+0000 7fd9f5571640 1 Processor -- start 2024-05-10T08:40:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.571+0000 7fd9f5571640 1 -- start start 2024-05-10T08:40:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9f5571640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f00b21f0 0x7fd9f015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9f5571640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9f00cf790 0x7fd9f01f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9f5571640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9f0162f50 0x7fd9f00d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9f5571640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f00cd480 con 0x7fd9f00cf790 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9f5571640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f006e0b0 con 0x7fd9f00b21f0 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9f5571640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f00cd600 con 0x7fd9f0162f50 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9f00cf790 0x7fd9f01f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9f00cf790 0x7fd9f01f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51654/0 (socket says 172.21.15.37:51654) 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 -- 172.21.15.37:0/1546507701 learned_addr learned my addr 172.21.15.37:0/1546507701 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9eeffd640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f00b21f0 0x7fd9f015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 -- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9f0162f50 msgr2=0x7fd9f00d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9f0162f50 0x7fd9f00d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 -- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f00b21f0 msgr2=0x7fd9f015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f00b21f0 0x7fd9f015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 -- 172.21.15.37:0/1546507701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f01f5520 con 0x7fd9f00cf790 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9ee7fc640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9f00cf790 0x7fd9f01f4ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4000c00 tx=0x7fd9e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9d77fe640 1 -- 172.21.15.37:0/1546507701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4037040 con 0x7fd9f00cf790 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9d77fe640 1 -- 172.21.15.37:0/1546507701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e4042070 con 0x7fd9f00cf790 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f01f5800 con 0x7fd9f00cf790 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.572+0000 7fd9d77fe640 1 -- 172.21.15.37:0/1546507701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4030860 con 0x7fd9f00cf790 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.573+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f00b3f20 con 0x7fd9f00cf790 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.573+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f00b4120 con 0x7fd9f00cf790 2024-05-10T08:40:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.574+0000 7fd9d77fe640 1 -- 172.21.15.37:0/1546507701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fd9e4030a00 con 0x7fd9f00cf790 2024-05-10T08:40:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.575+0000 7fd9d77fe640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd9dc076240 0x7fd9dc078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.575+0000 7fd9d77fe640 1 -- 172.21.15.37:0/1546507701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fd9e40b78f0 con 0x7fd9f00cf790 2024-05-10T08:40:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.575+0000 7fd9eeffd640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd9dc076240 0x7fd9dc078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.575+0000 7fd9eeffd640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd9dc076240 0x7fd9dc078700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0000f60 tx=0x7fd9e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:09.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.579+0000 7fd9d77fe640 1 -- 172.21.15.37:0/1546507701 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd9f00b4120 con 0x7fd9f00cf790 2024-05-10T08:40:09.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.812+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9f0069b00 con 0x7fd9f00cf790 2024-05-10T08:40:09.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.812+0000 7fd9d77fe640 1 -- 172.21.15.37:0/1546507701 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fd9e4081760 con 0x7fd9f00cf790 2024-05-10T08:40:09.812 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:09.812 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-10T08:40:09.813 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd9dc076240 msgr2=0x7fd9dc078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd9dc076240 0x7fd9dc078700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0000f60 tx=0x7fd9e0009040 comp rx=0 tx=0).stop 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9f00cf790 msgr2=0x7fd9f01f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9f00cf790 0x7fd9f01f4ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4000c00 tx=0x7fd9e40046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 shutdown_connections 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd9dc076240 0x7fd9dc078700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9f0162f50 0x7fd9f00d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9f00cf790 0x7fd9f01f4ad0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 --2- 172.21.15.37:0/1546507701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f00b21f0 0x7fd9f015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 >> 172.21.15.37:0/1546507701 conn(0x7fd9f009ba40 msgr2=0x7fd9f01622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 shutdown_connections 2024-05-10T08:40:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:09.815+0000 7fd9f5571640 1 -- 172.21.15.37:0/1546507701 wait complete. 2024-05-10T08:40:11.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.943+0000 7fe6dad46640 1 Processor -- start 2024-05-10T08:40:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.943+0000 7fe6dad46640 1 -- start start 2024-05-10T08:40:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6dad46640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6d40d3cd0 0x7fe6d40cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6dad46640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d40d3330 con 0x7fe6d40c9ee0 2024-05-10T08:40:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6dad46640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d40d2170 con 0x7fe6d41629a0 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6dad46640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d40d2450 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6d92e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe6d40c9ee0 0x7fe6d40d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36212/0 (socket says 172.21.15.37:36212) 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6d92e3640 1 -- 172.21.15.37:0/416380283 learned_addr learned my addr 172.21.15.37:0/416380283 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6d3fff640 1 --2- 172.21.15.37:0/416380283 >> v2:172.21.15.82:3300/0 conn(0x7fe6d40d3cd0 0x7fe6d40cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.944+0000 7fe6d37fe640 1 -- 172.21.15.37:0/416380283 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220477631 0 0) 0x7fe6d40d3330 con 0x7fe6d40c9ee0 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.945+0000 7fe6d37fe640 1 -- 172.21.15.37:0/416380283 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6c0003520 con 0x7fe6d40c9ee0 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.945+0000 7fe6d37fe640 1 -- 172.21.15.37:0/416380283 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984379723 0 0) 0x7fe6d40d2170 con 0x7fe6d41629a0 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.945+0000 7fe6d37fe640 1 -- 172.21.15.37:0/416380283 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d40d3330 con 0x7fe6d41629a0 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.945+0000 7fe6d3fff640 1 -- 172.21.15.37:0/416380283 >> v1:172.21.15.82:6789/0 conn(0x7fe6d41629a0 legacy=0x7fe6d40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.945+0000 7fe6d3fff640 1 -- 172.21.15.37:0/416380283 >> v1:172.21.15.37:6789/0 conn(0x7fe6d40c9ee0 legacy=0x7fe6d40d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.945+0000 7fe6d3fff640 1 -- 172.21.15.37:0/416380283 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d40d2730 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.945+0000 7fe6d3fff640 1 --2- 172.21.15.37:0/416380283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d40cfca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009d90 tx=0x7fe6c402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4a47406deecec1a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6d37fe640 1 -- 172.21.15.37:0/416380283 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4031600 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6d37fe640 1 -- 172.21.15.37:0/416380283 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c40317a0 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6d37fe640 1 -- 172.21.15.37:0/416380283 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4031b50 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6dad46640 1 -- 172.21.15.37:0/416380283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d40d3cd0 msgr2=0x7fe6d40cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6dad46640 1 --2- 172.21.15.37:0/416380283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d40cfca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009d90 tx=0x7fe6c402a5d0 comp rx=0 tx=0).stop 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6dad46640 1 -- 172.21.15.37:0/416380283 shutdown_connections 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6dad46640 1 --2- 172.21.15.37:0/416380283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d40cfca0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6dad46640 1 -- 172.21.15.37:0/416380283 >> 172.21.15.37:0/416380283 conn(0x7fe6d40d4fe0 msgr2=0x7fe6d40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6dad46640 1 -- 172.21.15.37:0/416380283 shutdown_connections 2024-05-10T08:40:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.946+0000 7fe6dad46640 1 -- 172.21.15.37:0/416380283 wait complete. 2024-05-10T08:40:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.947+0000 7fe6dad46640 1 Processor -- start 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.947+0000 7fe6dad46640 1 -- start start 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.948+0000 7fe6dad46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6d40c9ee0 0x7fe6d40baa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.948+0000 7fe6dad46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.948+0000 7fe6dad46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d41629a0 0x7fe6d40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.948+0000 7fe6dad46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d40cf440 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.948+0000 7fe6dad46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d40cf2c0 con 0x7fe6d41629a0 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.948+0000 7fe6dad46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d40d2dc0 con 0x7fe6d40c9ee0 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.948+0000 7fe6d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d415ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51662/0 (socket says 172.21.15.37:51662) 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 -- 172.21.15.37:0/2295670607 learned_addr learned my addr 172.21.15.37:0/2295670607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d92e3640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d41629a0 0x7fe6d40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d8ae2640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6d40c9ee0 0x7fe6d40baa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 -- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6d40c9ee0 msgr2=0x7fe6d40baa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6d40c9ee0 0x7fe6d40baa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 -- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d41629a0 msgr2=0x7fe6d40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d41629a0 0x7fe6d40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 -- 172.21.15.37:0/2295670607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d415b060 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d3fff640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d415ab20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4000f80 tx=0x7fe6c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d17fa640 1 -- 172.21.15.37:0/2295670607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4040070 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d17fa640 1 -- 172.21.15.37:0/2295670607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c403c830 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d40cd960 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6d17fa640 1 -- 172.21.15.37:0/2295670607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c403cbe0 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.949+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d40cdf20 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.951+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d4069d10 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.951+0000 7fe6d17fa640 1 -- 172.21.15.37:0/2295670607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fe6c4039040 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.952+0000 7fe6d17fa640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe6b4076240 0x7fe6b4078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.952+0000 7fe6d17fa640 1 -- 172.21.15.37:0/2295670607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7fe6c40b8170 con 0x7fe6d40d3cd0 2024-05-10T08:40:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.952+0000 7fe6d8ae2640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe6b4076240 0x7fe6b4078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.952+0000 7fe6d8ae2640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe6b4076240 0x7fe6b4078700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc007fd0 tx=0x7fe6bc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:11.956+0000 7fe6d17fa640 1 -- 172.21.15.37:0/2295670607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe6c4081950 con 0x7fe6d40d3cd0 2024-05-10T08:40:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.187+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6d40693f0 con 0x7fe6d40d3cd0 2024-05-10T08:40:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.188+0000 7fe6d17fa640 1 -- 172.21.15.37:0/2295670607 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3861 (secure 0 0 0) 0x7fe6c4085c50 con 0x7fe6d40d3cd0 2024-05-10T08:40:12.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:12.188 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-10T08:40:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe6b4076240 msgr2=0x7fe6b4078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe6b4076240 0x7fe6b4078700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc007fd0 tx=0x7fe6bc009040 comp rx=0 tx=0).stop 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6d40d3cd0 msgr2=0x7fe6d415ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d415ab20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4000f80 tx=0x7fe6c4004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 shutdown_connections 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe6b4076240 0x7fe6b4078700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d41629a0 0x7fe6d40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6d40d3cd0 0x7fe6d415ab20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 --2- 172.21.15.37:0/2295670607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6d40c9ee0 0x7fe6d40baa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 >> 172.21.15.37:0/2295670607 conn(0x7fe6d40d4fe0 msgr2=0x7fe6d40b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 shutdown_connections 2024-05-10T08:40:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.190+0000 7fe6dad46640 1 -- 172.21.15.37:0/2295670607 wait complete. 2024-05-10T08:40:12.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:40:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.304+0000 7fae16589640 1 Processor -- start 2024-05-10T08:40:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.304+0000 7fae16589640 1 -- start start 2024-05-10T08:40:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae16589640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae1015f380 0x7fae100d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae16589640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae16589640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae100d1760 con 0x7fae100d3b00 2024-05-10T08:40:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae16589640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fae100d30f0 con 0x7fae1015f380 2024-05-10T08:40:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae16589640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fae100d1150 con 0x7fae100d0cf0 2024-05-10T08:40:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae0ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae1015f380 0x7fae100d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae0ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae1015f380 0x7fae100d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51678/0 (socket says 172.21.15.37:51678) 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae0ffff640 1 -- 172.21.15.37:0/2688532552 learned_addr learned my addr 172.21.15.37:0/2688532552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.305+0000 7fae14b26640 1 --1- 172.21.15.37:0/2688532552 >> v1:172.21.15.37:6789/0 conn(0x7fae100d3b00 0x7fae10162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36218/0 (socket says 172.21.15.37:36218) 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.306+0000 7fae0f7fe640 1 --2- 172.21.15.37:0/2688532552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.306+0000 7fae0ffff640 1 -- 172.21.15.37:0/2688532552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 msgr2=0x7fae100d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.306+0000 7fae0ffff640 1 --2- 172.21.15.37:0/2688532552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.306+0000 7fae0ffff640 1 -- 172.21.15.37:0/2688532552 >> v1:172.21.15.37:6789/0 conn(0x7fae100d3b00 legacy=0x7fae10162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.306+0000 7fae0ffff640 1 -- 172.21.15.37:0/2688532552 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae100d1a40 con 0x7fae1015f380 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.306+0000 7fae0f7fe640 1 --2- 172.21.15.37:0/2688532552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.306+0000 7fae0ffff640 1 --2- 172.21.15.37:0/2688532552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae100d07b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae00009870 tx=0x7fae0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a202a4f430c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae0effd640 1 -- 172.21.15.37:0/2688532552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00037070 con 0x7fae1015f380 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae0effd640 1 -- 172.21.15.37:0/2688532552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00032440 con 0x7fae1015f380 2024-05-10T08:40:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae0effd640 1 -- 172.21.15.37:0/2688532552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00032810 con 0x7fae1015f380 2024-05-10T08:40:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 -- 172.21.15.37:0/2688532552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 msgr2=0x7fae100d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 --2- 172.21.15.37:0/2688532552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae100d07b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae00009870 tx=0x7fae0002a270 comp rx=0 tx=0).stop 2024-05-10T08:40:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 -- 172.21.15.37:0/2688532552 shutdown_connections 2024-05-10T08:40:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 --2- 172.21.15.37:0/2688532552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 --2- 172.21.15.37:0/2688532552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae100d07b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 -- 172.21.15.37:0/2688532552 >> 172.21.15.37:0/2688532552 conn(0x7fae100d4fe0 msgr2=0x7fae100d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 -- 172.21.15.37:0/2688532552 shutdown_connections 2024-05-10T08:40:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.307+0000 7fae16589640 1 -- 172.21.15.37:0/2688532552 wait complete. 2024-05-10T08:40:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.308+0000 7fae16589640 1 Processor -- start 2024-05-10T08:40:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae16589640 1 -- start start 2024-05-10T08:40:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae16589640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae16589640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae100d3b00 0x7fae101e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae16589640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae1015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae16589640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fae100b8e40 con 0x7fae1015f380 2024-05-10T08:40:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae16589640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae100d2370 con 0x7fae100d3b00 2024-05-10T08:40:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae16589640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fae100d2000 con 0x7fae100d0cf0 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae14b26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae1015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae14b26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae1015a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51692/0 (socket says 172.21.15.37:51692) 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.309+0000 7fae14b26640 1 -- 172.21.15.37:0/4120975942 learned_addr learned my addr 172.21.15.37:0/4120975942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae0ffff640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae0f7fe640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae100d3b00 0x7fae101e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae14b26640 1 -- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 msgr2=0x7fae100cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae14b26640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae14b26640 1 -- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae100d3b00 msgr2=0x7fae101e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae14b26640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae100d3b00 0x7fae101e8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae14b26640 1 -- 172.21.15.37:0/4120975942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae101e9330 con 0x7fae1015f380 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae14b26640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae1015a4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c780 tx=0x7fae0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae0cff9640 1 -- 172.21.15.37:0/4120975942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08017070 con 0x7fae1015f380 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae0cff9640 1 -- 172.21.15.37:0/4120975942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0800a640 con 0x7fae1015f380 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae101e9610 con 0x7fae1015f380 2024-05-10T08:40:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae0cff9640 1 -- 172.21.15.37:0/4120975942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0800aa30 con 0x7fae1015f380 2024-05-10T08:40:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.310+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae101e9bd0 con 0x7fae1015f380 2024-05-10T08:40:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.311+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae100693f0 con 0x7fae1015f380 2024-05-10T08:40:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.312+0000 7fae0cff9640 1 -- 172.21.15.37:0/4120975942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fae0801a070 con 0x7fae1015f380 2024-05-10T08:40:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.312+0000 7fae0cff9640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fadfc076240 0x7fadfc078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.312+0000 7fae0cff9640 1 -- 172.21.15.37:0/4120975942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7fae080966d0 con 0x7fae1015f380 2024-05-10T08:40:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.312+0000 7fae0ffff640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fadfc076240 0x7fadfc078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.313+0000 7fae0ffff640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fadfc076240 0x7fadfc078700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae00034000 tx=0x7fae0002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.317+0000 7fae0cff9640 1 -- 172.21.15.37:0/4120975942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fae0805fe20 con 0x7fae1015f380 2024-05-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.511+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fae1008cfd0 con 0x7fae1015f380 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.511+0000 7fae0cff9640 1 -- 172.21.15.37:0/4120975942 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) ==== 84+0+65 (secure 0 0 0) 0x7fae08064120 con 0x7fae1015f380 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:12.511 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fadfc076240 msgr2=0x7fadfc078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fadfc076240 0x7fadfc078700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae00034000 tx=0x7fae0002e000 comp rx=0 tx=0).stop 2024-05-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 msgr2=0x7fae1015a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae1015a4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c780 tx=0x7fae0800cc40 comp rx=0 tx=0).stop 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 shutdown_connections 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fadfc076240 0x7fadfc078700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae1015f380 0x7fae1015a4b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae100d3b00 0x7fae101e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 --2- 172.21.15.37:0/4120975942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fae100d0cf0 0x7fae100cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.513+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 >> 172.21.15.37:0/4120975942 conn(0x7fae100d4fe0 msgr2=0x7fae1006ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.514+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 shutdown_connections 2024-05-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.514+0000 7fae16589640 1 -- 172.21.15.37:0/4120975942 wait complete. 2024-05-10T08:40:12.524 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:40:12.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:40:12.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.631+0000 7f52dcbdd640 1 Processor -- start 2024-05-10T08:40:12.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.631+0000 7f52dcbdd640 1 -- start start 2024-05-10T08:40:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.632+0000 7f52dcbdd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815f680 0x7f52d80d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.632+0000 7f52dcbdd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80d5cc0 con 0x7f52d80d5750 2024-05-10T08:40:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.632+0000 7f52dcbdd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80cfcf0 con 0x7f52d80d3620 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.632+0000 7f52dcbdd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80d0620 con 0x7f52d815f680 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.632+0000 7f52d6d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f52d80d5750 0x7f52d80b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36232/0 (socket says 172.21.15.37:36232) 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.632+0000 7f52d6d9d640 1 -- 172.21.15.37:0/3785470165 learned_addr learned my addr 172.21.15.37:0/3785470165 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.632+0000 7f52d5d9b640 1 --2- 172.21.15.37:0/3785470165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815f680 0x7f52d80d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.633+0000 7f52d559a640 1 -- 172.21.15.37:0/3785470165 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051718195 0 0) 0x7f52d80d5cc0 con 0x7f52d80d5750 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.633+0000 7f52d559a640 1 -- 172.21.15.37:0/3785470165 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c0003520 con 0x7f52d80d5750 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.633+0000 7f52d559a640 1 -- 172.21.15.37:0/3785470165 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769770062 0 0) 0x7f52d80cfcf0 con 0x7f52d80d3620 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.633+0000 7f52d559a640 1 -- 172.21.15.37:0/3785470165 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d80d5cc0 con 0x7f52d80d3620 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.633+0000 7f52d5d9b640 1 -- 172.21.15.37:0/3785470165 >> v1:172.21.15.82:6789/0 conn(0x7f52d80d3620 legacy=0x7f52d80d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.633+0000 7f52d5d9b640 1 -- 172.21.15.37:0/3785470165 >> v1:172.21.15.37:6789/0 conn(0x7f52d80d5750 legacy=0x7f52d80b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.633+0000 7f52d5d9b640 1 -- 172.21.15.37:0/3785470165 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80cffd0 con 0x7f52d815f680 2024-05-10T08:40:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52d5d9b640 1 --2- 172.21.15.37:0/3785470165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815f680 0x7f52d80d2080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0097d0 tx=0x7f52cc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a220880f85603d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52d559a640 1 -- 172.21.15.37:0/3785470165 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc037070 con 0x7f52d815f680 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52d559a640 1 -- 172.21.15.37:0/3785470165 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc032440 con 0x7f52d815f680 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52d559a640 1 -- 172.21.15.37:0/3785470165 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc032810 con 0x7f52d815f680 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52dcbdd640 1 -- 172.21.15.37:0/3785470165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815f680 msgr2=0x7f52d80d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/3785470165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815f680 0x7f52d80d2080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0097d0 tx=0x7f52cc02a210 comp rx=0 tx=0).stop 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52dcbdd640 1 -- 172.21.15.37:0/3785470165 shutdown_connections 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/3785470165 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815f680 0x7f52d80d2080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52dcbdd640 1 -- 172.21.15.37:0/3785470165 >> 172.21.15.37:0/3785470165 conn(0x7f52d809e380 msgr2=0x7f52d80d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52dcbdd640 1 -- 172.21.15.37:0/3785470165 shutdown_connections 2024-05-10T08:40:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.634+0000 7f52dcbdd640 1 -- 172.21.15.37:0/3785470165 wait complete. 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 Processor -- start 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 -- start start 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80d3620 0x7f52d80cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80d5750 0x7f52d814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d815f680 0x7f52d815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80d0ab0 con 0x7f52d80d5750 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80d3040 con 0x7f52d815f680 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.636+0000 7f52dcbdd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80d0c30 con 0x7f52d80d3620 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80d5750 0x7f52d814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80d5750 0x7f52d814f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51702/0 (socket says 172.21.15.37:51702) 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 -- 172.21.15.37:0/2519642455 learned_addr learned my addr 172.21.15.37:0/2519642455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d6d9d640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d815f680 0x7f52d815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d659c640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80d3620 0x7f52d80cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 -- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80d3620 msgr2=0x7f52d80cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80d3620 0x7f52d80cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 -- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d815f680 msgr2=0x7f52d815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d815f680 0x7f52d815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 -- 172.21.15.37:0/2519642455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d8159f90 con 0x7f52d80d5750 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52d5d9b640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80d5750 0x7f52d814f480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f52cc035040 tx=0x7f52cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52c6ffd640 1 -- 172.21.15.37:0/2519642455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc041020 con 0x7f52d80d5750 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52c6ffd640 1 -- 172.21.15.37:0/2519642455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc03d720 con 0x7f52d80d5750 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d815a270 con 0x7f52d80d5750 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52c6ffd640 1 -- 172.21.15.37:0/2519642455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc037040 con 0x7f52d80d5750 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.637+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d815a830 con 0x7f52d80d5750 2024-05-10T08:40:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.638+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d80d2e30 con 0x7f52d80d5750 2024-05-10T08:40:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.639+0000 7f52c6ffd640 1 -- 172.21.15.37:0/2519642455 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f52cc044020 con 0x7f52d80d5750 2024-05-10T08:40:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.639+0000 7f52c6ffd640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f52b8076240 0x7f52b8078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.640+0000 7f52c6ffd640 1 -- 172.21.15.37:0/2519642455 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f52cc0b7710 con 0x7f52d80d5750 2024-05-10T08:40:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.640+0000 7f52d659c640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f52b8076240 0x7f52b8078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.640+0000 7f52d659c640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f52b8076240 0x7f52b8078700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52c8001ea0 tx=0x7f52c8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.644+0000 7f52c6ffd640 1 -- 172.21.15.37:0/2519642455 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f52d80d2e30 con 0x7f52d80d5750 2024-05-10T08:40:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:12.836+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f52d80693f0 con 0x7f52d80d5750 2024-05-10T08:40:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.691+0000 7f52c6ffd640 1 -- 172.21.15.37:0/2519642455 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f52cc04b030 con 0x7f52d80d5750 2024-05-10T08:40:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:40:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.694+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f52b8076240 msgr2=0x7f52b8078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.694+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f52b8076240 0x7f52b8078700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52c8001ea0 tx=0x7f52c8009040 comp rx=0 tx=0).stop 2024-05-10T08:40:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.694+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80d5750 msgr2=0x7f52d814f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.694+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80d5750 0x7f52d814f480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f52cc035040 tx=0x7f52cc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 shutdown_connections 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f52b8076240 0x7f52b8078700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d815f680 0x7f52d815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80d5750 0x7f52d814f480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 --2- 172.21.15.37:0/2519642455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80d3620 0x7f52d80cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 >> 172.21.15.37:0/2519642455 conn(0x7f52d809e380 msgr2=0x7f52d806e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 shutdown_connections 2024-05-10T08:40:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.695+0000 7f52dcbdd640 1 -- 172.21.15.37:0/2519642455 wait complete. 2024-05-10T08:40:13.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-10T08:40:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.822+0000 7f072e82a640 1 Processor -- start 2024-05-10T08:40:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.822+0000 7f072e82a640 1 -- start start 2024-05-10T08:40:13.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.822+0000 7f072e82a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07280b6590 0x7f07280d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:13.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.822+0000 7f072e82a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07280d2bb0 0x7f0728162d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:13.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.822+0000 7f072e82a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07280d3320 con 0x7f0728163290 2024-05-10T08:40:13.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.822+0000 7f072e82a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f07280d3600 con 0x7f07280b6590 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.822+0000 7f072e82a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f07280d38e0 con 0x7f07280d2bb0 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0727fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07280b6590 0x7f07280d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0727fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07280b6590 0x7f07280d0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51712/0 (socket says 172.21.15.37:51712) 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f072cdc7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0728163290 0x7f072815ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36248/0 (socket says 172.21.15.37:36248) 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0727fff640 1 -- 172.21.15.37:0/2381849849 learned_addr learned my addr 172.21.15.37:0/2381849849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f07277fe640 1 --2- 172.21.15.37:0/2381849849 >> v2:172.21.15.82:3300/0 conn(0x7f07280d2bb0 0x7f0728162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0727fff640 1 -- 172.21.15.37:0/2381849849 >> v2:172.21.15.82:3300/0 conn(0x7f07280d2bb0 msgr2=0x7f0728162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0727fff640 1 --2- 172.21.15.37:0/2381849849 >> v2:172.21.15.82:3300/0 conn(0x7f07280d2bb0 0x7f0728162d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0726ffd640 1 -- 172.21.15.37:0/2381849849 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547630242 0 0) 0x7f07280d3320 con 0x7f0728163290 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0727fff640 1 -- 172.21.15.37:0/2381849849 >> v1:172.21.15.37:6789/0 conn(0x7f0728163290 legacy=0x7f072815ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.823+0000 7f0727fff640 1 -- 172.21.15.37:0/2381849849 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07280d3bc0 con 0x7f07280b6590 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f0727fff640 1 --2- 172.21.15.37:0/2381849849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280b6590 0x7f07280d0bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f072808d6f0 tx=0x7f071802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa13c0d5c565b9dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f0726ffd640 1 -- 172.21.15.37:0/2381849849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718037070 con 0x7f07280b6590 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f0726ffd640 1 -- 172.21.15.37:0/2381849849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0718032440 con 0x7f07280b6590 2024-05-10T08:40:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f0726ffd640 1 -- 172.21.15.37:0/2381849849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718032810 con 0x7f07280b6590 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 -- 172.21.15.37:0/2381849849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280b6590 msgr2=0x7f07280d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 --2- 172.21.15.37:0/2381849849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280b6590 0x7f07280d0bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f072808d6f0 tx=0x7f071802a270 comp rx=0 tx=0).stop 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 -- 172.21.15.37:0/2381849849 shutdown_connections 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 --2- 172.21.15.37:0/2381849849 >> v2:172.21.15.82:3300/0 conn(0x7f07280d2bb0 0x7f0728162d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 --2- 172.21.15.37:0/2381849849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280b6590 0x7f07280d0bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 -- 172.21.15.37:0/2381849849 >> 172.21.15.37:0/2381849849 conn(0x7f07280d4fe0 msgr2=0x7f07280d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 -- 172.21.15.37:0/2381849849 shutdown_connections 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.824+0000 7f072e82a640 1 -- 172.21.15.37:0/2381849849 wait complete. 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.826+0000 7f072e82a640 1 Processor -- start 2024-05-10T08:40:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.826+0000 7f072e82a640 1 -- start start 2024-05-10T08:40:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.826+0000 7f072e82a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07280b6590 0x7f07281570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072e82a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280d2bb0 0x7f07280cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072e82a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0728163290 0x7f07280c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072e82a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f072815f340 con 0x7f07280d2bb0 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072e82a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07280d3010 con 0x7f07280b6590 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072e82a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f072815f4c0 con 0x7f0728163290 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280d2bb0 0x7f07280cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280d2bb0 0x7f07280cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51720/0 (socket says 172.21.15.37:51720) 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 -- 172.21.15.37:0/38188751 learned_addr learned my addr 172.21.15.37:0/38188751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f0727fff640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07280b6590 0x7f07281570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072cdc7640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0728163290 0x7f07280c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 -- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0728163290 msgr2=0x7f07280c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0728163290 0x7f07280c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 -- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07280b6590 msgr2=0x7f07281570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07280b6590 0x7f07281570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 -- 172.21.15.37:0/38188751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07280c8830 con 0x7f07280d2bb0 2024-05-10T08:40:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072cdc7640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0728163290 0x7f07280c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f07277fe640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280d2bb0 0x7f07280cebe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f071c00e960 tx=0x7f071c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f0724ff9640 1 -- 172.21.15.37:0/38188751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c017070 con 0x7f07280d2bb0 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f0724ff9640 1 -- 172.21.15.37:0/38188751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071c00ca00 con 0x7f07280d2bb0 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07280c8b10 con 0x7f07280d2bb0 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f0724ff9640 1 -- 172.21.15.37:0/38188751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c00cdf0 con 0x7f07280d2bb0 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.827+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07280c90d0 con 0x7f07280d2bb0 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.829+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07280693f0 con 0x7f07280d2bb0 2024-05-10T08:40:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.829+0000 7f0724ff9640 1 -- 172.21.15.37:0/38188751 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f071c01a070 con 0x7f07280d2bb0 2024-05-10T08:40:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.830+0000 7f0724ff9640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07140762d0 0x7f0714078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.830+0000 7f0724ff9640 1 -- 172.21.15.37:0/38188751 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f071c097790 con 0x7f07280d2bb0 2024-05-10T08:40:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.830+0000 7f0727fff640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07140762d0 0x7f0714078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.830+0000 7f0727fff640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07140762d0 0x7f0714078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0718034000 tx=0x7f071802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:13.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:13.834+0000 7f0724ff9640 1 -- 172.21.15.37:0/38188751 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f071c060c80 con 0x7f07280d2bb0 2024-05-10T08:40:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.029+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f07280b93a0 con 0x7f07280d2bb0 2024-05-10T08:40:14.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.699+0000 7f0724ff9640 1 -- 172.21.15.37:0/38188751 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f071c064f80 con 0x7f07280d2bb0 2024-05-10T08:40:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:40:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.703+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07140762d0 msgr2=0x7f0714078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.703+0000 7f072e82a640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07140762d0 0x7f0714078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0718034000 tx=0x7f071802e000 comp rx=0 tx=0).stop 2024-05-10T08:40:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280d2bb0 msgr2=0x7f07280cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280d2bb0 0x7f07280cebe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f071c00e960 tx=0x7f071c00ee20 comp rx=0 tx=0).stop 2024-05-10T08:40:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 shutdown_connections 2024-05-10T08:40:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07140762d0 0x7f0714078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0728163290 0x7f07280c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07280d2bb0 0x7f07280cebe0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 --2- 172.21.15.37:0/38188751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07280b6590 0x7f07281570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.704+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 >> 172.21.15.37:0/38188751 conn(0x7f07280d4fe0 msgr2=0x7f07280b8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.711+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 shutdown_connections 2024-05-10T08:40:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.711+0000 7f072e82a640 1 -- 172.21.15.37:0/38188751 wait complete. 2024-05-10T08:40:14.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:40:14.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.844+0000 7f8a61140640 1 Processor -- start 2024-05-10T08:40:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.844+0000 7f8a61140640 1 -- start start 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a61140640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a5c0b5ed0 0x7f8a5c0b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a61140640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a5c0d18e0 0x7f8a5c0d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a61140640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0d07f0 con 0x7f8a5c162910 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a61140640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5c0d2290 con 0x7f8a5c0b5ed0 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a61140640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5c0d2be0 con 0x7f8a5c0d18e0 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a53fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a5c0b5ed0 0x7f8a5c0b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a53fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a5c0b5ed0 0x7f8a5c0b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51728/0 (socket says 172.21.15.37:51728) 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a5ad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8a5c162910 0x7f8a5c0d5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36256/0 (socket says 172.21.15.37:36256) 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a53fff640 1 -- 172.21.15.37:0/4059776228 learned_addr learned my addr 172.21.15.37:0/4059776228 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a53fff640 1 -- 172.21.15.37:0/4059776228 >> v2:172.21.15.82:3300/0 conn(0x7f8a5c0d18e0 msgr2=0x7f8a5c0d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a5b59e640 1 --2- 172.21.15.37:0/4059776228 >> v2:172.21.15.82:3300/0 conn(0x7f8a5c0d18e0 0x7f8a5c0d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a53fff640 1 --2- 172.21.15.37:0/4059776228 >> v2:172.21.15.82:3300/0 conn(0x7f8a5c0d18e0 0x7f8a5c0d1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a5a59c640 1 -- 172.21.15.37:0/4059776228 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776450456 0 0) 0x7f8a5c0d07f0 con 0x7f8a5c162910 2024-05-10T08:40:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a53fff640 1 -- 172.21.15.37:0/4059776228 >> v1:172.21.15.37:6789/0 conn(0x7f8a5c162910 legacy=0x7f8a5c0d5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a53fff640 1 -- 172.21.15.37:0/4059776228 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0d0ad0 con 0x7f8a5c0b5ed0 2024-05-10T08:40:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.845+0000 7f8a5b59e640 1 --2- 172.21.15.37:0/4059776228 >> v2:172.21.15.82:3300/0 conn(0x7f8a5c0d18e0 0x7f8a5c0d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.846+0000 7f8a53fff640 1 --2- 172.21.15.37:0/4059776228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0b7e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009870 tx=0x7f8a4402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f4b6536a0bcfe5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.846+0000 7f8a5a59c640 1 -- 172.21.15.37:0/4059776228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44037070 con 0x7f8a5c0b5ed0 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.846+0000 7f8a5a59c640 1 -- 172.21.15.37:0/4059776228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44032440 con 0x7f8a5c0b5ed0 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.846+0000 7f8a5a59c640 1 -- 172.21.15.37:0/4059776228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44032810 con 0x7f8a5c0b5ed0 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 -- 172.21.15.37:0/4059776228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c0b5ed0 msgr2=0x7f8a5c0b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 --2- 172.21.15.37:0/4059776228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0b7e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009870 tx=0x7f8a4402a2a0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 -- 172.21.15.37:0/4059776228 shutdown_connections 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 --2- 172.21.15.37:0/4059776228 >> v2:172.21.15.82:3300/0 conn(0x7f8a5c0d18e0 0x7f8a5c0d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 --2- 172.21.15.37:0/4059776228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0b7e60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 -- 172.21.15.37:0/4059776228 >> 172.21.15.37:0/4059776228 conn(0x7f8a5c09e3e0 msgr2=0x7f8a5c0d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 -- 172.21.15.37:0/4059776228 shutdown_connections 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.847+0000 7f8a61140640 1 -- 172.21.15.37:0/4059776228 wait complete. 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.848+0000 7f8a61140640 1 Processor -- start 2024-05-10T08:40:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.848+0000 7f8a61140640 1 -- start start 2024-05-10T08:40:14.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a61140640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0d3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a61140640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5c0d18e0 0x7f8a5c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a61140640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c162910 0x7f8a5c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a61140640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0d2e30 con 0x7f8a5c162910 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a61140640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c162cf0 con 0x7f8a5c0b5ed0 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a61140640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c0d3350 con 0x7f8a5c0d18e0 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c162910 0x7f8a5c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c162910 0x7f8a5c0cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51732/0 (socket says 172.21.15.37:51732) 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 -- 172.21.15.37:0/1616698929 learned_addr learned my addr 172.21.15.37:0/1616698929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a53fff640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5c0d18e0 0x7f8a5c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5ad9d640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 -- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5c0d18e0 msgr2=0x7f8a5c0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5c0d18e0 0x7f8a5c0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 -- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a5c0b5ed0 msgr2=0x7f8a5c0d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 -- 172.21.15.37:0/1616698929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c15bb40 con 0x7f8a5c162910 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a53fff640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5c0d18e0 0x7f8a5c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5ad9d640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a5b59e640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c162910 0x7f8a5c0cb140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400cef0 tx=0x7f8a5400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a537fe640 1 -- 172.21.15.37:0/1616698929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5401a070 con 0x7f8a5c162910 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a537fe640 1 -- 172.21.15.37:0/1616698929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5400d860 con 0x7f8a5c162910 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.849+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c0cbb50 con 0x7f8a5c162910 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.850+0000 7f8a537fe640 1 -- 172.21.15.37:0/1616698929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400dc50 con 0x7f8a5c162910 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.850+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c0ccc10 con 0x7f8a5c162910 2024-05-10T08:40:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.850+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c0693f0 con 0x7f8a5c162910 2024-05-10T08:40:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.851+0000 7f8a537fe640 1 -- 172.21.15.37:0/1616698929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a5401d070 con 0x7f8a5c162910 2024-05-10T08:40:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.852+0000 7f8a537fe640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a3c0762d0 0x7f8a3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.852+0000 7f8a537fe640 1 -- 172.21.15.37:0/1616698929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f8a54097e90 con 0x7f8a5c162910 2024-05-10T08:40:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.852+0000 7f8a5ad9d640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a3c0762d0 0x7f8a3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.852+0000 7f8a5ad9d640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a3c0762d0 0x7f8a3c078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c000f60 tx=0x7f8a4c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:14.856+0000 7f8a537fe640 1 -- 172.21.15.37:0/1616698929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8a54061880 con 0x7f8a5c162910 2024-05-10T08:40:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.091+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8a5c0d2690 con 0x7f8a5c162910 2024-05-10T08:40:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.706+0000 7f8a537fe640 1 -- 172.21.15.37:0/1616698929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8a54061180 con 0x7f8a5c162910 2024-05-10T08:40:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T08:40:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.718+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a3c0762d0 msgr2=0x7f8a3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.718+0000 7f8a61140640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a3c0762d0 0x7f8a3c078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c000f60 tx=0x7f8a4c009040 comp rx=0 tx=0).stop 2024-05-10T08:40:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.718+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c162910 msgr2=0x7f8a5c0cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.718+0000 7f8a61140640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c162910 0x7f8a5c0cb140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400cef0 tx=0x7f8a5400a710 comp rx=0 tx=0).stop 2024-05-10T08:40:15.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.721+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 shutdown_connections 2024-05-10T08:40:15.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.721+0000 7f8a61140640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a3c0762d0 0x7f8a3c078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.721+0000 7f8a61140640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c162910 0x7f8a5c0cb140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.721+0000 7f8a61140640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a5c0d18e0 0x7f8a5c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.721+0000 7f8a61140640 1 --2- 172.21.15.37:0/1616698929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a5c0b5ed0 0x7f8a5c0d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.721+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 >> 172.21.15.37:0/1616698929 conn(0x7f8a5c09e3e0 msgr2=0x7f8a5c1637f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:15.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.722+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 shutdown_connections 2024-05-10T08:40:15.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.724+0000 7f8a61140640 1 -- 172.21.15.37:0/1616698929 wait complete. 2024-05-10T08:40:15.745 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-10T08:40:15.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-10T08:40:15.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.859+0000 7fed46864640 1 Processor -- start 2024-05-10T08:40:15.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.859+0000 7fed46864640 1 -- start start 2024-05-10T08:40:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed46864640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed400d5750 0x7fed400d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed46864640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed400d5cc0 con 0x7fed4015f680 2024-05-10T08:40:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed46864640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed400cfcf0 con 0x7fed400d3620 2024-05-10T08:40:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed46864640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fed400d0620 con 0x7fed400d5750 2024-05-10T08:40:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed4015f680 0x7fed400b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36264/0 (socket says 172.21.15.37:36264) 2024-05-10T08:40:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3f7fe640 1 -- 172.21.15.37:0/2235654414 learned_addr learned my addr 172.21.15.37:0/2235654414 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed44e01640 1 --2- 172.21.15.37:0/2235654414 >> v2:172.21.15.82:3300/0 conn(0x7fed400d5750 0x7fed400d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303700914 0 0) 0x7fed400d5cc0 con 0x7fed4015f680 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed28003520 con 0x7fed4015f680 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3644615706 0 0) 0x7fed28003520 con 0x7fed4015f680 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 >> v2:172.21.15.82:3300/0 conn(0x7fed400d5750 msgr2=0x7fed400d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 --2- 172.21.15.37:0/2235654414 >> v2:172.21.15.82:3300/0 conn(0x7fed400d5750 0x7fed400d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 >> v1:172.21.15.82:6789/0 conn(0x7fed400d3620 legacy=0x7fed400d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed400cffd0 con 0x7fed4015f680 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fed34001670 con 0x7fed4015f680 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed44e01640 1 --2- 172.21.15.37:0/2235654414 >> v2:172.21.15.82:3300/0 conn(0x7fed400d5750 0x7fed400d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 >> v1:172.21.15.37:6789/0 conn(0x7fed4015f680 legacy=0x7fed400b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed28004800 0x7fed28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed280051c0 0x7fed2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed400d0620 con 0x7fed280039b0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed2800c060 con 0x7fed28004800 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fed2800c260 con 0x7fed280051c0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.860+0000 7fed3ffff640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed28004800 0x7fed28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed44e01640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed280051c0 0x7fed2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed3ffff640 1 -- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed280051c0 msgr2=0x7fed2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed3ffff640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed280051c0 0x7fed2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed3ffff640 1 -- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed28004800 msgr2=0x7fed28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed3ffff640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed28004800 0x7fed28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed3ffff640 1 -- 172.21.15.37:0/2235654414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed28003520 con 0x7fed280039b0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed44e01640 1 -- 172.21.15.37:0/2235654414 reap_dead start 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.861+0000 7fed3ffff640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed28003dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed30001750 tx=0x7fed28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e0f0f32e54020c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30001370 con 0x7fed280039b0 2024-05-10T08:40:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed300052d0 con 0x7fed280039b0 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed3effd640 1 -- 172.21.15.37:0/2235654414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3002abc0 con 0x7fed280039b0 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed46864640 1 -- 172.21.15.37:0/2235654414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 msgr2=0x7fed28003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed46864640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed28003dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed30001750 tx=0x7fed28005830 comp rx=0 tx=0).stop 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed46864640 1 -- 172.21.15.37:0/2235654414 shutdown_connections 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed46864640 1 --2- 172.21.15.37:0/2235654414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed28003dd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed46864640 1 -- 172.21.15.37:0/2235654414 >> 172.21.15.37:0/2235654414 conn(0x7fed4009e380 msgr2=0x7fed400d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed46864640 1 -- 172.21.15.37:0/2235654414 shutdown_connections 2024-05-10T08:40:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.862+0000 7fed46864640 1 -- 172.21.15.37:0/2235654414 wait complete. 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.863+0000 7fed46864640 1 Processor -- start 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.864+0000 7fed46864640 1 -- start start 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.864+0000 7fed46864640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed40153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.864+0000 7fed46864640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed40154670 0x7fed40156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.864+0000 7fed46864640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed40157330 0x7fed400cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.864+0000 7fed46864640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed400d2080 con 0x7fed280039b0 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.864+0000 7fed46864640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed400d3040 con 0x7fed40157330 2024-05-10T08:40:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.864+0000 7fed46864640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fed400d2200 con 0x7fed40154670 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed40153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed40153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51756/0 (socket says 172.21.15.37:51756) 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 -- 172.21.15.37:0/1347394987 learned_addr learned my addr 172.21.15.37:0/1347394987 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed40154670 0x7fed40156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed44e01640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed40157330 0x7fed400cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 -- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed40154670 msgr2=0x7fed40156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed40154670 0x7fed40156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 -- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed40157330 msgr2=0x7fed400cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed40157330 0x7fed400cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 -- 172.21.15.37:0/1347394987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed40158e80 con 0x7fed280039b0 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3ffff640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed40153870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed30001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3cff9640 1 -- 172.21.15.37:0/1347394987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30037040 con 0x7fed280039b0 2024-05-10T08:40:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3cff9640 1 -- 172.21.15.37:0/1347394987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30005480 con 0x7fed280039b0 2024-05-10T08:40:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed3cff9640 1 -- 172.21.15.37:0/1347394987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30007a30 con 0x7fed280039b0 2024-05-10T08:40:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed40159100 con 0x7fed280039b0 2024-05-10T08:40:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.865+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed401596c0 con 0x7fed280039b0 2024-05-10T08:40:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.866+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed400d5cc0 con 0x7fed280039b0 2024-05-10T08:40:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.867+0000 7fed3cff9640 1 -- 172.21.15.37:0/1347394987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fed30044020 con 0x7fed280039b0 2024-05-10T08:40:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.867+0000 7fed3cff9640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fed2c076300 0x7fed2c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.867+0000 7fed3cff9640 1 -- 172.21.15.37:0/1347394987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fed300b7140 con 0x7fed280039b0 2024-05-10T08:40:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.867+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fed2c076300 0x7fed2c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.868+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fed2c076300 0x7fed2c0787c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed400d16d0 tx=0x7fed34000f80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:15.872+0000 7fed3cff9640 1 -- 172.21.15.37:0/1347394987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fed400d5cc0 con 0x7fed280039b0 2024-05-10T08:40:16.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.070+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fed4015db60 con 0x7fed280039b0 2024-05-10T08:40:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.711+0000 7fed3cff9640 1 -- 172.21.15.37:0/1347394987 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fed4015db60 con 0x7fed280039b0 2024-05-10T08:40:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fed2c076300 msgr2=0x7fed2c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fed2c076300 0x7fed2c0787c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed400d16d0 tx=0x7fed34000f80 comp rx=0 tx=0).stop 2024-05-10T08:40:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 msgr2=0x7fed40153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed40153870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed30001120 comp rx=0 tx=0).stop 2024-05-10T08:40:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 shutdown_connections 2024-05-10T08:40:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fed2c076300 0x7fed2c0787c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed40157330 0x7fed400cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fed40154670 0x7fed40156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 --2- 172.21.15.37:0/1347394987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed280039b0 0x7fed40153870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 >> 172.21.15.37:0/1347394987 conn(0x7fed4009e380 msgr2=0x7fed400b8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.715+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 shutdown_connections 2024-05-10T08:40:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.716+0000 7fed46864640 1 -- 172.21.15.37:0/1347394987 wait complete. 2024-05-10T08:40:16.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:40:16.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.846+0000 7f21ba837640 1 Processor -- start 2024-05-10T08:40:16.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.846+0000 7f21ba837640 1 -- start start 2024-05-10T08:40:16.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21ba837640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21b40b43f0 0x7f21b40d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21ba837640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 0x7f21b40b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21ba837640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21b40d2c20 con 0x7f21b415f460 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21ba837640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f21b40d5990 con 0x7f21b40b43f0 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21ba837640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f21b40d2f00 con 0x7f21b40d5520 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21b3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21b415f460 0x7f21b40d23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36268/0 (socket says 172.21.15.37:36268) 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21b3fff640 1 -- 172.21.15.37:0/2048419668 learned_addr learned my addr 172.21.15.37:0/2048419668 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024729343 0 0) 0x7f21b40d2c20 con 0x7f21b415f460 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f219c003520 con 0x7f21b415f460 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21b8dd4640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 0x7f21b40b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.847+0000 7f21b37fe640 1 --2- 172.21.15.37:0/2048419668 >> v2:172.21.15.82:3300/0 conn(0x7f21b40b43f0 0x7f21b40d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086402071 0 0) 0x7f219c003520 con 0x7f21b415f460 2024-05-10T08:40:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 msgr2=0x7f21b40b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 0x7f21b40b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 >> v2:172.21.15.82:3300/0 conn(0x7f21b40b43f0 msgr2=0x7f21b40d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 --2- 172.21.15.37:0/2048419668 >> v2:172.21.15.82:3300/0 conn(0x7f21b40b43f0 0x7f21b40d4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b40d31e0 con 0x7f21b415f460 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f21a4001670 con 0x7f21b415f460 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 >> v1:172.21.15.37:6789/0 conn(0x7f21b415f460 legacy=0x7f21b40d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219c003a90 0x7f219c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004800 0x7f219c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 0x7f219c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21b40d5990 con 0x7f219c003a90 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21b40d2f00 con 0x7f219c004800 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b3fff640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219c003a90 0x7f219c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f219c00b9f0 con 0x7f21b40d5520 2024-05-10T08:40:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b37fe640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004800 0x7f219c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b8dd4640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 0x7f219c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b3fff640 1 -- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 msgr2=0x7f219c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b3fff640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b40d5520 0x7f219c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b3fff640 1 -- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004800 msgr2=0x7f219c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b3fff640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004800 0x7f219c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.848+0000 7f21b3fff640 1 -- 172.21.15.37:0/2048419668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c003520 con 0x7f219c003a90 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.849+0000 7f21b3fff640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219c003a90 0x7f219c003eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f21a4001050 tx=0x7f219c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a49ccaa5d18fa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.849+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a402e070 con 0x7f219c003a90 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.849+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a4005af0 con 0x7f219c003a90 2024-05-10T08:40:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.849+0000 7f21b2ffd640 1 -- 172.21.15.37:0/2048419668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4007d70 con 0x7f219c003a90 2024-05-10T08:40:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.849+0000 7f21ba837640 1 -- 172.21.15.37:0/2048419668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219c003a90 msgr2=0x7f219c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.850+0000 7f21ba837640 1 --2- 172.21.15.37:0/2048419668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219c003a90 0x7f219c003eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f21a4001050 tx=0x7f219c005830 comp rx=0 tx=0).stop 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.850+0000 7f21b8dd4640 1 -- 172.21.15.37:0/2048419668 reap_dead start 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.850+0000 7f21ba837640 1 -- 172.21.15.37:0/2048419668 shutdown_connections 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.850+0000 7f21ba837640 1 -- 172.21.15.37:0/2048419668 >> 172.21.15.37:0/2048419668 conn(0x7f21b408eb00 msgr2=0x7f21b409e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.850+0000 7f21ba837640 1 -- 172.21.15.37:0/2048419668 shutdown_connections 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.850+0000 7f21ba837640 1 -- 172.21.15.37:0/2048419668 wait complete. 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.851+0000 7f21ba837640 1 Processor -- start 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.851+0000 7f21ba837640 1 -- start start 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21ba837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c003a90 0x7f21b414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21ba837640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b415a090 0x7f21b415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21ba837640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21b414f440 0x7f21b414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21ba837640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21b40d3a80 con 0x7f21b414f440 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21ba837640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21b40d37a0 con 0x7f219c003a90 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21ba837640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f21b40d3fa0 con 0x7f21b415a090 2024-05-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21b414f440 0x7f21b414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21b414f440 0x7f21b414f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51786/0 (socket says 172.21.15.37:51786) 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 -- 172.21.15.37:0/2410274518 learned_addr learned my addr 172.21.15.37:0/2410274518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b3fff640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c003a90 0x7f21b414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b37fe640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b415a090 0x7f21b415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 -- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b415a090 msgr2=0x7f21b415a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b415a090 0x7f21b415a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 -- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c003a90 msgr2=0x7f21b414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c003a90 0x7f21b414e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 -- 172.21.15.37:0/2410274518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b41507f0 con 0x7f21b414f440 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.852+0000 7f21b8dd4640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21b414f440 0x7f21b414f8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21b408d7f0 tx=0x7f21ac019800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.853+0000 7f21b0ff9640 1 -- 172.21.15.37:0/2410274518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac01f6d0 con 0x7f21b414f440 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.853+0000 7f21b0ff9640 1 -- 172.21.15.37:0/2410274518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ac01f890 con 0x7f21b414f440 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.853+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b4150230 con 0x7f21b414f440 2024-05-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.853+0000 7f21b0ff9640 1 -- 172.21.15.37:0/2410274518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac01fc80 con 0x7f21b414f440 2024-05-10T08:40:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.853+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b40b1d20 con 0x7f21b414f440 2024-05-10T08:40:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.854+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b40693f0 con 0x7f21b414f440 2024-05-10T08:40:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.854+0000 7f21b0ff9640 1 -- 172.21.15.37:0/2410274518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f21ac027020 con 0x7f21b414f440 2024-05-10T08:40:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.855+0000 7f21b0ff9640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21a0076300 0x7f21a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.855+0000 7f21b0ff9640 1 -- 172.21.15.37:0/2410274518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f21ac09fb00 con 0x7f21b414f440 2024-05-10T08:40:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.855+0000 7f21b3fff640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21a0076300 0x7f21a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.856+0000 7f21b3fff640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21a0076300 0x7f21a00787c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21a4033000 tx=0x7f21a4009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:16.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:16.859+0000 7f21b0ff9640 1 -- 172.21.15.37:0/2410274518 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f21ac02e020 con 0x7f21b414f440 2024-05-10T08:40:17.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:17.049+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f21b40738b0 con 0x7f21b414f440 2024-05-10T08:40:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.722+0000 7f21b0ff9640 1 -- 172.21.15.37:0/2410274518 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f21ac069330 con 0x7f21b414f440 2024-05-10T08:40:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2024-05-10T08:40:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21a0076300 msgr2=0x7f21a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21a0076300 0x7f21a00787c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21a4033000 tx=0x7f21a4009030 comp rx=0 tx=0).stop 2024-05-10T08:40:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21b414f440 msgr2=0x7f21b414f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21b414f440 0x7f21b414f8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21b408d7f0 tx=0x7f21ac019800 comp rx=0 tx=0).stop 2024-05-10T08:40:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 shutdown_connections 2024-05-10T08:40:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21a0076300 0x7f21a00787c0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f21a4033000 tx=0x7f21a4009030 comp rx=0 tx=0).stop 2024-05-10T08:40:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21b414f440 0x7f21b414f8c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f21b415a090 0x7f21b415a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 --2- 172.21.15.37:0/2410274518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c003a90 0x7f21b414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.726+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 >> 172.21.15.37:0/2410274518 conn(0x7f21b408eb00 msgr2=0x7f21b40b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.728+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 shutdown_connections 2024-05-10T08:40:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.728+0000 7f21ba837640 1 -- 172.21.15.37:0/2410274518 wait complete. 2024-05-10T08:40:18.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-10T08:40:18.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.860+0000 7f8bb5fc9640 1 Processor -- start 2024-05-10T08:40:18.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.860+0000 7f8bb5fc9640 1 -- start start 2024-05-10T08:40:18.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8bb5fc9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 0x7f8bb00d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8bb5fc9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb00d5cc0 con 0x7f8bb015f680 2024-05-10T08:40:18.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8bb5fc9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb00cfcf0 con 0x7f8bb00d5750 2024-05-10T08:40:18.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8bb5fc9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00d0620 con 0x7f8bb00d3620 2024-05-10T08:40:18.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8baeffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8bb015f680 0x7f8bb00d3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53934/0 (socket says 172.21.15.37:53934) 2024-05-10T08:40:18.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8baeffd640 1 -- 172.21.15.37:0/3039331774 learned_addr learned my addr 172.21.15.37:0/3039331774 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:18.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 0x7f8bb00d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085625214 0 0) 0x7f8bb00d5cc0 con 0x7f8bb015f680 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.861+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b98003520 con 0x7f8bb015f680 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 44156901 0 0) 0x7f8b98003520 con 0x7f8bb015f680 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 msgr2=0x7f8bb00d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 0x7f8bb00d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 >> v1:172.21.15.82:6789/0 conn(0x7f8bb00d5750 legacy=0x7f8bb00b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb00cffd0 con 0x7f8bb015f680 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8ba4001670 con 0x7f8bb015f680 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 >> v1:172.21.15.37:6789/0 conn(0x7f8bb015f680 legacy=0x7f8bb00d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b980039e0 0x7f8b98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98004390 0x7f8b98004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 0x7f8b980050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00d0620 con 0x7f8b980039e0 2024-05-10T08:40:18.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9800b9c0 con 0x7f8b98004390 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9800bbc0 con 0x7f8bb00d3620 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b980039e0 0x7f8b98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baeffd640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98004390 0x7f8b98004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baffff640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 0x7f8b980050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baf7fe640 1 -- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 msgr2=0x7f8b980050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8bb00d3620 0x7f8b980050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baf7fe640 1 -- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98004390 msgr2=0x7f8b98004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b98004390 0x7f8b98004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.862+0000 7f8baf7fe640 1 -- 172.21.15.37:0/3039331774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b98003520 con 0x7f8b980039e0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.863+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b980039e0 0x7f8b98003dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009ac0 tx=0x7f8b98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03bd28d6e0bb54e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.863+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0036070 con 0x7f8b980039e0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.863+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0031400 con 0x7f8b980039e0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.863+0000 7f8bae7fc640 1 -- 172.21.15.37:0/3039331774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0009690 con 0x7f8b980039e0 2024-05-10T08:40:18.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.864+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/3039331774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b980039e0 msgr2=0x7f8b98003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:18.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.864+0000 7f8bb5fc9640 1 --2- 172.21.15.37:0/3039331774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b980039e0 0x7f8b98003dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009ac0 tx=0x7f8b98005830 comp rx=0 tx=0).stop 2024-05-10T08:40:18.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.864+0000 7f8baffff640 1 -- 172.21.15.37:0/3039331774 reap_dead start 2024-05-10T08:40:18.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.864+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/3039331774 shutdown_connections 2024-05-10T08:40:18.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.864+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/3039331774 >> 172.21.15.37:0/3039331774 conn(0x7f8bb009e380 msgr2=0x7f8bb00d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:18.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.864+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/3039331774 shutdown_connections 2024-05-10T08:40:18.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.864+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/3039331774 wait complete. 2024-05-10T08:40:18.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.865+0000 7f8bb5fc9640 1 Processor -- start 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.865+0000 7f8bb5fc9640 1 -- start start 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8bb5fc9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b980039e0 0x7f8bb0159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8bb5fc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb015b250 0x7f8bb015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8bb5fc9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb006dc80 0x7f8bb006e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8bb5fc9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00d2080 con 0x7f8bb015b250 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8bb5fc9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00d3040 con 0x7f8bb006dc80 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8bb5fc9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00d2200 con 0x7f8b980039e0 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb015b250 0x7f8bb015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb015b250 0x7f8bb015b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38228/0 (socket says 172.21.15.37:38228) 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 -- 172.21.15.37:0/2976148453 learned_addr learned my addr 172.21.15.37:0/2976148453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:18.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baffff640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb006dc80 0x7f8bb006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b980039e0 0x7f8bb0159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 -- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b980039e0 msgr2=0x7f8bb0159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b980039e0 0x7f8bb0159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 -- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb006dc80 msgr2=0x7f8bb006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb006dc80 0x7f8bb006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 -- 172.21.15.37:0/2976148453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb00b9a80 con 0x7f8bb015b250 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8baeffd640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb015b250 0x7f8bb015b6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40072f0 tx=0x7f8ba40077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8b97fff640 1 -- 172.21.15.37:0/2976148453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba401a070 con 0x7f8bb015b250 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8b97fff640 1 -- 172.21.15.37:0/2976148453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba400f960 con 0x7f8bb015b250 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb015bdc0 con 0x7f8bb015b250 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.866+0000 7f8b97fff640 1 -- 172.21.15.37:0/2976148453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400fd50 con 0x7f8bb015b250 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.867+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb015a370 con 0x7f8bb015b250 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.867+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb00693f0 con 0x7f8bb015b250 2024-05-10T08:40:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.868+0000 7f8b97fff640 1 -- 172.21.15.37:0/2976148453 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ba401d070 con 0x7f8bb015b250 2024-05-10T08:40:18.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.869+0000 7f8b97fff640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b9c076300 0x7f8b9c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:18.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.869+0000 7f8b97fff640 1 -- 172.21.15.37:0/2976148453 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f8ba4097180 con 0x7f8bb015b250 2024-05-10T08:40:18.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.869+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b9c076300 0x7f8b9c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:18.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.869+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b9c076300 0x7f8b9c0787c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009ac0 tx=0x7f8ba0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:18.874+0000 7f8b97fff640 1 -- 172.21.15.37:0/2976148453 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8ba4060160 con 0x7f8bb015b250 2024-05-10T08:40:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.064+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f8bb00d5f50 con 0x7f8bb015b250 2024-05-10T08:40:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.729+0000 7f8b97fff640 1 -- 172.21.15.37:0/2976148453 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f8ba4064460 con 0x7f8bb015b250 2024-05-10T08:40:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 4 allow_ec_overwrites to true 2024-05-10T08:40:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.732+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b9c076300 msgr2=0x7f8b9c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.732+0000 7f8bb5fc9640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b9c076300 0x7f8b9c0787c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009ac0 tx=0x7f8ba0008030 comp rx=0 tx=0).stop 2024-05-10T08:40:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.732+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb015b250 msgr2=0x7f8bb015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.732+0000 7f8bb5fc9640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb015b250 0x7f8bb015b6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40072f0 tx=0x7f8ba40077b0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.733+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 shutdown_connections 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.733+0000 7f8bb5fc9640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b9c076300 0x7f8b9c0787c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.733+0000 7f8bb5fc9640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb006dc80 0x7f8bb006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.733+0000 7f8bb5fc9640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb015b250 0x7f8bb015b6d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.733+0000 7f8bb5fc9640 1 --2- 172.21.15.37:0/2976148453 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b980039e0 0x7f8bb0159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.733+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 >> 172.21.15.37:0/2976148453 conn(0x7f8bb009e380 msgr2=0x7f8bb00d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.734+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 shutdown_connections 2024-05-10T08:40:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.735+0000 7f8bb5fc9640 1 -- 172.21.15.37:0/2976148453 wait complete. 2024-05-10T08:40:19.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-10T08:40:19.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.873+0000 7ff3c241d640 1 Processor -- start 2024-05-10T08:40:19.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.873+0000 7ff3c241d640 1 -- start start 2024-05-10T08:40:19.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c241d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:19.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c241d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff3bc0d0cb0 0x7ff3bc0d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:19.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c241d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3bc0d3330 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c241d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff3bc0d2170 con 0x7ff3bc0d0cb0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c241d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff3bc0d2450 con 0x7ff3bc1629a0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c09ba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff3bc0d0cb0 0x7ff3bc0d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c09ba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff3bc0d0cb0 0x7ff3bc0d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38244/0 (socket says 172.21.15.37:38244) 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c09ba640 1 -- 172.21.15.37:0/3211220858 learned_addr learned my addr 172.21.15.37:0/3211220858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3bbfff640 1 --2- 172.21.15.37:0/3211220858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c09ba640 1 -- 172.21.15.37:0/3211220858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 msgr2=0x7ff3bc0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c09ba640 1 --2- 172.21.15.37:0/3211220858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c09ba640 1 -- 172.21.15.37:0/3211220858 >> v1:172.21.15.37:6789/0 conn(0x7ff3bc0d2dc0 legacy=0x7ff3bc0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3c09ba640 1 -- 172.21.15.37:0/3211220858 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc0d2730 con 0x7ff3bc0d0cb0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3baffd640 1 -- 172.21.15.37:0/3211220858 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207188041 0 0) 0x7ff3bc0d3330 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.874+0000 7ff3bbfff640 1 --2- 172.21.15.37:0/3211220858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.875+0000 7ff3c09ba640 1 --2- 172.21.15.37:0/3211220858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d0cb0 0x7ff3bc0d3b00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009e50 tx=0x7ff3b402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d574d74bfdf58b69 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.875+0000 7ff3baffd640 1 -- 172.21.15.37:0/3211220858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4036070 con 0x7ff3bc0d0cb0 2024-05-10T08:40:19.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.875+0000 7ff3baffd640 1 -- 172.21.15.37:0/3211220858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b4031600 con 0x7ff3bc0d0cb0 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.875+0000 7ff3baffd640 1 -- 172.21.15.37:0/3211220858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40319d0 con 0x7ff3bc0d0cb0 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 -- 172.21.15.37:0/3211220858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d0cb0 msgr2=0x7ff3bc0d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 --2- 172.21.15.37:0/3211220858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d0cb0 0x7ff3bc0d3b00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009e50 tx=0x7ff3b402a5f0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 -- 172.21.15.37:0/3211220858 shutdown_connections 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 --2- 172.21.15.37:0/3211220858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d0cb0 0x7ff3bc0d3b00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 --2- 172.21.15.37:0/3211220858 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 -- 172.21.15.37:0/3211220858 >> 172.21.15.37:0/3211220858 conn(0x7ff3bc0d4fe0 msgr2=0x7ff3bc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 -- 172.21.15.37:0/3211220858 shutdown_connections 2024-05-10T08:40:19.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.876+0000 7ff3c241d640 1 -- 172.21.15.37:0/3211220858 wait complete. 2024-05-10T08:40:19.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.877+0000 7ff3c241d640 1 Processor -- start 2024-05-10T08:40:19.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.877+0000 7ff3c241d640 1 -- start start 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c241d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3bc0d0cb0 0x7ff3bc15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c241d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d2dc0 0x7ff3bc158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c241d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c241d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc0cf440 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c241d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc0cf2c0 con 0x7ff3bc0d0cb0 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c241d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff3bc0c95e0 con 0x7ff3bc1629a0 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d2dc0 0x7ff3bc158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d2dc0 0x7ff3bc158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38252/0 (socket says 172.21.15.37:38252) 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 -- 172.21.15.37:0/1630506582 learned_addr learned my addr 172.21.15.37:0/1630506582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c09ba640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bbfff640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3bc0d0cb0 0x7ff3bc15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 -- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 msgr2=0x7ff3bc0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:19.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 -- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3bc0d0cb0 msgr2=0x7ff3bc15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3bc0d0cb0 0x7ff3bc15bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 -- 172.21.15.37:0/1630506582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc0cc5f0 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c09ba640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3bb7fe640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d2dc0 0x7ff3bc158640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000c4b0 tx=0x7ff3b000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3b8ff9640 1 -- 172.21.15.37:0/1630506582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0017070 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3b8ff9640 1 -- 172.21.15.37:0/1630506582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b0005480 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.878+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3bc0cc890 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.879+0000 7ff3b8ff9640 1 -- 172.21.15.37:0/1630506582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0003830 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.879+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3bc0cce50 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.879+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3bc0693f0 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.880+0000 7ff3b8ff9640 1 -- 172.21.15.37:0/1630506582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff3b001a070 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.880+0000 7ff3b8ff9640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a80762d0 0x7ff3a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:19.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.881+0000 7ff3b8ff9640 1 -- 172.21.15.37:0/1630506582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7ff3b0096c40 con 0x7ff3bc0d2dc0 2024-05-10T08:40:19.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.881+0000 7ff3bbfff640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a80762d0 0x7ff3a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:19.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.881+0000 7ff3bbfff640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a80762d0 0x7ff3a8078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc1620f0 tx=0x7ff3ac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:19.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:19.885+0000 7ff3b8ff9640 1 -- 172.21.15.37:0/1630506582 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff3b0060310 con 0x7ff3bc0d2dc0 2024-05-10T08:40:20.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.118+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ff3bc0d4810 con 0x7ff3bc0d2dc0 2024-05-10T08:40:20.540 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:40:20.540+0000 7f4173321640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.731+0000 7ff3b8ff9640 1 -- 172.21.15.37:0/1630506582 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7ff3b0068300 con 0x7ff3bc0d2dc0 2024-05-10T08:40:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 4 to fsmap 2024-05-10T08:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a80762d0 msgr2=0x7ff3a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a80762d0 0x7ff3a8078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc1620f0 tx=0x7ff3ac008040 comp rx=0 tx=0).stop 2024-05-10T08:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d2dc0 msgr2=0x7ff3bc158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d2dc0 0x7ff3bc158640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000c4b0 tx=0x7ff3b000c970 comp rx=0 tx=0).stop 2024-05-10T08:40:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 shutdown_connections 2024-05-10T08:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a80762d0 0x7ff3a8078790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3bc1629a0 0x7ff3bc0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3bc0d2dc0 0x7ff3bc158640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 --2- 172.21.15.37:0/1630506582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3bc0d0cb0 0x7ff3bc15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.734+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 >> 172.21.15.37:0/1630506582 conn(0x7ff3bc0d4fe0 msgr2=0x7ff3bc160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.735+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 shutdown_connections 2024-05-10T08:40:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.735+0000 7ff3c241d640 1 -- 172.21.15.37:0/1630506582 wait complete. 2024-05-10T08:40:20.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.859+0000 7f7eeae72640 1 Processor -- start 2024-05-10T08:40:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.859+0000 7f7eeae72640 1 -- start start 2024-05-10T08:40:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7eeae72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ee40d0ec0 0x7f7ee40d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7eeae72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7ee40d3b00 0x7f7ee40b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7eeae72640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee40d1760 con 0x7f7ee415f380 2024-05-10T08:40:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7eeae72640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee40d30f0 con 0x7f7ee40d0ec0 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7eeae72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee40d2370 con 0x7f7ee40d3b00 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ee40d0ec0 0x7f7ee40d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee8c0e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7ee415f380 0x7f7ee40d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53952/0 (socket says 172.21.15.37:53952) 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee8c0e640 1 -- 172.21.15.37:0/380770233 learned_addr learned my addr 172.21.15.37:0/380770233 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee940f640 1 --2- 172.21.15.37:0/380770233 >> v2:172.21.15.82:3300/0 conn(0x7f7ee40d3b00 0x7f7ee40b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee3fff640 1 -- 172.21.15.37:0/380770233 >> v2:172.21.15.82:3300/0 conn(0x7f7ee40d3b00 msgr2=0x7f7ee40b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee3fff640 1 --2- 172.21.15.37:0/380770233 >> v2:172.21.15.82:3300/0 conn(0x7f7ee40d3b00 0x7f7ee40b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee3fff640 1 -- 172.21.15.37:0/380770233 >> v1:172.21.15.37:6789/0 conn(0x7f7ee415f380 legacy=0x7f7ee40d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee37fe640 1 -- 172.21.15.37:0/380770233 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178690581 0 0) 0x7f7ee40d1760 con 0x7f7ee415f380 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.860+0000 7f7ee3fff640 1 -- 172.21.15.37:0/380770233 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee40d1a40 con 0x7f7ee40d0ec0 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.861+0000 7f7ee3fff640 1 --2- 172.21.15.37:0/380770233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee40d0ec0 0x7f7ee40d35c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4163f60 tx=0x7f7ed002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f58adbf7091c14 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.861+0000 7f7ee37fe640 1 -- 172.21.15.37:0/380770233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0037070 con 0x7f7ee40d0ec0 2024-05-10T08:40:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.861+0000 7f7ee37fe640 1 -- 172.21.15.37:0/380770233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed0032440 con 0x7f7ee40d0ec0 2024-05-10T08:40:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.861+0000 7f7ee37fe640 1 -- 172.21.15.37:0/380770233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0032810 con 0x7f7ee40d0ec0 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.861+0000 7f7eeae72640 1 -- 172.21.15.37:0/380770233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee40d0ec0 msgr2=0x7f7ee40d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.861+0000 7f7eeae72640 1 --2- 172.21.15.37:0/380770233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee40d0ec0 0x7f7ee40d35c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4163f60 tx=0x7f7ed002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.862+0000 7f7eeae72640 1 -- 172.21.15.37:0/380770233 shutdown_connections 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.862+0000 7f7eeae72640 1 --2- 172.21.15.37:0/380770233 >> v2:172.21.15.82:3300/0 conn(0x7f7ee40d3b00 0x7f7ee40b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.862+0000 7f7eeae72640 1 --2- 172.21.15.37:0/380770233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee40d0ec0 0x7f7ee40d35c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.862+0000 7f7eeae72640 1 -- 172.21.15.37:0/380770233 >> 172.21.15.37:0/380770233 conn(0x7f7ee40d4fe0 msgr2=0x7f7ee40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.862+0000 7f7eeae72640 1 -- 172.21.15.37:0/380770233 shutdown_connections 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.862+0000 7f7eeae72640 1 -- 172.21.15.37:0/380770233 wait complete. 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.863+0000 7f7eeae72640 1 Processor -- start 2024-05-10T08:40:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.863+0000 7f7eeae72640 1 -- start start 2024-05-10T08:40:20.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7eeae72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ee40d0ec0 0x7f7ee41542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:20.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7eeae72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee40d3b00 0x7f7ee415f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:20.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7eeae72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee415f380 0x7f7ee40ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:20.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7eeae72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee40d2000 con 0x7f7ee415f380 2024-05-10T08:40:20.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7eeae72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee40d3f30 con 0x7f7ee40d3b00 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7eeae72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee415f760 con 0x7f7ee40d0ec0 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee415f380 0x7f7ee40ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee415f380 0x7f7ee40ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38264/0 (socket says 172.21.15.37:38264) 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 -- 172.21.15.37:0/3791111126 learned_addr learned my addr 172.21.15.37:0/3791111126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee3fff640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee40d3b00 0x7f7ee415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 -- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ee40d0ec0 msgr2=0x7f7ee41542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ee40d0ec0 0x7f7ee41542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 -- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee40d3b00 msgr2=0x7f7ee415f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee40d3b00 0x7f7ee415f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 -- 172.21.15.37:0/3791111126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee40a1c60 con 0x7f7ee415f380 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee940f640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee415f380 0x7f7ee40ce820 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00cd70 tx=0x7f7edc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee17fa640 1 -- 172.21.15.37:0/3791111126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc003b90 con 0x7f7ee415f380 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee17fa640 1 -- 172.21.15.37:0/3791111126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7edc003d30 con 0x7f7ee415f380 2024-05-10T08:40:20.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee40a0bc0 con 0x7f7ee415f380 2024-05-10T08:40:20.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.864+0000 7f7ee17fa640 1 -- 172.21.15.37:0/3791111126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004240 con 0x7f7ee415f380 2024-05-10T08:40:20.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.865+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee40a1180 con 0x7f7ee415f380 2024-05-10T08:40:20.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.865+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee4068c40 con 0x7f7ee415f380 2024-05-10T08:40:20.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.866+0000 7f7ee17fa640 1 -- 172.21.15.37:0/3791111126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7edc0043e0 con 0x7f7ee415f380 2024-05-10T08:40:20.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.867+0000 7f7ee17fa640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ec80762d0 0x7f7ec8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:20.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.867+0000 7f7ee17fa640 1 -- 172.21.15.37:0/3791111126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7edc098530 con 0x7f7ee415f380 2024-05-10T08:40:20.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.867+0000 7f7ee8c0e640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ec80762d0 0x7f7ec8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:20.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.867+0000 7f7ee8c0e640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ec80762d0 0x7f7ec8078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8007fd0 tx=0x7f7ed8007920 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:20.871+0000 7f7ee17fa640 1 -- 172.21.15.37:0/3791111126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7ee4068c40 con 0x7f7ee415f380 2024-05-10T08:40:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.102+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ee408cfd0 con 0x7f7ee415f380 2024-05-10T08:40:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.102+0000 7f7ee17fa640 1 -- 172.21.15.37:0/3791111126 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5174 (secure 0 0 0) 0x7f7edc0613e0 con 0x7f7ee415f380 2024-05-10T08:40:21.102 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:21.102 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:20.120008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2024-05-10T08:40:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ec80762d0 msgr2=0x7f7ec8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ec80762d0 0x7f7ec8078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8007fd0 tx=0x7f7ed8007920 comp rx=0 tx=0).stop 2024-05-10T08:40:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee415f380 msgr2=0x7f7ee40ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee415f380 0x7f7ee40ce820 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00cd70 tx=0x7f7edc00a660 comp rx=0 tx=0).stop 2024-05-10T08:40:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 shutdown_connections 2024-05-10T08:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ec80762d0 0x7f7ec8078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee415f380 0x7f7ee40ce820 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee40d3b00 0x7f7ee415f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 --2- 172.21.15.37:0/3791111126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ee40d0ec0 0x7f7ee41542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 >> 172.21.15.37:0/3791111126 conn(0x7f7ee40d4fe0 msgr2=0x7f7ee406e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 shutdown_connections 2024-05-10T08:40:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.104+0000 7f7eeae72640 1 -- 172.21.15.37:0/3791111126 wait complete. 2024-05-10T08:40:21.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:21.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.219+0000 7f88e04bb640 1 Processor -- start 2024-05-10T08:40:21.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.219+0000 7f88e04bb640 1 -- start start 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88e04bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d815f450 0x7f88d806d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88e04bb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f88d806df40 0x7f88d80d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88e04bb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d80d0cb0 con 0x7f88d815f830 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88e04bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f88d806d690 con 0x7f88d815f450 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88e04bb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f88d80d0f90 con 0x7f88d806df40 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88de257640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d815f450 0x7f88d806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88dda56640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f88d815f830 0x7f88d806d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53964/0 (socket says 172.21.15.37:53964) 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88dda56640 1 -- 172.21.15.37:0/1333249409 learned_addr learned my addr 172.21.15.37:0/1333249409 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88dea58640 1 --2- 172.21.15.37:0/1333249409 >> v2:172.21.15.82:3300/0 conn(0x7f88d806df40 0x7f88d80d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88de257640 1 -- 172.21.15.37:0/1333249409 >> v2:172.21.15.82:3300/0 conn(0x7f88d806df40 msgr2=0x7f88d80d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88de257640 1 --2- 172.21.15.37:0/1333249409 >> v2:172.21.15.82:3300/0 conn(0x7f88d806df40 0x7f88d80d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88de257640 1 -- 172.21.15.37:0/1333249409 >> v1:172.21.15.37:6789/0 conn(0x7f88d815f830 legacy=0x7f88d806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88de257640 1 -- 172.21.15.37:0/1333249409 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d80d2fe0 con 0x7f88d815f450 2024-05-10T08:40:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.220+0000 7f88dd255640 1 -- 172.21.15.37:0/1333249409 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860002378 0 0) 0x7f88d80d0cb0 con 0x7f88d815f830 2024-05-10T08:40:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88de257640 1 --2- 172.21.15.37:0/1333249409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d815f450 0x7f88d806d150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f88d80d2b20 tx=0x7f88d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5f2f1d46a018dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88dd255640 1 -- 172.21.15.37:0/1333249409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0037070 con 0x7f88d815f450 2024-05-10T08:40:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88dd255640 1 -- 172.21.15.37:0/1333249409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0032440 con 0x7f88d815f450 2024-05-10T08:40:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88dd255640 1 -- 172.21.15.37:0/1333249409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0032810 con 0x7f88d815f450 2024-05-10T08:40:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88e04bb640 1 -- 172.21.15.37:0/1333249409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d815f450 msgr2=0x7f88d806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1333249409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d815f450 0x7f88d806d150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f88d80d2b20 tx=0x7f88d002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88e04bb640 1 -- 172.21.15.37:0/1333249409 shutdown_connections 2024-05-10T08:40:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1333249409 >> v2:172.21.15.82:3300/0 conn(0x7f88d806df40 0x7f88d80d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1333249409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d815f450 0x7f88d806d150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.221+0000 7f88e04bb640 1 -- 172.21.15.37:0/1333249409 >> 172.21.15.37:0/1333249409 conn(0x7f88d80d5040 msgr2=0x7f88d80d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.222+0000 7f88e04bb640 1 -- 172.21.15.37:0/1333249409 shutdown_connections 2024-05-10T08:40:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.222+0000 7f88e04bb640 1 -- 172.21.15.37:0/1333249409 wait complete. 2024-05-10T08:40:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 Processor -- start 2024-05-10T08:40:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 -- start start 2024-05-10T08:40:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d806df40 0x7f88d80c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88d815f450 0x7f88d80a2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88d815f830 0x7f88d815c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80d0880 con 0x7f88d806df40 2024-05-10T08:40:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80d0700 con 0x7f88d815f450 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88e04bb640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88d80d0a00 con 0x7f88d815f830 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.223+0000 7f88de257640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d806df40 0x7f88d80c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d806df40 0x7f88d80c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38280/0 (socket says 172.21.15.37:38280) 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 -- 172.21.15.37:0/1021678280 learned_addr learned my addr 172.21.15.37:0/1021678280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88dda56640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88d815f450 0x7f88d80a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88dea58640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88d815f830 0x7f88d815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 -- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88d815f830 msgr2=0x7f88d815c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88d815f830 0x7f88d815c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 -- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88d815f450 msgr2=0x7f88d80a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88d815f450 0x7f88d80a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 -- 172.21.15.37:0/1021678280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d80c98b0 con 0x7f88d806df40 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88de257640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d806df40 0x7f88d80c9370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000c00 tx=0x7f88d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88d6ffd640 1 -- 172.21.15.37:0/1021678280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0037040 con 0x7f88d806df40 2024-05-10T08:40:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88d6ffd640 1 -- 172.21.15.37:0/1021678280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0042070 con 0x7f88d806df40 2024-05-10T08:40:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d80c9b50 con 0x7f88d806df40 2024-05-10T08:40:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88d6ffd640 1 -- 172.21.15.37:0/1021678280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0030bd0 con 0x7f88d806df40 2024-05-10T08:40:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.224+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d80b5630 con 0x7f88d806df40 2024-05-10T08:40:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.225+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d80693f0 con 0x7f88d806df40 2024-05-10T08:40:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.226+0000 7f88d6ffd640 1 -- 172.21.15.37:0/1021678280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f88d0047460 con 0x7f88d806df40 2024-05-10T08:40:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.226+0000 7f88d6ffd640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88c40762d0 0x7f88c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.227+0000 7f88d6ffd640 1 -- 172.21.15.37:0/1021678280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f88d00b83e0 con 0x7f88d806df40 2024-05-10T08:40:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.227+0000 7f88dda56640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88c40762d0 0x7f88c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.227+0000 7f88dda56640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88c40762d0 0x7f88c4078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88d80b1de0 tx=0x7f88cc001700 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.231+0000 7f88d6ffd640 1 -- 172.21.15.37:0/1021678280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f88d0032e20 con 0x7f88d806df40 2024-05-10T08:40:21.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.423+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88d806d8a0 con 0x7f88d806df40 2024-05-10T08:40:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.425+0000 7f88d6ffd640 1 -- 172.21.15.37:0/1021678280 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18467 (secure 0 0 0) 0x7f88d00813a0 con 0x7f88d806df40 2024-05-10T08:40:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:21.425 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:20.119798+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88c40762d0 msgr2=0x7f88c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88c40762d0 0x7f88c4078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88d80b1de0 tx=0x7f88cc001700 comp rx=0 tx=0).stop 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d806df40 msgr2=0x7f88d80c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d806df40 0x7f88d80c9370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000c00 tx=0x7f88d00046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 shutdown_connections 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88c40762d0 0x7f88c4078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88d815f830 0x7f88d815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88d815f450 0x7f88d80a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 --2- 172.21.15.37:0/1021678280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d806df40 0x7f88d80c9370 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 >> 172.21.15.37:0/1021678280 conn(0x7f88d80d5040 msgr2=0x7f88d80ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 shutdown_connections 2024-05-10T08:40:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.427+0000 7f88e04bb640 1 -- 172.21.15.37:0/1021678280 wait complete. 2024-05-10T08:40:21.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:21.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.542+0000 7fb4a5ff7640 1 Processor -- start 2024-05-10T08:40:21.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.542+0000 7fb4a5ff7640 1 -- start start 2024-05-10T08:40:21.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.542+0000 7fb4a5ff7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00cf8a0 0x7fb4a015e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb4a5ff7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4a00d39b0 0x7fb4a00cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb4a5ff7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4a00d0f10 0x7fb4a00d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb4a5ff7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a015d5f0 con 0x7fb4a00d39b0 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb4a5ff7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a0161920 con 0x7fb4a00d0f10 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb4a5ff7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a00d0700 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4a00d39b0 0x7fb4a00cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4a00d39b0 0x7fb4a00cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38282/0 (socket says 172.21.15.37:38282) 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 -- 172.21.15.37:0/2914220662 learned_addr learned my addr 172.21.15.37:0/2914220662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49ffff640 1 --2- 172.21.15.37:0/2914220662 >> v2:172.21.15.82:3300/0 conn(0x7fb4a00d0f10 0x7fb4a00d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49f7fe640 1 --2- 172.21.15.37:0/2914220662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00cf8a0 0x7fb4a015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 -- 172.21.15.37:0/2914220662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00cf8a0 msgr2=0x7fb4a015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 --2- 172.21.15.37:0/2914220662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00cf8a0 0x7fb4a015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 -- 172.21.15.37:0/2914220662 >> v2:172.21.15.82:3300/0 conn(0x7fb4a00d0f10 msgr2=0x7fb4a00d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 --2- 172.21.15.37:0/2914220662 >> v2:172.21.15.82:3300/0 conn(0x7fb4a00d0f10 0x7fb4a00d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49effd640 1 -- 172.21.15.37:0/2914220662 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a00d01c0 con 0x7fb4a00d39b0 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49f7fe640 1 --2- 172.21.15.37:0/2914220662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00cf8a0 0x7fb4a015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.543+0000 7fb49ffff640 1 --2- 172.21.15.37:0/2914220662 >> v2:172.21.15.82:3300/0 conn(0x7fb4a00d0f10 0x7fb4a00d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:21.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb49effd640 1 --2- 172.21.15.37:0/2914220662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00d39b0 0x7fb4a00cfc80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0160bb0 tx=0x7fb49402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139ffef08bb8aff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb49e7fc640 1 -- 172.21.15.37:0/2914220662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494037070 con 0x7fb4a00d39b0 2024-05-10T08:40:21.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb49e7fc640 1 -- 172.21.15.37:0/2914220662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb494032440 con 0x7fb4a00d39b0 2024-05-10T08:40:21.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb49e7fc640 1 -- 172.21.15.37:0/2914220662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494032810 con 0x7fb4a00d39b0 2024-05-10T08:40:21.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/2914220662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00d39b0 msgr2=0x7fb4a00cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/2914220662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00d39b0 0x7fb4a00cfc80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0160bb0 tx=0x7fb49402a210 comp rx=0 tx=0).stop 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/2914220662 shutdown_connections 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/2914220662 >> v2:172.21.15.82:3300/0 conn(0x7fb4a00d0f10 0x7fb4a00d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/2914220662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00d39b0 0x7fb4a00cfc80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/2914220662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00cf8a0 0x7fb4a015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.544+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/2914220662 >> 172.21.15.37:0/2914220662 conn(0x7fb4a00d2e90 msgr2=0x7fb4a00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.545+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/2914220662 shutdown_connections 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.545+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/2914220662 wait complete. 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.546+0000 7fb4a5ff7640 1 Processor -- start 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.546+0000 7fb4a5ff7640 1 -- start start 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb4a5ff7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00cf8a0 0x7fb4a00b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb4a5ff7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a00d0f10 0x7fb4a01f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb4a5ff7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00d39b0 0x7fb4a00b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb4a5ff7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a01612d0 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb4a5ff7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a0160ff0 con 0x7fb4a00d0f10 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb4a5ff7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a01615b0 con 0x7fb4a00d39b0 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00cf8a0 0x7fb4a00b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00cf8a0 0x7fb4a00b8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38284/0 (socket says 172.21.15.37:38284) 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 -- 172.21.15.37:0/361309558 learned_addr learned my addr 172.21.15.37:0/361309558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49effd640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a00d0f10 0x7fb4a01f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49ffff640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00d39b0 0x7fb4a00b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 -- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00d39b0 msgr2=0x7fb4a00b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00d39b0 0x7fb4a00b7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 -- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a00d0f10 msgr2=0x7fb4a01f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a00d0f10 0x7fb4a01f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 -- 172.21.15.37:0/361309558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a006ef50 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49effd640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a00d0f10 0x7fb4a01f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:21.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49ffff640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00d39b0 0x7fb4a00b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb49f7fe640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00cf8a0 0x7fb4a00b8580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb49000c820 tx=0x7fb49000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb487fff640 1 -- 172.21.15.37:0/361309558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490015070 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb487fff640 1 -- 172.21.15.37:0/361309558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb490007a30 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.547+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a006f230 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.548+0000 7fb487fff640 1 -- 172.21.15.37:0/361309558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490007de0 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.548+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a006d8c0 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.549+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a00693f0 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.549+0000 7fb487fff640 1 -- 172.21.15.37:0/361309558 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb490018070 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.550+0000 7fb487fff640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb48c0762d0 0x7fb48c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.550+0000 7fb487fff640 1 -- 172.21.15.37:0/361309558 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb490097800 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.550+0000 7fb49effd640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb48c0762d0 0x7fb48c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.550+0000 7fb49effd640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb48c0762d0 0x7fb48c078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb494034000 tx=0x7fb49402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.554+0000 7fb487fff640 1 -- 172.21.15.37:0/361309558 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb490060eb0 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.754+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4a00b8b80 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.755+0000 7fb487fff640 1 -- 172.21.15.37:0/361309558 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fb4900607b0 con 0x7fb4a00cf8a0 2024-05-10T08:40:21.755 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:21.755 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb48c0762d0 msgr2=0x7fb48c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb48c0762d0 0x7fb48c078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb494034000 tx=0x7fb49402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00cf8a0 msgr2=0x7fb4a00b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00cf8a0 0x7fb4a00b8580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb49000c820 tx=0x7fb49000cce0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 shutdown_connections 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb48c0762d0 0x7fb48c078790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb4a00d39b0 0x7fb4a00b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a00d0f10 0x7fb4a01f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 --2- 172.21.15.37:0/361309558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a00cf8a0 0x7fb4a00b8580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 >> 172.21.15.37:0/361309558 conn(0x7fb4a00d2e90 msgr2=0x7fb4a00703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 shutdown_connections 2024-05-10T08:40:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.757+0000 7fb4a5ff7640 1 -- 172.21.15.37:0/361309558 wait complete. 2024-05-10T08:40:21.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:21.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.921+0000 7fda48a93640 1 Processor -- start 2024-05-10T08:40:21.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.921+0000 7fda48a93640 1 -- start start 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.922+0000 7fda48a93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda440d33f0 0x7fda4415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.922+0000 7fda48a93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda440718c0 con 0x7fda4415ccb0 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.922+0000 7fda48a93640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda44071ba0 con 0x7fda44070b90 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.922+0000 7fda48a93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda440afba0 con 0x7fda440d33f0 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda4259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda4415ccb0 0x7fda440d2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53978/0 (socket says 172.21.15.37:53978) 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda4259c640 1 -- 172.21.15.37:0/439618564 learned_addr learned my addr 172.21.15.37:0/439618564 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda41d9b640 1 --2- 172.21.15.37:0/439618564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda440d33f0 0x7fda4415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda4159a640 1 -- 172.21.15.37:0/439618564 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131264514 0 0) 0x7fda440718c0 con 0x7fda4415ccb0 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda4159a640 1 -- 172.21.15.37:0/439618564 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda30003520 con 0x7fda4415ccb0 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda4159a640 1 -- 172.21.15.37:0/439618564 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509684534 0 0) 0x7fda44071ba0 con 0x7fda44070b90 2024-05-10T08:40:21.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda4159a640 1 -- 172.21.15.37:0/439618564 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda440718c0 con 0x7fda44070b90 2024-05-10T08:40:21.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda41d9b640 1 -- 172.21.15.37:0/439618564 >> v1:172.21.15.82:6789/0 conn(0x7fda44070b90 legacy=0x7fda44071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda41d9b640 1 -- 172.21.15.37:0/439618564 >> v1:172.21.15.37:6789/0 conn(0x7fda4415ccb0 legacy=0x7fda440d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.923+0000 7fda41d9b640 1 -- 172.21.15.37:0/439618564 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda44071e80 con 0x7fda440d33f0 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.924+0000 7fda41d9b640 1 --2- 172.21.15.37:0/439618564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda440d33f0 0x7fda4415d090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097d0 tx=0x7fda2c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881d271943716f63 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.924+0000 7fda4159a640 1 -- 172.21.15.37:0/439618564 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c037070 con 0x7fda440d33f0 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.924+0000 7fda4159a640 1 -- 172.21.15.37:0/439618564 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c032440 con 0x7fda440d33f0 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.924+0000 7fda4159a640 1 -- 172.21.15.37:0/439618564 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0327f0 con 0x7fda440d33f0 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.924+0000 7fda48a93640 1 -- 172.21.15.37:0/439618564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda440d33f0 msgr2=0x7fda4415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.924+0000 7fda48a93640 1 --2- 172.21.15.37:0/439618564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda440d33f0 0x7fda4415d090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097d0 tx=0x7fda2c02a180 comp rx=0 tx=0).stop 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.925+0000 7fda48a93640 1 -- 172.21.15.37:0/439618564 shutdown_connections 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.925+0000 7fda48a93640 1 --2- 172.21.15.37:0/439618564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda440d33f0 0x7fda4415d090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.925+0000 7fda48a93640 1 -- 172.21.15.37:0/439618564 >> 172.21.15.37:0/439618564 conn(0x7fda4409ba40 msgr2=0x7fda4409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.925+0000 7fda48a93640 1 -- 172.21.15.37:0/439618564 shutdown_connections 2024-05-10T08:40:21.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.925+0000 7fda48a93640 1 -- 172.21.15.37:0/439618564 wait complete. 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.926+0000 7fda48a93640 1 Processor -- start 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.926+0000 7fda48a93640 1 -- start start 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda48a93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44070b90 0x7fda44149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda48a93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda440d33f0 0x7fda441496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda48a93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4415ccb0 0x7fda441f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda48a93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda440b11c0 con 0x7fda440d33f0 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda48a93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda440b1040 con 0x7fda44070b90 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda48a93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda440b1340 con 0x7fda4415ccb0 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda440d33f0 0x7fda441496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda440d33f0 0x7fda441496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38292/0 (socket says 172.21.15.37:38292) 2024-05-10T08:40:21.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 -- 172.21.15.37:0/3847969521 learned_addr learned my addr 172.21.15.37:0/3847969521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda4259c640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44070b90 0x7fda44149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda42d9d640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4415ccb0 0x7fda441f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 -- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4415ccb0 msgr2=0x7fda441f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4415ccb0 0x7fda441f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 -- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44070b90 msgr2=0x7fda44149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44070b90 0x7fda44149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 -- 172.21.15.37:0/3847969521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4415ff30 con 0x7fda440d33f0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda42d9d640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4415ccb0 0x7fda441f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.927+0000 7fda41d9b640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda440d33f0 0x7fda441496f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda2c035040 tx=0x7fda2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.928+0000 7fda3affd640 1 -- 172.21.15.37:0/3847969521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c037040 con 0x7fda440d33f0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.928+0000 7fda3affd640 1 -- 172.21.15.37:0/3847969521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c0044c0 con 0x7fda440d33f0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.928+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda440b7180 con 0x7fda440d33f0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.928+0000 7fda3affd640 1 -- 172.21.15.37:0/3847969521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0325f0 con 0x7fda440d33f0 2024-05-10T08:40:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.928+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda440b7740 con 0x7fda440d33f0 2024-05-10T08:40:21.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.929+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda44069b00 con 0x7fda440d33f0 2024-05-10T08:40:21.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.929+0000 7fda3affd640 1 -- 172.21.15.37:0/3847969521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda2c044020 con 0x7fda440d33f0 2024-05-10T08:40:21.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.930+0000 7fda3affd640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fda240762d0 0x7fda24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:21.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.930+0000 7fda3affd640 1 -- 172.21.15.37:0/3847969521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda2c0b79a0 con 0x7fda440d33f0 2024-05-10T08:40:21.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.930+0000 7fda4259c640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fda240762d0 0x7fda24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:21.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.930+0000 7fda4259c640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fda240762d0 0x7fda24078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda34000f60 tx=0x7fda34009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:21.934+0000 7fda3affd640 1 -- 172.21.15.37:0/3847969521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fda2c04b020 con 0x7fda440d33f0 2024-05-10T08:40:22.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.168+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda44070380 con 0x7fda440d33f0 2024-05-10T08:40:22.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.168+0000 7fda3affd640 1 -- 172.21.15.37:0/3847969521 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5174 (secure 0 0 0) 0x7fda2c080fb0 con 0x7fda440d33f0 2024-05-10T08:40:22.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:22.168 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:20.120008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:22.169 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2024-05-10T08:40:22.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.170+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fda240762d0 msgr2=0x7fda24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.170+0000 7fda48a93640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fda240762d0 0x7fda24078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda34000f60 tx=0x7fda34009040 comp rx=0 tx=0).stop 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.170+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda440d33f0 msgr2=0x7fda441496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.170+0000 7fda48a93640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda440d33f0 0x7fda441496f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda2c035040 tx=0x7fda2c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 shutdown_connections 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fda240762d0 0x7fda24078790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda4415ccb0 0x7fda441f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda440d33f0 0x7fda441496f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 --2- 172.21.15.37:0/3847969521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda44070b90 0x7fda44149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 >> 172.21.15.37:0/3847969521 conn(0x7fda4409ba40 msgr2=0x7fda440cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 shutdown_connections 2024-05-10T08:40:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.171+0000 7fda48a93640 1 -- 172.21.15.37:0/3847969521 wait complete. 2024-05-10T08:40:22.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.284+0000 7efe213d0640 1 Processor -- start 2024-05-10T08:40:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.285+0000 7efe213d0640 1 -- start start 2024-05-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.285+0000 7efe213d0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c15f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.285+0000 7efe213d0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c0b57c0 con 0x7efe1c0b6280 2024-05-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.285+0000 7efe213d0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c0afa30 con 0x7efe1c156530 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.285+0000 7efe213d0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efe1c0b5df0 con 0x7efe1c06cab0 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe1a7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efe1c0b6280 0x7efe1c06c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53992/0 (socket says 172.21.15.37:53992) 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe1a7fc640 1 -- 172.21.15.37:0/1486719525 learned_addr learned my addr 172.21.15.37:0/1486719525 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe1b7fe640 1 --2- 172.21.15.37:0/1486719525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c15f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625902122 0 0) 0x7efe1c0b57c0 con 0x7efe1c0b6280 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe08003520 con 0x7efe1c0b6280 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975977455 0 0) 0x7efe1c0afa30 con 0x7efe1c156530 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe1c0b57c0 con 0x7efe1c156530 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe1b7fe640 1 -- 172.21.15.37:0/1486719525 >> v1:172.21.15.82:6789/0 conn(0x7efe1c156530 legacy=0x7efe1c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe1b7fe640 1 -- 172.21.15.37:0/1486719525 >> v1:172.21.15.37:6789/0 conn(0x7efe1c0b6280 legacy=0x7efe1c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3524910168 0 0) 0x7efe08003520 con 0x7efe1c0b6280 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.286+0000 7efe1b7fe640 1 -- 172.21.15.37:0/1486719525 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c0b5a80 con 0x7efe1c06cab0 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.287+0000 7efe1b7fe640 1 --2- 172.21.15.37:0/1486719525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c15f9f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe140097d0 tx=0x7efe1402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b885ec7edebe242d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.287+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14037070 con 0x7efe1c06cab0 2024-05-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.287+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1402ac30 con 0x7efe1c06cab0 2024-05-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.287+0000 7efe19ffb640 1 -- 172.21.15.37:0/1486719525 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04001690 con 0x7efe1c06cab0 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.287+0000 7efe213d0640 1 -- 172.21.15.37:0/1486719525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 msgr2=0x7efe1c15f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.287+0000 7efe213d0640 1 --2- 172.21.15.37:0/1486719525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c15f9f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe140097d0 tx=0x7efe1402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.288+0000 7efe213d0640 1 -- 172.21.15.37:0/1486719525 shutdown_connections 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.288+0000 7efe213d0640 1 --2- 172.21.15.37:0/1486719525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c15f9f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.288+0000 7efe213d0640 1 -- 172.21.15.37:0/1486719525 >> 172.21.15.37:0/1486719525 conn(0x7efe1c0b39a0 msgr2=0x7efe1c0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.288+0000 7efe213d0640 1 -- 172.21.15.37:0/1486719525 shutdown_connections 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.288+0000 7efe213d0640 1 -- 172.21.15.37:0/1486719525 wait complete. 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.289+0000 7efe213d0640 1 Processor -- start 2024-05-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.289+0000 7efe213d0640 1 -- start start 2024-05-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe213d0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe213d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0b6280 0x7efe1c0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe213d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c156530 0x7efe1c143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe213d0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c0af6a0 con 0x7efe1c0b6280 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe213d0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c0afd10 con 0x7efe1c156530 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe213d0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efe1c15ff30 con 0x7efe1c06cab0 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0b6280 0x7efe1c0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0b6280 0x7efe1c0b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38298/0 (socket says 172.21.15.37:38298) 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 -- 172.21.15.37:0/1746570100 learned_addr learned my addr 172.21.15.37:0/1746570100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1b7fe640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c156530 0x7efe1c143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1affd640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 -- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 msgr2=0x7efe1c147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 -- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c156530 msgr2=0x7efe1c143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c156530 0x7efe1c143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 -- 172.21.15.37:0/1746570100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c147a80 con 0x7efe1c0b6280 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe1a7fc640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0b6280 0x7efe1c0b2f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe04005880 tx=0x7efe0400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe137fe640 1 -- 172.21.15.37:0/1746570100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04017070 con 0x7efe1c0b6280 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe137fe640 1 -- 172.21.15.37:0/1746570100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe04005ad0 con 0x7efe1c0b6280 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c15cda0 con 0x7efe1c0b6280 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.290+0000 7efe137fe640 1 -- 172.21.15.37:0/1746570100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400ce60 con 0x7efe1c0b6280 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.291+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c1570b0 con 0x7efe1c0b6280 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.292+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c15cf70 con 0x7efe1c0b6280 2024-05-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.292+0000 7efe137fe640 1 -- 172.21.15.37:0/1746570100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe0401a070 con 0x7efe1c0b6280 2024-05-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.293+0000 7efe137fe640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efdfc0762d0 0x7efdfc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.293+0000 7efe137fe640 1 -- 172.21.15.37:0/1746570100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efe04096c30 con 0x7efe1c0b6280 2024-05-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.293+0000 7efe1affd640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efdfc0762d0 0x7efdfc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.293+0000 7efe1affd640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efdfc0762d0 0x7efdfc078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe0c001560 tx=0x7efe0c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.297+0000 7efe137fe640 1 -- 172.21.15.37:0/1746570100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efe1c147a80 con 0x7efe1c0b6280 2024-05-10T08:40:22.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.487+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe1c069b00 con 0x7efe1c0b6280 2024-05-10T08:40:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.488+0000 7efe137fe640 1 -- 172.21.15.37:0/1746570100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7efe0405fc00 con 0x7efe1c0b6280 2024-05-10T08:40:22.488 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.490+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efdfc0762d0 msgr2=0x7efdfc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.490+0000 7efe213d0640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efdfc0762d0 0x7efdfc078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe0c001560 tx=0x7efe0c009040 comp rx=0 tx=0).stop 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.490+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0b6280 msgr2=0x7efe1c0b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.490+0000 7efe213d0640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0b6280 0x7efe1c0b2f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe04005880 tx=0x7efe0400cb20 comp rx=0 tx=0).stop 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.490+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 shutdown_connections 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.490+0000 7efe213d0640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efdfc0762d0 0x7efdfc078790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.491+0000 7efe213d0640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c156530 0x7efe1c143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.491+0000 7efe213d0640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0b6280 0x7efe1c0b2f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.491+0000 7efe213d0640 1 --2- 172.21.15.37:0/1746570100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe1c06cab0 0x7efe1c147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.491+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 >> 172.21.15.37:0/1746570100 conn(0x7efe1c0b39a0 msgr2=0x7efe1c0d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.491+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 shutdown_connections 2024-05-10T08:40:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:22.491+0000 7efe213d0640 1 -- 172.21.15.37:0/1746570100 wait complete. 2024-05-10T08:40:22.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:40:22.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:40:22.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:40:15.092985+0000', 'modified': '2024-05-10T08:40:20.120008+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/665979516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 665979516}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 665979516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4260, 'qdb_cluster': [4260]} 2024-05-10T08:40:22.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:40:22.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T08:40:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.009+0000 7fa53b47e640 1 Processor -- start 2024-05-10T08:40:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.010+0000 7fa53b47e640 1 -- start start 2024-05-10T08:40:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.010+0000 7fa53b47e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 0x7fa5341633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.010+0000 7fa53b47e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5340d0500 con 0x7fa534162f50 2024-05-10T08:40:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.010+0000 7fa53b47e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa53406da60 con 0x7fa5340b21f0 2024-05-10T08:40:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.010+0000 7fa53b47e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa53406d810 con 0x7fa5340cfea0 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.010+0000 7fa538a19640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa534162f50 0x7fa5340cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53998/0 (socket says 172.21.15.37:53998) 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.010+0000 7fa538a19640 1 -- 172.21.15.37:0/2033071428 learned_addr learned my addr 172.21.15.37:0/2033071428 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa539a1b640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 0x7fa5341633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475227283 0 0) 0x7fa5340d0500 con 0x7fa534162f50 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa51c003520 con 0x7fa534162f50 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221068545 0 0) 0x7fa53406da60 con 0x7fa5340b21f0 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5340d0500 con 0x7fa5340b21f0 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2049003457 0 0) 0x7fa51c003520 con 0x7fa534162f50 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 msgr2=0x7fa5341633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 0x7fa5341633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 >> v1:172.21.15.82:6789/0 conn(0x7fa5340b21f0 legacy=0x7fa53406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53406dd40 con 0x7fa534162f50 2024-05-10T08:40:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fa528001670 con 0x7fa534162f50 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa539a1b640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 0x7fa5341633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 >> v1:172.21.15.37:6789/0 conn(0x7fa534162f50 legacy=0x7fa5340cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c003b70 0x7fa51c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 0x7fa51c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c004d40 0x7fa51c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa53406d810 con 0x7fa51c003b70 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c00bb80 con 0x7fa51c004d40 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa51c00bd80 con 0x7fa5340cfea0 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa53921a640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c003b70 0x7fa51c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa539a1b640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c004d40 0x7fa51c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa538a19640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 0x7fa51c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa53921a640 1 -- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 msgr2=0x7fa51c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa53921a640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340cfea0 0x7fa51c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa53921a640 1 -- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c004d40 msgr2=0x7fa51c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa53921a640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c004d40 0x7fa51c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa53921a640 1 -- 172.21.15.37:0/2033071428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c003520 con 0x7fa51c003b70 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.011+0000 7fa539a1b640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c004d40 0x7fa51c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.012+0000 7fa53921a640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c003b70 0x7fa51c003f70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0018d0 tx=0x7fa51c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884215b33437360d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.012+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0014f0 con 0x7fa51c003b70 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.012+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c0052d0 con 0x7fa51c003b70 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.012+0000 7fa533fff640 1 -- 172.21.15.37:0/2033071428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c02aca0 con 0x7fa51c003b70 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.013+0000 7fa53b47e640 1 -- 172.21.15.37:0/2033071428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c003b70 msgr2=0x7fa51c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.013+0000 7fa53b47e640 1 --2- 172.21.15.37:0/2033071428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c003b70 0x7fa51c003f70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0018d0 tx=0x7fa51c005830 comp rx=0 tx=0).stop 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.013+0000 7fa539a1b640 1 -- 172.21.15.37:0/2033071428 reap_dead start 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.013+0000 7fa53b47e640 1 -- 172.21.15.37:0/2033071428 shutdown_connections 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.013+0000 7fa53b47e640 1 -- 172.21.15.37:0/2033071428 >> 172.21.15.37:0/2033071428 conn(0x7fa53409ba40 msgr2=0x7fa53409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.013+0000 7fa53b47e640 1 -- 172.21.15.37:0/2033071428 shutdown_connections 2024-05-10T08:40:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.013+0000 7fa53b47e640 1 -- 172.21.15.37:0/2033071428 wait complete. 2024-05-10T08:40:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.014+0000 7fa53b47e640 1 Processor -- start 2024-05-10T08:40:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.014+0000 7fa53b47e640 1 -- start start 2024-05-10T08:40:23.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa53b47e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c003b70 0x7fa53414e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa53b47e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340b2a80 0x7fa5340b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa53b47e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5340b3420 0x7fa53414c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa53b47e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341633e0 con 0x7fa5340b3420 2024-05-10T08:40:23.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa53b47e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa53406e0b0 con 0x7fa51c003b70 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa53b47e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa534163560 con 0x7fa5340b2a80 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5340b3420 0x7fa53414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5340b3420 0x7fa53414c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38320/0 (socket says 172.21.15.37:38320) 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 -- 172.21.15.37:0/188544246 learned_addr learned my addr 172.21.15.37:0/188544246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa53921a640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c003b70 0x7fa53414e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa538a19640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340b2a80 0x7fa5340b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 -- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340b2a80 msgr2=0x7fa5340b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340b2a80 0x7fa5340b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 -- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c003b70 msgr2=0x7fa53414e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c003b70 0x7fa53414e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 -- 172.21.15.37:0/188544246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5340c9750 con 0x7fa5340b3420 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa538a19640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340b2a80 0x7fa5340b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa539a1b640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5340b3420 0x7fa53414c680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5340d3dc0 tx=0x7fa5240115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.015+0000 7fa531ffb640 1 -- 172.21.15.37:0/188544246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524011db0 con 0x7fa5340b3420 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.016+0000 7fa531ffb640 1 -- 172.21.15.37:0/188544246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52401b070 con 0x7fa5340b3420 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.016+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5340b38a0 con 0x7fa5340b3420 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.016+0000 7fa531ffb640 1 -- 172.21.15.37:0/188544246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524003990 con 0x7fa5340b3420 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.016+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53414bba0 con 0x7fa5340b3420 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.017+0000 7fa531ffb640 1 -- 172.21.15.37:0/188544246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa524005d10 con 0x7fa5340b3420 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.018+0000 7fa531ffb640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5200762d0 0x7fa520078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.018+0000 7fa531ffb640 1 -- 172.21.15.37:0/188544246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa524097ed0 con 0x7fa5340b3420 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.018+0000 7fa53921a640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5200762d0 0x7fa520078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.018+0000 7fa53921a640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5200762d0 0x7fa520078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa52c032000 tx=0x7fa52c009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.019+0000 7fa53e19b740 1 Processor -- start 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.019+0000 7fa53e19b740 1 -- start start 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.019+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d59f50 0x55da14d5c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d5cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d2cbb0 0x55da14d303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa53e19b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da14c968d0 con 0x55da14d2cbb0 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da14c4fc10 con 0x55da14d5a330 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55da14c92890 con 0x55da14d59f50 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d2cbb0 0x55da14d303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d2cbb0 0x55da14d303c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38326/0 (socket says 172.21.15.37:38326) 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 -- 172.21.15.37:0/1936053725 learned_addr learned my addr 172.21.15.37:0/1936053725 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa538a19640 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d5cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa53921a640 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d59f50 0x55da14d5c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 -- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d59f50 msgr2=0x55da14d5c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d59f50 0x55da14d5c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 -- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 msgr2=0x55da14d5cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d5cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 -- 172.21.15.37:0/1936053725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da14c575d0 con 0x55da14d2cbb0 2024-05-10T08:40:23.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa539a1b640 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d2cbb0 0x55da14d303c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa524000f80 tx=0x7fa524060900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1af51edf3b0ead server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa51affd640 1 -- 172.21.15.37:0/1936053725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524060df0 con 0x55da14d2cbb0 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa51affd640 1 -- 172.21.15.37:0/1936053725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5240651a0 con 0x55da14d2cbb0 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.020+0000 7fa51affd640 1 -- 172.21.15.37:0/1936053725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524069930 con 0x55da14d2cbb0 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 -- 172.21.15.37:0/1936053725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d2cbb0 msgr2=0x55da14d303c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d2cbb0 0x55da14d303c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa524000f80 tx=0x7fa524060900 comp rx=0 tx=0).stop 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 -- 172.21.15.37:0/1936053725 shutdown_connections 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d2cbb0 0x55da14d303c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d5cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1936053725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d59f50 0x55da14d5c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 -- 172.21.15.37:0/1936053725 >> 172.21.15.37:0/1936053725 conn(0x55da14d2ee20 msgr2=0x55da14d77760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 -- 172.21.15.37:0/1936053725 shutdown_connections 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 -- 172.21.15.37:0/1936053725 wait complete. 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.021+0000 7fa53e19b740 1 -- start start 2024-05-10T08:40:23.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.022+0000 7fa53e19b740 1 Processor -- start 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.022+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.022+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d53290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.022+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53e19b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da14d31fd0 con 0x55da14d59f50 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da14c53760 con 0x55da14d5a330 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55da14d322b0 con 0x55da14d78890 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53e19b740 10 client.0 _ll_register_callbacks cb 0x55da14c8ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d875d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38334/0 (socket says 172.21.15.37:38334) 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 -- 172.21.15.37:0/2430709526 learned_addr learned my addr 172.21.15.37:0/2430709526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa538a19640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d53290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa539a1b640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 -- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 msgr2=0x55da14d537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 -- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 msgr2=0x55da14d53290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d53290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 -- 172.21.15.37:0/2430709526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da149a82d0 con 0x55da14d59f50 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa539a1b640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa538a19640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d53290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53921a640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d875d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa52c02a730 tx=0x7fa52c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9312f69ab7aefc36 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa513fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa513fff640 1 -- 172.21.15.37:0/2430709526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c037040 con 0x55da14d59f50 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa513fff640 1 -- 172.21.15.37:0/2430709526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa52c006c60 con 0x55da14d59f50 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5240651a0 con 0x55da14d59f50 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa513fff640 1 -- 172.21.15.37:0/2430709526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa52c057050 con 0x55da14d59f50 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53e19b740 10 client.4401 fetch_fsmap learned FSMap version 7 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.023+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55da14a726b0 con 0x55da14d59f50 2024-05-10T08:40:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa513fff640 1 -- 172.21.15.37:0/2430709526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5240651a0 con 0x55da14d59f50 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa513fff640 1 -- 172.21.15.37:0/2430709526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fa52c05a020 con 0x55da14d59f50 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa53e19b740 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa53e19b740 10 client.4401 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa53e19b740 20 client.4401 populate_metadata read hostname 'smithi037' 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa53e19b740 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14d8b370 0x55da14d96090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa53e19b740 4 client.4401 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 --> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da14c1a760 con 0x55da14d8b370 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa538a19640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14d8b370 0x55da14d96090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa513fff640 10 client.4401 ms_handle_connect on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.024+0000 7fa538a19640 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14d8b370 0x55da14d96090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8d4078e0d2b3789 server_cookie=ac71d230177a1d3 in_seq=0 out_seq=0 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa513fff640 1 -- 172.21.15.37:0/2430709526 <== mds.0 v2:172.21.15.37:6833/665979516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55da14c1a760 con 0x55da14d8b370 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa513fff640 10 client.4401 handle_command_reply: tid=0 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 client.4401 shutdown 2024-05-10T08:40:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 msgr2=0x55da14d875d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d875d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa52c02a730 tx=0x7fa52c02c070 comp rx=0 tx=0).stop 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 shutdown_connections 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14d8b370 0x55da14d96090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d53290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 --2- 172.21.15.37:0/2430709526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d875d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa513fff640 0 client.4401 ms_handle_reset on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 >> 172.21.15.37:0/2430709526 conn(0x55da14d2cbb0 msgr2=0x55da14d2dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 shutdown_connections 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 1 -- 172.21.15.37:0/2430709526 wait complete. 2024-05-10T08:40:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.025+0000 7fa53e19b740 20 client.4401 trim_cache size 0 max 16384 2024-05-10T08:40:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.044+0000 7fa53e19b740 1 Processor -- start 2024-05-10T08:40:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.044+0000 7fa53e19b740 1 -- start start 2024-05-10T08:40:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d27f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d2ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53e19b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa534202410 con 0x55da14d59f50 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa534201770 con 0x55da14d5a330 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa534201dc0 con 0x55da14d78890 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d303c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38340/0 (socket says 172.21.15.37:38340) 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 -- 172.21.15.37:0/4294351556 learned_addr learned my addr 172.21.15.37:0/4294351556 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa538a19640 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d27f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa539a1b640 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d2ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 -- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 msgr2=0x55da14d2ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d2ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 -- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 msgr2=0x55da14d27f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d27f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 -- 172.21.15.37:0/4294351556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da14d91a20 con 0x55da14d59f50 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa538a19640 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d27f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa53921a640 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d303c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa52c001750 tx=0x7fa52c040070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abeab082ca4e22c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa51a7fc640 1 -- 172.21.15.37:0/4294351556 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c006e60 con 0x55da14d59f50 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa51a7fc640 1 -- 172.21.15.37:0/4294351556 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c04f070 con 0x55da14d59f50 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.045+0000 7fa51a7fc640 1 -- 172.21.15.37:0/4294351556 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c052640 con 0x55da14d59f50 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 -- 172.21.15.37:0/4294351556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 msgr2=0x55da14d303c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d303c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa52c001750 tx=0x7fa52c040070 comp rx=0 tx=0).stop 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 -- 172.21.15.37:0/4294351556 shutdown_connections 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d2ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d5a330 0x55da14d27f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 --2- 172.21.15.37:0/4294351556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d59f50 0x55da14d303c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 -- 172.21.15.37:0/4294351556 >> 172.21.15.37:0/4294351556 conn(0x55da14d2cbb0 msgr2=0x55da14d74680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 -- 172.21.15.37:0/4294351556 shutdown_connections 2024-05-10T08:40:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 -- 172.21.15.37:0/4294351556 wait complete. 2024-05-10T08:40:23.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.046+0000 7fa53e19b740 1 -- start start 2024-05-10T08:40:23.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.047+0000 7fa53e19b740 1 Processor -- start 2024-05-10T08:40:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.047+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d59f50 0x55da14d2ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.047+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d5a330 0x55da14d2bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.047+0000 7fa53e19b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d6d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.047+0000 7fa53e19b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da14d7b480 con 0x55da14d5a330 2024-05-10T08:40:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.047+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da14d51c00 con 0x55da14d59f50 2024-05-10T08:40:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.047+0000 7fa53e19b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55da14d52b00 con 0x55da14d78890 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa53e19b740 10 client.0 _ll_register_callbacks cb 0x7fa51c00baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d5a330 0x55da14d2bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d5a330 0x55da14d2bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38350/0 (socket says 172.21.15.37:38350) 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa53921a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d59f50 0x55da14d2ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 -- 172.21.15.37:0/1768036836 learned_addr learned my addr 172.21.15.37:0/1768036836 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa539a1b640 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d6d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 -- 172.21.15.37:0/1768036836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 msgr2=0x55da14d6d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d6d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 -- 172.21.15.37:0/1768036836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d59f50 msgr2=0x55da14d2ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d59f50 0x55da14d2ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 -- 172.21.15.37:0/1768036836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da14d31700 con 0x55da14d5a330 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa538a19640 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d5a330 0x55da14d2bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa528000fb0 tx=0x7fa52801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7787eed91cbf8b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa513fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa513fff640 1 -- 172.21.15.37:0/1768036836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528020070 con 0x55da14d5a330 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa513fff640 1 -- 172.21.15.37:0/1768036836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa528021c00 con 0x55da14d5a330 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa52c04f070 con 0x55da14d5a330 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa513fff640 1 -- 172.21.15.37:0/1768036836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa52802b050 con 0x55da14d5a330 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa53e19b740 10 client.4407 fetch_fsmap learned FSMap version 7 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.048+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55da14d5c830 con 0x55da14d5a330 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa513fff640 1 -- 172.21.15.37:0/1768036836 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c04f070 con 0x55da14d5a330 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa513fff640 1 -- 172.21.15.37:0/1768036836 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fa52802e020 con 0x55da14d5a330 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 10 client.4407 fetch_fsmap finished waiting for FSMap version 7 2024-05-10T08:40:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 10 client.4407 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 20 client.4407 populate_metadata read hostname 'smithi037' 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14df52c0 0x55da14df56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 4 client.4407 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 --> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] -- command(tid 0: {"prefix": "status"}) -- 0x55da14d55b90 con 0x55da14df52c0 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53921a640 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14df52c0 0x55da14df56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa513fff640 10 client.4407 ms_handle_connect on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53921a640 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14df52c0 0x55da14df56a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65438f7957f41417 server_cookie=56e0da28aca36a91 in_seq=0 out_seq=0 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa513fff640 1 -- 172.21.15.37:0/1768036836 <== mds.0 v2:172.21.15.37:6833/665979516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55da14d55b90 con 0x55da14df52c0 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa513fff640 10 client.4407 handle_command_reply: tid=0 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 client.4407 shutdown 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d5a330 msgr2=0x55da14d2bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d5a330 0x55da14d2bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa528000fb0 tx=0x7fa52801c490 comp rx=0 tx=0).stop 2024-05-10T08:40:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 shutdown_connections 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55da14d78890 0x55da14d6d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da14d5a330 0x55da14d2bf80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55da14df52c0 0x55da14df56a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 --2- 172.21.15.37:0/1768036836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da14d59f50 0x55da14d2ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa513fff640 0 client.4407 ms_handle_reset on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.049+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 >> 172.21.15.37:0/1768036836 conn(0x55da14d2cbb0 msgr2=0x55da14d2db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 shutdown_connections 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53e19b740 1 -- 172.21.15.37:0/1768036836 wait complete. 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53e19b740 20 client.4407 trim_cache size 0 max 16384 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:40:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4260, 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 7.3424489929999996, 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 7, 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 25, 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 23, 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 13.520096101 2024-05-10T08:40:23.057 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:40:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5200762d0 msgr2=0x7fa520078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5200762d0 0x7fa520078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa52c032000 tx=0x7fa52c009030 comp rx=0 tx=0).stop 2024-05-10T08:40:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5340b3420 msgr2=0x7fa53414c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5340b3420 0x7fa53414c680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5340d3dc0 tx=0x7fa5240115a0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 shutdown_connections 2024-05-10T08:40:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5200762d0 0x7fa520078790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5340b3420 0x7fa53414c680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340b2a80 0x7fa5340b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 --2- 172.21.15.37:0/188544246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa51c003b70 0x7fa53414e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 >> 172.21.15.37:0/188544246 conn(0x7fa53409ba40 msgr2=0x7fa5340b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 shutdown_connections 2024-05-10T08:40:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.050+0000 7fa53b47e640 1 -- 172.21.15.37:0/188544246 wait complete. 2024-05-10T08:40:23.060 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T08:40:23.061 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:23.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:40:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.165+0000 7f18be519640 1 Processor -- start 2024-05-10T08:40:23.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.165+0000 7f18be519640 1 -- start start 2024-05-10T08:40:23.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18be519640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b815f420 0x7f18b80d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18be519640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18b80d3ca0 0x7f18b80d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18be519640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f18b80d1eb0 0x7f18b80d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18be519640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f18b80d22f0 con 0x7f18b80d3ca0 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18be519640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f18b81630b0 con 0x7f18b80d1eb0 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18be519640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f18b80d2550 con 0x7f18b815f420 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18b80d3ca0 0x7f18b80d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18b80d3ca0 0x7f18b80d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38352/0 (socket says 172.21.15.37:38352) 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 -- 172.21.15.37:0/2007498774 learned_addr learned my addr 172.21.15.37:0/2007498774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b7fff640 1 --2- 172.21.15.37:0/2007498774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b815f420 0x7f18b80d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18bcab6640 1 --2- 172.21.15.37:0/2007498774 >> v2:172.21.15.82:3300/0 conn(0x7f18b80d1eb0 0x7f18b80d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 -- 172.21.15.37:0/2007498774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b815f420 msgr2=0x7f18b80d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 --2- 172.21.15.37:0/2007498774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b815f420 0x7f18b80d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 -- 172.21.15.37:0/2007498774 >> v2:172.21.15.82:3300/0 conn(0x7f18b80d1eb0 msgr2=0x7f18b80d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 --2- 172.21.15.37:0/2007498774 >> v2:172.21.15.82:3300/0 conn(0x7f18b80d1eb0 0x7f18b80d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b77fe640 1 -- 172.21.15.37:0/2007498774 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b80d2c80 con 0x7f18b80d3ca0 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.166+0000 7f18b7fff640 1 --2- 172.21.15.37:0/2007498774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b815f420 0x7f18b80d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.167+0000 7f18b77fe640 1 --2- 172.21.15.37:0/2007498774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d3ca0 0x7f18b80d1970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18b80d17a0 tx=0x7f18ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78db048802a2ab86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.167+0000 7f18b6ffd640 1 -- 172.21.15.37:0/2007498774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac037070 con 0x7f18b80d3ca0 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.167+0000 7f18b6ffd640 1 -- 172.21.15.37:0/2007498774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac032440 con 0x7f18b80d3ca0 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.167+0000 7f18b6ffd640 1 -- 172.21.15.37:0/2007498774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac032810 con 0x7f18b80d3ca0 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.167+0000 7f18be519640 1 -- 172.21.15.37:0/2007498774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d3ca0 msgr2=0x7f18b80d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.167+0000 7f18be519640 1 --2- 172.21.15.37:0/2007498774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d3ca0 0x7f18b80d1970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18b80d17a0 tx=0x7f18ac02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.168+0000 7f18be519640 1 -- 172.21.15.37:0/2007498774 shutdown_connections 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.168+0000 7f18be519640 1 --2- 172.21.15.37:0/2007498774 >> v2:172.21.15.82:3300/0 conn(0x7f18b80d1eb0 0x7f18b80d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.168+0000 7f18be519640 1 --2- 172.21.15.37:0/2007498774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d3ca0 0x7f18b80d1970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.168+0000 7f18be519640 1 --2- 172.21.15.37:0/2007498774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b815f420 0x7f18b80d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.168+0000 7f18be519640 1 -- 172.21.15.37:0/2007498774 >> 172.21.15.37:0/2007498774 conn(0x7f18b808eac0 msgr2=0x7f18b809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.168+0000 7f18be519640 1 -- 172.21.15.37:0/2007498774 shutdown_connections 2024-05-10T08:40:23.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.168+0000 7f18be519640 1 -- 172.21.15.37:0/2007498774 wait complete. 2024-05-10T08:40:23.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.169+0000 7f18be519640 1 Processor -- start 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.169+0000 7f18be519640 1 -- start start 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18be519640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d1eb0 0x7f18b8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18be519640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806d740 0x7f18b80cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18be519640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b806dbc0 0x7f18b80cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18be519640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80d2830 con 0x7f18b80d1eb0 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18be519640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80d3240 con 0x7f18b806d740 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18be519640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f18b80d5200 con 0x7f18b806dbc0 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d1eb0 0x7f18b8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d1eb0 0x7f18b8159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38366/0 (socket says 172.21.15.37:38366) 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 -- 172.21.15.37:0/3008135526 learned_addr learned my addr 172.21.15.37:0/3008135526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b77fe640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806d740 0x7f18b80cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18bcab6640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b806dbc0 0x7f18b80cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 -- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b806dbc0 msgr2=0x7f18b80cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b806dbc0 0x7f18b80cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 -- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806d740 msgr2=0x7f18b80cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806d740 0x7f18b80cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 -- 172.21.15.37:0/3008135526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b80cdf50 con 0x7f18b80d1eb0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b7fff640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d1eb0 0x7f18b8159b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18a800d7d0 tx=0x7f18a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b4ff9640 1 -- 172.21.15.37:0/3008135526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8004030 con 0x7f18b80d1eb0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18b4ff9640 1 -- 172.21.15.37:0/3008135526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a80041d0 con 0x7f18b80d1eb0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.170+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b80ce1d0 con 0x7f18b80d1eb0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.171+0000 7f18b4ff9640 1 -- 172.21.15.37:0/3008135526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8009640 con 0x7f18b80d1eb0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.171+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b80ce790 con 0x7f18b80d1eb0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.171+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b80693f0 con 0x7f18b80d1eb0 2024-05-10T08:40:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.172+0000 7f18b4ff9640 1 -- 172.21.15.37:0/3008135526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18a80097e0 con 0x7f18b80d1eb0 2024-05-10T08:40:23.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.173+0000 7f18b4ff9640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18a40762d0 0x7f18a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:23.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.173+0000 7f18b4ff9640 1 -- 172.21.15.37:0/3008135526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f18a8097b80 con 0x7f18b80d1eb0 2024-05-10T08:40:23.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.173+0000 7f18b77fe640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18a40762d0 0x7f18a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:23.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.174+0000 7f18b77fe640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18a40762d0 0x7f18a4078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18ac034000 tx=0x7f18ac02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:23.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.177+0000 7f18b4ff9640 1 -- 172.21.15.37:0/3008135526 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f18b80cdf50 con 0x7f18b80d1eb0 2024-05-10T08:40:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.410+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18b80d1c90 con 0x7f18b80d1eb0 2024-05-10T08:40:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.410+0000 7f18b4ff9640 1 -- 172.21.15.37:0/3008135526 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f18a8011340 con 0x7f18b80d1eb0 2024-05-10T08:40:23.410 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18a40762d0 msgr2=0x7f18a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18a40762d0 0x7f18a4078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18ac034000 tx=0x7f18ac02e000 comp rx=0 tx=0).stop 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d1eb0 msgr2=0x7f18b8159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d1eb0 0x7f18b8159b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18a800d7d0 tx=0x7f18a800dc90 comp rx=0 tx=0).stop 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 shutdown_connections 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18a40762d0 0x7f18a4078790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18b806dbc0 0x7f18b80cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806d740 0x7f18b80cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 --2- 172.21.15.37:0/3008135526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b80d1eb0 0x7f18b8159b60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 >> 172.21.15.37:0/3008135526 conn(0x7f18b808eac0 msgr2=0x7f18b80b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 shutdown_connections 2024-05-10T08:40:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23.412+0000 7f18be519640 1 -- 172.21.15.37:0/3008135526 wait complete. 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:40:23.423 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T08:40:23.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:23.423 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:40:23.440 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42738sec preferred_lft 42738sec 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:23.441 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:40:23.442 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T08:40:23.442 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:23.442 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:23.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-05-10T08:40:23.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-05-10T08:40:23.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-05-10T08:40:23.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T08:40:23.442 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:23.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:23.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:23.672 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:40:23.697 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:40:23.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:23.699 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:40:23.841 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:40:23.841 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:40:23.841 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:40:23.841 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:40:23.841 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:40:23.842 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:23.842 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:23.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:40:23.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:40:23.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:40:23.842 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:23.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:24.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:24.092 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:40:24.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:24.108 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-05-10T08:40:24.164 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:24.164 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:24.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T08:40:24.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-10T08:40:24.164 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:24.285 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-10T08:40:24.285 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:24.285 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:24.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-10T08:40:24.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T08:40:24.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-10T08:40:24.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-10T08:40:24.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-10T08:40:24.286 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:24.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:24.543 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:24.543 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:24.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:40:24.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T08:40:24.544 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:24.623 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-10T08:40:24.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:24.623 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:24.639 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T08:40:24.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:24.639 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:24.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-05-10T08:40:24.766 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-05-10T08:40:24.824 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-05-10T08:40:24.824 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-05-10T08:40:24.824 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-05-10T08:40:24.824 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-05-10T08:40:24.824 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-05-10T08:40:24.824 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-05-10T08:40:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-0 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-1 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-2 2024-05-10T08:40:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-3 2024-05-10T08:40:24.827 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-05-10T08:40:24.827 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T08:40:24.827 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T08:40:24.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:24.827 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-05-10T08:40:24.880 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-10T08:40:24.881 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-10T08:40:24.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-05-10T08:40:24.948 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-05-10T08:40:25.004 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-05-10T08:40:25.004 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-05-10T08:40:25.005 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-0 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-1 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-2 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-3 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T08:40:25.006 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T08:40:25.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:25.007 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-05-10T08:40:25.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2024-05-10T08:40:25.038+0000 7f06dc921480 -1 init, newargv = 0x55b76e0211d0 newargc=15 2024-05-10T08:40:25.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[42332]: starting ceph client 2024-05-10T08:40:25.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[42332]: starting fuse 2024-05-10T08:40:25.054 INFO:teuthology.orchestra.run.smithi037.stdout:40 2024-05-10T08:40:25.054 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> import re 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-10T08:40:25.055 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2024-05-10T08:40:25.056 DEBUG:teuthology.orchestra.run.smithi037:> return f 2024-05-10T08:40:25.057 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-10T08:40:25.057 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:40:25.057 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2024-05-10T08:40:25.057 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:40:25.176 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.42332.asok 2024-05-10T08:40:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:25.186 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42332.asok 2024-05-10T08:40:25.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:25.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42332.asok status 2024-05-10T08:40:25.325 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:40:25.325 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2024-05-10T08:40:25.325 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "d39fa08867836ac070c47cb66c782fa559fd480b", 2024-05-10T08:40:25.325 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev)", 2024-05-10T08:40:25.325 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "42332", 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4419, 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4419 2024-05-10T08:40:25.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 452577575 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 452577575 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4419 192.168.0.1:0/452577575", 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/452577575", 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 7, 2024-05-10T08:40:25.327 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 25, 2024-05-10T08:40:25.328 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2024-05-10T08:40:25.328 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2024-05-10T08:40:25.328 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2024-05-10T08:40:25.328 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:40:25.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:25.334 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2024-05-10T08:40:25.334 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:25.350 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2024-05-10T08:40:25.350 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:25.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:25.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:25.417 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-10T08:40:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:25.528 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2024-05-10T08:40:25.528 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-10T08:40:25.528 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:25.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:25.534 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:25.534 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:25.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:40:25.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.697+0000 7ff71997f640 1 Processor -- start 2024-05-10T08:40:25.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.697+0000 7ff71997f640 1 -- start start 2024-05-10T08:40:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.697+0000 7ff71997f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff714162c60 0x7ff7141630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.697+0000 7ff71997f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7140d2c80 con 0x7ff7140d5bc0 2024-05-10T08:40:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.697+0000 7ff71997f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7140d2f60 con 0x7ff71415f100 2024-05-10T08:40:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.697+0000 7ff71997f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff7140d35b0 con 0x7ff714162c60 2024-05-10T08:40:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.698+0000 7ff7137fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff714162c60 0x7ff7141630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.698+0000 7ff7127fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff7140d5bc0 0x7ff7140d3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54006/0 (socket says 172.21.15.37:54006) 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.698+0000 7ff7127fc640 1 -- 172.21.15.37:0/572241874 learned_addr learned my addr 172.21.15.37:0/572241874 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.698+0000 7ff7137fe640 1 -- 172.21.15.37:0/572241874 >> v1:172.21.15.82:6789/0 conn(0x7ff71415f100 legacy=0x7ff7140d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.698+0000 7ff7137fe640 1 -- 172.21.15.37:0/572241874 >> v1:172.21.15.37:6789/0 conn(0x7ff7140d5bc0 legacy=0x7ff7140d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.698+0000 7ff7137fe640 1 -- 172.21.15.37:0/572241874 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7140d3240 con 0x7ff714162c60 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff7137fe640 1 --2- 172.21.15.37:0/572241874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff714162c60 0x7ff7141630f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff704009dc0 tx=0x7ff70402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe75893bb36dd5a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff711ffb640 1 -- 172.21.15.37:0/572241874 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704037070 con 0x7ff714162c60 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff711ffb640 1 -- 172.21.15.37:0/572241874 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff704007740 con 0x7ff714162c60 2024-05-10T08:40:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff711ffb640 1 -- 172.21.15.37:0/572241874 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704007b10 con 0x7ff714162c60 2024-05-10T08:40:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff71997f640 1 -- 172.21.15.37:0/572241874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff714162c60 msgr2=0x7ff7141630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff71997f640 1 --2- 172.21.15.37:0/572241874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff714162c60 0x7ff7141630f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff704009dc0 tx=0x7ff70402a7c0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff71997f640 1 -- 172.21.15.37:0/572241874 shutdown_connections 2024-05-10T08:40:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff71997f640 1 --2- 172.21.15.37:0/572241874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff714162c60 0x7ff7141630f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff71997f640 1 -- 172.21.15.37:0/572241874 >> 172.21.15.37:0/572241874 conn(0x7ff71409e3e0 msgr2=0x7ff7140d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff71997f640 1 -- 172.21.15.37:0/572241874 shutdown_connections 2024-05-10T08:40:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.699+0000 7ff71997f640 1 -- 172.21.15.37:0/572241874 wait complete. 2024-05-10T08:40:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.700+0000 7ff71997f640 1 Processor -- start 2024-05-10T08:40:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.701+0000 7ff71997f640 1 -- start start 2024-05-10T08:40:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.701+0000 7ff71997f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7140d5bc0 0x7ff7140cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.701+0000 7ff71997f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff71415f100 0x7ff7140b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.701+0000 7ff71997f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714162c60 0x7ff71414f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.701+0000 7ff71997f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff71415f4e0 con 0x7ff7140d5bc0 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.701+0000 7ff71997f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff714163630 con 0x7ff714162c60 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.701+0000 7ff71997f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff7140b4970 con 0x7ff71415f100 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7140d5bc0 0x7ff7140cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7140d5bc0 0x7ff7140cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38376/0 (socket says 172.21.15.37:38376) 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 -- 172.21.15.37:0/2241173370 learned_addr learned my addr 172.21.15.37:0/2241173370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff7137fe640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714162c60 0x7ff71414f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff7127fc640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff71415f100 0x7ff7140b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 -- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff71415f100 msgr2=0x7ff7140b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff71415f100 0x7ff7140b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 -- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714162c60 msgr2=0x7ff71414f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714162c60 0x7ff71414f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 -- 172.21.15.37:0/2241173370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7140cdc60 con 0x7ff7140d5bc0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff7137fe640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714162c60 0x7ff71414f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff712ffd640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7140d5bc0 0x7ff7140cd680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c400 tx=0x7ff70c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff70bfff640 1 -- 172.21.15.37:0/2241173370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0052d0 con 0x7ff7140d5bc0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff70bfff640 1 -- 172.21.15.37:0/2241173370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70c005490 con 0x7ff7140d5bc0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7140cdf40 con 0x7ff7140d5bc0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff70bfff640 1 -- 172.21.15.37:0/2241173370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c007260 con 0x7ff7140d5bc0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.702+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7140ce500 con 0x7ff7140d5bc0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.703+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7140c84b0 con 0x7ff7140d5bc0 2024-05-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.704+0000 7ff70bfff640 1 -- 172.21.15.37:0/2241173370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff70c007400 con 0x7ff7140d5bc0 2024-05-10T08:40:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.704+0000 7ff70bfff640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6f40762d0 0x7ff6f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.705+0000 7ff70bfff640 1 -- 172.21.15.37:0/2241173370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff70c096f10 con 0x7ff7140d5bc0 2024-05-10T08:40:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.705+0000 7ff7127fc640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6f40762d0 0x7ff6f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.705+0000 7ff7127fc640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6f40762d0 0x7ff6f4078790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7140cbf00 tx=0x7ff6fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.709+0000 7ff70bfff640 1 -- 172.21.15.37:0/2241173370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff7140c84b0 con 0x7ff7140d5bc0 2024-05-10T08:40:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.916+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7140693f0 con 0x7ff7140d5bc0 2024-05-10T08:40:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.916+0000 7ff70bfff640 1 -- 172.21.15.37:0/2241173370 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff70c060490 con 0x7ff7140d5bc0 2024-05-10T08:40:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:40:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6f40762d0 msgr2=0x7ff6f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6f40762d0 0x7ff6f4078790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7140cbf00 tx=0x7ff6fc009040 comp rx=0 tx=0).stop 2024-05-10T08:40:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7140d5bc0 msgr2=0x7ff7140cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7140d5bc0 0x7ff7140cd680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c400 tx=0x7ff70c00c8c0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 shutdown_connections 2024-05-10T08:40:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6f40762d0 0x7ff6f4078790 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714162c60 0x7ff71414f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff71415f100 0x7ff7140b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 --2- 172.21.15.37:0/2241173370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7140d5bc0 0x7ff7140cd680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 >> 172.21.15.37:0/2241173370 conn(0x7ff71409e3e0 msgr2=0x7ff7140d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 shutdown_connections 2024-05-10T08:40:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:25.918+0000 7ff71997f640 1 -- 172.21.15.37:0/2241173370 wait complete. 2024-05-10T08:40:25.929 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:25.929 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:25.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:40:26.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.090+0000 7fbb92464640 1 Processor -- start 2024-05-10T08:40:26.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.090+0000 7fbb92464640 1 -- start start 2024-05-10T08:40:26.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.091+0000 7fbb92464640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb8c0d3cd0 0x7fbb8c16a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.091+0000 7fbb92464640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c0d1760 con 0x7fbb8c15f380 2024-05-10T08:40:26.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.091+0000 7fbb92464640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c0d1a40 con 0x7fbb8c0d0ec0 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.091+0000 7fbb92464640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8c0d30f0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.091+0000 7fbb8bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb8c15f380 0x7fbb8c0d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54012/0 (socket says 172.21.15.37:54012) 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.091+0000 7fbb8bfff640 1 -- 172.21.15.37:0/164164842 learned_addr learned my addr 172.21.15.37:0/164164842 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.091+0000 7fbb90a01640 1 --2- 172.21.15.37:0/164164842 >> v2:172.21.15.82:3300/0 conn(0x7fbb8c0d3cd0 0x7fbb8c16a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872577676 0 0) 0x7fbb8c0d1760 con 0x7fbb8c15f380 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb78003520 con 0x7fbb8c15f380 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004247403 0 0) 0x7fbb8c0d1a40 con 0x7fbb8c0d0ec0 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb8c0d1760 con 0x7fbb8c0d0ec0 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb90a01640 1 -- 172.21.15.37:0/164164842 >> v1:172.21.15.82:6789/0 conn(0x7fbb8c0d0ec0 legacy=0x7fbb8c0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1907621345 0 0) 0x7fbb78003520 con 0x7fbb8c15f380 2024-05-10T08:40:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb90a01640 1 -- 172.21.15.37:0/164164842 >> v1:172.21.15.37:6789/0 conn(0x7fbb8c15f380 legacy=0x7fbb8c0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.092+0000 7fbb90a01640 1 -- 172.21.15.37:0/164164842 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c0d1d20 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb90a01640 1 --2- 172.21.15.37:0/164164842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c16a1f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a10cea6329af1c01 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c001670 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb84007540 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb8b7fe640 1 -- 172.21.15.37:0/164164842 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb840078f0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb92464640 1 -- 172.21.15.37:0/164164842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c0d3cd0 msgr2=0x7fbb8c16a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb92464640 1 --2- 172.21.15.37:0/164164842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c16a1f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8402a680 comp rx=0 tx=0).stop 2024-05-10T08:40:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb92464640 1 -- 172.21.15.37:0/164164842 shutdown_connections 2024-05-10T08:40:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb92464640 1 --2- 172.21.15.37:0/164164842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c16a1f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.093+0000 7fbb92464640 1 -- 172.21.15.37:0/164164842 >> 172.21.15.37:0/164164842 conn(0x7fbb8c0d4fe0 msgr2=0x7fbb8c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.094+0000 7fbb92464640 1 -- 172.21.15.37:0/164164842 shutdown_connections 2024-05-10T08:40:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.094+0000 7fbb92464640 1 -- 172.21.15.37:0/164164842 wait complete. 2024-05-10T08:40:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 Processor -- start 2024-05-10T08:40:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 -- start start 2024-05-10T08:40:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb8c0d0ec0 0x7fbb8c0a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c15f380 0x7fbb8c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c0b8e40 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c0d2370 con 0x7fbb8c15f380 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.095+0000 7fbb92464640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c15f760 con 0x7fbb8c0d0ec0 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c0ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38378/0 (socket says 172.21.15.37:38378) 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 -- 172.21.15.37:0/3290071284 learned_addr learned my addr 172.21.15.37:0/3290071284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb90a01640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c15f380 0x7fbb8c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb8bfff640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb8c0d0ec0 0x7fbb8c0a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 -- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb8c0d0ec0 msgr2=0x7fbb8c0a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb8c0d0ec0 0x7fbb8c0a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 -- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c15f380 msgr2=0x7fbb8c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c15f380 0x7fbb8c0cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 -- 172.21.15.37:0/3290071284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c0a0740 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb83fff640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c0ce550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c500 tx=0x7fbb7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb897fa640 1 -- 172.21.15.37:0/3290071284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740052d0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb897fa640 1 -- 172.21.15.37:0/3290071284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb74005490 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c0a0a20 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb897fa640 1 -- 172.21.15.37:0/3290071284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74012870 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.096+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c0a0fe0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.097+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c0693f0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.098+0000 7fbb897fa640 1 -- 172.21.15.37:0/3290071284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb74012a10 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.098+0000 7fbb897fa640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb6c0762d0 0x7fbb6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.099+0000 7fbb897fa640 1 -- 172.21.15.37:0/3290071284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbb740974f0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.099+0000 7fbb8bfff640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb6c0762d0 0x7fbb6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.099+0000 7fbb8bfff640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb6c0762d0 0x7fbb6c078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0011e0 tx=0x7fbb7c0016f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.103+0000 7fbb897fa640 1 -- 172.21.15.37:0/3290071284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbb740604d0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.308+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbb8c0b6870 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.308+0000 7fbb897fa640 1 -- 172.21.15.37:0/3290071284 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fbb740647d0 con 0x7fbb8c0d3cd0 2024-05-10T08:40:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:40:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb6c0762d0 msgr2=0x7fbb6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb6c0762d0 0x7fbb6c078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0011e0 tx=0x7fbb7c0016f0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb8c0d3cd0 msgr2=0x7fbb8c0ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c0ce550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c500 tx=0x7fbb7400c9c0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 shutdown_connections 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb6c0762d0 0x7fbb6c078790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c15f380 0x7fbb8c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb8c0d3cd0 0x7fbb8c0ce550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 --2- 172.21.15.37:0/3290071284 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb8c0d0ec0 0x7fbb8c0a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 >> 172.21.15.37:0/3290071284 conn(0x7fbb8c0d4fe0 msgr2=0x7fbb8c0b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 shutdown_connections 2024-05-10T08:40:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.310+0000 7fbb92464640 1 -- 172.21.15.37:0/3290071284 wait complete. 2024-05-10T08:40:26.321 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2024-05-10T08:40:26.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:26.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-10T08:40:26.345 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[42332]: fuse finished with error 0 and tester_r 0 2024-05-10T08:40:26.347 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:40:26.426 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:40:26.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:26.427 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-10T08:40:26.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.577+0000 7fc6d1912640 1 Processor -- start 2024-05-10T08:40:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.577+0000 7fc6d1912640 1 -- start start 2024-05-10T08:40:26.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6d1912640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc06d620 0x7fc6cc073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6d1912640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6cc1637b0 0x7fc6cc0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6d1912640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6cc0b5120 con 0x7fc6cc06da00 2024-05-10T08:40:26.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6d1912640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc6cc0afaa0 con 0x7fc6cc1637b0 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6d1912640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc6cc0b5a50 con 0x7fc6cc06d620 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6cb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6cc1637b0 0x7fc6cc0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc06d620 0x7fc6cc073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc06d620 0x7fc6cc073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:57910/0 (socket says 172.21.15.37:57910) 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.578+0000 7fc6caffd640 1 -- 172.21.15.37:0/3545537211 learned_addr learned my addr 172.21.15.37:0/3545537211 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.579+0000 7fc6cb7fe640 1 -- 172.21.15.37:0/3545537211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc06d620 msgr2=0x7fc6cc073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.579+0000 7fc6cb7fe640 1 --2- 172.21.15.37:0/3545537211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc06d620 0x7fc6cc073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.579+0000 7fc6cb7fe640 1 -- 172.21.15.37:0/3545537211 >> v1:172.21.15.82:6789/0 conn(0x7fc6cc06da00 legacy=0x7fc6cc0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.579+0000 7fc6cb7fe640 1 -- 172.21.15.37:0/3545537211 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc0b5400 con 0x7fc6cc1637b0 2024-05-10T08:40:26.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.579+0000 7fc6ca7fc640 1 -- 172.21.15.37:0/3545537211 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126229176 0 0) 0x7fc6cc0b5120 con 0x7fc6cc06da00 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.579+0000 7fc6cb7fe640 1 --2- 172.21.15.37:0/3545537211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc1637b0 0x7fc6cc0b5ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009d90 tx=0x7fc6c402a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9914bea35d8f2e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6ca7fc640 1 -- 172.21.15.37:0/3545537211 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4007740 con 0x7fc6cc1637b0 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6ca7fc640 1 -- 172.21.15.37:0/3545537211 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c40078e0 con 0x7fc6cc1637b0 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6ca7fc640 1 -- 172.21.15.37:0/3545537211 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4007cb0 con 0x7fc6cc1637b0 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 -- 172.21.15.37:0/3545537211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc1637b0 msgr2=0x7fc6cc0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 --2- 172.21.15.37:0/3545537211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc1637b0 0x7fc6cc0b5ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009d90 tx=0x7fc6c402a530 comp rx=0 tx=0).stop 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 -- 172.21.15.37:0/3545537211 shutdown_connections 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 --2- 172.21.15.37:0/3545537211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc1637b0 0x7fc6cc0b5ee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 --2- 172.21.15.37:0/3545537211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc06d620 0x7fc6cc073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 -- 172.21.15.37:0/3545537211 >> 172.21.15.37:0/3545537211 conn(0x7fc6cc0728c0 msgr2=0x7fc6cc072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 -- 172.21.15.37:0/3545537211 shutdown_connections 2024-05-10T08:40:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.580+0000 7fc6d1912640 1 -- 172.21.15.37:0/3545537211 wait complete. 2024-05-10T08:40:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.581+0000 7fc6d1912640 1 Processor -- start 2024-05-10T08:40:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.581+0000 7fc6d1912640 1 -- start start 2024-05-10T08:40:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6d1912640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6cc06d620 0x7fc6cc1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6d1912640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc06da00 0x7fc6cc1f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6d1912640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc1637b0 0x7fc6cc1f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6d1912640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc0b65a0 con 0x7fc6cc06d620 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6d1912640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc0b6420 con 0x7fc6cc06da00 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6d1912640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc6cc06e920 con 0x7fc6cc1637b0 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6cc06d620 0x7fc6cc1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6cc06d620 0x7fc6cc1585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38394/0 (socket says 172.21.15.37:38394) 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6caffd640 1 -- 172.21.15.37:0/2873450541 learned_addr learned my addr 172.21.15.37:0/2873450541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6c3fff640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc06da00 0x7fc6cc1f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.582+0000 7fc6cb7fe640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc1637b0 0x7fc6cc1f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6caffd640 1 -- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc1637b0 msgr2=0x7fc6cc1f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6caffd640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc1637b0 0x7fc6cc1f8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6caffd640 1 -- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc06da00 msgr2=0x7fc6cc1f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6caffd640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc06da00 0x7fc6cc1f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6caffd640 1 -- 172.21.15.37:0/2873450541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc15a5a0 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6c3fff640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc06da00 0x7fc6cc1f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6caffd640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6cc06d620 0x7fc6cc1585e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009fd0 tx=0x7fc6bc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6c8ff9640 1 -- 172.21.15.37:0/2873450541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc017070 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6c8ff9640 1 -- 172.21.15.37:0/2873450541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00c940 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6cc1f65e0 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6c8ff9640 1 -- 172.21.15.37:0/2873450541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00cd10 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.583+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6cc158ff0 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.584+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6cc0693f0 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.584+0000 7fc6c8ff9640 1 -- 172.21.15.37:0/2873450541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6bc01a070 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.585+0000 7fc6c8ff9640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6ac0762d0 0x7fc6ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.585+0000 7fc6c8ff9640 1 -- 172.21.15.37:0/2873450541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc6bc097980 con 0x7fc6cc06d620 2024-05-10T08:40:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.585+0000 7fc6c3fff640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6ac0762d0 0x7fc6ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.586+0000 7fc6c3fff640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6ac0762d0 0x7fc6ac078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc159320 tx=0x7fc6b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.589+0000 7fc6c8ff9640 1 -- 172.21.15.37:0/2873450541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc6bc060f20 con 0x7fc6cc06d620 2024-05-10T08:40:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.781+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6cc1631f0 con 0x7fc6cc06d620 2024-05-10T08:40:26.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.782+0000 7fc6c8ff9640 1 -- 172.21.15.37:0/2873450541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fc6bc060820 con 0x7fc6cc06d620 2024-05-10T08:40:26.782 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:26.782 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:26.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.784+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6ac0762d0 msgr2=0x7fc6ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.784+0000 7fc6d1912640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6ac0762d0 0x7fc6ac078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc159320 tx=0x7fc6b4009040 comp rx=0 tx=0).stop 2024-05-10T08:40:26.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.784+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6cc06d620 msgr2=0x7fc6cc1585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.784+0000 7fc6d1912640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6cc06d620 0x7fc6cc1585e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009fd0 tx=0x7fc6bc00ed40 comp rx=0 tx=0).stop 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.784+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 shutdown_connections 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.785+0000 7fc6d1912640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6ac0762d0 0x7fc6ac078790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.785+0000 7fc6d1912640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6cc1637b0 0x7fc6cc1f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.785+0000 7fc6d1912640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc06da00 0x7fc6cc1f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.785+0000 7fc6d1912640 1 --2- 172.21.15.37:0/2873450541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6cc06d620 0x7fc6cc1585e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.785+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 >> 172.21.15.37:0/2873450541 conn(0x7fc6cc0728c0 msgr2=0x7fc6cc0af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.785+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 shutdown_connections 2024-05-10T08:40:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.785+0000 7fc6d1912640 1 -- 172.21.15.37:0/2873450541 wait complete. 2024-05-10T08:40:26.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:26.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.898+0000 7feca3cd1640 1 Processor -- start 2024-05-10T08:40:26.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.899+0000 7feca3cd1640 1 -- start start 2024-05-10T08:40:26.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.899+0000 7feca3cd1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec9c1524f0 0x7fec9c0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.899+0000 7feca3cd1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c06eaa0 0x7fec9c073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.899+0000 7feca3cd1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec9c0b4590 con 0x7fec9c15bc80 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.899+0000 7feca3cd1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fec9c0b51a0 con 0x7fec9c1524f0 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.899+0000 7feca3cd1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fec9c073450 con 0x7fec9c06eaa0 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca1a6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec9c1524f0 0x7fec9c0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca1a6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec9c1524f0 0x7fec9c0b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38410/0 (socket says 172.21.15.37:38410) 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca1a6d640 1 -- 172.21.15.37:0/2717309694 learned_addr learned my addr 172.21.15.37:0/2717309694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca226e640 1 --2- 172.21.15.37:0/2717309694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c06eaa0 0x7fec9c073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca1a6d640 1 -- 172.21.15.37:0/2717309694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c06eaa0 msgr2=0x7fec9c073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca1a6d640 1 --2- 172.21.15.37:0/2717309694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c06eaa0 0x7fec9c073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca1a6d640 1 -- 172.21.15.37:0/2717309694 >> v1:172.21.15.82:6789/0 conn(0x7fec9c15bc80 legacy=0x7fec9c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.900+0000 7feca1a6d640 1 -- 172.21.15.37:0/2717309694 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c0b4870 con 0x7fec9c1524f0 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca1a6d640 1 --2- 172.21.15.37:0/2717309694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c1524f0 0x7fec9c0b3c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec9800bb00 tx=0x7fec9802c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77455f20f9bd2520 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca0a6b640 1 -- 172.21.15.37:0/2717309694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9803a070 con 0x7fec9c1524f0 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca0a6b640 1 -- 172.21.15.37:0/2717309694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec98032480 con 0x7fec9c1524f0 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca0a6b640 1 -- 172.21.15.37:0/2717309694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98032850 con 0x7fec9c1524f0 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca3cd1640 1 -- 172.21.15.37:0/2717309694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c1524f0 msgr2=0x7fec9c0b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2717309694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c1524f0 0x7fec9c0b3c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec9800bb00 tx=0x7fec9802c6e0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca3cd1640 1 -- 172.21.15.37:0/2717309694 shutdown_connections 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2717309694 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c06eaa0 0x7fec9c073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2717309694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c1524f0 0x7fec9c0b3c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.901+0000 7feca3cd1640 1 -- 172.21.15.37:0/2717309694 >> 172.21.15.37:0/2717309694 conn(0x7fec9c06c3a0 msgr2=0x7fec9c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.902+0000 7feca3cd1640 1 -- 172.21.15.37:0/2717309694 shutdown_connections 2024-05-10T08:40:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.902+0000 7feca3cd1640 1 -- 172.21.15.37:0/2717309694 wait complete. 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.903+0000 7feca3cd1640 1 Processor -- start 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.903+0000 7feca3cd1640 1 -- start start 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c06eaa0 0x7fec9c158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c1524f0 0x7fec9c09e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c15bc80 0x7fec9c156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c1528d0 con 0x7fec9c06eaa0 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c0b4e30 con 0x7fec9c15bc80 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fec9c0b5630 con 0x7fec9c1524f0 2024-05-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c06eaa0 0x7fec9c158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c06eaa0 0x7fec9c158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38424/0 (socket says 172.21.15.37:38424) 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 -- 172.21.15.37:0/2706006865 learned_addr learned my addr 172.21.15.37:0/2706006865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca226e640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c15bc80 0x7fec9c156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca126c640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c1524f0 0x7fec9c09e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 -- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c1524f0 msgr2=0x7fec9c09e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c1524f0 0x7fec9c09e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 -- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c15bc80 msgr2=0x7fec9c156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c15bc80 0x7fec9c156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 -- 172.21.15.37:0/2706006865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c09d030 con 0x7fec9c06eaa0 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca126c640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c1524f0 0x7fec9c09e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca1a6d640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c06eaa0 0x7fec9c158c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec98038040 tx=0x7fec980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7fec927fc640 1 -- 172.21.15.37:0/2706006865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9803a070 con 0x7fec9c06eaa0 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7fec927fc640 1 -- 172.21.15.37:0/2706006865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec98035a50 con 0x7fec9c06eaa0 2024-05-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9c09d310 con 0x7fec9c06eaa0 2024-05-10T08:40:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7fec927fc640 1 -- 172.21.15.37:0/2706006865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98006dd0 con 0x7fec9c06eaa0 2024-05-10T08:40:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.904+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9c09d8d0 con 0x7fec9c06eaa0 2024-05-10T08:40:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.905+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9c0693f0 con 0x7fec9c06eaa0 2024-05-10T08:40:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.906+0000 7fec927fc640 1 -- 172.21.15.37:0/2706006865 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec98047060 con 0x7fec9c06eaa0 2024-05-10T08:40:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.907+0000 7fec927fc640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec800762d0 0x7fec80078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.907+0000 7fec927fc640 1 -- 172.21.15.37:0/2706006865 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fec980b7b80 con 0x7fec9c06eaa0 2024-05-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.907+0000 7feca126c640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec800762d0 0x7fec80078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.907+0000 7feca126c640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec800762d0 0x7fec80078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec9c1fd380 tx=0x7fec8c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:26.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:26.911+0000 7fec927fc640 1 -- 172.21.15.37:0/2706006865 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fec980811a0 con 0x7fec9c06eaa0 2024-05-10T08:40:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.102+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec9c159320 con 0x7fec9c06eaa0 2024-05-10T08:40:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.103+0000 7fec927fc640 1 -- 172.21.15.37:0/2706006865 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fec98080aa0 con 0x7fec9c06eaa0 2024-05-10T08:40:27.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:27.103 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec800762d0 msgr2=0x7fec80078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec800762d0 0x7fec80078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec9c1fd380 tx=0x7fec8c009040 comp rx=0 tx=0).stop 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c06eaa0 msgr2=0x7fec9c158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c06eaa0 0x7fec9c158c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec98038040 tx=0x7fec980046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 shutdown_connections 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec800762d0 0x7fec80078790 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9c15bc80 0x7fec9c156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec9c1524f0 0x7fec9c09e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 --2- 172.21.15.37:0/2706006865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c06eaa0 0x7fec9c158c90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 >> 172.21.15.37:0/2706006865 conn(0x7fec9c06c3a0 msgr2=0x7fec9c072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 shutdown_connections 2024-05-10T08:40:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.105+0000 7feca3cd1640 1 -- 172.21.15.37:0/2706006865 wait complete. 2024-05-10T08:40:27.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:40:27.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.222+0000 7fa414a72640 1 Processor -- start 2024-05-10T08:40:27.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.222+0000 7fa414a72640 1 -- start start 2024-05-10T08:40:27.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.223+0000 7fa414a72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa41015ccb0 0x7fa41015d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.223+0000 7fa414a72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4100d2ce0 0x7fa4100d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.223+0000 7fa414a72640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4100718c0 con 0x7fa410070b90 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.223+0000 7fa414a72640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa4100afba0 con 0x7fa41015ccb0 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.223+0000 7fa414a72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa410071ba0 con 0x7fa4100d2ce0 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.223+0000 7fa40e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa41015ccb0 0x7fa41015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.223+0000 7fa40e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa41015ccb0 0x7fa41015d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38430/0 (socket says 172.21.15.37:38430) 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.224+0000 7fa40e59c640 1 -- 172.21.15.37:0/1297642239 learned_addr learned my addr 172.21.15.37:0/1297642239 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.224+0000 7fa40dd9b640 1 --2- 172.21.15.37:0/1297642239 >> v2:172.21.15.82:3300/0 conn(0x7fa4100d2ce0 0x7fa4100d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.224+0000 7fa40e59c640 1 -- 172.21.15.37:0/1297642239 >> v2:172.21.15.82:3300/0 conn(0x7fa4100d2ce0 msgr2=0x7fa4100d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.224+0000 7fa40e59c640 1 --2- 172.21.15.37:0/1297642239 >> v2:172.21.15.82:3300/0 conn(0x7fa4100d2ce0 0x7fa4100d3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.224+0000 7fa40e59c640 1 -- 172.21.15.37:0/1297642239 >> v1:172.21.15.82:6789/0 conn(0x7fa410070b90 legacy=0x7fa410071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.224+0000 7fa40e59c640 1 -- 172.21.15.37:0/1297642239 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa410071e80 con 0x7fa41015ccb0 2024-05-10T08:40:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.224+0000 7fa40e59c640 1 --2- 172.21.15.37:0/1297642239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa41015ccb0 0x7fa41015d090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4100b20c0 tx=0x7fa40802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a383ce37b71e11 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa40d59a640 1 -- 172.21.15.37:0/1297642239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408037070 con 0x7fa41015ccb0 2024-05-10T08:40:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa40d59a640 1 -- 172.21.15.37:0/1297642239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408032440 con 0x7fa41015ccb0 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa40d59a640 1 -- 172.21.15.37:0/1297642239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408032810 con 0x7fa41015ccb0 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 -- 172.21.15.37:0/1297642239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa41015ccb0 msgr2=0x7fa41015d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 --2- 172.21.15.37:0/1297642239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa41015ccb0 0x7fa41015d090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4100b20c0 tx=0x7fa40802a1a0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 -- 172.21.15.37:0/1297642239 shutdown_connections 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 --2- 172.21.15.37:0/1297642239 >> v2:172.21.15.82:3300/0 conn(0x7fa4100d2ce0 0x7fa4100d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 --2- 172.21.15.37:0/1297642239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa41015ccb0 0x7fa41015d090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 -- 172.21.15.37:0/1297642239 >> 172.21.15.37:0/1297642239 conn(0x7fa41009ba40 msgr2=0x7fa41009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 -- 172.21.15.37:0/1297642239 shutdown_connections 2024-05-10T08:40:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.225+0000 7fa414a72640 1 -- 172.21.15.37:0/1297642239 wait complete. 2024-05-10T08:40:27.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 Processor -- start 2024-05-10T08:40:27.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 -- start start 2024-05-10T08:40:27.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410070b90 0x7fa41015d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4100d2ce0 0x7fa4101592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa41015ccb0 0x7fa41006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100cf980 con 0x7fa4100d2ce0 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100d3660 con 0x7fa410070b90 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.227+0000 7fa414a72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa4100cfb00 con 0x7fa41015ccb0 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4100d2ce0 0x7fa4101592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4100d2ce0 0x7fa4101592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38440/0 (socket says 172.21.15.37:38440) 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 -- 172.21.15.37:0/1250412446 learned_addr learned my addr 172.21.15.37:0/1250412446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40e59c640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410070b90 0x7fa41015d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40ed9d640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa41015ccb0 0x7fa41006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 -- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa41015ccb0 msgr2=0x7fa41006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa41015ccb0 0x7fa41006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 -- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410070b90 msgr2=0x7fa41015d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410070b90 0x7fa41015d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 -- 172.21.15.37:0/1250412446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41006dd00 con 0x7fa4100d2ce0 2024-05-10T08:40:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa40dd9b640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4100d2ce0 0x7fa4101592a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c820 tx=0x7fa3f800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa406ffd640 1 -- 172.21.15.37:0/1250412446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8015070 con 0x7fa4100d2ce0 2024-05-10T08:40:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa406ffd640 1 -- 172.21.15.37:0/1250412446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f8004240 con 0x7fa4100d2ce0 2024-05-10T08:40:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa406ffd640 1 -- 172.21.15.37:0/1250412446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800ce10 con 0x7fa4100d2ce0 2024-05-10T08:40:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41006dfe0 con 0x7fa4100d2ce0 2024-05-10T08:40:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.228+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa41006e5a0 con 0x7fa4100d2ce0 2024-05-10T08:40:27.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.229+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa410069b00 con 0x7fa4100d2ce0 2024-05-10T08:40:27.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.230+0000 7fa406ffd640 1 -- 172.21.15.37:0/1250412446 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa3f8007830 con 0x7fa4100d2ce0 2024-05-10T08:40:27.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.230+0000 7fa406ffd640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3f00762d0 0x7fa3f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.231+0000 7fa406ffd640 1 -- 172.21.15.37:0/1250412446 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa3f8097780 con 0x7fa4100d2ce0 2024-05-10T08:40:27.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.231+0000 7fa40e59c640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3f00762d0 0x7fa3f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.231+0000 7fa40e59c640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3f00762d0 0x7fa3f0078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa408034000 tx=0x7fa40802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.235+0000 7fa406ffd640 1 -- 172.21.15.37:0/1250412446 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa3f8060e30 con 0x7fa4100d2ce0 2024-05-10T08:40:27.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.462+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa410070380 con 0x7fa4100d2ce0 2024-05-10T08:40:27.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.760+0000 7fa406ffd640 1 -- 172.21.15.37:0/1250412446 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fa3f8060730 con 0x7fa4100d2ce0 2024-05-10T08:40:27.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3f00762d0 msgr2=0x7fa3f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3f00762d0 0x7fa3f0078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa408034000 tx=0x7fa40802e000 comp rx=0 tx=0).stop 2024-05-10T08:40:27.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4100d2ce0 msgr2=0x7fa4101592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4100d2ce0 0x7fa4101592a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c820 tx=0x7fa3f800cce0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 shutdown_connections 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3f00762d0 0x7fa3f0078790 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa41015ccb0 0x7fa41006d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4100d2ce0 0x7fa4101592a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 --2- 172.21.15.37:0/1250412446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410070b90 0x7fa41015d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 >> 172.21.15.37:0/1250412446 conn(0x7fa41009ba40 msgr2=0x7fa4100b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 shutdown_connections 2024-05-10T08:40:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.762+0000 7fa414a72640 1 -- 172.21.15.37:0/1250412446 wait complete. 2024-05-10T08:40:27.773 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-10T08:40:27.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:40:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.881+0000 7fd93bc46640 1 Processor -- start 2024-05-10T08:40:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.881+0000 7fd93bc46640 1 -- start start 2024-05-10T08:40:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93bc46640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd93415f4e0 0x7fd9340cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93bc46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9340d3aa0 0x7fd9340d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93bc46640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9340d3f00 0x7fd9340d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93bc46640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd9340d0320 con 0x7fd9340d3f00 2024-05-10T08:40:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93bc46640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd9340d0600 con 0x7fd93415f4e0 2024-05-10T08:40:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93bc46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9340d08e0 con 0x7fd9340d3aa0 2024-05-10T08:40:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93a1e3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9340d3f00 0x7fd9340d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93a1e3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9340d3f00 0x7fd9340d54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57754/0 (socket says 172.21.15.37:57754) 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.882+0000 7fd93a1e3640 1 -- 172.21.15.37:0/4271443219 learned_addr learned my addr 172.21.15.37:0/4271443219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd9391e1640 1 --2- 172.21.15.37:0/4271443219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9340d3aa0 0x7fd9340d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd9399e2640 1 --2- 172.21.15.37:0/4271443219 >> v2:172.21.15.82:3300/0 conn(0x7fd93415f4e0 0x7fd9340cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd93a1e3640 1 -- 172.21.15.37:0/4271443219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9340d3aa0 msgr2=0x7fd9340d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd93a1e3640 1 --2- 172.21.15.37:0/4271443219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9340d3aa0 0x7fd9340d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd93a1e3640 1 -- 172.21.15.37:0/4271443219 >> v2:172.21.15.82:3300/0 conn(0x7fd93415f4e0 msgr2=0x7fd9340cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd93a1e3640 1 --2- 172.21.15.37:0/4271443219 >> v2:172.21.15.82:3300/0 conn(0x7fd93415f4e0 0x7fd9340cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd93a1e3640 1 -- 172.21.15.37:0/4271443219 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9340d0bc0 con 0x7fd9340d3f00 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd9399e2640 1 --2- 172.21.15.37:0/4271443219 >> v2:172.21.15.82:3300/0 conn(0x7fd93415f4e0 0x7fd9340cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.883+0000 7fd93a1e3640 1 --2- 172.21.15.37:0/4271443219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9340d54e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9340b6230 tx=0x7fd92402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e1dd5b75912883 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd9389e0640 1 -- 172.21.15.37:0/4271443219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924036070 con 0x7fd9340d3f00 2024-05-10T08:40:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd9389e0640 1 -- 172.21.15.37:0/4271443219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd924031600 con 0x7fd9340d3f00 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd9389e0640 1 -- 172.21.15.37:0/4271443219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9240319d0 con 0x7fd9340d3f00 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 -- 172.21.15.37:0/4271443219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 msgr2=0x7fd9340d54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 --2- 172.21.15.37:0/4271443219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9340d54e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9340b6230 tx=0x7fd92402a6a0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 -- 172.21.15.37:0/4271443219 shutdown_connections 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 --2- 172.21.15.37:0/4271443219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9340d54e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 --2- 172.21.15.37:0/4271443219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9340d3aa0 0x7fd9340d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 --2- 172.21.15.37:0/4271443219 >> v2:172.21.15.82:3300/0 conn(0x7fd93415f4e0 0x7fd9340cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 -- 172.21.15.37:0/4271443219 >> 172.21.15.37:0/4271443219 conn(0x7fd93408eac0 msgr2=0x7fd93409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.884+0000 7fd93bc46640 1 -- 172.21.15.37:0/4271443219 shutdown_connections 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.885+0000 7fd93bc46640 1 -- 172.21.15.37:0/4271443219 wait complete. 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 Processor -- start 2024-05-10T08:40:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 -- start start 2024-05-10T08:40:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9340d3aa0 0x7fd9340ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9341f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd93415f4e0 0x7fd9341f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9340b50d0 con 0x7fd9340d3f00 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd93415f8c0 con 0x7fd9340d3aa0 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.886+0000 7fd93bc46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9340b5250 con 0x7fd93415f4e0 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9341f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9341f66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57762/0 (socket says 172.21.15.37:57762) 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 -- 172.21.15.37:0/3142775557 learned_addr learned my addr 172.21.15.37:0/3142775557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9399e2640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9340d3aa0 0x7fd9340ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd93a1e3640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd93415f4e0 0x7fd9341f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 -- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd93415f4e0 msgr2=0x7fd9341f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd93415f4e0 0x7fd9341f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 -- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9340d3aa0 msgr2=0x7fd9340ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9340d3aa0 0x7fd9340ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 -- 172.21.15.37:0/3142775557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9340b7d40 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9391e1640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9341f66d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd92800c7f0 tx=0x7fd92800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9327fc640 1 -- 172.21.15.37:0/3142775557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928015070 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9327fc640 1 -- 172.21.15.37:0/3142775557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd928004220 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9340b8020 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd9327fc640 1 -- 172.21.15.37:0/3142775557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928007620 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.887+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9341f8370 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.888+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9340693f0 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.889+0000 7fd9327fc640 1 -- 172.21.15.37:0/3142775557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd9280077c0 con 0x7fd9340d3f00 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.889+0000 7fd9327fc640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd920076300 0x7fd9200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.890+0000 7fd9327fc640 1 -- 172.21.15.37:0/3142775557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd928097790 con 0x7fd9340d3f00 2024-05-10T08:40:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.890+0000 7fd9399e2640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd920076300 0x7fd9200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.890+0000 7fd9399e2640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd920076300 0x7fd9200787c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00aac0 tx=0x7fd92c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:27.894+0000 7fd9327fc640 1 -- 172.21.15.37:0/3142775557 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd9280606d0 con 0x7fd9340d3f00 2024-05-10T08:40:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.122+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd93406dde0 con 0x7fd9340d3f00 2024-05-10T08:40:28.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.761+0000 7fd9327fc640 1 -- 172.21.15.37:0/3142775557 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fd9280649d0 con 0x7fd9340d3f00 2024-05-10T08:40:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd920076300 msgr2=0x7fd9200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd920076300 0x7fd9200787c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00aac0 tx=0x7fd92c008040 comp rx=0 tx=0).stop 2024-05-10T08:40:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 msgr2=0x7fd9341f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9341f66d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd92800c7f0 tx=0x7fd92800ccb0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 shutdown_connections 2024-05-10T08:40:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd920076300 0x7fd9200787c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd93415f4e0 0x7fd9341f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9340d3f00 0x7fd9341f66d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 --2- 172.21.15.37:0/3142775557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9340d3aa0 0x7fd9340ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 >> 172.21.15.37:0/3142775557 conn(0x7fd93408eac0 msgr2=0x7fd9340d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.765+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 shutdown_connections 2024-05-10T08:40:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.766+0000 7fd93bc46640 1 -- 172.21.15.37:0/3142775557 wait complete. 2024-05-10T08:40:28.778 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:40:28.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.888+0000 7fdcb4a46640 1 Processor -- start 2024-05-10T08:40:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.888+0000 7fdcb4a46640 1 -- start start 2024-05-10T08:40:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.889+0000 7fdcb4a46640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdcb015f420 0x7fdcb00d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.889+0000 7fdcb4a46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb00d3ca0 0x7fdcb00d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.889+0000 7fdcb4a46640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb01630b0 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.889+0000 7fdcb4a46640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb00d22f0 con 0x7fdcb015f420 2024-05-10T08:40:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.889+0000 7fdcb4a46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb00d2550 con 0x7fdcb00d3ca0 2024-05-10T08:40:28.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcae59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdcb015f420 0x7fdcb00d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcadd9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb00d3ca0 0x7fdcb00d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcadd9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb00d3ca0 0x7fdcb00d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:52920/0 (socket says 172.21.15.37:52920) 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcae59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdcb015f420 0x7fdcb00d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55394/0 (socket says 172.21.15.37:55394) 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcadd9b640 1 -- 172.21.15.37:0/1914370779 learned_addr learned my addr 172.21.15.37:0/1914370779 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcaed9d640 1 --1- 172.21.15.37:0/1914370779 >> v1:172.21.15.82:6789/0 conn(0x7fdcb00d1eb0 0x7fdcb00d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44544/0 (socket says 172.21.15.37:44544) 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcae59c640 1 -- 172.21.15.37:0/1914370779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb00d3ca0 msgr2=0x7fdcb00d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcae59c640 1 --2- 172.21.15.37:0/1914370779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb00d3ca0 0x7fdcb00d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcae59c640 1 -- 172.21.15.37:0/1914370779 >> v1:172.21.15.82:6789/0 conn(0x7fdcb00d1eb0 legacy=0x7fdcb00d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.890+0000 7fdcae59c640 1 -- 172.21.15.37:0/1914370779 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb00d2c80 con 0x7fdcb015f420 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.891+0000 7fdcae59c640 1 --2- 172.21.15.37:0/1914370779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb015f420 0x7fdcb00d3760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d23842038e5e09 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.891+0000 7fdcad59a640 1 -- 172.21.15.37:0/1914370779 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0007740 con 0x7fdcb015f420 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.891+0000 7fdcad59a640 1 -- 172.21.15.37:0/1914370779 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca00078e0 con 0x7fdcb015f420 2024-05-10T08:40:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.891+0000 7fdcad59a640 1 -- 172.21.15.37:0/1914370779 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0007cb0 con 0x7fdcb015f420 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 -- 172.21.15.37:0/1914370779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb015f420 msgr2=0x7fdcb00d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/1914370779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb015f420 0x7fdcb00d3760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca002a660 comp rx=0 tx=0).stop 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 -- 172.21.15.37:0/1914370779 shutdown_connections 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/1914370779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb00d3ca0 0x7fdcb00d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/1914370779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb015f420 0x7fdcb00d3760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 -- 172.21.15.37:0/1914370779 >> 172.21.15.37:0/1914370779 conn(0x7fdcb008eac0 msgr2=0x7fdcb009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 -- 172.21.15.37:0/1914370779 shutdown_connections 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.892+0000 7fdcb4a46640 1 -- 172.21.15.37:0/1914370779 wait complete. 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.893+0000 7fdcb4a46640 1 Processor -- start 2024-05-10T08:40:28.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.893+0000 7fdcb4a46640 1 -- start start 2024-05-10T08:40:28.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcb4a46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00d1eb0 0x7fdcb015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:28.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcb4a46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb0162090 0x7fdcb00cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcb4a46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb00cc620 0x7fdcb00caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcb4a46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb00d2830 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcb4a46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb00d3240 con 0x7fdcb00cc620 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcb4a46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb00d53d0 con 0x7fdcb0162090 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00d1eb0 0x7fdcb015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00d1eb0 0x7fdcb015c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57772/0 (socket says 172.21.15.37:57772) 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcae59c640 1 -- 172.21.15.37:0/3770640070 learned_addr learned my addr 172.21.15.37:0/3770640070 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcaed9d640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb00cc620 0x7fdcb00caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcadd9b640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb0162090 0x7fdcb00cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcae59c640 1 -- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb0162090 msgr2=0x7fdcb00cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:28.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcae59c640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb0162090 0x7fdcb00cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcae59c640 1 -- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb00cc620 msgr2=0x7fdcb00caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.894+0000 7fdcae59c640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb00cc620 0x7fdcb00caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdcae59c640 1 -- 172.21.15.37:0/3770640070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb015a4d0 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdcaed9d640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb00cc620 0x7fdcb00caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdcae59c640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00d1eb0 0x7fdcb015c200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdca6ffd640 1 -- 172.21.15.37:0/3770640070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca003f070 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdca6ffd640 1 -- 172.21.15.37:0/3770640070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca0031c40 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb00c9ed0 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdca6ffd640 1 -- 172.21.15.37:0/3770640070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0009450 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.895+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb00ca490 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.896+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb00693f0 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.897+0000 7fdca6ffd640 1 -- 172.21.15.37:0/3770640070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdca0044460 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.897+0000 7fdca6ffd640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdc900762d0 0x7fdc90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.897+0000 7fdca6ffd640 1 -- 172.21.15.37:0/3770640070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdca00b9010 con 0x7fdcb00d1eb0 2024-05-10T08:40:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.897+0000 7fdcadd9b640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdc900762d0 0x7fdc90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:28.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.898+0000 7fdcadd9b640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdc900762d0 0x7fdc90078790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdcb015ab40 tx=0x7fdc98008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:28.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:28.902+0000 7fdca6ffd640 1 -- 172.21.15.37:0/3770640070 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdca00826c0 con 0x7fdcb00d1eb0 2024-05-10T08:40:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.129+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcb00763f0 con 0x7fdcb00d1eb0 2024-05-10T08:40:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.130+0000 7fdca6ffd640 1 -- 172.21.15.37:0/3770640070 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7fdca0081fc0 con 0x7fdcb00d1eb0 2024-05-10T08:40:29.130 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:29.130 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.132+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdc900762d0 msgr2=0x7fdc90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.132+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdc900762d0 0x7fdc90078790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdcb015ab40 tx=0x7fdc98008040 comp rx=0 tx=0).stop 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.132+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00d1eb0 msgr2=0x7fdcb015c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.132+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00d1eb0 0x7fdcb015c200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca0004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 shutdown_connections 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdc900762d0 0x7fdc90078790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcb00cc620 0x7fdcb00caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdcb0162090 0x7fdcb00cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 --2- 172.21.15.37:0/3770640070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00d1eb0 0x7fdcb015c200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 >> 172.21.15.37:0/3770640070 conn(0x7fdcb008eac0 msgr2=0x7fdcb0163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 shutdown_connections 2024-05-10T08:40:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.133+0000 7fdcb4a46640 1 -- 172.21.15.37:0/3770640070 wait complete. 2024-05-10T08:40:29.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.247+0000 7fa76e59d640 1 Processor -- start 2024-05-10T08:40:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.247+0000 7fa76e59d640 1 -- start start 2024-05-10T08:40:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.248+0000 7fa76e59d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa76815f2d0 0x7fa7680b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.248+0000 7fa76e59d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa7680d4fc0 0x7fa7680d5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.248+0000 7fa76e59d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7680d2730 con 0x7fa7680d1c00 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.248+0000 7fa76e59d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa7680d5960 con 0x7fa76815f2d0 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.248+0000 7fa76e59d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa7680b5810 con 0x7fa7680d4fc0 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa767fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa76815f2d0 0x7fa7680b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa767fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa76815f2d0 0x7fa7680b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57786/0 (socket says 172.21.15.37:57786) 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa767fff640 1 -- 172.21.15.37:0/3588630157 learned_addr learned my addr 172.21.15.37:0/3588630157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa7677fe640 1 --2- 172.21.15.37:0/3588630157 >> v2:172.21.15.82:3300/0 conn(0x7fa7680d4fc0 0x7fa7680d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa767fff640 1 -- 172.21.15.37:0/3588630157 >> v2:172.21.15.82:3300/0 conn(0x7fa7680d4fc0 msgr2=0x7fa7680d5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa767fff640 1 --2- 172.21.15.37:0/3588630157 >> v2:172.21.15.82:3300/0 conn(0x7fa7680d4fc0 0x7fa7680d5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa767fff640 1 -- 172.21.15.37:0/3588630157 >> v1:172.21.15.82:6789/0 conn(0x7fa7680d1c00 legacy=0x7fa7680d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:29.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.249+0000 7fa767fff640 1 -- 172.21.15.37:0/3588630157 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7681606c0 con 0x7fa76815f2d0 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa767fff640 1 --2- 172.21.15.37:0/3588630157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76815f2d0 0x7fa7680b5ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa76808e9b0 tx=0x7fa75802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3312fa4779bb80c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa766ffd640 1 -- 172.21.15.37:0/3588630157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758037070 con 0x7fa76815f2d0 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa766ffd640 1 -- 172.21.15.37:0/3588630157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa758032440 con 0x7fa76815f2d0 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa766ffd640 1 -- 172.21.15.37:0/3588630157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758032810 con 0x7fa76815f2d0 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 -- 172.21.15.37:0/3588630157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76815f2d0 msgr2=0x7fa7680b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 --2- 172.21.15.37:0/3588630157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76815f2d0 0x7fa7680b5ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa76808e9b0 tx=0x7fa75802a230 comp rx=0 tx=0).stop 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 -- 172.21.15.37:0/3588630157 shutdown_connections 2024-05-10T08:40:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 --2- 172.21.15.37:0/3588630157 >> v2:172.21.15.82:3300/0 conn(0x7fa7680d4fc0 0x7fa7680d5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 --2- 172.21.15.37:0/3588630157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76815f2d0 0x7fa7680b5ca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 -- 172.21.15.37:0/3588630157 >> 172.21.15.37:0/3588630157 conn(0x7fa7680746d0 msgr2=0x7fa76809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 -- 172.21.15.37:0/3588630157 shutdown_connections 2024-05-10T08:40:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.250+0000 7fa76e59d640 1 -- 172.21.15.37:0/3588630157 wait complete. 2024-05-10T08:40:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 Processor -- start 2024-05-10T08:40:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 -- start start 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680d1c00 0x7fa7680ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7680d4fc0 0x7fa768154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa76815f2d0 0x7fa7680c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7680b54a0 con 0x7fa7680d1c00 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7680b51c0 con 0x7fa7680d4fc0 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.252+0000 7fa76e59d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7680d2c00 con 0x7fa76815f2d0 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680d1c00 0x7fa7680ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680d1c00 0x7fa7680ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57798/0 (socket says 172.21.15.37:57798) 2024-05-10T08:40:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 -- 172.21.15.37:0/4287185657 learned_addr learned my addr 172.21.15.37:0/4287185657 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa7677fe640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7680d4fc0 0x7fa768154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa76cb3a640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa76815f2d0 0x7fa7680c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 -- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa76815f2d0 msgr2=0x7fa7680c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa76815f2d0 0x7fa7680c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 -- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7680d4fc0 msgr2=0x7fa768154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7680d4fc0 0x7fa768154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 -- 172.21.15.37:0/4287185657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7680b7ea0 con 0x7fa7680d1c00 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa76cb3a640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa76815f2d0 0x7fa7680c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa767fff640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680d1c00 0x7fa7680ccb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa7580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa764ff9640 1 -- 172.21.15.37:0/4287185657 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758041020 con 0x7fa7680d1c00 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa764ff9640 1 -- 172.21.15.37:0/4287185657 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7580306c0 con 0x7fa7680d1c00 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7680b8180 con 0x7fa7680d1c00 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa764ff9640 1 -- 172.21.15.37:0/4287185657 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758037040 con 0x7fa7680d1c00 2024-05-10T08:40:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.253+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7680b8740 con 0x7fa7680d1c00 2024-05-10T08:40:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.254+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa768069b00 con 0x7fa7680d1c00 2024-05-10T08:40:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.255+0000 7fa764ff9640 1 -- 172.21.15.37:0/4287185657 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa758044020 con 0x7fa7680d1c00 2024-05-10T08:40:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.255+0000 7fa764ff9640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7540762d0 0x7fa754078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.256+0000 7fa764ff9640 1 -- 172.21.15.37:0/4287185657 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa7580b8190 con 0x7fa7680d1c00 2024-05-10T08:40:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.256+0000 7fa7677fe640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7540762d0 0x7fa754078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.256+0000 7fa7677fe640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7540762d0 0x7fa754078790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7680ce140 tx=0x7fa75c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.260+0000 7fa764ff9640 1 -- 172.21.15.37:0/4287185657 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa75804b030 con 0x7fa7680d1c00 2024-05-10T08:40:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.452+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7680b4b60 con 0x7fa7680d1c00 2024-05-10T08:40:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.453+0000 7fa764ff9640 1 -- 172.21.15.37:0/4287185657 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fa758081720 con 0x7fa7680d1c00 2024-05-10T08:40:29.453 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:29.453 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7540762d0 msgr2=0x7fa754078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7540762d0 0x7fa754078790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7680ce140 tx=0x7fa75c008040 comp rx=0 tx=0).stop 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680d1c00 msgr2=0x7fa7680ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680d1c00 0x7fa7680ccb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa7580046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 shutdown_connections 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7540762d0 0x7fa754078790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa76815f2d0 0x7fa7680c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7680d4fc0 0x7fa768154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 --2- 172.21.15.37:0/4287185657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680d1c00 0x7fa7680ccb10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 >> 172.21.15.37:0/4287185657 conn(0x7fa7680746d0 msgr2=0x7fa7680d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:29.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 shutdown_connections 2024-05-10T08:40:29.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.455+0000 7fa76e59d640 1 -- 172.21.15.37:0/4287185657 wait complete. 2024-05-10T08:40:29.466 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:40:29.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:40:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.571+0000 7f1546540640 1 Processor -- start 2024-05-10T08:40:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f1546540640 1 -- start start 2024-05-10T08:40:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f1546540640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f154015ccb0 0x7f154015d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f1546540640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15400d2ce0 0x7f15400d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f1546540640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f1540071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f1546540640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f15400afba0 con 0x7f154015ccb0 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f1546540640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f15400718c0 con 0x7f15400d2ce0 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f1546540640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1540071ba0 con 0x7f1540070b90 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.572+0000 7f153ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f154015ccb0 0x7f154015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f153ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f154015ccb0 0x7f154015d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57802/0 (socket says 172.21.15.37:57802) 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f153ffff640 1 -- 172.21.15.37:0/60837355 learned_addr learned my addr 172.21.15.37:0/60837355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f1537fff640 1 --2- 172.21.15.37:0/60837355 >> v2:172.21.15.82:3300/0 conn(0x7f15400d2ce0 0x7f15400d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f1544add640 1 --2- 172.21.15.37:0/60837355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f1540071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f153ffff640 1 -- 172.21.15.37:0/60837355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 msgr2=0x7f1540071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f153ffff640 1 --2- 172.21.15.37:0/60837355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f1540071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f153ffff640 1 -- 172.21.15.37:0/60837355 >> v2:172.21.15.82:3300/0 conn(0x7f15400d2ce0 msgr2=0x7f15400d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f153ffff640 1 --2- 172.21.15.37:0/60837355 >> v2:172.21.15.82:3300/0 conn(0x7f15400d2ce0 0x7f15400d3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.573+0000 7f153ffff640 1 -- 172.21.15.37:0/60837355 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1540071e80 con 0x7f154015ccb0 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f153ffff640 1 --2- 172.21.15.37:0/60837355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f154015d090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15400b20c0 tx=0x7f153002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b0518d9cb4bf71 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f153f7fe640 1 -- 172.21.15.37:0/60837355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530037070 con 0x7f154015ccb0 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f153f7fe640 1 -- 172.21.15.37:0/60837355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1530032440 con 0x7f154015ccb0 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f153f7fe640 1 -- 172.21.15.37:0/60837355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530032810 con 0x7f154015ccb0 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 -- 172.21.15.37:0/60837355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 msgr2=0x7f154015d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 --2- 172.21.15.37:0/60837355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f154015d090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15400b20c0 tx=0x7f153002a1e0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 -- 172.21.15.37:0/60837355 shutdown_connections 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 --2- 172.21.15.37:0/60837355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f1540071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 --2- 172.21.15.37:0/60837355 >> v2:172.21.15.82:3300/0 conn(0x7f15400d2ce0 0x7f15400d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 --2- 172.21.15.37:0/60837355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f154015d090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 -- 172.21.15.37:0/60837355 >> 172.21.15.37:0/60837355 conn(0x7f154009ba40 msgr2=0x7f154009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 -- 172.21.15.37:0/60837355 shutdown_connections 2024-05-10T08:40:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.574+0000 7f1546540640 1 -- 172.21.15.37:0/60837355 wait complete. 2024-05-10T08:40:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 Processor -- start 2024-05-10T08:40:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 -- start start 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f15400b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15400d2ce0 0x7f15400cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f15400b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1540071560 con 0x7f154015ccb0 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15400d3660 con 0x7f15400d2ce0 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1546540640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15400cf980 con 0x7f1540070b90 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1544add640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f15400b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1544add640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f15400b7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57810/0 (socket says 172.21.15.37:57810) 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.576+0000 7f1544add640 1 -- 172.21.15.37:0/1010741740 learned_addr learned my addr 172.21.15.37:0/1010741740 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1537fff640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15400d2ce0 0x7f15400cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f153ffff640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f15400b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1544add640 1 -- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 msgr2=0x7f15400b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1544add640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f15400b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1544add640 1 -- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15400d2ce0 msgr2=0x7f15400cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1544add640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15400d2ce0 0x7f15400cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1544add640 1 -- 172.21.15.37:0/1010741740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15400b60d0 con 0x7f154015ccb0 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f153ffff640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f15400b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1544add640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f15400b7900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f153800cbb0 tx=0x7f153800a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f153d7fa640 1 -- 172.21.15.37:0/1010741740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538015070 con 0x7f154015ccb0 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f153d7fa640 1 -- 172.21.15.37:0/1010741740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153800abd0 con 0x7f154015ccb0 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f153d7fa640 1 -- 172.21.15.37:0/1010741740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153800d040 con 0x7f154015ccb0 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154015f290 con 0x7f154015ccb0 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.577+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154015f850 con 0x7f154015ccb0 2024-05-10T08:40:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.578+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1540069b00 con 0x7f154015ccb0 2024-05-10T08:40:29.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.579+0000 7f153d7fa640 1 -- 172.21.15.37:0/1010741740 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1538018070 con 0x7f154015ccb0 2024-05-10T08:40:29.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.579+0000 7f153d7fa640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15200762d0 0x7f1520078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.579+0000 7f153d7fa640 1 -- 172.21.15.37:0/1010741740 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f15380975c0 con 0x7f154015ccb0 2024-05-10T08:40:29.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.580+0000 7f153ffff640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15200762d0 0x7f1520078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.580+0000 7f153ffff640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15200762d0 0x7f1520078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1530034000 tx=0x7f153002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.583+0000 7f153d7fa640 1 -- 172.21.15.37:0/1010741740 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1538060be0 con 0x7f154015ccb0 2024-05-10T08:40:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.771+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1540160130 con 0x7f15200762d0 2024-05-10T08:40:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.781+0000 7f153d7fa640 1 -- 172.21.15.37:0/1010741740 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332521 (secure 0 0 0) 0x7f1540160130 con 0x7f15200762d0 2024-05-10T08:40:29.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:40:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15200762d0 msgr2=0x7f1520078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15200762d0 0x7f1520078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1530034000 tx=0x7f153002e000 comp rx=0 tx=0).stop 2024-05-10T08:40:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 msgr2=0x7f15400b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f15400b7900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f153800cbb0 tx=0x7f153800a4c0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 shutdown_connections 2024-05-10T08:40:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15200762d0 0x7f1520078790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154015ccb0 0x7f15400b7900 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15400d2ce0 0x7f15400cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 --2- 172.21.15.37:0/1010741740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1540070b90 0x7f15400b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 >> 172.21.15.37:0/1010741740 conn(0x7f154009ba40 msgr2=0x7f15400b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 shutdown_connections 2024-05-10T08:40:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.784+0000 7f1546540640 1 -- 172.21.15.37:0/1010741740 wait complete. 2024-05-10T08:40:29.795 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-10T08:40:29.327149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593227,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":147,"num_write_kb":1643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219520,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755200,"statfs":{"total":773094113280,"available":772869324800,"internally_reserved":0,"allocated":3383296,"data_stored":2042510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.591367"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792232+0000","last_change":"2024-05-10T08:40:14.722841+0000","last_active":"2024-05-10T08:40:21.792232+0000","last_peered":"2024-05-10T08:40:21.792232+0000","last_clean":"2024-05-10T08:40:21.792232+0000","last_became_active":"2024-05-10T08:40:14.722183+0000","last_became_peered":"2024-05-10T08:40:14.722183+0000","last_unstale":"2024-05-10T08:40:21.792232+0000","last_undegraded":"2024-05-10T08:40:21.792232+0000","last_fullsized":"2024-05-10T08:40:21.792232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:06.547146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736024+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.736024+0000","last_peered":"2024-05-10T08:40:21.736024+0000","last_clean":"2024-05-10T08:40:21.736024+0000","last_became_active":"2024-05-10T08:40:15.727402+0000","last_became_peered":"2024-05-10T08:40:15.727402+0000","last_unstale":"2024-05-10T08:40:21.736024+0000","last_undegraded":"2024-05-10T08:40:21.736024+0000","last_fullsized":"2024-05-10T08:40:21.736024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737026+0000","last_change":"2024-05-10T08:40:20.252446+0000","last_active":"2024-05-10T08:40:21.737026+0000","last_peered":"2024-05-10T08:40:21.737026+0000","last_clean":"2024-05-10T08:40:21.737026+0000","last_became_active":"2024-05-10T08:40:20.251506+0000","last_became_peered":"2024-05-10T08:40:20.251506+0000","last_unstale":"2024-05-10T08:40:21.737026+0000","last_undegraded":"2024-05-10T08:40:21.737026+0000","last_fullsized":"2024-05-10T08:40:21.737026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:20.266480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736220+0000","last_change":"2024-05-10T08:40:14.718258+0000","last_active":"2024-05-10T08:40:21.736220+0000","last_peered":"2024-05-10T08:40:21.736220+0000","last_clean":"2024-05-10T08:40:21.736220+0000","last_became_active":"2024-05-10T08:40:14.717977+0000","last_became_peered":"2024-05-10T08:40:14.717977+0000","last_unstale":"2024-05-10T08:40:21.736220+0000","last_undegraded":"2024-05-10T08:40:21.736220+0000","last_fullsized":"2024-05-10T08:40:21.736220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791950+0000","last_change":"2024-05-10T08:40:15.728761+0000","last_active":"2024-05-10T08:40:21.791950+0000","last_peered":"2024-05-10T08:40:21.791950+0000","last_clean":"2024-05-10T08:40:21.791950+0000","last_became_active":"2024-05-10T08:40:15.728245+0000","last_became_peered":"2024-05-10T08:40:15.728245+0000","last_unstale":"2024-05-10T08:40:21.791950+0000","last_undegraded":"2024-05-10T08:40:21.791950+0000","last_fullsized":"2024-05-10T08:40:21.791950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:08.921084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736087+0000","last_change":"2024-05-10T08:40:19.751295+0000","last_active":"2024-05-10T08:40:21.736087+0000","last_peered":"2024-05-10T08:40:21.736087+0000","last_clean":"2024-05-10T08:40:21.736087+0000","last_became_active":"2024-05-10T08:40:19.750747+0000","last_became_peered":"2024-05-10T08:40:19.750747+0000","last_unstale":"2024-05-10T08:40:21.736087+0000","last_undegraded":"2024-05-10T08:40:21.736087+0000","last_fullsized":"2024-05-10T08:40:21.736087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:52.662846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794387+0000","last_change":"2024-05-10T08:40:14.722485+0000","last_active":"2024-05-10T08:40:21.794387+0000","last_peered":"2024-05-10T08:40:21.794387+0000","last_clean":"2024-05-10T08:40:21.794387+0000","last_became_active":"2024-05-10T08:40:14.722184+0000","last_became_peered":"2024-05-10T08:40:14.722184+0000","last_unstale":"2024-05-10T08:40:21.794387+0000","last_undegraded":"2024-05-10T08:40:21.794387+0000","last_fullsized":"2024-05-10T08:40:21.794387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:43.340926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792763+0000","last_change":"2024-05-10T08:40:15.724844+0000","last_active":"2024-05-10T08:40:21.792763+0000","last_peered":"2024-05-10T08:40:21.792763+0000","last_clean":"2024-05-10T08:40:21.792763+0000","last_became_active":"2024-05-10T08:40:15.724533+0000","last_became_peered":"2024-05-10T08:40:15.724533+0000","last_unstale":"2024-05-10T08:40:21.792763+0000","last_undegraded":"2024-05-10T08:40:21.792763+0000","last_fullsized":"2024-05-10T08:40:21.792763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737099+0000","last_change":"2024-05-10T08:40:19.753339+0000","last_active":"2024-05-10T08:40:21.737099+0000","last_peered":"2024-05-10T08:40:21.737099+0000","last_clean":"2024-05-10T08:40:21.737099+0000","last_became_active":"2024-05-10T08:40:19.751018+0000","last_became_peered":"2024-05-10T08:40:19.751018+0000","last_unstale":"2024-05-10T08:40:21.737099+0000","last_undegraded":"2024-05-10T08:40:21.737099+0000","last_fullsized":"2024-05-10T08:40:21.737099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793602+0000","last_change":"2024-05-10T08:40:14.724343+0000","last_active":"2024-05-10T08:40:21.793602+0000","last_peered":"2024-05-10T08:40:21.793602+0000","last_clean":"2024-05-10T08:40:21.793602+0000","last_became_active":"2024-05-10T08:40:14.724052+0000","last_became_peered":"2024-05-10T08:40:14.724052+0000","last_unstale":"2024-05-10T08:40:21.793602+0000","last_undegraded":"2024-05-10T08:40:21.793602+0000","last_fullsized":"2024-05-10T08:40:21.793602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793405+0000","last_change":"2024-05-10T08:40:15.726508+0000","last_active":"2024-05-10T08:40:21.793405+0000","last_peered":"2024-05-10T08:40:21.793405+0000","last_clean":"2024-05-10T08:40:21.793405+0000","last_became_active":"2024-05-10T08:40:15.723751+0000","last_became_peered":"2024-05-10T08:40:15.723751+0000","last_unstale":"2024-05-10T08:40:21.793405+0000","last_undegraded":"2024-05-10T08:40:21.793405+0000","last_fullsized":"2024-05-10T08:40:21.793405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736296+0000","last_change":"2024-05-10T08:40:19.758941+0000","last_active":"2024-05-10T08:40:21.736296+0000","last_peered":"2024-05-10T08:40:21.736296+0000","last_clean":"2024-05-10T08:40:21.736296+0000","last_became_active":"2024-05-10T08:40:19.758340+0000","last_became_peered":"2024-05-10T08:40:19.758340+0000","last_unstale":"2024-05-10T08:40:21.736296+0000","last_undegraded":"2024-05-10T08:40:21.736296+0000","last_fullsized":"2024-05-10T08:40:21.736296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793269+0000","last_change":"2024-05-10T08:40:15.716167+0000","last_active":"2024-05-10T08:40:21.793269+0000","last_peered":"2024-05-10T08:40:21.793269+0000","last_clean":"2024-05-10T08:40:21.793269+0000","last_became_active":"2024-05-10T08:40:15.715892+0000","last_became_peered":"2024-05-10T08:40:15.715892+0000","last_unstale":"2024-05-10T08:40:21.793269+0000","last_undegraded":"2024-05-10T08:40:21.793269+0000","last_fullsized":"2024-05-10T08:40:21.793269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794201+0000","last_change":"2024-05-10T08:40:14.722515+0000","last_active":"2024-05-10T08:40:21.794201+0000","last_peered":"2024-05-10T08:40:21.794201+0000","last_clean":"2024-05-10T08:40:21.794201+0000","last_became_active":"2024-05-10T08:40:14.722210+0000","last_became_peered":"2024-05-10T08:40:14.722210+0000","last_unstale":"2024-05-10T08:40:21.794201+0000","last_undegraded":"2024-05-10T08:40:21.794201+0000","last_fullsized":"2024-05-10T08:40:21.794201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736849+0000","last_change":"2024-05-10T08:40:19.758434+0000","last_active":"2024-05-10T08:40:21.736849+0000","last_peered":"2024-05-10T08:40:21.736849+0000","last_clean":"2024-05-10T08:40:21.736849+0000","last_became_active":"2024-05-10T08:40:19.758013+0000","last_became_peered":"2024-05-10T08:40:19.758013+0000","last_unstale":"2024-05-10T08:40:21.736849+0000","last_undegraded":"2024-05-10T08:40:21.736849+0000","last_fullsized":"2024-05-10T08:40:21.736849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736292+0000","last_change":"2024-05-10T08:40:15.733728+0000","last_active":"2024-05-10T08:40:21.736292+0000","last_peered":"2024-05-10T08:40:21.736292+0000","last_clean":"2024-05-10T08:40:21.736292+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.736292+0000","last_undegraded":"2024-05-10T08:40:21.736292+0000","last_fullsized":"2024-05-10T08:40:21.736292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736094+0000","last_change":"2024-05-10T08:40:14.711008+0000","last_active":"2024-05-10T08:40:21.736094+0000","last_peered":"2024-05-10T08:40:21.736094+0000","last_clean":"2024-05-10T08:40:21.736094+0000","last_became_active":"2024-05-10T08:40:14.710716+0000","last_became_peered":"2024-05-10T08:40:14.710716+0000","last_unstale":"2024-05-10T08:40:21.736094+0000","last_undegraded":"2024-05-10T08:40:21.736094+0000","last_fullsized":"2024-05-10T08:40:21.736094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736797+0000","last_change":"2024-05-10T08:40:19.753357+0000","last_active":"2024-05-10T08:40:21.736797+0000","last_peered":"2024-05-10T08:40:21.736797+0000","last_clean":"2024-05-10T08:40:21.736797+0000","last_became_active":"2024-05-10T08:40:19.752967+0000","last_became_peered":"2024-05-10T08:40:19.752967+0000","last_unstale":"2024-05-10T08:40:21.736797+0000","last_undegraded":"2024-05-10T08:40:21.736797+0000","last_fullsized":"2024-05-10T08:40:21.736797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736816+0000","last_change":"2024-05-10T08:40:15.719215+0000","last_active":"2024-05-10T08:40:21.736816+0000","last_peered":"2024-05-10T08:40:21.736816+0000","last_clean":"2024-05-10T08:40:21.736816+0000","last_became_active":"2024-05-10T08:40:15.718864+0000","last_became_peered":"2024-05-10T08:40:15.718864+0000","last_unstale":"2024-05-10T08:40:21.736816+0000","last_undegraded":"2024-05-10T08:40:21.736816+0000","last_fullsized":"2024-05-10T08:40:21.736816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735514+0000","last_change":"2024-05-10T08:40:14.719728+0000","last_active":"2024-05-10T08:40:21.735514+0000","last_peered":"2024-05-10T08:40:21.735514+0000","last_clean":"2024-05-10T08:40:21.735514+0000","last_became_active":"2024-05-10T08:40:14.719401+0000","last_became_peered":"2024-05-10T08:40:14.719401+0000","last_unstale":"2024-05-10T08:40:21.735514+0000","last_undegraded":"2024-05-10T08:40:21.735514+0000","last_fullsized":"2024-05-10T08:40:21.735514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737417+0000","last_change":"2024-05-10T08:40:20.250769+0000","last_active":"2024-05-10T08:40:21.737417+0000","last_peered":"2024-05-10T08:40:21.737417+0000","last_clean":"2024-05-10T08:40:21.737417+0000","last_became_active":"2024-05-10T08:40:20.250387+0000","last_became_peered":"2024-05-10T08:40:20.250387+0000","last_unstale":"2024-05-10T08:40:21.737417+0000","last_undegraded":"2024-05-10T08:40:21.737417+0000","last_fullsized":"2024-05-10T08:40:21.737417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736533+0000","last_change":"2024-05-10T08:40:15.719306+0000","last_active":"2024-05-10T08:40:21.736533+0000","last_peered":"2024-05-10T08:40:21.736533+0000","last_clean":"2024-05-10T08:40:21.736533+0000","last_became_active":"2024-05-10T08:40:15.718968+0000","last_became_peered":"2024-05-10T08:40:15.718968+0000","last_unstale":"2024-05-10T08:40:21.736533+0000","last_undegraded":"2024-05-10T08:40:21.736533+0000","last_fullsized":"2024-05-10T08:40:21.736533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:34.334556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792277+0000","last_change":"2024-05-10T08:40:14.723003+0000","last_active":"2024-05-10T08:40:21.792277+0000","last_peered":"2024-05-10T08:40:21.792277+0000","last_clean":"2024-05-10T08:40:21.792277+0000","last_became_active":"2024-05-10T08:40:14.722721+0000","last_became_peered":"2024-05-10T08:40:14.722721+0000","last_unstale":"2024-05-10T08:40:21.792277+0000","last_undegraded":"2024-05-10T08:40:21.792277+0000","last_fullsized":"2024-05-10T08:40:21.792277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736700+0000","last_change":"2024-05-10T08:40:19.751296+0000","last_active":"2024-05-10T08:40:21.736700+0000","last_peered":"2024-05-10T08:40:21.736700+0000","last_clean":"2024-05-10T08:40:21.736700+0000","last_became_active":"2024-05-10T08:40:19.750813+0000","last_became_peered":"2024-05-10T08:40:19.750813+0000","last_unstale":"2024-05-10T08:40:21.736700+0000","last_undegraded":"2024-05-10T08:40:21.736700+0000","last_fullsized":"2024-05-10T08:40:21.736700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:58.250654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792010+0000","last_change":"2024-05-10T08:40:15.722099+0000","last_active":"2024-05-10T08:40:21.792010+0000","last_peered":"2024-05-10T08:40:21.792010+0000","last_clean":"2024-05-10T08:40:21.792010+0000","last_became_active":"2024-05-10T08:40:15.721386+0000","last_became_peered":"2024-05-10T08:40:15.721386+0000","last_unstale":"2024-05-10T08:40:21.792010+0000","last_undegraded":"2024-05-10T08:40:21.792010+0000","last_fullsized":"2024-05-10T08:40:21.792010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:07:45.250348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794133+0000","last_change":"2024-05-10T08:40:14.721450+0000","last_active":"2024-05-10T08:40:21.794133+0000","last_peered":"2024-05-10T08:40:21.794133+0000","last_clean":"2024-05-10T08:40:21.794133+0000","last_became_active":"2024-05-10T08:40:14.721110+0000","last_became_peered":"2024-05-10T08:40:14.721110+0000","last_unstale":"2024-05-10T08:40:21.794133+0000","last_undegraded":"2024-05-10T08:40:21.794133+0000","last_fullsized":"2024-05-10T08:40:21.794133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736263+0000","last_change":"2024-05-10T08:40:20.250784+0000","last_active":"2024-05-10T08:40:21.736263+0000","last_peered":"2024-05-10T08:40:21.736263+0000","last_clean":"2024-05-10T08:40:21.736263+0000","last_became_active":"2024-05-10T08:40:20.250338+0000","last_became_peered":"2024-05-10T08:40:20.250338+0000","last_unstale":"2024-05-10T08:40:21.736263+0000","last_undegraded":"2024-05-10T08:40:21.736263+0000","last_fullsized":"2024-05-10T08:40:21.736263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:15.728115+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:15.727814+0000","last_became_peered":"2024-05-10T08:40:15.727814+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736643+0000","last_change":"2024-05-10T08:40:14.712174+0000","last_active":"2024-05-10T08:40:21.736643+0000","last_peered":"2024-05-10T08:40:21.736643+0000","last_clean":"2024-05-10T08:40:21.736643+0000","last_became_active":"2024-05-10T08:40:14.711817+0000","last_became_peered":"2024-05-10T08:40:14.711817+0000","last_unstale":"2024-05-10T08:40:21.736643+0000","last_undegraded":"2024-05-10T08:40:21.736643+0000","last_fullsized":"2024-05-10T08:40:21.736643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736599+0000","last_change":"2024-05-10T08:40:20.250340+0000","last_active":"2024-05-10T08:40:21.736599+0000","last_peered":"2024-05-10T08:40:21.736599+0000","last_clean":"2024-05-10T08:40:21.736599+0000","last_became_active":"2024-05-10T08:40:20.249928+0000","last_became_peered":"2024-05-10T08:40:20.249928+0000","last_unstale":"2024-05-10T08:40:21.736599+0000","last_undegraded":"2024-05-10T08:40:21.736599+0000","last_fullsized":"2024-05-10T08:40:21.736599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:29.943142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736966+0000","last_change":"2024-05-10T08:40:15.717354+0000","last_active":"2024-05-10T08:40:21.736966+0000","last_peered":"2024-05-10T08:40:21.736966+0000","last_clean":"2024-05-10T08:40:21.736966+0000","last_became_active":"2024-05-10T08:40:15.717033+0000","last_became_peered":"2024-05-10T08:40:15.717033+0000","last_unstale":"2024-05-10T08:40:21.736966+0000","last_undegraded":"2024-05-10T08:40:21.736966+0000","last_fullsized":"2024-05-10T08:40:21.736966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794461+0000","last_change":"2024-05-10T08:40:14.722906+0000","last_active":"2024-05-10T08:40:21.794461+0000","last_peered":"2024-05-10T08:40:21.794461+0000","last_clean":"2024-05-10T08:40:21.794461+0000","last_became_active":"2024-05-10T08:40:14.722607+0000","last_became_peered":"2024-05-10T08:40:14.722607+0000","last_unstale":"2024-05-10T08:40:21.794461+0000","last_undegraded":"2024-05-10T08:40:21.794461+0000","last_fullsized":"2024-05-10T08:40:21.794461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:38.589413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792174+0000","last_change":"2024-05-10T08:40:20.250418+0000","last_active":"2024-05-10T08:40:21.792174+0000","last_peered":"2024-05-10T08:40:21.792174+0000","last_clean":"2024-05-10T08:40:21.792174+0000","last_became_active":"2024-05-10T08:40:20.249925+0000","last_became_peered":"2024-05-10T08:40:20.249925+0000","last_unstale":"2024-05-10T08:40:21.792174+0000","last_undegraded":"2024-05-10T08:40:21.792174+0000","last_fullsized":"2024-05-10T08:40:21.792174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793510+0000","last_change":"2024-05-10T08:40:15.735822+0000","last_active":"2024-05-10T08:40:21.793510+0000","last_peered":"2024-05-10T08:40:21.793510+0000","last_clean":"2024-05-10T08:40:21.793510+0000","last_became_active":"2024-05-10T08:40:15.735525+0000","last_became_peered":"2024-05-10T08:40:15.735525+0000","last_unstale":"2024-05-10T08:40:21.793510+0000","last_undegraded":"2024-05-10T08:40:21.793510+0000","last_fullsized":"2024-05-10T08:40:21.793510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737066+0000","last_change":"2024-05-10T08:40:14.720119+0000","last_active":"2024-05-10T08:40:21.737066+0000","last_peered":"2024-05-10T08:40:21.737066+0000","last_clean":"2024-05-10T08:40:21.737066+0000","last_became_active":"2024-05-10T08:40:14.719807+0000","last_became_peered":"2024-05-10T08:40:14.719807+0000","last_unstale":"2024-05-10T08:40:21.737066+0000","last_undegraded":"2024-05-10T08:40:21.737066+0000","last_fullsized":"2024-05-10T08:40:21.737066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735653+0000","last_change":"2024-05-10T08:40:19.758680+0000","last_active":"2024-05-10T08:40:21.735653+0000","last_peered":"2024-05-10T08:40:21.735653+0000","last_clean":"2024-05-10T08:40:21.735653+0000","last_became_active":"2024-05-10T08:40:19.757930+0000","last_became_peered":"2024-05-10T08:40:19.757930+0000","last_unstale":"2024-05-10T08:40:21.735653+0000","last_undegraded":"2024-05-10T08:40:21.735653+0000","last_fullsized":"2024-05-10T08:40:21.735653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737171+0000","last_change":"2024-05-10T08:40:15.727979+0000","last_active":"2024-05-10T08:40:21.737171+0000","last_peered":"2024-05-10T08:40:21.737171+0000","last_clean":"2024-05-10T08:40:21.737171+0000","last_became_active":"2024-05-10T08:40:15.727689+0000","last_became_peered":"2024-05-10T08:40:15.727689+0000","last_unstale":"2024-05-10T08:40:21.737171+0000","last_undegraded":"2024-05-10T08:40:21.737171+0000","last_fullsized":"2024-05-10T08:40:21.737171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:00.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793318+0000","last_change":"2024-05-10T08:40:14.719368+0000","last_active":"2024-05-10T08:40:21.793318+0000","last_peered":"2024-05-10T08:40:21.793318+0000","last_clean":"2024-05-10T08:40:21.793318+0000","last_became_active":"2024-05-10T08:40:14.719067+0000","last_became_peered":"2024-05-10T08:40:14.719067+0000","last_unstale":"2024-05-10T08:40:21.793318+0000","last_undegraded":"2024-05-10T08:40:21.793318+0000","last_fullsized":"2024-05-10T08:40:21.793318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736975+0000","last_change":"2024-05-10T08:40:19.749606+0000","last_active":"2024-05-10T08:40:21.736975+0000","last_peered":"2024-05-10T08:40:21.736975+0000","last_clean":"2024-05-10T08:40:21.736975+0000","last_became_active":"2024-05-10T08:40:19.748828+0000","last_became_peered":"2024-05-10T08:40:19.748828+0000","last_unstale":"2024-05-10T08:40:21.736975+0000","last_undegraded":"2024-05-10T08:40:21.736975+0000","last_fullsized":"2024-05-10T08:40:21.736975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735649+0000","last_change":"2024-05-10T08:40:15.720054+0000","last_active":"2024-05-10T08:40:21.735649+0000","last_peered":"2024-05-10T08:40:21.735649+0000","last_clean":"2024-05-10T08:40:21.735649+0000","last_became_active":"2024-05-10T08:40:15.719769+0000","last_became_peered":"2024-05-10T08:40:15.719769+0000","last_unstale":"2024-05-10T08:40:21.735649+0000","last_undegraded":"2024-05-10T08:40:21.735649+0000","last_fullsized":"2024-05-10T08:40:21.735649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791550+0000","last_change":"2024-05-10T08:40:14.721738+0000","last_active":"2024-05-10T08:40:21.791550+0000","last_peered":"2024-05-10T08:40:21.791550+0000","last_clean":"2024-05-10T08:40:21.791550+0000","last_became_active":"2024-05-10T08:40:14.721434+0000","last_became_peered":"2024-05-10T08:40:14.721434+0000","last_unstale":"2024-05-10T08:40:21.791550+0000","last_undegraded":"2024-05-10T08:40:21.791550+0000","last_fullsized":"2024-05-10T08:40:21.791550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:19.758288+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:19.757825+0000","last_became_peered":"2024-05-10T08:40:19.757825+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791777+0000","last_change":"2024-05-10T08:40:15.722819+0000","last_active":"2024-05-10T08:40:21.791777+0000","last_peered":"2024-05-10T08:40:21.791777+0000","last_clean":"2024-05-10T08:40:21.791777+0000","last_became_active":"2024-05-10T08:40:15.722444+0000","last_became_peered":"2024-05-10T08:40:15.722444+0000","last_unstale":"2024-05-10T08:40:21.791777+0000","last_undegraded":"2024-05-10T08:40:21.791777+0000","last_fullsized":"2024-05-10T08:40:21.791777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792365+0000","last_change":"2024-05-10T08:40:14.723089+0000","last_active":"2024-05-10T08:40:21.792365+0000","last_peered":"2024-05-10T08:40:21.792365+0000","last_clean":"2024-05-10T08:40:21.792365+0000","last_became_active":"2024-05-10T08:40:14.722771+0000","last_became_peered":"2024-05-10T08:40:14.722771+0000","last_unstale":"2024-05-10T08:40:21.792365+0000","last_undegraded":"2024-05-10T08:40:21.792365+0000","last_fullsized":"2024-05-10T08:40:21.792365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792005+0000","last_change":"2024-05-10T08:40:20.250543+0000","last_active":"2024-05-10T08:40:21.792005+0000","last_peered":"2024-05-10T08:40:21.792005+0000","last_clean":"2024-05-10T08:40:21.792005+0000","last_became_active":"2024-05-10T08:40:20.249990+0000","last_became_peered":"2024-05-10T08:40:20.249990+0000","last_unstale":"2024-05-10T08:40:21.792005+0000","last_undegraded":"2024-05-10T08:40:21.792005+0000","last_fullsized":"2024-05-10T08:40:21.792005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735932+0000","last_change":"2024-05-10T08:40:15.730255+0000","last_active":"2024-05-10T08:40:21.735932+0000","last_peered":"2024-05-10T08:40:21.735932+0000","last_clean":"2024-05-10T08:40:21.735932+0000","last_became_active":"2024-05-10T08:40:15.729980+0000","last_became_peered":"2024-05-10T08:40:15.729980+0000","last_unstale":"2024-05-10T08:40:21.735932+0000","last_undegraded":"2024-05-10T08:40:21.735932+0000","last_fullsized":"2024-05-10T08:40:21.735932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792701+0000","last_change":"2024-05-10T08:40:14.715445+0000","last_active":"2024-05-10T08:40:21.792701+0000","last_peered":"2024-05-10T08:40:21.792701+0000","last_clean":"2024-05-10T08:40:21.792701+0000","last_became_active":"2024-05-10T08:40:14.715170+0000","last_became_peered":"2024-05-10T08:40:14.715170+0000","last_unstale":"2024-05-10T08:40:21.792701+0000","last_undegraded":"2024-05-10T08:40:21.792701+0000","last_fullsized":"2024-05-10T08:40:21.792701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792391+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:40:21.792391+0000","last_peered":"2024-05-10T08:40:21.792391+0000","last_clean":"2024-05-10T08:40:21.792391+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:40:21.792391+0000","last_undegraded":"2024-05-10T08:40:21.792391+0000","last_fullsized":"2024-05-10T08:40:21.792391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793767+0000","last_change":"2024-05-10T08:40:20.252336+0000","last_active":"2024-05-10T08:40:21.793767+0000","last_peered":"2024-05-10T08:40:21.793767+0000","last_clean":"2024-05-10T08:40:21.793767+0000","last_became_active":"2024-05-10T08:40:20.251817+0000","last_became_peered":"2024-05-10T08:40:20.251817+0000","last_unstale":"2024-05-10T08:40:21.793767+0000","last_undegraded":"2024-05-10T08:40:21.793767+0000","last_fullsized":"2024-05-10T08:40:21.793767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794293+0000","last_change":"2024-05-10T08:40:15.727310+0000","last_active":"2024-05-10T08:40:21.794293+0000","last_peered":"2024-05-10T08:40:21.794293+0000","last_clean":"2024-05-10T08:40:21.794293+0000","last_became_active":"2024-05-10T08:40:15.727030+0000","last_became_peered":"2024-05-10T08:40:15.727030+0000","last_unstale":"2024-05-10T08:40:21.794293+0000","last_undegraded":"2024-05-10T08:40:21.794293+0000","last_fullsized":"2024-05-10T08:40:21.794293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791837+0000","last_change":"2024-05-10T08:40:14.715295+0000","last_active":"2024-05-10T08:40:21.791837+0000","last_peered":"2024-05-10T08:40:21.791837+0000","last_clean":"2024-05-10T08:40:21.791837+0000","last_became_active":"2024-05-10T08:40:14.715006+0000","last_became_peered":"2024-05-10T08:40:14.715006+0000","last_unstale":"2024-05-10T08:40:21.791837+0000","last_undegraded":"2024-05-10T08:40:21.791837+0000","last_fullsized":"2024-05-10T08:40:21.791837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793015+0000","last_change":"2024-05-10T08:40:20.251128+0000","last_active":"2024-05-10T08:40:21.793015+0000","last_peered":"2024-05-10T08:40:21.793015+0000","last_clean":"2024-05-10T08:40:21.793015+0000","last_became_active":"2024-05-10T08:40:20.249896+0000","last_became_peered":"2024-05-10T08:40:20.249896+0000","last_unstale":"2024-05-10T08:40:21.793015+0000","last_undegraded":"2024-05-10T08:40:21.793015+0000","last_fullsized":"2024-05-10T08:40:21.793015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792798+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792798+0000","last_peered":"2024-05-10T08:40:21.792798+0000","last_clean":"2024-05-10T08:40:21.792798+0000","last_became_active":"2024-05-10T08:40:15.737918+0000","last_became_peered":"2024-05-10T08:40:15.737918+0000","last_unstale":"2024-05-10T08:40:21.792798+0000","last_undegraded":"2024-05-10T08:40:21.792798+0000","last_fullsized":"2024-05-10T08:40:21.792798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736170+0000","last_change":"2024-05-10T08:40:14.709667+0000","last_active":"2024-05-10T08:40:21.736170+0000","last_peered":"2024-05-10T08:40:21.736170+0000","last_clean":"2024-05-10T08:40:21.736170+0000","last_became_active":"2024-05-10T08:40:14.709290+0000","last_became_peered":"2024-05-10T08:40:14.709290+0000","last_unstale":"2024-05-10T08:40:21.736170+0000","last_undegraded":"2024-05-10T08:40:21.736170+0000","last_fullsized":"2024-05-10T08:40:21.736170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792343+0000","last_change":"2024-05-10T08:40:19.766100+0000","last_active":"2024-05-10T08:40:21.792343+0000","last_peered":"2024-05-10T08:40:21.792343+0000","last_clean":"2024-05-10T08:40:21.792343+0000","last_became_active":"2024-05-10T08:40:19.765485+0000","last_became_peered":"2024-05-10T08:40:19.765485+0000","last_unstale":"2024-05-10T08:40:21.792343+0000","last_undegraded":"2024-05-10T08:40:21.792343+0000","last_fullsized":"2024-05-10T08:40:21.792343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794462+0000","last_change":"2024-05-10T08:40:15.723306+0000","last_active":"2024-05-10T08:40:21.794462+0000","last_peered":"2024-05-10T08:40:21.794462+0000","last_clean":"2024-05-10T08:40:21.794462+0000","last_became_active":"2024-05-10T08:40:15.720173+0000","last_became_peered":"2024-05-10T08:40:15.720173+0000","last_unstale":"2024-05-10T08:40:21.794462+0000","last_undegraded":"2024-05-10T08:40:21.794462+0000","last_fullsized":"2024-05-10T08:40:21.794462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:36.488692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792415+0000","last_change":"2024-05-10T08:40:14.711881+0000","last_active":"2024-05-10T08:40:21.792415+0000","last_peered":"2024-05-10T08:40:21.792415+0000","last_clean":"2024-05-10T08:40:21.792415+0000","last_became_active":"2024-05-10T08:40:14.711578+0000","last_became_peered":"2024-05-10T08:40:14.711578+0000","last_unstale":"2024-05-10T08:40:21.792415+0000","last_undegraded":"2024-05-10T08:40:21.792415+0000","last_fullsized":"2024-05-10T08:40:21.792415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792212+0000","last_change":"2024-05-10T08:40:20.252617+0000","last_active":"2024-05-10T08:40:21.792212+0000","last_peered":"2024-05-10T08:40:21.792212+0000","last_clean":"2024-05-10T08:40:21.792212+0000","last_became_active":"2024-05-10T08:40:20.252213+0000","last_became_peered":"2024-05-10T08:40:20.252213+0000","last_unstale":"2024-05-10T08:40:21.792212+0000","last_undegraded":"2024-05-10T08:40:21.792212+0000","last_fullsized":"2024-05-10T08:40:21.792212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793833+0000","last_change":"2024-05-10T08:40:15.719378+0000","last_active":"2024-05-10T08:40:21.793833+0000","last_peered":"2024-05-10T08:40:21.793833+0000","last_clean":"2024-05-10T08:40:21.793833+0000","last_became_active":"2024-05-10T08:40:15.718906+0000","last_became_peered":"2024-05-10T08:40:15.718906+0000","last_unstale":"2024-05-10T08:40:21.793833+0000","last_undegraded":"2024-05-10T08:40:21.793833+0000","last_fullsized":"2024-05-10T08:40:21.793833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736956+0000","last_change":"2024-05-10T08:40:14.717865+0000","last_active":"2024-05-10T08:40:21.736956+0000","last_peered":"2024-05-10T08:40:21.736956+0000","last_clean":"2024-05-10T08:40:21.736956+0000","last_became_active":"2024-05-10T08:40:14.717601+0000","last_became_peered":"2024-05-10T08:40:14.717601+0000","last_unstale":"2024-05-10T08:40:21.736956+0000","last_undegraded":"2024-05-10T08:40:21.736956+0000","last_fullsized":"2024-05-10T08:40:21.736956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:55.833310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736067+0000","last_change":"2024-05-10T08:40:19.752756+0000","last_active":"2024-05-10T08:40:21.736067+0000","last_peered":"2024-05-10T08:40:21.736067+0000","last_clean":"2024-05-10T08:40:21.736067+0000","last_became_active":"2024-05-10T08:40:19.751028+0000","last_became_peered":"2024-05-10T08:40:19.751028+0000","last_unstale":"2024-05-10T08:40:21.736067+0000","last_undegraded":"2024-05-10T08:40:21.736067+0000","last_fullsized":"2024-05-10T08:40:21.736067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792686+0000","last_change":"2024-05-10T08:40:15.716663+0000","last_active":"2024-05-10T08:40:21.792686+0000","last_peered":"2024-05-10T08:40:21.792686+0000","last_clean":"2024-05-10T08:40:21.792686+0000","last_became_active":"2024-05-10T08:40:15.715575+0000","last_became_peered":"2024-05-10T08:40:15.715575+0000","last_unstale":"2024-05-10T08:40:21.792686+0000","last_undegraded":"2024-05-10T08:40:21.792686+0000","last_fullsized":"2024-05-10T08:40:21.792686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791328+0000","last_change":"2024-05-10T08:40:14.717681+0000","last_active":"2024-05-10T08:40:21.791328+0000","last_peered":"2024-05-10T08:40:21.791328+0000","last_clean":"2024-05-10T08:40:21.791328+0000","last_became_active":"2024-05-10T08:40:14.717306+0000","last_became_peered":"2024-05-10T08:40:14.717306+0000","last_unstale":"2024-05-10T08:40:21.791328+0000","last_undegraded":"2024-05-10T08:40:21.791328+0000","last_fullsized":"2024-05-10T08:40:21.791328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791819+0000","last_change":"2024-05-10T08:40:19.762550+0000","last_active":"2024-05-10T08:40:21.791819+0000","last_peered":"2024-05-10T08:40:21.791819+0000","last_clean":"2024-05-10T08:40:21.791819+0000","last_became_active":"2024-05-10T08:40:19.762116+0000","last_became_peered":"2024-05-10T08:40:19.762116+0000","last_unstale":"2024-05-10T08:40:21.791819+0000","last_undegraded":"2024-05-10T08:40:21.791819+0000","last_fullsized":"2024-05-10T08:40:21.791819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792755+0000","last_change":"2024-05-10T08:40:15.723458+0000","last_active":"2024-05-10T08:40:21.792755+0000","last_peered":"2024-05-10T08:40:21.792755+0000","last_clean":"2024-05-10T08:40:21.792755+0000","last_became_active":"2024-05-10T08:40:15.722820+0000","last_became_peered":"2024-05-10T08:40:15.722820+0000","last_unstale":"2024-05-10T08:40:21.792755+0000","last_undegraded":"2024-05-10T08:40:21.792755+0000","last_fullsized":"2024-05-10T08:40:21.792755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793086+0000","last_change":"2024-05-10T08:40:14.715478+0000","last_active":"2024-05-10T08:40:21.793086+0000","last_peered":"2024-05-10T08:40:21.793086+0000","last_clean":"2024-05-10T08:40:21.793086+0000","last_became_active":"2024-05-10T08:40:14.715204+0000","last_became_peered":"2024-05-10T08:40:14.715204+0000","last_unstale":"2024-05-10T08:40:21.793086+0000","last_undegraded":"2024-05-10T08:40:21.793086+0000","last_fullsized":"2024-05-10T08:40:21.793086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737185+0000","last_change":"2024-05-10T08:40:20.251710+0000","last_active":"2024-05-10T08:40:21.737185+0000","last_peered":"2024-05-10T08:40:21.737185+0000","last_clean":"2024-05-10T08:40:21.737185+0000","last_became_active":"2024-05-10T08:40:20.251322+0000","last_became_peered":"2024-05-10T08:40:20.251322+0000","last_unstale":"2024-05-10T08:40:21.737185+0000","last_undegraded":"2024-05-10T08:40:21.737185+0000","last_fullsized":"2024-05-10T08:40:21.737185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:52.128436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794087+0000","last_change":"2024-05-10T08:40:15.719208+0000","last_active":"2024-05-10T08:40:21.794087+0000","last_peered":"2024-05-10T08:40:21.794087+0000","last_clean":"2024-05-10T08:40:21.794087+0000","last_became_active":"2024-05-10T08:40:15.718750+0000","last_became_peered":"2024-05-10T08:40:15.718750+0000","last_unstale":"2024-05-10T08:40:21.794087+0000","last_undegraded":"2024-05-10T08:40:21.794087+0000","last_fullsized":"2024-05-10T08:40:21.794087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793271+0000","last_change":"2024-05-10T08:40:14.721820+0000","last_active":"2024-05-10T08:40:21.793271+0000","last_peered":"2024-05-10T08:40:21.793271+0000","last_clean":"2024-05-10T08:40:21.793271+0000","last_became_active":"2024-05-10T08:40:14.721098+0000","last_became_peered":"2024-05-10T08:40:14.721098+0000","last_unstale":"2024-05-10T08:40:21.793271+0000","last_undegraded":"2024-05-10T08:40:21.793271+0000","last_fullsized":"2024-05-10T08:40:21.793271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736113+0000","last_change":"2024-05-10T08:40:20.250336+0000","last_active":"2024-05-10T08:40:21.736113+0000","last_peered":"2024-05-10T08:40:21.736113+0000","last_clean":"2024-05-10T08:40:21.736113+0000","last_became_active":"2024-05-10T08:40:20.249910+0000","last_became_peered":"2024-05-10T08:40:20.249910+0000","last_unstale":"2024-05-10T08:40:21.736113+0000","last_undegraded":"2024-05-10T08:40:21.736113+0000","last_fullsized":"2024-05-10T08:40:21.736113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:58.918102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792248+0000","last_change":"2024-05-10T08:40:15.730912+0000","last_active":"2024-05-10T08:40:21.792248+0000","last_peered":"2024-05-10T08:40:21.792248+0000","last_clean":"2024-05-10T08:40:21.792248+0000","last_became_active":"2024-05-10T08:40:15.730664+0000","last_became_peered":"2024-05-10T08:40:15.730664+0000","last_unstale":"2024-05-10T08:40:21.792248+0000","last_undegraded":"2024-05-10T08:40:21.792248+0000","last_fullsized":"2024-05-10T08:40:21.792248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792437+0000","last_change":"2024-05-10T08:40:14.719958+0000","last_active":"2024-05-10T08:40:21.792437+0000","last_peered":"2024-05-10T08:40:21.792437+0000","last_clean":"2024-05-10T08:40:21.792437+0000","last_became_active":"2024-05-10T08:40:14.719527+0000","last_became_peered":"2024-05-10T08:40:14.719527+0000","last_unstale":"2024-05-10T08:40:21.792437+0000","last_undegraded":"2024-05-10T08:40:21.792437+0000","last_fullsized":"2024-05-10T08:40:21.792437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:39.671884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793250+0000","last_change":"2024-05-10T08:40:20.250393+0000","last_active":"2024-05-10T08:40:21.793250+0000","last_peered":"2024-05-10T08:40:21.793250+0000","last_clean":"2024-05-10T08:40:21.793250+0000","last_became_active":"2024-05-10T08:40:20.249931+0000","last_became_peered":"2024-05-10T08:40:20.249931+0000","last_unstale":"2024-05-10T08:40:21.793250+0000","last_undegraded":"2024-05-10T08:40:21.793250+0000","last_fullsized":"2024-05-10T08:40:21.793250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794216+0000","last_change":"2024-05-10T08:40:15.723825+0000","last_active":"2024-05-10T08:40:21.794216+0000","last_peered":"2024-05-10T08:40:21.794216+0000","last_clean":"2024-05-10T08:40:21.794216+0000","last_became_active":"2024-05-10T08:40:15.723549+0000","last_became_peered":"2024-05-10T08:40:15.723549+0000","last_unstale":"2024-05-10T08:40:21.794216+0000","last_undegraded":"2024-05-10T08:40:21.794216+0000","last_fullsized":"2024-05-10T08:40:21.794216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793747+0000","last_change":"2024-05-10T08:40:14.721803+0000","last_active":"2024-05-10T08:40:21.793747+0000","last_peered":"2024-05-10T08:40:21.793747+0000","last_clean":"2024-05-10T08:40:21.793747+0000","last_became_active":"2024-05-10T08:40:14.721510+0000","last_became_peered":"2024-05-10T08:40:14.721510+0000","last_unstale":"2024-05-10T08:40:21.793747+0000","last_undegraded":"2024-05-10T08:40:21.793747+0000","last_fullsized":"2024-05-10T08:40:21.793747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2061,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735875+0000","last_change":"2024-05-10T08:40:19.758340+0000","last_active":"2024-05-10T08:40:21.735875+0000","last_peered":"2024-05-10T08:40:21.735875+0000","last_clean":"2024-05-10T08:40:21.735875+0000","last_became_active":"2024-05-10T08:40:19.757420+0000","last_became_peered":"2024-05-10T08:40:19.757420+0000","last_unstale":"2024-05-10T08:40:21.735875+0000","last_undegraded":"2024-05-10T08:40:21.735875+0000","last_fullsized":"2024-05-10T08:40:21.735875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736978+0000","last_change":"2024-05-10T08:40:15.722046+0000","last_active":"2024-05-10T08:40:21.736978+0000","last_peered":"2024-05-10T08:40:21.736978+0000","last_clean":"2024-05-10T08:40:21.736978+0000","last_became_active":"2024-05-10T08:40:15.721780+0000","last_became_peered":"2024-05-10T08:40:15.721780+0000","last_unstale":"2024-05-10T08:40:21.736978+0000","last_undegraded":"2024-05-10T08:40:21.736978+0000","last_fullsized":"2024-05-10T08:40:21.736978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736056+0000","last_change":"2024-05-10T08:40:14.715667+0000","last_active":"2024-05-10T08:40:21.736056+0000","last_peered":"2024-05-10T08:40:21.736056+0000","last_clean":"2024-05-10T08:40:21.736056+0000","last_became_active":"2024-05-10T08:40:14.715389+0000","last_became_peered":"2024-05-10T08:40:14.715389+0000","last_unstale":"2024-05-10T08:40:21.736056+0000","last_undegraded":"2024-05-10T08:40:21.736056+0000","last_fullsized":"2024-05-10T08:40:21.736056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736950+0000","last_change":"2024-05-10T08:40:19.752944+0000","last_active":"2024-05-10T08:40:21.736950+0000","last_peered":"2024-05-10T08:40:21.736950+0000","last_clean":"2024-05-10T08:40:21.736950+0000","last_became_active":"2024-05-10T08:40:19.750307+0000","last_became_peered":"2024-05-10T08:40:19.750307+0000","last_unstale":"2024-05-10T08:40:21.736950+0000","last_undegraded":"2024-05-10T08:40:21.736950+0000","last_fullsized":"2024-05-10T08:40:21.736950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792136+0000","last_change":"2024-05-10T08:40:15.728526+0000","last_active":"2024-05-10T08:40:21.792136+0000","last_peered":"2024-05-10T08:40:21.792136+0000","last_clean":"2024-05-10T08:40:21.792136+0000","last_became_active":"2024-05-10T08:40:15.727954+0000","last_became_peered":"2024-05-10T08:40:15.727954+0000","last_unstale":"2024-05-10T08:40:21.792136+0000","last_undegraded":"2024-05-10T08:40:21.792136+0000","last_fullsized":"2024-05-10T08:40:21.792136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793153+0000","last_change":"2024-05-10T08:40:14.713649+0000","last_active":"2024-05-10T08:40:21.793153+0000","last_peered":"2024-05-10T08:40:21.793153+0000","last_clean":"2024-05-10T08:40:21.793153+0000","last_became_active":"2024-05-10T08:40:14.713343+0000","last_became_peered":"2024-05-10T08:40:14.713343+0000","last_unstale":"2024-05-10T08:40:21.793153+0000","last_undegraded":"2024-05-10T08:40:21.793153+0000","last_fullsized":"2024-05-10T08:40:21.793153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736758+0000","last_change":"2024-05-10T08:40:19.759670+0000","last_active":"2024-05-10T08:40:21.736758+0000","last_peered":"2024-05-10T08:40:21.736758+0000","last_clean":"2024-05-10T08:40:21.736758+0000","last_became_active":"2024-05-10T08:40:19.756600+0000","last_became_peered":"2024-05-10T08:40:19.756600+0000","last_unstale":"2024-05-10T08:40:21.736758+0000","last_undegraded":"2024-05-10T08:40:21.736758+0000","last_fullsized":"2024-05-10T08:40:21.736758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.094481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793080+0000","last_change":"2024-05-10T08:40:15.721196+0000","last_active":"2024-05-10T08:40:21.793080+0000","last_peered":"2024-05-10T08:40:21.793080+0000","last_clean":"2024-05-10T08:40:21.793080+0000","last_became_active":"2024-05-10T08:40:15.720932+0000","last_became_peered":"2024-05-10T08:40:15.720932+0000","last_unstale":"2024-05-10T08:40:21.793080+0000","last_undegraded":"2024-05-10T08:40:21.793080+0000","last_fullsized":"2024-05-10T08:40:21.793080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794024+0000","last_change":"2024-05-10T08:40:14.717072+0000","last_active":"2024-05-10T08:40:21.794024+0000","last_peered":"2024-05-10T08:40:21.794024+0000","last_clean":"2024-05-10T08:40:21.794024+0000","last_became_active":"2024-05-10T08:40:14.716685+0000","last_became_peered":"2024-05-10T08:40:14.716685+0000","last_unstale":"2024-05-10T08:40:21.794024+0000","last_undegraded":"2024-05-10T08:40:21.794024+0000","last_fullsized":"2024-05-10T08:40:21.794024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737170+0000","last_change":"2024-05-10T08:40:20.251795+0000","last_active":"2024-05-10T08:40:21.737170+0000","last_peered":"2024-05-10T08:40:21.737170+0000","last_clean":"2024-05-10T08:40:21.737170+0000","last_became_active":"2024-05-10T08:40:20.251422+0000","last_became_peered":"2024-05-10T08:40:20.251422+0000","last_unstale":"2024-05-10T08:40:21.737170+0000","last_undegraded":"2024-05-10T08:40:21.737170+0000","last_fullsized":"2024-05-10T08:40:21.737170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:58.035145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791821+0000","last_change":"2024-05-10T08:40:20.251855+0000","last_active":"2024-05-10T08:40:21.791821+0000","last_peered":"2024-05-10T08:40:21.791821+0000","last_clean":"2024-05-10T08:40:21.791821+0000","last_became_active":"2024-05-10T08:40:20.251483+0000","last_became_peered":"2024-05-10T08:40:20.251483+0000","last_unstale":"2024-05-10T08:40:21.791821+0000","last_undegraded":"2024-05-10T08:40:21.791821+0000","last_fullsized":"2024-05-10T08:40:21.791821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735406+0000","last_change":"2024-05-10T08:40:15.733791+0000","last_active":"2024-05-10T08:40:21.735406+0000","last_peered":"2024-05-10T08:40:21.735406+0000","last_clean":"2024-05-10T08:40:21.735406+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.735406+0000","last_undegraded":"2024-05-10T08:40:21.735406+0000","last_fullsized":"2024-05-10T08:40:21.735406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792355+0000","last_change":"2024-05-10T08:40:14.713288+0000","last_active":"2024-05-10T08:40:21.792355+0000","last_peered":"2024-05-10T08:40:21.792355+0000","last_clean":"2024-05-10T08:40:21.792355+0000","last_became_active":"2024-05-10T08:40:14.713009+0000","last_became_peered":"2024-05-10T08:40:14.713009+0000","last_unstale":"2024-05-10T08:40:21.792355+0000","last_undegraded":"2024-05-10T08:40:21.792355+0000","last_fullsized":"2024-05-10T08:40:21.792355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793990+0000","last_change":"2024-05-10T08:40:19.758631+0000","last_active":"2024-05-10T08:40:21.793990+0000","last_peered":"2024-05-10T08:40:21.793990+0000","last_clean":"2024-05-10T08:40:21.793990+0000","last_became_active":"2024-05-10T08:40:19.758133+0000","last_became_peered":"2024-05-10T08:40:19.758133+0000","last_unstale":"2024-05-10T08:40:21.793990+0000","last_undegraded":"2024-05-10T08:40:21.793990+0000","last_fullsized":"2024-05-10T08:40:21.793990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736724+0000","last_change":"2024-05-10T08:40:15.733269+0000","last_active":"2024-05-10T08:40:21.736724+0000","last_peered":"2024-05-10T08:40:21.736724+0000","last_clean":"2024-05-10T08:40:21.736724+0000","last_became_active":"2024-05-10T08:40:15.732928+0000","last_became_peered":"2024-05-10T08:40:15.732928+0000","last_unstale":"2024-05-10T08:40:21.736724+0000","last_undegraded":"2024-05-10T08:40:21.736724+0000","last_fullsized":"2024-05-10T08:40:21.736724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737390+0000","last_change":"2024-05-10T08:40:14.716035+0000","last_active":"2024-05-10T08:40:21.737390+0000","last_peered":"2024-05-10T08:40:21.737390+0000","last_clean":"2024-05-10T08:40:21.737390+0000","last_became_active":"2024-05-10T08:40:14.715525+0000","last_became_peered":"2024-05-10T08:40:14.715525+0000","last_unstale":"2024-05-10T08:40:21.737390+0000","last_undegraded":"2024-05-10T08:40:21.737390+0000","last_fullsized":"2024-05-10T08:40:21.737390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793415+0000","last_change":"2024-05-10T08:40:14.716190+0000","last_active":"2024-05-10T08:40:21.793415+0000","last_peered":"2024-05-10T08:40:21.793415+0000","last_clean":"2024-05-10T08:40:21.793415+0000","last_became_active":"2024-05-10T08:40:14.715910+0000","last_became_peered":"2024-05-10T08:40:14.715910+0000","last_unstale":"2024-05-10T08:40:21.793415+0000","last_undegraded":"2024-05-10T08:40:21.793415+0000","last_fullsized":"2024-05-10T08:40:21.793415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792400+0000","last_change":"2024-05-10T08:40:15.721466+0000","last_active":"2024-05-10T08:40:21.792400+0000","last_peered":"2024-05-10T08:40:21.792400+0000","last_clean":"2024-05-10T08:40:21.792400+0000","last_became_active":"2024-05-10T08:40:15.721200+0000","last_became_peered":"2024-05-10T08:40:15.721200+0000","last_unstale":"2024-05-10T08:40:21.792400+0000","last_undegraded":"2024-05-10T08:40:21.792400+0000","last_fullsized":"2024-05-10T08:40:21.792400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791730+0000","last_change":"2024-05-10T08:40:19.755853+0000","last_active":"2024-05-10T08:40:21.791730+0000","last_peered":"2024-05-10T08:40:21.791730+0000","last_clean":"2024-05-10T08:40:21.791730+0000","last_became_active":"2024-05-10T08:40:19.755406+0000","last_became_peered":"2024-05-10T08:40:19.755406+0000","last_unstale":"2024-05-10T08:40:21.791730+0000","last_undegraded":"2024-05-10T08:40:21.791730+0000","last_fullsized":"2024-05-10T08:40:21.791730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:12.946445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736391+0000","last_change":"2024-05-10T08:40:14.720438+0000","last_active":"2024-05-10T08:40:21.736391+0000","last_peered":"2024-05-10T08:40:21.736391+0000","last_clean":"2024-05-10T08:40:21.736391+0000","last_became_active":"2024-05-10T08:40:14.720127+0000","last_became_peered":"2024-05-10T08:40:14.720127+0000","last_unstale":"2024-05-10T08:40:21.736391+0000","last_undegraded":"2024-05-10T08:40:21.736391+0000","last_fullsized":"2024-05-10T08:40:21.736391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736427+0000","last_change":"2024-05-10T08:40:15.707932+0000","last_active":"2024-05-10T08:40:21.736427+0000","last_peered":"2024-05-10T08:40:21.736427+0000","last_clean":"2024-05-10T08:40:21.736427+0000","last_became_active":"2024-05-10T08:40:15.707646+0000","last_became_peered":"2024-05-10T08:40:15.707646+0000","last_unstale":"2024-05-10T08:40:21.736427+0000","last_undegraded":"2024-05-10T08:40:21.736427+0000","last_fullsized":"2024-05-10T08:40:21.736427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:56.956134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736748+0000","last_change":"2024-05-10T08:40:19.751262+0000","last_active":"2024-05-10T08:40:21.736748+0000","last_peered":"2024-05-10T08:40:21.736748+0000","last_clean":"2024-05-10T08:40:21.736748+0000","last_became_active":"2024-05-10T08:40:19.750835+0000","last_became_peered":"2024-05-10T08:40:19.750835+0000","last_unstale":"2024-05-10T08:40:21.736748+0000","last_undegraded":"2024-05-10T08:40:21.736748+0000","last_fullsized":"2024-05-10T08:40:21.736748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:37.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792880+0000","last_change":"2024-05-10T08:40:15.726263+0000","last_active":"2024-05-10T08:40:21.792880+0000","last_peered":"2024-05-10T08:40:21.792880+0000","last_clean":"2024-05-10T08:40:21.792880+0000","last_became_active":"2024-05-10T08:40:15.725796+0000","last_became_peered":"2024-05-10T08:40:15.725796+0000","last_unstale":"2024-05-10T08:40:21.792880+0000","last_undegraded":"2024-05-10T08:40:21.792880+0000","last_fullsized":"2024-05-10T08:40:21.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791487+0000","last_change":"2024-05-10T08:40:15.722103+0000","last_active":"2024-05-10T08:40:21.791487+0000","last_peered":"2024-05-10T08:40:21.791487+0000","last_clean":"2024-05-10T08:40:21.791487+0000","last_became_active":"2024-05-10T08:40:15.721824+0000","last_became_peered":"2024-05-10T08:40:15.721824+0000","last_unstale":"2024-05-10T08:40:21.791487+0000","last_undegraded":"2024-05-10T08:40:21.791487+0000","last_fullsized":"2024-05-10T08:40:21.791487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793168+0000","last_change":"2024-05-10T08:40:15.730264+0000","last_active":"2024-05-10T08:40:21.793168+0000","last_peered":"2024-05-10T08:40:21.793168+0000","last_clean":"2024-05-10T08:40:21.793168+0000","last_became_active":"2024-05-10T08:40:15.729988+0000","last_became_peered":"2024-05-10T08:40:15.729988+0000","last_unstale":"2024-05-10T08:40:21.793168+0000","last_undegraded":"2024-05-10T08:40:21.793168+0000","last_fullsized":"2024-05-10T08:40:21.793168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792351+0000","last_change":"2024-05-10T08:40:15.722004+0000","last_active":"2024-05-10T08:40:21.792351+0000","last_peered":"2024-05-10T08:40:21.792351+0000","last_clean":"2024-05-10T08:40:21.792351+0000","last_became_active":"2024-05-10T08:40:15.721735+0000","last_became_peered":"2024-05-10T08:40:15.721735+0000","last_unstale":"2024-05-10T08:40:21.792351+0000","last_undegraded":"2024-05-10T08:40:21.792351+0000","last_fullsized":"2024-05-10T08:40:21.792351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736384+0000","last_change":"2024-05-10T08:40:15.733681+0000","last_active":"2024-05-10T08:40:21.736384+0000","last_peered":"2024-05-10T08:40:21.736384+0000","last_clean":"2024-05-10T08:40:21.736384+0000","last_became_active":"2024-05-10T08:40:15.730232+0000","last_became_peered":"2024-05-10T08:40:15.730232+0000","last_unstale":"2024-05-10T08:40:21.736384+0000","last_undegraded":"2024-05-10T08:40:21.736384+0000","last_fullsized":"2024-05-10T08:40:21.736384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735862+0000","last_change":"2024-05-10T08:40:15.721502+0000","last_active":"2024-05-10T08:40:21.735862+0000","last_peered":"2024-05-10T08:40:21.735862+0000","last_clean":"2024-05-10T08:40:21.735862+0000","last_became_active":"2024-05-10T08:40:15.721196+0000","last_became_peered":"2024-05-10T08:40:15.721196+0000","last_unstale":"2024-05-10T08:40:21.735862+0000","last_undegraded":"2024-05-10T08:40:21.735862+0000","last_fullsized":"2024-05-10T08:40:21.735862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794000+0000","last_change":"2024-05-10T08:40:15.719934+0000","last_active":"2024-05-10T08:40:21.794000+0000","last_peered":"2024-05-10T08:40:21.794000+0000","last_clean":"2024-05-10T08:40:21.794000+0000","last_became_active":"2024-05-10T08:40:15.719673+0000","last_became_peered":"2024-05-10T08:40:15.719673+0000","last_unstale":"2024-05-10T08:40:21.794000+0000","last_undegraded":"2024-05-10T08:40:21.794000+0000","last_fullsized":"2024-05-10T08:40:21.794000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737224+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.737224+0000","last_peered":"2024-05-10T08:40:21.737224+0000","last_clean":"2024-05-10T08:40:21.737224+0000","last_became_active":"2024-05-10T08:40:15.726438+0000","last_became_peered":"2024-05-10T08:40:15.726438+0000","last_unstale":"2024-05-10T08:40:21.737224+0000","last_undegraded":"2024-05-10T08:40:21.737224+0000","last_fullsized":"2024-05-10T08:40:21.737224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792352+0000","last_change":"2024-05-10T08:40:15.730586+0000","last_active":"2024-05-10T08:40:21.792352+0000","last_peered":"2024-05-10T08:40:21.792352+0000","last_clean":"2024-05-10T08:40:21.792352+0000","last_became_active":"2024-05-10T08:40:15.730214+0000","last_became_peered":"2024-05-10T08:40:15.730214+0000","last_unstale":"2024-05-10T08:40:21.792352+0000","last_undegraded":"2024-05-10T08:40:21.792352+0000","last_fullsized":"2024-05-10T08:40:21.792352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737367+0000","last_change":"2024-05-10T08:40:15.729639+0000","last_active":"2024-05-10T08:40:21.737367+0000","last_peered":"2024-05-10T08:40:21.737367+0000","last_clean":"2024-05-10T08:40:21.737367+0000","last_became_active":"2024-05-10T08:40:15.722616+0000","last_became_peered":"2024-05-10T08:40:15.722616+0000","last_unstale":"2024-05-10T08:40:21.737367+0000","last_undegraded":"2024-05-10T08:40:21.737367+0000","last_fullsized":"2024-05-10T08:40:21.737367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793084+0000","last_change":"2024-05-10T08:40:15.730859+0000","last_active":"2024-05-10T08:40:21.793084+0000","last_peered":"2024-05-10T08:40:21.793084+0000","last_clean":"2024-05-10T08:40:21.793084+0000","last_became_active":"2024-05-10T08:40:15.730568+0000","last_became_peered":"2024-05-10T08:40:15.730568+0000","last_unstale":"2024-05-10T08:40:21.793084+0000","last_undegraded":"2024-05-10T08:40:21.793084+0000","last_fullsized":"2024-05-10T08:40:21.793084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792243+0000","last_change":"2024-05-10T08:40:15.732254+0000","last_active":"2024-05-10T08:40:21.792243+0000","last_peered":"2024-05-10T08:40:21.792243+0000","last_clean":"2024-05-10T08:40:21.792243+0000","last_became_active":"2024-05-10T08:40:15.731908+0000","last_became_peered":"2024-05-10T08:40:15.731908+0000","last_unstale":"2024-05-10T08:40:21.792243+0000","last_undegraded":"2024-05-10T08:40:21.792243+0000","last_fullsized":"2024-05-10T08:40:21.792243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793673+0000","last_change":"2024-05-10T08:40:15.719640+0000","last_active":"2024-05-10T08:40:21.793673+0000","last_peered":"2024-05-10T08:40:21.793673+0000","last_clean":"2024-05-10T08:40:21.793673+0000","last_became_active":"2024-05-10T08:40:15.719365+0000","last_became_peered":"2024-05-10T08:40:15.719365+0000","last_unstale":"2024-05-10T08:40:21.793673+0000","last_undegraded":"2024-05-10T08:40:21.793673+0000","last_fullsized":"2024-05-10T08:40:21.793673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794444+0000","last_change":"2024-05-10T08:40:15.720838+0000","last_active":"2024-05-10T08:40:21.794444+0000","last_peered":"2024-05-10T08:40:21.794444+0000","last_clean":"2024-05-10T08:40:21.794444+0000","last_became_active":"2024-05-10T08:40:15.720001+0000","last_became_peered":"2024-05-10T08:40:15.720001+0000","last_unstale":"2024-05-10T08:40:21.794444+0000","last_undegraded":"2024-05-10T08:40:21.794444+0000","last_fullsized":"2024-05-10T08:40:21.794444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:33.337354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792361+0000","last_change":"2024-05-10T08:40:15.718557+0000","last_active":"2024-05-10T08:40:21.792361+0000","last_peered":"2024-05-10T08:40:21.792361+0000","last_clean":"2024-05-10T08:40:21.792361+0000","last_became_active":"2024-05-10T08:40:15.718245+0000","last_became_peered":"2024-05-10T08:40:15.718245+0000","last_unstale":"2024-05-10T08:40:21.792361+0000","last_undegraded":"2024-05-10T08:40:21.792361+0000","last_fullsized":"2024-05-10T08:40:21.792361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:58.260494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793531+0000","last_change":"2024-05-10T08:40:15.731367+0000","last_active":"2024-05-10T08:40:21.793531+0000","last_peered":"2024-05-10T08:40:21.793531+0000","last_clean":"2024-05-10T08:40:21.793531+0000","last_became_active":"2024-05-10T08:40:15.731074+0000","last_became_peered":"2024-05-10T08:40:15.731074+0000","last_unstale":"2024-05-10T08:40:21.793531+0000","last_undegraded":"2024-05-10T08:40:21.793531+0000","last_fullsized":"2024-05-10T08:40:21.793531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792246+0000","last_change":"2024-05-10T08:40:15.732380+0000","last_active":"2024-05-10T08:40:21.792246+0000","last_peered":"2024-05-10T08:40:21.792246+0000","last_clean":"2024-05-10T08:40:21.792246+0000","last_became_active":"2024-05-10T08:40:15.732090+0000","last_became_peered":"2024-05-10T08:40:15.732090+0000","last_unstale":"2024-05-10T08:40:21.792246+0000","last_undegraded":"2024-05-10T08:40:21.792246+0000","last_fullsized":"2024-05-10T08:40:21.792246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735458+0000","last_change":"2024-05-10T08:40:15.710587+0000","last_active":"2024-05-10T08:40:21.735458+0000","last_peered":"2024-05-10T08:40:21.735458+0000","last_clean":"2024-05-10T08:40:21.735458+0000","last_became_active":"2024-05-10T08:40:15.710276+0000","last_became_peered":"2024-05-10T08:40:15.710276+0000","last_unstale":"2024-05-10T08:40:21.735458+0000","last_undegraded":"2024-05-10T08:40:21.735458+0000","last_fullsized":"2024-05-10T08:40:21.735458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792150+0000","last_change":"2024-05-10T08:40:15.725581+0000","last_active":"2024-05-10T08:40:21.792150+0000","last_peered":"2024-05-10T08:40:21.792150+0000","last_clean":"2024-05-10T08:40:21.792150+0000","last_became_active":"2024-05-10T08:40:15.725302+0000","last_became_peered":"2024-05-10T08:40:15.725302+0000","last_unstale":"2024-05-10T08:40:21.792150+0000","last_undegraded":"2024-05-10T08:40:21.792150+0000","last_fullsized":"2024-05-10T08:40:21.792150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736194+0000","last_change":"2024-05-10T08:40:15.719950+0000","last_active":"2024-05-10T08:40:21.736194+0000","last_peered":"2024-05-10T08:40:21.736194+0000","last_clean":"2024-05-10T08:40:21.736194+0000","last_became_active":"2024-05-10T08:40:15.719681+0000","last_became_peered":"2024-05-10T08:40:15.719681+0000","last_unstale":"2024-05-10T08:40:21.736194+0000","last_undegraded":"2024-05-10T08:40:21.736194+0000","last_fullsized":"2024-05-10T08:40:21.736194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736919+0000","last_change":"2024-05-10T08:40:15.716857+0000","last_active":"2024-05-10T08:40:21.736919+0000","last_peered":"2024-05-10T08:40:21.736919+0000","last_clean":"2024-05-10T08:40:21.736919+0000","last_became_active":"2024-05-10T08:40:15.716582+0000","last_became_peered":"2024-05-10T08:40:15.716582+0000","last_unstale":"2024-05-10T08:40:21.736919+0000","last_undegraded":"2024-05-10T08:40:21.736919+0000","last_fullsized":"2024-05-10T08:40:21.736919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:27.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793884+0000","last_change":"2024-05-10T08:40:15.728928+0000","last_active":"2024-05-10T08:40:21.793884+0000","last_peered":"2024-05-10T08:40:21.793884+0000","last_clean":"2024-05-10T08:40:21.793884+0000","last_became_active":"2024-05-10T08:40:15.728156+0000","last_became_peered":"2024-05-10T08:40:15.728156+0000","last_unstale":"2024-05-10T08:40:21.793884+0000","last_undegraded":"2024-05-10T08:40:21.793884+0000","last_fullsized":"2024-05-10T08:40:21.793884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793898+0000","last_change":"2024-05-10T08:40:15.722176+0000","last_active":"2024-05-10T08:40:21.793898+0000","last_peered":"2024-05-10T08:40:21.793898+0000","last_clean":"2024-05-10T08:40:21.793898+0000","last_became_active":"2024-05-10T08:40:15.721908+0000","last_became_peered":"2024-05-10T08:40:15.721908+0000","last_unstale":"2024-05-10T08:40:21.793898+0000","last_undegraded":"2024-05-10T08:40:21.793898+0000","last_fullsized":"2024-05-10T08:40:21.793898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794390+0000","last_change":"2024-05-10T08:40:15.725446+0000","last_active":"2024-05-10T08:40:21.794390+0000","last_peered":"2024-05-10T08:40:21.794390+0000","last_clean":"2024-05-10T08:40:21.794390+0000","last_became_active":"2024-05-10T08:40:15.725178+0000","last_became_peered":"2024-05-10T08:40:15.725178+0000","last_unstale":"2024-05-10T08:40:21.794390+0000","last_undegraded":"2024-05-10T08:40:21.794390+0000","last_fullsized":"2024-05-10T08:40:21.794390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:54.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736627+0000","last_change":"2024-05-10T08:40:15.730664+0000","last_active":"2024-05-10T08:40:21.736627+0000","last_peered":"2024-05-10T08:40:21.736627+0000","last_clean":"2024-05-10T08:40:21.736627+0000","last_became_active":"2024-05-10T08:40:15.729235+0000","last_became_peered":"2024-05-10T08:40:15.729235+0000","last_unstale":"2024-05-10T08:40:21.736627+0000","last_undegraded":"2024-05-10T08:40:21.736627+0000","last_fullsized":"2024-05-10T08:40:21.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792606+0000","last_change":"2024-05-10T08:40:15.727662+0000","last_active":"2024-05-10T08:40:21.792606+0000","last_peered":"2024-05-10T08:40:21.792606+0000","last_clean":"2024-05-10T08:40:21.792606+0000","last_became_active":"2024-05-10T08:40:15.727391+0000","last_became_peered":"2024-05-10T08:40:15.727391+0000","last_unstale":"2024-05-10T08:40:21.792606+0000","last_undegraded":"2024-05-10T08:40:21.792606+0000","last_fullsized":"2024-05-10T08:40:21.792606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793064+0000","last_change":"2024-05-10T08:40:15.726033+0000","last_active":"2024-05-10T08:40:21.793064+0000","last_peered":"2024-05-10T08:40:21.793064+0000","last_clean":"2024-05-10T08:40:21.793064+0000","last_became_active":"2024-05-10T08:40:15.725410+0000","last_became_peered":"2024-05-10T08:40:15.725410+0000","last_unstale":"2024-05-10T08:40:21.793064+0000","last_undegraded":"2024-05-10T08:40:21.793064+0000","last_fullsized":"2024-05-10T08:40:21.793064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793970+0000","last_change":"2024-05-10T08:40:15.721088+0000","last_active":"2024-05-10T08:40:21.793970+0000","last_peered":"2024-05-10T08:40:21.793970+0000","last_clean":"2024-05-10T08:40:21.793970+0000","last_became_active":"2024-05-10T08:40:15.720831+0000","last_became_peered":"2024-05-10T08:40:15.720831+0000","last_unstale":"2024-05-10T08:40:21.793970+0000","last_undegraded":"2024-05-10T08:40:21.793970+0000","last_fullsized":"2024-05-10T08:40:21.793970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792673+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792673+0000","last_peered":"2024-05-10T08:40:21.792673+0000","last_clean":"2024-05-10T08:40:21.792673+0000","last_became_active":"2024-05-10T08:40:15.737931+0000","last_became_peered":"2024-05-10T08:40:15.737931+0000","last_unstale":"2024-05-10T08:40:21.792673+0000","last_undegraded":"2024-05-10T08:40:21.792673+0000","last_fullsized":"2024-05-10T08:40:21.792673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791744+0000","last_change":"2024-05-10T08:40:15.723463+0000","last_active":"2024-05-10T08:40:21.791744+0000","last_peered":"2024-05-10T08:40:21.791744+0000","last_clean":"2024-05-10T08:40:21.791744+0000","last_became_active":"2024-05-10T08:40:15.723178+0000","last_became_peered":"2024-05-10T08:40:15.723178+0000","last_unstale":"2024-05-10T08:40:21.791744+0000","last_undegraded":"2024-05-10T08:40:21.791744+0000","last_fullsized":"2024-05-10T08:40:21.791744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736554+0000","last_change":"2024-05-10T08:40:15.724998+0000","last_active":"2024-05-10T08:40:21.736554+0000","last_peered":"2024-05-10T08:40:21.736554+0000","last_clean":"2024-05-10T08:40:21.736554+0000","last_became_active":"2024-05-10T08:40:15.724639+0000","last_became_peered":"2024-05-10T08:40:15.724639+0000","last_unstale":"2024-05-10T08:40:21.736554+0000","last_undegraded":"2024-05-10T08:40:21.736554+0000","last_fullsized":"2024-05-10T08:40:21.736554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794309+0000","last_change":"2024-05-10T08:40:15.723566+0000","last_active":"2024-05-10T08:40:21.794309+0000","last_peered":"2024-05-10T08:40:21.794309+0000","last_clean":"2024-05-10T08:40:21.794309+0000","last_became_active":"2024-05-10T08:40:15.719857+0000","last_became_peered":"2024-05-10T08:40:15.719857+0000","last_unstale":"2024-05-10T08:40:21.794309+0000","last_undegraded":"2024-05-10T08:40:21.794309+0000","last_fullsized":"2024-05-10T08:40:21.794309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:42.339941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2859,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":697957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":109068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":109068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":107007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:40:29.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:40:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.940+0000 7f9706b12640 1 Processor -- start 2024-05-10T08:40:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.940+0000 7f9706b12640 1 -- start start 2024-05-10T08:40:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.940+0000 7f9706b12640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97000b21f0 0x7f970006e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.940+0000 7f9706b12640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f97000cfea0 0x7f97001633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.940+0000 7f9706b12640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97000d0500 con 0x7f9700162f50 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.940+0000 7f9706b12640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f970006d810 con 0x7f97000b21f0 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.940+0000 7f9706b12640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f970006e0b0 con 0x7f97000cfea0 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97048ae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97000b21f0 0x7f970006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97048ae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97000b21f0 0x7f970006e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57814/0 (socket says 172.21.15.37:57814) 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97048ae640 1 -- 172.21.15.37:0/1903379974 learned_addr learned my addr 172.21.15.37:0/1903379974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97050af640 1 --2- 172.21.15.37:0/1903379974 >> v2:172.21.15.82:3300/0 conn(0x7f97000cfea0 0x7f97001633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97048ae640 1 -- 172.21.15.37:0/1903379974 >> v2:172.21.15.82:3300/0 conn(0x7f97000cfea0 msgr2=0x7f97001633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97048ae640 1 --2- 172.21.15.37:0/1903379974 >> v2:172.21.15.82:3300/0 conn(0x7f97000cfea0 0x7f97001633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97048ae640 1 -- 172.21.15.37:0/1903379974 >> v1:172.21.15.82:6789/0 conn(0x7f9700162f50 legacy=0x7f97000cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.941+0000 7f97048ae640 1 -- 172.21.15.37:0/1903379974 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970006da60 con 0x7f97000b21f0 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f97048ae640 1 --2- 172.21.15.37:0/1903379974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970006e540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f97000cf470 tx=0x7f96f802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590e7ef3a928f07b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f96ff7fe640 1 -- 172.21.15.37:0/1903379974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8037070 con 0x7f97000b21f0 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f96ff7fe640 1 -- 172.21.15.37:0/1903379974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f8032440 con 0x7f97000b21f0 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f96ff7fe640 1 -- 172.21.15.37:0/1903379974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8032810 con 0x7f97000b21f0 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f9706b12640 1 -- 172.21.15.37:0/1903379974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 msgr2=0x7f970006e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f9706b12640 1 --2- 172.21.15.37:0/1903379974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970006e540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f97000cf470 tx=0x7f96f802a150 comp rx=0 tx=0).stop 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f9706b12640 1 -- 172.21.15.37:0/1903379974 shutdown_connections 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f9706b12640 1 --2- 172.21.15.37:0/1903379974 >> v2:172.21.15.82:3300/0 conn(0x7f97000cfea0 0x7f97001633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f9706b12640 1 --2- 172.21.15.37:0/1903379974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970006e540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f9706b12640 1 -- 172.21.15.37:0/1903379974 >> 172.21.15.37:0/1903379974 conn(0x7f970009ba40 msgr2=0x7f970009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.942+0000 7f9706b12640 1 -- 172.21.15.37:0/1903379974 shutdown_connections 2024-05-10T08:40:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.943+0000 7f9706b12640 1 -- 172.21.15.37:0/1903379974 wait complete. 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.944+0000 7f9706b12640 1 Processor -- start 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.944+0000 7f9706b12640 1 -- start start 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.944+0000 7f9706b12640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f9706b12640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97000cfea0 0x7f97000b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f9706b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9700162f50 0x7f97000d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f9706b12640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97000b25d0 con 0x7f97000b21f0 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f9706b12640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f970006ea80 con 0x7f9700162f50 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f9706b12640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f97000cd480 con 0x7f97000cfea0 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970015c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57822/0 (socket says 172.21.15.37:57822) 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 -- 172.21.15.37:0/5655031 learned_addr learned my addr 172.21.15.37:0/5655031 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97050af640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9700162f50 0x7f97000d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f96fffff640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97000cfea0 0x7f97000b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 -- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97000cfea0 msgr2=0x7f97000b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97000cfea0 0x7f97000b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 -- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9700162f50 msgr2=0x7f97000d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9700162f50 0x7f97000d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 -- 172.21.15.37:0/5655031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97000b3260 con 0x7f97000b21f0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f97048ae640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970015c030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f96f802a190 tx=0x7f96f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f96fd7fa640 1 -- 172.21.15.37:0/5655031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8037040 con 0x7f97000b21f0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f96fd7fa640 1 -- 172.21.15.37:0/5655031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f8042070 con 0x7f97000b21f0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f96fd7fa640 1 -- 172.21.15.37:0/5655031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8030920 con 0x7f97000b21f0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.945+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97000b3540 con 0x7f97000b21f0 2024-05-10T08:40:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.946+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97000b3b00 con 0x7f97000b21f0 2024-05-10T08:40:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.947+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9700069b00 con 0x7f97000b21f0 2024-05-10T08:40:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.947+0000 7f96fd7fa640 1 -- 172.21.15.37:0/5655031 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f96f8030ac0 con 0x7f97000b21f0 2024-05-10T08:40:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.948+0000 7f96fd7fa640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96e0076300 0x7f96e00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:29.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.948+0000 7f96fd7fa640 1 -- 172.21.15.37:0/5655031 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96f80b8100 con 0x7f97000b21f0 2024-05-10T08:40:29.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.948+0000 7f96fffff640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96e0076300 0x7f96e00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:29.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.948+0000 7f96fffff640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96e0076300 0x7f96e00787c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97001ea310 tx=0x7f96f0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:29.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:29.952+0000 7f96fd7fa640 1 -- 172.21.15.37:0/5655031 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f96f80810d0 con 0x7f97000b21f0 2024-05-10T08:40:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.139+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97000b4300 con 0x7f96e0076300 2024-05-10T08:40:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.147+0000 7f96fd7fa640 1 -- 172.21.15.37:0/5655031 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332521 (secure 0 0 0) 0x7f96f0006b50 con 0x7f96e0076300 2024-05-10T08:40:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:40:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96e0076300 msgr2=0x7f96e00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96e0076300 0x7f96e00787c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97001ea310 tx=0x7f96f0009040 comp rx=0 tx=0).stop 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 msgr2=0x7f970015c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970015c030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f96f802a190 tx=0x7f96f80046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 shutdown_connections 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96e0076300 0x7f96e00787c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9700162f50 0x7f97000d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.150+0000 7f9706b12640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97000cfea0 0x7f97000b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.151+0000 7f9706b12640 1 --2- 172.21.15.37:0/5655031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97000b21f0 0x7f970015c030 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.151+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 >> 172.21.15.37:0/5655031 conn(0x7f970009ba40 msgr2=0x7f97000b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.151+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 shutdown_connections 2024-05-10T08:40:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.151+0000 7f9706b12640 1 -- 172.21.15.37:0/5655031 wait complete. 2024-05-10T08:40:30.161 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-10T08:40:29.327149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593227,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":147,"num_write_kb":1643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219520,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755200,"statfs":{"total":773094113280,"available":772869324800,"internally_reserved":0,"allocated":3383296,"data_stored":2042510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.591367"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792232+0000","last_change":"2024-05-10T08:40:14.722841+0000","last_active":"2024-05-10T08:40:21.792232+0000","last_peered":"2024-05-10T08:40:21.792232+0000","last_clean":"2024-05-10T08:40:21.792232+0000","last_became_active":"2024-05-10T08:40:14.722183+0000","last_became_peered":"2024-05-10T08:40:14.722183+0000","last_unstale":"2024-05-10T08:40:21.792232+0000","last_undegraded":"2024-05-10T08:40:21.792232+0000","last_fullsized":"2024-05-10T08:40:21.792232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:06.547146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736024+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.736024+0000","last_peered":"2024-05-10T08:40:21.736024+0000","last_clean":"2024-05-10T08:40:21.736024+0000","last_became_active":"2024-05-10T08:40:15.727402+0000","last_became_peered":"2024-05-10T08:40:15.727402+0000","last_unstale":"2024-05-10T08:40:21.736024+0000","last_undegraded":"2024-05-10T08:40:21.736024+0000","last_fullsized":"2024-05-10T08:40:21.736024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737026+0000","last_change":"2024-05-10T08:40:20.252446+0000","last_active":"2024-05-10T08:40:21.737026+0000","last_peered":"2024-05-10T08:40:21.737026+0000","last_clean":"2024-05-10T08:40:21.737026+0000","last_became_active":"2024-05-10T08:40:20.251506+0000","last_became_peered":"2024-05-10T08:40:20.251506+0000","last_unstale":"2024-05-10T08:40:21.737026+0000","last_undegraded":"2024-05-10T08:40:21.737026+0000","last_fullsized":"2024-05-10T08:40:21.737026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:20.266480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736220+0000","last_change":"2024-05-10T08:40:14.718258+0000","last_active":"2024-05-10T08:40:21.736220+0000","last_peered":"2024-05-10T08:40:21.736220+0000","last_clean":"2024-05-10T08:40:21.736220+0000","last_became_active":"2024-05-10T08:40:14.717977+0000","last_became_peered":"2024-05-10T08:40:14.717977+0000","last_unstale":"2024-05-10T08:40:21.736220+0000","last_undegraded":"2024-05-10T08:40:21.736220+0000","last_fullsized":"2024-05-10T08:40:21.736220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791950+0000","last_change":"2024-05-10T08:40:15.728761+0000","last_active":"2024-05-10T08:40:21.791950+0000","last_peered":"2024-05-10T08:40:21.791950+0000","last_clean":"2024-05-10T08:40:21.791950+0000","last_became_active":"2024-05-10T08:40:15.728245+0000","last_became_peered":"2024-05-10T08:40:15.728245+0000","last_unstale":"2024-05-10T08:40:21.791950+0000","last_undegraded":"2024-05-10T08:40:21.791950+0000","last_fullsized":"2024-05-10T08:40:21.791950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:08.921084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736087+0000","last_change":"2024-05-10T08:40:19.751295+0000","last_active":"2024-05-10T08:40:21.736087+0000","last_peered":"2024-05-10T08:40:21.736087+0000","last_clean":"2024-05-10T08:40:21.736087+0000","last_became_active":"2024-05-10T08:40:19.750747+0000","last_became_peered":"2024-05-10T08:40:19.750747+0000","last_unstale":"2024-05-10T08:40:21.736087+0000","last_undegraded":"2024-05-10T08:40:21.736087+0000","last_fullsized":"2024-05-10T08:40:21.736087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:52.662846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794387+0000","last_change":"2024-05-10T08:40:14.722485+0000","last_active":"2024-05-10T08:40:21.794387+0000","last_peered":"2024-05-10T08:40:21.794387+0000","last_clean":"2024-05-10T08:40:21.794387+0000","last_became_active":"2024-05-10T08:40:14.722184+0000","last_became_peered":"2024-05-10T08:40:14.722184+0000","last_unstale":"2024-05-10T08:40:21.794387+0000","last_undegraded":"2024-05-10T08:40:21.794387+0000","last_fullsized":"2024-05-10T08:40:21.794387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:43.340926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792763+0000","last_change":"2024-05-10T08:40:15.724844+0000","last_active":"2024-05-10T08:40:21.792763+0000","last_peered":"2024-05-10T08:40:21.792763+0000","last_clean":"2024-05-10T08:40:21.792763+0000","last_became_active":"2024-05-10T08:40:15.724533+0000","last_became_peered":"2024-05-10T08:40:15.724533+0000","last_unstale":"2024-05-10T08:40:21.792763+0000","last_undegraded":"2024-05-10T08:40:21.792763+0000","last_fullsized":"2024-05-10T08:40:21.792763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737099+0000","last_change":"2024-05-10T08:40:19.753339+0000","last_active":"2024-05-10T08:40:21.737099+0000","last_peered":"2024-05-10T08:40:21.737099+0000","last_clean":"2024-05-10T08:40:21.737099+0000","last_became_active":"2024-05-10T08:40:19.751018+0000","last_became_peered":"2024-05-10T08:40:19.751018+0000","last_unstale":"2024-05-10T08:40:21.737099+0000","last_undegraded":"2024-05-10T08:40:21.737099+0000","last_fullsized":"2024-05-10T08:40:21.737099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793602+0000","last_change":"2024-05-10T08:40:14.724343+0000","last_active":"2024-05-10T08:40:21.793602+0000","last_peered":"2024-05-10T08:40:21.793602+0000","last_clean":"2024-05-10T08:40:21.793602+0000","last_became_active":"2024-05-10T08:40:14.724052+0000","last_became_peered":"2024-05-10T08:40:14.724052+0000","last_unstale":"2024-05-10T08:40:21.793602+0000","last_undegraded":"2024-05-10T08:40:21.793602+0000","last_fullsized":"2024-05-10T08:40:21.793602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793405+0000","last_change":"2024-05-10T08:40:15.726508+0000","last_active":"2024-05-10T08:40:21.793405+0000","last_peered":"2024-05-10T08:40:21.793405+0000","last_clean":"2024-05-10T08:40:21.793405+0000","last_became_active":"2024-05-10T08:40:15.723751+0000","last_became_peered":"2024-05-10T08:40:15.723751+0000","last_unstale":"2024-05-10T08:40:21.793405+0000","last_undegraded":"2024-05-10T08:40:21.793405+0000","last_fullsized":"2024-05-10T08:40:21.793405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736296+0000","last_change":"2024-05-10T08:40:19.758941+0000","last_active":"2024-05-10T08:40:21.736296+0000","last_peered":"2024-05-10T08:40:21.736296+0000","last_clean":"2024-05-10T08:40:21.736296+0000","last_became_active":"2024-05-10T08:40:19.758340+0000","last_became_peered":"2024-05-10T08:40:19.758340+0000","last_unstale":"2024-05-10T08:40:21.736296+0000","last_undegraded":"2024-05-10T08:40:21.736296+0000","last_fullsized":"2024-05-10T08:40:21.736296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793269+0000","last_change":"2024-05-10T08:40:15.716167+0000","last_active":"2024-05-10T08:40:21.793269+0000","last_peered":"2024-05-10T08:40:21.793269+0000","last_clean":"2024-05-10T08:40:21.793269+0000","last_became_active":"2024-05-10T08:40:15.715892+0000","last_became_peered":"2024-05-10T08:40:15.715892+0000","last_unstale":"2024-05-10T08:40:21.793269+0000","last_undegraded":"2024-05-10T08:40:21.793269+0000","last_fullsized":"2024-05-10T08:40:21.793269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794201+0000","last_change":"2024-05-10T08:40:14.722515+0000","last_active":"2024-05-10T08:40:21.794201+0000","last_peered":"2024-05-10T08:40:21.794201+0000","last_clean":"2024-05-10T08:40:21.794201+0000","last_became_active":"2024-05-10T08:40:14.722210+0000","last_became_peered":"2024-05-10T08:40:14.722210+0000","last_unstale":"2024-05-10T08:40:21.794201+0000","last_undegraded":"2024-05-10T08:40:21.794201+0000","last_fullsized":"2024-05-10T08:40:21.794201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736849+0000","last_change":"2024-05-10T08:40:19.758434+0000","last_active":"2024-05-10T08:40:21.736849+0000","last_peered":"2024-05-10T08:40:21.736849+0000","last_clean":"2024-05-10T08:40:21.736849+0000","last_became_active":"2024-05-10T08:40:19.758013+0000","last_became_peered":"2024-05-10T08:40:19.758013+0000","last_unstale":"2024-05-10T08:40:21.736849+0000","last_undegraded":"2024-05-10T08:40:21.736849+0000","last_fullsized":"2024-05-10T08:40:21.736849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736292+0000","last_change":"2024-05-10T08:40:15.733728+0000","last_active":"2024-05-10T08:40:21.736292+0000","last_peered":"2024-05-10T08:40:21.736292+0000","last_clean":"2024-05-10T08:40:21.736292+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.736292+0000","last_undegraded":"2024-05-10T08:40:21.736292+0000","last_fullsized":"2024-05-10T08:40:21.736292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736094+0000","last_change":"2024-05-10T08:40:14.711008+0000","last_active":"2024-05-10T08:40:21.736094+0000","last_peered":"2024-05-10T08:40:21.736094+0000","last_clean":"2024-05-10T08:40:21.736094+0000","last_became_active":"2024-05-10T08:40:14.710716+0000","last_became_peered":"2024-05-10T08:40:14.710716+0000","last_unstale":"2024-05-10T08:40:21.736094+0000","last_undegraded":"2024-05-10T08:40:21.736094+0000","last_fullsized":"2024-05-10T08:40:21.736094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736797+0000","last_change":"2024-05-10T08:40:19.753357+0000","last_active":"2024-05-10T08:40:21.736797+0000","last_peered":"2024-05-10T08:40:21.736797+0000","last_clean":"2024-05-10T08:40:21.736797+0000","last_became_active":"2024-05-10T08:40:19.752967+0000","last_became_peered":"2024-05-10T08:40:19.752967+0000","last_unstale":"2024-05-10T08:40:21.736797+0000","last_undegraded":"2024-05-10T08:40:21.736797+0000","last_fullsized":"2024-05-10T08:40:21.736797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736816+0000","last_change":"2024-05-10T08:40:15.719215+0000","last_active":"2024-05-10T08:40:21.736816+0000","last_peered":"2024-05-10T08:40:21.736816+0000","last_clean":"2024-05-10T08:40:21.736816+0000","last_became_active":"2024-05-10T08:40:15.718864+0000","last_became_peered":"2024-05-10T08:40:15.718864+0000","last_unstale":"2024-05-10T08:40:21.736816+0000","last_undegraded":"2024-05-10T08:40:21.736816+0000","last_fullsized":"2024-05-10T08:40:21.736816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735514+0000","last_change":"2024-05-10T08:40:14.719728+0000","last_active":"2024-05-10T08:40:21.735514+0000","last_peered":"2024-05-10T08:40:21.735514+0000","last_clean":"2024-05-10T08:40:21.735514+0000","last_became_active":"2024-05-10T08:40:14.719401+0000","last_became_peered":"2024-05-10T08:40:14.719401+0000","last_unstale":"2024-05-10T08:40:21.735514+0000","last_undegraded":"2024-05-10T08:40:21.735514+0000","last_fullsized":"2024-05-10T08:40:21.735514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737417+0000","last_change":"2024-05-10T08:40:20.250769+0000","last_active":"2024-05-10T08:40:21.737417+0000","last_peered":"2024-05-10T08:40:21.737417+0000","last_clean":"2024-05-10T08:40:21.737417+0000","last_became_active":"2024-05-10T08:40:20.250387+0000","last_became_peered":"2024-05-10T08:40:20.250387+0000","last_unstale":"2024-05-10T08:40:21.737417+0000","last_undegraded":"2024-05-10T08:40:21.737417+0000","last_fullsized":"2024-05-10T08:40:21.737417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736533+0000","last_change":"2024-05-10T08:40:15.719306+0000","last_active":"2024-05-10T08:40:21.736533+0000","last_peered":"2024-05-10T08:40:21.736533+0000","last_clean":"2024-05-10T08:40:21.736533+0000","last_became_active":"2024-05-10T08:40:15.718968+0000","last_became_peered":"2024-05-10T08:40:15.718968+0000","last_unstale":"2024-05-10T08:40:21.736533+0000","last_undegraded":"2024-05-10T08:40:21.736533+0000","last_fullsized":"2024-05-10T08:40:21.736533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:34.334556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792277+0000","last_change":"2024-05-10T08:40:14.723003+0000","last_active":"2024-05-10T08:40:21.792277+0000","last_peered":"2024-05-10T08:40:21.792277+0000","last_clean":"2024-05-10T08:40:21.792277+0000","last_became_active":"2024-05-10T08:40:14.722721+0000","last_became_peered":"2024-05-10T08:40:14.722721+0000","last_unstale":"2024-05-10T08:40:21.792277+0000","last_undegraded":"2024-05-10T08:40:21.792277+0000","last_fullsized":"2024-05-10T08:40:21.792277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736700+0000","last_change":"2024-05-10T08:40:19.751296+0000","last_active":"2024-05-10T08:40:21.736700+0000","last_peered":"2024-05-10T08:40:21.736700+0000","last_clean":"2024-05-10T08:40:21.736700+0000","last_became_active":"2024-05-10T08:40:19.750813+0000","last_became_peered":"2024-05-10T08:40:19.750813+0000","last_unstale":"2024-05-10T08:40:21.736700+0000","last_undegraded":"2024-05-10T08:40:21.736700+0000","last_fullsized":"2024-05-10T08:40:21.736700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:58.250654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792010+0000","last_change":"2024-05-10T08:40:15.722099+0000","last_active":"2024-05-10T08:40:21.792010+0000","last_peered":"2024-05-10T08:40:21.792010+0000","last_clean":"2024-05-10T08:40:21.792010+0000","last_became_active":"2024-05-10T08:40:15.721386+0000","last_became_peered":"2024-05-10T08:40:15.721386+0000","last_unstale":"2024-05-10T08:40:21.792010+0000","last_undegraded":"2024-05-10T08:40:21.792010+0000","last_fullsized":"2024-05-10T08:40:21.792010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:07:45.250348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794133+0000","last_change":"2024-05-10T08:40:14.721450+0000","last_active":"2024-05-10T08:40:21.794133+0000","last_peered":"2024-05-10T08:40:21.794133+0000","last_clean":"2024-05-10T08:40:21.794133+0000","last_became_active":"2024-05-10T08:40:14.721110+0000","last_became_peered":"2024-05-10T08:40:14.721110+0000","last_unstale":"2024-05-10T08:40:21.794133+0000","last_undegraded":"2024-05-10T08:40:21.794133+0000","last_fullsized":"2024-05-10T08:40:21.794133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736263+0000","last_change":"2024-05-10T08:40:20.250784+0000","last_active":"2024-05-10T08:40:21.736263+0000","last_peered":"2024-05-10T08:40:21.736263+0000","last_clean":"2024-05-10T08:40:21.736263+0000","last_became_active":"2024-05-10T08:40:20.250338+0000","last_became_peered":"2024-05-10T08:40:20.250338+0000","last_unstale":"2024-05-10T08:40:21.736263+0000","last_undegraded":"2024-05-10T08:40:21.736263+0000","last_fullsized":"2024-05-10T08:40:21.736263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:15.728115+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:15.727814+0000","last_became_peered":"2024-05-10T08:40:15.727814+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736643+0000","last_change":"2024-05-10T08:40:14.712174+0000","last_active":"2024-05-10T08:40:21.736643+0000","last_peered":"2024-05-10T08:40:21.736643+0000","last_clean":"2024-05-10T08:40:21.736643+0000","last_became_active":"2024-05-10T08:40:14.711817+0000","last_became_peered":"2024-05-10T08:40:14.711817+0000","last_unstale":"2024-05-10T08:40:21.736643+0000","last_undegraded":"2024-05-10T08:40:21.736643+0000","last_fullsized":"2024-05-10T08:40:21.736643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736599+0000","last_change":"2024-05-10T08:40:20.250340+0000","last_active":"2024-05-10T08:40:21.736599+0000","last_peered":"2024-05-10T08:40:21.736599+0000","last_clean":"2024-05-10T08:40:21.736599+0000","last_became_active":"2024-05-10T08:40:20.249928+0000","last_became_peered":"2024-05-10T08:40:20.249928+0000","last_unstale":"2024-05-10T08:40:21.736599+0000","last_undegraded":"2024-05-10T08:40:21.736599+0000","last_fullsized":"2024-05-10T08:40:21.736599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:29.943142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736966+0000","last_change":"2024-05-10T08:40:15.717354+0000","last_active":"2024-05-10T08:40:21.736966+0000","last_peered":"2024-05-10T08:40:21.736966+0000","last_clean":"2024-05-10T08:40:21.736966+0000","last_became_active":"2024-05-10T08:40:15.717033+0000","last_became_peered":"2024-05-10T08:40:15.717033+0000","last_unstale":"2024-05-10T08:40:21.736966+0000","last_undegraded":"2024-05-10T08:40:21.736966+0000","last_fullsized":"2024-05-10T08:40:21.736966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794461+0000","last_change":"2024-05-10T08:40:14.722906+0000","last_active":"2024-05-10T08:40:21.794461+0000","last_peered":"2024-05-10T08:40:21.794461+0000","last_clean":"2024-05-10T08:40:21.794461+0000","last_became_active":"2024-05-10T08:40:14.722607+0000","last_became_peered":"2024-05-10T08:40:14.722607+0000","last_unstale":"2024-05-10T08:40:21.794461+0000","last_undegraded":"2024-05-10T08:40:21.794461+0000","last_fullsized":"2024-05-10T08:40:21.794461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:38.589413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792174+0000","last_change":"2024-05-10T08:40:20.250418+0000","last_active":"2024-05-10T08:40:21.792174+0000","last_peered":"2024-05-10T08:40:21.792174+0000","last_clean":"2024-05-10T08:40:21.792174+0000","last_became_active":"2024-05-10T08:40:20.249925+0000","last_became_peered":"2024-05-10T08:40:20.249925+0000","last_unstale":"2024-05-10T08:40:21.792174+0000","last_undegraded":"2024-05-10T08:40:21.792174+0000","last_fullsized":"2024-05-10T08:40:21.792174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793510+0000","last_change":"2024-05-10T08:40:15.735822+0000","last_active":"2024-05-10T08:40:21.793510+0000","last_peered":"2024-05-10T08:40:21.793510+0000","last_clean":"2024-05-10T08:40:21.793510+0000","last_became_active":"2024-05-10T08:40:15.735525+0000","last_became_peered":"2024-05-10T08:40:15.735525+0000","last_unstale":"2024-05-10T08:40:21.793510+0000","last_undegraded":"2024-05-10T08:40:21.793510+0000","last_fullsized":"2024-05-10T08:40:21.793510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737066+0000","last_change":"2024-05-10T08:40:14.720119+0000","last_active":"2024-05-10T08:40:21.737066+0000","last_peered":"2024-05-10T08:40:21.737066+0000","last_clean":"2024-05-10T08:40:21.737066+0000","last_became_active":"2024-05-10T08:40:14.719807+0000","last_became_peered":"2024-05-10T08:40:14.719807+0000","last_unstale":"2024-05-10T08:40:21.737066+0000","last_undegraded":"2024-05-10T08:40:21.737066+0000","last_fullsized":"2024-05-10T08:40:21.737066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735653+0000","last_change":"2024-05-10T08:40:19.758680+0000","last_active":"2024-05-10T08:40:21.735653+0000","last_peered":"2024-05-10T08:40:21.735653+0000","last_clean":"2024-05-10T08:40:21.735653+0000","last_became_active":"2024-05-10T08:40:19.757930+0000","last_became_peered":"2024-05-10T08:40:19.757930+0000","last_unstale":"2024-05-10T08:40:21.735653+0000","last_undegraded":"2024-05-10T08:40:21.735653+0000","last_fullsized":"2024-05-10T08:40:21.735653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737171+0000","last_change":"2024-05-10T08:40:15.727979+0000","last_active":"2024-05-10T08:40:21.737171+0000","last_peered":"2024-05-10T08:40:21.737171+0000","last_clean":"2024-05-10T08:40:21.737171+0000","last_became_active":"2024-05-10T08:40:15.727689+0000","last_became_peered":"2024-05-10T08:40:15.727689+0000","last_unstale":"2024-05-10T08:40:21.737171+0000","last_undegraded":"2024-05-10T08:40:21.737171+0000","last_fullsized":"2024-05-10T08:40:21.737171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:00.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793318+0000","last_change":"2024-05-10T08:40:14.719368+0000","last_active":"2024-05-10T08:40:21.793318+0000","last_peered":"2024-05-10T08:40:21.793318+0000","last_clean":"2024-05-10T08:40:21.793318+0000","last_became_active":"2024-05-10T08:40:14.719067+0000","last_became_peered":"2024-05-10T08:40:14.719067+0000","last_unstale":"2024-05-10T08:40:21.793318+0000","last_undegraded":"2024-05-10T08:40:21.793318+0000","last_fullsized":"2024-05-10T08:40:21.793318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736975+0000","last_change":"2024-05-10T08:40:19.749606+0000","last_active":"2024-05-10T08:40:21.736975+0000","last_peered":"2024-05-10T08:40:21.736975+0000","last_clean":"2024-05-10T08:40:21.736975+0000","last_became_active":"2024-05-10T08:40:19.748828+0000","last_became_peered":"2024-05-10T08:40:19.748828+0000","last_unstale":"2024-05-10T08:40:21.736975+0000","last_undegraded":"2024-05-10T08:40:21.736975+0000","last_fullsized":"2024-05-10T08:40:21.736975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735649+0000","last_change":"2024-05-10T08:40:15.720054+0000","last_active":"2024-05-10T08:40:21.735649+0000","last_peered":"2024-05-10T08:40:21.735649+0000","last_clean":"2024-05-10T08:40:21.735649+0000","last_became_active":"2024-05-10T08:40:15.719769+0000","last_became_peered":"2024-05-10T08:40:15.719769+0000","last_unstale":"2024-05-10T08:40:21.735649+0000","last_undegraded":"2024-05-10T08:40:21.735649+0000","last_fullsized":"2024-05-10T08:40:21.735649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791550+0000","last_change":"2024-05-10T08:40:14.721738+0000","last_active":"2024-05-10T08:40:21.791550+0000","last_peered":"2024-05-10T08:40:21.791550+0000","last_clean":"2024-05-10T08:40:21.791550+0000","last_became_active":"2024-05-10T08:40:14.721434+0000","last_became_peered":"2024-05-10T08:40:14.721434+0000","last_unstale":"2024-05-10T08:40:21.791550+0000","last_undegraded":"2024-05-10T08:40:21.791550+0000","last_fullsized":"2024-05-10T08:40:21.791550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:19.758288+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:19.757825+0000","last_became_peered":"2024-05-10T08:40:19.757825+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791777+0000","last_change":"2024-05-10T08:40:15.722819+0000","last_active":"2024-05-10T08:40:21.791777+0000","last_peered":"2024-05-10T08:40:21.791777+0000","last_clean":"2024-05-10T08:40:21.791777+0000","last_became_active":"2024-05-10T08:40:15.722444+0000","last_became_peered":"2024-05-10T08:40:15.722444+0000","last_unstale":"2024-05-10T08:40:21.791777+0000","last_undegraded":"2024-05-10T08:40:21.791777+0000","last_fullsized":"2024-05-10T08:40:21.791777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792365+0000","last_change":"2024-05-10T08:40:14.723089+0000","last_active":"2024-05-10T08:40:21.792365+0000","last_peered":"2024-05-10T08:40:21.792365+0000","last_clean":"2024-05-10T08:40:21.792365+0000","last_became_active":"2024-05-10T08:40:14.722771+0000","last_became_peered":"2024-05-10T08:40:14.722771+0000","last_unstale":"2024-05-10T08:40:21.792365+0000","last_undegraded":"2024-05-10T08:40:21.792365+0000","last_fullsized":"2024-05-10T08:40:21.792365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792005+0000","last_change":"2024-05-10T08:40:20.250543+0000","last_active":"2024-05-10T08:40:21.792005+0000","last_peered":"2024-05-10T08:40:21.792005+0000","last_clean":"2024-05-10T08:40:21.792005+0000","last_became_active":"2024-05-10T08:40:20.249990+0000","last_became_peered":"2024-05-10T08:40:20.249990+0000","last_unstale":"2024-05-10T08:40:21.792005+0000","last_undegraded":"2024-05-10T08:40:21.792005+0000","last_fullsized":"2024-05-10T08:40:21.792005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735932+0000","last_change":"2024-05-10T08:40:15.730255+0000","last_active":"2024-05-10T08:40:21.735932+0000","last_peered":"2024-05-10T08:40:21.735932+0000","last_clean":"2024-05-10T08:40:21.735932+0000","last_became_active":"2024-05-10T08:40:15.729980+0000","last_became_peered":"2024-05-10T08:40:15.729980+0000","last_unstale":"2024-05-10T08:40:21.735932+0000","last_undegraded":"2024-05-10T08:40:21.735932+0000","last_fullsized":"2024-05-10T08:40:21.735932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792701+0000","last_change":"2024-05-10T08:40:14.715445+0000","last_active":"2024-05-10T08:40:21.792701+0000","last_peered":"2024-05-10T08:40:21.792701+0000","last_clean":"2024-05-10T08:40:21.792701+0000","last_became_active":"2024-05-10T08:40:14.715170+0000","last_became_peered":"2024-05-10T08:40:14.715170+0000","last_unstale":"2024-05-10T08:40:21.792701+0000","last_undegraded":"2024-05-10T08:40:21.792701+0000","last_fullsized":"2024-05-10T08:40:21.792701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792391+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:40:21.792391+0000","last_peered":"2024-05-10T08:40:21.792391+0000","last_clean":"2024-05-10T08:40:21.792391+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:40:21.792391+0000","last_undegraded":"2024-05-10T08:40:21.792391+0000","last_fullsized":"2024-05-10T08:40:21.792391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793767+0000","last_change":"2024-05-10T08:40:20.252336+0000","last_active":"2024-05-10T08:40:21.793767+0000","last_peered":"2024-05-10T08:40:21.793767+0000","last_clean":"2024-05-10T08:40:21.793767+0000","last_became_active":"2024-05-10T08:40:20.251817+0000","last_became_peered":"2024-05-10T08:40:20.251817+0000","last_unstale":"2024-05-10T08:40:21.793767+0000","last_undegraded":"2024-05-10T08:40:21.793767+0000","last_fullsized":"2024-05-10T08:40:21.793767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794293+0000","last_change":"2024-05-10T08:40:15.727310+0000","last_active":"2024-05-10T08:40:21.794293+0000","last_peered":"2024-05-10T08:40:21.794293+0000","last_clean":"2024-05-10T08:40:21.794293+0000","last_became_active":"2024-05-10T08:40:15.727030+0000","last_became_peered":"2024-05-10T08:40:15.727030+0000","last_unstale":"2024-05-10T08:40:21.794293+0000","last_undegraded":"2024-05-10T08:40:21.794293+0000","last_fullsized":"2024-05-10T08:40:21.794293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791837+0000","last_change":"2024-05-10T08:40:14.715295+0000","last_active":"2024-05-10T08:40:21.791837+0000","last_peered":"2024-05-10T08:40:21.791837+0000","last_clean":"2024-05-10T08:40:21.791837+0000","last_became_active":"2024-05-10T08:40:14.715006+0000","last_became_peered":"2024-05-10T08:40:14.715006+0000","last_unstale":"2024-05-10T08:40:21.791837+0000","last_undegraded":"2024-05-10T08:40:21.791837+0000","last_fullsized":"2024-05-10T08:40:21.791837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793015+0000","last_change":"2024-05-10T08:40:20.251128+0000","last_active":"2024-05-10T08:40:21.793015+0000","last_peered":"2024-05-10T08:40:21.793015+0000","last_clean":"2024-05-10T08:40:21.793015+0000","last_became_active":"2024-05-10T08:40:20.249896+0000","last_became_peered":"2024-05-10T08:40:20.249896+0000","last_unstale":"2024-05-10T08:40:21.793015+0000","last_undegraded":"2024-05-10T08:40:21.793015+0000","last_fullsized":"2024-05-10T08:40:21.793015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792798+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792798+0000","last_peered":"2024-05-10T08:40:21.792798+0000","last_clean":"2024-05-10T08:40:21.792798+0000","last_became_active":"2024-05-10T08:40:15.737918+0000","last_became_peered":"2024-05-10T08:40:15.737918+0000","last_unstale":"2024-05-10T08:40:21.792798+0000","last_undegraded":"2024-05-10T08:40:21.792798+0000","last_fullsized":"2024-05-10T08:40:21.792798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736170+0000","last_change":"2024-05-10T08:40:14.709667+0000","last_active":"2024-05-10T08:40:21.736170+0000","last_peered":"2024-05-10T08:40:21.736170+0000","last_clean":"2024-05-10T08:40:21.736170+0000","last_became_active":"2024-05-10T08:40:14.709290+0000","last_became_peered":"2024-05-10T08:40:14.709290+0000","last_unstale":"2024-05-10T08:40:21.736170+0000","last_undegraded":"2024-05-10T08:40:21.736170+0000","last_fullsized":"2024-05-10T08:40:21.736170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792343+0000","last_change":"2024-05-10T08:40:19.766100+0000","last_active":"2024-05-10T08:40:21.792343+0000","last_peered":"2024-05-10T08:40:21.792343+0000","last_clean":"2024-05-10T08:40:21.792343+0000","last_became_active":"2024-05-10T08:40:19.765485+0000","last_became_peered":"2024-05-10T08:40:19.765485+0000","last_unstale":"2024-05-10T08:40:21.792343+0000","last_undegraded":"2024-05-10T08:40:21.792343+0000","last_fullsized":"2024-05-10T08:40:21.792343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794462+0000","last_change":"2024-05-10T08:40:15.723306+0000","last_active":"2024-05-10T08:40:21.794462+0000","last_peered":"2024-05-10T08:40:21.794462+0000","last_clean":"2024-05-10T08:40:21.794462+0000","last_became_active":"2024-05-10T08:40:15.720173+0000","last_became_peered":"2024-05-10T08:40:15.720173+0000","last_unstale":"2024-05-10T08:40:21.794462+0000","last_undegraded":"2024-05-10T08:40:21.794462+0000","last_fullsized":"2024-05-10T08:40:21.794462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:36.488692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792415+0000","last_change":"2024-05-10T08:40:14.711881+0000","last_active":"2024-05-10T08:40:21.792415+0000","last_peered":"2024-05-10T08:40:21.792415+0000","last_clean":"2024-05-10T08:40:21.792415+0000","last_became_active":"2024-05-10T08:40:14.711578+0000","last_became_peered":"2024-05-10T08:40:14.711578+0000","last_unstale":"2024-05-10T08:40:21.792415+0000","last_undegraded":"2024-05-10T08:40:21.792415+0000","last_fullsized":"2024-05-10T08:40:21.792415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792212+0000","last_change":"2024-05-10T08:40:20.252617+0000","last_active":"2024-05-10T08:40:21.792212+0000","last_peered":"2024-05-10T08:40:21.792212+0000","last_clean":"2024-05-10T08:40:21.792212+0000","last_became_active":"2024-05-10T08:40:20.252213+0000","last_became_peered":"2024-05-10T08:40:20.252213+0000","last_unstale":"2024-05-10T08:40:21.792212+0000","last_undegraded":"2024-05-10T08:40:21.792212+0000","last_fullsized":"2024-05-10T08:40:21.792212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793833+0000","last_change":"2024-05-10T08:40:15.719378+0000","last_active":"2024-05-10T08:40:21.793833+0000","last_peered":"2024-05-10T08:40:21.793833+0000","last_clean":"2024-05-10T08:40:21.793833+0000","last_became_active":"2024-05-10T08:40:15.718906+0000","last_became_peered":"2024-05-10T08:40:15.718906+0000","last_unstale":"2024-05-10T08:40:21.793833+0000","last_undegraded":"2024-05-10T08:40:21.793833+0000","last_fullsized":"2024-05-10T08:40:21.793833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736956+0000","last_change":"2024-05-10T08:40:14.717865+0000","last_active":"2024-05-10T08:40:21.736956+0000","last_peered":"2024-05-10T08:40:21.736956+0000","last_clean":"2024-05-10T08:40:21.736956+0000","last_became_active":"2024-05-10T08:40:14.717601+0000","last_became_peered":"2024-05-10T08:40:14.717601+0000","last_unstale":"2024-05-10T08:40:21.736956+0000","last_undegraded":"2024-05-10T08:40:21.736956+0000","last_fullsized":"2024-05-10T08:40:21.736956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:55.833310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736067+0000","last_change":"2024-05-10T08:40:19.752756+0000","last_active":"2024-05-10T08:40:21.736067+0000","last_peered":"2024-05-10T08:40:21.736067+0000","last_clean":"2024-05-10T08:40:21.736067+0000","last_became_active":"2024-05-10T08:40:19.751028+0000","last_became_peered":"2024-05-10T08:40:19.751028+0000","last_unstale":"2024-05-10T08:40:21.736067+0000","last_undegraded":"2024-05-10T08:40:21.736067+0000","last_fullsized":"2024-05-10T08:40:21.736067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792686+0000","last_change":"2024-05-10T08:40:15.716663+0000","last_active":"2024-05-10T08:40:21.792686+0000","last_peered":"2024-05-10T08:40:21.792686+0000","last_clean":"2024-05-10T08:40:21.792686+0000","last_became_active":"2024-05-10T08:40:15.715575+0000","last_became_peered":"2024-05-10T08:40:15.715575+0000","last_unstale":"2024-05-10T08:40:21.792686+0000","last_undegraded":"2024-05-10T08:40:21.792686+0000","last_fullsized":"2024-05-10T08:40:21.792686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791328+0000","last_change":"2024-05-10T08:40:14.717681+0000","last_active":"2024-05-10T08:40:21.791328+0000","last_peered":"2024-05-10T08:40:21.791328+0000","last_clean":"2024-05-10T08:40:21.791328+0000","last_became_active":"2024-05-10T08:40:14.717306+0000","last_became_peered":"2024-05-10T08:40:14.717306+0000","last_unstale":"2024-05-10T08:40:21.791328+0000","last_undegraded":"2024-05-10T08:40:21.791328+0000","last_fullsized":"2024-05-10T08:40:21.791328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791819+0000","last_change":"2024-05-10T08:40:19.762550+0000","last_active":"2024-05-10T08:40:21.791819+0000","last_peered":"2024-05-10T08:40:21.791819+0000","last_clean":"2024-05-10T08:40:21.791819+0000","last_became_active":"2024-05-10T08:40:19.762116+0000","last_became_peered":"2024-05-10T08:40:19.762116+0000","last_unstale":"2024-05-10T08:40:21.791819+0000","last_undegraded":"2024-05-10T08:40:21.791819+0000","last_fullsized":"2024-05-10T08:40:21.791819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792755+0000","last_change":"2024-05-10T08:40:15.723458+0000","last_active":"2024-05-10T08:40:21.792755+0000","last_peered":"2024-05-10T08:40:21.792755+0000","last_clean":"2024-05-10T08:40:21.792755+0000","last_became_active":"2024-05-10T08:40:15.722820+0000","last_became_peered":"2024-05-10T08:40:15.722820+0000","last_unstale":"2024-05-10T08:40:21.792755+0000","last_undegraded":"2024-05-10T08:40:21.792755+0000","last_fullsized":"2024-05-10T08:40:21.792755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793086+0000","last_change":"2024-05-10T08:40:14.715478+0000","last_active":"2024-05-10T08:40:21.793086+0000","last_peered":"2024-05-10T08:40:21.793086+0000","last_clean":"2024-05-10T08:40:21.793086+0000","last_became_active":"2024-05-10T08:40:14.715204+0000","last_became_peered":"2024-05-10T08:40:14.715204+0000","last_unstale":"2024-05-10T08:40:21.793086+0000","last_undegraded":"2024-05-10T08:40:21.793086+0000","last_fullsized":"2024-05-10T08:40:21.793086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737185+0000","last_change":"2024-05-10T08:40:20.251710+0000","last_active":"2024-05-10T08:40:21.737185+0000","last_peered":"2024-05-10T08:40:21.737185+0000","last_clean":"2024-05-10T08:40:21.737185+0000","last_became_active":"2024-05-10T08:40:20.251322+0000","last_became_peered":"2024-05-10T08:40:20.251322+0000","last_unstale":"2024-05-10T08:40:21.737185+0000","last_undegraded":"2024-05-10T08:40:21.737185+0000","last_fullsized":"2024-05-10T08:40:21.737185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:52.128436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794087+0000","last_change":"2024-05-10T08:40:15.719208+0000","last_active":"2024-05-10T08:40:21.794087+0000","last_peered":"2024-05-10T08:40:21.794087+0000","last_clean":"2024-05-10T08:40:21.794087+0000","last_became_active":"2024-05-10T08:40:15.718750+0000","last_became_peered":"2024-05-10T08:40:15.718750+0000","last_unstale":"2024-05-10T08:40:21.794087+0000","last_undegraded":"2024-05-10T08:40:21.794087+0000","last_fullsized":"2024-05-10T08:40:21.794087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793271+0000","last_change":"2024-05-10T08:40:14.721820+0000","last_active":"2024-05-10T08:40:21.793271+0000","last_peered":"2024-05-10T08:40:21.793271+0000","last_clean":"2024-05-10T08:40:21.793271+0000","last_became_active":"2024-05-10T08:40:14.721098+0000","last_became_peered":"2024-05-10T08:40:14.721098+0000","last_unstale":"2024-05-10T08:40:21.793271+0000","last_undegraded":"2024-05-10T08:40:21.793271+0000","last_fullsized":"2024-05-10T08:40:21.793271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736113+0000","last_change":"2024-05-10T08:40:20.250336+0000","last_active":"2024-05-10T08:40:21.736113+0000","last_peered":"2024-05-10T08:40:21.736113+0000","last_clean":"2024-05-10T08:40:21.736113+0000","last_became_active":"2024-05-10T08:40:20.249910+0000","last_became_peered":"2024-05-10T08:40:20.249910+0000","last_unstale":"2024-05-10T08:40:21.736113+0000","last_undegraded":"2024-05-10T08:40:21.736113+0000","last_fullsized":"2024-05-10T08:40:21.736113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:58.918102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792248+0000","last_change":"2024-05-10T08:40:15.730912+0000","last_active":"2024-05-10T08:40:21.792248+0000","last_peered":"2024-05-10T08:40:21.792248+0000","last_clean":"2024-05-10T08:40:21.792248+0000","last_became_active":"2024-05-10T08:40:15.730664+0000","last_became_peered":"2024-05-10T08:40:15.730664+0000","last_unstale":"2024-05-10T08:40:21.792248+0000","last_undegraded":"2024-05-10T08:40:21.792248+0000","last_fullsized":"2024-05-10T08:40:21.792248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792437+0000","last_change":"2024-05-10T08:40:14.719958+0000","last_active":"2024-05-10T08:40:21.792437+0000","last_peered":"2024-05-10T08:40:21.792437+0000","last_clean":"2024-05-10T08:40:21.792437+0000","last_became_active":"2024-05-10T08:40:14.719527+0000","last_became_peered":"2024-05-10T08:40:14.719527+0000","last_unstale":"2024-05-10T08:40:21.792437+0000","last_undegraded":"2024-05-10T08:40:21.792437+0000","last_fullsized":"2024-05-10T08:40:21.792437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:39.671884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793250+0000","last_change":"2024-05-10T08:40:20.250393+0000","last_active":"2024-05-10T08:40:21.793250+0000","last_peered":"2024-05-10T08:40:21.793250+0000","last_clean":"2024-05-10T08:40:21.793250+0000","last_became_active":"2024-05-10T08:40:20.249931+0000","last_became_peered":"2024-05-10T08:40:20.249931+0000","last_unstale":"2024-05-10T08:40:21.793250+0000","last_undegraded":"2024-05-10T08:40:21.793250+0000","last_fullsized":"2024-05-10T08:40:21.793250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794216+0000","last_change":"2024-05-10T08:40:15.723825+0000","last_active":"2024-05-10T08:40:21.794216+0000","last_peered":"2024-05-10T08:40:21.794216+0000","last_clean":"2024-05-10T08:40:21.794216+0000","last_became_active":"2024-05-10T08:40:15.723549+0000","last_became_peered":"2024-05-10T08:40:15.723549+0000","last_unstale":"2024-05-10T08:40:21.794216+0000","last_undegraded":"2024-05-10T08:40:21.794216+0000","last_fullsized":"2024-05-10T08:40:21.794216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793747+0000","last_change":"2024-05-10T08:40:14.721803+0000","last_active":"2024-05-10T08:40:21.793747+0000","last_peered":"2024-05-10T08:40:21.793747+0000","last_clean":"2024-05-10T08:40:21.793747+0000","last_became_active":"2024-05-10T08:40:14.721510+0000","last_became_peered":"2024-05-10T08:40:14.721510+0000","last_unstale":"2024-05-10T08:40:21.793747+0000","last_undegraded":"2024-05-10T08:40:21.793747+0000","last_fullsized":"2024-05-10T08:40:21.793747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2061,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735875+0000","last_change":"2024-05-10T08:40:19.758340+0000","last_active":"2024-05-10T08:40:21.735875+0000","last_peered":"2024-05-10T08:40:21.735875+0000","last_clean":"2024-05-10T08:40:21.735875+0000","last_became_active":"2024-05-10T08:40:19.757420+0000","last_became_peered":"2024-05-10T08:40:19.757420+0000","last_unstale":"2024-05-10T08:40:21.735875+0000","last_undegraded":"2024-05-10T08:40:21.735875+0000","last_fullsized":"2024-05-10T08:40:21.735875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736978+0000","last_change":"2024-05-10T08:40:15.722046+0000","last_active":"2024-05-10T08:40:21.736978+0000","last_peered":"2024-05-10T08:40:21.736978+0000","last_clean":"2024-05-10T08:40:21.736978+0000","last_became_active":"2024-05-10T08:40:15.721780+0000","last_became_peered":"2024-05-10T08:40:15.721780+0000","last_unstale":"2024-05-10T08:40:21.736978+0000","last_undegraded":"2024-05-10T08:40:21.736978+0000","last_fullsized":"2024-05-10T08:40:21.736978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736056+0000","last_change":"2024-05-10T08:40:14.715667+0000","last_active":"2024-05-10T08:40:21.736056+0000","last_peered":"2024-05-10T08:40:21.736056+0000","last_clean":"2024-05-10T08:40:21.736056+0000","last_became_active":"2024-05-10T08:40:14.715389+0000","last_became_peered":"2024-05-10T08:40:14.715389+0000","last_unstale":"2024-05-10T08:40:21.736056+0000","last_undegraded":"2024-05-10T08:40:21.736056+0000","last_fullsized":"2024-05-10T08:40:21.736056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736950+0000","last_change":"2024-05-10T08:40:19.752944+0000","last_active":"2024-05-10T08:40:21.736950+0000","last_peered":"2024-05-10T08:40:21.736950+0000","last_clean":"2024-05-10T08:40:21.736950+0000","last_became_active":"2024-05-10T08:40:19.750307+0000","last_became_peered":"2024-05-10T08:40:19.750307+0000","last_unstale":"2024-05-10T08:40:21.736950+0000","last_undegraded":"2024-05-10T08:40:21.736950+0000","last_fullsized":"2024-05-10T08:40:21.736950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792136+0000","last_change":"2024-05-10T08:40:15.728526+0000","last_active":"2024-05-10T08:40:21.792136+0000","last_peered":"2024-05-10T08:40:21.792136+0000","last_clean":"2024-05-10T08:40:21.792136+0000","last_became_active":"2024-05-10T08:40:15.727954+0000","last_became_peered":"2024-05-10T08:40:15.727954+0000","last_unstale":"2024-05-10T08:40:21.792136+0000","last_undegraded":"2024-05-10T08:40:21.792136+0000","last_fullsized":"2024-05-10T08:40:21.792136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793153+0000","last_change":"2024-05-10T08:40:14.713649+0000","last_active":"2024-05-10T08:40:21.793153+0000","last_peered":"2024-05-10T08:40:21.793153+0000","last_clean":"2024-05-10T08:40:21.793153+0000","last_became_active":"2024-05-10T08:40:14.713343+0000","last_became_peered":"2024-05-10T08:40:14.713343+0000","last_unstale":"2024-05-10T08:40:21.793153+0000","last_undegraded":"2024-05-10T08:40:21.793153+0000","last_fullsized":"2024-05-10T08:40:21.793153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736758+0000","last_change":"2024-05-10T08:40:19.759670+0000","last_active":"2024-05-10T08:40:21.736758+0000","last_peered":"2024-05-10T08:40:21.736758+0000","last_clean":"2024-05-10T08:40:21.736758+0000","last_became_active":"2024-05-10T08:40:19.756600+0000","last_became_peered":"2024-05-10T08:40:19.756600+0000","last_unstale":"2024-05-10T08:40:21.736758+0000","last_undegraded":"2024-05-10T08:40:21.736758+0000","last_fullsized":"2024-05-10T08:40:21.736758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.094481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793080+0000","last_change":"2024-05-10T08:40:15.721196+0000","last_active":"2024-05-10T08:40:21.793080+0000","last_peered":"2024-05-10T08:40:21.793080+0000","last_clean":"2024-05-10T08:40:21.793080+0000","last_became_active":"2024-05-10T08:40:15.720932+0000","last_became_peered":"2024-05-10T08:40:15.720932+0000","last_unstale":"2024-05-10T08:40:21.793080+0000","last_undegraded":"2024-05-10T08:40:21.793080+0000","last_fullsized":"2024-05-10T08:40:21.793080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794024+0000","last_change":"2024-05-10T08:40:14.717072+0000","last_active":"2024-05-10T08:40:21.794024+0000","last_peered":"2024-05-10T08:40:21.794024+0000","last_clean":"2024-05-10T08:40:21.794024+0000","last_became_active":"2024-05-10T08:40:14.716685+0000","last_became_peered":"2024-05-10T08:40:14.716685+0000","last_unstale":"2024-05-10T08:40:21.794024+0000","last_undegraded":"2024-05-10T08:40:21.794024+0000","last_fullsized":"2024-05-10T08:40:21.794024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737170+0000","last_change":"2024-05-10T08:40:20.251795+0000","last_active":"2024-05-10T08:40:21.737170+0000","last_peered":"2024-05-10T08:40:21.737170+0000","last_clean":"2024-05-10T08:40:21.737170+0000","last_became_active":"2024-05-10T08:40:20.251422+0000","last_became_peered":"2024-05-10T08:40:20.251422+0000","last_unstale":"2024-05-10T08:40:21.737170+0000","last_undegraded":"2024-05-10T08:40:21.737170+0000","last_fullsized":"2024-05-10T08:40:21.737170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:58.035145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791821+0000","last_change":"2024-05-10T08:40:20.251855+0000","last_active":"2024-05-10T08:40:21.791821+0000","last_peered":"2024-05-10T08:40:21.791821+0000","last_clean":"2024-05-10T08:40:21.791821+0000","last_became_active":"2024-05-10T08:40:20.251483+0000","last_became_peered":"2024-05-10T08:40:20.251483+0000","last_unstale":"2024-05-10T08:40:21.791821+0000","last_undegraded":"2024-05-10T08:40:21.791821+0000","last_fullsized":"2024-05-10T08:40:21.791821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735406+0000","last_change":"2024-05-10T08:40:15.733791+0000","last_active":"2024-05-10T08:40:21.735406+0000","last_peered":"2024-05-10T08:40:21.735406+0000","last_clean":"2024-05-10T08:40:21.735406+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.735406+0000","last_undegraded":"2024-05-10T08:40:21.735406+0000","last_fullsized":"2024-05-10T08:40:21.735406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792355+0000","last_change":"2024-05-10T08:40:14.713288+0000","last_active":"2024-05-10T08:40:21.792355+0000","last_peered":"2024-05-10T08:40:21.792355+0000","last_clean":"2024-05-10T08:40:21.792355+0000","last_became_active":"2024-05-10T08:40:14.713009+0000","last_became_peered":"2024-05-10T08:40:14.713009+0000","last_unstale":"2024-05-10T08:40:21.792355+0000","last_undegraded":"2024-05-10T08:40:21.792355+0000","last_fullsized":"2024-05-10T08:40:21.792355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793990+0000","last_change":"2024-05-10T08:40:19.758631+0000","last_active":"2024-05-10T08:40:21.793990+0000","last_peered":"2024-05-10T08:40:21.793990+0000","last_clean":"2024-05-10T08:40:21.793990+0000","last_became_active":"2024-05-10T08:40:19.758133+0000","last_became_peered":"2024-05-10T08:40:19.758133+0000","last_unstale":"2024-05-10T08:40:21.793990+0000","last_undegraded":"2024-05-10T08:40:21.793990+0000","last_fullsized":"2024-05-10T08:40:21.793990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736724+0000","last_change":"2024-05-10T08:40:15.733269+0000","last_active":"2024-05-10T08:40:21.736724+0000","last_peered":"2024-05-10T08:40:21.736724+0000","last_clean":"2024-05-10T08:40:21.736724+0000","last_became_active":"2024-05-10T08:40:15.732928+0000","last_became_peered":"2024-05-10T08:40:15.732928+0000","last_unstale":"2024-05-10T08:40:21.736724+0000","last_undegraded":"2024-05-10T08:40:21.736724+0000","last_fullsized":"2024-05-10T08:40:21.736724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737390+0000","last_change":"2024-05-10T08:40:14.716035+0000","last_active":"2024-05-10T08:40:21.737390+0000","last_peered":"2024-05-10T08:40:21.737390+0000","last_clean":"2024-05-10T08:40:21.737390+0000","last_became_active":"2024-05-10T08:40:14.715525+0000","last_became_peered":"2024-05-10T08:40:14.715525+0000","last_unstale":"2024-05-10T08:40:21.737390+0000","last_undegraded":"2024-05-10T08:40:21.737390+0000","last_fullsized":"2024-05-10T08:40:21.737390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793415+0000","last_change":"2024-05-10T08:40:14.716190+0000","last_active":"2024-05-10T08:40:21.793415+0000","last_peered":"2024-05-10T08:40:21.793415+0000","last_clean":"2024-05-10T08:40:21.793415+0000","last_became_active":"2024-05-10T08:40:14.715910+0000","last_became_peered":"2024-05-10T08:40:14.715910+0000","last_unstale":"2024-05-10T08:40:21.793415+0000","last_undegraded":"2024-05-10T08:40:21.793415+0000","last_fullsized":"2024-05-10T08:40:21.793415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792400+0000","last_change":"2024-05-10T08:40:15.721466+0000","last_active":"2024-05-10T08:40:21.792400+0000","last_peered":"2024-05-10T08:40:21.792400+0000","last_clean":"2024-05-10T08:40:21.792400+0000","last_became_active":"2024-05-10T08:40:15.721200+0000","last_became_peered":"2024-05-10T08:40:15.721200+0000","last_unstale":"2024-05-10T08:40:21.792400+0000","last_undegraded":"2024-05-10T08:40:21.792400+0000","last_fullsized":"2024-05-10T08:40:21.792400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791730+0000","last_change":"2024-05-10T08:40:19.755853+0000","last_active":"2024-05-10T08:40:21.791730+0000","last_peered":"2024-05-10T08:40:21.791730+0000","last_clean":"2024-05-10T08:40:21.791730+0000","last_became_active":"2024-05-10T08:40:19.755406+0000","last_became_peered":"2024-05-10T08:40:19.755406+0000","last_unstale":"2024-05-10T08:40:21.791730+0000","last_undegraded":"2024-05-10T08:40:21.791730+0000","last_fullsized":"2024-05-10T08:40:21.791730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:12.946445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736391+0000","last_change":"2024-05-10T08:40:14.720438+0000","last_active":"2024-05-10T08:40:21.736391+0000","last_peered":"2024-05-10T08:40:21.736391+0000","last_clean":"2024-05-10T08:40:21.736391+0000","last_became_active":"2024-05-10T08:40:14.720127+0000","last_became_peered":"2024-05-10T08:40:14.720127+0000","last_unstale":"2024-05-10T08:40:21.736391+0000","last_undegraded":"2024-05-10T08:40:21.736391+0000","last_fullsized":"2024-05-10T08:40:21.736391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736427+0000","last_change":"2024-05-10T08:40:15.707932+0000","last_active":"2024-05-10T08:40:21.736427+0000","last_peered":"2024-05-10T08:40:21.736427+0000","last_clean":"2024-05-10T08:40:21.736427+0000","last_became_active":"2024-05-10T08:40:15.707646+0000","last_became_peered":"2024-05-10T08:40:15.707646+0000","last_unstale":"2024-05-10T08:40:21.736427+0000","last_undegraded":"2024-05-10T08:40:21.736427+0000","last_fullsized":"2024-05-10T08:40:21.736427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:56.956134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736748+0000","last_change":"2024-05-10T08:40:19.751262+0000","last_active":"2024-05-10T08:40:21.736748+0000","last_peered":"2024-05-10T08:40:21.736748+0000","last_clean":"2024-05-10T08:40:21.736748+0000","last_became_active":"2024-05-10T08:40:19.750835+0000","last_became_peered":"2024-05-10T08:40:19.750835+0000","last_unstale":"2024-05-10T08:40:21.736748+0000","last_undegraded":"2024-05-10T08:40:21.736748+0000","last_fullsized":"2024-05-10T08:40:21.736748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:37.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792880+0000","last_change":"2024-05-10T08:40:15.726263+0000","last_active":"2024-05-10T08:40:21.792880+0000","last_peered":"2024-05-10T08:40:21.792880+0000","last_clean":"2024-05-10T08:40:21.792880+0000","last_became_active":"2024-05-10T08:40:15.725796+0000","last_became_peered":"2024-05-10T08:40:15.725796+0000","last_unstale":"2024-05-10T08:40:21.792880+0000","last_undegraded":"2024-05-10T08:40:21.792880+0000","last_fullsized":"2024-05-10T08:40:21.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791487+0000","last_change":"2024-05-10T08:40:15.722103+0000","last_active":"2024-05-10T08:40:21.791487+0000","last_peered":"2024-05-10T08:40:21.791487+0000","last_clean":"2024-05-10T08:40:21.791487+0000","last_became_active":"2024-05-10T08:40:15.721824+0000","last_became_peered":"2024-05-10T08:40:15.721824+0000","last_unstale":"2024-05-10T08:40:21.791487+0000","last_undegraded":"2024-05-10T08:40:21.791487+0000","last_fullsized":"2024-05-10T08:40:21.791487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793168+0000","last_change":"2024-05-10T08:40:15.730264+0000","last_active":"2024-05-10T08:40:21.793168+0000","last_peered":"2024-05-10T08:40:21.793168+0000","last_clean":"2024-05-10T08:40:21.793168+0000","last_became_active":"2024-05-10T08:40:15.729988+0000","last_became_peered":"2024-05-10T08:40:15.729988+0000","last_unstale":"2024-05-10T08:40:21.793168+0000","last_undegraded":"2024-05-10T08:40:21.793168+0000","last_fullsized":"2024-05-10T08:40:21.793168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792351+0000","last_change":"2024-05-10T08:40:15.722004+0000","last_active":"2024-05-10T08:40:21.792351+0000","last_peered":"2024-05-10T08:40:21.792351+0000","last_clean":"2024-05-10T08:40:21.792351+0000","last_became_active":"2024-05-10T08:40:15.721735+0000","last_became_peered":"2024-05-10T08:40:15.721735+0000","last_unstale":"2024-05-10T08:40:21.792351+0000","last_undegraded":"2024-05-10T08:40:21.792351+0000","last_fullsized":"2024-05-10T08:40:21.792351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736384+0000","last_change":"2024-05-10T08:40:15.733681+0000","last_active":"2024-05-10T08:40:21.736384+0000","last_peered":"2024-05-10T08:40:21.736384+0000","last_clean":"2024-05-10T08:40:21.736384+0000","last_became_active":"2024-05-10T08:40:15.730232+0000","last_became_peered":"2024-05-10T08:40:15.730232+0000","last_unstale":"2024-05-10T08:40:21.736384+0000","last_undegraded":"2024-05-10T08:40:21.736384+0000","last_fullsized":"2024-05-10T08:40:21.736384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735862+0000","last_change":"2024-05-10T08:40:15.721502+0000","last_active":"2024-05-10T08:40:21.735862+0000","last_peered":"2024-05-10T08:40:21.735862+0000","last_clean":"2024-05-10T08:40:21.735862+0000","last_became_active":"2024-05-10T08:40:15.721196+0000","last_became_peered":"2024-05-10T08:40:15.721196+0000","last_unstale":"2024-05-10T08:40:21.735862+0000","last_undegraded":"2024-05-10T08:40:21.735862+0000","last_fullsized":"2024-05-10T08:40:21.735862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794000+0000","last_change":"2024-05-10T08:40:15.719934+0000","last_active":"2024-05-10T08:40:21.794000+0000","last_peered":"2024-05-10T08:40:21.794000+0000","last_clean":"2024-05-10T08:40:21.794000+0000","last_became_active":"2024-05-10T08:40:15.719673+0000","last_became_peered":"2024-05-10T08:40:15.719673+0000","last_unstale":"2024-05-10T08:40:21.794000+0000","last_undegraded":"2024-05-10T08:40:21.794000+0000","last_fullsized":"2024-05-10T08:40:21.794000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737224+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.737224+0000","last_peered":"2024-05-10T08:40:21.737224+0000","last_clean":"2024-05-10T08:40:21.737224+0000","last_became_active":"2024-05-10T08:40:15.726438+0000","last_became_peered":"2024-05-10T08:40:15.726438+0000","last_unstale":"2024-05-10T08:40:21.737224+0000","last_undegraded":"2024-05-10T08:40:21.737224+0000","last_fullsized":"2024-05-10T08:40:21.737224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792352+0000","last_change":"2024-05-10T08:40:15.730586+0000","last_active":"2024-05-10T08:40:21.792352+0000","last_peered":"2024-05-10T08:40:21.792352+0000","last_clean":"2024-05-10T08:40:21.792352+0000","last_became_active":"2024-05-10T08:40:15.730214+0000","last_became_peered":"2024-05-10T08:40:15.730214+0000","last_unstale":"2024-05-10T08:40:21.792352+0000","last_undegraded":"2024-05-10T08:40:21.792352+0000","last_fullsized":"2024-05-10T08:40:21.792352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737367+0000","last_change":"2024-05-10T08:40:15.729639+0000","last_active":"2024-05-10T08:40:21.737367+0000","last_peered":"2024-05-10T08:40:21.737367+0000","last_clean":"2024-05-10T08:40:21.737367+0000","last_became_active":"2024-05-10T08:40:15.722616+0000","last_became_peered":"2024-05-10T08:40:15.722616+0000","last_unstale":"2024-05-10T08:40:21.737367+0000","last_undegraded":"2024-05-10T08:40:21.737367+0000","last_fullsized":"2024-05-10T08:40:21.737367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793084+0000","last_change":"2024-05-10T08:40:15.730859+0000","last_active":"2024-05-10T08:40:21.793084+0000","last_peered":"2024-05-10T08:40:21.793084+0000","last_clean":"2024-05-10T08:40:21.793084+0000","last_became_active":"2024-05-10T08:40:15.730568+0000","last_became_peered":"2024-05-10T08:40:15.730568+0000","last_unstale":"2024-05-10T08:40:21.793084+0000","last_undegraded":"2024-05-10T08:40:21.793084+0000","last_fullsized":"2024-05-10T08:40:21.793084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792243+0000","last_change":"2024-05-10T08:40:15.732254+0000","last_active":"2024-05-10T08:40:21.792243+0000","last_peered":"2024-05-10T08:40:21.792243+0000","last_clean":"2024-05-10T08:40:21.792243+0000","last_became_active":"2024-05-10T08:40:15.731908+0000","last_became_peered":"2024-05-10T08:40:15.731908+0000","last_unstale":"2024-05-10T08:40:21.792243+0000","last_undegraded":"2024-05-10T08:40:21.792243+0000","last_fullsized":"2024-05-10T08:40:21.792243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793673+0000","last_change":"2024-05-10T08:40:15.719640+0000","last_active":"2024-05-10T08:40:21.793673+0000","last_peered":"2024-05-10T08:40:21.793673+0000","last_clean":"2024-05-10T08:40:21.793673+0000","last_became_active":"2024-05-10T08:40:15.719365+0000","last_became_peered":"2024-05-10T08:40:15.719365+0000","last_unstale":"2024-05-10T08:40:21.793673+0000","last_undegraded":"2024-05-10T08:40:21.793673+0000","last_fullsized":"2024-05-10T08:40:21.793673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794444+0000","last_change":"2024-05-10T08:40:15.720838+0000","last_active":"2024-05-10T08:40:21.794444+0000","last_peered":"2024-05-10T08:40:21.794444+0000","last_clean":"2024-05-10T08:40:21.794444+0000","last_became_active":"2024-05-10T08:40:15.720001+0000","last_became_peered":"2024-05-10T08:40:15.720001+0000","last_unstale":"2024-05-10T08:40:21.794444+0000","last_undegraded":"2024-05-10T08:40:21.794444+0000","last_fullsized":"2024-05-10T08:40:21.794444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:33.337354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792361+0000","last_change":"2024-05-10T08:40:15.718557+0000","last_active":"2024-05-10T08:40:21.792361+0000","last_peered":"2024-05-10T08:40:21.792361+0000","last_clean":"2024-05-10T08:40:21.792361+0000","last_became_active":"2024-05-10T08:40:15.718245+0000","last_became_peered":"2024-05-10T08:40:15.718245+0000","last_unstale":"2024-05-10T08:40:21.792361+0000","last_undegraded":"2024-05-10T08:40:21.792361+0000","last_fullsized":"2024-05-10T08:40:21.792361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:58.260494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793531+0000","last_change":"2024-05-10T08:40:15.731367+0000","last_active":"2024-05-10T08:40:21.793531+0000","last_peered":"2024-05-10T08:40:21.793531+0000","last_clean":"2024-05-10T08:40:21.793531+0000","last_became_active":"2024-05-10T08:40:15.731074+0000","last_became_peered":"2024-05-10T08:40:15.731074+0000","last_unstale":"2024-05-10T08:40:21.793531+0000","last_undegraded":"2024-05-10T08:40:21.793531+0000","last_fullsized":"2024-05-10T08:40:21.793531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792246+0000","last_change":"2024-05-10T08:40:15.732380+0000","last_active":"2024-05-10T08:40:21.792246+0000","last_peered":"2024-05-10T08:40:21.792246+0000","last_clean":"2024-05-10T08:40:21.792246+0000","last_became_active":"2024-05-10T08:40:15.732090+0000","last_became_peered":"2024-05-10T08:40:15.732090+0000","last_unstale":"2024-05-10T08:40:21.792246+0000","last_undegraded":"2024-05-10T08:40:21.792246+0000","last_fullsized":"2024-05-10T08:40:21.792246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735458+0000","last_change":"2024-05-10T08:40:15.710587+0000","last_active":"2024-05-10T08:40:21.735458+0000","last_peered":"2024-05-10T08:40:21.735458+0000","last_clean":"2024-05-10T08:40:21.735458+0000","last_became_active":"2024-05-10T08:40:15.710276+0000","last_became_peered":"2024-05-10T08:40:15.710276+0000","last_unstale":"2024-05-10T08:40:21.735458+0000","last_undegraded":"2024-05-10T08:40:21.735458+0000","last_fullsized":"2024-05-10T08:40:21.735458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792150+0000","last_change":"2024-05-10T08:40:15.725581+0000","last_active":"2024-05-10T08:40:21.792150+0000","last_peered":"2024-05-10T08:40:21.792150+0000","last_clean":"2024-05-10T08:40:21.792150+0000","last_became_active":"2024-05-10T08:40:15.725302+0000","last_became_peered":"2024-05-10T08:40:15.725302+0000","last_unstale":"2024-05-10T08:40:21.792150+0000","last_undegraded":"2024-05-10T08:40:21.792150+0000","last_fullsized":"2024-05-10T08:40:21.792150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736194+0000","last_change":"2024-05-10T08:40:15.719950+0000","last_active":"2024-05-10T08:40:21.736194+0000","last_peered":"2024-05-10T08:40:21.736194+0000","last_clean":"2024-05-10T08:40:21.736194+0000","last_became_active":"2024-05-10T08:40:15.719681+0000","last_became_peered":"2024-05-10T08:40:15.719681+0000","last_unstale":"2024-05-10T08:40:21.736194+0000","last_undegraded":"2024-05-10T08:40:21.736194+0000","last_fullsized":"2024-05-10T08:40:21.736194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736919+0000","last_change":"2024-05-10T08:40:15.716857+0000","last_active":"2024-05-10T08:40:21.736919+0000","last_peered":"2024-05-10T08:40:21.736919+0000","last_clean":"2024-05-10T08:40:21.736919+0000","last_became_active":"2024-05-10T08:40:15.716582+0000","last_became_peered":"2024-05-10T08:40:15.716582+0000","last_unstale":"2024-05-10T08:40:21.736919+0000","last_undegraded":"2024-05-10T08:40:21.736919+0000","last_fullsized":"2024-05-10T08:40:21.736919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:27.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793884+0000","last_change":"2024-05-10T08:40:15.728928+0000","last_active":"2024-05-10T08:40:21.793884+0000","last_peered":"2024-05-10T08:40:21.793884+0000","last_clean":"2024-05-10T08:40:21.793884+0000","last_became_active":"2024-05-10T08:40:15.728156+0000","last_became_peered":"2024-05-10T08:40:15.728156+0000","last_unstale":"2024-05-10T08:40:21.793884+0000","last_undegraded":"2024-05-10T08:40:21.793884+0000","last_fullsized":"2024-05-10T08:40:21.793884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793898+0000","last_change":"2024-05-10T08:40:15.722176+0000","last_active":"2024-05-10T08:40:21.793898+0000","last_peered":"2024-05-10T08:40:21.793898+0000","last_clean":"2024-05-10T08:40:21.793898+0000","last_became_active":"2024-05-10T08:40:15.721908+0000","last_became_peered":"2024-05-10T08:40:15.721908+0000","last_unstale":"2024-05-10T08:40:21.793898+0000","last_undegraded":"2024-05-10T08:40:21.793898+0000","last_fullsized":"2024-05-10T08:40:21.793898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794390+0000","last_change":"2024-05-10T08:40:15.725446+0000","last_active":"2024-05-10T08:40:21.794390+0000","last_peered":"2024-05-10T08:40:21.794390+0000","last_clean":"2024-05-10T08:40:21.794390+0000","last_became_active":"2024-05-10T08:40:15.725178+0000","last_became_peered":"2024-05-10T08:40:15.725178+0000","last_unstale":"2024-05-10T08:40:21.794390+0000","last_undegraded":"2024-05-10T08:40:21.794390+0000","last_fullsized":"2024-05-10T08:40:21.794390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:54.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736627+0000","last_change":"2024-05-10T08:40:15.730664+0000","last_active":"2024-05-10T08:40:21.736627+0000","last_peered":"2024-05-10T08:40:21.736627+0000","last_clean":"2024-05-10T08:40:21.736627+0000","last_became_active":"2024-05-10T08:40:15.729235+0000","last_became_peered":"2024-05-10T08:40:15.729235+0000","last_unstale":"2024-05-10T08:40:21.736627+0000","last_undegraded":"2024-05-10T08:40:21.736627+0000","last_fullsized":"2024-05-10T08:40:21.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792606+0000","last_change":"2024-05-10T08:40:15.727662+0000","last_active":"2024-05-10T08:40:21.792606+0000","last_peered":"2024-05-10T08:40:21.792606+0000","last_clean":"2024-05-10T08:40:21.792606+0000","last_became_active":"2024-05-10T08:40:15.727391+0000","last_became_peered":"2024-05-10T08:40:15.727391+0000","last_unstale":"2024-05-10T08:40:21.792606+0000","last_undegraded":"2024-05-10T08:40:21.792606+0000","last_fullsized":"2024-05-10T08:40:21.792606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793064+0000","last_change":"2024-05-10T08:40:15.726033+0000","last_active":"2024-05-10T08:40:21.793064+0000","last_peered":"2024-05-10T08:40:21.793064+0000","last_clean":"2024-05-10T08:40:21.793064+0000","last_became_active":"2024-05-10T08:40:15.725410+0000","last_became_peered":"2024-05-10T08:40:15.725410+0000","last_unstale":"2024-05-10T08:40:21.793064+0000","last_undegraded":"2024-05-10T08:40:21.793064+0000","last_fullsized":"2024-05-10T08:40:21.793064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793970+0000","last_change":"2024-05-10T08:40:15.721088+0000","last_active":"2024-05-10T08:40:21.793970+0000","last_peered":"2024-05-10T08:40:21.793970+0000","last_clean":"2024-05-10T08:40:21.793970+0000","last_became_active":"2024-05-10T08:40:15.720831+0000","last_became_peered":"2024-05-10T08:40:15.720831+0000","last_unstale":"2024-05-10T08:40:21.793970+0000","last_undegraded":"2024-05-10T08:40:21.793970+0000","last_fullsized":"2024-05-10T08:40:21.793970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792673+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792673+0000","last_peered":"2024-05-10T08:40:21.792673+0000","last_clean":"2024-05-10T08:40:21.792673+0000","last_became_active":"2024-05-10T08:40:15.737931+0000","last_became_peered":"2024-05-10T08:40:15.737931+0000","last_unstale":"2024-05-10T08:40:21.792673+0000","last_undegraded":"2024-05-10T08:40:21.792673+0000","last_fullsized":"2024-05-10T08:40:21.792673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791744+0000","last_change":"2024-05-10T08:40:15.723463+0000","last_active":"2024-05-10T08:40:21.791744+0000","last_peered":"2024-05-10T08:40:21.791744+0000","last_clean":"2024-05-10T08:40:21.791744+0000","last_became_active":"2024-05-10T08:40:15.723178+0000","last_became_peered":"2024-05-10T08:40:15.723178+0000","last_unstale":"2024-05-10T08:40:21.791744+0000","last_undegraded":"2024-05-10T08:40:21.791744+0000","last_fullsized":"2024-05-10T08:40:21.791744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736554+0000","last_change":"2024-05-10T08:40:15.724998+0000","last_active":"2024-05-10T08:40:21.736554+0000","last_peered":"2024-05-10T08:40:21.736554+0000","last_clean":"2024-05-10T08:40:21.736554+0000","last_became_active":"2024-05-10T08:40:15.724639+0000","last_became_peered":"2024-05-10T08:40:15.724639+0000","last_unstale":"2024-05-10T08:40:21.736554+0000","last_undegraded":"2024-05-10T08:40:21.736554+0000","last_fullsized":"2024-05-10T08:40:21.736554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794309+0000","last_change":"2024-05-10T08:40:15.723566+0000","last_active":"2024-05-10T08:40:21.794309+0000","last_peered":"2024-05-10T08:40:21.794309+0000","last_clean":"2024-05-10T08:40:21.794309+0000","last_became_active":"2024-05-10T08:40:15.719857+0000","last_became_peered":"2024-05-10T08:40:15.719857+0000","last_unstale":"2024-05-10T08:40:21.794309+0000","last_undegraded":"2024-05-10T08:40:21.794309+0000","last_fullsized":"2024-05-10T08:40:21.794309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:42.339941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2859,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":697957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":109068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":109068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":107007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:40:30.165 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:40:30.166 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T08:40:30.166 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T08:40:30.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T08:40:30.166 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T08:40:30.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.305+0000 7fb801464640 1 Processor -- start 2024-05-10T08:40:30.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.305+0000 7fb801464640 1 -- start start 2024-05-10T08:40:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb801464640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc0d0ec0 0x7fb7fc0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb801464640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb7fc0d3b00 0x7fb7fc0b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb801464640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc0d1760 con 0x7fb7fc15f380 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb801464640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb7fc0d30f0 con 0x7fb7fc0d3b00 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb801464640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc0d2370 con 0x7fb7fc0d0ec0 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb7faffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb7fc15f380 0x7fb7fc0d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40860/0 (socket says 172.21.15.37:40860) 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb7faffd640 1 -- 172.21.15.37:0/2392437847 learned_addr learned my addr 172.21.15.37:0/2392437847 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/2392437847 >> v2:172.21.15.82:3300/0 conn(0x7fb7fc0d3b00 0x7fb7fc0b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb7fa7fc640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc0d0ec0 0x7fb7fc0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006691236 0 0) 0x7fb7fc0d1760 con 0x7fb7fc15f380 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.306+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e8003520 con 0x7fb7fc15f380 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2300487428 0 0) 0x7fb7e8003520 con 0x7fb7fc15f380 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc0d0ec0 msgr2=0x7fb7fc0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc0d0ec0 0x7fb7fc0d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 >> v2:172.21.15.82:3300/0 conn(0x7fb7fc0d3b00 msgr2=0x7fb7fc0b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 --2- 172.21.15.37:0/2392437847 >> v2:172.21.15.82:3300/0 conn(0x7fb7fc0d3b00 0x7fb7fc0b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc0d1a40 con 0x7fb7fc15f380 2024-05-10T08:40:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fb7f40019f0 con 0x7fb7fc15f380 2024-05-10T08:40:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/2392437847 >> v2:172.21.15.82:3300/0 conn(0x7fb7fc0d3b00 0x7fb7fc0b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 >> v1:172.21.15.37:6789/0 conn(0x7fb7fc15f380 legacy=0x7fb7fc0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7e80039b0 0x7fb7e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e80043a0 0x7fb7e8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8004ef0 0x7fb7e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc0d30f0 con 0x7fb7e8004ef0 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc0d2370 con 0x7fb7e80043a0 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e800bf00 con 0x7fb7e80039b0 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fa7fc640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc0d0ec0 0x7fb7fc0d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8004ef0 0x7fb7e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7faffd640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7e80039b0 0x7fb7e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fa7fc640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e80043a0 0x7fb7e8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7e80039b0 msgr2=0x7fb7e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7e80039b0 0x7fb7e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e80043a0 msgr2=0x7fb7e8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e80043a0 0x7fb7e8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/2392437847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8003520 con 0x7fb7e8004ef0 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7faffd640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7e80039b0 0x7fb7e8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.307+0000 7fb7fa7fc640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e80043a0 0x7fb7e8004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.308+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8004ef0 0x7fb7e800b9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009c90 tx=0x7fb7e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0d3fbdf7761b2e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.308+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec036070 con 0x7fb7e8004ef0 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.308+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec031400 con 0x7fb7e8004ef0 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.308+0000 7fb7f9ffb640 1 -- 172.21.15.37:0/2392437847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec009860 con 0x7fb7e8004ef0 2024-05-10T08:40:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.308+0000 7fb801464640 1 -- 172.21.15.37:0/2392437847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8004ef0 msgr2=0x7fb7e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.308+0000 7fb801464640 1 --2- 172.21.15.37:0/2392437847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e8004ef0 0x7fb7e800b9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009c90 tx=0x7fb7e8005830 comp rx=0 tx=0).stop 2024-05-10T08:40:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.308+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/2392437847 reap_dead start 2024-05-10T08:40:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.309+0000 7fb801464640 1 -- 172.21.15.37:0/2392437847 shutdown_connections 2024-05-10T08:40:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.309+0000 7fb801464640 1 -- 172.21.15.37:0/2392437847 >> 172.21.15.37:0/2392437847 conn(0x7fb7fc0d4fe0 msgr2=0x7fb7fc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.309+0000 7fb801464640 1 -- 172.21.15.37:0/2392437847 shutdown_connections 2024-05-10T08:40:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.309+0000 7fb801464640 1 -- 172.21.15.37:0/2392437847 wait complete. 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.310+0000 7fb801464640 1 Processor -- start 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.310+0000 7fb801464640 1 -- start start 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb801464640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e8004ef0 0x7fb7fc0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb801464640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc1f5c10 0x7fb7fc158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb801464640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7fc1f9160 0x7fb7fc0b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb801464640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc15f760 con 0x7fb7fc1f9160 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb801464640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc0d2000 con 0x7fb7e8004ef0 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb801464640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc0d2800 con 0x7fb7fc1f5c10 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7fc1f9160 0x7fb7fc0b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7fc1f9160 0x7fb7fc0b9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57836/0 (socket says 172.21.15.37:57836) 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/1778559434 learned_addr learned my addr 172.21.15.37:0/1778559434 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7faffd640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e8004ef0 0x7fb7fc0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fa7fc640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc1f5c10 0x7fb7fc158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc1f5c10 msgr2=0x7fb7fc158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc1f5c10 0x7fb7fc158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e8004ef0 msgr2=0x7fb7fc0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e8004ef0 0x7fb7fc0cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 -- 172.21.15.37:0/1778559434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc0ce820 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.311+0000 7fb7fb7fe640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7fc1f9160 0x7fb7fc0b9d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec034040 tx=0x7fb7ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.312+0000 7fb7f37fe640 1 -- 172.21.15.37:0/1778559434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec036040 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.312+0000 7fb7f37fe640 1 -- 172.21.15.37:0/1778559434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec043070 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.312+0000 7fb7f37fe640 1 -- 172.21.15.37:0/1778559434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec009860 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.312+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7fc1f5130 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.312+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7fc0ce480 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.313+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7fc0693f0 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.313+0000 7fb7f37fe640 1 -- 172.21.15.37:0/1778559434 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb7ec039070 con 0x7fb7fc1f9160 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.314+0000 7fb7f37fe640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7dc0762d0 0x7fb7dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.314+0000 7fb7f37fe640 1 -- 172.21.15.37:0/1778559434 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7ec0b7850 con 0x7fb7fc1f9160 2024-05-10T08:40:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.314+0000 7fb7faffd640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7dc0762d0 0x7fb7dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.314+0000 7fb7faffd640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7dc0762d0 0x7fb7dc078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4000f80 tx=0x7fb7f40017b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.318+0000 7fb7f37fe640 1 -- 172.21.15.37:0/1778559434 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb7ec080790 con 0x7fb7fc1f9160 2024-05-10T08:40:30.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.558+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb7fc08cfd0 con 0x7fb7fc1f9160 2024-05-10T08:40:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.561+0000 7fb7f37fe640 1 -- 172.21.15.37:0/1778559434 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189521 (secure 0 0 0) 0x7fb7ec084a90 con 0x7fb7fc1f9160 2024-05-10T08:40:30.563 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:30.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7dc0762d0 msgr2=0x7fb7dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7dc0762d0 0x7fb7dc078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4000f80 tx=0x7fb7f40017b0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7fc1f9160 msgr2=0x7fb7fc0b9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7fc1f9160 0x7fb7fc0b9d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec034040 tx=0x7fb7ec004730 comp rx=0 tx=0).stop 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 shutdown_connections 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7dc0762d0 0x7fb7dc078790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7fc1f9160 0x7fb7fc0b9d00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7fc1f5c10 0x7fb7fc158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 --2- 172.21.15.37:0/1778559434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e8004ef0 0x7fb7fc0cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 >> 172.21.15.37:0/1778559434 conn(0x7fb7fc0d4fe0 msgr2=0x7fb7fc0c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 shutdown_connections 2024-05-10T08:40:30.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.564+0000 7fb801464640 1 -- 172.21.15.37:0/1778559434 wait complete. 2024-05-10T08:40:30.574 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2336330207},{"type":"v1","addr":"172.21.15.82:6833","nonce":2336330207}]},"active_addr":"172.21.15.82:6833/2336330207","active_change":"2024-05-10T08:40:03.313662+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1218473583}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1728088213}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":4161003449}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2613551584}]}]} 2024-05-10T08:40:30.577 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T08:40:30.577 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T08:40:30.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.718+0000 7f0c5c6da640 1 Processor -- start 2024-05-10T08:40:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.718+0000 7f0c5c6da640 1 -- start start 2024-05-10T08:40:30.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.719+0000 7f0c5c6da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c5415f2d0 0x7f0c540b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.719+0000 7f0c5c6da640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c540d2730 con 0x7f0c540d2310 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.719+0000 7f0c5c6da640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c541606c0 con 0x7f0c540d4fc0 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.719+0000 7f0c5c6da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0c540b5810 con 0x7f0c5415f2d0 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.719+0000 7f0c5a476640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c5415f2d0 0x7f0c540b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.720+0000 7f0c5a476640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c5415f2d0 0x7f0c540b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57846/0 (socket says 172.21.15.37:57846) 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.720+0000 7f0c5ac77640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0c540d2310 0x7f0c540d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40872/0 (socket says 172.21.15.37:40872) 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.720+0000 7f0c5a476640 1 -- 172.21.15.37:0/468558058 learned_addr learned my addr 172.21.15.37:0/468558058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.720+0000 7f0c5a476640 1 -- 172.21.15.37:0/468558058 >> v1:172.21.15.82:6789/0 conn(0x7f0c540d4fc0 legacy=0x7f0c540d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.720+0000 7f0c5a476640 1 -- 172.21.15.37:0/468558058 >> v1:172.21.15.37:6789/0 conn(0x7f0c540d2310 legacy=0x7f0c540d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.720+0000 7f0c59474640 1 -- 172.21.15.37:0/468558058 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007041745 0 0) 0x7f0c540d2730 con 0x7f0c540d2310 2024-05-10T08:40:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.720+0000 7f0c5a476640 1 -- 172.21.15.37:0/468558058 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c540b4f00 con 0x7f0c5415f2d0 2024-05-10T08:40:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.721+0000 7f0c5a476640 1 --2- 172.21.15.37:0/468558058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5415f2d0 0x7f0c540b5ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009870 tx=0x7f0c5002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1123d39a49d75a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.721+0000 7f0c59474640 1 -- 172.21.15.37:0/468558058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50037070 con 0x7f0c5415f2d0 2024-05-10T08:40:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.721+0000 7f0c59474640 1 -- 172.21.15.37:0/468558058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5002ae50 con 0x7f0c5415f2d0 2024-05-10T08:40:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.721+0000 7f0c59474640 1 -- 172.21.15.37:0/468558058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50032860 con 0x7f0c5415f2d0 2024-05-10T08:40:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.721+0000 7f0c5c6da640 1 -- 172.21.15.37:0/468558058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5415f2d0 msgr2=0x7f0c540b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.721+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/468558058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5415f2d0 0x7f0c540b5ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009870 tx=0x7f0c5002a300 comp rx=0 tx=0).stop 2024-05-10T08:40:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.722+0000 7f0c5c6da640 1 -- 172.21.15.37:0/468558058 shutdown_connections 2024-05-10T08:40:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.722+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/468558058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5415f2d0 0x7f0c540b5ca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.722+0000 7f0c5c6da640 1 -- 172.21.15.37:0/468558058 >> 172.21.15.37:0/468558058 conn(0x7f0c540746d0 msgr2=0x7f0c5409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.722+0000 7f0c5c6da640 1 -- 172.21.15.37:0/468558058 shutdown_connections 2024-05-10T08:40:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.722+0000 7f0c5c6da640 1 -- 172.21.15.37:0/468558058 wait complete. 2024-05-10T08:40:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.723+0000 7f0c5c6da640 1 Processor -- start 2024-05-10T08:40:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.723+0000 7f0c5c6da640 1 -- start start 2024-05-10T08:40:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c540d2310 0x7f0c540ba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c540d4fc0 0x7f0c540b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415f2d0 0x7f0c5414d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c540d5420 con 0x7f0c540d4fc0 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c540b54a0 con 0x7f0c540d2310 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0c540d55a0 con 0x7f0c5415f2d0 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c540d4fc0 0x7f0c540b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c540d4fc0 0x7f0c540b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57856/0 (socket says 172.21.15.37:57856) 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 -- 172.21.15.37:0/2853363334 learned_addr learned my addr 172.21.15.37:0/2853363334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5a476640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c540d2310 0x7f0c540ba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5ac77640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415f2d0 0x7f0c5414d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 -- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415f2d0 msgr2=0x7f0c5414d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415f2d0 0x7f0c5414d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 -- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c540d2310 msgr2=0x7f0c540ba7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c540d2310 0x7f0c540ba7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 -- 172.21.15.37:0/2853363334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5414c580 con 0x7f0c540d4fc0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c59c75640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c540d4fc0 0x7f0c540b1c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c400 tx=0x7f0c4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c4affd640 1 -- 172.21.15.37:0/2853363334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44017070 con 0x7f0c540d4fc0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c4affd640 1 -- 172.21.15.37:0/2853363334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c440052f0 con 0x7f0c540d4fc0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5414c860 con 0x7f0c540d4fc0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c4affd640 1 -- 172.21.15.37:0/2853363334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44003830 con 0x7f0c540d4fc0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.724+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5414ce20 con 0x7f0c540d4fc0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.725+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c54069b00 con 0x7f0c540d4fc0 2024-05-10T08:40:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.726+0000 7f0c4affd640 1 -- 172.21.15.37:0/2853363334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c4401a070 con 0x7f0c540d4fc0 2024-05-10T08:40:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.726+0000 7f0c4affd640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0c380762d0 0x7f0c38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.727+0000 7f0c4affd640 1 -- 172.21.15.37:0/2853363334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c44096c20 con 0x7f0c540d4fc0 2024-05-10T08:40:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.727+0000 7f0c5a476640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0c380762d0 0x7f0c38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:30.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.727+0000 7f0c5a476640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0c380762d0 0x7f0c38078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c50034000 tx=0x7f0c5002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:30.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.731+0000 7f0c4affd640 1 -- 172.21.15.37:0/2853363334 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0c4405fc80 con 0x7f0c540d4fc0 2024-05-10T08:40:30.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.922+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c5415e580 con 0x7f0c540d4fc0 2024-05-10T08:40:30.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.924+0000 7f0c4affd640 1 -- 172.21.15.37:0/2853363334 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f0c440682c0 con 0x7f0c540d4fc0 2024-05-10T08:40:30.923 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:30.923 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.925+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0c380762d0 msgr2=0x7f0c38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.925+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0c380762d0 0x7f0c38078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c50034000 tx=0x7f0c5002e000 comp rx=0 tx=0).stop 2024-05-10T08:40:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.925+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c540d4fc0 msgr2=0x7f0c540b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.925+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c540d4fc0 0x7f0c540b1c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c400 tx=0x7f0c4400c8c0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.925+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 shutdown_connections 2024-05-10T08:40:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.925+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0c380762d0 0x7f0c38078790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.926+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0c5415f2d0 0x7f0c5414d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.926+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c540d4fc0 0x7f0c540b1c40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.926+0000 7f0c5c6da640 1 --2- 172.21.15.37:0/2853363334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c540d2310 0x7f0c540ba7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.926+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 >> 172.21.15.37:0/2853363334 conn(0x7f0c540746d0 msgr2=0x7f0c540d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.926+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 shutdown_connections 2024-05-10T08:40:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:30.926+0000 7f0c5c6da640 1 -- 172.21.15.37:0/2853363334 wait complete. 2024-05-10T08:40:30.937 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T08:40:30.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.041+0000 7f46d9493640 1 Processor -- start 2024-05-10T08:40:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.041+0000 7f46d9493640 1 -- start start 2024-05-10T08:40:31.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d9493640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 0x7f46d40d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d9493640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46d40d3b00 0x7f46d40b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d9493640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d40d1760 con 0x7f46d415f380 2024-05-10T08:40:31.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d9493640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f46d40d30f0 con 0x7f46d40d3b00 2024-05-10T08:40:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d9493640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40d2370 con 0x7f46d40d0ec0 2024-05-10T08:40:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f46d415f380 0x7f46d40d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40884/0 (socket says 172.21.15.37:40884) 2024-05-10T08:40:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d2ffd640 1 -- 172.21.15.37:0/397186741 learned_addr learned my addr 172.21.15.37:0/397186741 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d37fe640 1 --2- 172.21.15.37:0/397186741 >> v2:172.21.15.82:3300/0 conn(0x7f46d40d3b00 0x7f46d40b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1429052086 0 0) 0x7f46d40d1760 con 0x7f46d415f380 2024-05-10T08:40:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46cbfff640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 0x7f46d40d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46c0003520 con 0x7f46d415f380 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317450572 0 0) 0x7f46c0003520 con 0x7f46d415f380 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 msgr2=0x7f46d40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 0x7f46d40d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 >> v2:172.21.15.82:3300/0 conn(0x7f46d40d3b00 msgr2=0x7f46d40b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 --2- 172.21.15.37:0/397186741 >> v2:172.21.15.82:3300/0 conn(0x7f46d40d3b00 0x7f46d40b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d40d1a40 con 0x7f46d415f380 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f46c4001670 con 0x7f46d415f380 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 >> v1:172.21.15.37:6789/0 conn(0x7f46d415f380 legacy=0x7f46d40d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c00039b0 0x7f46c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 0x7f46c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c0004d40 0x7f46c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40d30f0 con 0x7f46c0004d40 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40d2370 con 0x7f46c00039b0 2024-05-10T08:40:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.042+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46c000b9c0 con 0x7f46d40d0ec0 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46d2ffd640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c00039b0 0x7f46c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46d37fe640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c0004d40 0x7f46c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46cbfff640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 0x7f46c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46d37fe640 1 -- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 msgr2=0x7f46c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46d37fe640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d40d0ec0 0x7f46c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46d37fe640 1 -- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c00039b0 msgr2=0x7f46c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46d37fe640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c00039b0 0x7f46c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.043+0000 7f46d37fe640 1 -- 172.21.15.37:0/397186741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c0003520 con 0x7f46c0004d40 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d37fe640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c0004d40 0x7f46c00051c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009fc0 tx=0x7f46c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06a967909d22c20 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc009c10 con 0x7f46c0004d40 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc036070 con 0x7f46c0004d40 2024-05-10T08:40:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d27fc640 1 -- 172.21.15.37:0/397186741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc02d070 con 0x7f46c0004d40 2024-05-10T08:40:31.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d9493640 1 -- 172.21.15.37:0/397186741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c0004d40 msgr2=0x7f46c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d9493640 1 --2- 172.21.15.37:0/397186741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c0004d40 0x7f46c00051c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009fc0 tx=0x7f46c0005830 comp rx=0 tx=0).stop 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d37fe640 1 -- 172.21.15.37:0/397186741 reap_dead start 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d9493640 1 -- 172.21.15.37:0/397186741 shutdown_connections 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d9493640 1 -- 172.21.15.37:0/397186741 >> 172.21.15.37:0/397186741 conn(0x7f46d40d4fe0 msgr2=0x7f46d40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d9493640 1 -- 172.21.15.37:0/397186741 shutdown_connections 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.044+0000 7f46d9493640 1 -- 172.21.15.37:0/397186741 wait complete. 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.045+0000 7f46d9493640 1 Processor -- start 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d9493640 1 -- start start 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d9493640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c0004d40 0x7f46d414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d9493640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d40b9b30 0x7f46d40b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d9493640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d41f7cd0 0x7f46d41f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d9493640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46d415f760 con 0x7f46d40b9b30 2024-05-10T08:40:31.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d9493640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40d2000 con 0x7f46d41f7cd0 2024-05-10T08:40:31.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d9493640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40d2800 con 0x7f46c0004d40 2024-05-10T08:40:31.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d40b9b30 0x7f46d40b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d40b9b30 0x7f46d40b9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57876/0 (socket says 172.21.15.37:57876) 2024-05-10T08:40:31.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46cbfff640 1 -- 172.21.15.37:0/3970368691 learned_addr learned my addr 172.21.15.37:0/3970368691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.046+0000 7f46d37fe640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d41f7cd0 0x7f46d41f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46d2ffd640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c0004d40 0x7f46d414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cbfff640 1 -- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c0004d40 msgr2=0x7f46d414e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cbfff640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c0004d40 0x7f46d414e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cbfff640 1 -- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d41f7cd0 msgr2=0x7f46d41f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cbfff640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d41f7cd0 0x7f46d41f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cbfff640 1 -- 172.21.15.37:0/3970368691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d414ecd0 con 0x7f46d40b9b30 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46d2ffd640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c0004d40 0x7f46d414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:31.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46d37fe640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d41f7cd0 0x7f46d41f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cbfff640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d40b9b30 0x7f46d40b9f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46bc011910 tx=0x7f46bc011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cb7fe640 1 -- 172.21.15.37:0/3970368691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc019070 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cb7fe640 1 -- 172.21.15.37:0/3970368691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46bc004240 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46cb7fe640 1 -- 172.21.15.37:0/3970368691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00f8e0 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d414efb0 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.047+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d414f570 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.048+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d40693f0 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.049+0000 7f46cb7fe640 1 -- 172.21.15.37:0/3970368691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46bc01c070 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.049+0000 7f46cb7fe640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b4076300 0x7f46b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.049+0000 7f46cb7fe640 1 -- 172.21.15.37:0/3970368691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f46bc097e20 con 0x7f46d40b9b30 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.049+0000 7f46d2ffd640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b4076300 0x7f46b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.050+0000 7f46d2ffd640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b4076300 0x7f46b40787c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46c4007e10 tx=0x7f46c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.054+0000 7f46cb7fe640 1 -- 172.21.15.37:0/3970368691 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f46bc061440 con 0x7f46d40b9b30 2024-05-10T08:40:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.245+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46d408cfd0 con 0x7f46d40b9b30 2024-05-10T08:40:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.246+0000 7f46cb7fe640 1 -- 172.21.15.37:0/3970368691 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f46bc094830 con 0x7f46d40b9b30 2024-05-10T08:40:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:31.246 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b4076300 msgr2=0x7f46b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b4076300 0x7f46b40787c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46c4007e10 tx=0x7f46c4009040 comp rx=0 tx=0).stop 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d40b9b30 msgr2=0x7f46d40b9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d40b9b30 0x7f46d40b9f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46bc011910 tx=0x7f46bc011dd0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 shutdown_connections 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b4076300 0x7f46b40787c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d41f7cd0 0x7f46d41f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d40b9b30 0x7f46d40b9f90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 --2- 172.21.15.37:0/3970368691 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c0004d40 0x7f46d414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 >> 172.21.15.37:0/3970368691 conn(0x7f46d40d4fe0 msgr2=0x7f46d40d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 shutdown_connections 2024-05-10T08:40:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.249+0000 7f46d9493640 1 -- 172.21.15.37:0/3970368691 wait complete. 2024-05-10T08:40:31.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T08:40:31.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T08:40:31.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T08:40:31.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T08:40:31.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T08:40:31.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T08:40:31.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T08:40:31.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T08:40:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.446+0000 7fc7fe52b640 1 Processor -- start 2024-05-10T08:40:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.446+0000 7f8ab9883640 1 Processor -- start 2024-05-10T08:40:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.446+0000 7f8ab9883640 1 -- start start 2024-05-10T08:40:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.446+0000 7f698d3da640 1 Processor -- start 2024-05-10T08:40:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.446+0000 7f698d3da640 1 -- start start 2024-05-10T08:40:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f9355d33640 1 Processor -- start 2024-05-10T08:40:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f9355d33640 1 -- start start 2024-05-10T08:40:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.446+0000 7fc7fe52b640 1 -- start start 2024-05-10T08:40:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f14a759e640 1 Processor -- start 2024-05-10T08:40:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f869a103640 1 Processor -- start 2024-05-10T08:40:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f0b03baf640 1 Processor -- start 2024-05-10T08:40:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f59858a0640 1 Processor -- start 2024-05-10T08:40:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f8ab9883640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab40b5cb0 0x7f8ab40d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f698d3da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69880cf0f0 0x7f69880b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f698d3da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f698806fca0 0x7f69880cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f698d3da640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69880cfa10 con 0x7f69880cce50 2024-05-10T08:40:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f698d3da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f69880d1210 con 0x7f698806fca0 2024-05-10T08:40:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f698d3da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6988071840 con 0x7f69880cf0f0 2024-05-10T08:40:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7fc7fe52b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7f000b0b0 0x7fc7f0053f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f8ab9883640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab40d2f40 con 0x7f8ab40d3e10 2024-05-10T08:40:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f6986ffd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69880cf0f0 0x7f69880b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f6986ffd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69880cf0f0 0x7f69880b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53036/0 (socket says 172.21.15.37:53036) 2024-05-10T08:40:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f6986ffd640 1 -- 172.21.15.37:0/3051733585 learned_addr learned my addr 172.21.15.37:0/3051733585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f14a759e640 1 -- start start 2024-05-10T08:40:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f9355d33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9348051aa0 0x7f9348055e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7fc7fe52b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f0007850 con 0x7fc7f00e7760 2024-05-10T08:40:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7fc7fe52b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f0007b30 con 0x7fc7f0007340 2024-05-10T08:40:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7fc7fe52b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f00e7b40 con 0x7fc7f000b0b0 2024-05-10T08:40:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7fc7f7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7f00e7760 0x7fc7f00489d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40902/0 (socket says 172.21.15.37:40902) 2024-05-10T08:40:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7fc7f7fff640 1 -- 172.21.15.37:0/2340785010 learned_addr learned my addr 172.21.15.37:0/2340785010 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f69867fc640 1 --2- 172.21.15.37:0/3051733585 >> v2:172.21.15.82:3300/0 conn(0x7f698806fca0 0x7f69880cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f8ab9883640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab40d3220 con 0x7f8ab4163ac0 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f8ab9883640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab40d2cf0 con 0x7f8ab40b5cb0 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f8ab2ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8ab4163ac0 0x7f8ab40d3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44576/0 (socket says 172.21.15.37:44576) 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f8ab2ffd640 1 -- 172.21.15.37:0/2755546136 learned_addr learned my addr 172.21.15.37:0/2755546136 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f8ab3fff640 1 --2- 172.21.15.37:0/2755546136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab40b5cb0 0x7f8ab40d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f6986ffd640 1 -- 172.21.15.37:0/3051733585 >> v2:172.21.15.82:3300/0 conn(0x7f698806fca0 msgr2=0x7f69880cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f6986ffd640 1 --2- 172.21.15.37:0/3051733585 >> v2:172.21.15.82:3300/0 conn(0x7f698806fca0 0x7f69880cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f6986ffd640 1 -- 172.21.15.37:0/3051733585 >> v1:172.21.15.37:6789/0 conn(0x7f69880cce50 legacy=0x7f69880d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f6986ffd640 1 -- 172.21.15.37:0/3051733585 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6988070480 con 0x7f69880cf0f0 2024-05-10T08:40:31.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9348051aa0 0x7f9348055e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9348051aa0 0x7f9348055e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53068/0 (socket says 172.21.15.37:53068) 2024-05-10T08:40:31.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f8ab1ffb640 1 -- 172.21.15.37:0/2755546136 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203000272 0 0) 0x7f8ab40d3220 con 0x7f8ab4163ac0 2024-05-10T08:40:31.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f8ab1ffb640 1 -- 172.21.15.37:0/2755546136 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a9c003520 con 0x7f8ab4163ac0 2024-05-10T08:40:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f934effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9348056770 0x7f9348051e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44602/0 (socket says 172.21.15.37:44602) 2024-05-10T08:40:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7f9355d33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f934803a2a0 0x7f934803a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.448+0000 7fc7f77fe640 1 --2- 172.21.15.37:0/2340785010 >> v2:172.21.15.37:3300/0 conn(0x7fc7f000b0b0 0x7fc7f0053f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f934f7fe640 1 -- 172.21.15.37:0/3732778324 learned_addr learned my addr 172.21.15.37:0/3732778324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f0b03baf640 1 -- start start 2024-05-10T08:40:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f934ffff640 1 --2- 172.21.15.37:0/3732778324 >> v2:172.21.15.82:3300/0 conn(0x7f934803a2a0 0x7f934803a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f59858a0640 1 -- start start 2024-05-10T08:40:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f59858a0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59801676c0 0x7f59800b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93480068f0 con 0x7f9348056770 2024-05-10T08:40:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f8ab3fff640 1 -- 172.21.15.37:0/2755546136 >> v1:172.21.15.82:6789/0 conn(0x7f8ab4163ac0 legacy=0x7f8ab40d3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f8ab3fff640 1 -- 172.21.15.37:0/2755546136 >> v1:172.21.15.37:6789/0 conn(0x7f8ab40d3e10 legacy=0x7f8ab40b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f14a759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14a0006a30 0x7f14a0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f8ab3fff640 1 -- 172.21.15.37:0/2755546136 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab40d0a20 con 0x7f8ab40b5cb0 2024-05-10T08:40:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f14a759e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a0053720 con 0x7f14a00ead00 2024-05-10T08:40:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f14a759e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a0053a00 con 0x7f14a0005ee0 2024-05-10T08:40:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f14a759e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f14a0054330 con 0x7f14a0006a30 2024-05-10T08:40:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9348006bd0 con 0x7f934803a2a0 2024-05-10T08:40:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f59858a0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59800711d0 con 0x7f5980070d80 2024-05-10T08:40:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f59858a0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f598006f2d0 con 0x7f59801634e0 2024-05-10T08:40:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f59858a0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f598006ed60 con 0x7f59801676c0 2024-05-10T08:40:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.447+0000 7f869a103640 1 -- start start 2024-05-10T08:40:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f597effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f59801634e0 0x7f5980166fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44618/0 (socket says 172.21.15.37:44618) 2024-05-10T08:40:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f597effd640 1 -- 172.21.15.37:0/3688770645 learned_addr learned my addr 172.21.15.37:0/3688770645 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9348006eb0 con 0x7f9348051aa0 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b03baf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163710 0x7f0afc0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b03baf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0afc163af0 0x7f0afc0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b0194b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163710 0x7f0afc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b0194b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163710 0x7f0afc0b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53076/0 (socket says 172.21.15.37:53076) 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b0194b640 1 -- 172.21.15.37:0/988727407 learned_addr learned my addr 172.21.15.37:0/988727407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc06e730 con 0x7f0afc06f1d0 2024-05-10T08:40:31.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0afc0afd70 con 0x7f0afc163af0 2024-05-10T08:40:31.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0afc0afa90 con 0x7f0afc163710 2024-05-10T08:40:31.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f14a5d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f14a0005ee0 0x7f14a0006320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44622/0 (socket says 172.21.15.37:44622) 2024-05-10T08:40:31.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f14a5d9b640 1 -- 172.21.15.37:0/1314069509 learned_addr learned my addr 172.21.15.37:0/1314069509 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.449+0000 7f934e7fc640 1 -- 172.21.15.37:0/3732778324 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693613973 0 0) 0x7f93480068f0 con 0x7f9348056770 2024-05-10T08:40:31.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f0b0114a640 1 --2- 172.21.15.37:0/988727407 >> v2:172.21.15.82:3300/0 conn(0x7f0afc163af0 0x7f0afc0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f597dffb640 1 -- 172.21.15.37:0/3688770645 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833163045 0 0) 0x7f598006f2d0 con 0x7f59801634e0 2024-05-10T08:40:31.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f597dffb640 1 -- 172.21.15.37:0/3688770645 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5968003520 con 0x7f59801634e0 2024-05-10T08:40:31.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f14a6d9d640 1 --2- 172.21.15.37:0/1314069509 >> v2:172.21.15.82:3300/0 conn(0x7f14a0006a30 0x7f14a0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f934e7fc640 1 -- 172.21.15.37:0/3732778324 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9340003520 con 0x7f9348056770 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410411342 0 0) 0x7f14a0053a00 con 0x7f14a0005ee0 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1490003520 con 0x7f14a0005ee0 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2326670294 0 0) 0x7f14a0053720 con 0x7f14a00ead00 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a0053a00 con 0x7f14a00ead00 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109199352 0 0) 0x7f14a0053a00 con 0x7f14a00ead00 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 >> v2:172.21.15.82:3300/0 conn(0x7f14a0006a30 msgr2=0x7f14a0006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 --2- 172.21.15.37:0/1314069509 >> v2:172.21.15.82:3300/0 conn(0x7f14a0006a30 0x7f14a0006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 >> v1:172.21.15.82:6789/0 conn(0x7f14a0005ee0 legacy=0x7f14a0006320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a0053ce0 con 0x7f14a00ead00 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f14a8075580 con 0x7f14a00ead00 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 >> v1:172.21.15.37:6789/0 conn(0x7f14a00ead00 legacy=0x7f14a004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1490003b80 0x7f1490003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f934f7fe640 1 -- 172.21.15.37:0/3732778324 >> v2:172.21.15.82:3300/0 conn(0x7f934803a2a0 msgr2=0x7f934803a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f934f7fe640 1 --2- 172.21.15.37:0/3732778324 >> v2:172.21.15.82:3300/0 conn(0x7f934803a2a0 0x7f934803a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f934f7fe640 1 -- 172.21.15.37:0/3732778324 >> v1:172.21.15.82:6789/0 conn(0x7f9348056770 legacy=0x7f9348051e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f934f7fe640 1 -- 172.21.15.37:0/3732778324 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9348007190 con 0x7f9348051aa0 2024-05-10T08:40:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f0b0194b640 1 -- 172.21.15.37:0/988727407 >> v2:172.21.15.82:3300/0 conn(0x7f0afc163af0 msgr2=0x7f0afc0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f0b0194b640 1 --2- 172.21.15.37:0/988727407 >> v2:172.21.15.82:3300/0 conn(0x7f0afc163af0 0x7f0afc0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f0b0194b640 1 -- 172.21.15.37:0/988727407 >> v1:172.21.15.82:6789/0 conn(0x7f0afc06f1d0 legacy=0x7f0afc06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f0b0194b640 1 -- 172.21.15.37:0/988727407 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc06e9d0 con 0x7f0afc163710 2024-05-10T08:40:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7fc7f77fe640 1 -- 172.21.15.37:0/2340785010 >> v1:172.21.15.82:6789/0 conn(0x7fc7f0007340 legacy=0x7fc7f004f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7fc7f77fe640 1 -- 172.21.15.37:0/2340785010 >> v1:172.21.15.37:6789/0 conn(0x7fc7f00e7760 legacy=0x7fc7f00489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7fc7f77fe640 1 -- 172.21.15.37:0/2340785010 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0053740 con 0x7fc7f000b0b0 2024-05-10T08:40:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f869a103640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f869415d1e0 0x7f86940d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f869a103640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86940cf350 con 0x7f86940d38a0 2024-05-10T08:40:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f869a103640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86940cf630 con 0x7f8694160c60 2024-05-10T08:40:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f869a103640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f869415d5c0 con 0x7f869415d1e0 2024-05-10T08:40:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f8693fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8694160c60 0x7f8694070030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44642/0 (socket says 172.21.15.37:44642) 2024-05-10T08:40:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f8693fff640 1 -- 172.21.15.37:0/3334252187 learned_addr learned my addr 172.21.15.37:0/3334252187 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f86937fe640 1 --2- 172.21.15.37:0/3334252187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f869415d1e0 0x7f86940d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f597e7fc640 1 --2- 172.21.15.37:0/3688770645 >> v2:172.21.15.37:3300/0 conn(0x7f59801676c0 0x7f59800b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f597e7fc640 1 -- 172.21.15.37:0/3688770645 >> v1:172.21.15.82:6789/0 conn(0x7f59801634e0 legacy=0x7f5980166fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f597e7fc640 1 -- 172.21.15.37:0/3688770645 >> v1:172.21.15.37:6789/0 conn(0x7f5980070d80 legacy=0x7f598006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f597e7fc640 1 -- 172.21.15.37:0/3688770645 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5980167d80 con 0x7f59801676c0 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f8ab3fff640 1 --2- 172.21.15.37:0/2755546136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab40b5cb0 0x7f8ab40d5c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40d2e70 tx=0x7f8aa802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58d56bbce41145b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f8ab1ffb640 1 -- 172.21.15.37:0/2755546136 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8037070 con 0x7f8ab40b5cb0 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f8ab1ffb640 1 -- 172.21.15.37:0/2755546136 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa802ae10 con 0x7f8ab40b5cb0 2024-05-10T08:40:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f8ab1ffb640 1 -- 172.21.15.37:0/2755546136 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8032640 con 0x7f8ab40b5cb0 2024-05-10T08:40:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f6986ffd640 1 --2- 172.21.15.37:0/3051733585 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69880cf0f0 0x7f69880b4e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f698000d370 tx=0x7f698002ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd19478fd8f0d2e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f6985ffb640 1 -- 172.21.15.37:0/3051733585 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980036070 con 0x7f69880cf0f0 2024-05-10T08:40:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f6985ffb640 1 -- 172.21.15.37:0/3051733585 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6980031880 con 0x7f69880cf0f0 2024-05-10T08:40:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.450+0000 7f6985ffb640 1 -- 172.21.15.37:0/3051733585 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698000be60 con 0x7f69880cf0f0 2024-05-10T08:40:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490004800 0x7f1490004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14900051c0 0x7f149000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0054330 con 0x7f1490004800 2024-05-10T08:40:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f149000bf80 con 0x7f14900051c0 2024-05-10T08:40:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f149000c180 con 0x7f1490003b80 2024-05-10T08:40:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f14a659c640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1490003b80 0x7f1490003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7f8692ffd640 1 -- 172.21.15.37:0/3334252187 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908112864 0 0) 0x7f86940cf630 con 0x7f8694160c60 2024-05-10T08:40:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f934f7fe640 1 --2- 172.21.15.37:0/3732778324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9348051aa0 0x7f9348055e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9344009870 tx=0x7f934402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f90aeff195f5c1e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8692ffd640 1 -- 172.21.15.37:0/3334252187 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8680003520 con 0x7f8694160c60 2024-05-10T08:40:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8ab9883640 1 -- 172.21.15.37:0/2755546136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab40b5cb0 msgr2=0x7f8ab40d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8ab9883640 1 --2- 172.21.15.37:0/2755546136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab40b5cb0 0x7f8ab40d5c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40d2e70 tx=0x7f8aa802a100 comp rx=0 tx=0).stop 2024-05-10T08:40:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8ab9883640 1 -- 172.21.15.37:0/2755546136 shutdown_connections 2024-05-10T08:40:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8ab9883640 1 --2- 172.21.15.37:0/2755546136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab40b5cb0 0x7f8ab40d5c40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8692ffd640 1 -- 172.21.15.37:0/3334252187 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353089983 0 0) 0x7f86940cf350 con 0x7f86940d38a0 2024-05-10T08:40:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8ab9883640 1 -- 172.21.15.37:0/2755546136 >> 172.21.15.37:0/2755546136 conn(0x7f8ab40d5120 msgr2=0x7f8ab40d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 -- 172.21.15.37:0/3051733585 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69880cf0f0 msgr2=0x7f69880b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 --2- 172.21.15.37:0/3051733585 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69880cf0f0 0x7f69880b4e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f698000d370 tx=0x7f698002ca40 comp rx=0 tx=0).stop 2024-05-10T08:40:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f86937fe640 1 -- 172.21.15.37:0/3334252187 >> v1:172.21.15.82:6789/0 conn(0x7f8694160c60 legacy=0x7f8694070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 -- 172.21.15.37:0/3051733585 shutdown_connections 2024-05-10T08:40:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 --2- 172.21.15.37:0/3051733585 >> v2:172.21.15.82:3300/0 conn(0x7f698806fca0 0x7f69880cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 --2- 172.21.15.37:0/3051733585 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69880cf0f0 0x7f69880b4e40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 -- 172.21.15.37:0/3051733585 >> 172.21.15.37:0/3051733585 conn(0x7f698809ba40 msgr2=0x7f69880b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f86937fe640 1 -- 172.21.15.37:0/3334252187 >> v1:172.21.15.37:6789/0 conn(0x7f86940d38a0 legacy=0x7f86940ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8ab9883640 1 -- 172.21.15.37:0/2755546136 shutdown_connections 2024-05-10T08:40:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f8ab9883640 1 -- 172.21.15.37:0/2755546136 wait complete. 2024-05-10T08:40:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f86937fe640 1 -- 172.21.15.37:0/3334252187 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86940cf910 con 0x7f869415d1e0 2024-05-10T08:40:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f0b0194b640 1 --2- 172.21.15.37:0/988727407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163710 0x7f0afc0b2ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0d21e0 tx=0x7f0af802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470cf8b1ad040749 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f597e7fc640 1 --2- 172.21.15.37:0/3688770645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 0x7f59800b44e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59700097a0 tx=0x7f597002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eeca9cd0b4ea5df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f934e7fc640 1 -- 172.21.15.37:0/3732778324 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344037070 con 0x7f9348051aa0 2024-05-10T08:40:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a6d9d640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14900051c0 0x7f149000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a5d9b640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490004800 0x7f1490004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 -- 172.21.15.37:0/3051733585 shutdown_connections 2024-05-10T08:40:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.451+0000 7fc7f77fe640 1 --2- 172.21.15.37:0/2340785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f000b0b0 0x7fc7f0053f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009720 tx=0x7fc7ec02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5490d864109b163f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a659c640 1 -- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14900051c0 msgr2=0x7f149000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a659c640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14900051c0 0x7f149000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a659c640 1 -- 172.21.15.37:0/1314069509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490004800 msgr2=0x7f1490004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a659c640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490004800 0x7f1490004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f597dffb640 1 -- 172.21.15.37:0/3688770645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970037070 con 0x7f59801676c0 2024-05-10T08:40:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f597dffb640 1 -- 172.21.15.37:0/3688770645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5970032440 con 0x7f59801676c0 2024-05-10T08:40:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f597dffb640 1 -- 172.21.15.37:0/3688770645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970032850 con 0x7f59801676c0 2024-05-10T08:40:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f698d3da640 1 -- 172.21.15.37:0/3051733585 wait complete. 2024-05-10T08:40:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a659c640 1 -- 172.21.15.37:0/1314069509 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a0053ce0 con 0x7f1490003b80 2024-05-10T08:40:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f934e7fc640 1 -- 172.21.15.37:0/3732778324 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9344032440 con 0x7f9348051aa0 2024-05-10T08:40:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a6d9d640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14900051c0 0x7f149000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f14a6d9d640 1 -- 172.21.15.37:0/1314069509 reap_dead start 2024-05-10T08:40:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7fc7f6ffd640 1 -- 172.21.15.37:0/2340785010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec037070 con 0x7fc7f000b0b0 2024-05-10T08:40:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7fc7f6ffd640 1 -- 172.21.15.37:0/2340785010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ec02adc0 con 0x7fc7f000b0b0 2024-05-10T08:40:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7fc7f6ffd640 1 -- 172.21.15.37:0/2340785010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec032660 con 0x7fc7f000b0b0 2024-05-10T08:40:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.452+0000 7f934e7fc640 1 -- 172.21.15.37:0/3732778324 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344032810 con 0x7f9348051aa0 2024-05-10T08:40:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f0b00949640 1 -- 172.21.15.37:0/988727407 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8037070 con 0x7f0afc163710 2024-05-10T08:40:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f0b00949640 1 -- 172.21.15.37:0/988727407 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af8032440 con 0x7f0afc163710 2024-05-10T08:40:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f0b00949640 1 -- 172.21.15.37:0/988727407 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8032810 con 0x7f0afc163710 2024-05-10T08:40:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f14a659c640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1490003b80 0x7f1490003fc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14a806b710 tx=0x7f1490005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db754960748ee25 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f59858a0640 1 -- 172.21.15.37:0/3688770645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 msgr2=0x7f59800b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f59858a0640 1 --2- 172.21.15.37:0/3688770645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 0x7f59800b44e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59700097a0 tx=0x7f597002a1c0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7fc7fe52b640 1 -- 172.21.15.37:0/2340785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f000b0b0 msgr2=0x7fc7f0053f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7fc7fe52b640 1 --2- 172.21.15.37:0/2340785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f000b0b0 0x7fc7f0053f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009720 tx=0x7fc7ec02a0b0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f8ab9883640 1 Processor -- start 2024-05-10T08:40:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a80693f0 con 0x7f1490003b80 2024-05-10T08:40:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a80a7580 con 0x7f1490003b80 2024-05-10T08:40:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f14a559a640 1 -- 172.21.15.37:0/1314069509 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a80693f0 con 0x7f1490003b80 2024-05-10T08:40:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7fc7fe52b640 1 -- 172.21.15.37:0/2340785010 shutdown_connections 2024-05-10T08:40:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163710 msgr2=0x7f0afc0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f0b03baf640 1 --2- 172.21.15.37:0/988727407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163710 0x7f0afc0b2ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0d21e0 tx=0x7f0af802a1e0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f698d3da640 1 Processor -- start 2024-05-10T08:40:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7fc7fe52b640 1 --2- 172.21.15.37:0/2340785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f000b0b0 0x7fc7f0053f40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7fc7fe52b640 1 -- 172.21.15.37:0/2340785010 >> 172.21.15.37:0/2340785010 conn(0x7fc7f000a400 msgr2=0x7fc7f000a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f698d3da640 1 -- start start 2024-05-10T08:40:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7fc7fe52b640 1 -- 172.21.15.37:0/2340785010 shutdown_connections 2024-05-10T08:40:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 shutdown_connections 2024-05-10T08:40:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f86937fe640 1 --2- 172.21.15.37:0/3334252187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f869415d1e0 0x7f86940d0110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8684009800 tx=0x7f868402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=553cb9b236956321 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f0b03baf640 1 --2- 172.21.15.37:0/988727407 >> v2:172.21.15.82:3300/0 conn(0x7f0afc163af0 0x7f0afc0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f0b03baf640 1 --2- 172.21.15.37:0/988727407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163710 0x7f0afc0b2ce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 >> 172.21.15.37:0/988727407 conn(0x7f0afc0b6570 msgr2=0x7f0afc0b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9348051aa0 msgr2=0x7f9348055e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 --2- 172.21.15.37:0/3732778324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9348051aa0 0x7f9348055e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9344009870 tx=0x7f934402a250 comp rx=0 tx=0).stop 2024-05-10T08:40:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 shutdown_connections 2024-05-10T08:40:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 --2- 172.21.15.37:0/3732778324 >> v2:172.21.15.82:3300/0 conn(0x7f934803a2a0 0x7f934803a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 --2- 172.21.15.37:0/3732778324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9348051aa0 0x7f9348055e90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 >> 172.21.15.37:0/3732778324 conn(0x7f9348056cd0 msgr2=0x7f93480570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 shutdown_connections 2024-05-10T08:40:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.453+0000 7f9355d33640 1 -- 172.21.15.37:0/3732778324 wait complete. 2024-05-10T08:40:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 shutdown_connections 2024-05-10T08:40:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f14a759e640 1 -- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1490003b80 msgr2=0x7f1490003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f14a759e640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1490003b80 0x7f1490003fc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14a806b710 tx=0x7f1490005830 comp rx=0 tx=0).stop 2024-05-10T08:40:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f14a759e640 1 -- 172.21.15.37:0/1314069509 shutdown_connections 2024-05-10T08:40:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f14a759e640 1 --2- 172.21.15.37:0/1314069509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1490003b80 0x7f1490003fc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f14a759e640 1 -- 172.21.15.37:0/1314069509 >> 172.21.15.37:0/1314069509 conn(0x7f14a0009fb0 msgr2=0x7f14a000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f14a759e640 1 -- 172.21.15.37:0/1314069509 shutdown_connections 2024-05-10T08:40:31.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f698d3da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f698806fca0 0x7f6988150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f698d3da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69880cce50 0x7f69881f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f14a759e640 1 -- 172.21.15.37:0/1314069509 wait complete. 2024-05-10T08:40:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f698d3da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69880cf0f0 0x7f698815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f698d3da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6988071560 con 0x7f69880cf0f0 2024-05-10T08:40:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f698d3da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6988071280 con 0x7f69880cce50 2024-05-10T08:40:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f698d3da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69880d1440 con 0x7f698806fca0 2024-05-10T08:40:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7f8ab9883640 1 -- start start 2024-05-10T08:40:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f8692ffd640 1 -- 172.21.15.37:0/3334252187 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684037070 con 0x7f869415d1e0 2024-05-10T08:40:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f0b03baf640 1 -- 172.21.15.37:0/988727407 wait complete. 2024-05-10T08:40:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.454+0000 7fc7fe52b640 1 -- 172.21.15.37:0/2340785010 wait complete. 2024-05-10T08:40:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f8692ffd640 1 -- 172.21.15.37:0/3334252187 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8684032440 con 0x7f869415d1e0 2024-05-10T08:40:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f6987fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69880cf0f0 0x7f698815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f69867fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69880cce50 0x7f69881f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f6986ffd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f698806fca0 0x7f6988150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f8692ffd640 1 -- 172.21.15.37:0/3334252187 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684032810 con 0x7f869415d1e0 2024-05-10T08:40:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f6987fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69880cf0f0 0x7f698815cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57900/0 (socket says 172.21.15.37:57900) 2024-05-10T08:40:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f6987fff640 1 -- 172.21.15.37:0/1031893508 learned_addr learned my addr 172.21.15.37:0/1031893508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f6986ffd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f698806fca0 0x7f6988150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53104/0 (socket says 172.21.15.37:53104) 2024-05-10T08:40:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f59858a0640 1 -- 172.21.15.37:0/3688770645 shutdown_connections 2024-05-10T08:40:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f59858a0640 1 --2- 172.21.15.37:0/3688770645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 0x7f59800b44e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f59858a0640 1 -- 172.21.15.37:0/3688770645 >> 172.21.15.37:0/3688770645 conn(0x7f59800d14f0 msgr2=0x7f59800d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f9355d33640 1 Processor -- start 2024-05-10T08:40:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.455+0000 7f8ab9883640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab40b5cb0 0x7f8ab415f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f6987fff640 1 -- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f698806fca0 msgr2=0x7f6988150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f6987fff640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f698806fca0 0x7f6988150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f6987fff640 1 -- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69880cce50 msgr2=0x7f69881f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f6987fff640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69880cce50 0x7f69881f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f6987fff640 1 -- 172.21.15.37:0/1031893508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69881f4df0 con 0x7f69880cf0f0 2024-05-10T08:40:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab9883640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab40d3e10 0x7f8ab41f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f9355d33640 1 -- start start 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab9883640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab4163ac0 0x7f8ab41e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab40b5cb0 0x7f8ab415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab40b5cb0 0x7f8ab415f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57904/0 (socket says 172.21.15.37:57904) 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab2ffd640 1 -- 172.21.15.37:0/3540648379 learned_addr learned my addr 172.21.15.37:0/3540648379 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab40b4d60 con 0x7f8ab40b5cb0 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab40d07d0 con 0x7f8ab40d3e10 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab40b4ee0 con 0x7f8ab4163ac0 2024-05-10T08:40:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f869a103640 1 -- 172.21.15.37:0/3334252187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f869415d1e0 msgr2=0x7f86940d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f869a103640 1 --2- 172.21.15.37:0/3334252187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f869415d1e0 0x7f86940d0110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8684009800 tx=0x7f868402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f0b03baf640 1 Processor -- start 2024-05-10T08:40:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f869a103640 1 -- 172.21.15.37:0/3334252187 shutdown_connections 2024-05-10T08:40:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f869a103640 1 --2- 172.21.15.37:0/3334252187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f869415d1e0 0x7f86940d0110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f869a103640 1 -- 172.21.15.37:0/3334252187 >> 172.21.15.37:0/3334252187 conn(0x7f86940d2c30 msgr2=0x7f86940d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7f8ab3fff640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab4163ac0 0x7f8ab41e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8ab3fff640 1 -- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab40d3e10 msgr2=0x7f8ab41f8a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8ab3fff640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab40d3e10 0x7f8ab41f8a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8ab3fff640 1 -- 172.21.15.37:0/3540648379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab40b5cb0 msgr2=0x7f8ab415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8ab3fff640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab40b5cb0 0x7f8ab415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8ab3fff640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab40b82b0 con 0x7f8ab4163ac0 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f6987fff640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69880cf0f0 0x7f698815cd70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f697c00c3f0 tx=0x7f697c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f0b03baf640 1 -- start start 2024-05-10T08:40:31.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8ab2ffd640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab40b5cb0 0x7f8ab415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:31.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7fc7fe52b640 1 Processor -- start 2024-05-10T08:40:31.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.456+0000 7fc7fe52b640 1 -- start start 2024-05-10T08:40:31.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f869a103640 1 -- 172.21.15.37:0/3334252187 shutdown_connections 2024-05-10T08:40:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f59858a0640 1 -- 172.21.15.37:0/3688770645 shutdown_connections 2024-05-10T08:40:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f869a103640 1 -- 172.21.15.37:0/3334252187 wait complete. 2024-05-10T08:40:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8ab3fff640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab4163ac0 0x7f8ab41e8d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40d2c20 tx=0x7f8aa80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f9355d33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f934803a2a0 0x7f9348185bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f14a759e640 1 Processor -- start 2024-05-10T08:40:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f14a759e640 1 -- start start 2024-05-10T08:40:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f9355d33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9348051aa0 0x7f9348186110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f9355d33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348056770 0x7f93480e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c0052d0 con 0x7f69880cf0f0 2024-05-10T08:40:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f9355d33640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93480e12a0 con 0x7f9348056770 2024-05-10T08:40:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f9355d33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9348007750 con 0x7f9348051aa0 2024-05-10T08:40:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f9355d33640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f934804b560 con 0x7f934803a2a0 2024-05-10T08:40:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f934ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348056770 0x7f93480e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f934ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348056770 0x7f93480e2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57908/0 (socket says 172.21.15.37:57908) 2024-05-10T08:40:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f934ffff640 1 -- 172.21.15.37:0/1883337978 learned_addr learned my addr 172.21.15.37:0/1883337978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f934ffff640 1 -- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f934803a2a0 msgr2=0x7f9348185bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f934ffff640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f934803a2a0 0x7f9348185bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f934ffff640 1 -- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9348051aa0 msgr2=0x7f9348186110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f934ffff640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9348051aa0 0x7f9348186110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f0b03baf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0afc06f1d0 0x7f0afc1ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f0b03baf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0afc163710 0x7f0afc14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f0b0194b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0afc06f1d0 0x7f0afc1ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0194b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0afc06f1d0 0x7f0afc1ec2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55580/0 (socket says 172.21.15.37:55580) 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0194b640 1 -- 172.21.15.37:0/2949013739 learned_addr learned my addr 172.21.15.37:0/2949013739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b03baf640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163af0 0x7f0afc14a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc0b0990 con 0x7f0afc163710 2024-05-10T08:40:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc0b0810 con 0x7f0afc06f1d0 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0114a640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0afc163710 0x7f0afc14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0afc06fd30 con 0x7f0afc163af0 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7fc7fe52b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f0007340 0x7fc7f00dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7fc7fe52b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f000b0b0 0x7fc7f004bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7fc7fe52b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7f00e7760 0x7fc7f004c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7fc7fe52b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0053430 con 0x7fc7f0007340 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7fc7fe52b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00490e0 con 0x7fc7f000b0b0 2024-05-10T08:40:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7fc7fe52b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f0048570 con 0x7fc7f00e7760 2024-05-10T08:40:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f59858a0640 1 -- 172.21.15.37:0/3688770645 wait complete. 2024-05-10T08:40:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f59858a0640 1 Processor -- start 2024-05-10T08:40:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8037040 con 0x7f8ab4163ac0 2024-05-10T08:40:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa802ac10 con 0x7f8ab4163ac0 2024-05-10T08:40:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa803d440 con 0x7f8ab4163ac0 2024-05-10T08:40:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab40b8570 con 0x7f8ab4163ac0 2024-05-10T08:40:31.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab40b8b30 con 0x7f8ab4163ac0 2024-05-10T08:40:31.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.457+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69881f50d0 con 0x7f69880cf0f0 2024-05-10T08:40:31.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69880cb070 con 0x7f69880cf0f0 2024-05-10T08:40:31.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.458+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c005490 con 0x7f69880cf0f0 2024-05-10T08:40:31.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c007260 con 0x7f69880cf0f0 2024-05-10T08:40:31.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0214c640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163af0 0x7f0afc14a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f0007340 0x7fc7f00dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7f00e7760 0x7fc7f004c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7f00e7760 0x7fc7f004c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53130/0 (socket says 172.21.15.37:53130) 2024-05-10T08:40:31.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 -- 172.21.15.37:0/866591498 learned_addr learned my addr 172.21.15.37:0/866591498 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f934ffff640 1 -- 172.21.15.37:0/1883337978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934804acc0 con 0x7f9348056770 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7f77fe640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f000b0b0 0x7fc7f004bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490003b80 0x7f14a00da1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14a004dba0 0x7f14a004e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a759e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14a00dce20 0x7f14a00dd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0054940 con 0x7f1490003b80 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a759e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00547c0 con 0x7f14a004dba0 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a759e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f14a004f550 con 0x7f14a00dce20 2024-05-10T08:40:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490003b80 0x7f14a00da1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490003b80 0x7f14a00da1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57928/0 (socket says 172.21.15.37:57928) 2024-05-10T08:40:31.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a659c640 1 -- 172.21.15.37:0/2482790896 learned_addr learned my addr 172.21.15.37:0/2482790896 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f14a5d9b640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14a004dba0 0x7f14a004e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f934ffff640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348056770 0x7f93480e2ba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9350063f70 tx=0x7f9350069df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0114a640 1 -- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163af0 msgr2=0x7f0afc14a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0114a640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163af0 0x7f0afc14a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0114a640 1 -- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0afc06f1d0 msgr2=0x7f0afc1ec2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0114a640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0afc06f1d0 0x7f0afc1ec2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f0b0114a640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc14c150 con 0x7f0afc163710 2024-05-10T08:40:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 -- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f000b0b0 msgr2=0x7fc7f004bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f000b0b0 0x7fc7f004bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 -- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f0007340 msgr2=0x7fc7f00dc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f0007340 0x7fc7f00dc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f59858a0640 1 -- start start 2024-05-10T08:40:31.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f0b0194b640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0afc06f1d0 0x7f0afc1ec2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:31.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7fc7fcac8640 1 -- 172.21.15.37:0/866591498 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0035c90 con 0x7fc7f00e7760 2024-05-10T08:40:31.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f0007340 0x7fc7f00dc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:31.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f0b0214c640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0afc163af0 0x7f0afc14a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:31.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f14a6d9d640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14a00dce20 0x7f14a00dd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.459+0000 7f869a103640 1 Processor -- start 2024-05-10T08:40:31.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f14a659c640 1 -- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14a00dce20 msgr2=0x7f14a00dd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f14a659c640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14a00dce20 0x7f14a00dd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f14a659c640 1 -- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14a004dba0 msgr2=0x7f14a004e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f14a659c640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14a004dba0 0x7f14a004e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f14a659c640 1 -- 172.21.15.37:0/2482790896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a00dacc0 con 0x7f1490003b80 2024-05-10T08:40:31.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f0b0114a640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0afc163710 0x7f0afc14ba30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0af400ebc0 tx=0x7f0af400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7fc7fcac8640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7f00e7760 0x7fc7f004c490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8052040 tx=0x7fc7f806a810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f869a103640 1 -- start start 2024-05-10T08:40:31.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80709f0 con 0x7fc7f00e7760 2024-05-10T08:40:31.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8070b90 con 0x7fc7f00e7760 2024-05-10T08:40:31.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.460+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6968001030 con 0x7f69880cf0f0 2024-05-10T08:40:31.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f14a659c640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490003b80 0x7f14a00da1d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f14a8063f70 tx=0x7f14a806c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f59858a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5980070d80 0x7f5980165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f59858a0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59801634e0 0x7f5980201b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f59858a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 0x7f59802020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f597e7fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59801634e0 0x7f5980201b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f597e7fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59801634e0 0x7f5980201b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53168/0 (socket says 172.21.15.37:53168) 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f597effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5980070d80 0x7f5980165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f597effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5980070d80 0x7f5980165bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55616/0 (socket says 172.21.15.37:55616) 2024-05-10T08:40:31.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350074550 con 0x7f9348056770 2024-05-10T08:40:31.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4018020 con 0x7f0afc163710 2024-05-10T08:40:31.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af400cd40 con 0x7f0afc163710 2024-05-10T08:40:31.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f869a103640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86940d38a0 0x7f8694152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a80693f0 con 0x7f1490003b80 2024-05-10T08:40:31.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a8051630 con 0x7f1490003b80 2024-05-10T08:40:31.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a8075580 con 0x7f1490003b80 2024-05-10T08:40:31.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f14a759e640 1 -- 172.21.15.37:0/2482790896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a00daf60 con 0x7f1490003b80 2024-05-10T08:40:31.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc14c430 con 0x7f0afc163710 2024-05-10T08:40:31.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f14a759e640 1 -- 172.21.15.37:0/2482790896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a00db520 con 0x7f1490003b80 2024-05-10T08:40:31.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f869a103640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f869415d1e0 0x7f86940c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f869a103640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8694160c60 0x7f86940ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0afc14c9f0 con 0x7f0afc163710 2024-05-10T08:40:31.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8074130 con 0x7fc7f00e7760 2024-05-10T08:40:31.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8aa8044020 con 0x7f8ab4163ac0 2024-05-10T08:40:31.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7fc7fe52b640 1 -- 172.21.15.37:0/866591498 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f00dcc10 con 0x7fc7f00e7760 2024-05-10T08:40:31.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7fc7fe52b640 1 -- 172.21.15.37:0/866591498 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f004cda0 con 0x7fc7f00e7760 2024-05-10T08:40:31.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f868bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f869415d1e0 0x7f86940c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f868bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f869415d1e0 0x7f86940c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55620/0 (socket says 172.21.15.37:55620) 2024-05-10T08:40:31.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.461+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93500746f0 con 0x7f9348056770 2024-05-10T08:40:31.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350096440 con 0x7f9348056770 2024-05-10T08:40:31.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934804afa0 con 0x7f9348056770 2024-05-10T08:40:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934804ef50 con 0x7f9348056770 2024-05-10T08:40:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f8693fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8694160c60 0x7f86940ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f8693fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8694160c60 0x7f86940ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57938/0 (socket says 172.21.15.37:57938) 2024-05-10T08:40:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f868bfff640 1 -- 172.21.15.37:0/1099436219 learned_addr learned my addr 172.21.15.37:0/1099436219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f869a103640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8694161270 con 0x7f8694160c60 2024-05-10T08:40:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f869a103640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86941610f0 con 0x7f869415d1e0 2024-05-10T08:40:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f869a103640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f86941613f0 con 0x7f86940d38a0 2024-05-10T08:40:31.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f8a9bfff640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8aa00762d0 0x7f8aa0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8aa80b7740 con 0x7f8ab4163ac0 2024-05-10T08:40:31.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.462+0000 7f8a99ffb640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ab4069b00 con 0x7f8ab4163ac0 2024-05-10T08:40:31.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8a9bfff640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f8aa007f9c0 0x7f8aa0081e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f597e7fc640 1 -- 172.21.15.37:0/1399175076 learned_addr learned my addr 172.21.15.37:0/1399175076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f598006f850 con 0x7f59801676c0 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f598006e9f0 con 0x7f5980070d80 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f597f7fe640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 0x7f59802020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f598006cab0 con 0x7f59801634e0 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8aa00824d0 con 0x7f8aa007f9c0 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8ab2ffd640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8aa00762d0 0x7f8aa0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8aa807cca0 con 0x7f8ab4163ac0 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af40146c0 con 0x7f0afc163710 2024-05-10T08:40:31.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f0adffff640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0afc069b00 con 0x7f0afc163710 2024-05-10T08:40:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f86937fe640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86940d38a0 0x7f8694152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8693fff640 1 -- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86940d38a0 msgr2=0x7f8694152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8693fff640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f86940d38a0 0x7f8694152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8693fff640 1 -- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f869415d1e0 msgr2=0x7f86940c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8693fff640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f869415d1e0 0x7f86940c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8693fff640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86940ca870 con 0x7f8694160c60 2024-05-10T08:40:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8ab27fc640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f8aa007f9c0 0x7f8aa0081e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f597f7fe640 1 -- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59801634e0 msgr2=0x7f5980201b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f597f7fe640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59801634e0 0x7f5980201b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f597f7fe640 1 -- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5980070d80 msgr2=0x7f5980165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f597f7fe640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5980070d80 0x7f5980165bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f597f7fe640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5980202900 con 0x7f59801676c0 2024-05-10T08:40:31.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f697c007400 con 0x7f69880cf0f0 2024-05-10T08:40:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7f8ab2ffd640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8aa00762d0 0x7f8aa0078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40011e0 tx=0x7f8aa4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f597effd640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5980070d80 0x7f5980165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f8693fff640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8694160c60 0x7f86940ca240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f868c00ce20 tx=0x7f868c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.463+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7d0001030 con 0x7fc7f00e7760 2024-05-10T08:40:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f14a759e640 1 -- 172.21.15.37:0/2482790896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f148c001030 con 0x7f1490003b80 2024-05-10T08:40:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f597f7fe640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 0x7f59802020d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f597800c730 tx=0x7f597800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f696f7fe640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69740763d0 0x7f6974078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93480052c0 con 0x7f9348056770 2024-05-10T08:40:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f8ab27fc640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f8aa007f9c0 0x7f8aa0081e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.464+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f697c0977e0 con 0x7f69880cf0f0 2024-05-10T08:40:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f6986ffd640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69740763d0 0x7f6974078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c017070 con 0x7f8694160c60 2024-05-10T08:40:31.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c00ad40 con 0x7f8694160c60 2024-05-10T08:40:31.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c012600 con 0x7f8694160c60 2024-05-10T08:40:31.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc7f80742d0 con 0x7fc7f00e7760 2024-05-10T08:40:31.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f869a103640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86940cab50 con 0x7f8694160c60 2024-05-10T08:40:31.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f869a103640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86940cb110 con 0x7f8694160c60 2024-05-10T08:40:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f696f7fe640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f697407fb40 0x7f6974081f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f697c004ec0 con 0x7f697407fb40 2024-05-10T08:40:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978016020 con 0x7f59801676c0 2024-05-10T08:40:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5978006d50 con 0x7f59801676c0 2024-05-10T08:40:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.465+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f697c097bd0 con 0x7f69880cf0f0 2024-05-10T08:40:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7fc7f4ff9640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc7dc0763a0 0x7fc7dc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc7dc0763a0 0x7fc7dc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978003bb0 con 0x7f59801676c0 2024-05-10T08:40:31.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc7f8113ac0 con 0x7fc7f00e7760 2024-05-10T08:40:31.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5980162170 con 0x7f59801676c0 2024-05-10T08:40:31.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5980162730 con 0x7f59801676c0 2024-05-10T08:40:31.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc7dc0763a0 0x7fc7dc078860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4005880 tx=0x7fc7e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7fc7f4ff9640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7fc7dc07fb20 0x7fc7dc081f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7f808eec0 con 0x7fc7dc07fb20 2024-05-10T08:40:31.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f14a80ba460 con 0x7f1490003b80 2024-05-10T08:40:31.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f6986ffd640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69740763d0 0x7f6974078890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6980038000 tx=0x7f698000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f1496ffd640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f14880762d0 0x7f1488078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f69867fc640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f697407fb40 0x7f6974081f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7f8113eb0 con 0x7fc7f00e7760 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f14a5d9b640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f14880762d0 0x7f1488078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f14a81335a0 con 0x7f1490003b80 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0af4005d10 con 0x7f0afc163710 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f0af27fc640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ae0076320 0x7f0ae00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0af40984e0 con 0x7f0afc163710 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f0af27fc640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f0ae007fa20 0x7f0ae0081e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.466+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0af401ce70 con 0x7f0ae007fa20 2024-05-10T08:40:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f0b0214c640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f0ae007fa20 0x7f0ae0081e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f0b0194b640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ae0076320 0x7f0ae00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0af409f050 con 0x7f0afc163710 2024-05-10T08:40:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8aa00824d0 con 0x7f8aa007f9c0 2024-05-10T08:40:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f1496ffd640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f148807f950 0x7f1488081d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.467+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14a80a7580 con 0x7f148807f950 2024-05-10T08:40:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f14a5d9b640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f14880762d0 0x7f1488078790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14a00335a0 tx=0x7f1498009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f14a6d9d640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f148807f950 0x7f1488081d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f69867fc640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f697407fb40 0x7f6974081f80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f0b0214c640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f0ae007fa20 0x7f0ae0081e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14a80f8bd0 con 0x7f1490003b80 2024-05-10T08:40:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f869a103640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86940cb4f0 con 0x7f8694160c60 2024-05-10T08:40:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7fc7f77fe640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7fc7dc07fb20 0x7fc7dc081f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f14a6d9d640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f148807f950 0x7f1488081d90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f697c004ec0 con 0x7f697407fb40 2024-05-10T08:40:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f935009f440 con 0x7f9348056770 2024-05-10T08:40:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5980050740 con 0x7f59801676c0 2024-05-10T08:40:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7fc7f77fe640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7fc7dc07fb20 0x7fc7dc081f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f0b0194b640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ae0076320 0x7f0ae00787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009630 tx=0x7f0af802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f933bfff640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93340763a0 0x7f9334078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14a80a7580 con 0x7f148807f950 2024-05-10T08:40:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0af401ce70 con 0x7f0ae007fa20 2024-05-10T08:40:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9350113fa0 con 0x7f9348056770 2024-05-10T08:40:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.468+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f868c01a070 con 0x7f8694160c60 2024-05-10T08:40:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f8690ff9640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f86740762d0 0x7f8674078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f868c0975e0 con 0x7f8694160c60 2024-05-10T08:40:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f86937fe640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f86740762d0 0x7f8674078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f8690ff9640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7f867407f9d0 0x7f8674081e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f868c01de80 con 0x7f867407f9d0 2024-05-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.469+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f868c09e050 con 0x7f8694160c60 2024-05-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f934f7fe640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93340763a0 0x7f9334078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f933bfff640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f933407fb10 0x7f9334081f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9350071e80 con 0x7f933407fb10 2024-05-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9350114390 con 0x7f9348056770 2024-05-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f59780050d0 con 0x7f59801676c0 2024-05-10T08:40:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f934effd640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f933407fb10 0x7f9334081f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f5967fff640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f596c0763a0 0x7f596c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f934f7fe640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93340763a0 0x7f9334078860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f934402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7f808eec0 con 0x7fc7dc07fb20 2024-05-10T08:40:31.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f934effd640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f933407fb10 0x7f9334081f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.470+0000 7f868bfff640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7f867407f9d0 0x7f8674081e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f868bfff640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7f867407f9d0 0x7f8674081e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f86937fe640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f86740762d0 0x7f8674078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8684034000 tx=0x7f868402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f597effd640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f596c0763a0 0x7f596c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f59780972a0 con 0x7f59801676c0 2024-05-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f5967fff640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f596c07faa0 0x7f596c081ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f597801eec0 con 0x7f596c07faa0 2024-05-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f597809e050 con 0x7f59801676c0 2024-05-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f597e7fc640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f596c07faa0 0x7f596c081ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.472+0000 7f597effd640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f596c0763a0 0x7f596c078860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5974005880 tx=0x7f5974009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.471+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f868c01de80 con 0x7f867407f9d0 2024-05-10T08:40:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.472+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9350071e80 con 0x7f933407fb10 2024-05-10T08:40:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.474+0000 7f597e7fc640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f596c07faa0 0x7f596c081ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.474+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f597801eec0 con 0x7f596c07faa0 2024-05-10T08:40:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.500+0000 7f8a99ffb640 1 -- 172.21.15.37:0/3540648379 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ab4069b00 con 0x7f8aa007f9c0 2024-05-10T08:40:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.501+0000 7f8a9bfff640 1 -- 172.21.15.37:0/3540648379 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ab4069b00 con 0x7f8aa007f9c0 2024-05-10T08:40:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.501+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f8aa007f9c0 msgr2=0x7f8aa0081e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.501+0000 7f8ab9883640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f8aa007f9c0 0x7f8aa0081e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.502+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8aa00762d0 msgr2=0x7f8aa0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.502+0000 7f8ab9883640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8aa00762d0 0x7f8aa0078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40011e0 tx=0x7f8aa4009040 comp rx=0 tx=0).stop 2024-05-10T08:40:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.502+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab4163ac0 msgr2=0x7f8ab41e8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.502+0000 7f8ab9883640 1 --2- 172.21.15.37:0/3540648379 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ab4163ac0 0x7f8ab41e8d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40d2c20 tx=0x7f8aa80046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.502+0000 7f8ab3fff640 1 -- 172.21.15.37:0/3540648379 reap_dead start 2024-05-10T08:40:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.502+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 shutdown_connections 2024-05-10T08:40:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.502+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 >> 172.21.15.37:0/3540648379 conn(0x7f8ab40d5120 msgr2=0x7f8ab40b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f14a759e640 1 -- 172.21.15.37:0/2482790896 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f148c002dd0 con 0x7f148807f950 2024-05-10T08:40:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 shutdown_connections 2024-05-10T08:40:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f8ab9883640 1 -- 172.21.15.37:0/3540648379 wait complete. 2024-05-10T08:40:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f0adffff640 1 -- 172.21.15.37:0/2949013739 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0afc0695a0 con 0x7f0ae007fa20 2024-05-10T08:40:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f869a103640 1 -- 172.21.15.37:0/1099436219 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8694050740 con 0x7f867407f9d0 2024-05-10T08:40:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f0af27fc640 1 -- 172.21.15.37:0/2949013739 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0afc0695a0 con 0x7f0ae007fa20 2024-05-10T08:40:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f8690ff9640 1 -- 172.21.15.37:0/1099436219 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8694050740 con 0x7f867407f9d0 2024-05-10T08:40:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.503+0000 7f1496ffd640 1 -- 172.21.15.37:0/2482790896 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f148c002dd0 con 0x7f148807f950 2024-05-10T08:40:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f1494ff9640 1 -- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f148807f950 msgr2=0x7f1488081d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f1494ff9640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f148807f950 0x7f1488081d90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f0ae007fa20 msgr2=0x7f0ae0081e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f0b03baf640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f0ae007fa20 0x7f0ae0081e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7d0002dd0 con 0x7fc7dc07fb20 2024-05-10T08:40:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f8689ffb640 1 -- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7f867407f9d0 msgr2=0x7f8674081e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f8689ffb640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7f867407f9d0 0x7f8674081e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f8689ffb640 1 -- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f86740762d0 msgr2=0x7f8674078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f8689ffb640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f86740762d0 0x7f8674078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8684034000 tx=0x7f868402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f8689ffb640 1 -- 172.21.15.37:0/1099436219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8694160c60 msgr2=0x7f86940ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f8689ffb640 1 --2- 172.21.15.37:0/1099436219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8694160c60 0x7f86940ca240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f868c00ce20 tx=0x7f868c00a430 comp rx=0 tx=0).stop 2024-05-10T08:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f8693fff640 1 -- 172.21.15.37:0/1099436219 reap_dead start 2024-05-10T08:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.504+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6968002dd0 con 0x7f697407fb40 2024-05-10T08:40:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7fc7f4ff9640 1 -- 172.21.15.37:0/866591498 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc7d0002dd0 con 0x7fc7dc07fb20 2024-05-10T08:40:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f8689ffb640 1 -- 172.21.15.37:0/1099436219 shutdown_connections 2024-05-10T08:40:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f8689ffb640 1 -- 172.21.15.37:0/1099436219 >> 172.21.15.37:0/1099436219 conn(0x7f86940d2c30 msgr2=0x7f86940cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f8689ffb640 1 -- 172.21.15.37:0/1099436219 shutdown_connections 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 -- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f14880762d0 msgr2=0x7f1488078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f14880762d0 0x7f1488078790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14a00335a0 tx=0x7f1498009040 comp rx=0 tx=0).stop 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 -- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490003b80 msgr2=0x7f14a00da1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 --2- 172.21.15.37:0/2482790896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490003b80 0x7f14a00da1d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f14a8063f70 tx=0x7f14a806c260 comp rx=0 tx=0).stop 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f14a6d9d640 1 -- 172.21.15.37:0/2482790896 reap_dead start 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 -- 172.21.15.37:0/2482790896 shutdown_connections 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 -- 172.21.15.37:0/2482790896 >> 172.21.15.37:0/2482790896 conn(0x7f14a0009fb0 msgr2=0x7f14a00056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f696f7fe640 1 -- 172.21.15.37:0/1031893508 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6968002dd0 con 0x7f697407fb40 2024-05-10T08:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ae0076320 msgr2=0x7f0ae00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ae0076320 0x7f0ae00787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009630 tx=0x7f0af802e000 comp rx=0 tx=0).stop 2024-05-10T08:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0afc163710 msgr2=0x7f0afc14ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 --2- 172.21.15.37:0/2949013739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0afc163710 0x7f0afc14ba30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0af400ebc0 tx=0x7f0af400c490 comp rx=0 tx=0).stop 2024-05-10T08:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b0214c640 1 -- 172.21.15.37:0/2949013739 reap_dead start 2024-05-10T08:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 shutdown_connections 2024-05-10T08:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 >> 172.21.15.37:0/2949013739 conn(0x7f0afc0b6570 msgr2=0x7f0afc0af140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f934804d790 con 0x7f933407fb10 2024-05-10T08:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 -- 172.21.15.37:0/2482790896 shutdown_connections 2024-05-10T08:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f1494ff9640 1 -- 172.21.15.37:0/2482790896 wait complete. 2024-05-10T08:40:31.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 shutdown_connections 2024-05-10T08:40:31.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f8689ffb640 1 -- 172.21.15.37:0/1099436219 wait complete. 2024-05-10T08:40:31.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f0b03baf640 1 -- 172.21.15.37:0/2949013739 wait complete. 2024-05-10T08:40:31.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f697407fb40 msgr2=0x7f6974081f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.505+0000 7f698d3da640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f697407fb40 0x7f6974081f80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7fc7dc07fb20 msgr2=0x7fc7dc081f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7fc7dc07fb20 0x7fc7dc081f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69740763d0 msgr2=0x7f6974078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69740763d0 0x7f6974078890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6980038000 tx=0x7f698000b040 comp rx=0 tx=0).stop 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69880cf0f0 msgr2=0x7f698815cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 --2- 172.21.15.37:0/1031893508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69880cf0f0 0x7f698815cd70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f697c00c3f0 tx=0x7f697c00c8b0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f6987fff640 1 -- 172.21.15.37:0/1031893508 reap_dead start 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 shutdown_connections 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 >> 172.21.15.37:0/1031893508 conn(0x7f698809ba40 msgr2=0x7f69880d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc7dc0763a0 msgr2=0x7fc7dc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc7dc0763a0 0x7fc7dc078860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4005880 tx=0x7fc7e4009040 comp rx=0 tx=0).stop 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7f00e7760 msgr2=0x7fc7f004c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 --2- 172.21.15.37:0/866591498 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc7f00e7760 0x7fc7f004c490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8052040 tx=0x7fc7f806a810 comp rx=0 tx=0).stop 2024-05-10T08:40:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7fcac8640 1 -- 172.21.15.37:0/866591498 reap_dead start 2024-05-10T08:40:31.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 shutdown_connections 2024-05-10T08:40:31.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f698d3da640 1 -- 172.21.15.37:0/1031893508 wait complete. 2024-05-10T08:40:31.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 shutdown_connections 2024-05-10T08:40:31.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 >> 172.21.15.37:0/866591498 conn(0x7fc7f000a400 msgr2=0x7fc7f0049360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 shutdown_connections 2024-05-10T08:40:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7fc7e27fc640 1 -- 172.21.15.37:0/866591498 wait complete. 2024-05-10T08:40:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.506+0000 7f933bfff640 1 -- 172.21.15.37:0/1883337978 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f934804d790 con 0x7f933407fb10 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.507+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f933407fb10 msgr2=0x7f9334081f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.507+0000 7f9355d33640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f933407fb10 0x7f9334081f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.507+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93340763a0 msgr2=0x7f9334078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.507+0000 7f9355d33640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93340763a0 0x7f9334078860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f934402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.507+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348056770 msgr2=0x7f93480e2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.507+0000 7f9355d33640 1 --2- 172.21.15.37:0/1883337978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348056770 0x7f93480e2ba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9350063f70 tx=0x7f9350069df0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.508+0000 7f934ffff640 1 -- 172.21.15.37:0/1883337978 reap_dead start 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.508+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 shutdown_connections 2024-05-10T08:40:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.508+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 >> 172.21.15.37:0/1883337978 conn(0x7f9348056cd0 msgr2=0x7f93480dee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.508+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f598015e020 con 0x7f596c07faa0 2024-05-10T08:40:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.508+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 shutdown_connections 2024-05-10T08:40:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.508+0000 7f9355d33640 1 -- 172.21.15.37:0/1883337978 wait complete. 2024-05-10T08:40:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.508+0000 7f5967fff640 1 -- 172.21.15.37:0/1399175076 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f598015e020 con 0x7f596c07faa0 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.510+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f596c07faa0 msgr2=0x7f596c081ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.510+0000 7f59858a0640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f596c07faa0 0x7f596c081ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.510+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f596c0763a0 msgr2=0x7f596c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.510+0000 7f59858a0640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f596c0763a0 0x7f596c078860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5974005880 tx=0x7f5974009040 comp rx=0 tx=0).stop 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.510+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 msgr2=0x7f59802020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.510+0000 7f59858a0640 1 --2- 172.21.15.37:0/1399175076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59801676c0 0x7f59802020d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f597800c730 tx=0x7f597800cbf0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.510+0000 7f597f7fe640 1 -- 172.21.15.37:0/1399175076 reap_dead start 2024-05-10T08:40:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.511+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 shutdown_connections 2024-05-10T08:40:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.511+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 >> 172.21.15.37:0/1399175076 conn(0x7f59800d14f0 msgr2=0x7f598015e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.511+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 shutdown_connections 2024-05-10T08:40:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.511+0000 7f59858a0640 1 -- 172.21.15.37:0/1399175076 wait complete. 2024-05-10T08:40:31.564 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2024-05-10T08:40:31.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T08:40:31.566 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-10T08:40:31.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T08:40:31.567 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2024-05-10T08:40:31.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T08:40:31.568 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2024-05-10T08:40:31.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T08:40:31.569 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:31.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T08:40:31.570 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:31.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T08:40:31.571 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-10T08:40:31.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T08:40:31.572 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:31.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T08:40:31.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.787+0000 7fc0df208640 1 Processor -- start 2024-05-10T08:40:31.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.788+0000 7f8a3a9c1640 1 Processor -- start 2024-05-10T08:40:31.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.787+0000 7fc0df208640 1 -- start start 2024-05-10T08:40:31.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.788+0000 7fc0df208640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0d80d1970 0x7fc0d80d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.788+0000 7fc0df208640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d4cc0 0x7fc0d80d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.789+0000 7f1a5486d640 1 Processor -- start 2024-05-10T08:40:31.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.788+0000 7f8a3a9c1640 1 -- start start 2024-05-10T08:40:31.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.789+0000 7f1a5486d640 1 -- start start 2024-05-10T08:40:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.788+0000 7fc0df208640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d81630b0 con 0x7fc0d815f420 2024-05-10T08:40:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.788+0000 7fc0df208640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d80d3e70 con 0x7fc0d80d1970 2024-05-10T08:40:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.788+0000 7fc0df208640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d80d5670 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.789+0000 7fc0dcfa4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc0d815f420 0x7fc0d80d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44646/0 (socket says 172.21.15.37:44646) 2024-05-10T08:40:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.789+0000 7fc0dcfa4640 1 -- 172.21.15.37:0/3400470925 learned_addr learned my addr 172.21.15.37:0/3400470925 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.789+0000 7fad5a637640 1 Processor -- start 2024-05-10T08:40:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.789+0000 7fad5a637640 1 -- start start 2024-05-10T08:40:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7fc0d7fff640 1 --2- 172.21.15.37:0/3400470925 >> v2:172.21.15.82:3300/0 conn(0x7fc0d80d1970 0x7fc0d80d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f8a3a9c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3415eb80 0x7f8a340d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f8a3a9c1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a3415ef60 con 0x7f8a3406ea50 2024-05-10T08:40:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f8a3a9c1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a340cfea0 con 0x7f8a34070920 2024-05-10T08:40:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f8a3a9c1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a340d0180 con 0x7f8a3415eb80 2024-05-10T08:40:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3415eb80 0x7f8a340d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f1a5486d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a50159980 0x7f1a500aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f1a5486d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a501605f0 0x7f1a500b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fc0dd7a5640 1 --2- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d4cc0 0x7fc0d80d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3415eb80 0x7f8a340d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53202/0 (socket says 172.21.15.37:53202) 2024-05-10T08:40:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.790+0000 7f8a33fff640 1 -- 172.21.15.37:0/1635243559 learned_addr learned my addr 172.21.15.37:0/1635243559 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fc0d7fff640 1 -- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d4cc0 msgr2=0x7fc0d80d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f6d98a93640 1 Processor -- start 2024-05-10T08:40:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f8a33fff640 1 -- 172.21.15.37:0/1635243559 >> v1:172.21.15.82:6789/0 conn(0x7f8a34070920 legacy=0x7f8a340b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f8a33fff640 1 -- 172.21.15.37:0/1635243559 >> v1:172.21.15.37:6789/0 conn(0x7f8a3406ea50 legacy=0x7f8a340cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f8a33fff640 1 -- 172.21.15.37:0/1635243559 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a340d0460 con 0x7f8a3415eb80 2024-05-10T08:40:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad5a637640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad540d1970 0x7fad540d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad5a637640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad540d4cc0 0x7fad540d50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad5a637640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad541630b0 con 0x7fad5415f420 2024-05-10T08:40:31.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad5a637640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fad540d3e70 con 0x7fad540d1970 2024-05-10T08:40:31.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad5a637640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fad540d2550 con 0x7fad540d4cc0 2024-05-10T08:40:31.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f1a4dd9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a501605f0 0x7f1a500b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f1a4dd9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a501605f0 0x7f1a500b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53206/0 (socket says 172.21.15.37:53206) 2024-05-10T08:40:31.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f1a5486d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a50159d60 con 0x7f1a500af4d0 2024-05-10T08:40:31.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f1a5486d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1a50160160 con 0x7f1a50159980 2024-05-10T08:40:31.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f1a5486d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5015f860 con 0x7f1a501605f0 2024-05-10T08:40:31.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f1a4ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a500af4d0 0x7f1a500b52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40928/0 (socket says 172.21.15.37:40928) 2024-05-10T08:40:31.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f1a4ed9d640 1 -- 172.21.15.37:0/125831700 learned_addr learned my addr 172.21.15.37:0/125831700 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad58bd4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad540d4cc0 0x7fad540d50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad58bd4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad540d4cc0 0x7fad540d50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55652/0 (socket says 172.21.15.37:55652) 2024-05-10T08:40:31.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fad58bd4640 1 -- 172.21.15.37:0/15707996 learned_addr learned my addr 172.21.15.37:0/15707996 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fad537fe640 1 --2- 172.21.15.37:0/15707996 >> v2:172.21.15.37:3300/0 conn(0x7fad540d1970 0x7fad540d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7f1a4e59c640 1 --2- 172.21.15.37:0/125831700 >> v2:172.21.15.37:3300/0 conn(0x7f1a50159980 0x7f1a500aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fad58bd4640 1 -- 172.21.15.37:0/15707996 >> v2:172.21.15.37:3300/0 conn(0x7fad540d1970 msgr2=0x7fad540d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7f1a4dd9b640 1 -- 172.21.15.37:0/125831700 >> v2:172.21.15.37:3300/0 conn(0x7f1a50159980 msgr2=0x7f1a500aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7f1a4dd9b640 1 --2- 172.21.15.37:0/125831700 >> v2:172.21.15.37:3300/0 conn(0x7f1a50159980 0x7f1a500aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7f1a4dd9b640 1 -- 172.21.15.37:0/125831700 >> v1:172.21.15.37:6789/0 conn(0x7f1a500af4d0 legacy=0x7f1a500b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7f8a33fff640 1 --2- 172.21.15.37:0/1635243559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3415eb80 0x7f8a340d0f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d180 tx=0x7f8a2c02c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30c094e823de785e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fad58bd4640 1 --2- 172.21.15.37:0/15707996 >> v2:172.21.15.37:3300/0 conn(0x7fad540d1970 0x7fad540d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fad58bd4640 1 -- 172.21.15.37:0/15707996 >> v1:172.21.15.82:6789/0 conn(0x7fad5415f420 legacy=0x7fad540d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fad58bd4640 1 -- 172.21.15.37:0/15707996 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad540d2c80 con 0x7fad540d4cc0 2024-05-10T08:40:31.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fad537fe640 1 --2- 172.21.15.37:0/15707996 >> v2:172.21.15.37:3300/0 conn(0x7fad540d1970 0x7fad540d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f42b14c0640 1 Processor -- start 2024-05-10T08:40:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fc0d7fff640 1 --2- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d4cc0 0x7fc0d80d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fc0d7fff640 1 -- 172.21.15.37:0/3400470925 >> v1:172.21.15.82:6789/0 conn(0x7fc0d815f420 legacy=0x7fc0d80d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7fc0d7fff640 1 -- 172.21.15.37:0/3400470925 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80d2550 con 0x7fc0d80d1970 2024-05-10T08:40:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fc0dd7a5640 1 --2- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d4cc0 0x7fc0d80d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7fc0d7fff640 1 --2- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80d1970 0x7fc0d80d1e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009d90 tx=0x7fc0d002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ada764c3daf62bf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f42b14c0640 1 -- start start 2024-05-10T08:40:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.792+0000 7f1a4dd9b640 1 -- 172.21.15.37:0/125831700 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a500afa30 con 0x7f1a501605f0 2024-05-10T08:40:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.791+0000 7f6d98a93640 1 -- start start 2024-05-10T08:40:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d98a93640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d8c0e1240 0x7f6d8c0563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f1a4e59c640 1 --2- 172.21.15.37:0/125831700 >> v2:172.21.15.37:3300/0 conn(0x7f1a50159980 0x7f1a500aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d98a93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c038e90 0x7f6d8c03a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d98a93640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d8c051b50 con 0x7f6d8c0516f0 2024-05-10T08:40:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d98a93640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6d8c056a60 con 0x7f6d8c0e1240 2024-05-10T08:40:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d98a93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c051e90 con 0x7f6d8c038e90 2024-05-10T08:40:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d91d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6d8c0516f0 0x7f6d8c038780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44678/0 (socket says 172.21.15.37:44678) 2024-05-10T08:40:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d91d9b640 1 -- 172.21.15.37:0/1399574136 learned_addr learned my addr 172.21.15.37:0/1399574136 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f6d92d9d640 1 --2- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c038e90 0x7f6d8c03a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f6d9259c640 1 --2- 172.21.15.37:0/1399574136 >> v2:172.21.15.82:3300/0 conn(0x7f6d8c0e1240 0x7f6d8c0563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.793+0000 7f8a32ffd640 1 -- 172.21.15.37:0/1635243559 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c033780 con 0x7f8a3415eb80 2024-05-10T08:40:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f8a32ffd640 1 -- 172.21.15.37:0/1635243559 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c039070 con 0x7f8a3415eb80 2024-05-10T08:40:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f8a32ffd640 1 -- 172.21.15.37:0/1635243559 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c033780 con 0x7f8a3415eb80 2024-05-10T08:40:31.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f1a4dd9b640 1 --2- 172.21.15.37:0/125831700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a501605f0 0x7f1a500b65e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a4402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69ea05d85ea52ef8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f2f0a812640 1 Processor -- start 2024-05-10T08:40:31.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7fad58bd4640 1 --2- 172.21.15.37:0/15707996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d4cc0 0x7fad540d50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad540d17a0 tx=0x7fad4c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e796a1a806477240 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f1a4d59a640 1 -- 172.21.15.37:0/125831700 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44037070 con 0x7f1a501605f0 2024-05-10T08:40:31.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f1a4d59a640 1 -- 172.21.15.37:0/125831700 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a44032440 con 0x7f1a501605f0 2024-05-10T08:40:31.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f42b14c0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42ac071f60 0x7f42ac15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f1a4d59a640 1 -- 172.21.15.37:0/125831700 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44032850 con 0x7f1a501605f0 2024-05-10T08:40:31.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f2f0a812640 1 -- start start 2024-05-10T08:40:31.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f42b14c0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac070910 con 0x7f42ac0ce120 2024-05-10T08:40:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f42b14c0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac06ef40 con 0x7f42ac0cfa10 2024-05-10T08:40:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f42b14c0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac06fd00 con 0x7f42ac071f60 2024-05-10T08:40:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f42abfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42ac071f60 0x7f42ac15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f42abfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42ac071f60 0x7f42ac15b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57958/0 (socket says 172.21.15.37:57958) 2024-05-10T08:40:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f42abfff640 1 -- 172.21.15.37:0/305075007 learned_addr learned my addr 172.21.15.37:0/305075007 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/1635243559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3415eb80 msgr2=0x7f8a340d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f6d9259c640 1 -- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c038e90 msgr2=0x7f6d8c03a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f6d9259c640 1 --2- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c038e90 0x7f6d8c03a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f6d9259c640 1 -- 172.21.15.37:0/1399574136 >> v1:172.21.15.82:6789/0 conn(0x7f6d8c0516f0 legacy=0x7f6d8c038780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.794+0000 7f6d9259c640 1 -- 172.21.15.37:0/1399574136 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c052170 con 0x7f6d8c0e1240 2024-05-10T08:40:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f42abfff640 1 -- 172.21.15.37:0/305075007 >> v1:172.21.15.82:6789/0 conn(0x7f42ac0cfa10 legacy=0x7f42ac165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f42abfff640 1 -- 172.21.15.37:0/305075007 >> v1:172.21.15.37:6789/0 conn(0x7f42ac0ce120 legacy=0x7f42ac0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f42abfff640 1 -- 172.21.15.37:0/305075007 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac06f220 con 0x7f42ac071f60 2024-05-10T08:40:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/1635243559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3415eb80 0x7f8a340d0f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d180 tx=0x7f8a2c02c950 comp rx=0 tx=0).stop 2024-05-10T08:40:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7fc0d77fe640 1 -- 172.21.15.37:0/3400470925 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0007740 con 0x7fc0d80d1970 2024-05-10T08:40:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f1a5486d640 1 -- 172.21.15.37:0/125831700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a501605f0 msgr2=0x7f1a500b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7fad52ffd640 1 -- 172.21.15.37:0/15707996 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c036070 con 0x7fad540d4cc0 2024-05-10T08:40:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7fad52ffd640 1 -- 172.21.15.37:0/15707996 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4c031600 con 0x7fad540d4cc0 2024-05-10T08:40:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7fad52ffd640 1 -- 172.21.15.37:0/15707996 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c036070 con 0x7fad540d4cc0 2024-05-10T08:40:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7fc0d77fe640 1 -- 172.21.15.37:0/3400470925 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d00078e0 con 0x7fc0d80d1970 2024-05-10T08:40:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7fc0d77fe640 1 -- 172.21.15.37:0/3400470925 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0007c90 con 0x7fc0d80d1970 2024-05-10T08:40:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f1a5486d640 1 --2- 172.21.15.37:0/125831700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a501605f0 0x7f1a500b65e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a4402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f6d9259c640 1 --2- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0563d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d840097a0 tx=0x7f6d8402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbfaa94fdb1c5342 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/1635243559 shutdown_connections 2024-05-10T08:40:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/1635243559 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3415eb80 0x7f8a340d0f40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/1635243559 >> 172.21.15.37:0/1635243559 conn(0x7f8a340738e0 msgr2=0x7f8a3406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.795+0000 7f6d9159a640 1 -- 172.21.15.37:0/1399574136 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84037070 con 0x7f6d8c0e1240 2024-05-10T08:40:31.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f6d9159a640 1 -- 172.21.15.37:0/1399574136 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d84032440 con 0x7f6d8c0e1240 2024-05-10T08:40:31.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f1a5486d640 1 -- 172.21.15.37:0/125831700 shutdown_connections 2024-05-10T08:40:31.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f6d9159a640 1 -- 172.21.15.37:0/1399574136 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84037070 con 0x7f6d8c0e1240 2024-05-10T08:40:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f0a812640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2efc0df000 0x7f2efc04f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f1a5486d640 1 --2- 172.21.15.37:0/125831700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a501605f0 0x7f1a500b65e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f0a812640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2efc050330 0x7f2efc0530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f0a812640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc054d40 con 0x7f2efc0df3e0 2024-05-10T08:40:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f0a812640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2efc0507a0 con 0x7f2efc050330 2024-05-10T08:40:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f0a812640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2efc054640 con 0x7f2efc0df000 2024-05-10T08:40:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/1635243559 shutdown_connections 2024-05-10T08:40:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f1a5486d640 1 --2- 172.21.15.37:0/125831700 >> v2:172.21.15.37:3300/0 conn(0x7f1a50159980 0x7f1a500aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f1a5486d640 1 -- 172.21.15.37:0/125831700 >> 172.21.15.37:0/125831700 conn(0x7f1a500b39a0 msgr2=0x7f1a500b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/1635243559 wait complete. 2024-05-10T08:40:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f1a5486d640 1 -- 172.21.15.37:0/125831700 shutdown_connections 2024-05-10T08:40:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f1a5486d640 1 -- 172.21.15.37:0/125831700 wait complete. 2024-05-10T08:40:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f09810640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2efc0df000 0x7f2efc04f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f09810640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2efc0df000 0x7f2efc04f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55660/0 (socket says 172.21.15.37:55660) 2024-05-10T08:40:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f09810640 1 -- 172.21.15.37:0/1103430644 learned_addr learned my addr 172.21.15.37:0/1103430644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7f2f0a011640 1 --2- 172.21.15.37:0/1103430644 >> v2:172.21.15.37:3300/0 conn(0x7f2efc050330 0x7f2efc0530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7fc0df208640 1 -- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80d1970 msgr2=0x7fc0d80d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7fc0df208640 1 --2- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80d1970 0x7fc0d80d1e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009d90 tx=0x7fc0d002a680 comp rx=0 tx=0).stop 2024-05-10T08:40:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7fad5a637640 1 -- 172.21.15.37:0/15707996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d4cc0 msgr2=0x7fad540d50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.796+0000 7fad5a637640 1 --2- 172.21.15.37:0/15707996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d4cc0 0x7fad540d50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad540d17a0 tx=0x7fad4c02a6f0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f42abfff640 1 --2- 172.21.15.37:0/305075007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac071f60 0x7f42ac15b1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f429c00dc90 tx=0x7f429c02e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeddd94a1255748b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fad5a637640 1 -- 172.21.15.37:0/15707996 shutdown_connections 2024-05-10T08:40:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fad5a637640 1 --2- 172.21.15.37:0/15707996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d4cc0 0x7fad540d50e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fad5a637640 1 --2- 172.21.15.37:0/15707996 >> v2:172.21.15.37:3300/0 conn(0x7fad540d1970 0x7fad540d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f6d98a93640 1 -- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c0e1240 msgr2=0x7f6d8c0563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f6d98a93640 1 --2- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0563d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d840097a0 tx=0x7f6d8402a110 comp rx=0 tx=0).stop 2024-05-10T08:40:31.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fad5a637640 1 -- 172.21.15.37:0/15707996 >> 172.21.15.37:0/15707996 conn(0x7fad5408eac0 msgr2=0x7fad5409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f2f0a011640 1 -- 172.21.15.37:0/1103430644 >> v2:172.21.15.82:3300/0 conn(0x7f2efc0df000 msgr2=0x7f2efc04f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f2f0a011640 1 --2- 172.21.15.37:0/1103430644 >> v2:172.21.15.82:3300/0 conn(0x7f2efc0df000 0x7f2efc04f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f42aaffd640 1 -- 172.21.15.37:0/305075007 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c03a070 con 0x7f42ac071f60 2024-05-10T08:40:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f6d98a93640 1 -- 172.21.15.37:0/1399574136 shutdown_connections 2024-05-10T08:40:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f2f0a011640 1 -- 172.21.15.37:0/1103430644 >> v1:172.21.15.37:6789/0 conn(0x7f2efc0df3e0 legacy=0x7f2efc04fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f2f0a011640 1 -- 172.21.15.37:0/1103430644 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc006de0 con 0x7f2efc050330 2024-05-10T08:40:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f42aaffd640 1 -- 172.21.15.37:0/305075007 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c00b650 con 0x7f42ac071f60 2024-05-10T08:40:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f42aaffd640 1 -- 172.21.15.37:0/305075007 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c00ba20 con 0x7f42ac071f60 2024-05-10T08:40:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f6d98a93640 1 --2- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c038e90 0x7f6d8c03a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fad5a637640 1 -- 172.21.15.37:0/15707996 shutdown_connections 2024-05-10T08:40:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fc0df208640 1 -- 172.21.15.37:0/3400470925 shutdown_connections 2024-05-10T08:40:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fc0df208640 1 --2- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d4cc0 0x7fc0d80d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fc0df208640 1 --2- 172.21.15.37:0/3400470925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80d1970 0x7fc0d80d1e20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fc0df208640 1 -- 172.21.15.37:0/3400470925 >> 172.21.15.37:0/3400470925 conn(0x7fc0d808eac0 msgr2=0x7fc0d809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f6d98a93640 1 --2- 172.21.15.37:0/1399574136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0563d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7f6d98a93640 1 -- 172.21.15.37:0/1399574136 >> 172.21.15.37:0/1399574136 conn(0x7f6d8c053780 msgr2=0x7f6d8c053b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f2f0a011640 1 --2- 172.21.15.37:0/1103430644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc0530c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f04052040 tx=0x7f2f040a6640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8ec2280ca0f65c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.797+0000 7fad5a637640 1 -- 172.21.15.37:0/15707996 wait complete. 2024-05-10T08:40:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f2f0880e640 1 -- 172.21.15.37:0/1103430644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0406e620 con 0x7f2efc050330 2024-05-10T08:40:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f2f0880e640 1 -- 172.21.15.37:0/1103430644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0406e7c0 con 0x7f2efc050330 2024-05-10T08:40:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f6d98a93640 1 -- 172.21.15.37:0/1399574136 shutdown_connections 2024-05-10T08:40:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f8a3a9c1640 1 Processor -- start 2024-05-10T08:40:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f2f0880e640 1 -- 172.21.15.37:0/1103430644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0406ebb0 con 0x7f2efc050330 2024-05-10T08:40:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f42b14c0640 1 -- 172.21.15.37:0/305075007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac071f60 msgr2=0x7f42ac15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f42b14c0640 1 --2- 172.21.15.37:0/305075007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac071f60 0x7f42ac15b1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f429c00dc90 tx=0x7f429c02e6d0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f8a3a9c1640 1 -- start start 2024-05-10T08:40:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7fc0df208640 1 -- 172.21.15.37:0/3400470925 shutdown_connections 2024-05-10T08:40:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7fc0df208640 1 -- 172.21.15.37:0/3400470925 wait complete. 2024-05-10T08:40:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f1a5486d640 1 Processor -- start 2024-05-10T08:40:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f1a5486d640 1 -- start start 2024-05-10T08:40:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f42b14c0640 1 -- 172.21.15.37:0/305075007 shutdown_connections 2024-05-10T08:40:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f42b14c0640 1 --2- 172.21.15.37:0/305075007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac071f60 0x7f42ac15b1c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f42b14c0640 1 -- 172.21.15.37:0/305075007 >> 172.21.15.37:0/305075007 conn(0x7f42ac0cd600 msgr2=0x7f42ac0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.798+0000 7f6d98a93640 1 -- 172.21.15.37:0/1399574136 wait complete. 2024-05-10T08:40:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7fad5a637640 1 Processor -- start 2024-05-10T08:40:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f2f0a812640 1 -- 172.21.15.37:0/1103430644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 msgr2=0x7f2efc0530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7fad5a637640 1 -- start start 2024-05-10T08:40:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f2f0a812640 1 --2- 172.21.15.37:0/1103430644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc0530c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f04052040 tx=0x7f2f040a6640 comp rx=0 tx=0).stop 2024-05-10T08:40:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f2f0a812640 1 -- 172.21.15.37:0/1103430644 shutdown_connections 2024-05-10T08:40:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f2f0a812640 1 --2- 172.21.15.37:0/1103430644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc0530c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f2f0a812640 1 --2- 172.21.15.37:0/1103430644 >> v2:172.21.15.82:3300/0 conn(0x7f2efc0df000 0x7f2efc04f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.799+0000 7f2f0a812640 1 -- 172.21.15.37:0/1103430644 >> 172.21.15.37:0/1103430644 conn(0x7f2efc00a400 msgr2=0x7f2efc00a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f2f0a812640 1 -- 172.21.15.37:0/1103430644 shutdown_connections 2024-05-10T08:40:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f8a3a9c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3406ea50 0x7f8a34159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f2f0a812640 1 -- 172.21.15.37:0/1103430644 wait complete. 2024-05-10T08:40:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f8a3a9c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a34070920 0x7f8a3413cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f6d98a93640 1 Processor -- start 2024-05-10T08:40:31.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f6d98a93640 1 -- start start 2024-05-10T08:40:31.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7fc0df208640 1 Processor -- start 2024-05-10T08:40:31.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f42b14c0640 1 -- 172.21.15.37:0/305075007 shutdown_connections 2024-05-10T08:40:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3406ea50 0x7f8a34159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3406ea50 0x7f8a34159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53230/0 (socket says 172.21.15.37:53230) 2024-05-10T08:40:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f8a337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a34070920 0x7f8a3413cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7f8a337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a34070920 0x7f8a3413cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57968/0 (socket says 172.21.15.37:57968) 2024-05-10T08:40:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a33fff640 1 -- 172.21.15.37:0/4244094641 learned_addr learned my addr 172.21.15.37:0/4244094641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.800+0000 7fc0df208640 1 -- start start 2024-05-10T08:40:31.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f42b14c0640 1 -- 172.21.15.37:0/305075007 wait complete. 2024-05-10T08:40:31.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a3415eb80 0x7f8a340b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a5486d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a500af4d0 0x7f1a50159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a34070d50 con 0x7f8a34070920 2024-05-10T08:40:31.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a340d0a20 con 0x7f8a3415eb80 2024-05-10T08:40:31.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a34070ed0 con 0x7f8a3406ea50 2024-05-10T08:40:31.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a5486d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a50159980 0x7f1a50155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7fad5a637640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d1970 0x7fad5415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7fad5a637640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad540d4cc0 0x7fad54161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a5486d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a501605f0 0x7f1a500b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a4e59c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a500af4d0 0x7f1a50159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a4e59c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a500af4d0 0x7f1a50159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53244/0 (socket says 172.21.15.37:53244) 2024-05-10T08:40:31.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a4dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a50159980 0x7f1a50155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a4dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a50159980 0x7f1a50155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57976/0 (socket says 172.21.15.37:57976) 2024-05-10T08:40:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a4e59c640 1 -- 172.21.15.37:0/999102682 learned_addr learned my addr 172.21.15.37:0/999102682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a5486d640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a500b1450 con 0x7f1a50159980 2024-05-10T08:40:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a5486d640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5015fdf0 con 0x7f1a501605f0 2024-05-10T08:40:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a4ed9d640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a501605f0 0x7f1a500b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f1a5486d640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a500b6b20 con 0x7f1a500af4d0 2024-05-10T08:40:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7fad537fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad540d4cc0 0x7fad54161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a337fe640 1 -- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3406ea50 msgr2=0x7f8a34159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a337fe640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3406ea50 0x7f8a34159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a337fe640 1 -- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a3415eb80 msgr2=0x7f8a340b5a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T08:40:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a337fe640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a3415eb80 0x7f8a340b5a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f8a337fe640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3413d090 con 0x7f8a34070920 2024-05-10T08:40:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7fad537fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad540d4cc0 0x7fad54161d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53250/0 (socket says 172.21.15.37:53250) 2024-05-10T08:40:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7f6d98a93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c038e90 0x7f6d8c050fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d98a93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c0516f0 0x7f6d8c04cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d98a93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d98a93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0e1620 con 0x7f6d8c0e1240 2024-05-10T08:40:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d98a93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c03a180 con 0x7f6d8c038e90 2024-05-10T08:40:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d98a93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c0e17a0 con 0x7f6d8c0516f0 2024-05-10T08:40:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.801+0000 7fad5a637640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162290 0x7fad541fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad5a637640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad540d2830 con 0x7fad54162290 2024-05-10T08:40:31.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f2f0a812640 1 Processor -- start 2024-05-10T08:40:31.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad5a637640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad540d3240 con 0x7fad540d1970 2024-05-10T08:40:31.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f2f0a812640 1 -- start start 2024-05-10T08:40:31.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f8a337fe640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a34070920 0x7f8a3413cb50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c780 tx=0x7f8a2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad5a637640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fad540d5620 con 0x7fad540d4cc0 2024-05-10T08:40:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d92d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0d91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad537fe640 1 -- 172.21.15.37:0/3913928698 learned_addr learned my addr 172.21.15.37:0/3913928698 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad53fff640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d1970 0x7fad5415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad58bd4640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162290 0x7fad541fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fc3cf0e8640 1 Processor -- start 2024-05-10T08:40:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fc0df208640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d1970 0x7fc0d80cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d92d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0d91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57990/0 (socket says 172.21.15.37:57990) 2024-05-10T08:40:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d92d9d640 1 -- 172.21.15.37:0/933045830 learned_addr learned my addr 172.21.15.37:0/933045830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d9259c640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c038e90 0x7f6d8c050fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f6d91d9b640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c0516f0 0x7f6d8c04cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f1a4dd9b640 1 -- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a500af4d0 msgr2=0x7f1a50159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f1a4dd9b640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a500af4d0 0x7f1a50159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f1a4dd9b640 1 -- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a501605f0 msgr2=0x7f1a500b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fc0df208640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0d80d4cc0 0x7fc0d80b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fc0df208640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80b8e60 0x7fc0d80b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fc0df208640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d80d3240 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f1a4dd9b640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a501605f0 0x7f1a500b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fc0df208640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d80d2f60 con 0x7fc0d80b8e60 2024-05-10T08:40:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fc0df208640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d80d2830 con 0x7fc0d80d1970 2024-05-10T08:40:31.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f1a4dd9b640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a501f5090 con 0x7f1a50159980 2024-05-10T08:40:31.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f8a30ff9640 1 -- 172.21.15.37:0/4244094641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24017070 con 0x7f8a34070920 2024-05-10T08:40:31.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f8a30ff9640 1 -- 172.21.15.37:0/4244094641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a24005070 con 0x7f8a34070920 2024-05-10T08:40:31.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f8a30ff9640 1 -- 172.21.15.37:0/4244094641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24005460 con 0x7f8a34070920 2024-05-10T08:40:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3413fb20 con 0x7f8a34070920 2024-05-10T08:40:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3415c610 con 0x7f8a34070920 2024-05-10T08:40:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0d80d4cc0 0x7fc0d80b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0d80d4cc0 0x7fc0d80b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58004/0 (socket says 172.21.15.37:58004) 2024-05-10T08:40:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 -- 172.21.15.37:0/1738994712 learned_addr learned my addr 172.21.15.37:0/1738994712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f42b14c0640 1 Processor -- start 2024-05-10T08:40:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f2f0a812640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc04f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 -- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d1970 msgr2=0x7fc0d80cb260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T08:40:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d1970 0x7fc0d80cb260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 -- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80b8e60 msgr2=0x7fc0d80b2c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T08:40:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80b8e60 0x7fc0d80b2c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc0d7fff640 1 -- 172.21.15.37:0/1738994712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d81eabe0 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f1a4dd9b640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a50159980 0x7f1a50155680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a501602e0 tx=0x7f1a440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f2f0a812640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2efc0df000 0x7f2efc179650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fc3cf0e8640 1 -- start start 2024-05-10T08:40:31.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f6d91d9b640 1 -- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c038e90 msgr2=0x7f6d8c050fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f6d91d9b640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c038e90 0x7f6d8c050fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f6d91d9b640 1 -- 172.21.15.37:0/933045830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c0e1240 msgr2=0x7f6d8c0d91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f6d91d9b640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0d91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7f6d91d9b640 1 -- 172.21.15.37:0/933045830 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c0d6970 con 0x7f6d8c0516f0 2024-05-10T08:40:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f0a812640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2efc0df3e0 0x7f2efc031b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f0a812640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc007680 con 0x7f2efc050330 2024-05-10T08:40:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f0a812640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc0073a0 con 0x7f2efc0df000 2024-05-10T08:40:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f0a812640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc007ba0 con 0x7f2efc0df3e0 2024-05-10T08:40:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f6d91d9b640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c0516f0 0x7f6d8c04cd30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800c440 tx=0x7f6d88001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc04f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc04f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58018/0 (socket says 172.21.15.37:58018) 2024-05-10T08:40:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 -- 172.21.15.37:0/980592194 learned_addr learned my addr 172.21.15.37:0/980592194 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fc0d7fff640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0d80d4cc0 0x7fc0d80b26e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009d90 tx=0x7fc0d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f0900f640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2efc0df000 0x7f2efc179650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad537fe640 1 -- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d1970 msgr2=0x7fad5415e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad537fe640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d1970 0x7fad5415e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.802+0000 7fad537fe640 1 -- 172.21.15.37:0/3913928698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162290 msgr2=0x7fad541fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fad537fe640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162290 0x7fad541fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fad537fe640 1 -- 172.21.15.37:0/3913928698 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad540b8940 con 0x7fad540d4cc0 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fad58bd4640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162290 0x7fad541fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.803+0000 7fad537fe640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad540d4cc0 0x7fad54161d50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad4400e7e0 tx=0x7fad4400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f0a011640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2efc0df3e0 0x7f2efc031b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fad50ff9640 1 -- 172.21.15.37:0/3913928698 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4400f040 con 0x7fad540d4cc0 2024-05-10T08:40:31.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a34069b00 con 0x7f8a34070920 2024-05-10T08:40:31.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f6d82ffd640 1 -- 172.21.15.37:0/933045830 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88017070 con 0x7f6d8c0516f0 2024-05-10T08:40:31.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f42b14c0640 1 -- start start 2024-05-10T08:40:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 -- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2efc0df3e0 msgr2=0x7f2efc031b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f6d82ffd640 1 -- 172.21.15.37:0/933045830 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d88005ce0 con 0x7f6d8c0516f0 2024-05-10T08:40:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f6d82ffd640 1 -- 172.21.15.37:0/933045830 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88017070 con 0x7f6d8c0516f0 2024-05-10T08:40:31.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2efc0df3e0 0x7f2efc031b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 -- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2efc0df000 msgr2=0x7f2efc179650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8c0d5df0 con 0x7f6d8c0516f0 2024-05-10T08:40:31.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fc3cf0e8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c80d0fc0 0x7fc3c80af790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fc3cf0e8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c80ae750 con 0x7fc3c8163500 2024-05-10T08:40:31.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fc3cf0e8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c81638e0 con 0x7fc3c806ff00 2024-05-10T08:40:31.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fc3cf0e8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c80ae9d0 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2efc0df000 0x7f2efc179650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7f2f09810640 1 -- 172.21.15.37:0/980592194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc0db1d0 con 0x7f2efc050330 2024-05-10T08:40:31.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8c0d63b0 con 0x7f6d8c0516f0 2024-05-10T08:40:31.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7f2f0a011640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2efc0df3e0 0x7f2efc031b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:31.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7f2f09810640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc04f9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009fd0 tx=0x7f2ef400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc3cd685640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c80d0fc0 0x7fc3c80af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc3cd685640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c80d0fc0 0x7fc3c80af790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53274/0 (socket says 172.21.15.37:53274) 2024-05-10T08:40:31.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc3cd685640 1 -- 172.21.15.37:0/2748993374 learned_addr learned my addr 172.21.15.37:0/2748993374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7f2efa7fc640 1 -- 172.21.15.37:0/980592194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4017070 con 0x7f2efc050330 2024-05-10T08:40:31.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc3cd685640 1 -- 172.21.15.37:0/2748993374 >> v1:172.21.15.82:6789/0 conn(0x7fc3c806ff00 legacy=0x7fc3c80d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc0d57fa640 1 -- 172.21.15.37:0/1738994712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0004250 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7f2efa7fc640 1 -- 172.21.15.37:0/980592194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef400c940 con 0x7f2efc050330 2024-05-10T08:40:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc0db4b0 con 0x7f2efc050330 2024-05-10T08:40:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d81ea900 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d80c8e80 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b14c0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac071f60 0x7f42ac1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7fc0d57fa640 1 -- 172.21.15.37:0/1738994712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d00043f0 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7fc0d57fa640 1 -- 172.21.15.37:0/1738994712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00047c0 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b14c0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42ac0ce120 0x7f42ac157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b14c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac0cfa10 0x7f42ac09dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b14c0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac15b700 con 0x7f42ac0cfa10 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b14c0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac06f870 con 0x7f42ac071f60 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b14c0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac073570 con 0x7f42ac0ce120 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b0cbf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac0cfa10 0x7f42ac09dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f42b0cbf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac0cfa10 0x7f42ac09dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58022/0 (socket says 172.21.15.37:58022) 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f42b0cbf640 1 -- 172.21.15.37:0/386247282 learned_addr learned my addr 172.21.15.37:0/386247282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc0dba70 con 0x7f2efc050330 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fad50ff9640 1 -- 172.21.15.37:0/3913928698 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad44004030 con 0x7fad540d4cc0 2024-05-10T08:40:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.804+0000 7fad50ff9640 1 -- 172.21.15.37:0/3913928698 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad440043e0 con 0x7fad540d4cc0 2024-05-10T08:40:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad540b8c20 con 0x7fad540d4cc0 2024-05-10T08:40:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad540b91e0 con 0x7fad540d4cc0 2024-05-10T08:40:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc3cd685640 1 -- 172.21.15.37:0/2748993374 >> v1:172.21.15.37:6789/0 conn(0x7fc3c8163500 legacy=0x7fc3c806e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.805+0000 7fc3cd685640 1 -- 172.21.15.37:0/2748993374 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c80aecb0 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f1a3effd640 1 -- 172.21.15.37:0/999102682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44040020 con 0x7f1a50159980 2024-05-10T08:40:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f1a3effd640 1 -- 172.21.15.37:0/999102682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a44038040 con 0x7f1a50159980 2024-05-10T08:40:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.806+0000 7f1a3effd640 1 -- 172.21.15.37:0/999102682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44037070 con 0x7f1a50159980 2024-05-10T08:40:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f2efa7fc640 1 -- 172.21.15.37:0/980592194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400ccf0 con 0x7f2efc050330 2024-05-10T08:40:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f42b0cbf640 1 -- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42ac0ce120 msgr2=0x7f42ac157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f42b0cbf640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42ac0ce120 0x7f42ac157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad540693f0 con 0x7fad540d4cc0 2024-05-10T08:40:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f42b0cbf640 1 -- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac071f60 msgr2=0x7f42ac1507f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T08:40:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f42b0cbf640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac071f60 0x7f42ac1507f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f42b0cbf640 1 -- 172.21.15.37:0/386247282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac156560 con 0x7f42ac0cfa10 2024-05-10T08:40:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.807+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8c005740 con 0x7f6d8c0516f0 2024-05-10T08:40:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc005710 con 0x7f2efc050330 2024-05-10T08:40:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7fc3cd685640 1 --2- 172.21.15.37:0/2748993374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c80d0fc0 0x7fc3c80af790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009e80 tx=0x7fc3c002a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74ce91d7f859707f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7f42b0cbf640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac0cfa10 0x7f42ac09dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f429400c3f0 tx=0x7f429400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7f8a30ff9640 1 -- 172.21.15.37:0/4244094641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a2401a070 con 0x7f8a34070920 2024-05-10T08:40:31.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7fad50ff9640 1 -- 172.21.15.37:0/3913928698 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fad4400c6d0 con 0x7fad540d4cc0 2024-05-10T08:40:31.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b8005290 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7f1a5486d640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a501f5370 con 0x7f1a50159980 2024-05-10T08:40:31.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.808+0000 7f1a5486d640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a501f5930 con 0x7f1a50159980 2024-05-10T08:40:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7f8a30ff9640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a14076540 0x7f8a14078a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7f6d82ffd640 1 -- 172.21.15.37:0/933045830 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d8801a070 con 0x7f6d8c0516f0 2024-05-10T08:40:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7fad50ff9640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fad340763a0 0x7fad34078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7fc3c77fe640 1 -- 172.21.15.37:0/2748993374 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0036070 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7fc3c77fe640 1 -- 172.21.15.37:0/2748993374 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c0031600 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7fc3c77fe640 1 -- 172.21.15.37:0/2748993374 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00319d0 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7fad50ff9640 1 -- 172.21.15.37:0/3913928698 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fad440975f0 con 0x7fad540d4cc0 2024-05-10T08:40:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7fad53fff640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fad340763a0 0x7fad34078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7f2efa7fc640 1 -- 172.21.15.37:0/980592194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ef401a070 con 0x7f2efc050330 2024-05-10T08:40:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7f8a30ff9640 1 -- 172.21.15.37:0/4244094641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a24096b30 con 0x7f8a34070920 2024-05-10T08:40:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7f1a5486d640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a50069b00 con 0x7f1a50159980 2024-05-10T08:40:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7f8a33fff640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a14076540 0x7f8a14078a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.809+0000 7f6d82ffd640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6d740766d0 0x7f6d74078b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7f6d82ffd640 1 -- 172.21.15.37:0/933045830 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d88005ae0 con 0x7f6d8c0516f0 2024-05-10T08:40:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7f6d9259c640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6d740766d0 0x7f6d74078b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2748993374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c80d0fc0 msgr2=0x7fc3c80af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2748993374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c80d0fc0 0x7fc3c80af790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009e80 tx=0x7fc3c002a750 comp rx=0 tx=0).stop 2024-05-10T08:40:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7f2efa7fc640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ee80762d0 0x7f2ee8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2748993374 shutdown_connections 2024-05-10T08:40:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2748993374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c80d0fc0 0x7fc3c80af790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2748993374 >> 172.21.15.37:0/2748993374 conn(0x7fc3c806c3a0 msgr2=0x7fc3c806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fad53fff640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fad340763a0 0x7fad34078860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad540b2c90 tx=0x7fad3c009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc0d57fa640 1 -- 172.21.15.37:0/1738994712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0d0039040 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7f8a33fff640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a14076540 0x7f8a14078a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0083b0 tx=0x7f8a2c031000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2748993374 shutdown_connections 2024-05-10T08:40:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2748993374 wait complete. 2024-05-10T08:40:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.810+0000 7f2efa7fc640 1 -- 172.21.15.37:0/980592194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2ef4098010 con 0x7f2efc050330 2024-05-10T08:40:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.811+0000 7f6d9259c640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6d740766d0 0x7f6d74078b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d84034000 tx=0x7f6d8402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.811+0000 7f2f0900f640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ee80762d0 0x7f2ee8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.811+0000 7fc0d57fa640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0c4076320 0x7fc0c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.811+0000 7fc0dcfa4640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0c4076320 0x7fc0c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.811+0000 7f2f0900f640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ee80762d0 0x7f2ee8078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0db000 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.812+0000 7fc0dcfa4640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0c4076320 0x7fc0c40787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8005880 tx=0x7fc0c8007a00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.812+0000 7fc3cf0e8640 1 Processor -- start 2024-05-10T08:40:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.812+0000 7fc3cf0e8640 1 -- start start 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cf0e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c806ff00 0x7fc3c81ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cf0e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80d0fc0 0x7fc3c81ec700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cf0e8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c8163500 0x7fc3c81522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cf0e8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c80b3c20 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cf0e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c80af270 con 0x7fc3c806ff00 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cf0e8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c80b3da0 con 0x7fc3c8163500 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80d0fc0 0x7fc3c81ec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cd685640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c8163500 0x7fc3c81522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80d0fc0 0x7fc3c81ec700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58028/0 (socket says 172.21.15.37:58028) 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 -- 172.21.15.37:0/2582704977 learned_addr learned my addr 172.21.15.37:0/2582704977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cce84640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c806ff00 0x7fc3c81ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 -- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c8163500 msgr2=0x7fc3c81522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c8163500 0x7fc3c81522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 -- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c806ff00 msgr2=0x7fc3c81ebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c806ff00 0x7fc3c81ebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 -- 172.21.15.37:0/2582704977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c8151530 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cd685640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c8163500 0x7fc3c81522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3cce84640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c806ff00 0x7fc3c81ebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.813+0000 7fc3c7fff640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80d0fc0 0x7fc3c81ec700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c480 tx=0x7fc3bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.814+0000 7fc0d57fa640 1 -- 172.21.15.37:0/1738994712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc0d0032df0 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.814+0000 7f8a30ff9640 1 -- 172.21.15.37:0/4244094641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8a2405fba0 con 0x7f8a34070920 2024-05-10T08:40:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.814+0000 7fad50ff9640 1 -- 172.21.15.37:0/3913928698 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fad44017020 con 0x7fad540d4cc0 2024-05-10T08:40:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7f42a8ff9640 1 -- 172.21.15.37:0/386247282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42940052d0 con 0x7f42ac0cfa10 2024-05-10T08:40:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7f6d82ffd640 1 -- 172.21.15.37:0/933045830 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6d8805f590 con 0x7f6d8c0516f0 2024-05-10T08:40:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac156800 con 0x7f42ac0cfa10 2024-05-10T08:40:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7f2efa7fc640 1 -- 172.21.15.37:0/980592194 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2ef4060fc0 con 0x7f2efc050330 2024-05-10T08:40:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7fc3c57fa640 1 -- 172.21.15.37:0/2582704977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0052d0 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c8151810 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac15e5c0 con 0x7f42ac0cfa10 2024-05-10T08:40:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.819+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c8151dd0 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.820+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c80693f0 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.820+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac0b0260 con 0x7f42ac0cfa10 2024-05-10T08:40:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.821+0000 7f1a3effd640 1 -- 172.21.15.37:0/999102682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a44043020 con 0x7f1a50159980 2024-05-10T08:40:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.822+0000 7f1a3effd640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a30076320 0x7f1a300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.822+0000 7f1a4e59c640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a30076320 0x7f1a300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.823+0000 7f1a4e59c640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a30076320 0x7f1a300787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006d40 tx=0x7f1a40008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.824+0000 7f42a8ff9640 1 -- 172.21.15.37:0/386247282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4294005470 con 0x7f42ac0cfa10 2024-05-10T08:40:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.825+0000 7f1a3effd640 1 -- 172.21.15.37:0/999102682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1a4403ddf0 con 0x7f1a50159980 2024-05-10T08:40:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.825+0000 7fc0d57fa640 1 -- 172.21.15.37:0/1738994712 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc0d0040030 con 0x7fc0d80d4cc0 2024-05-10T08:40:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.825+0000 7f42a8ff9640 1 -- 172.21.15.37:0/386247282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294020060 con 0x7f42ac0cfa10 2024-05-10T08:40:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.825+0000 7fc3c57fa640 1 -- 172.21.15.37:0/2582704977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3bc005470 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.825+0000 7fc3c57fa640 1 -- 172.21.15.37:0/2582704977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc012830 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.827+0000 7f42a8ff9640 1 -- 172.21.15.37:0/386247282 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42940069d0 con 0x7f42ac0cfa10 2024-05-10T08:40:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.827+0000 7f42a8ff9640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f428c076300 0x7f428c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.828+0000 7f42abfff640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f428c076300 0x7f428c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.828+0000 7f42abfff640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f428c076300 0x7f428c0787c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f429c037000 tx=0x7f429c00d000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.829+0000 7fc3c57fa640 1 -- 172.21.15.37:0/2582704977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3bc0129d0 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.830+0000 7fc3c57fa640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3b40762d0 0x7fc3b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.830+0000 7fc3cce84640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3b40762d0 0x7fc3b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.831+0000 7fc3cce84640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3b40762d0 0x7fc3b4078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8006fd0 tx=0x7fc3b8009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.832+0000 7f42a8ff9640 1 -- 172.21.15.37:0/386247282 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f429405c770 con 0x7f42ac0cfa10 2024-05-10T08:40:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.832+0000 7f1a3effd640 1 -- 172.21.15.37:0/999102682 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1a4404a030 con 0x7f1a50159980 2024-05-10T08:40:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.833+0000 7fc3c57fa640 1 -- 172.21.15.37:0/2582704977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3bc096130 con 0x7fc3c80d0fc0 2024-05-10T08:40:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.842+0000 7f42a8ff9640 1 -- 172.21.15.37:0/386247282 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4294060be0 con 0x7f42ac0cfa10 2024-05-10T08:40:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:31.852+0000 7fc3c57fa640 1 -- 172.21.15.37:0/2582704977 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc3bc060f10 con 0x7fc3c80d0fc0 2024-05-10T08:40:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.260+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc0b8005850 con 0x7fc0d80d4cc0 2024-05-10T08:40:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.261+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fad540bae90 con 0x7fad540d4cc0 2024-05-10T08:40:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.261+0000 7fc0d57fa640 1 -- 172.21.15.37:0/1738994712 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0d0082870 con 0x7fc0d80d4cc0 2024-05-10T08:40:32.261 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-05-10T08:40:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.262+0000 7fad50ff9640 1 -- 172.21.15.37:0/3913928698 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad44060630 con 0x7fad540d4cc0 2024-05-10T08:40:32.264 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-10T08:40:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0c4076320 msgr2=0x7fc0c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0c4076320 0x7fc0c40787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8005880 tx=0x7fc0c8007a00 comp rx=0 tx=0).stop 2024-05-10T08:40:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0d80d4cc0 msgr2=0x7fc0d80b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0d80d4cc0 0x7fc0d80b26e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009d90 tx=0x7fc0d0004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fad340763a0 msgr2=0x7fad34078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 shutdown_connections 2024-05-10T08:40:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0c4076320 0x7fc0c40787e0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8005880 tx=0x7fc0c8007a00 comp rx=0 tx=0).stop 2024-05-10T08:40:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0d80b8e60 0x7fc0d80b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0d80d4cc0 0x7fc0d80b26e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 --2- 172.21.15.37:0/1738994712 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0d80d1970 0x7fc0d80cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.265+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 >> 172.21.15.37:0/1738994712 conn(0x7fc0d808eac0 msgr2=0x7fc0d80b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fad340763a0 0x7fad34078860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad540b2c90 tx=0x7fad3c009060 comp rx=0 tx=0).stop 2024-05-10T08:40:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6d8c04ddd0 con 0x7f6d8c0516f0 2024-05-10T08:40:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad540d4cc0 msgr2=0x7fad54161d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad540d4cc0 0x7fad54161d50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad4400e7e0 tx=0x7fad4400eca0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 shutdown_connections 2024-05-10T08:40:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fad340763a0 0x7fad34078860 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162290 0x7fad541fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad540d4cc0 0x7fad54161d50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7fad5a637640 1 --2- 172.21.15.37:0/3913928698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad540d1970 0x7fad5415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.266+0000 7f6d82ffd640 1 -- 172.21.15.37:0/933045830 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d88063890 con 0x7f6d8c0516f0 2024-05-10T08:40:32.270 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2024-05-10T08:40:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.267+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 >> 172.21.15.37:0/3913928698 conn(0x7fad5408eac0 msgr2=0x7fad5406cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.267+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 shutdown_connections 2024-05-10T08:40:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.267+0000 7fad5a637640 1 -- 172.21.15.37:0/3913928698 wait complete. 2024-05-10T08:40:32.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.267+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 shutdown_connections 2024-05-10T08:40:32.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.267+0000 7fc0df208640 1 -- 172.21.15.37:0/1738994712 wait complete. 2024-05-10T08:40:32.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.267+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8a3415cd90 con 0x7f8a34070920 2024-05-10T08:40:32.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.268+0000 7f8a30ff9640 1 -- 172.21.15.37:0/4244094641 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a240681e0 con 0x7f8a34070920 2024-05-10T08:40:32.272 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6d740766d0 msgr2=0x7f6d74078b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6d740766d0 0x7f6d74078b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d84034000 tx=0x7f6d8402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c0516f0 msgr2=0x7f6d8c04cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c0516f0 0x7f6d8c04cd30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800c440 tx=0x7f6d88001e70 comp rx=0 tx=0).stop 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 shutdown_connections 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6d740766d0 0x7f6d74078b90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c0e1240 0x7f6d8c0d91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d8c0516f0 0x7f6d8c04cd30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 --2- 172.21.15.37:0/933045830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d8c038e90 0x7f6d8c050fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.270+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 >> 172.21.15.37:0/933045830 conn(0x7f6d8c053780 msgr2=0x7f6d8c0e0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.271+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 shutdown_connections 2024-05-10T08:40:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.271+0000 7f6d98a93640 1 -- 172.21.15.37:0/933045830 wait complete. 2024-05-10T08:40:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a14076540 msgr2=0x7f8a14078a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a14076540 0x7f8a14078a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0083b0 tx=0x7f8a2c031000 comp rx=0 tx=0).stop 2024-05-10T08:40:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a34070920 msgr2=0x7f8a3413cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a34070920 0x7f8a3413cb50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c780 tx=0x7f8a2400cc40 comp rx=0 tx=0).stop 2024-05-10T08:40:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2efc054b20 con 0x7f2efc050330 2024-05-10T08:40:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 shutdown_connections 2024-05-10T08:40:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a14076540 0x7f8a14078a00 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0083b0 tx=0x7f8a2c031000 comp rx=0 tx=0).stop 2024-05-10T08:40:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a3415eb80 0x7f8a340b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a34070920 0x7f8a3413cb50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 --2- 172.21.15.37:0/4244094641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a3406ea50 0x7f8a34159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.272+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 >> 172.21.15.37:0/4244094641 conn(0x7f8a340738e0 msgr2=0x7f8a34075840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.273+0000 7f2efa7fc640 1 -- 172.21.15.37:0/980592194 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ef40652c0 con 0x7f2efc050330 2024-05-10T08:40:32.276 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.273+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 shutdown_connections 2024-05-10T08:40:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.273+0000 7f8a3a9c1640 1 -- 172.21.15.37:0/4244094641 wait complete. 2024-05-10T08:40:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.276+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ee80762d0 msgr2=0x7f2ee8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.276+0000 7f2f0a812640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ee80762d0 0x7f2ee8078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0db000 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 msgr2=0x7f2efc04f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc04f9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009fd0 tx=0x7f2ef400ed40 comp rx=0 tx=0).stop 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 shutdown_connections 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ee80762d0 0x7f2ee8078790 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0db000 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2efc0df3e0 0x7f2efc031b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2efc0df000 0x7f2efc179650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 --2- 172.21.15.37:0/980592194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2efc050330 0x7f2efc04f9b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.277+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 >> 172.21.15.37:0/980592194 conn(0x7f2efc00a400 msgr2=0x7f2efc038330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.278+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 shutdown_connections 2024-05-10T08:40:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.278+0000 7f2f0a812640 1 -- 172.21.15.37:0/980592194 wait complete. 2024-05-10T08:40:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.280+0000 7f1a5486d640 1 -- 172.21.15.37:0/999102682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1a501f5d10 con 0x7f1a50159980 2024-05-10T08:40:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.281+0000 7f1a3effd640 1 -- 172.21.15.37:0/999102682 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a44081830 con 0x7f1a50159980 2024-05-10T08:40:32.281 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.285+0000 7f1a3cff9640 1 -- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a30076320 msgr2=0x7f1a300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.285+0000 7f1a3cff9640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a30076320 0x7f1a300787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006d40 tx=0x7f1a40008040 comp rx=0 tx=0).stop 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.285+0000 7f1a3cff9640 1 -- 172.21.15.37:0/999102682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a50159980 msgr2=0x7f1a50155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.285+0000 7f1a3cff9640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a50159980 0x7f1a50155680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a501602e0 tx=0x7f1a440046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.285+0000 7f1a3cff9640 1 -- 172.21.15.37:0/999102682 shutdown_connections 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.285+0000 7f1a3cff9640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a30076320 0x7f1a300787e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.286+0000 7f1a3cff9640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a501605f0 0x7f1a500b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.286+0000 7f1a3cff9640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a50159980 0x7f1a50155680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.286+0000 7f1a3cff9640 1 --2- 172.21.15.37:0/999102682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a500af4d0 0x7f1a50159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.286+0000 7f1a3cff9640 1 -- 172.21.15.37:0/999102682 >> 172.21.15.37:0/999102682 conn(0x7f1a500b39a0 msgr2=0x7f1a500b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.286+0000 7f1a3cff9640 1 -- 172.21.15.37:0/999102682 shutdown_connections 2024-05-10T08:40:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.286+0000 7f1a3cff9640 1 -- 172.21.15.37:0/999102682 wait complete. 2024-05-10T08:40:32.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-05-10T08:40:32.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-05-10T08:40:32.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-05-10T08:40:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.292+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f42ac050740 con 0x7f42ac0cfa10 2024-05-10T08:40:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.293+0000 7f42a8ff9640 1 -- 172.21.15.37:0/386247282 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42940604e0 con 0x7f42ac0cfa10 2024-05-10T08:40:32.293 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-10T08:40:32.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.293+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc3c81ece30 con 0x7fc3c80d0fc0 2024-05-10T08:40:32.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.294+0000 7fc3c57fa640 1 -- 172.21.15.37:0/2582704977 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3bc065210 con 0x7fc3c80d0fc0 2024-05-10T08:40:32.293 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-10T08:40:32.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-05-10T08:40:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f428c076300 msgr2=0x7f428c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f428c076300 0x7f428c0787c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f429c037000 tx=0x7f429c00d000 comp rx=0 tx=0).stop 2024-05-10T08:40:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac0cfa10 msgr2=0x7f42ac09dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac0cfa10 0x7f42ac09dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f429400c3f0 tx=0x7f429400c8b0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3b40762d0 msgr2=0x7fc3b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3b40762d0 0x7fc3b4078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8006fd0 tx=0x7fc3b8009060 comp rx=0 tx=0).stop 2024-05-10T08:40:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80d0fc0 msgr2=0x7fc3c81ec700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80d0fc0 0x7fc3c81ec700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c480 tx=0x7fc3bc00c940 comp rx=0 tx=0).stop 2024-05-10T08:40:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 shutdown_connections 2024-05-10T08:40:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f428c076300 0x7f428c0787c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 shutdown_connections 2024-05-10T08:40:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3b40762d0 0x7fc3b4078790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3c8163500 0x7fc3c81522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80d0fc0 0x7fc3c81ec700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 --2- 172.21.15.37:0/2582704977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3c806ff00 0x7fc3c81ebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 >> 172.21.15.37:0/2582704977 conn(0x7fc3c806c3a0 msgr2=0x7fc3c80b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac0cfa10 0x7f42ac09dcd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42ac0ce120 0x7f42ac157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 --2- 172.21.15.37:0/386247282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42ac071f60 0x7f42ac1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 >> 172.21.15.37:0/386247282 conn(0x7f42ac0cd600 msgr2=0x7f42ac0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 shutdown_connections 2024-05-10T08:40:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.296+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 shutdown_connections 2024-05-10T08:40:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.297+0000 7f42b14c0640 1 -- 172.21.15.37:0/386247282 wait complete. 2024-05-10T08:40:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:32.297+0000 7fc3cf0e8640 1 -- 172.21.15.37:0/2582704977 wait complete. 2024-05-10T08:40:32.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-05-10T08:40:32.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-05-10T08:40:32.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-05-10T08:40:32.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-05-10T08:40:33.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T08:40:33.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T08:40:33.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T08:40:33.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T08:40:33.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T08:40:33.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T08:40:33.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T08:40:33.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T08:40:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.463+0000 7ff99a7dd640 1 Processor -- start 2024-05-10T08:40:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.463+0000 7f111ee59640 1 Processor -- start 2024-05-10T08:40:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.463+0000 7f111ee59640 1 -- start start 2024-05-10T08:40:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7f111ee59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f111815f2d0 0x7f11180b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.463+0000 7ff99a7dd640 1 -- start start 2024-05-10T08:40:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff99a7dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994167c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff99a7dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9940cfd00 0x7ff9940d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff99a7dd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9940d31d0 con 0x7ff9940b4770 2024-05-10T08:40:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff99a7dd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff994168170 con 0x7ff9940cfd00 2024-05-10T08:40:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff99a7dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff9940d34b0 con 0x7ff9940d53d0 2024-05-10T08:40:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7f111ee59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11180d2730 con 0x7f11180d4fc0 2024-05-10T08:40:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7f111ee59640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11181606c0 con 0x7f11180d2310 2024-05-10T08:40:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7f111ee59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f11180b5810 con 0x7f111815f2d0 2024-05-10T08:40:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff9937fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994167c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff998d7a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9940cfd00 0x7ff9940d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff9937fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994167c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53296/0 (socket says 172.21.15.37:53296) 2024-05-10T08:40:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7ff9937fe640 1 -- 172.21.15.37:0/478523333 learned_addr learned my addr 172.21.15.37:0/478523333 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7f1117fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f11180d4fc0 0x7f11180d1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40976/0 (socket says 172.21.15.37:40976) 2024-05-10T08:40:33.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7f1117fff640 1 -- 172.21.15.37:0/1026752563 learned_addr learned my addr 172.21.15.37:0/1026752563 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:33.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7fe76ebc8640 1 Processor -- start 2024-05-10T08:40:33.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.465+0000 7fe76ebc8640 1 -- start start 2024-05-10T08:40:33.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.466+0000 7f111cbf5640 1 --2- 172.21.15.37:0/1026752563 >> v2:172.21.15.82:3300/0 conn(0x7f111815f2d0 0x7f11180b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.466+0000 7ff9937fe640 1 -- 172.21.15.37:0/478523333 >> v2:172.21.15.37:3300/0 conn(0x7ff9940cfd00 msgr2=0x7ff9940d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.466+0000 7ff9937fe640 1 --2- 172.21.15.37:0/478523333 >> v2:172.21.15.37:3300/0 conn(0x7ff9940cfd00 0x7ff9940d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.466+0000 7ff9937fe640 1 -- 172.21.15.37:0/478523333 >> v1:172.21.15.37:6789/0 conn(0x7ff9940b4770 legacy=0x7ff9940d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.466+0000 7ff9937fe640 1 -- 172.21.15.37:0/478523333 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9940d3790 con 0x7ff9940d53d0 2024-05-10T08:40:33.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7f11177fe640 1 -- 172.21.15.37:0/1026752563 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085364255 0 0) 0x7f11180d2730 con 0x7f11180d4fc0 2024-05-10T08:40:33.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7f11177fe640 1 -- 172.21.15.37:0/1026752563 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1100003520 con 0x7f11180d4fc0 2024-05-10T08:40:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe76ebc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe768163680 0x7fe7680d4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe76ebc8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe768167b50 0x7fe7680d4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe76ebc8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76806dae0 con 0x7fe76806eb80 2024-05-10T08:40:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe76ebc8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe76806d890 con 0x7fe768163680 2024-05-10T08:40:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe76ebc8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe76806ddc0 con 0x7fe768167b50 2024-05-10T08:40:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7f111cbf5640 1 -- 172.21.15.37:0/1026752563 >> v1:172.21.15.82:6789/0 conn(0x7f11180d2310 legacy=0x7f11180d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7f111cbf5640 1 -- 172.21.15.37:0/1026752563 >> v1:172.21.15.37:6789/0 conn(0x7f11180d4fc0 legacy=0x7f11180d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7f111cbf5640 1 -- 172.21.15.37:0/1026752563 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11180b4f00 con 0x7f111815f2d0 2024-05-10T08:40:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe767fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe76806eb80 0x7fe768167440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40992/0 (socket says 172.21.15.37:40992) 2024-05-10T08:40:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe767fff640 1 -- 172.21.15.37:0/4067456715 learned_addr learned my addr 172.21.15.37:0/4067456715 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.467+0000 7fe76d165640 1 --2- 172.21.15.37:0/4067456715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe768167b50 0x7fe7680d4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.468+0000 7fe76d165640 1 -- 172.21.15.37:0/4067456715 >> v2:172.21.15.37:3300/0 conn(0x7fe768163680 msgr2=0x7fe7680d4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.468+0000 7fe76d165640 1 --2- 172.21.15.37:0/4067456715 >> v2:172.21.15.37:3300/0 conn(0x7fe768163680 0x7fe7680d4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.468+0000 7fe76d165640 1 -- 172.21.15.37:0/4067456715 >> v1:172.21.15.37:6789/0 conn(0x7fe76806eb80 legacy=0x7fe768167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.468+0000 7fe76d165640 1 -- 172.21.15.37:0/4067456715 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76806e0a0 con 0x7fe768167b50 2024-05-10T08:40:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7f111cbf5640 1 --2- 172.21.15.37:0/1026752563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 0x7f11180b5ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1110009d90 tx=0x7f111002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=319a1775b08c9ea4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7ff9937fe640 1 --2- 172.21.15.37:0/478523333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994167c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff988009870 tx=0x7ff98802a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d950c27724f7291 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7fe76d165640 1 --2- 172.21.15.37:0/4067456715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe768167b50 0x7fe7680d4a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe76806da10 tx=0x7fe76002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc1857ded4035197 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7f11177fe640 1 -- 172.21.15.37:0/1026752563 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110007740 con 0x7f111815f2d0 2024-05-10T08:40:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7f11177fe640 1 -- 172.21.15.37:0/1026752563 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11100078e0 con 0x7f111815f2d0 2024-05-10T08:40:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7f11177fe640 1 -- 172.21.15.37:0/1026752563 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110007cf0 con 0x7f111815f2d0 2024-05-10T08:40:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7fe7677fe640 1 -- 172.21.15.37:0/4067456715 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760007740 con 0x7fe768167b50 2024-05-10T08:40:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7fe7677fe640 1 -- 172.21.15.37:0/4067456715 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7600078e0 con 0x7fe768167b50 2024-05-10T08:40:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7fe7677fe640 1 -- 172.21.15.37:0/4067456715 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760007cb0 con 0x7fe768167b50 2024-05-10T08:40:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.469+0000 7ff992ffd640 1 -- 172.21.15.37:0/478523333 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988037070 con 0x7ff9940d53d0 2024-05-10T08:40:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.470+0000 7f111ee59640 1 -- 172.21.15.37:0/1026752563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 msgr2=0x7f11180b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.470+0000 7f111ee59640 1 --2- 172.21.15.37:0/1026752563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 0x7f11180b5ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1110009d90 tx=0x7f111002a730 comp rx=0 tx=0).stop 2024-05-10T08:40:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.470+0000 7fe76ebc8640 1 -- 172.21.15.37:0/4067456715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe768167b50 msgr2=0x7fe7680d4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7ff992ffd640 1 -- 172.21.15.37:0/478523333 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98802ae00 con 0x7ff9940d53d0 2024-05-10T08:40:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7ff992ffd640 1 -- 172.21.15.37:0/478523333 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988032660 con 0x7ff9940d53d0 2024-05-10T08:40:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.470+0000 7f111ee59640 1 -- 172.21.15.37:0/1026752563 shutdown_connections 2024-05-10T08:40:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7f111ee59640 1 --2- 172.21.15.37:0/1026752563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 0x7f11180b5ca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7f111ee59640 1 -- 172.21.15.37:0/1026752563 >> 172.21.15.37:0/1026752563 conn(0x7f11180746d0 msgr2=0x7f111809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7f111ee59640 1 -- 172.21.15.37:0/1026752563 shutdown_connections 2024-05-10T08:40:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7f111ee59640 1 -- 172.21.15.37:0/1026752563 wait complete. 2024-05-10T08:40:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.470+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/4067456715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe768167b50 0x7fe7680d4a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe76806da10 tx=0x7fe76002a6d0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7fe76ebc8640 1 -- 172.21.15.37:0/4067456715 shutdown_connections 2024-05-10T08:40:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/4067456715 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe768167b50 0x7fe7680d4a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/4067456715 >> v2:172.21.15.37:3300/0 conn(0x7fe768163680 0x7fe7680d4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7fe76ebc8640 1 -- 172.21.15.37:0/4067456715 >> 172.21.15.37:0/4067456715 conn(0x7fe7680d5210 msgr2=0x7fe7680d5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7fe76ebc8640 1 -- 172.21.15.37:0/4067456715 shutdown_connections 2024-05-10T08:40:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.471+0000 7fe76ebc8640 1 -- 172.21.15.37:0/4067456715 wait complete. 2024-05-10T08:40:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 -- 172.21.15.37:0/478523333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 msgr2=0x7ff994167c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 --2- 172.21.15.37:0/478523333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994167c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff988009870 tx=0x7ff98802a0f0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 -- 172.21.15.37:0/478523333 shutdown_connections 2024-05-10T08:40:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 --2- 172.21.15.37:0/478523333 >> v2:172.21.15.37:3300/0 conn(0x7ff9940cfd00 0x7ff9940d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 --2- 172.21.15.37:0/478523333 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994167c30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 -- 172.21.15.37:0/478523333 >> 172.21.15.37:0/478523333 conn(0x7ff99408eac0 msgr2=0x7ff99409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 -- 172.21.15.37:0/478523333 shutdown_connections 2024-05-10T08:40:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.473+0000 7f111ee59640 1 Processor -- start 2024-05-10T08:40:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.473+0000 7f111ee59640 1 -- start start 2024-05-10T08:40:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.473+0000 7fe76ebc8640 1 Processor -- start 2024-05-10T08:40:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.474+0000 7fe76ebc8640 1 -- start start 2024-05-10T08:40:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.472+0000 7ff99a7dd640 1 -- 172.21.15.37:0/478523333 wait complete. 2024-05-10T08:40:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.474+0000 7ff99a7dd640 1 Processor -- start 2024-05-10T08:40:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.475+0000 7f111ee59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11180d2310 0x7f11180b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.475+0000 7ff99a7dd640 1 -- start start 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.475+0000 7f111cbf5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11180d2310 0x7f11180b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.475+0000 7f111cbf5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11180d2310 0x7f11180b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58040/0 (socket says 172.21.15.37:58040) 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.475+0000 7f111cbf5640 1 -- 172.21.15.37:0/1436624706 learned_addr learned my addr 172.21.15.37:0/1436624706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.475+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11180d4fc0 0x7f111815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 0x7f11180b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11180d5420 con 0x7f11180d2310 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7f1117fff640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11180d4fc0 0x7f111815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f11180b54a0 con 0x7f111815f2d0 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f11180d55a0 con 0x7f11180d4fc0 2024-05-10T08:40:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7ff99a7dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940b4770 0x7ff9940c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7fe76ebc8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe76806eb80 0x7fe768205ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7fe76ebc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe768163680 0x7fe768206000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7fe76ebc8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe768167b50 0x7fe7680b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7fe76ebc8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680b3c60 con 0x7fe768163680 2024-05-10T08:40:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7fe76ebc8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe76806e660 con 0x7fe768167b50 2024-05-10T08:40:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.476+0000 7fe76ebc8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe7680b3de0 con 0x7fe76806eb80 2024-05-10T08:40:33.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7ff993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940b4770 0x7ff9940c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7fe767fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe768163680 0x7fe768206000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7fe767fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe768163680 0x7fe768206000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58060/0 (socket says 172.21.15.37:58060) 2024-05-10T08:40:33.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7fe767fff640 1 -- 172.21.15.37:0/1207403979 learned_addr learned my addr 172.21.15.37:0/1207403979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7f111cbf5640 1 -- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11180d4fc0 msgr2=0x7f111815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7f111cbf5640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11180d4fc0 0x7f111815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7f111cbf5640 1 -- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 msgr2=0x7f11180b67d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T08:40:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7f111cbf5640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 0x7f11180b67d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7f111cbf5640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11180b2180 con 0x7f11180d2310 2024-05-10T08:40:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7fe767fff640 1 -- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe76806eb80 msgr2=0x7fe768205ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7fe76c964640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe76806eb80 0x7fe768205ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7ff99a7dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9940cfd00 0x7ff9940b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7ff99a7dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7ff99a7dd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9940d2df0 con 0x7ff9940b4770 2024-05-10T08:40:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7fe76d165640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe768167b50 0x7fe7680b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff9937fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9940cfd00 0x7ff9940b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff99a7dd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9940c8430 con 0x7ff9940cfd00 2024-05-10T08:40:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940b4770 0x7ff9940c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58056/0 (socket says 172.21.15.37:58056) 2024-05-10T08:40:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff99a7dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff9940d2f70 con 0x7ff9940d53d0 2024-05-10T08:40:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff993fff640 1 -- 172.21.15.37:0/783334127 learned_addr learned my addr 172.21.15.37:0/783334127 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff998d7a640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7f111cbf5640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11180d2310 0x7f11180b1c40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1110009d90 tx=0x7f1110004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7f1117fff640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11180d4fc0 0x7f111815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.477+0000 7fe767fff640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe76806eb80 0x7fe768205ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7fe767fff640 1 -- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe768167b50 msgr2=0x7fe7680b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7f11157fa640 1 -- 172.21.15.37:0/1436624706 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111003f070 con 0x7f11180d2310 2024-05-10T08:40:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7f11157fa640 1 -- 172.21.15.37:0/1436624706 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1110031b40 con 0x7f11180d2310 2024-05-10T08:40:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7f11157fa640 1 -- 172.21.15.37:0/1436624706 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110043410 con 0x7f11180d2310 2024-05-10T08:40:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111815aad0 con 0x7f11180d2310 2024-05-10T08:40:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7fe767fff640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe768167b50 0x7fe7680b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff998d7a640 1 -- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9940cfd00 msgr2=0x7ff9940b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7fe767fff640 1 -- 172.21.15.37:0/1207403979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76815cb50 con 0x7fe768163680 2024-05-10T08:40:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff998d7a640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9940cfd00 0x7ff9940b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff998d7a640 1 -- 172.21.15.37:0/783334127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940b4770 msgr2=0x7ff9940c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff998d7a640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940b4770 0x7ff9940c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.478+0000 7ff998d7a640 1 -- 172.21.15.37:0/783334127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff994156b90 con 0x7ff9940d53d0 2024-05-10T08:40:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.479+0000 7ff998d7a640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994072cd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d530 tx=0x7ff98400d9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.479+0000 7fe767fff640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe768163680 0x7fe768206000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c4a0 tx=0x7fe75800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.479+0000 7ff993fff640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940b4770 0x7ff9940c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.479+0000 7ff9937fe640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9940cfd00 0x7ff9940b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.479+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1118160f00 con 0x7f11180d2310 2024-05-10T08:40:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.480+0000 7fe7657fa640 1 -- 172.21.15.37:0/1207403979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758017070 con 0x7fe768163680 2024-05-10T08:40:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.480+0000 7fe7657fa640 1 -- 172.21.15.37:0/1207403979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe758005ce0 con 0x7fe768163680 2024-05-10T08:40:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.480+0000 7fe7657fa640 1 -- 172.21.15.37:0/1207403979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758007270 con 0x7fe768163680 2024-05-10T08:40:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.480+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76815ce30 con 0x7fe768163680 2024-05-10T08:40:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.481+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76815d3f0 con 0x7fe768163680 2024-05-10T08:40:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.482+0000 7ff990ff9640 1 -- 172.21.15.37:0/783334127 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9840125f0 con 0x7ff9940d53d0 2024-05-10T08:40:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.482+0000 7ff99a7dd640 1 -- 172.21.15.37:0/783334127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9940b8d60 con 0x7ff9940d53d0 2024-05-10T08:40:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.482+0000 7ff99a7dd640 1 -- 172.21.15.37:0/783334127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff994156e30 con 0x7ff9940d53d0 2024-05-10T08:40:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.482+0000 7ff990ff9640 1 -- 172.21.15.37:0/783334127 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff984019070 con 0x7ff9940d53d0 2024-05-10T08:40:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.483+0000 7ff990ff9640 1 -- 172.21.15.37:0/783334127 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9840125f0 con 0x7ff9940d53d0 2024-05-10T08:40:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.484+0000 7ff99a7dd640 1 -- 172.21.15.37:0/783334127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff974005290 con 0x7ff9940d53d0 2024-05-10T08:40:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.484+0000 7fe7657fa640 1 -- 172.21.15.37:0/1207403979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe75801a070 con 0x7fe768163680 2024-05-10T08:40:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.484+0000 7fe7657fa640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7540763a0 0x7fe754078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.485+0000 7fe7657fa640 1 -- 172.21.15.37:0/1207403979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe758096c10 con 0x7fe768163680 2024-05-10T08:40:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.485+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe748005290 con 0x7fe768163680 2024-05-10T08:40:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.485+0000 7f11157fa640 1 -- 172.21.15.37:0/1436624706 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f111003b410 con 0x7f11180d2310 2024-05-10T08:40:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.486+0000 7f11157fa640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11040763a0 0x7f1104078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.486+0000 7f11157fa640 1 -- 172.21.15.37:0/1436624706 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f11100b8c30 con 0x7f11180d2310 2024-05-10T08:40:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.487+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1118069b00 con 0x7f11180d2310 2024-05-10T08:40:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.487+0000 7ff990ff9640 1 -- 172.21.15.37:0/783334127 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff984012790 con 0x7ff9940d53d0 2024-05-10T08:40:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.487+0000 7fe76c964640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7540763a0 0x7fe754078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.487+0000 7f1117fff640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11040763a0 0x7f1104078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.487+0000 7ff990ff9640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff9800766d0 0x7ff980078b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.487+0000 7ff990ff9640 1 -- 172.21.15.37:0/783334127 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff98400f040 con 0x7ff9940d53d0 2024-05-10T08:40:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.488+0000 7ff993fff640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff9800766d0 0x7ff980078b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.488+0000 7fe76c964640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7540763a0 0x7fe754078860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00a810 tx=0x7fe75c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.488+0000 7f1117fff640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11040763a0 0x7f1104078860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f111815eb60 tx=0x7f1108009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.489+0000 7ff993fff640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff9800766d0 0x7ff980078b90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9940b5730 tx=0x7ff98c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.490+0000 7ff990ff9640 1 -- 172.21.15.37:0/783334127 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff984061710 con 0x7ff9940d53d0 2024-05-10T08:40:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.495+0000 7fe7657fa640 1 -- 172.21.15.37:0/1207403979 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe758068020 con 0x7fe768163680 2024-05-10T08:40:33.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.505+0000 7f11157fa640 1 -- 172.21.15.37:0/1436624706 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f111815aad0 con 0x7f11180d2310 2024-05-10T08:40:33.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.519+0000 7fd42a3da640 1 Processor -- start 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.519+0000 7fd42a3da640 1 -- start start 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fd42a3da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4240b5360 0x7fd4240b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fd42a3da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415ecd0 0x7fd42415f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fd42a3da640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4240b42c0 con 0x7fd42415b0f0 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fd42a3da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd42415f680 con 0x7fd4240b5360 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fd42a3da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd4240b45a0 con 0x7fd42415ecd0 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fd4237fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4240b5360 0x7fd4240b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fd4237fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4240b5360 0x7fd4240b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58064/0 (socket says 172.21.15.37:58064) 2024-05-10T08:40:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.522+0000 7fd4237fe640 1 -- 172.21.15.37:0/293157750 learned_addr learned my addr 172.21.15.37:0/293157750 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.522+0000 7fd4237fe640 1 -- 172.21.15.37:0/293157750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415ecd0 msgr2=0x7fd42415f140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T08:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.522+0000 7fd4237fe640 1 --2- 172.21.15.37:0/293157750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415ecd0 0x7fd42415f140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.522+0000 7fd4237fe640 1 -- 172.21.15.37:0/293157750 >> v1:172.21.15.82:6789/0 conn(0x7fd42415b0f0 legacy=0x7fd4240aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.522+0000 7fd4237fe640 1 -- 172.21.15.37:0/293157750 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4240b4880 con 0x7fd4240b5360 2024-05-10T08:40:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fbb0f59e640 1 Processor -- start 2024-05-10T08:40:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.521+0000 7fbb0f59e640 1 -- start start 2024-05-10T08:40:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7f3306b78640 1 Processor -- start 2024-05-10T08:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0f59e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb080e0010 0x7fbb0800b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0f59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb08008f40 0x7fbb0803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0f59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb0803adf0 0x7fbb08007c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0f59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbb0800b700 con 0x7fbb08008f40 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0f59e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbb0800cb20 con 0x7fbb0803adf0 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0f59e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb080565c0 con 0x7fbb080e0010 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0e59c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb080e0010 0x7fbb0800b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0e59c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb080e0010 0x7fbb0800b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53364/0 (socket says 172.21.15.37:53364) 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0e59c640 1 -- 172.21.15.37:0/3026632980 learned_addr learned my addr 172.21.15.37:0/3026632980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7fbb0ed9d640 1 --2- 172.21.15.37:0/3026632980 >> v2:172.21.15.82:3300/0 conn(0x7fbb0803adf0 0x7fbb08007c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.524+0000 7fd4237fe640 1 --2- 172.21.15.37:0/293157750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd4240b3c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd414009ad0 tx=0x7fd41402a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123f4432262fa0d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.524+0000 7fbb0e59c640 1 -- 172.21.15.37:0/3026632980 >> v2:172.21.15.82:3300/0 conn(0x7fbb0803adf0 msgr2=0x7fbb08007c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.524+0000 7fbb0e59c640 1 --2- 172.21.15.37:0/3026632980 >> v2:172.21.15.82:3300/0 conn(0x7fbb0803adf0 0x7fbb08007c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.524+0000 7fbb0e59c640 1 -- 172.21.15.37:0/3026632980 >> v2:172.21.15.37:3300/0 conn(0x7fbb08008f40 msgr2=0x7fbb0803a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.524+0000 7fbb0e59c640 1 --2- 172.21.15.37:0/3026632980 >> v2:172.21.15.37:3300/0 conn(0x7fbb08008f40 0x7fbb0803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.524+0000 7fbb0e59c640 1 -- 172.21.15.37:0/3026632980 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb080568a0 con 0x7fbb080e0010 2024-05-10T08:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.523+0000 7f3306b78640 1 -- start start 2024-05-10T08:40:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306b78640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f330015b1c0 0x7f33000700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306b78640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3300071f60 0x7f33000cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306b78640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33000cff50 0x7f330006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306b78640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f330006fd00 con 0x7f330015b1c0 2024-05-10T08:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306b78640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f33000d03c0 con 0x7f3300071f60 2024-05-10T08:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306b78640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f330006f870 con 0x7f33000cff50 2024-05-10T08:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7fd422ffd640 1 -- 172.21.15.37:0/293157750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414036070 con 0x7fd4240b5360 2024-05-10T08:40:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7fd422ffd640 1 -- 172.21.15.37:0/293157750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd414031600 con 0x7fd4240b5360 2024-05-10T08:40:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306377640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33000cff50 0x7f330006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306377640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33000cff50 0x7f330006de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53366/0 (socket says 172.21.15.37:53366) 2024-05-10T08:40:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306377640 1 -- 172.21.15.37:0/544559392 learned_addr learned my addr 172.21.15.37:0/544559392 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306377640 1 -- 172.21.15.37:0/544559392 >> v2:172.21.15.82:3300/0 conn(0x7f3300071f60 msgr2=0x7f33000cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3305375640 1 --2- 172.21.15.37:0/544559392 >> v2:172.21.15.82:3300/0 conn(0x7f3300071f60 0x7f33000cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306377640 1 --2- 172.21.15.37:0/544559392 >> v2:172.21.15.82:3300/0 conn(0x7f3300071f60 0x7f33000cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306377640 1 -- 172.21.15.37:0/544559392 >> v2:172.21.15.37:3300/0 conn(0x7f330015b1c0 msgr2=0x7f33000700c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7f3306377640 1 --2- 172.21.15.37:0/544559392 >> v2:172.21.15.37:3300/0 conn(0x7f330015b1c0 0x7f33000700c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7f3306377640 1 -- 172.21.15.37:0/544559392 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3300070910 con 0x7f33000cff50 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7fd42a3da640 1 -- 172.21.15.37:0/293157750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 msgr2=0x7fd4240b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7fd42a3da640 1 --2- 172.21.15.37:0/293157750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd4240b3c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd414009ad0 tx=0x7fd41402a490 comp rx=0 tx=0).stop 2024-05-10T08:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7f3626fc1640 1 Processor -- start 2024-05-10T08:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7f3306377640 1 --2- 172.21.15.37:0/544559392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33000cff50 0x7f330006de90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3300076250 tx=0x7f32f002c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fcf166f2a59fa33 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.527+0000 7f3304b74640 1 -- 172.21.15.37:0/544559392 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0008be0 con 0x7f33000cff50 2024-05-10T08:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.527+0000 7f3304b74640 1 -- 172.21.15.37:0/544559392 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f0008d80 con 0x7f33000cff50 2024-05-10T08:40:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.527+0000 7f3304b74640 1 -- 172.21.15.37:0/544559392 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f000a2f0 con 0x7f33000cff50 2024-05-10T08:40:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7f3626fc1640 1 -- start start 2024-05-10T08:40:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.527+0000 7f99276cc640 1 Processor -- start 2024-05-10T08:40:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.525+0000 7fbb0e59c640 1 --2- 172.21.15.37:0/3026632980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb080e0010 0x7fbb0800b1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009870 tx=0x7fbb0002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=131a91d81e5005af server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7fbb0d59a640 1 -- 172.21.15.37:0/3026632980 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00037070 con 0x7fbb080e0010 2024-05-10T08:40:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7fbb0d59a640 1 -- 172.21.15.37:0/3026632980 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb00032440 con 0x7fbb080e0010 2024-05-10T08:40:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.526+0000 7fbb0d59a640 1 -- 172.21.15.37:0/3026632980 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb000327f0 con 0x7fbb080e0010 2024-05-10T08:40:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.527+0000 7fbb0f59e640 1 -- 172.21.15.37:0/3026632980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb080e0010 msgr2=0x7fbb0800b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.527+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/3026632980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb080e0010 0x7fbb0800b1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009870 tx=0x7fbb0002a230 comp rx=0 tx=0).stop 2024-05-10T08:40:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.527+0000 7f99276cc640 1 -- start start 2024-05-10T08:40:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fd42a3da640 1 -- 172.21.15.37:0/293157750 shutdown_connections 2024-05-10T08:40:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fd42a3da640 1 --2- 172.21.15.37:0/293157750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415ecd0 0x7fd42415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fd42a3da640 1 --2- 172.21.15.37:0/293157750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd4240b3c20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fd42a3da640 1 -- 172.21.15.37:0/293157750 >> 172.21.15.37:0/293157750 conn(0x7fd4240b2920 msgr2=0x7fd4240b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 -- 172.21.15.37:0/544559392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33000cff50 msgr2=0x7f330006de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 --2- 172.21.15.37:0/544559392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33000cff50 0x7f330006de90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3300076250 tx=0x7f32f002c3c0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fbb0f59e640 1 -- 172.21.15.37:0/3026632980 shutdown_connections 2024-05-10T08:40:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/3026632980 >> v2:172.21.15.82:3300/0 conn(0x7fbb0803adf0 0x7fbb08007c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/3026632980 >> v2:172.21.15.37:3300/0 conn(0x7fbb08008f40 0x7fbb0803a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/3026632980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb080e0010 0x7fbb0800b1c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fbb0f59e640 1 -- 172.21.15.37:0/3026632980 >> 172.21.15.37:0/3026632980 conn(0x7fbb0801ef60 msgr2=0x7fbb08055c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fd42a3da640 1 -- 172.21.15.37:0/293157750 shutdown_connections 2024-05-10T08:40:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 -- 172.21.15.37:0/544559392 shutdown_connections 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 --2- 172.21.15.37:0/544559392 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33000cff50 0x7f330006de90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 --2- 172.21.15.37:0/544559392 >> v2:172.21.15.82:3300/0 conn(0x7f3300071f60 0x7f33000cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 --2- 172.21.15.37:0/544559392 >> v2:172.21.15.37:3300/0 conn(0x7f330015b1c0 0x7f33000700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 -- 172.21.15.37:0/544559392 >> 172.21.15.37:0/544559392 conn(0x7f33000cd600 msgr2=0x7f33000cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 -- 172.21.15.37:0/544559392 shutdown_connections 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7f3306b78640 1 -- 172.21.15.37:0/544559392 wait complete. 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f99276cc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f992015f130 0x7f99200d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f3626fc1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3618048100 0x7f3618006f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f3626fc1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3618054560 0x7f361804f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f3626fc1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3618005f10 con 0x7f36180074b0 2024-05-10T08:40:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f3626fc1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f36180e7b90 con 0x7f3618054560 2024-05-10T08:40:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f3626fc1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3618006ae0 con 0x7f3618048100 2024-05-10T08:40:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f99276cc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f510 0x7f99200d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f99276cc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99200d2cd0 con 0x7f99200d0a10 2024-05-10T08:40:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f99276cc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f99200d2a80 con 0x7f992015f130 2024-05-10T08:40:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f99276cc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f99200d2fb0 con 0x7f992015f510 2024-05-10T08:40:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fd42a3da640 1 -- 172.21.15.37:0/293157750 wait complete. 2024-05-10T08:40:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fbb0f59e640 1 -- 172.21.15.37:0/3026632980 shutdown_connections 2024-05-10T08:40:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.528+0000 7fbb0f59e640 1 -- 172.21.15.37:0/3026632980 wait complete. 2024-05-10T08:40:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f362555e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3618054560 0x7f361804f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f362555e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3618054560 0x7f361804f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58090/0 (socket says 172.21.15.37:58090) 2024-05-10T08:40:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.529+0000 7f362555e640 1 -- 172.21.15.37:0/1164176039 learned_addr learned my addr 172.21.15.37:0/1164176039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7f9924c67640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f510 0x7f99200d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7fd42a3da640 1 Processor -- start 2024-05-10T08:40:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7f9924c67640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f510 0x7f99200d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53368/0 (socket says 172.21.15.37:53368) 2024-05-10T08:40:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7f9924c67640 1 -- 172.21.15.37:0/2068522723 learned_addr learned my addr 172.21.15.37:0/2068522723 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7f9925468640 1 --2- 172.21.15.37:0/2068522723 >> v2:172.21.15.82:3300/0 conn(0x7f992015f130 0x7f99200d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7fd42a3da640 1 -- start start 2024-05-10T08:40:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7f3306b78640 1 Processor -- start 2024-05-10T08:40:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7f3306b78640 1 -- start start 2024-05-10T08:40:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7f3624d5d640 1 --2- 172.21.15.37:0/1164176039 >> v2:172.21.15.82:3300/0 conn(0x7f3618048100 0x7f3618006f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f9917fff640 1 -- 172.21.15.37:0/2068522723 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062974437 0 0) 0x7f99200d2cd0 con 0x7f99200d0a10 2024-05-10T08:40:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f9917fff640 1 -- 172.21.15.37:0/2068522723 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c003520 con 0x7f99200d0a10 2024-05-10T08:40:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f9925468640 1 -- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f510 msgr2=0x7f99200d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f9925468640 1 --2- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f510 0x7f99200d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f9925468640 1 -- 172.21.15.37:0/2068522723 >> v1:172.21.15.82:6789/0 conn(0x7f99200d0a10 legacy=0x7f9920162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f9925468640 1 -- 172.21.15.37:0/2068522723 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99200d3290 con 0x7f992015f130 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f362555e640 1 -- 172.21.15.37:0/1164176039 >> v2:172.21.15.82:3300/0 conn(0x7f3618048100 msgr2=0x7f3618006f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f362555e640 1 --2- 172.21.15.37:0/1164176039 >> v2:172.21.15.82:3300/0 conn(0x7f3618048100 0x7f3618006f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f362555e640 1 -- 172.21.15.37:0/1164176039 >> v1:172.21.15.37:6789/0 conn(0x7f36180074b0 legacy=0x7f3618053e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f362555e640 1 -- 172.21.15.37:0/1164176039 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3618053280 con 0x7f3618054560 2024-05-10T08:40:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f9924c67640 1 --2- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f510 0x7f99200d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f3306b78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3300071f60 0x7f330015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f3306b78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33000cff50 0x7f330009d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f3306b78640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f330015b1c0 0x7f330015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f3306b78640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f330006f220 con 0x7f3300071f60 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f3306b78640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3300073570 con 0x7f33000cff50 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.531+0000 7f3306b78640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f330006f500 con 0x7f330015b1c0 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3306377640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f330015b1c0 0x7f330015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3306377640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f330015b1c0 0x7f330015d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53372/0 (socket says 172.21.15.37:53372) 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3306377640 1 -- 172.21.15.37:0/2819344245 learned_addr learned my addr 172.21.15.37:0/2819344245 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3305375640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33000cff50 0x7f330009d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3305b76640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3300071f60 0x7f330015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7fbb0f59e640 1 Processor -- start 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.530+0000 7fbb0f59e640 1 -- start start 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fbb0f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb08008f40 0x7fbb0804f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fbb0f59e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb0803adf0 0x7fbb0804d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fbb0f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb080e0010 0x7fbb0804f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fbb0f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb080e03f0 con 0x7fbb08008f40 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fbb0f59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb08053490 con 0x7fbb080e0010 2024-05-10T08:40:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fbb0f59e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb0803b600 con 0x7fbb0803adf0 2024-05-10T08:40:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3306377640 1 -- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33000cff50 msgr2=0x7f330009d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f9925468640 1 --2- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f130 0x7f99200d3a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f991c0097a0 tx=0x7f991c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c780380e47dce35 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3306377640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33000cff50 0x7f330009d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd42a3da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd42409eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd42a3da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415b0f0 0x7fd42409ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd42a3da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd42415ecd0 0x7fd424200d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd42a3da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd42415c4e0 con 0x7fd4240b5360 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd42a3da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240b4e40 con 0x7fd42415ecd0 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd42a3da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd4240b3410 con 0x7fd42415b0f0 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd423fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd42409eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd423fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd42409eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58110/0 (socket says 172.21.15.37:58110) 2024-05-10T08:40:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd423fff640 1 -- 172.21.15.37:0/2978808246 learned_addr learned my addr 172.21.15.37:0/2978808246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7fd428977640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd42415ecd0 0x7fd424200d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb080e0010 0x7fbb0804f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb080e0010 0x7fbb0804f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55804/0 (socket says 172.21.15.37:55804) 2024-05-10T08:40:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb08008f40 0x7fbb0804f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0ed9d640 1 -- 172.21.15.37:0/1090498462 learned_addr learned my addr 172.21.15.37:0/1090498462 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd4237fe640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415b0f0 0x7fd42409ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd428977640 1 -- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415b0f0 msgr2=0x7fd42409ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd428977640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415b0f0 0x7fd42409ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.532+0000 7f3306377640 1 -- 172.21.15.37:0/2819344245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3300071f60 msgr2=0x7f330015c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd428977640 1 -- 172.21.15.37:0/2978808246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 msgr2=0x7fd42409eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd428977640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd42409eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd428977640 1 -- 172.21.15.37:0/2978808246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4240cf0e0 con 0x7fd42415ecd0 2024-05-10T08:40:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd423fff640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd42409eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7f9917fff640 1 -- 172.21.15.37:0/2068522723 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c037070 con 0x7f992015f130 2024-05-10T08:40:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7f9917fff640 1 -- 172.21.15.37:0/2068522723 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c032440 con 0x7f992015f130 2024-05-10T08:40:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd4237fe640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415b0f0 0x7fd42409ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7f9917fff640 1 -- 172.21.15.37:0/2068522723 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c032810 con 0x7f992015f130 2024-05-10T08:40:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0dd9b640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb0803adf0 0x7fbb0804d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7f3306377640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3300071f60 0x7f330015c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7f3306377640 1 -- 172.21.15.37:0/2819344245 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33001fd720 con 0x7f330015b1c0 2024-05-10T08:40:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7f3305b76640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3300071f60 0x7f330015c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0dd9b640 1 -- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb080e0010 msgr2=0x7fbb0804f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7f362555e640 1 --2- 172.21.15.37:0/1164176039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3618054560 0x7f361804f930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3618006c60 tx=0x7f360c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b2a85385c925a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0dd9b640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb080e0010 0x7fbb0804f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0dd9b640 1 -- 172.21.15.37:0/1090498462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb08008f40 msgr2=0x7fbb0804f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fd428977640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd42415ecd0 0x7fd424200d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd41800b3e0 tx=0x7fd41800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0dd9b640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb08008f40 0x7fbb0804f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0dd9b640 1 -- 172.21.15.37:0/1090498462 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0804dfb0 con 0x7fbb0803adf0 2024-05-10T08:40:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.533+0000 7fbb0e59c640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb08008f40 0x7fbb0804f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7fd420ff9640 1 -- 172.21.15.37:0/2978808246 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418015020 con 0x7fd42415ecd0 2024-05-10T08:40:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f3306377640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f330015b1c0 0x7f330015d7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32f002c9b0 tx=0x7f32f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7fd420ff9640 1 -- 172.21.15.37:0/2978808246 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd418011850 con 0x7fd42415ecd0 2024-05-10T08:40:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7fd420ff9640 1 -- 172.21.15.37:0/2978808246 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418011c40 con 0x7fd42415ecd0 2024-05-10T08:40:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f32f67fc640 1 -- 172.21.15.37:0/2819344245 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0040020 con 0x7f330015b1c0 2024-05-10T08:40:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f361f7fe640 1 -- 172.21.15.37:0/1164176039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c037070 con 0x7f3618054560 2024-05-10T08:40:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33001fc7c0 con 0x7f330015b1c0 2024-05-10T08:40:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f33001fcd80 con 0x7f330015b1c0 2024-05-10T08:40:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f32f67fc640 1 -- 172.21.15.37:0/2819344245 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f003c820 con 0x7f330015b1c0 2024-05-10T08:40:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f361f7fe640 1 -- 172.21.15.37:0/1164176039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360c032440 con 0x7f3618054560 2024-05-10T08:40:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f99276cc640 1 -- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f130 msgr2=0x7f99200d3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f99276cc640 1 --2- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f130 0x7f99200d3a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f991c0097a0 tx=0x7f991c02a180 comp rx=0 tx=0).stop 2024-05-10T08:40:33.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7fbb0dd9b640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb0803adf0 0x7fbb0804d860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb1006b1f0 tx=0x7fbb1006a810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.534+0000 7f32f67fc640 1 -- 172.21.15.37:0/2819344245 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f003cc10 con 0x7f330015b1c0 2024-05-10T08:40:33.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.535+0000 7f361f7fe640 1 -- 172.21.15.37:0/1164176039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c032810 con 0x7f3618054560 2024-05-10T08:40:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.535+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4240cf3c0 con 0x7fd42415ecd0 2024-05-10T08:40:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.535+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4240cf980 con 0x7fd42415ecd0 2024-05-10T08:40:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.535+0000 7f3626fc1640 1 -- 172.21.15.37:0/1164176039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3618054560 msgr2=0x7f361804f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.535+0000 7f3626fc1640 1 --2- 172.21.15.37:0/1164176039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3618054560 0x7f361804f930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3618006c60 tx=0x7f360c02a2c0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.535+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3300050740 con 0x7f330015b1c0 2024-05-10T08:40:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f3626fc1640 1 -- 172.21.15.37:0/1164176039 shutdown_connections 2024-05-10T08:40:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f3626fc1640 1 --2- 172.21.15.37:0/1164176039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3618054560 0x7f361804f930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7fbafeffd640 1 -- 172.21.15.37:0/1090498462 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10070990 con 0x7fbb0803adf0 2024-05-10T08:40:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7fbafeffd640 1 -- 172.21.15.37:0/1090498462 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb10070b30 con 0x7fbb0803adf0 2024-05-10T08:40:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7fbafeffd640 1 -- 172.21.15.37:0/1090498462 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10074130 con 0x7fbb0803adf0 2024-05-10T08:40:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f3626fc1640 1 --2- 172.21.15.37:0/1164176039 >> v2:172.21.15.82:3300/0 conn(0x7f3618048100 0x7f3618006f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f99276cc640 1 -- 172.21.15.37:0/2068522723 shutdown_connections 2024-05-10T08:40:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f99276cc640 1 --2- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f510 0x7f99200d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f99276cc640 1 --2- 172.21.15.37:0/2068522723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f130 0x7f99200d3a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f99276cc640 1 -- 172.21.15.37:0/2068522723 >> 172.21.15.37:0/2068522723 conn(0x7f99200d4eb0 msgr2=0x7f99200d52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f3626fc1640 1 -- 172.21.15.37:0/1164176039 >> 172.21.15.37:0/1164176039 conn(0x7f3618009fe0 msgr2=0x7f361800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0804e290 con 0x7fbb0803adf0 2024-05-10T08:40:33.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0804e850 con 0x7fbb0803adf0 2024-05-10T08:40:33.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f99276cc640 1 -- 172.21.15.37:0/2068522723 shutdown_connections 2024-05-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.536+0000 7f99276cc640 1 -- 172.21.15.37:0/2068522723 wait complete. 2024-05-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.537+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4240693f0 con 0x7fd42415ecd0 2024-05-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.537+0000 7f32f67fc640 1 -- 172.21.15.37:0/2819344245 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32f0043020 con 0x7f330015b1c0 2024-05-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.537+0000 7f3626fc1640 1 -- 172.21.15.37:0/1164176039 shutdown_connections 2024-05-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.537+0000 7f3626fc1640 1 -- 172.21.15.37:0/1164176039 wait complete. 2024-05-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.538+0000 7f32f67fc640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32e40763a0 0x7f32e4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.538+0000 7fd420ff9640 1 -- 172.21.15.37:0/2978808246 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd418018020 con 0x7fd42415ecd0 2024-05-10T08:40:33.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.538+0000 7f99276cc640 1 Processor -- start 2024-05-10T08:40:33.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.538+0000 7f99276cc640 1 -- start start 2024-05-10T08:40:33.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.538+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf4005290 con 0x7fbb0803adf0 2024-05-10T08:40:33.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7f3305b76640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32e40763a0 0x7f32e4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7fd420ff9640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd410076300 0x7fd4100787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7fd420ff9640 1 -- 172.21.15.37:0/2978808246 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd418097820 con 0x7fd42415ecd0 2024-05-10T08:40:33.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7f3626fc1640 1 Processor -- start 2024-05-10T08:40:33.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7f3626fc1640 1 -- start start 2024-05-10T08:40:33.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7fd423fff640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd410076300 0x7fd4100787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7f3305b76640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32e40763a0 0x7f32e4078860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f33000afe80 tx=0x7f32f800d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7f32f67fc640 1 -- 172.21.15.37:0/2819344245 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f32f00b78f0 con 0x7f330015b1c0 2024-05-10T08:40:33.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.539+0000 7fbafeffd640 1 -- 172.21.15.37:0/1090498462 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb100742d0 con 0x7fbb0803adf0 2024-05-10T08:40:33.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f99276cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200d0a10 0x7f9920158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7fd423fff640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd410076300 0x7fd4100787c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd41c007fd0 tx=0x7fd41c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f99276cc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f130 0x7f9920157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f99276cc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f510 0x7f99201e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f9925468640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200d0a10 0x7f9920158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f9925468640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200d0a10 0x7f9920158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58138/0 (socket says 172.21.15.37:58138) 2024-05-10T08:40:33.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f9925468640 1 -- 172.21.15.37:0/2573257557 learned_addr learned my addr 172.21.15.37:0/2573257557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7fbafeffd640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbaf00763a0 0x7fbaf0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99200d5d10 con 0x7f99200d0a10 2024-05-10T08:40:33.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7fbb0e59c640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbaf00763a0 0x7fbaf0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f9925c69640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f510 0x7f99201e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f99200d5b90 con 0x7f992015f510 2024-05-10T08:40:33.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f99201635f0 con 0x7f992015f130 2024-05-10T08:40:33.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7fbafeffd640 1 -- 172.21.15.37:0/1090498462 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbb10113320 con 0x7fbb0803adf0 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.540+0000 7f9924c67640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f130 0x7f9920157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f9925c69640 1 -- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f130 msgr2=0x7f9920157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f9925c69640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f130 0x7f9920157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f9925c69640 1 -- 172.21.15.37:0/2573257557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200d0a10 msgr2=0x7f9920158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f9925c69640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200d0a10 0x7f9920158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f9925c69640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9920158240 con 0x7f992015f510 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f9925468640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200d0a10 0x7f9920158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:33.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7fbb0e59c640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbaf00763a0 0x7fbaf0078860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb00034000 tx=0x7fbb0002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3626fc1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180074b0 0x7f36180de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f9925c69640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f510 0x7f99201e9fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f991800c700 tx=0x7f991800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3624d5d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180074b0 0x7f36180de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3624d5d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180074b0 0x7f36180de3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58144/0 (socket says 172.21.15.37:58144) 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3624d5d640 1 -- 172.21.15.37:0/1039981987 learned_addr learned my addr 172.21.15.37:0/1039981987 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3626fc1640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3618048100 0x7f36180e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3626fc1640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3618054560 0x7f36180e6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3626fc1640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3618006770 con 0x7f36180074b0 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3626fc1640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3618006490 con 0x7f3618048100 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f3626fc1640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f361804fe70 con 0x7f3618054560 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f362555e640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3618054560 0x7f36180e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.541+0000 7f361ffff640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3618048100 0x7f36180e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3624d5d640 1 -- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3618054560 msgr2=0x7f36180e6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3624d5d640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3618054560 0x7f36180e6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3624d5d640 1 -- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3618048100 msgr2=0x7f36180e5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3624d5d640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3618048100 0x7f36180e5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3624d5d640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36180e2320 con 0x7f36180074b0 2024-05-10T08:40:33.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f362555e640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3618054560 0x7f36180e6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:33.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3624d5d640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180074b0 0x7f36180de3e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f362006aed0 tx=0x7f362006a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f361d7fa640 1 -- 172.21.15.37:0/1039981987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620074880 con 0x7f36180074b0 2024-05-10T08:40:33.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f361d7fa640 1 -- 172.21.15.37:0/1039981987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3620074a20 con 0x7f36180074b0 2024-05-10T08:40:33.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3626fc1640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36180e2600 con 0x7f36180074b0 2024-05-10T08:40:33.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f32f67fc640 1 -- 172.21.15.37:0/2819344245 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f32f004a070 con 0x7f330015b1c0 2024-05-10T08:40:33.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.542+0000 7f3626fc1640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36180e2bc0 con 0x7f36180074b0 2024-05-10T08:40:33.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.544+0000 7f361d7fa640 1 -- 172.21.15.37:0/1039981987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620095640 con 0x7f36180074b0 2024-05-10T08:40:33.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.544+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f8005290 con 0x7f36180074b0 2024-05-10T08:40:33.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.544+0000 7f9915ffb640 1 -- 172.21.15.37:0/2573257557 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918003b70 con 0x7f992015f510 2024-05-10T08:40:33.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.544+0000 7f9915ffb640 1 -- 172.21.15.37:0/2573257557 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918003d30 con 0x7f992015f510 2024-05-10T08:40:33.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.544+0000 7f9915ffb640 1 -- 172.21.15.37:0/2573257557 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918005310 con 0x7f992015f510 2024-05-10T08:40:33.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.545+0000 7fd420ff9640 1 -- 172.21.15.37:0/2978808246 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd41801f020 con 0x7fd42415ecd0 2024-05-10T08:40:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.545+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99200b9bd0 con 0x7f992015f510 2024-05-10T08:40:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.545+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99200ba190 con 0x7f992015f510 2024-05-10T08:40:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.545+0000 7f361d7fa640 1 -- 172.21.15.37:0/1039981987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36200958a0 con 0x7f36180074b0 2024-05-10T08:40:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.546+0000 7f361d7fa640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36040762d0 0x7f3604078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.546+0000 7f361ffff640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36040762d0 0x7f3604078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.546+0000 7f361d7fa640 1 -- 172.21.15.37:0/1039981987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3620113da0 con 0x7f36180074b0 2024-05-10T08:40:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.547+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9920050740 con 0x7f992015f510 2024-05-10T08:40:33.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.548+0000 7fbafeffd640 1 -- 172.21.15.37:0/1090498462 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbb10099030 con 0x7fbb0803adf0 2024-05-10T08:40:33.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.548+0000 7f361ffff640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36040762d0 0x7f3604078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3618047ca0 tx=0x7f36140090e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.548+0000 7f9915ffb640 1 -- 172.21.15.37:0/2573257557 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f99180054b0 con 0x7f992015f510 2024-05-10T08:40:33.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.549+0000 7f9915ffb640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f99040762d0 0x7f9904078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:33.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.549+0000 7f9915ffb640 1 -- 172.21.15.37:0/2573257557 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9918097670 con 0x7f992015f510 2024-05-10T08:40:33.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.550+0000 7f9925468640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f99040762d0 0x7f9904078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:33.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.550+0000 7f9925468640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f99040762d0 0x7f9904078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f991c009560 tx=0x7f991c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:33.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.553+0000 7f9915ffb640 1 -- 172.21.15.37:0/2573257557 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9918060630 con 0x7f992015f510 2024-05-10T08:40:33.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.556+0000 7f361d7fa640 1 -- 172.21.15.37:0/1039981987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f36200dcd60 con 0x7f36180074b0 2024-05-10T08:40:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.916+0000 7ff99a7dd640 1 -- 172.21.15.37:0/783334127 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff974005850 con 0x7ff9940d53d0 2024-05-10T08:40:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.917+0000 7ff990ff9640 1 -- 172.21.15.37:0/783334127 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff984061010 con 0x7ff9940d53d0 2024-05-10T08:40:33.917 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-10T08:40:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.920+0000 7ff97a7fc640 1 -- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff9800766d0 msgr2=0x7ff980078b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.920+0000 7ff97a7fc640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff9800766d0 0x7ff980078b90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9940b5730 tx=0x7ff98c00b040 comp rx=0 tx=0).stop 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 -- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 msgr2=0x7ff994072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994072cd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d530 tx=0x7ff98400d9f0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 -- 172.21.15.37:0/783334127 shutdown_connections 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff9800766d0 0x7ff980078b90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9940d53d0 0x7ff994072cd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9940cfd00 0x7ff9940b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 --2- 172.21.15.37:0/783334127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940b4770 0x7ff9940c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.921+0000 7ff97a7fc640 1 -- 172.21.15.37:0/783334127 >> 172.21.15.37:0/783334127 conn(0x7ff99408eac0 msgr2=0x7ff9940b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.922+0000 7ff97a7fc640 1 -- 172.21.15.37:0/783334127 shutdown_connections 2024-05-10T08:40:33.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.922+0000 7ff97a7fc640 1 -- 172.21.15.37:0/783334127 wait complete. 2024-05-10T08:40:33.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-05-10T08:40:33.938 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:33.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.941+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe748005580 con 0x7fe768163680 2024-05-10T08:40:33.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.942+0000 7fe7657fa640 1 -- 172.21.15.37:0/1207403979 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe758068200 con 0x7fe768163680 2024-05-10T08:40:33.941 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2024-05-10T08:40:33.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7540763a0 msgr2=0x7fe754078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7540763a0 0x7fe754078860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00a810 tx=0x7fe75c008040 comp rx=0 tx=0).stop 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe768163680 msgr2=0x7fe768206000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe768163680 0x7fe768206000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c4a0 tx=0x7fe75800c960 comp rx=0 tx=0).stop 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 shutdown_connections 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7540763a0 0x7fe754078860 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe768167b50 0x7fe7680b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe768163680 0x7fe768206000 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 --2- 172.21.15.37:0/1207403979 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe76806eb80 0x7fe768205ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 >> 172.21.15.37:0/1207403979 conn(0x7fe7680d5210 msgr2=0x7fe768163ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 shutdown_connections 2024-05-10T08:40:33.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.945+0000 7fe76ebc8640 1 -- 172.21.15.37:0/1207403979 wait complete. 2024-05-10T08:40:33.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.959+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f111815d910 con 0x7f11180d2310 2024-05-10T08:40:33.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.960+0000 7f11157fa640 1 -- 172.21.15.37:0/1436624706 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11100822c0 con 0x7f11180d2310 2024-05-10T08:40:33.960 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:33.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-05-10T08:40:33.961 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:33.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.962+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11040763a0 msgr2=0x7f1104078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.962+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11040763a0 0x7f1104078860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f111815eb60 tx=0x7f1108009040 comp rx=0 tx=0).stop 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.962+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11180d2310 msgr2=0x7f11180b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.962+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11180d2310 0x7f11180b1c40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1110009d90 tx=0x7f1110004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 shutdown_connections 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11040763a0 0x7f1104078860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111815f2d0 0x7f11180b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11180d4fc0 0x7f111815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 --2- 172.21.15.37:0/1436624706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11180d2310 0x7f11180b1c40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 >> 172.21.15.37:0/1436624706 conn(0x7f11180746d0 msgr2=0x7f11180b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 shutdown_connections 2024-05-10T08:40:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.963+0000 7f111ee59640 1 -- 172.21.15.37:0/1436624706 wait complete. 2024-05-10T08:40:33.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.967+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f35f8005580 con 0x7f36180074b0 2024-05-10T08:40:33.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.967+0000 7f361d7fa640 1 -- 172.21.15.37:0/1039981987 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f36200e53a0 con 0x7f36180074b0 2024-05-10T08:40:33.966 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-10T08:40:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.969+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36040762d0 msgr2=0x7f3604078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.969+0000 7f360affd640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36040762d0 0x7f3604078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3618047ca0 tx=0x7f36140090e0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.969+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180074b0 msgr2=0x7f36180de3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.969+0000 7f360affd640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180074b0 0x7f36180de3e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f362006aed0 tx=0x7f362006a810 comp rx=0 tx=0).stop 2024-05-10T08:40:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.969+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 shutdown_connections 2024-05-10T08:40:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.969+0000 7f360affd640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36040762d0 0x7f3604078790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.969+0000 7f360affd640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3618054560 0x7f36180e6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.970+0000 7f360affd640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3618048100 0x7f36180e5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.970+0000 7f360affd640 1 --2- 172.21.15.37:0/1039981987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180074b0 0x7f36180de3e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.970+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 >> 172.21.15.37:0/1039981987 conn(0x7f3618009fe0 msgr2=0x7f3618005710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.970+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 shutdown_connections 2024-05-10T08:40:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.970+0000 7f360affd640 1 -- 172.21.15.37:0/1039981987 wait complete. 2024-05-10T08:40:33.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-05-10T08:40:33.975 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:33.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-05-10T08:40:33.981 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.989+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f33000ae840 con 0x7f330015b1c0 2024-05-10T08:40:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.989+0000 7f32f67fc640 1 -- 172.21.15.37:0/2819344245 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32f0080930 con 0x7f330015b1c0 2024-05-10T08:40:33.989 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32e40763a0 msgr2=0x7f32e4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32e40763a0 0x7f32e4078860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f33000afe80 tx=0x7f32f800d040 comp rx=0 tx=0).stop 2024-05-10T08:40:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f330015b1c0 msgr2=0x7f330015d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f330015b1c0 0x7f330015d7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32f002c9b0 tx=0x7f32f00046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 shutdown_connections 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32e40763a0 0x7f32e4078860 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f330015b1c0 0x7f330015d7c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33000cff50 0x7f330009d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 --2- 172.21.15.37:0/2819344245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3300071f60 0x7f330015c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 >> 172.21.15.37:0/2819344245 conn(0x7f33000cd600 msgr2=0x7f330015a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 shutdown_connections 2024-05-10T08:40:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.991+0000 7f3306b78640 1 -- 172.21.15.37:0/2819344245 wait complete. 2024-05-10T08:40:33.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.997+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd4240d19e0 con 0x7fd42415ecd0 2024-05-10T08:40:33.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.997+0000 7fd420ff9640 1 -- 172.21.15.37:0/2978808246 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd41801f020 con 0x7fd42415ecd0 2024-05-10T08:40:33.997 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2024-05-10T08:40:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.998+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9920074870 con 0x7f992015f510 2024-05-10T08:40:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:33.999+0000 7f9915ffb640 1 -- 172.21.15.37:0/2573257557 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9918064930 con 0x7f992015f510 2024-05-10T08:40:33.998 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2024-05-10T08:40:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbaf4005580 con 0x7fbb0803adf0 2024-05-10T08:40:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd410076300 msgr2=0x7fd4100787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd410076300 0x7fd4100787c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd41c007fd0 tx=0x7fd41c009040 comp rx=0 tx=0).stop 2024-05-10T08:40:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd42415ecd0 msgr2=0x7fd424200d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd42415ecd0 0x7fd424200d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd41800b3e0 tx=0x7fd41800b8a0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 shutdown_connections 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd410076300 0x7fd4100787c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd42415ecd0 0x7fd424200d90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd42415b0f0 0x7fd42409ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 --2- 172.21.15.37:0/2978808246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4240b5360 0x7fd42409eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.000+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 >> 172.21.15.37:0/2978808246 conn(0x7fd4240b2920 msgr2=0x7fd4240b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 shutdown_connections 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7fd42a3da640 1 -- 172.21.15.37:0/2978808246 wait complete. 2024-05-10T08:40:34.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7fbafeffd640 1 -- 172.21.15.37:0/1090498462 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb10090030 con 0x7fbb0803adf0 2024-05-10T08:40:34.002 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f99040762d0 msgr2=0x7f9904078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f99040762d0 0x7f9904078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f991c009560 tx=0x7f991c02e000 comp rx=0 tx=0).stop 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f510 msgr2=0x7f99201e9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f510 0x7f99201e9fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f991800c700 tx=0x7f991800cbc0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 shutdown_connections 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f99040762d0 0x7f9904078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992015f510 0x7f99201e9fa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f992015f130 0x7f9920157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 --2- 172.21.15.37:0/2573257557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200d0a10 0x7f9920158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 >> 172.21.15.37:0/2573257557 conn(0x7f99200d4eb0 msgr2=0x7f992015fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 shutdown_connections 2024-05-10T08:40:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.001+0000 7f99276cc640 1 -- 172.21.15.37:0/2573257557 wait complete. 2024-05-10T08:40:34.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-05-10T08:40:34.005 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbaf00763a0 msgr2=0x7fbaf0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbaf00763a0 0x7fbaf0078860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb00034000 tx=0x7fbb0002e000 comp rx=0 tx=0).stop 2024-05-10T08:40:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb0803adf0 msgr2=0x7fbb0804d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb0803adf0 0x7fbb0804d860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb1006b1f0 tx=0x7fbb1006a810 comp rx=0 tx=0).stop 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 shutdown_connections 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbaf00763a0 0x7fbaf0078860 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb080e0010 0x7fbb0804f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb0803adf0 0x7fbb0804d860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 --2- 172.21.15.37:0/1090498462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb08008f40 0x7fbb0804f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 >> 172.21.15.37:0/1090498462 conn(0x7fbb0801ef60 msgr2=0x7fbb08053fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 shutdown_connections 2024-05-10T08:40:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.004+0000 7fbb0f59e640 1 -- 172.21.15.37:0/1090498462 wait complete. 2024-05-10T08:40:34.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-05-10T08:40:34.015 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:34.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-05-10T08:40:34.015 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:34.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-05-10T08:40:34.016 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:34.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:40:34.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:40:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.159+0000 7f4958c1d640 1 Processor -- start 2024-05-10T08:40:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.159+0000 7f4958c1d640 1 -- start start 2024-05-10T08:40:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4958c1d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49540d0ec0 0x7f49540d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4958c1d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49540d3b00 0x7f49540b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4958c1d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49540d1760 con 0x7f495415f380 2024-05-10T08:40:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4958c1d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f49540d30f0 con 0x7f49540d0ec0 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4958c1d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f49540d2370 con 0x7f49540d3b00 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4951d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49540d0ec0 0x7f49540d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4951d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49540d0ec0 0x7f49540d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58158/0 (socket says 172.21.15.37:58158) 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f495259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f495415f380 0x7f49540d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41006/0 (socket says 172.21.15.37:41006) 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.160+0000 7f4951d9b640 1 -- 172.21.15.37:0/564468805 learned_addr learned my addr 172.21.15.37:0/564468805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.161+0000 7f4952d9d640 1 --2- 172.21.15.37:0/564468805 >> v2:172.21.15.82:3300/0 conn(0x7f49540d3b00 0x7f49540b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.161+0000 7f4951d9b640 1 -- 172.21.15.37:0/564468805 >> v2:172.21.15.82:3300/0 conn(0x7f49540d3b00 msgr2=0x7f49540b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.161+0000 7f4951d9b640 1 --2- 172.21.15.37:0/564468805 >> v2:172.21.15.82:3300/0 conn(0x7f49540d3b00 0x7f49540b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.161+0000 7f4951d9b640 1 -- 172.21.15.37:0/564468805 >> v1:172.21.15.37:6789/0 conn(0x7f495415f380 legacy=0x7f49540d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.161+0000 7f495159a640 1 -- 172.21.15.37:0/564468805 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585857972 0 0) 0x7f49540d1760 con 0x7f495415f380 2024-05-10T08:40:34.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.161+0000 7f4951d9b640 1 -- 172.21.15.37:0/564468805 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49540d1a40 con 0x7f49540d0ec0 2024-05-10T08:40:34.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.161+0000 7f4951d9b640 1 --2- 172.21.15.37:0/564468805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d0ec0 0x7f49540d35c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4954163f60 tx=0x7f494802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20a497cba97ff8b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f495159a640 1 -- 172.21.15.37:0/564468805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948037070 con 0x7f49540d0ec0 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f495159a640 1 -- 172.21.15.37:0/564468805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948032440 con 0x7f49540d0ec0 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f495159a640 1 -- 172.21.15.37:0/564468805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948032810 con 0x7f49540d0ec0 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 -- 172.21.15.37:0/564468805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d0ec0 msgr2=0x7f49540d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 --2- 172.21.15.37:0/564468805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d0ec0 0x7f49540d35c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4954163f60 tx=0x7f494802a270 comp rx=0 tx=0).stop 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 -- 172.21.15.37:0/564468805 shutdown_connections 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 --2- 172.21.15.37:0/564468805 >> v2:172.21.15.82:3300/0 conn(0x7f49540d3b00 0x7f49540b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 --2- 172.21.15.37:0/564468805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d0ec0 0x7f49540d35c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 -- 172.21.15.37:0/564468805 >> 172.21.15.37:0/564468805 conn(0x7f49540d4fe0 msgr2=0x7f49540d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 -- 172.21.15.37:0/564468805 shutdown_connections 2024-05-10T08:40:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.162+0000 7f4958c1d640 1 -- 172.21.15.37:0/564468805 wait complete. 2024-05-10T08:40:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 Processor -- start 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 -- start start 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49540d0ec0 0x7f49541626a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d3b00 0x7f49540caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f495415f380 0x7f495415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49540d2000 con 0x7f49540d3b00 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49540d3f30 con 0x7f49540d0ec0 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4958c1d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f495415f760 con 0x7f495415f380 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4951d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d3b00 0x7f49540caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.164+0000 7f4951d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d3b00 0x7f49540caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58164/0 (socket says 172.21.15.37:58164) 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4951d9b640 1 -- 172.21.15.37:0/2114753518 learned_addr learned my addr 172.21.15.37:0/2114753518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f495259c640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49540d0ec0 0x7f49541626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4952d9d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f495415f380 0x7f495415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4951d9b640 1 -- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f495415f380 msgr2=0x7f495415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4951d9b640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f495415f380 0x7f495415fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4951d9b640 1 -- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49540d0ec0 msgr2=0x7f49541626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4951d9b640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49540d0ec0 0x7f49541626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4951d9b640 1 -- 172.21.15.37:0/2114753518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4954162c80 con 0x7f49540d3b00 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f495259c640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49540d0ec0 0x7f49541626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4952d9d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f495415f380 0x7f495415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4951d9b640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d3b00 0x7f49540caf00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f49480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4942ffd640 1 -- 172.21.15.37:0/2114753518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948037040 con 0x7f49540d3b00 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4942ffd640 1 -- 172.21.15.37:0/2114753518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948004030 con 0x7f49540d3b00 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4954162f60 con 0x7f49540d3b00 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4942ffd640 1 -- 172.21.15.37:0/2114753518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948004400 con 0x7f49540d3b00 2024-05-10T08:40:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.165+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4954163520 con 0x7f49540d3b00 2024-05-10T08:40:34.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.166+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49540693f0 con 0x7f49540d3b00 2024-05-10T08:40:34.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.167+0000 7f4942ffd640 1 -- 172.21.15.37:0/2114753518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f494803a070 con 0x7f49540d3b00 2024-05-10T08:40:34.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.167+0000 7f4942ffd640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49340762d0 0x7f4934078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.167+0000 7f4942ffd640 1 -- 172.21.15.37:0/2114753518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f49480b7f50 con 0x7f49540d3b00 2024-05-10T08:40:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.168+0000 7f495259c640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49340762d0 0x7f4934078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.168+0000 7f495259c640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49340762d0 0x7f4934078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4944000f60 tx=0x7f4944009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.172+0000 7f4942ffd640 1 -- 172.21.15.37:0/2114753518 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4948041020 con 0x7f49540d3b00 2024-05-10T08:40:34.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.363+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49540b62b0 con 0x7f49340762d0 2024-05-10T08:40:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.372+0000 7f4942ffd640 1 -- 172.21.15.37:0/2114753518 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f49540b62b0 con 0x7f49340762d0 2024-05-10T08:40:34.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:40:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49340762d0 msgr2=0x7f4934078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49340762d0 0x7f4934078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4944000f60 tx=0x7f4944009040 comp rx=0 tx=0).stop 2024-05-10T08:40:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d3b00 msgr2=0x7f49540caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d3b00 0x7f49540caf00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f49480046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 shutdown_connections 2024-05-10T08:40:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49340762d0 0x7f4934078790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f495415f380 0x7f495415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49540d3b00 0x7f49540caf00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 --2- 172.21.15.37:0/2114753518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49540d0ec0 0x7f49541626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 >> 172.21.15.37:0/2114753518 conn(0x7f49540d4fe0 msgr2=0x7f49540ba3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 shutdown_connections 2024-05-10T08:40:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.375+0000 7f4958c1d640 1 -- 172.21.15.37:0/2114753518 wait complete. 2024-05-10T08:40:34.386 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-05-10T08:40:33.328286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219496,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755224,"statfs":{"total":773094113280,"available":772869349376,"internally_reserved":0,"allocated":3383296,"data_stored":2046072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.593941"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792232+0000","last_change":"2024-05-10T08:40:14.722841+0000","last_active":"2024-05-10T08:40:21.792232+0000","last_peered":"2024-05-10T08:40:21.792232+0000","last_clean":"2024-05-10T08:40:21.792232+0000","last_became_active":"2024-05-10T08:40:14.722183+0000","last_became_peered":"2024-05-10T08:40:14.722183+0000","last_unstale":"2024-05-10T08:40:21.792232+0000","last_undegraded":"2024-05-10T08:40:21.792232+0000","last_fullsized":"2024-05-10T08:40:21.792232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:06.547146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736024+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.736024+0000","last_peered":"2024-05-10T08:40:21.736024+0000","last_clean":"2024-05-10T08:40:21.736024+0000","last_became_active":"2024-05-10T08:40:15.727402+0000","last_became_peered":"2024-05-10T08:40:15.727402+0000","last_unstale":"2024-05-10T08:40:21.736024+0000","last_undegraded":"2024-05-10T08:40:21.736024+0000","last_fullsized":"2024-05-10T08:40:21.736024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737026+0000","last_change":"2024-05-10T08:40:20.252446+0000","last_active":"2024-05-10T08:40:21.737026+0000","last_peered":"2024-05-10T08:40:21.737026+0000","last_clean":"2024-05-10T08:40:21.737026+0000","last_became_active":"2024-05-10T08:40:20.251506+0000","last_became_peered":"2024-05-10T08:40:20.251506+0000","last_unstale":"2024-05-10T08:40:21.737026+0000","last_undegraded":"2024-05-10T08:40:21.737026+0000","last_fullsized":"2024-05-10T08:40:21.737026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:20.266480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736220+0000","last_change":"2024-05-10T08:40:14.718258+0000","last_active":"2024-05-10T08:40:21.736220+0000","last_peered":"2024-05-10T08:40:21.736220+0000","last_clean":"2024-05-10T08:40:21.736220+0000","last_became_active":"2024-05-10T08:40:14.717977+0000","last_became_peered":"2024-05-10T08:40:14.717977+0000","last_unstale":"2024-05-10T08:40:21.736220+0000","last_undegraded":"2024-05-10T08:40:21.736220+0000","last_fullsized":"2024-05-10T08:40:21.736220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791950+0000","last_change":"2024-05-10T08:40:15.728761+0000","last_active":"2024-05-10T08:40:21.791950+0000","last_peered":"2024-05-10T08:40:21.791950+0000","last_clean":"2024-05-10T08:40:21.791950+0000","last_became_active":"2024-05-10T08:40:15.728245+0000","last_became_peered":"2024-05-10T08:40:15.728245+0000","last_unstale":"2024-05-10T08:40:21.791950+0000","last_undegraded":"2024-05-10T08:40:21.791950+0000","last_fullsized":"2024-05-10T08:40:21.791950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:08.921084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736087+0000","last_change":"2024-05-10T08:40:19.751295+0000","last_active":"2024-05-10T08:40:21.736087+0000","last_peered":"2024-05-10T08:40:21.736087+0000","last_clean":"2024-05-10T08:40:21.736087+0000","last_became_active":"2024-05-10T08:40:19.750747+0000","last_became_peered":"2024-05-10T08:40:19.750747+0000","last_unstale":"2024-05-10T08:40:21.736087+0000","last_undegraded":"2024-05-10T08:40:21.736087+0000","last_fullsized":"2024-05-10T08:40:21.736087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:52.662846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794387+0000","last_change":"2024-05-10T08:40:14.722485+0000","last_active":"2024-05-10T08:40:21.794387+0000","last_peered":"2024-05-10T08:40:21.794387+0000","last_clean":"2024-05-10T08:40:21.794387+0000","last_became_active":"2024-05-10T08:40:14.722184+0000","last_became_peered":"2024-05-10T08:40:14.722184+0000","last_unstale":"2024-05-10T08:40:21.794387+0000","last_undegraded":"2024-05-10T08:40:21.794387+0000","last_fullsized":"2024-05-10T08:40:21.794387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:43.340926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792763+0000","last_change":"2024-05-10T08:40:15.724844+0000","last_active":"2024-05-10T08:40:21.792763+0000","last_peered":"2024-05-10T08:40:21.792763+0000","last_clean":"2024-05-10T08:40:21.792763+0000","last_became_active":"2024-05-10T08:40:15.724533+0000","last_became_peered":"2024-05-10T08:40:15.724533+0000","last_unstale":"2024-05-10T08:40:21.792763+0000","last_undegraded":"2024-05-10T08:40:21.792763+0000","last_fullsized":"2024-05-10T08:40:21.792763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737099+0000","last_change":"2024-05-10T08:40:19.753339+0000","last_active":"2024-05-10T08:40:21.737099+0000","last_peered":"2024-05-10T08:40:21.737099+0000","last_clean":"2024-05-10T08:40:21.737099+0000","last_became_active":"2024-05-10T08:40:19.751018+0000","last_became_peered":"2024-05-10T08:40:19.751018+0000","last_unstale":"2024-05-10T08:40:21.737099+0000","last_undegraded":"2024-05-10T08:40:21.737099+0000","last_fullsized":"2024-05-10T08:40:21.737099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793602+0000","last_change":"2024-05-10T08:40:14.724343+0000","last_active":"2024-05-10T08:40:21.793602+0000","last_peered":"2024-05-10T08:40:21.793602+0000","last_clean":"2024-05-10T08:40:21.793602+0000","last_became_active":"2024-05-10T08:40:14.724052+0000","last_became_peered":"2024-05-10T08:40:14.724052+0000","last_unstale":"2024-05-10T08:40:21.793602+0000","last_undegraded":"2024-05-10T08:40:21.793602+0000","last_fullsized":"2024-05-10T08:40:21.793602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793405+0000","last_change":"2024-05-10T08:40:15.726508+0000","last_active":"2024-05-10T08:40:21.793405+0000","last_peered":"2024-05-10T08:40:21.793405+0000","last_clean":"2024-05-10T08:40:21.793405+0000","last_became_active":"2024-05-10T08:40:15.723751+0000","last_became_peered":"2024-05-10T08:40:15.723751+0000","last_unstale":"2024-05-10T08:40:21.793405+0000","last_undegraded":"2024-05-10T08:40:21.793405+0000","last_fullsized":"2024-05-10T08:40:21.793405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736296+0000","last_change":"2024-05-10T08:40:19.758941+0000","last_active":"2024-05-10T08:40:21.736296+0000","last_peered":"2024-05-10T08:40:21.736296+0000","last_clean":"2024-05-10T08:40:21.736296+0000","last_became_active":"2024-05-10T08:40:19.758340+0000","last_became_peered":"2024-05-10T08:40:19.758340+0000","last_unstale":"2024-05-10T08:40:21.736296+0000","last_undegraded":"2024-05-10T08:40:21.736296+0000","last_fullsized":"2024-05-10T08:40:21.736296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793269+0000","last_change":"2024-05-10T08:40:15.716167+0000","last_active":"2024-05-10T08:40:21.793269+0000","last_peered":"2024-05-10T08:40:21.793269+0000","last_clean":"2024-05-10T08:40:21.793269+0000","last_became_active":"2024-05-10T08:40:15.715892+0000","last_became_peered":"2024-05-10T08:40:15.715892+0000","last_unstale":"2024-05-10T08:40:21.793269+0000","last_undegraded":"2024-05-10T08:40:21.793269+0000","last_fullsized":"2024-05-10T08:40:21.793269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794201+0000","last_change":"2024-05-10T08:40:14.722515+0000","last_active":"2024-05-10T08:40:21.794201+0000","last_peered":"2024-05-10T08:40:21.794201+0000","last_clean":"2024-05-10T08:40:21.794201+0000","last_became_active":"2024-05-10T08:40:14.722210+0000","last_became_peered":"2024-05-10T08:40:14.722210+0000","last_unstale":"2024-05-10T08:40:21.794201+0000","last_undegraded":"2024-05-10T08:40:21.794201+0000","last_fullsized":"2024-05-10T08:40:21.794201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736849+0000","last_change":"2024-05-10T08:40:19.758434+0000","last_active":"2024-05-10T08:40:21.736849+0000","last_peered":"2024-05-10T08:40:21.736849+0000","last_clean":"2024-05-10T08:40:21.736849+0000","last_became_active":"2024-05-10T08:40:19.758013+0000","last_became_peered":"2024-05-10T08:40:19.758013+0000","last_unstale":"2024-05-10T08:40:21.736849+0000","last_undegraded":"2024-05-10T08:40:21.736849+0000","last_fullsized":"2024-05-10T08:40:21.736849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736292+0000","last_change":"2024-05-10T08:40:15.733728+0000","last_active":"2024-05-10T08:40:21.736292+0000","last_peered":"2024-05-10T08:40:21.736292+0000","last_clean":"2024-05-10T08:40:21.736292+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.736292+0000","last_undegraded":"2024-05-10T08:40:21.736292+0000","last_fullsized":"2024-05-10T08:40:21.736292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736094+0000","last_change":"2024-05-10T08:40:14.711008+0000","last_active":"2024-05-10T08:40:21.736094+0000","last_peered":"2024-05-10T08:40:21.736094+0000","last_clean":"2024-05-10T08:40:21.736094+0000","last_became_active":"2024-05-10T08:40:14.710716+0000","last_became_peered":"2024-05-10T08:40:14.710716+0000","last_unstale":"2024-05-10T08:40:21.736094+0000","last_undegraded":"2024-05-10T08:40:21.736094+0000","last_fullsized":"2024-05-10T08:40:21.736094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736797+0000","last_change":"2024-05-10T08:40:19.753357+0000","last_active":"2024-05-10T08:40:21.736797+0000","last_peered":"2024-05-10T08:40:21.736797+0000","last_clean":"2024-05-10T08:40:21.736797+0000","last_became_active":"2024-05-10T08:40:19.752967+0000","last_became_peered":"2024-05-10T08:40:19.752967+0000","last_unstale":"2024-05-10T08:40:21.736797+0000","last_undegraded":"2024-05-10T08:40:21.736797+0000","last_fullsized":"2024-05-10T08:40:21.736797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736816+0000","last_change":"2024-05-10T08:40:15.719215+0000","last_active":"2024-05-10T08:40:21.736816+0000","last_peered":"2024-05-10T08:40:21.736816+0000","last_clean":"2024-05-10T08:40:21.736816+0000","last_became_active":"2024-05-10T08:40:15.718864+0000","last_became_peered":"2024-05-10T08:40:15.718864+0000","last_unstale":"2024-05-10T08:40:21.736816+0000","last_undegraded":"2024-05-10T08:40:21.736816+0000","last_fullsized":"2024-05-10T08:40:21.736816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735514+0000","last_change":"2024-05-10T08:40:14.719728+0000","last_active":"2024-05-10T08:40:21.735514+0000","last_peered":"2024-05-10T08:40:21.735514+0000","last_clean":"2024-05-10T08:40:21.735514+0000","last_became_active":"2024-05-10T08:40:14.719401+0000","last_became_peered":"2024-05-10T08:40:14.719401+0000","last_unstale":"2024-05-10T08:40:21.735514+0000","last_undegraded":"2024-05-10T08:40:21.735514+0000","last_fullsized":"2024-05-10T08:40:21.735514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737417+0000","last_change":"2024-05-10T08:40:20.250769+0000","last_active":"2024-05-10T08:40:21.737417+0000","last_peered":"2024-05-10T08:40:21.737417+0000","last_clean":"2024-05-10T08:40:21.737417+0000","last_became_active":"2024-05-10T08:40:20.250387+0000","last_became_peered":"2024-05-10T08:40:20.250387+0000","last_unstale":"2024-05-10T08:40:21.737417+0000","last_undegraded":"2024-05-10T08:40:21.737417+0000","last_fullsized":"2024-05-10T08:40:21.737417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736533+0000","last_change":"2024-05-10T08:40:15.719306+0000","last_active":"2024-05-10T08:40:21.736533+0000","last_peered":"2024-05-10T08:40:21.736533+0000","last_clean":"2024-05-10T08:40:21.736533+0000","last_became_active":"2024-05-10T08:40:15.718968+0000","last_became_peered":"2024-05-10T08:40:15.718968+0000","last_unstale":"2024-05-10T08:40:21.736533+0000","last_undegraded":"2024-05-10T08:40:21.736533+0000","last_fullsized":"2024-05-10T08:40:21.736533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:34.334556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792277+0000","last_change":"2024-05-10T08:40:14.723003+0000","last_active":"2024-05-10T08:40:21.792277+0000","last_peered":"2024-05-10T08:40:21.792277+0000","last_clean":"2024-05-10T08:40:21.792277+0000","last_became_active":"2024-05-10T08:40:14.722721+0000","last_became_peered":"2024-05-10T08:40:14.722721+0000","last_unstale":"2024-05-10T08:40:21.792277+0000","last_undegraded":"2024-05-10T08:40:21.792277+0000","last_fullsized":"2024-05-10T08:40:21.792277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736700+0000","last_change":"2024-05-10T08:40:19.751296+0000","last_active":"2024-05-10T08:40:21.736700+0000","last_peered":"2024-05-10T08:40:21.736700+0000","last_clean":"2024-05-10T08:40:21.736700+0000","last_became_active":"2024-05-10T08:40:19.750813+0000","last_became_peered":"2024-05-10T08:40:19.750813+0000","last_unstale":"2024-05-10T08:40:21.736700+0000","last_undegraded":"2024-05-10T08:40:21.736700+0000","last_fullsized":"2024-05-10T08:40:21.736700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:58.250654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792010+0000","last_change":"2024-05-10T08:40:15.722099+0000","last_active":"2024-05-10T08:40:21.792010+0000","last_peered":"2024-05-10T08:40:21.792010+0000","last_clean":"2024-05-10T08:40:21.792010+0000","last_became_active":"2024-05-10T08:40:15.721386+0000","last_became_peered":"2024-05-10T08:40:15.721386+0000","last_unstale":"2024-05-10T08:40:21.792010+0000","last_undegraded":"2024-05-10T08:40:21.792010+0000","last_fullsized":"2024-05-10T08:40:21.792010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:07:45.250348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794133+0000","last_change":"2024-05-10T08:40:14.721450+0000","last_active":"2024-05-10T08:40:21.794133+0000","last_peered":"2024-05-10T08:40:21.794133+0000","last_clean":"2024-05-10T08:40:21.794133+0000","last_became_active":"2024-05-10T08:40:14.721110+0000","last_became_peered":"2024-05-10T08:40:14.721110+0000","last_unstale":"2024-05-10T08:40:21.794133+0000","last_undegraded":"2024-05-10T08:40:21.794133+0000","last_fullsized":"2024-05-10T08:40:21.794133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736263+0000","last_change":"2024-05-10T08:40:20.250784+0000","last_active":"2024-05-10T08:40:21.736263+0000","last_peered":"2024-05-10T08:40:21.736263+0000","last_clean":"2024-05-10T08:40:21.736263+0000","last_became_active":"2024-05-10T08:40:20.250338+0000","last_became_peered":"2024-05-10T08:40:20.250338+0000","last_unstale":"2024-05-10T08:40:21.736263+0000","last_undegraded":"2024-05-10T08:40:21.736263+0000","last_fullsized":"2024-05-10T08:40:21.736263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:15.728115+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:15.727814+0000","last_became_peered":"2024-05-10T08:40:15.727814+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736643+0000","last_change":"2024-05-10T08:40:14.712174+0000","last_active":"2024-05-10T08:40:21.736643+0000","last_peered":"2024-05-10T08:40:21.736643+0000","last_clean":"2024-05-10T08:40:21.736643+0000","last_became_active":"2024-05-10T08:40:14.711817+0000","last_became_peered":"2024-05-10T08:40:14.711817+0000","last_unstale":"2024-05-10T08:40:21.736643+0000","last_undegraded":"2024-05-10T08:40:21.736643+0000","last_fullsized":"2024-05-10T08:40:21.736643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736599+0000","last_change":"2024-05-10T08:40:20.250340+0000","last_active":"2024-05-10T08:40:21.736599+0000","last_peered":"2024-05-10T08:40:21.736599+0000","last_clean":"2024-05-10T08:40:21.736599+0000","last_became_active":"2024-05-10T08:40:20.249928+0000","last_became_peered":"2024-05-10T08:40:20.249928+0000","last_unstale":"2024-05-10T08:40:21.736599+0000","last_undegraded":"2024-05-10T08:40:21.736599+0000","last_fullsized":"2024-05-10T08:40:21.736599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:29.943142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736966+0000","last_change":"2024-05-10T08:40:15.717354+0000","last_active":"2024-05-10T08:40:21.736966+0000","last_peered":"2024-05-10T08:40:21.736966+0000","last_clean":"2024-05-10T08:40:21.736966+0000","last_became_active":"2024-05-10T08:40:15.717033+0000","last_became_peered":"2024-05-10T08:40:15.717033+0000","last_unstale":"2024-05-10T08:40:21.736966+0000","last_undegraded":"2024-05-10T08:40:21.736966+0000","last_fullsized":"2024-05-10T08:40:21.736966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794461+0000","last_change":"2024-05-10T08:40:14.722906+0000","last_active":"2024-05-10T08:40:21.794461+0000","last_peered":"2024-05-10T08:40:21.794461+0000","last_clean":"2024-05-10T08:40:21.794461+0000","last_became_active":"2024-05-10T08:40:14.722607+0000","last_became_peered":"2024-05-10T08:40:14.722607+0000","last_unstale":"2024-05-10T08:40:21.794461+0000","last_undegraded":"2024-05-10T08:40:21.794461+0000","last_fullsized":"2024-05-10T08:40:21.794461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:38.589413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792174+0000","last_change":"2024-05-10T08:40:20.250418+0000","last_active":"2024-05-10T08:40:21.792174+0000","last_peered":"2024-05-10T08:40:21.792174+0000","last_clean":"2024-05-10T08:40:21.792174+0000","last_became_active":"2024-05-10T08:40:20.249925+0000","last_became_peered":"2024-05-10T08:40:20.249925+0000","last_unstale":"2024-05-10T08:40:21.792174+0000","last_undegraded":"2024-05-10T08:40:21.792174+0000","last_fullsized":"2024-05-10T08:40:21.792174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793510+0000","last_change":"2024-05-10T08:40:15.735822+0000","last_active":"2024-05-10T08:40:21.793510+0000","last_peered":"2024-05-10T08:40:21.793510+0000","last_clean":"2024-05-10T08:40:21.793510+0000","last_became_active":"2024-05-10T08:40:15.735525+0000","last_became_peered":"2024-05-10T08:40:15.735525+0000","last_unstale":"2024-05-10T08:40:21.793510+0000","last_undegraded":"2024-05-10T08:40:21.793510+0000","last_fullsized":"2024-05-10T08:40:21.793510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737066+0000","last_change":"2024-05-10T08:40:14.720119+0000","last_active":"2024-05-10T08:40:21.737066+0000","last_peered":"2024-05-10T08:40:21.737066+0000","last_clean":"2024-05-10T08:40:21.737066+0000","last_became_active":"2024-05-10T08:40:14.719807+0000","last_became_peered":"2024-05-10T08:40:14.719807+0000","last_unstale":"2024-05-10T08:40:21.737066+0000","last_undegraded":"2024-05-10T08:40:21.737066+0000","last_fullsized":"2024-05-10T08:40:21.737066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735653+0000","last_change":"2024-05-10T08:40:19.758680+0000","last_active":"2024-05-10T08:40:21.735653+0000","last_peered":"2024-05-10T08:40:21.735653+0000","last_clean":"2024-05-10T08:40:21.735653+0000","last_became_active":"2024-05-10T08:40:19.757930+0000","last_became_peered":"2024-05-10T08:40:19.757930+0000","last_unstale":"2024-05-10T08:40:21.735653+0000","last_undegraded":"2024-05-10T08:40:21.735653+0000","last_fullsized":"2024-05-10T08:40:21.735653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737171+0000","last_change":"2024-05-10T08:40:15.727979+0000","last_active":"2024-05-10T08:40:21.737171+0000","last_peered":"2024-05-10T08:40:21.737171+0000","last_clean":"2024-05-10T08:40:21.737171+0000","last_became_active":"2024-05-10T08:40:15.727689+0000","last_became_peered":"2024-05-10T08:40:15.727689+0000","last_unstale":"2024-05-10T08:40:21.737171+0000","last_undegraded":"2024-05-10T08:40:21.737171+0000","last_fullsized":"2024-05-10T08:40:21.737171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:00.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793318+0000","last_change":"2024-05-10T08:40:14.719368+0000","last_active":"2024-05-10T08:40:21.793318+0000","last_peered":"2024-05-10T08:40:21.793318+0000","last_clean":"2024-05-10T08:40:21.793318+0000","last_became_active":"2024-05-10T08:40:14.719067+0000","last_became_peered":"2024-05-10T08:40:14.719067+0000","last_unstale":"2024-05-10T08:40:21.793318+0000","last_undegraded":"2024-05-10T08:40:21.793318+0000","last_fullsized":"2024-05-10T08:40:21.793318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736975+0000","last_change":"2024-05-10T08:40:19.749606+0000","last_active":"2024-05-10T08:40:21.736975+0000","last_peered":"2024-05-10T08:40:21.736975+0000","last_clean":"2024-05-10T08:40:21.736975+0000","last_became_active":"2024-05-10T08:40:19.748828+0000","last_became_peered":"2024-05-10T08:40:19.748828+0000","last_unstale":"2024-05-10T08:40:21.736975+0000","last_undegraded":"2024-05-10T08:40:21.736975+0000","last_fullsized":"2024-05-10T08:40:21.736975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735649+0000","last_change":"2024-05-10T08:40:15.720054+0000","last_active":"2024-05-10T08:40:21.735649+0000","last_peered":"2024-05-10T08:40:21.735649+0000","last_clean":"2024-05-10T08:40:21.735649+0000","last_became_active":"2024-05-10T08:40:15.719769+0000","last_became_peered":"2024-05-10T08:40:15.719769+0000","last_unstale":"2024-05-10T08:40:21.735649+0000","last_undegraded":"2024-05-10T08:40:21.735649+0000","last_fullsized":"2024-05-10T08:40:21.735649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791550+0000","last_change":"2024-05-10T08:40:14.721738+0000","last_active":"2024-05-10T08:40:21.791550+0000","last_peered":"2024-05-10T08:40:21.791550+0000","last_clean":"2024-05-10T08:40:21.791550+0000","last_became_active":"2024-05-10T08:40:14.721434+0000","last_became_peered":"2024-05-10T08:40:14.721434+0000","last_unstale":"2024-05-10T08:40:21.791550+0000","last_undegraded":"2024-05-10T08:40:21.791550+0000","last_fullsized":"2024-05-10T08:40:21.791550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:19.758288+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:19.757825+0000","last_became_peered":"2024-05-10T08:40:19.757825+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791777+0000","last_change":"2024-05-10T08:40:15.722819+0000","last_active":"2024-05-10T08:40:21.791777+0000","last_peered":"2024-05-10T08:40:21.791777+0000","last_clean":"2024-05-10T08:40:21.791777+0000","last_became_active":"2024-05-10T08:40:15.722444+0000","last_became_peered":"2024-05-10T08:40:15.722444+0000","last_unstale":"2024-05-10T08:40:21.791777+0000","last_undegraded":"2024-05-10T08:40:21.791777+0000","last_fullsized":"2024-05-10T08:40:21.791777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792365+0000","last_change":"2024-05-10T08:40:14.723089+0000","last_active":"2024-05-10T08:40:21.792365+0000","last_peered":"2024-05-10T08:40:21.792365+0000","last_clean":"2024-05-10T08:40:21.792365+0000","last_became_active":"2024-05-10T08:40:14.722771+0000","last_became_peered":"2024-05-10T08:40:14.722771+0000","last_unstale":"2024-05-10T08:40:21.792365+0000","last_undegraded":"2024-05-10T08:40:21.792365+0000","last_fullsized":"2024-05-10T08:40:21.792365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792005+0000","last_change":"2024-05-10T08:40:20.250543+0000","last_active":"2024-05-10T08:40:21.792005+0000","last_peered":"2024-05-10T08:40:21.792005+0000","last_clean":"2024-05-10T08:40:21.792005+0000","last_became_active":"2024-05-10T08:40:20.249990+0000","last_became_peered":"2024-05-10T08:40:20.249990+0000","last_unstale":"2024-05-10T08:40:21.792005+0000","last_undegraded":"2024-05-10T08:40:21.792005+0000","last_fullsized":"2024-05-10T08:40:21.792005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735932+0000","last_change":"2024-05-10T08:40:15.730255+0000","last_active":"2024-05-10T08:40:21.735932+0000","last_peered":"2024-05-10T08:40:21.735932+0000","last_clean":"2024-05-10T08:40:21.735932+0000","last_became_active":"2024-05-10T08:40:15.729980+0000","last_became_peered":"2024-05-10T08:40:15.729980+0000","last_unstale":"2024-05-10T08:40:21.735932+0000","last_undegraded":"2024-05-10T08:40:21.735932+0000","last_fullsized":"2024-05-10T08:40:21.735932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792701+0000","last_change":"2024-05-10T08:40:14.715445+0000","last_active":"2024-05-10T08:40:21.792701+0000","last_peered":"2024-05-10T08:40:21.792701+0000","last_clean":"2024-05-10T08:40:21.792701+0000","last_became_active":"2024-05-10T08:40:14.715170+0000","last_became_peered":"2024-05-10T08:40:14.715170+0000","last_unstale":"2024-05-10T08:40:21.792701+0000","last_undegraded":"2024-05-10T08:40:21.792701+0000","last_fullsized":"2024-05-10T08:40:21.792701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792391+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:40:21.792391+0000","last_peered":"2024-05-10T08:40:21.792391+0000","last_clean":"2024-05-10T08:40:21.792391+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:40:21.792391+0000","last_undegraded":"2024-05-10T08:40:21.792391+0000","last_fullsized":"2024-05-10T08:40:21.792391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793767+0000","last_change":"2024-05-10T08:40:20.252336+0000","last_active":"2024-05-10T08:40:21.793767+0000","last_peered":"2024-05-10T08:40:21.793767+0000","last_clean":"2024-05-10T08:40:21.793767+0000","last_became_active":"2024-05-10T08:40:20.251817+0000","last_became_peered":"2024-05-10T08:40:20.251817+0000","last_unstale":"2024-05-10T08:40:21.793767+0000","last_undegraded":"2024-05-10T08:40:21.793767+0000","last_fullsized":"2024-05-10T08:40:21.793767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794293+0000","last_change":"2024-05-10T08:40:15.727310+0000","last_active":"2024-05-10T08:40:21.794293+0000","last_peered":"2024-05-10T08:40:21.794293+0000","last_clean":"2024-05-10T08:40:21.794293+0000","last_became_active":"2024-05-10T08:40:15.727030+0000","last_became_peered":"2024-05-10T08:40:15.727030+0000","last_unstale":"2024-05-10T08:40:21.794293+0000","last_undegraded":"2024-05-10T08:40:21.794293+0000","last_fullsized":"2024-05-10T08:40:21.794293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791837+0000","last_change":"2024-05-10T08:40:14.715295+0000","last_active":"2024-05-10T08:40:21.791837+0000","last_peered":"2024-05-10T08:40:21.791837+0000","last_clean":"2024-05-10T08:40:21.791837+0000","last_became_active":"2024-05-10T08:40:14.715006+0000","last_became_peered":"2024-05-10T08:40:14.715006+0000","last_unstale":"2024-05-10T08:40:21.791837+0000","last_undegraded":"2024-05-10T08:40:21.791837+0000","last_fullsized":"2024-05-10T08:40:21.791837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793015+0000","last_change":"2024-05-10T08:40:20.251128+0000","last_active":"2024-05-10T08:40:21.793015+0000","last_peered":"2024-05-10T08:40:21.793015+0000","last_clean":"2024-05-10T08:40:21.793015+0000","last_became_active":"2024-05-10T08:40:20.249896+0000","last_became_peered":"2024-05-10T08:40:20.249896+0000","last_unstale":"2024-05-10T08:40:21.793015+0000","last_undegraded":"2024-05-10T08:40:21.793015+0000","last_fullsized":"2024-05-10T08:40:21.793015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792798+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792798+0000","last_peered":"2024-05-10T08:40:21.792798+0000","last_clean":"2024-05-10T08:40:21.792798+0000","last_became_active":"2024-05-10T08:40:15.737918+0000","last_became_peered":"2024-05-10T08:40:15.737918+0000","last_unstale":"2024-05-10T08:40:21.792798+0000","last_undegraded":"2024-05-10T08:40:21.792798+0000","last_fullsized":"2024-05-10T08:40:21.792798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736170+0000","last_change":"2024-05-10T08:40:14.709667+0000","last_active":"2024-05-10T08:40:21.736170+0000","last_peered":"2024-05-10T08:40:21.736170+0000","last_clean":"2024-05-10T08:40:21.736170+0000","last_became_active":"2024-05-10T08:40:14.709290+0000","last_became_peered":"2024-05-10T08:40:14.709290+0000","last_unstale":"2024-05-10T08:40:21.736170+0000","last_undegraded":"2024-05-10T08:40:21.736170+0000","last_fullsized":"2024-05-10T08:40:21.736170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792343+0000","last_change":"2024-05-10T08:40:19.766100+0000","last_active":"2024-05-10T08:40:21.792343+0000","last_peered":"2024-05-10T08:40:21.792343+0000","last_clean":"2024-05-10T08:40:21.792343+0000","last_became_active":"2024-05-10T08:40:19.765485+0000","last_became_peered":"2024-05-10T08:40:19.765485+0000","last_unstale":"2024-05-10T08:40:21.792343+0000","last_undegraded":"2024-05-10T08:40:21.792343+0000","last_fullsized":"2024-05-10T08:40:21.792343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794462+0000","last_change":"2024-05-10T08:40:15.723306+0000","last_active":"2024-05-10T08:40:21.794462+0000","last_peered":"2024-05-10T08:40:21.794462+0000","last_clean":"2024-05-10T08:40:21.794462+0000","last_became_active":"2024-05-10T08:40:15.720173+0000","last_became_peered":"2024-05-10T08:40:15.720173+0000","last_unstale":"2024-05-10T08:40:21.794462+0000","last_undegraded":"2024-05-10T08:40:21.794462+0000","last_fullsized":"2024-05-10T08:40:21.794462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:36.488692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792415+0000","last_change":"2024-05-10T08:40:14.711881+0000","last_active":"2024-05-10T08:40:21.792415+0000","last_peered":"2024-05-10T08:40:21.792415+0000","last_clean":"2024-05-10T08:40:21.792415+0000","last_became_active":"2024-05-10T08:40:14.711578+0000","last_became_peered":"2024-05-10T08:40:14.711578+0000","last_unstale":"2024-05-10T08:40:21.792415+0000","last_undegraded":"2024-05-10T08:40:21.792415+0000","last_fullsized":"2024-05-10T08:40:21.792415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792212+0000","last_change":"2024-05-10T08:40:20.252617+0000","last_active":"2024-05-10T08:40:21.792212+0000","last_peered":"2024-05-10T08:40:21.792212+0000","last_clean":"2024-05-10T08:40:21.792212+0000","last_became_active":"2024-05-10T08:40:20.252213+0000","last_became_peered":"2024-05-10T08:40:20.252213+0000","last_unstale":"2024-05-10T08:40:21.792212+0000","last_undegraded":"2024-05-10T08:40:21.792212+0000","last_fullsized":"2024-05-10T08:40:21.792212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793833+0000","last_change":"2024-05-10T08:40:15.719378+0000","last_active":"2024-05-10T08:40:21.793833+0000","last_peered":"2024-05-10T08:40:21.793833+0000","last_clean":"2024-05-10T08:40:21.793833+0000","last_became_active":"2024-05-10T08:40:15.718906+0000","last_became_peered":"2024-05-10T08:40:15.718906+0000","last_unstale":"2024-05-10T08:40:21.793833+0000","last_undegraded":"2024-05-10T08:40:21.793833+0000","last_fullsized":"2024-05-10T08:40:21.793833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736956+0000","last_change":"2024-05-10T08:40:14.717865+0000","last_active":"2024-05-10T08:40:21.736956+0000","last_peered":"2024-05-10T08:40:21.736956+0000","last_clean":"2024-05-10T08:40:21.736956+0000","last_became_active":"2024-05-10T08:40:14.717601+0000","last_became_peered":"2024-05-10T08:40:14.717601+0000","last_unstale":"2024-05-10T08:40:21.736956+0000","last_undegraded":"2024-05-10T08:40:21.736956+0000","last_fullsized":"2024-05-10T08:40:21.736956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:55.833310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736067+0000","last_change":"2024-05-10T08:40:19.752756+0000","last_active":"2024-05-10T08:40:21.736067+0000","last_peered":"2024-05-10T08:40:21.736067+0000","last_clean":"2024-05-10T08:40:21.736067+0000","last_became_active":"2024-05-10T08:40:19.751028+0000","last_became_peered":"2024-05-10T08:40:19.751028+0000","last_unstale":"2024-05-10T08:40:21.736067+0000","last_undegraded":"2024-05-10T08:40:21.736067+0000","last_fullsized":"2024-05-10T08:40:21.736067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792686+0000","last_change":"2024-05-10T08:40:15.716663+0000","last_active":"2024-05-10T08:40:21.792686+0000","last_peered":"2024-05-10T08:40:21.792686+0000","last_clean":"2024-05-10T08:40:21.792686+0000","last_became_active":"2024-05-10T08:40:15.715575+0000","last_became_peered":"2024-05-10T08:40:15.715575+0000","last_unstale":"2024-05-10T08:40:21.792686+0000","last_undegraded":"2024-05-10T08:40:21.792686+0000","last_fullsized":"2024-05-10T08:40:21.792686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791328+0000","last_change":"2024-05-10T08:40:14.717681+0000","last_active":"2024-05-10T08:40:21.791328+0000","last_peered":"2024-05-10T08:40:21.791328+0000","last_clean":"2024-05-10T08:40:21.791328+0000","last_became_active":"2024-05-10T08:40:14.717306+0000","last_became_peered":"2024-05-10T08:40:14.717306+0000","last_unstale":"2024-05-10T08:40:21.791328+0000","last_undegraded":"2024-05-10T08:40:21.791328+0000","last_fullsized":"2024-05-10T08:40:21.791328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791819+0000","last_change":"2024-05-10T08:40:19.762550+0000","last_active":"2024-05-10T08:40:21.791819+0000","last_peered":"2024-05-10T08:40:21.791819+0000","last_clean":"2024-05-10T08:40:21.791819+0000","last_became_active":"2024-05-10T08:40:19.762116+0000","last_became_peered":"2024-05-10T08:40:19.762116+0000","last_unstale":"2024-05-10T08:40:21.791819+0000","last_undegraded":"2024-05-10T08:40:21.791819+0000","last_fullsized":"2024-05-10T08:40:21.791819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792755+0000","last_change":"2024-05-10T08:40:15.723458+0000","last_active":"2024-05-10T08:40:21.792755+0000","last_peered":"2024-05-10T08:40:21.792755+0000","last_clean":"2024-05-10T08:40:21.792755+0000","last_became_active":"2024-05-10T08:40:15.722820+0000","last_became_peered":"2024-05-10T08:40:15.722820+0000","last_unstale":"2024-05-10T08:40:21.792755+0000","last_undegraded":"2024-05-10T08:40:21.792755+0000","last_fullsized":"2024-05-10T08:40:21.792755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793086+0000","last_change":"2024-05-10T08:40:14.715478+0000","last_active":"2024-05-10T08:40:21.793086+0000","last_peered":"2024-05-10T08:40:21.793086+0000","last_clean":"2024-05-10T08:40:21.793086+0000","last_became_active":"2024-05-10T08:40:14.715204+0000","last_became_peered":"2024-05-10T08:40:14.715204+0000","last_unstale":"2024-05-10T08:40:21.793086+0000","last_undegraded":"2024-05-10T08:40:21.793086+0000","last_fullsized":"2024-05-10T08:40:21.793086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737185+0000","last_change":"2024-05-10T08:40:20.251710+0000","last_active":"2024-05-10T08:40:21.737185+0000","last_peered":"2024-05-10T08:40:21.737185+0000","last_clean":"2024-05-10T08:40:21.737185+0000","last_became_active":"2024-05-10T08:40:20.251322+0000","last_became_peered":"2024-05-10T08:40:20.251322+0000","last_unstale":"2024-05-10T08:40:21.737185+0000","last_undegraded":"2024-05-10T08:40:21.737185+0000","last_fullsized":"2024-05-10T08:40:21.737185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:52.128436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794087+0000","last_change":"2024-05-10T08:40:15.719208+0000","last_active":"2024-05-10T08:40:21.794087+0000","last_peered":"2024-05-10T08:40:21.794087+0000","last_clean":"2024-05-10T08:40:21.794087+0000","last_became_active":"2024-05-10T08:40:15.718750+0000","last_became_peered":"2024-05-10T08:40:15.718750+0000","last_unstale":"2024-05-10T08:40:21.794087+0000","last_undegraded":"2024-05-10T08:40:21.794087+0000","last_fullsized":"2024-05-10T08:40:21.794087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793271+0000","last_change":"2024-05-10T08:40:14.721820+0000","last_active":"2024-05-10T08:40:21.793271+0000","last_peered":"2024-05-10T08:40:21.793271+0000","last_clean":"2024-05-10T08:40:21.793271+0000","last_became_active":"2024-05-10T08:40:14.721098+0000","last_became_peered":"2024-05-10T08:40:14.721098+0000","last_unstale":"2024-05-10T08:40:21.793271+0000","last_undegraded":"2024-05-10T08:40:21.793271+0000","last_fullsized":"2024-05-10T08:40:21.793271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736113+0000","last_change":"2024-05-10T08:40:20.250336+0000","last_active":"2024-05-10T08:40:21.736113+0000","last_peered":"2024-05-10T08:40:21.736113+0000","last_clean":"2024-05-10T08:40:21.736113+0000","last_became_active":"2024-05-10T08:40:20.249910+0000","last_became_peered":"2024-05-10T08:40:20.249910+0000","last_unstale":"2024-05-10T08:40:21.736113+0000","last_undegraded":"2024-05-10T08:40:21.736113+0000","last_fullsized":"2024-05-10T08:40:21.736113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:58.918102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792248+0000","last_change":"2024-05-10T08:40:15.730912+0000","last_active":"2024-05-10T08:40:21.792248+0000","last_peered":"2024-05-10T08:40:21.792248+0000","last_clean":"2024-05-10T08:40:21.792248+0000","last_became_active":"2024-05-10T08:40:15.730664+0000","last_became_peered":"2024-05-10T08:40:15.730664+0000","last_unstale":"2024-05-10T08:40:21.792248+0000","last_undegraded":"2024-05-10T08:40:21.792248+0000","last_fullsized":"2024-05-10T08:40:21.792248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792437+0000","last_change":"2024-05-10T08:40:14.719958+0000","last_active":"2024-05-10T08:40:21.792437+0000","last_peered":"2024-05-10T08:40:21.792437+0000","last_clean":"2024-05-10T08:40:21.792437+0000","last_became_active":"2024-05-10T08:40:14.719527+0000","last_became_peered":"2024-05-10T08:40:14.719527+0000","last_unstale":"2024-05-10T08:40:21.792437+0000","last_undegraded":"2024-05-10T08:40:21.792437+0000","last_fullsized":"2024-05-10T08:40:21.792437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:39.671884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793250+0000","last_change":"2024-05-10T08:40:20.250393+0000","last_active":"2024-05-10T08:40:21.793250+0000","last_peered":"2024-05-10T08:40:21.793250+0000","last_clean":"2024-05-10T08:40:21.793250+0000","last_became_active":"2024-05-10T08:40:20.249931+0000","last_became_peered":"2024-05-10T08:40:20.249931+0000","last_unstale":"2024-05-10T08:40:21.793250+0000","last_undegraded":"2024-05-10T08:40:21.793250+0000","last_fullsized":"2024-05-10T08:40:21.793250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794216+0000","last_change":"2024-05-10T08:40:15.723825+0000","last_active":"2024-05-10T08:40:21.794216+0000","last_peered":"2024-05-10T08:40:21.794216+0000","last_clean":"2024-05-10T08:40:21.794216+0000","last_became_active":"2024-05-10T08:40:15.723549+0000","last_became_peered":"2024-05-10T08:40:15.723549+0000","last_unstale":"2024-05-10T08:40:21.794216+0000","last_undegraded":"2024-05-10T08:40:21.794216+0000","last_fullsized":"2024-05-10T08:40:21.794216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:25.527408+0000","last_change":"2024-05-10T08:40:14.721803+0000","last_active":"2024-05-10T08:40:25.527408+0000","last_peered":"2024-05-10T08:40:25.527408+0000","last_clean":"2024-05-10T08:40:25.527408+0000","last_became_active":"2024-05-10T08:40:14.721510+0000","last_became_peered":"2024-05-10T08:40:14.721510+0000","last_unstale":"2024-05-10T08:40:25.527408+0000","last_undegraded":"2024-05-10T08:40:25.527408+0000","last_fullsized":"2024-05-10T08:40:25.527408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735875+0000","last_change":"2024-05-10T08:40:19.758340+0000","last_active":"2024-05-10T08:40:21.735875+0000","last_peered":"2024-05-10T08:40:21.735875+0000","last_clean":"2024-05-10T08:40:21.735875+0000","last_became_active":"2024-05-10T08:40:19.757420+0000","last_became_peered":"2024-05-10T08:40:19.757420+0000","last_unstale":"2024-05-10T08:40:21.735875+0000","last_undegraded":"2024-05-10T08:40:21.735875+0000","last_fullsized":"2024-05-10T08:40:21.735875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736978+0000","last_change":"2024-05-10T08:40:15.722046+0000","last_active":"2024-05-10T08:40:21.736978+0000","last_peered":"2024-05-10T08:40:21.736978+0000","last_clean":"2024-05-10T08:40:21.736978+0000","last_became_active":"2024-05-10T08:40:15.721780+0000","last_became_peered":"2024-05-10T08:40:15.721780+0000","last_unstale":"2024-05-10T08:40:21.736978+0000","last_undegraded":"2024-05-10T08:40:21.736978+0000","last_fullsized":"2024-05-10T08:40:21.736978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736056+0000","last_change":"2024-05-10T08:40:14.715667+0000","last_active":"2024-05-10T08:40:21.736056+0000","last_peered":"2024-05-10T08:40:21.736056+0000","last_clean":"2024-05-10T08:40:21.736056+0000","last_became_active":"2024-05-10T08:40:14.715389+0000","last_became_peered":"2024-05-10T08:40:14.715389+0000","last_unstale":"2024-05-10T08:40:21.736056+0000","last_undegraded":"2024-05-10T08:40:21.736056+0000","last_fullsized":"2024-05-10T08:40:21.736056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736950+0000","last_change":"2024-05-10T08:40:19.752944+0000","last_active":"2024-05-10T08:40:21.736950+0000","last_peered":"2024-05-10T08:40:21.736950+0000","last_clean":"2024-05-10T08:40:21.736950+0000","last_became_active":"2024-05-10T08:40:19.750307+0000","last_became_peered":"2024-05-10T08:40:19.750307+0000","last_unstale":"2024-05-10T08:40:21.736950+0000","last_undegraded":"2024-05-10T08:40:21.736950+0000","last_fullsized":"2024-05-10T08:40:21.736950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792136+0000","last_change":"2024-05-10T08:40:15.728526+0000","last_active":"2024-05-10T08:40:21.792136+0000","last_peered":"2024-05-10T08:40:21.792136+0000","last_clean":"2024-05-10T08:40:21.792136+0000","last_became_active":"2024-05-10T08:40:15.727954+0000","last_became_peered":"2024-05-10T08:40:15.727954+0000","last_unstale":"2024-05-10T08:40:21.792136+0000","last_undegraded":"2024-05-10T08:40:21.792136+0000","last_fullsized":"2024-05-10T08:40:21.792136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793153+0000","last_change":"2024-05-10T08:40:14.713649+0000","last_active":"2024-05-10T08:40:21.793153+0000","last_peered":"2024-05-10T08:40:21.793153+0000","last_clean":"2024-05-10T08:40:21.793153+0000","last_became_active":"2024-05-10T08:40:14.713343+0000","last_became_peered":"2024-05-10T08:40:14.713343+0000","last_unstale":"2024-05-10T08:40:21.793153+0000","last_undegraded":"2024-05-10T08:40:21.793153+0000","last_fullsized":"2024-05-10T08:40:21.793153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736758+0000","last_change":"2024-05-10T08:40:19.759670+0000","last_active":"2024-05-10T08:40:21.736758+0000","last_peered":"2024-05-10T08:40:21.736758+0000","last_clean":"2024-05-10T08:40:21.736758+0000","last_became_active":"2024-05-10T08:40:19.756600+0000","last_became_peered":"2024-05-10T08:40:19.756600+0000","last_unstale":"2024-05-10T08:40:21.736758+0000","last_undegraded":"2024-05-10T08:40:21.736758+0000","last_fullsized":"2024-05-10T08:40:21.736758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.094481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793080+0000","last_change":"2024-05-10T08:40:15.721196+0000","last_active":"2024-05-10T08:40:21.793080+0000","last_peered":"2024-05-10T08:40:21.793080+0000","last_clean":"2024-05-10T08:40:21.793080+0000","last_became_active":"2024-05-10T08:40:15.720932+0000","last_became_peered":"2024-05-10T08:40:15.720932+0000","last_unstale":"2024-05-10T08:40:21.793080+0000","last_undegraded":"2024-05-10T08:40:21.793080+0000","last_fullsized":"2024-05-10T08:40:21.793080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794024+0000","last_change":"2024-05-10T08:40:14.717072+0000","last_active":"2024-05-10T08:40:21.794024+0000","last_peered":"2024-05-10T08:40:21.794024+0000","last_clean":"2024-05-10T08:40:21.794024+0000","last_became_active":"2024-05-10T08:40:14.716685+0000","last_became_peered":"2024-05-10T08:40:14.716685+0000","last_unstale":"2024-05-10T08:40:21.794024+0000","last_undegraded":"2024-05-10T08:40:21.794024+0000","last_fullsized":"2024-05-10T08:40:21.794024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737170+0000","last_change":"2024-05-10T08:40:20.251795+0000","last_active":"2024-05-10T08:40:21.737170+0000","last_peered":"2024-05-10T08:40:21.737170+0000","last_clean":"2024-05-10T08:40:21.737170+0000","last_became_active":"2024-05-10T08:40:20.251422+0000","last_became_peered":"2024-05-10T08:40:20.251422+0000","last_unstale":"2024-05-10T08:40:21.737170+0000","last_undegraded":"2024-05-10T08:40:21.737170+0000","last_fullsized":"2024-05-10T08:40:21.737170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:58.035145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791821+0000","last_change":"2024-05-10T08:40:20.251855+0000","last_active":"2024-05-10T08:40:21.791821+0000","last_peered":"2024-05-10T08:40:21.791821+0000","last_clean":"2024-05-10T08:40:21.791821+0000","last_became_active":"2024-05-10T08:40:20.251483+0000","last_became_peered":"2024-05-10T08:40:20.251483+0000","last_unstale":"2024-05-10T08:40:21.791821+0000","last_undegraded":"2024-05-10T08:40:21.791821+0000","last_fullsized":"2024-05-10T08:40:21.791821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735406+0000","last_change":"2024-05-10T08:40:15.733791+0000","last_active":"2024-05-10T08:40:21.735406+0000","last_peered":"2024-05-10T08:40:21.735406+0000","last_clean":"2024-05-10T08:40:21.735406+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.735406+0000","last_undegraded":"2024-05-10T08:40:21.735406+0000","last_fullsized":"2024-05-10T08:40:21.735406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792355+0000","last_change":"2024-05-10T08:40:14.713288+0000","last_active":"2024-05-10T08:40:21.792355+0000","last_peered":"2024-05-10T08:40:21.792355+0000","last_clean":"2024-05-10T08:40:21.792355+0000","last_became_active":"2024-05-10T08:40:14.713009+0000","last_became_peered":"2024-05-10T08:40:14.713009+0000","last_unstale":"2024-05-10T08:40:21.792355+0000","last_undegraded":"2024-05-10T08:40:21.792355+0000","last_fullsized":"2024-05-10T08:40:21.792355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793990+0000","last_change":"2024-05-10T08:40:19.758631+0000","last_active":"2024-05-10T08:40:21.793990+0000","last_peered":"2024-05-10T08:40:21.793990+0000","last_clean":"2024-05-10T08:40:21.793990+0000","last_became_active":"2024-05-10T08:40:19.758133+0000","last_became_peered":"2024-05-10T08:40:19.758133+0000","last_unstale":"2024-05-10T08:40:21.793990+0000","last_undegraded":"2024-05-10T08:40:21.793990+0000","last_fullsized":"2024-05-10T08:40:21.793990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736724+0000","last_change":"2024-05-10T08:40:15.733269+0000","last_active":"2024-05-10T08:40:21.736724+0000","last_peered":"2024-05-10T08:40:21.736724+0000","last_clean":"2024-05-10T08:40:21.736724+0000","last_became_active":"2024-05-10T08:40:15.732928+0000","last_became_peered":"2024-05-10T08:40:15.732928+0000","last_unstale":"2024-05-10T08:40:21.736724+0000","last_undegraded":"2024-05-10T08:40:21.736724+0000","last_fullsized":"2024-05-10T08:40:21.736724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737390+0000","last_change":"2024-05-10T08:40:14.716035+0000","last_active":"2024-05-10T08:40:21.737390+0000","last_peered":"2024-05-10T08:40:21.737390+0000","last_clean":"2024-05-10T08:40:21.737390+0000","last_became_active":"2024-05-10T08:40:14.715525+0000","last_became_peered":"2024-05-10T08:40:14.715525+0000","last_unstale":"2024-05-10T08:40:21.737390+0000","last_undegraded":"2024-05-10T08:40:21.737390+0000","last_fullsized":"2024-05-10T08:40:21.737390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793415+0000","last_change":"2024-05-10T08:40:14.716190+0000","last_active":"2024-05-10T08:40:21.793415+0000","last_peered":"2024-05-10T08:40:21.793415+0000","last_clean":"2024-05-10T08:40:21.793415+0000","last_became_active":"2024-05-10T08:40:14.715910+0000","last_became_peered":"2024-05-10T08:40:14.715910+0000","last_unstale":"2024-05-10T08:40:21.793415+0000","last_undegraded":"2024-05-10T08:40:21.793415+0000","last_fullsized":"2024-05-10T08:40:21.793415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792400+0000","last_change":"2024-05-10T08:40:15.721466+0000","last_active":"2024-05-10T08:40:21.792400+0000","last_peered":"2024-05-10T08:40:21.792400+0000","last_clean":"2024-05-10T08:40:21.792400+0000","last_became_active":"2024-05-10T08:40:15.721200+0000","last_became_peered":"2024-05-10T08:40:15.721200+0000","last_unstale":"2024-05-10T08:40:21.792400+0000","last_undegraded":"2024-05-10T08:40:21.792400+0000","last_fullsized":"2024-05-10T08:40:21.792400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791730+0000","last_change":"2024-05-10T08:40:19.755853+0000","last_active":"2024-05-10T08:40:21.791730+0000","last_peered":"2024-05-10T08:40:21.791730+0000","last_clean":"2024-05-10T08:40:21.791730+0000","last_became_active":"2024-05-10T08:40:19.755406+0000","last_became_peered":"2024-05-10T08:40:19.755406+0000","last_unstale":"2024-05-10T08:40:21.791730+0000","last_undegraded":"2024-05-10T08:40:21.791730+0000","last_fullsized":"2024-05-10T08:40:21.791730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:12.946445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736391+0000","last_change":"2024-05-10T08:40:14.720438+0000","last_active":"2024-05-10T08:40:21.736391+0000","last_peered":"2024-05-10T08:40:21.736391+0000","last_clean":"2024-05-10T08:40:21.736391+0000","last_became_active":"2024-05-10T08:40:14.720127+0000","last_became_peered":"2024-05-10T08:40:14.720127+0000","last_unstale":"2024-05-10T08:40:21.736391+0000","last_undegraded":"2024-05-10T08:40:21.736391+0000","last_fullsized":"2024-05-10T08:40:21.736391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736427+0000","last_change":"2024-05-10T08:40:15.707932+0000","last_active":"2024-05-10T08:40:21.736427+0000","last_peered":"2024-05-10T08:40:21.736427+0000","last_clean":"2024-05-10T08:40:21.736427+0000","last_became_active":"2024-05-10T08:40:15.707646+0000","last_became_peered":"2024-05-10T08:40:15.707646+0000","last_unstale":"2024-05-10T08:40:21.736427+0000","last_undegraded":"2024-05-10T08:40:21.736427+0000","last_fullsized":"2024-05-10T08:40:21.736427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:56.956134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736748+0000","last_change":"2024-05-10T08:40:19.751262+0000","last_active":"2024-05-10T08:40:21.736748+0000","last_peered":"2024-05-10T08:40:21.736748+0000","last_clean":"2024-05-10T08:40:21.736748+0000","last_became_active":"2024-05-10T08:40:19.750835+0000","last_became_peered":"2024-05-10T08:40:19.750835+0000","last_unstale":"2024-05-10T08:40:21.736748+0000","last_undegraded":"2024-05-10T08:40:21.736748+0000","last_fullsized":"2024-05-10T08:40:21.736748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:37.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792880+0000","last_change":"2024-05-10T08:40:15.726263+0000","last_active":"2024-05-10T08:40:21.792880+0000","last_peered":"2024-05-10T08:40:21.792880+0000","last_clean":"2024-05-10T08:40:21.792880+0000","last_became_active":"2024-05-10T08:40:15.725796+0000","last_became_peered":"2024-05-10T08:40:15.725796+0000","last_unstale":"2024-05-10T08:40:21.792880+0000","last_undegraded":"2024-05-10T08:40:21.792880+0000","last_fullsized":"2024-05-10T08:40:21.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791487+0000","last_change":"2024-05-10T08:40:15.722103+0000","last_active":"2024-05-10T08:40:21.791487+0000","last_peered":"2024-05-10T08:40:21.791487+0000","last_clean":"2024-05-10T08:40:21.791487+0000","last_became_active":"2024-05-10T08:40:15.721824+0000","last_became_peered":"2024-05-10T08:40:15.721824+0000","last_unstale":"2024-05-10T08:40:21.791487+0000","last_undegraded":"2024-05-10T08:40:21.791487+0000","last_fullsized":"2024-05-10T08:40:21.791487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793168+0000","last_change":"2024-05-10T08:40:15.730264+0000","last_active":"2024-05-10T08:40:21.793168+0000","last_peered":"2024-05-10T08:40:21.793168+0000","last_clean":"2024-05-10T08:40:21.793168+0000","last_became_active":"2024-05-10T08:40:15.729988+0000","last_became_peered":"2024-05-10T08:40:15.729988+0000","last_unstale":"2024-05-10T08:40:21.793168+0000","last_undegraded":"2024-05-10T08:40:21.793168+0000","last_fullsized":"2024-05-10T08:40:21.793168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792351+0000","last_change":"2024-05-10T08:40:15.722004+0000","last_active":"2024-05-10T08:40:21.792351+0000","last_peered":"2024-05-10T08:40:21.792351+0000","last_clean":"2024-05-10T08:40:21.792351+0000","last_became_active":"2024-05-10T08:40:15.721735+0000","last_became_peered":"2024-05-10T08:40:15.721735+0000","last_unstale":"2024-05-10T08:40:21.792351+0000","last_undegraded":"2024-05-10T08:40:21.792351+0000","last_fullsized":"2024-05-10T08:40:21.792351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736384+0000","last_change":"2024-05-10T08:40:15.733681+0000","last_active":"2024-05-10T08:40:21.736384+0000","last_peered":"2024-05-10T08:40:21.736384+0000","last_clean":"2024-05-10T08:40:21.736384+0000","last_became_active":"2024-05-10T08:40:15.730232+0000","last_became_peered":"2024-05-10T08:40:15.730232+0000","last_unstale":"2024-05-10T08:40:21.736384+0000","last_undegraded":"2024-05-10T08:40:21.736384+0000","last_fullsized":"2024-05-10T08:40:21.736384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735862+0000","last_change":"2024-05-10T08:40:15.721502+0000","last_active":"2024-05-10T08:40:21.735862+0000","last_peered":"2024-05-10T08:40:21.735862+0000","last_clean":"2024-05-10T08:40:21.735862+0000","last_became_active":"2024-05-10T08:40:15.721196+0000","last_became_peered":"2024-05-10T08:40:15.721196+0000","last_unstale":"2024-05-10T08:40:21.735862+0000","last_undegraded":"2024-05-10T08:40:21.735862+0000","last_fullsized":"2024-05-10T08:40:21.735862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794000+0000","last_change":"2024-05-10T08:40:15.719934+0000","last_active":"2024-05-10T08:40:21.794000+0000","last_peered":"2024-05-10T08:40:21.794000+0000","last_clean":"2024-05-10T08:40:21.794000+0000","last_became_active":"2024-05-10T08:40:15.719673+0000","last_became_peered":"2024-05-10T08:40:15.719673+0000","last_unstale":"2024-05-10T08:40:21.794000+0000","last_undegraded":"2024-05-10T08:40:21.794000+0000","last_fullsized":"2024-05-10T08:40:21.794000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737224+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.737224+0000","last_peered":"2024-05-10T08:40:21.737224+0000","last_clean":"2024-05-10T08:40:21.737224+0000","last_became_active":"2024-05-10T08:40:15.726438+0000","last_became_peered":"2024-05-10T08:40:15.726438+0000","last_unstale":"2024-05-10T08:40:21.737224+0000","last_undegraded":"2024-05-10T08:40:21.737224+0000","last_fullsized":"2024-05-10T08:40:21.737224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792352+0000","last_change":"2024-05-10T08:40:15.730586+0000","last_active":"2024-05-10T08:40:21.792352+0000","last_peered":"2024-05-10T08:40:21.792352+0000","last_clean":"2024-05-10T08:40:21.792352+0000","last_became_active":"2024-05-10T08:40:15.730214+0000","last_became_peered":"2024-05-10T08:40:15.730214+0000","last_unstale":"2024-05-10T08:40:21.792352+0000","last_undegraded":"2024-05-10T08:40:21.792352+0000","last_fullsized":"2024-05-10T08:40:21.792352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737367+0000","last_change":"2024-05-10T08:40:15.729639+0000","last_active":"2024-05-10T08:40:21.737367+0000","last_peered":"2024-05-10T08:40:21.737367+0000","last_clean":"2024-05-10T08:40:21.737367+0000","last_became_active":"2024-05-10T08:40:15.722616+0000","last_became_peered":"2024-05-10T08:40:15.722616+0000","last_unstale":"2024-05-10T08:40:21.737367+0000","last_undegraded":"2024-05-10T08:40:21.737367+0000","last_fullsized":"2024-05-10T08:40:21.737367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793084+0000","last_change":"2024-05-10T08:40:15.730859+0000","last_active":"2024-05-10T08:40:21.793084+0000","last_peered":"2024-05-10T08:40:21.793084+0000","last_clean":"2024-05-10T08:40:21.793084+0000","last_became_active":"2024-05-10T08:40:15.730568+0000","last_became_peered":"2024-05-10T08:40:15.730568+0000","last_unstale":"2024-05-10T08:40:21.793084+0000","last_undegraded":"2024-05-10T08:40:21.793084+0000","last_fullsized":"2024-05-10T08:40:21.793084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792243+0000","last_change":"2024-05-10T08:40:15.732254+0000","last_active":"2024-05-10T08:40:21.792243+0000","last_peered":"2024-05-10T08:40:21.792243+0000","last_clean":"2024-05-10T08:40:21.792243+0000","last_became_active":"2024-05-10T08:40:15.731908+0000","last_became_peered":"2024-05-10T08:40:15.731908+0000","last_unstale":"2024-05-10T08:40:21.792243+0000","last_undegraded":"2024-05-10T08:40:21.792243+0000","last_fullsized":"2024-05-10T08:40:21.792243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793673+0000","last_change":"2024-05-10T08:40:15.719640+0000","last_active":"2024-05-10T08:40:21.793673+0000","last_peered":"2024-05-10T08:40:21.793673+0000","last_clean":"2024-05-10T08:40:21.793673+0000","last_became_active":"2024-05-10T08:40:15.719365+0000","last_became_peered":"2024-05-10T08:40:15.719365+0000","last_unstale":"2024-05-10T08:40:21.793673+0000","last_undegraded":"2024-05-10T08:40:21.793673+0000","last_fullsized":"2024-05-10T08:40:21.793673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794444+0000","last_change":"2024-05-10T08:40:15.720838+0000","last_active":"2024-05-10T08:40:21.794444+0000","last_peered":"2024-05-10T08:40:21.794444+0000","last_clean":"2024-05-10T08:40:21.794444+0000","last_became_active":"2024-05-10T08:40:15.720001+0000","last_became_peered":"2024-05-10T08:40:15.720001+0000","last_unstale":"2024-05-10T08:40:21.794444+0000","last_undegraded":"2024-05-10T08:40:21.794444+0000","last_fullsized":"2024-05-10T08:40:21.794444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:33.337354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792361+0000","last_change":"2024-05-10T08:40:15.718557+0000","last_active":"2024-05-10T08:40:21.792361+0000","last_peered":"2024-05-10T08:40:21.792361+0000","last_clean":"2024-05-10T08:40:21.792361+0000","last_became_active":"2024-05-10T08:40:15.718245+0000","last_became_peered":"2024-05-10T08:40:15.718245+0000","last_unstale":"2024-05-10T08:40:21.792361+0000","last_undegraded":"2024-05-10T08:40:21.792361+0000","last_fullsized":"2024-05-10T08:40:21.792361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:58.260494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793531+0000","last_change":"2024-05-10T08:40:15.731367+0000","last_active":"2024-05-10T08:40:21.793531+0000","last_peered":"2024-05-10T08:40:21.793531+0000","last_clean":"2024-05-10T08:40:21.793531+0000","last_became_active":"2024-05-10T08:40:15.731074+0000","last_became_peered":"2024-05-10T08:40:15.731074+0000","last_unstale":"2024-05-10T08:40:21.793531+0000","last_undegraded":"2024-05-10T08:40:21.793531+0000","last_fullsized":"2024-05-10T08:40:21.793531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792246+0000","last_change":"2024-05-10T08:40:15.732380+0000","last_active":"2024-05-10T08:40:21.792246+0000","last_peered":"2024-05-10T08:40:21.792246+0000","last_clean":"2024-05-10T08:40:21.792246+0000","last_became_active":"2024-05-10T08:40:15.732090+0000","last_became_peered":"2024-05-10T08:40:15.732090+0000","last_unstale":"2024-05-10T08:40:21.792246+0000","last_undegraded":"2024-05-10T08:40:21.792246+0000","last_fullsized":"2024-05-10T08:40:21.792246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735458+0000","last_change":"2024-05-10T08:40:15.710587+0000","last_active":"2024-05-10T08:40:21.735458+0000","last_peered":"2024-05-10T08:40:21.735458+0000","last_clean":"2024-05-10T08:40:21.735458+0000","last_became_active":"2024-05-10T08:40:15.710276+0000","last_became_peered":"2024-05-10T08:40:15.710276+0000","last_unstale":"2024-05-10T08:40:21.735458+0000","last_undegraded":"2024-05-10T08:40:21.735458+0000","last_fullsized":"2024-05-10T08:40:21.735458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792150+0000","last_change":"2024-05-10T08:40:15.725581+0000","last_active":"2024-05-10T08:40:21.792150+0000","last_peered":"2024-05-10T08:40:21.792150+0000","last_clean":"2024-05-10T08:40:21.792150+0000","last_became_active":"2024-05-10T08:40:15.725302+0000","last_became_peered":"2024-05-10T08:40:15.725302+0000","last_unstale":"2024-05-10T08:40:21.792150+0000","last_undegraded":"2024-05-10T08:40:21.792150+0000","last_fullsized":"2024-05-10T08:40:21.792150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736194+0000","last_change":"2024-05-10T08:40:15.719950+0000","last_active":"2024-05-10T08:40:21.736194+0000","last_peered":"2024-05-10T08:40:21.736194+0000","last_clean":"2024-05-10T08:40:21.736194+0000","last_became_active":"2024-05-10T08:40:15.719681+0000","last_became_peered":"2024-05-10T08:40:15.719681+0000","last_unstale":"2024-05-10T08:40:21.736194+0000","last_undegraded":"2024-05-10T08:40:21.736194+0000","last_fullsized":"2024-05-10T08:40:21.736194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736919+0000","last_change":"2024-05-10T08:40:15.716857+0000","last_active":"2024-05-10T08:40:21.736919+0000","last_peered":"2024-05-10T08:40:21.736919+0000","last_clean":"2024-05-10T08:40:21.736919+0000","last_became_active":"2024-05-10T08:40:15.716582+0000","last_became_peered":"2024-05-10T08:40:15.716582+0000","last_unstale":"2024-05-10T08:40:21.736919+0000","last_undegraded":"2024-05-10T08:40:21.736919+0000","last_fullsized":"2024-05-10T08:40:21.736919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:27.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793884+0000","last_change":"2024-05-10T08:40:15.728928+0000","last_active":"2024-05-10T08:40:21.793884+0000","last_peered":"2024-05-10T08:40:21.793884+0000","last_clean":"2024-05-10T08:40:21.793884+0000","last_became_active":"2024-05-10T08:40:15.728156+0000","last_became_peered":"2024-05-10T08:40:15.728156+0000","last_unstale":"2024-05-10T08:40:21.793884+0000","last_undegraded":"2024-05-10T08:40:21.793884+0000","last_fullsized":"2024-05-10T08:40:21.793884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793898+0000","last_change":"2024-05-10T08:40:15.722176+0000","last_active":"2024-05-10T08:40:21.793898+0000","last_peered":"2024-05-10T08:40:21.793898+0000","last_clean":"2024-05-10T08:40:21.793898+0000","last_became_active":"2024-05-10T08:40:15.721908+0000","last_became_peered":"2024-05-10T08:40:15.721908+0000","last_unstale":"2024-05-10T08:40:21.793898+0000","last_undegraded":"2024-05-10T08:40:21.793898+0000","last_fullsized":"2024-05-10T08:40:21.793898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794390+0000","last_change":"2024-05-10T08:40:15.725446+0000","last_active":"2024-05-10T08:40:21.794390+0000","last_peered":"2024-05-10T08:40:21.794390+0000","last_clean":"2024-05-10T08:40:21.794390+0000","last_became_active":"2024-05-10T08:40:15.725178+0000","last_became_peered":"2024-05-10T08:40:15.725178+0000","last_unstale":"2024-05-10T08:40:21.794390+0000","last_undegraded":"2024-05-10T08:40:21.794390+0000","last_fullsized":"2024-05-10T08:40:21.794390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:54.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736627+0000","last_change":"2024-05-10T08:40:15.730664+0000","last_active":"2024-05-10T08:40:21.736627+0000","last_peered":"2024-05-10T08:40:21.736627+0000","last_clean":"2024-05-10T08:40:21.736627+0000","last_became_active":"2024-05-10T08:40:15.729235+0000","last_became_peered":"2024-05-10T08:40:15.729235+0000","last_unstale":"2024-05-10T08:40:21.736627+0000","last_undegraded":"2024-05-10T08:40:21.736627+0000","last_fullsized":"2024-05-10T08:40:21.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792606+0000","last_change":"2024-05-10T08:40:15.727662+0000","last_active":"2024-05-10T08:40:21.792606+0000","last_peered":"2024-05-10T08:40:21.792606+0000","last_clean":"2024-05-10T08:40:21.792606+0000","last_became_active":"2024-05-10T08:40:15.727391+0000","last_became_peered":"2024-05-10T08:40:15.727391+0000","last_unstale":"2024-05-10T08:40:21.792606+0000","last_undegraded":"2024-05-10T08:40:21.792606+0000","last_fullsized":"2024-05-10T08:40:21.792606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793064+0000","last_change":"2024-05-10T08:40:15.726033+0000","last_active":"2024-05-10T08:40:21.793064+0000","last_peered":"2024-05-10T08:40:21.793064+0000","last_clean":"2024-05-10T08:40:21.793064+0000","last_became_active":"2024-05-10T08:40:15.725410+0000","last_became_peered":"2024-05-10T08:40:15.725410+0000","last_unstale":"2024-05-10T08:40:21.793064+0000","last_undegraded":"2024-05-10T08:40:21.793064+0000","last_fullsized":"2024-05-10T08:40:21.793064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793970+0000","last_change":"2024-05-10T08:40:15.721088+0000","last_active":"2024-05-10T08:40:21.793970+0000","last_peered":"2024-05-10T08:40:21.793970+0000","last_clean":"2024-05-10T08:40:21.793970+0000","last_became_active":"2024-05-10T08:40:15.720831+0000","last_became_peered":"2024-05-10T08:40:15.720831+0000","last_unstale":"2024-05-10T08:40:21.793970+0000","last_undegraded":"2024-05-10T08:40:21.793970+0000","last_fullsized":"2024-05-10T08:40:21.793970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792673+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792673+0000","last_peered":"2024-05-10T08:40:21.792673+0000","last_clean":"2024-05-10T08:40:21.792673+0000","last_became_active":"2024-05-10T08:40:15.737931+0000","last_became_peered":"2024-05-10T08:40:15.737931+0000","last_unstale":"2024-05-10T08:40:21.792673+0000","last_undegraded":"2024-05-10T08:40:21.792673+0000","last_fullsized":"2024-05-10T08:40:21.792673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791744+0000","last_change":"2024-05-10T08:40:15.723463+0000","last_active":"2024-05-10T08:40:21.791744+0000","last_peered":"2024-05-10T08:40:21.791744+0000","last_clean":"2024-05-10T08:40:21.791744+0000","last_became_active":"2024-05-10T08:40:15.723178+0000","last_became_peered":"2024-05-10T08:40:15.723178+0000","last_unstale":"2024-05-10T08:40:21.791744+0000","last_undegraded":"2024-05-10T08:40:21.791744+0000","last_fullsized":"2024-05-10T08:40:21.791744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736554+0000","last_change":"2024-05-10T08:40:15.724998+0000","last_active":"2024-05-10T08:40:21.736554+0000","last_peered":"2024-05-10T08:40:21.736554+0000","last_clean":"2024-05-10T08:40:21.736554+0000","last_became_active":"2024-05-10T08:40:15.724639+0000","last_became_peered":"2024-05-10T08:40:15.724639+0000","last_unstale":"2024-05-10T08:40:21.736554+0000","last_undegraded":"2024-05-10T08:40:21.736554+0000","last_fullsized":"2024-05-10T08:40:21.736554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794309+0000","last_change":"2024-05-10T08:40:15.723566+0000","last_active":"2024-05-10T08:40:21.794309+0000","last_peered":"2024-05-10T08:40:21.794309+0000","last_clean":"2024-05-10T08:40:21.794309+0000","last_became_active":"2024-05-10T08:40:15.719857+0000","last_became_peered":"2024-05-10T08:40:15.719857+0000","last_unstale":"2024-05-10T08:40:21.794309+0000","last_undegraded":"2024-05-10T08:40:21.794309+0000","last_fullsized":"2024-05-10T08:40:21.794309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:42.339941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":697957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":107007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:40:34.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:40:34.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 Processor -- start 2024-05-10T08:40:34.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 -- start start 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c0b21f0 0x7f687c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f687c162f50 0x7f687c1633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f687c0cf790 0x7f687c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f687c1638f0 con 0x7f687c0cf790 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f687c06d810 con 0x7f687c162f50 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.531+0000 7f688319d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f687c06e0b0 con 0x7f687c0b21f0 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f687c0cf790 0x7f687c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f687c0cf790 0x7f687c0cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58180/0 (socket says 172.21.15.37:58180) 2024-05-10T08:40:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 -- 172.21.15.37:0/2196372541 learned_addr learned my addr 172.21.15.37:0/2196372541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f6880f39640 1 --2- 172.21.15.37:0/2196372541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c0b21f0 0x7f687c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f687bfff640 1 --2- 172.21.15.37:0/2196372541 >> v2:172.21.15.82:3300/0 conn(0x7f687c162f50 0x7f687c1633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 -- 172.21.15.37:0/2196372541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c0b21f0 msgr2=0x7f687c06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 --2- 172.21.15.37:0/2196372541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c0b21f0 0x7f687c06e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 -- 172.21.15.37:0/2196372541 >> v2:172.21.15.82:3300/0 conn(0x7f687c162f50 msgr2=0x7f687c1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 --2- 172.21.15.37:0/2196372541 >> v2:172.21.15.82:3300/0 conn(0x7f687c162f50 0x7f687c1633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.532+0000 7f688173a640 1 -- 172.21.15.37:0/2196372541 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687c0d0500 con 0x7f687c0cf790 2024-05-10T08:40:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688173a640 1 --2- 172.21.15.37:0/2196372541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0cf790 0x7f687c0cfc20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f687c0d0920 tx=0x7f687402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af8b687314c8766 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f687b7fe640 1 -- 172.21.15.37:0/2196372541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6874036070 con 0x7f687c0cf790 2024-05-10T08:40:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f687b7fe640 1 -- 172.21.15.37:0/2196372541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6874031600 con 0x7f687c0cf790 2024-05-10T08:40:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f687b7fe640 1 -- 172.21.15.37:0/2196372541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68740319d0 con 0x7f687c0cf790 2024-05-10T08:40:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688319d640 1 -- 172.21.15.37:0/2196372541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0cf790 msgr2=0x7f687c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688319d640 1 --2- 172.21.15.37:0/2196372541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0cf790 0x7f687c0cfc20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f687c0d0920 tx=0x7f687402a570 comp rx=0 tx=0).stop 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688319d640 1 -- 172.21.15.37:0/2196372541 shutdown_connections 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688319d640 1 --2- 172.21.15.37:0/2196372541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0cf790 0x7f687c0cfc20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688319d640 1 --2- 172.21.15.37:0/2196372541 >> v2:172.21.15.82:3300/0 conn(0x7f687c162f50 0x7f687c1633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688319d640 1 --2- 172.21.15.37:0/2196372541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c0b21f0 0x7f687c06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.533+0000 7f688319d640 1 -- 172.21.15.37:0/2196372541 >> 172.21.15.37:0/2196372541 conn(0x7f687c09ba40 msgr2=0x7f687c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.534+0000 7f688319d640 1 -- 172.21.15.37:0/2196372541 shutdown_connections 2024-05-10T08:40:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.534+0000 7f688319d640 1 -- 172.21.15.37:0/2196372541 wait complete. 2024-05-10T08:40:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.536+0000 7f688319d640 1 Processor -- start 2024-05-10T08:40:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.536+0000 7f688319d640 1 -- start start 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688319d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0b21f0 0x7f687c15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688319d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f687c0cf790 0x7f687c0c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688319d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c162f50 0x7f687c09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688319d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f687c06ea80 con 0x7f687c0b21f0 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688319d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f687c06dd40 con 0x7f687c0cf790 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688319d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f687c0b25d0 con 0x7f687c162f50 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0b21f0 0x7f687c15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0b21f0 0x7f687c15de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58188/0 (socket says 172.21.15.37:58188) 2024-05-10T08:40:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 -- 172.21.15.37:0/2080904985 learned_addr learned my addr 172.21.15.37:0/2080904985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688173a640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c162f50 0x7f687c09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f687bfff640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f687c0cf790 0x7f687c0c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 -- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c162f50 msgr2=0x7f687c09cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c162f50 0x7f687c09cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 -- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f687c0cf790 msgr2=0x7f687c0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f687c0cf790 0x7f687c0c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 -- 172.21.15.37:0/2080904985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687c0b7270 con 0x7f687c0b21f0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f688173a640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c162f50 0x7f687c09cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.537+0000 7f6880f39640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0b21f0 0x7f687c15de80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f687000e890 tx=0x7f687000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.538+0000 7f68797fa640 1 -- 172.21.15.37:0/2080904985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870017070 con 0x7f687c0b21f0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.538+0000 7f68797fa640 1 -- 172.21.15.37:0/2080904985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687000c940 con 0x7f687c0b21f0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.538+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687c0b7550 con 0x7f687c0b21f0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.538+0000 7f68797fa640 1 -- 172.21.15.37:0/2080904985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687000cd10 con 0x7f687c0b21f0 2024-05-10T08:40:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.538+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687c15e3c0 con 0x7f687c0b21f0 2024-05-10T08:40:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.539+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f687c069b00 con 0x7f687c0b21f0 2024-05-10T08:40:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.539+0000 7f68797fa640 1 -- 172.21.15.37:0/2080904985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f687001a070 con 0x7f687c0b21f0 2024-05-10T08:40:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.540+0000 7f68797fa640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6860076300 0x7f68600787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.540+0000 7f68797fa640 1 -- 172.21.15.37:0/2080904985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6870097910 con 0x7f687c0b21f0 2024-05-10T08:40:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.540+0000 7f687bfff640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6860076300 0x7f68600787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.541+0000 7f687bfff640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6860076300 0x7f68600787c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f687c0b6cb0 tx=0x7f6868008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.544+0000 7f68797fa640 1 -- 172.21.15.37:0/2080904985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6870060f30 con 0x7f687c0b21f0 2024-05-10T08:40:34.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.731+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f687c070a30 con 0x7f6860076300 2024-05-10T08:40:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.740+0000 7f68797fa640 1 -- 172.21.15.37:0/2080904985 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f687c070a30 con 0x7f6860076300 2024-05-10T08:40:34.743 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6860076300 msgr2=0x7f68600787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6860076300 0x7f68600787c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f687c0b6cb0 tx=0x7f6868008040 comp rx=0 tx=0).stop 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0b21f0 msgr2=0x7f687c15de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0b21f0 0x7f687c15de80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f687000e890 tx=0x7f687000ed50 comp rx=0 tx=0).stop 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 shutdown_connections 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6860076300 0x7f68600787c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f687c162f50 0x7f687c09cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f687c0cf790 0x7f687c0c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 --2- 172.21.15.37:0/2080904985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f687c0b21f0 0x7f687c15de80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 >> 172.21.15.37:0/2080904985 conn(0x7f687c09ba40 msgr2=0x7f687c15f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 shutdown_connections 2024-05-10T08:40:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.743+0000 7f688319d640 1 -- 172.21.15.37:0/2080904985 wait complete. 2024-05-10T08:40:34.754 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-05-10T08:40:33.328286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219496,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755224,"statfs":{"total":773094113280,"available":772869349376,"internally_reserved":0,"allocated":3383296,"data_stored":2046072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.593941"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792232+0000","last_change":"2024-05-10T08:40:14.722841+0000","last_active":"2024-05-10T08:40:21.792232+0000","last_peered":"2024-05-10T08:40:21.792232+0000","last_clean":"2024-05-10T08:40:21.792232+0000","last_became_active":"2024-05-10T08:40:14.722183+0000","last_became_peered":"2024-05-10T08:40:14.722183+0000","last_unstale":"2024-05-10T08:40:21.792232+0000","last_undegraded":"2024-05-10T08:40:21.792232+0000","last_fullsized":"2024-05-10T08:40:21.792232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:06.547146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736024+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.736024+0000","last_peered":"2024-05-10T08:40:21.736024+0000","last_clean":"2024-05-10T08:40:21.736024+0000","last_became_active":"2024-05-10T08:40:15.727402+0000","last_became_peered":"2024-05-10T08:40:15.727402+0000","last_unstale":"2024-05-10T08:40:21.736024+0000","last_undegraded":"2024-05-10T08:40:21.736024+0000","last_fullsized":"2024-05-10T08:40:21.736024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737026+0000","last_change":"2024-05-10T08:40:20.252446+0000","last_active":"2024-05-10T08:40:21.737026+0000","last_peered":"2024-05-10T08:40:21.737026+0000","last_clean":"2024-05-10T08:40:21.737026+0000","last_became_active":"2024-05-10T08:40:20.251506+0000","last_became_peered":"2024-05-10T08:40:20.251506+0000","last_unstale":"2024-05-10T08:40:21.737026+0000","last_undegraded":"2024-05-10T08:40:21.737026+0000","last_fullsized":"2024-05-10T08:40:21.737026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:20.266480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736220+0000","last_change":"2024-05-10T08:40:14.718258+0000","last_active":"2024-05-10T08:40:21.736220+0000","last_peered":"2024-05-10T08:40:21.736220+0000","last_clean":"2024-05-10T08:40:21.736220+0000","last_became_active":"2024-05-10T08:40:14.717977+0000","last_became_peered":"2024-05-10T08:40:14.717977+0000","last_unstale":"2024-05-10T08:40:21.736220+0000","last_undegraded":"2024-05-10T08:40:21.736220+0000","last_fullsized":"2024-05-10T08:40:21.736220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791950+0000","last_change":"2024-05-10T08:40:15.728761+0000","last_active":"2024-05-10T08:40:21.791950+0000","last_peered":"2024-05-10T08:40:21.791950+0000","last_clean":"2024-05-10T08:40:21.791950+0000","last_became_active":"2024-05-10T08:40:15.728245+0000","last_became_peered":"2024-05-10T08:40:15.728245+0000","last_unstale":"2024-05-10T08:40:21.791950+0000","last_undegraded":"2024-05-10T08:40:21.791950+0000","last_fullsized":"2024-05-10T08:40:21.791950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:08.921084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736087+0000","last_change":"2024-05-10T08:40:19.751295+0000","last_active":"2024-05-10T08:40:21.736087+0000","last_peered":"2024-05-10T08:40:21.736087+0000","last_clean":"2024-05-10T08:40:21.736087+0000","last_became_active":"2024-05-10T08:40:19.750747+0000","last_became_peered":"2024-05-10T08:40:19.750747+0000","last_unstale":"2024-05-10T08:40:21.736087+0000","last_undegraded":"2024-05-10T08:40:21.736087+0000","last_fullsized":"2024-05-10T08:40:21.736087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:52.662846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794387+0000","last_change":"2024-05-10T08:40:14.722485+0000","last_active":"2024-05-10T08:40:21.794387+0000","last_peered":"2024-05-10T08:40:21.794387+0000","last_clean":"2024-05-10T08:40:21.794387+0000","last_became_active":"2024-05-10T08:40:14.722184+0000","last_became_peered":"2024-05-10T08:40:14.722184+0000","last_unstale":"2024-05-10T08:40:21.794387+0000","last_undegraded":"2024-05-10T08:40:21.794387+0000","last_fullsized":"2024-05-10T08:40:21.794387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:53:43.340926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792763+0000","last_change":"2024-05-10T08:40:15.724844+0000","last_active":"2024-05-10T08:40:21.792763+0000","last_peered":"2024-05-10T08:40:21.792763+0000","last_clean":"2024-05-10T08:40:21.792763+0000","last_became_active":"2024-05-10T08:40:15.724533+0000","last_became_peered":"2024-05-10T08:40:15.724533+0000","last_unstale":"2024-05-10T08:40:21.792763+0000","last_undegraded":"2024-05-10T08:40:21.792763+0000","last_fullsized":"2024-05-10T08:40:21.792763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:32:08.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737099+0000","last_change":"2024-05-10T08:40:19.753339+0000","last_active":"2024-05-10T08:40:21.737099+0000","last_peered":"2024-05-10T08:40:21.737099+0000","last_clean":"2024-05-10T08:40:21.737099+0000","last_became_active":"2024-05-10T08:40:19.751018+0000","last_became_peered":"2024-05-10T08:40:19.751018+0000","last_unstale":"2024-05-10T08:40:21.737099+0000","last_undegraded":"2024-05-10T08:40:21.737099+0000","last_fullsized":"2024-05-10T08:40:21.737099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793602+0000","last_change":"2024-05-10T08:40:14.724343+0000","last_active":"2024-05-10T08:40:21.793602+0000","last_peered":"2024-05-10T08:40:21.793602+0000","last_clean":"2024-05-10T08:40:21.793602+0000","last_became_active":"2024-05-10T08:40:14.724052+0000","last_became_peered":"2024-05-10T08:40:14.724052+0000","last_unstale":"2024-05-10T08:40:21.793602+0000","last_undegraded":"2024-05-10T08:40:21.793602+0000","last_fullsized":"2024-05-10T08:40:21.793602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793405+0000","last_change":"2024-05-10T08:40:15.726508+0000","last_active":"2024-05-10T08:40:21.793405+0000","last_peered":"2024-05-10T08:40:21.793405+0000","last_clean":"2024-05-10T08:40:21.793405+0000","last_became_active":"2024-05-10T08:40:15.723751+0000","last_became_peered":"2024-05-10T08:40:15.723751+0000","last_unstale":"2024-05-10T08:40:21.793405+0000","last_undegraded":"2024-05-10T08:40:21.793405+0000","last_fullsized":"2024-05-10T08:40:21.793405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736296+0000","last_change":"2024-05-10T08:40:19.758941+0000","last_active":"2024-05-10T08:40:21.736296+0000","last_peered":"2024-05-10T08:40:21.736296+0000","last_clean":"2024-05-10T08:40:21.736296+0000","last_became_active":"2024-05-10T08:40:19.758340+0000","last_became_peered":"2024-05-10T08:40:19.758340+0000","last_unstale":"2024-05-10T08:40:21.736296+0000","last_undegraded":"2024-05-10T08:40:21.736296+0000","last_fullsized":"2024-05-10T08:40:21.736296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793269+0000","last_change":"2024-05-10T08:40:15.716167+0000","last_active":"2024-05-10T08:40:21.793269+0000","last_peered":"2024-05-10T08:40:21.793269+0000","last_clean":"2024-05-10T08:40:21.793269+0000","last_became_active":"2024-05-10T08:40:15.715892+0000","last_became_peered":"2024-05-10T08:40:15.715892+0000","last_unstale":"2024-05-10T08:40:21.793269+0000","last_undegraded":"2024-05-10T08:40:21.793269+0000","last_fullsized":"2024-05-10T08:40:21.793269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794201+0000","last_change":"2024-05-10T08:40:14.722515+0000","last_active":"2024-05-10T08:40:21.794201+0000","last_peered":"2024-05-10T08:40:21.794201+0000","last_clean":"2024-05-10T08:40:21.794201+0000","last_became_active":"2024-05-10T08:40:14.722210+0000","last_became_peered":"2024-05-10T08:40:14.722210+0000","last_unstale":"2024-05-10T08:40:21.794201+0000","last_undegraded":"2024-05-10T08:40:21.794201+0000","last_fullsized":"2024-05-10T08:40:21.794201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736849+0000","last_change":"2024-05-10T08:40:19.758434+0000","last_active":"2024-05-10T08:40:21.736849+0000","last_peered":"2024-05-10T08:40:21.736849+0000","last_clean":"2024-05-10T08:40:21.736849+0000","last_became_active":"2024-05-10T08:40:19.758013+0000","last_became_peered":"2024-05-10T08:40:19.758013+0000","last_unstale":"2024-05-10T08:40:21.736849+0000","last_undegraded":"2024-05-10T08:40:21.736849+0000","last_fullsized":"2024-05-10T08:40:21.736849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736292+0000","last_change":"2024-05-10T08:40:15.733728+0000","last_active":"2024-05-10T08:40:21.736292+0000","last_peered":"2024-05-10T08:40:21.736292+0000","last_clean":"2024-05-10T08:40:21.736292+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.736292+0000","last_undegraded":"2024-05-10T08:40:21.736292+0000","last_fullsized":"2024-05-10T08:40:21.736292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736094+0000","last_change":"2024-05-10T08:40:14.711008+0000","last_active":"2024-05-10T08:40:21.736094+0000","last_peered":"2024-05-10T08:40:21.736094+0000","last_clean":"2024-05-10T08:40:21.736094+0000","last_became_active":"2024-05-10T08:40:14.710716+0000","last_became_peered":"2024-05-10T08:40:14.710716+0000","last_unstale":"2024-05-10T08:40:21.736094+0000","last_undegraded":"2024-05-10T08:40:21.736094+0000","last_fullsized":"2024-05-10T08:40:21.736094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736797+0000","last_change":"2024-05-10T08:40:19.753357+0000","last_active":"2024-05-10T08:40:21.736797+0000","last_peered":"2024-05-10T08:40:21.736797+0000","last_clean":"2024-05-10T08:40:21.736797+0000","last_became_active":"2024-05-10T08:40:19.752967+0000","last_became_peered":"2024-05-10T08:40:19.752967+0000","last_unstale":"2024-05-10T08:40:21.736797+0000","last_undegraded":"2024-05-10T08:40:21.736797+0000","last_fullsized":"2024-05-10T08:40:21.736797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736816+0000","last_change":"2024-05-10T08:40:15.719215+0000","last_active":"2024-05-10T08:40:21.736816+0000","last_peered":"2024-05-10T08:40:21.736816+0000","last_clean":"2024-05-10T08:40:21.736816+0000","last_became_active":"2024-05-10T08:40:15.718864+0000","last_became_peered":"2024-05-10T08:40:15.718864+0000","last_unstale":"2024-05-10T08:40:21.736816+0000","last_undegraded":"2024-05-10T08:40:21.736816+0000","last_fullsized":"2024-05-10T08:40:21.736816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735514+0000","last_change":"2024-05-10T08:40:14.719728+0000","last_active":"2024-05-10T08:40:21.735514+0000","last_peered":"2024-05-10T08:40:21.735514+0000","last_clean":"2024-05-10T08:40:21.735514+0000","last_became_active":"2024-05-10T08:40:14.719401+0000","last_became_peered":"2024-05-10T08:40:14.719401+0000","last_unstale":"2024-05-10T08:40:21.735514+0000","last_undegraded":"2024-05-10T08:40:21.735514+0000","last_fullsized":"2024-05-10T08:40:21.735514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737417+0000","last_change":"2024-05-10T08:40:20.250769+0000","last_active":"2024-05-10T08:40:21.737417+0000","last_peered":"2024-05-10T08:40:21.737417+0000","last_clean":"2024-05-10T08:40:21.737417+0000","last_became_active":"2024-05-10T08:40:20.250387+0000","last_became_peered":"2024-05-10T08:40:20.250387+0000","last_unstale":"2024-05-10T08:40:21.737417+0000","last_undegraded":"2024-05-10T08:40:21.737417+0000","last_fullsized":"2024-05-10T08:40:21.737417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736533+0000","last_change":"2024-05-10T08:40:15.719306+0000","last_active":"2024-05-10T08:40:21.736533+0000","last_peered":"2024-05-10T08:40:21.736533+0000","last_clean":"2024-05-10T08:40:21.736533+0000","last_became_active":"2024-05-10T08:40:15.718968+0000","last_became_peered":"2024-05-10T08:40:15.718968+0000","last_unstale":"2024-05-10T08:40:21.736533+0000","last_undegraded":"2024-05-10T08:40:21.736533+0000","last_fullsized":"2024-05-10T08:40:21.736533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:34.334556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792277+0000","last_change":"2024-05-10T08:40:14.723003+0000","last_active":"2024-05-10T08:40:21.792277+0000","last_peered":"2024-05-10T08:40:21.792277+0000","last_clean":"2024-05-10T08:40:21.792277+0000","last_became_active":"2024-05-10T08:40:14.722721+0000","last_became_peered":"2024-05-10T08:40:14.722721+0000","last_unstale":"2024-05-10T08:40:21.792277+0000","last_undegraded":"2024-05-10T08:40:21.792277+0000","last_fullsized":"2024-05-10T08:40:21.792277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736700+0000","last_change":"2024-05-10T08:40:19.751296+0000","last_active":"2024-05-10T08:40:21.736700+0000","last_peered":"2024-05-10T08:40:21.736700+0000","last_clean":"2024-05-10T08:40:21.736700+0000","last_became_active":"2024-05-10T08:40:19.750813+0000","last_became_peered":"2024-05-10T08:40:19.750813+0000","last_unstale":"2024-05-10T08:40:21.736700+0000","last_undegraded":"2024-05-10T08:40:21.736700+0000","last_fullsized":"2024-05-10T08:40:21.736700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:58.250654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792010+0000","last_change":"2024-05-10T08:40:15.722099+0000","last_active":"2024-05-10T08:40:21.792010+0000","last_peered":"2024-05-10T08:40:21.792010+0000","last_clean":"2024-05-10T08:40:21.792010+0000","last_became_active":"2024-05-10T08:40:15.721386+0000","last_became_peered":"2024-05-10T08:40:15.721386+0000","last_unstale":"2024-05-10T08:40:21.792010+0000","last_undegraded":"2024-05-10T08:40:21.792010+0000","last_fullsized":"2024-05-10T08:40:21.792010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:07:45.250348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794133+0000","last_change":"2024-05-10T08:40:14.721450+0000","last_active":"2024-05-10T08:40:21.794133+0000","last_peered":"2024-05-10T08:40:21.794133+0000","last_clean":"2024-05-10T08:40:21.794133+0000","last_became_active":"2024-05-10T08:40:14.721110+0000","last_became_peered":"2024-05-10T08:40:14.721110+0000","last_unstale":"2024-05-10T08:40:21.794133+0000","last_undegraded":"2024-05-10T08:40:21.794133+0000","last_fullsized":"2024-05-10T08:40:21.794133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736263+0000","last_change":"2024-05-10T08:40:20.250784+0000","last_active":"2024-05-10T08:40:21.736263+0000","last_peered":"2024-05-10T08:40:21.736263+0000","last_clean":"2024-05-10T08:40:21.736263+0000","last_became_active":"2024-05-10T08:40:20.250338+0000","last_became_peered":"2024-05-10T08:40:20.250338+0000","last_unstale":"2024-05-10T08:40:21.736263+0000","last_undegraded":"2024-05-10T08:40:21.736263+0000","last_fullsized":"2024-05-10T08:40:21.736263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:15.728115+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:15.727814+0000","last_became_peered":"2024-05-10T08:40:15.727814+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736643+0000","last_change":"2024-05-10T08:40:14.712174+0000","last_active":"2024-05-10T08:40:21.736643+0000","last_peered":"2024-05-10T08:40:21.736643+0000","last_clean":"2024-05-10T08:40:21.736643+0000","last_became_active":"2024-05-10T08:40:14.711817+0000","last_became_peered":"2024-05-10T08:40:14.711817+0000","last_unstale":"2024-05-10T08:40:21.736643+0000","last_undegraded":"2024-05-10T08:40:21.736643+0000","last_fullsized":"2024-05-10T08:40:21.736643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736599+0000","last_change":"2024-05-10T08:40:20.250340+0000","last_active":"2024-05-10T08:40:21.736599+0000","last_peered":"2024-05-10T08:40:21.736599+0000","last_clean":"2024-05-10T08:40:21.736599+0000","last_became_active":"2024-05-10T08:40:20.249928+0000","last_became_peered":"2024-05-10T08:40:20.249928+0000","last_unstale":"2024-05-10T08:40:21.736599+0000","last_undegraded":"2024-05-10T08:40:21.736599+0000","last_fullsized":"2024-05-10T08:40:21.736599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:54:29.943142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736966+0000","last_change":"2024-05-10T08:40:15.717354+0000","last_active":"2024-05-10T08:40:21.736966+0000","last_peered":"2024-05-10T08:40:21.736966+0000","last_clean":"2024-05-10T08:40:21.736966+0000","last_became_active":"2024-05-10T08:40:15.717033+0000","last_became_peered":"2024-05-10T08:40:15.717033+0000","last_unstale":"2024-05-10T08:40:21.736966+0000","last_undegraded":"2024-05-10T08:40:21.736966+0000","last_fullsized":"2024-05-10T08:40:21.736966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794461+0000","last_change":"2024-05-10T08:40:14.722906+0000","last_active":"2024-05-10T08:40:21.794461+0000","last_peered":"2024-05-10T08:40:21.794461+0000","last_clean":"2024-05-10T08:40:21.794461+0000","last_became_active":"2024-05-10T08:40:14.722607+0000","last_became_peered":"2024-05-10T08:40:14.722607+0000","last_unstale":"2024-05-10T08:40:21.794461+0000","last_undegraded":"2024-05-10T08:40:21.794461+0000","last_fullsized":"2024-05-10T08:40:21.794461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:38.589413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792174+0000","last_change":"2024-05-10T08:40:20.250418+0000","last_active":"2024-05-10T08:40:21.792174+0000","last_peered":"2024-05-10T08:40:21.792174+0000","last_clean":"2024-05-10T08:40:21.792174+0000","last_became_active":"2024-05-10T08:40:20.249925+0000","last_became_peered":"2024-05-10T08:40:20.249925+0000","last_unstale":"2024-05-10T08:40:21.792174+0000","last_undegraded":"2024-05-10T08:40:21.792174+0000","last_fullsized":"2024-05-10T08:40:21.792174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793510+0000","last_change":"2024-05-10T08:40:15.735822+0000","last_active":"2024-05-10T08:40:21.793510+0000","last_peered":"2024-05-10T08:40:21.793510+0000","last_clean":"2024-05-10T08:40:21.793510+0000","last_became_active":"2024-05-10T08:40:15.735525+0000","last_became_peered":"2024-05-10T08:40:15.735525+0000","last_unstale":"2024-05-10T08:40:21.793510+0000","last_undegraded":"2024-05-10T08:40:21.793510+0000","last_fullsized":"2024-05-10T08:40:21.793510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737066+0000","last_change":"2024-05-10T08:40:14.720119+0000","last_active":"2024-05-10T08:40:21.737066+0000","last_peered":"2024-05-10T08:40:21.737066+0000","last_clean":"2024-05-10T08:40:21.737066+0000","last_became_active":"2024-05-10T08:40:14.719807+0000","last_became_peered":"2024-05-10T08:40:14.719807+0000","last_unstale":"2024-05-10T08:40:21.737066+0000","last_undegraded":"2024-05-10T08:40:21.737066+0000","last_fullsized":"2024-05-10T08:40:21.737066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735653+0000","last_change":"2024-05-10T08:40:19.758680+0000","last_active":"2024-05-10T08:40:21.735653+0000","last_peered":"2024-05-10T08:40:21.735653+0000","last_clean":"2024-05-10T08:40:21.735653+0000","last_became_active":"2024-05-10T08:40:19.757930+0000","last_became_peered":"2024-05-10T08:40:19.757930+0000","last_unstale":"2024-05-10T08:40:21.735653+0000","last_undegraded":"2024-05-10T08:40:21.735653+0000","last_fullsized":"2024-05-10T08:40:21.735653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737171+0000","last_change":"2024-05-10T08:40:15.727979+0000","last_active":"2024-05-10T08:40:21.737171+0000","last_peered":"2024-05-10T08:40:21.737171+0000","last_clean":"2024-05-10T08:40:21.737171+0000","last_became_active":"2024-05-10T08:40:15.727689+0000","last_became_peered":"2024-05-10T08:40:15.727689+0000","last_unstale":"2024-05-10T08:40:21.737171+0000","last_undegraded":"2024-05-10T08:40:21.737171+0000","last_fullsized":"2024-05-10T08:40:21.737171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:12:00.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793318+0000","last_change":"2024-05-10T08:40:14.719368+0000","last_active":"2024-05-10T08:40:21.793318+0000","last_peered":"2024-05-10T08:40:21.793318+0000","last_clean":"2024-05-10T08:40:21.793318+0000","last_became_active":"2024-05-10T08:40:14.719067+0000","last_became_peered":"2024-05-10T08:40:14.719067+0000","last_unstale":"2024-05-10T08:40:21.793318+0000","last_undegraded":"2024-05-10T08:40:21.793318+0000","last_fullsized":"2024-05-10T08:40:21.793318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736975+0000","last_change":"2024-05-10T08:40:19.749606+0000","last_active":"2024-05-10T08:40:21.736975+0000","last_peered":"2024-05-10T08:40:21.736975+0000","last_clean":"2024-05-10T08:40:21.736975+0000","last_became_active":"2024-05-10T08:40:19.748828+0000","last_became_peered":"2024-05-10T08:40:19.748828+0000","last_unstale":"2024-05-10T08:40:21.736975+0000","last_undegraded":"2024-05-10T08:40:21.736975+0000","last_fullsized":"2024-05-10T08:40:21.736975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735649+0000","last_change":"2024-05-10T08:40:15.720054+0000","last_active":"2024-05-10T08:40:21.735649+0000","last_peered":"2024-05-10T08:40:21.735649+0000","last_clean":"2024-05-10T08:40:21.735649+0000","last_became_active":"2024-05-10T08:40:15.719769+0000","last_became_peered":"2024-05-10T08:40:15.719769+0000","last_unstale":"2024-05-10T08:40:21.735649+0000","last_undegraded":"2024-05-10T08:40:21.735649+0000","last_fullsized":"2024-05-10T08:40:21.735649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791550+0000","last_change":"2024-05-10T08:40:14.721738+0000","last_active":"2024-05-10T08:40:21.791550+0000","last_peered":"2024-05-10T08:40:21.791550+0000","last_clean":"2024-05-10T08:40:21.791550+0000","last_became_active":"2024-05-10T08:40:14.721434+0000","last_became_peered":"2024-05-10T08:40:14.721434+0000","last_unstale":"2024-05-10T08:40:21.791550+0000","last_undegraded":"2024-05-10T08:40:21.791550+0000","last_fullsized":"2024-05-10T08:40:21.791550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737281+0000","last_change":"2024-05-10T08:40:19.758288+0000","last_active":"2024-05-10T08:40:21.737281+0000","last_peered":"2024-05-10T08:40:21.737281+0000","last_clean":"2024-05-10T08:40:21.737281+0000","last_became_active":"2024-05-10T08:40:19.757825+0000","last_became_peered":"2024-05-10T08:40:19.757825+0000","last_unstale":"2024-05-10T08:40:21.737281+0000","last_undegraded":"2024-05-10T08:40:21.737281+0000","last_fullsized":"2024-05-10T08:40:21.737281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791777+0000","last_change":"2024-05-10T08:40:15.722819+0000","last_active":"2024-05-10T08:40:21.791777+0000","last_peered":"2024-05-10T08:40:21.791777+0000","last_clean":"2024-05-10T08:40:21.791777+0000","last_became_active":"2024-05-10T08:40:15.722444+0000","last_became_peered":"2024-05-10T08:40:15.722444+0000","last_unstale":"2024-05-10T08:40:21.791777+0000","last_undegraded":"2024-05-10T08:40:21.791777+0000","last_fullsized":"2024-05-10T08:40:21.791777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792365+0000","last_change":"2024-05-10T08:40:14.723089+0000","last_active":"2024-05-10T08:40:21.792365+0000","last_peered":"2024-05-10T08:40:21.792365+0000","last_clean":"2024-05-10T08:40:21.792365+0000","last_became_active":"2024-05-10T08:40:14.722771+0000","last_became_peered":"2024-05-10T08:40:14.722771+0000","last_unstale":"2024-05-10T08:40:21.792365+0000","last_undegraded":"2024-05-10T08:40:21.792365+0000","last_fullsized":"2024-05-10T08:40:21.792365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:21.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792005+0000","last_change":"2024-05-10T08:40:20.250543+0000","last_active":"2024-05-10T08:40:21.792005+0000","last_peered":"2024-05-10T08:40:21.792005+0000","last_clean":"2024-05-10T08:40:21.792005+0000","last_became_active":"2024-05-10T08:40:20.249990+0000","last_became_peered":"2024-05-10T08:40:20.249990+0000","last_unstale":"2024-05-10T08:40:21.792005+0000","last_undegraded":"2024-05-10T08:40:21.792005+0000","last_fullsized":"2024-05-10T08:40:21.792005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735932+0000","last_change":"2024-05-10T08:40:15.730255+0000","last_active":"2024-05-10T08:40:21.735932+0000","last_peered":"2024-05-10T08:40:21.735932+0000","last_clean":"2024-05-10T08:40:21.735932+0000","last_became_active":"2024-05-10T08:40:15.729980+0000","last_became_peered":"2024-05-10T08:40:15.729980+0000","last_unstale":"2024-05-10T08:40:21.735932+0000","last_undegraded":"2024-05-10T08:40:21.735932+0000","last_fullsized":"2024-05-10T08:40:21.735932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792701+0000","last_change":"2024-05-10T08:40:14.715445+0000","last_active":"2024-05-10T08:40:21.792701+0000","last_peered":"2024-05-10T08:40:21.792701+0000","last_clean":"2024-05-10T08:40:21.792701+0000","last_became_active":"2024-05-10T08:40:14.715170+0000","last_became_peered":"2024-05-10T08:40:14.715170+0000","last_unstale":"2024-05-10T08:40:21.792701+0000","last_undegraded":"2024-05-10T08:40:21.792701+0000","last_fullsized":"2024-05-10T08:40:21.792701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792391+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:40:21.792391+0000","last_peered":"2024-05-10T08:40:21.792391+0000","last_clean":"2024-05-10T08:40:21.792391+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:40:21.792391+0000","last_undegraded":"2024-05-10T08:40:21.792391+0000","last_fullsized":"2024-05-10T08:40:21.792391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793767+0000","last_change":"2024-05-10T08:40:20.252336+0000","last_active":"2024-05-10T08:40:21.793767+0000","last_peered":"2024-05-10T08:40:21.793767+0000","last_clean":"2024-05-10T08:40:21.793767+0000","last_became_active":"2024-05-10T08:40:20.251817+0000","last_became_peered":"2024-05-10T08:40:20.251817+0000","last_unstale":"2024-05-10T08:40:21.793767+0000","last_undegraded":"2024-05-10T08:40:21.793767+0000","last_fullsized":"2024-05-10T08:40:21.793767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.995777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794293+0000","last_change":"2024-05-10T08:40:15.727310+0000","last_active":"2024-05-10T08:40:21.794293+0000","last_peered":"2024-05-10T08:40:21.794293+0000","last_clean":"2024-05-10T08:40:21.794293+0000","last_became_active":"2024-05-10T08:40:15.727030+0000","last_became_peered":"2024-05-10T08:40:15.727030+0000","last_unstale":"2024-05-10T08:40:21.794293+0000","last_undegraded":"2024-05-10T08:40:21.794293+0000","last_fullsized":"2024-05-10T08:40:21.794293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791837+0000","last_change":"2024-05-10T08:40:14.715295+0000","last_active":"2024-05-10T08:40:21.791837+0000","last_peered":"2024-05-10T08:40:21.791837+0000","last_clean":"2024-05-10T08:40:21.791837+0000","last_became_active":"2024-05-10T08:40:14.715006+0000","last_became_peered":"2024-05-10T08:40:14.715006+0000","last_unstale":"2024-05-10T08:40:21.791837+0000","last_undegraded":"2024-05-10T08:40:21.791837+0000","last_fullsized":"2024-05-10T08:40:21.791837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793015+0000","last_change":"2024-05-10T08:40:20.251128+0000","last_active":"2024-05-10T08:40:21.793015+0000","last_peered":"2024-05-10T08:40:21.793015+0000","last_clean":"2024-05-10T08:40:21.793015+0000","last_became_active":"2024-05-10T08:40:20.249896+0000","last_became_peered":"2024-05-10T08:40:20.249896+0000","last_unstale":"2024-05-10T08:40:21.793015+0000","last_undegraded":"2024-05-10T08:40:21.793015+0000","last_fullsized":"2024-05-10T08:40:21.793015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792798+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792798+0000","last_peered":"2024-05-10T08:40:21.792798+0000","last_clean":"2024-05-10T08:40:21.792798+0000","last_became_active":"2024-05-10T08:40:15.737918+0000","last_became_peered":"2024-05-10T08:40:15.737918+0000","last_unstale":"2024-05-10T08:40:21.792798+0000","last_undegraded":"2024-05-10T08:40:21.792798+0000","last_fullsized":"2024-05-10T08:40:21.792798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:52.970415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736170+0000","last_change":"2024-05-10T08:40:14.709667+0000","last_active":"2024-05-10T08:40:21.736170+0000","last_peered":"2024-05-10T08:40:21.736170+0000","last_clean":"2024-05-10T08:40:21.736170+0000","last_became_active":"2024-05-10T08:40:14.709290+0000","last_became_peered":"2024-05-10T08:40:14.709290+0000","last_unstale":"2024-05-10T08:40:21.736170+0000","last_undegraded":"2024-05-10T08:40:21.736170+0000","last_fullsized":"2024-05-10T08:40:21.736170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:46.378493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792343+0000","last_change":"2024-05-10T08:40:19.766100+0000","last_active":"2024-05-10T08:40:21.792343+0000","last_peered":"2024-05-10T08:40:21.792343+0000","last_clean":"2024-05-10T08:40:21.792343+0000","last_became_active":"2024-05-10T08:40:19.765485+0000","last_became_peered":"2024-05-10T08:40:19.765485+0000","last_unstale":"2024-05-10T08:40:21.792343+0000","last_undegraded":"2024-05-10T08:40:21.792343+0000","last_fullsized":"2024-05-10T08:40:21.792343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:50.445160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794462+0000","last_change":"2024-05-10T08:40:15.723306+0000","last_active":"2024-05-10T08:40:21.794462+0000","last_peered":"2024-05-10T08:40:21.794462+0000","last_clean":"2024-05-10T08:40:21.794462+0000","last_became_active":"2024-05-10T08:40:15.720173+0000","last_became_peered":"2024-05-10T08:40:15.720173+0000","last_unstale":"2024-05-10T08:40:21.794462+0000","last_undegraded":"2024-05-10T08:40:21.794462+0000","last_fullsized":"2024-05-10T08:40:21.794462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:36.488692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792415+0000","last_change":"2024-05-10T08:40:14.711881+0000","last_active":"2024-05-10T08:40:21.792415+0000","last_peered":"2024-05-10T08:40:21.792415+0000","last_clean":"2024-05-10T08:40:21.792415+0000","last_became_active":"2024-05-10T08:40:14.711578+0000","last_became_peered":"2024-05-10T08:40:14.711578+0000","last_unstale":"2024-05-10T08:40:21.792415+0000","last_undegraded":"2024-05-10T08:40:21.792415+0000","last_fullsized":"2024-05-10T08:40:21.792415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792212+0000","last_change":"2024-05-10T08:40:20.252617+0000","last_active":"2024-05-10T08:40:21.792212+0000","last_peered":"2024-05-10T08:40:21.792212+0000","last_clean":"2024-05-10T08:40:21.792212+0000","last_became_active":"2024-05-10T08:40:20.252213+0000","last_became_peered":"2024-05-10T08:40:20.252213+0000","last_unstale":"2024-05-10T08:40:21.792212+0000","last_undegraded":"2024-05-10T08:40:21.792212+0000","last_fullsized":"2024-05-10T08:40:21.792212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:24:26.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793833+0000","last_change":"2024-05-10T08:40:15.719378+0000","last_active":"2024-05-10T08:40:21.793833+0000","last_peered":"2024-05-10T08:40:21.793833+0000","last_clean":"2024-05-10T08:40:21.793833+0000","last_became_active":"2024-05-10T08:40:15.718906+0000","last_became_peered":"2024-05-10T08:40:15.718906+0000","last_unstale":"2024-05-10T08:40:21.793833+0000","last_undegraded":"2024-05-10T08:40:21.793833+0000","last_fullsized":"2024-05-10T08:40:21.793833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736956+0000","last_change":"2024-05-10T08:40:14.717865+0000","last_active":"2024-05-10T08:40:21.736956+0000","last_peered":"2024-05-10T08:40:21.736956+0000","last_clean":"2024-05-10T08:40:21.736956+0000","last_became_active":"2024-05-10T08:40:14.717601+0000","last_became_peered":"2024-05-10T08:40:14.717601+0000","last_unstale":"2024-05-10T08:40:21.736956+0000","last_undegraded":"2024-05-10T08:40:21.736956+0000","last_fullsized":"2024-05-10T08:40:21.736956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:55.833310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736067+0000","last_change":"2024-05-10T08:40:19.752756+0000","last_active":"2024-05-10T08:40:21.736067+0000","last_peered":"2024-05-10T08:40:21.736067+0000","last_clean":"2024-05-10T08:40:21.736067+0000","last_became_active":"2024-05-10T08:40:19.751028+0000","last_became_peered":"2024-05-10T08:40:19.751028+0000","last_unstale":"2024-05-10T08:40:21.736067+0000","last_undegraded":"2024-05-10T08:40:21.736067+0000","last_fullsized":"2024-05-10T08:40:21.736067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:05.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792686+0000","last_change":"2024-05-10T08:40:15.716663+0000","last_active":"2024-05-10T08:40:21.792686+0000","last_peered":"2024-05-10T08:40:21.792686+0000","last_clean":"2024-05-10T08:40:21.792686+0000","last_became_active":"2024-05-10T08:40:15.715575+0000","last_became_peered":"2024-05-10T08:40:15.715575+0000","last_unstale":"2024-05-10T08:40:21.792686+0000","last_undegraded":"2024-05-10T08:40:21.792686+0000","last_fullsized":"2024-05-10T08:40:21.792686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791328+0000","last_change":"2024-05-10T08:40:14.717681+0000","last_active":"2024-05-10T08:40:21.791328+0000","last_peered":"2024-05-10T08:40:21.791328+0000","last_clean":"2024-05-10T08:40:21.791328+0000","last_became_active":"2024-05-10T08:40:14.717306+0000","last_became_peered":"2024-05-10T08:40:14.717306+0000","last_unstale":"2024-05-10T08:40:21.791328+0000","last_undegraded":"2024-05-10T08:40:21.791328+0000","last_fullsized":"2024-05-10T08:40:21.791328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791819+0000","last_change":"2024-05-10T08:40:19.762550+0000","last_active":"2024-05-10T08:40:21.791819+0000","last_peered":"2024-05-10T08:40:21.791819+0000","last_clean":"2024-05-10T08:40:21.791819+0000","last_became_active":"2024-05-10T08:40:19.762116+0000","last_became_peered":"2024-05-10T08:40:19.762116+0000","last_unstale":"2024-05-10T08:40:21.791819+0000","last_undegraded":"2024-05-10T08:40:21.791819+0000","last_fullsized":"2024-05-10T08:40:21.791819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:46.365303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792755+0000","last_change":"2024-05-10T08:40:15.723458+0000","last_active":"2024-05-10T08:40:21.792755+0000","last_peered":"2024-05-10T08:40:21.792755+0000","last_clean":"2024-05-10T08:40:21.792755+0000","last_became_active":"2024-05-10T08:40:15.722820+0000","last_became_peered":"2024-05-10T08:40:15.722820+0000","last_unstale":"2024-05-10T08:40:21.792755+0000","last_undegraded":"2024-05-10T08:40:21.792755+0000","last_fullsized":"2024-05-10T08:40:21.792755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793086+0000","last_change":"2024-05-10T08:40:14.715478+0000","last_active":"2024-05-10T08:40:21.793086+0000","last_peered":"2024-05-10T08:40:21.793086+0000","last_clean":"2024-05-10T08:40:21.793086+0000","last_became_active":"2024-05-10T08:40:14.715204+0000","last_became_peered":"2024-05-10T08:40:14.715204+0000","last_unstale":"2024-05-10T08:40:21.793086+0000","last_undegraded":"2024-05-10T08:40:21.793086+0000","last_fullsized":"2024-05-10T08:40:21.793086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737185+0000","last_change":"2024-05-10T08:40:20.251710+0000","last_active":"2024-05-10T08:40:21.737185+0000","last_peered":"2024-05-10T08:40:21.737185+0000","last_clean":"2024-05-10T08:40:21.737185+0000","last_became_active":"2024-05-10T08:40:20.251322+0000","last_became_peered":"2024-05-10T08:40:20.251322+0000","last_unstale":"2024-05-10T08:40:21.737185+0000","last_undegraded":"2024-05-10T08:40:21.737185+0000","last_fullsized":"2024-05-10T08:40:21.737185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:52.128436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794087+0000","last_change":"2024-05-10T08:40:15.719208+0000","last_active":"2024-05-10T08:40:21.794087+0000","last_peered":"2024-05-10T08:40:21.794087+0000","last_clean":"2024-05-10T08:40:21.794087+0000","last_became_active":"2024-05-10T08:40:15.718750+0000","last_became_peered":"2024-05-10T08:40:15.718750+0000","last_unstale":"2024-05-10T08:40:21.794087+0000","last_undegraded":"2024-05-10T08:40:21.794087+0000","last_fullsized":"2024-05-10T08:40:21.794087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793271+0000","last_change":"2024-05-10T08:40:14.721820+0000","last_active":"2024-05-10T08:40:21.793271+0000","last_peered":"2024-05-10T08:40:21.793271+0000","last_clean":"2024-05-10T08:40:21.793271+0000","last_became_active":"2024-05-10T08:40:14.721098+0000","last_became_peered":"2024-05-10T08:40:14.721098+0000","last_unstale":"2024-05-10T08:40:21.793271+0000","last_undegraded":"2024-05-10T08:40:21.793271+0000","last_fullsized":"2024-05-10T08:40:21.793271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:33.326113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736113+0000","last_change":"2024-05-10T08:40:20.250336+0000","last_active":"2024-05-10T08:40:21.736113+0000","last_peered":"2024-05-10T08:40:21.736113+0000","last_clean":"2024-05-10T08:40:21.736113+0000","last_became_active":"2024-05-10T08:40:20.249910+0000","last_became_peered":"2024-05-10T08:40:20.249910+0000","last_unstale":"2024-05-10T08:40:21.736113+0000","last_undegraded":"2024-05-10T08:40:21.736113+0000","last_fullsized":"2024-05-10T08:40:21.736113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:58.918102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792248+0000","last_change":"2024-05-10T08:40:15.730912+0000","last_active":"2024-05-10T08:40:21.792248+0000","last_peered":"2024-05-10T08:40:21.792248+0000","last_clean":"2024-05-10T08:40:21.792248+0000","last_became_active":"2024-05-10T08:40:15.730664+0000","last_became_peered":"2024-05-10T08:40:15.730664+0000","last_unstale":"2024-05-10T08:40:21.792248+0000","last_undegraded":"2024-05-10T08:40:21.792248+0000","last_fullsized":"2024-05-10T08:40:21.792248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792437+0000","last_change":"2024-05-10T08:40:14.719958+0000","last_active":"2024-05-10T08:40:21.792437+0000","last_peered":"2024-05-10T08:40:21.792437+0000","last_clean":"2024-05-10T08:40:21.792437+0000","last_became_active":"2024-05-10T08:40:14.719527+0000","last_became_peered":"2024-05-10T08:40:14.719527+0000","last_unstale":"2024-05-10T08:40:21.792437+0000","last_undegraded":"2024-05-10T08:40:21.792437+0000","last_fullsized":"2024-05-10T08:40:21.792437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:39.671884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793250+0000","last_change":"2024-05-10T08:40:20.250393+0000","last_active":"2024-05-10T08:40:21.793250+0000","last_peered":"2024-05-10T08:40:21.793250+0000","last_clean":"2024-05-10T08:40:21.793250+0000","last_became_active":"2024-05-10T08:40:20.249931+0000","last_became_peered":"2024-05-10T08:40:20.249931+0000","last_unstale":"2024-05-10T08:40:21.793250+0000","last_undegraded":"2024-05-10T08:40:21.793250+0000","last_fullsized":"2024-05-10T08:40:21.793250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:02:14.112934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794216+0000","last_change":"2024-05-10T08:40:15.723825+0000","last_active":"2024-05-10T08:40:21.794216+0000","last_peered":"2024-05-10T08:40:21.794216+0000","last_clean":"2024-05-10T08:40:21.794216+0000","last_became_active":"2024-05-10T08:40:15.723549+0000","last_became_peered":"2024-05-10T08:40:15.723549+0000","last_unstale":"2024-05-10T08:40:21.794216+0000","last_undegraded":"2024-05-10T08:40:21.794216+0000","last_fullsized":"2024-05-10T08:40:21.794216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:01.362438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:25.527408+0000","last_change":"2024-05-10T08:40:14.721803+0000","last_active":"2024-05-10T08:40:25.527408+0000","last_peered":"2024-05-10T08:40:25.527408+0000","last_clean":"2024-05-10T08:40:25.527408+0000","last_became_active":"2024-05-10T08:40:14.721510+0000","last_became_peered":"2024-05-10T08:40:14.721510+0000","last_unstale":"2024-05-10T08:40:25.527408+0000","last_undegraded":"2024-05-10T08:40:25.527408+0000","last_fullsized":"2024-05-10T08:40:25.527408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:26.766736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735875+0000","last_change":"2024-05-10T08:40:19.758340+0000","last_active":"2024-05-10T08:40:21.735875+0000","last_peered":"2024-05-10T08:40:21.735875+0000","last_clean":"2024-05-10T08:40:21.735875+0000","last_became_active":"2024-05-10T08:40:19.757420+0000","last_became_peered":"2024-05-10T08:40:19.757420+0000","last_unstale":"2024-05-10T08:40:21.735875+0000","last_undegraded":"2024-05-10T08:40:21.735875+0000","last_fullsized":"2024-05-10T08:40:21.735875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:06.007165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736978+0000","last_change":"2024-05-10T08:40:15.722046+0000","last_active":"2024-05-10T08:40:21.736978+0000","last_peered":"2024-05-10T08:40:21.736978+0000","last_clean":"2024-05-10T08:40:21.736978+0000","last_became_active":"2024-05-10T08:40:15.721780+0000","last_became_peered":"2024-05-10T08:40:15.721780+0000","last_unstale":"2024-05-10T08:40:21.736978+0000","last_undegraded":"2024-05-10T08:40:21.736978+0000","last_fullsized":"2024-05-10T08:40:21.736978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736056+0000","last_change":"2024-05-10T08:40:14.715667+0000","last_active":"2024-05-10T08:40:21.736056+0000","last_peered":"2024-05-10T08:40:21.736056+0000","last_clean":"2024-05-10T08:40:21.736056+0000","last_became_active":"2024-05-10T08:40:14.715389+0000","last_became_peered":"2024-05-10T08:40:14.715389+0000","last_unstale":"2024-05-10T08:40:21.736056+0000","last_undegraded":"2024-05-10T08:40:21.736056+0000","last_fullsized":"2024-05-10T08:40:21.736056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:57.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736950+0000","last_change":"2024-05-10T08:40:19.752944+0000","last_active":"2024-05-10T08:40:21.736950+0000","last_peered":"2024-05-10T08:40:21.736950+0000","last_clean":"2024-05-10T08:40:21.736950+0000","last_became_active":"2024-05-10T08:40:19.750307+0000","last_became_peered":"2024-05-10T08:40:19.750307+0000","last_unstale":"2024-05-10T08:40:21.736950+0000","last_undegraded":"2024-05-10T08:40:21.736950+0000","last_fullsized":"2024-05-10T08:40:21.736950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:40.514054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792136+0000","last_change":"2024-05-10T08:40:15.728526+0000","last_active":"2024-05-10T08:40:21.792136+0000","last_peered":"2024-05-10T08:40:21.792136+0000","last_clean":"2024-05-10T08:40:21.792136+0000","last_became_active":"2024-05-10T08:40:15.727954+0000","last_became_peered":"2024-05-10T08:40:15.727954+0000","last_unstale":"2024-05-10T08:40:21.792136+0000","last_undegraded":"2024-05-10T08:40:21.792136+0000","last_fullsized":"2024-05-10T08:40:21.792136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793153+0000","last_change":"2024-05-10T08:40:14.713649+0000","last_active":"2024-05-10T08:40:21.793153+0000","last_peered":"2024-05-10T08:40:21.793153+0000","last_clean":"2024-05-10T08:40:21.793153+0000","last_became_active":"2024-05-10T08:40:14.713343+0000","last_became_peered":"2024-05-10T08:40:14.713343+0000","last_unstale":"2024-05-10T08:40:21.793153+0000","last_undegraded":"2024-05-10T08:40:21.793153+0000","last_fullsized":"2024-05-10T08:40:21.793153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736758+0000","last_change":"2024-05-10T08:40:19.759670+0000","last_active":"2024-05-10T08:40:21.736758+0000","last_peered":"2024-05-10T08:40:21.736758+0000","last_clean":"2024-05-10T08:40:21.736758+0000","last_became_active":"2024-05-10T08:40:19.756600+0000","last_became_peered":"2024-05-10T08:40:19.756600+0000","last_unstale":"2024-05-10T08:40:21.736758+0000","last_undegraded":"2024-05-10T08:40:21.736758+0000","last_fullsized":"2024-05-10T08:40:21.736758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.094481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793080+0000","last_change":"2024-05-10T08:40:15.721196+0000","last_active":"2024-05-10T08:40:21.793080+0000","last_peered":"2024-05-10T08:40:21.793080+0000","last_clean":"2024-05-10T08:40:21.793080+0000","last_became_active":"2024-05-10T08:40:15.720932+0000","last_became_peered":"2024-05-10T08:40:15.720932+0000","last_unstale":"2024-05-10T08:40:21.793080+0000","last_undegraded":"2024-05-10T08:40:21.793080+0000","last_fullsized":"2024-05-10T08:40:21.793080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.833405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794024+0000","last_change":"2024-05-10T08:40:14.717072+0000","last_active":"2024-05-10T08:40:21.794024+0000","last_peered":"2024-05-10T08:40:21.794024+0000","last_clean":"2024-05-10T08:40:21.794024+0000","last_became_active":"2024-05-10T08:40:14.716685+0000","last_became_peered":"2024-05-10T08:40:14.716685+0000","last_unstale":"2024-05-10T08:40:21.794024+0000","last_undegraded":"2024-05-10T08:40:21.794024+0000","last_fullsized":"2024-05-10T08:40:21.794024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737170+0000","last_change":"2024-05-10T08:40:20.251795+0000","last_active":"2024-05-10T08:40:21.737170+0000","last_peered":"2024-05-10T08:40:21.737170+0000","last_clean":"2024-05-10T08:40:21.737170+0000","last_became_active":"2024-05-10T08:40:20.251422+0000","last_became_peered":"2024-05-10T08:40:20.251422+0000","last_unstale":"2024-05-10T08:40:21.737170+0000","last_undegraded":"2024-05-10T08:40:21.737170+0000","last_fullsized":"2024-05-10T08:40:21.737170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:58.035145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791821+0000","last_change":"2024-05-10T08:40:20.251855+0000","last_active":"2024-05-10T08:40:21.791821+0000","last_peered":"2024-05-10T08:40:21.791821+0000","last_clean":"2024-05-10T08:40:21.791821+0000","last_became_active":"2024-05-10T08:40:20.251483+0000","last_became_peered":"2024-05-10T08:40:20.251483+0000","last_unstale":"2024-05-10T08:40:21.791821+0000","last_undegraded":"2024-05-10T08:40:21.791821+0000","last_fullsized":"2024-05-10T08:40:21.791821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:37.362715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735406+0000","last_change":"2024-05-10T08:40:15.733791+0000","last_active":"2024-05-10T08:40:21.735406+0000","last_peered":"2024-05-10T08:40:21.735406+0000","last_clean":"2024-05-10T08:40:21.735406+0000","last_became_active":"2024-05-10T08:40:15.733357+0000","last_became_peered":"2024-05-10T08:40:15.733357+0000","last_unstale":"2024-05-10T08:40:21.735406+0000","last_undegraded":"2024-05-10T08:40:21.735406+0000","last_fullsized":"2024-05-10T08:40:21.735406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792355+0000","last_change":"2024-05-10T08:40:14.713288+0000","last_active":"2024-05-10T08:40:21.792355+0000","last_peered":"2024-05-10T08:40:21.792355+0000","last_clean":"2024-05-10T08:40:21.792355+0000","last_became_active":"2024-05-10T08:40:14.713009+0000","last_became_peered":"2024-05-10T08:40:14.713009+0000","last_unstale":"2024-05-10T08:40:21.792355+0000","last_undegraded":"2024-05-10T08:40:21.792355+0000","last_fullsized":"2024-05-10T08:40:21.792355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:55.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793990+0000","last_change":"2024-05-10T08:40:19.758631+0000","last_active":"2024-05-10T08:40:21.793990+0000","last_peered":"2024-05-10T08:40:21.793990+0000","last_clean":"2024-05-10T08:40:21.793990+0000","last_became_active":"2024-05-10T08:40:19.758133+0000","last_became_peered":"2024-05-10T08:40:19.758133+0000","last_unstale":"2024-05-10T08:40:21.793990+0000","last_undegraded":"2024-05-10T08:40:21.793990+0000","last_fullsized":"2024-05-10T08:40:21.793990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:18.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736724+0000","last_change":"2024-05-10T08:40:15.733269+0000","last_active":"2024-05-10T08:40:21.736724+0000","last_peered":"2024-05-10T08:40:21.736724+0000","last_clean":"2024-05-10T08:40:21.736724+0000","last_became_active":"2024-05-10T08:40:15.732928+0000","last_became_peered":"2024-05-10T08:40:15.732928+0000","last_unstale":"2024-05-10T08:40:21.736724+0000","last_undegraded":"2024-05-10T08:40:21.736724+0000","last_fullsized":"2024-05-10T08:40:21.736724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737390+0000","last_change":"2024-05-10T08:40:14.716035+0000","last_active":"2024-05-10T08:40:21.737390+0000","last_peered":"2024-05-10T08:40:21.737390+0000","last_clean":"2024-05-10T08:40:21.737390+0000","last_became_active":"2024-05-10T08:40:14.715525+0000","last_became_peered":"2024-05-10T08:40:14.715525+0000","last_unstale":"2024-05-10T08:40:21.737390+0000","last_undegraded":"2024-05-10T08:40:21.737390+0000","last_fullsized":"2024-05-10T08:40:21.737390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:32.396548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793415+0000","last_change":"2024-05-10T08:40:14.716190+0000","last_active":"2024-05-10T08:40:21.793415+0000","last_peered":"2024-05-10T08:40:21.793415+0000","last_clean":"2024-05-10T08:40:21.793415+0000","last_became_active":"2024-05-10T08:40:14.715910+0000","last_became_peered":"2024-05-10T08:40:14.715910+0000","last_unstale":"2024-05-10T08:40:21.793415+0000","last_undegraded":"2024-05-10T08:40:21.793415+0000","last_fullsized":"2024-05-10T08:40:21.793415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:11:59.861484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792400+0000","last_change":"2024-05-10T08:40:15.721466+0000","last_active":"2024-05-10T08:40:21.792400+0000","last_peered":"2024-05-10T08:40:21.792400+0000","last_clean":"2024-05-10T08:40:21.792400+0000","last_became_active":"2024-05-10T08:40:15.721200+0000","last_became_peered":"2024-05-10T08:40:15.721200+0000","last_unstale":"2024-05-10T08:40:21.792400+0000","last_undegraded":"2024-05-10T08:40:21.792400+0000","last_fullsized":"2024-05-10T08:40:21.792400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791730+0000","last_change":"2024-05-10T08:40:19.755853+0000","last_active":"2024-05-10T08:40:21.791730+0000","last_peered":"2024-05-10T08:40:21.791730+0000","last_clean":"2024-05-10T08:40:21.791730+0000","last_became_active":"2024-05-10T08:40:19.755406+0000","last_became_peered":"2024-05-10T08:40:19.755406+0000","last_unstale":"2024-05-10T08:40:21.791730+0000","last_undegraded":"2024-05-10T08:40:21.791730+0000","last_fullsized":"2024-05-10T08:40:21.791730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:12.946445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736391+0000","last_change":"2024-05-10T08:40:14.720438+0000","last_active":"2024-05-10T08:40:21.736391+0000","last_peered":"2024-05-10T08:40:21.736391+0000","last_clean":"2024-05-10T08:40:21.736391+0000","last_became_active":"2024-05-10T08:40:14.720127+0000","last_became_peered":"2024-05-10T08:40:14.720127+0000","last_unstale":"2024-05-10T08:40:21.736391+0000","last_undegraded":"2024-05-10T08:40:21.736391+0000","last_fullsized":"2024-05-10T08:40:21.736391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:13.684271+0000","last_clean_scrub_stamp":"2024-05-10T08:40:13.684271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:39:03.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736427+0000","last_change":"2024-05-10T08:40:15.707932+0000","last_active":"2024-05-10T08:40:21.736427+0000","last_peered":"2024-05-10T08:40:21.736427+0000","last_clean":"2024-05-10T08:40:21.736427+0000","last_became_active":"2024-05-10T08:40:15.707646+0000","last_became_peered":"2024-05-10T08:40:15.707646+0000","last_unstale":"2024-05-10T08:40:21.736427+0000","last_undegraded":"2024-05-10T08:40:21.736427+0000","last_fullsized":"2024-05-10T08:40:21.736427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:15:56.956134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736748+0000","last_change":"2024-05-10T08:40:19.751262+0000","last_active":"2024-05-10T08:40:21.736748+0000","last_peered":"2024-05-10T08:40:21.736748+0000","last_clean":"2024-05-10T08:40:21.736748+0000","last_became_active":"2024-05-10T08:40:19.750835+0000","last_became_peered":"2024-05-10T08:40:19.750835+0000","last_unstale":"2024-05-10T08:40:21.736748+0000","last_undegraded":"2024-05-10T08:40:21.736748+0000","last_fullsized":"2024-05-10T08:40:21.736748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:18.718075+0000","last_clean_scrub_stamp":"2024-05-10T08:40:18.718075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:37.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792880+0000","last_change":"2024-05-10T08:40:15.726263+0000","last_active":"2024-05-10T08:40:21.792880+0000","last_peered":"2024-05-10T08:40:21.792880+0000","last_clean":"2024-05-10T08:40:21.792880+0000","last_became_active":"2024-05-10T08:40:15.725796+0000","last_became_peered":"2024-05-10T08:40:15.725796+0000","last_unstale":"2024-05-10T08:40:21.792880+0000","last_undegraded":"2024-05-10T08:40:21.792880+0000","last_fullsized":"2024-05-10T08:40:21.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791487+0000","last_change":"2024-05-10T08:40:15.722103+0000","last_active":"2024-05-10T08:40:21.791487+0000","last_peered":"2024-05-10T08:40:21.791487+0000","last_clean":"2024-05-10T08:40:21.791487+0000","last_became_active":"2024-05-10T08:40:15.721824+0000","last_became_peered":"2024-05-10T08:40:15.721824+0000","last_unstale":"2024-05-10T08:40:21.791487+0000","last_undegraded":"2024-05-10T08:40:21.791487+0000","last_fullsized":"2024-05-10T08:40:21.791487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:22.798503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793168+0000","last_change":"2024-05-10T08:40:15.730264+0000","last_active":"2024-05-10T08:40:21.793168+0000","last_peered":"2024-05-10T08:40:21.793168+0000","last_clean":"2024-05-10T08:40:21.793168+0000","last_became_active":"2024-05-10T08:40:15.729988+0000","last_became_peered":"2024-05-10T08:40:15.729988+0000","last_unstale":"2024-05-10T08:40:21.793168+0000","last_undegraded":"2024-05-10T08:40:21.793168+0000","last_fullsized":"2024-05-10T08:40:21.793168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:14.625077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792351+0000","last_change":"2024-05-10T08:40:15.722004+0000","last_active":"2024-05-10T08:40:21.792351+0000","last_peered":"2024-05-10T08:40:21.792351+0000","last_clean":"2024-05-10T08:40:21.792351+0000","last_became_active":"2024-05-10T08:40:15.721735+0000","last_became_peered":"2024-05-10T08:40:15.721735+0000","last_unstale":"2024-05-10T08:40:21.792351+0000","last_undegraded":"2024-05-10T08:40:21.792351+0000","last_fullsized":"2024-05-10T08:40:21.792351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736384+0000","last_change":"2024-05-10T08:40:15.733681+0000","last_active":"2024-05-10T08:40:21.736384+0000","last_peered":"2024-05-10T08:40:21.736384+0000","last_clean":"2024-05-10T08:40:21.736384+0000","last_became_active":"2024-05-10T08:40:15.730232+0000","last_became_peered":"2024-05-10T08:40:15.730232+0000","last_unstale":"2024-05-10T08:40:21.736384+0000","last_undegraded":"2024-05-10T08:40:21.736384+0000","last_fullsized":"2024-05-10T08:40:21.736384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:54.788836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735862+0000","last_change":"2024-05-10T08:40:15.721502+0000","last_active":"2024-05-10T08:40:21.735862+0000","last_peered":"2024-05-10T08:40:21.735862+0000","last_clean":"2024-05-10T08:40:21.735862+0000","last_became_active":"2024-05-10T08:40:15.721196+0000","last_became_peered":"2024-05-10T08:40:15.721196+0000","last_unstale":"2024-05-10T08:40:21.735862+0000","last_undegraded":"2024-05-10T08:40:21.735862+0000","last_fullsized":"2024-05-10T08:40:21.735862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794000+0000","last_change":"2024-05-10T08:40:15.719934+0000","last_active":"2024-05-10T08:40:21.794000+0000","last_peered":"2024-05-10T08:40:21.794000+0000","last_clean":"2024-05-10T08:40:21.794000+0000","last_became_active":"2024-05-10T08:40:15.719673+0000","last_became_peered":"2024-05-10T08:40:15.719673+0000","last_unstale":"2024-05-10T08:40:21.794000+0000","last_undegraded":"2024-05-10T08:40:21.794000+0000","last_fullsized":"2024-05-10T08:40:21.794000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737224+0000","last_change":"2024-05-10T08:40:15.727721+0000","last_active":"2024-05-10T08:40:21.737224+0000","last_peered":"2024-05-10T08:40:21.737224+0000","last_clean":"2024-05-10T08:40:21.737224+0000","last_became_active":"2024-05-10T08:40:15.726438+0000","last_became_peered":"2024-05-10T08:40:15.726438+0000","last_unstale":"2024-05-10T08:40:21.737224+0000","last_undegraded":"2024-05-10T08:40:21.737224+0000","last_fullsized":"2024-05-10T08:40:21.737224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792352+0000","last_change":"2024-05-10T08:40:15.730586+0000","last_active":"2024-05-10T08:40:21.792352+0000","last_peered":"2024-05-10T08:40:21.792352+0000","last_clean":"2024-05-10T08:40:21.792352+0000","last_became_active":"2024-05-10T08:40:15.730214+0000","last_became_peered":"2024-05-10T08:40:15.730214+0000","last_unstale":"2024-05-10T08:40:21.792352+0000","last_undegraded":"2024-05-10T08:40:21.792352+0000","last_fullsized":"2024-05-10T08:40:21.792352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.737367+0000","last_change":"2024-05-10T08:40:15.729639+0000","last_active":"2024-05-10T08:40:21.737367+0000","last_peered":"2024-05-10T08:40:21.737367+0000","last_clean":"2024-05-10T08:40:21.737367+0000","last_became_active":"2024-05-10T08:40:15.722616+0000","last_became_peered":"2024-05-10T08:40:15.722616+0000","last_unstale":"2024-05-10T08:40:21.737367+0000","last_undegraded":"2024-05-10T08:40:21.737367+0000","last_fullsized":"2024-05-10T08:40:21.737367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793084+0000","last_change":"2024-05-10T08:40:15.730859+0000","last_active":"2024-05-10T08:40:21.793084+0000","last_peered":"2024-05-10T08:40:21.793084+0000","last_clean":"2024-05-10T08:40:21.793084+0000","last_became_active":"2024-05-10T08:40:15.730568+0000","last_became_peered":"2024-05-10T08:40:15.730568+0000","last_unstale":"2024-05-10T08:40:21.793084+0000","last_undegraded":"2024-05-10T08:40:21.793084+0000","last_fullsized":"2024-05-10T08:40:21.793084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:48.637485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792243+0000","last_change":"2024-05-10T08:40:15.732254+0000","last_active":"2024-05-10T08:40:21.792243+0000","last_peered":"2024-05-10T08:40:21.792243+0000","last_clean":"2024-05-10T08:40:21.792243+0000","last_became_active":"2024-05-10T08:40:15.731908+0000","last_became_peered":"2024-05-10T08:40:15.731908+0000","last_unstale":"2024-05-10T08:40:21.792243+0000","last_undegraded":"2024-05-10T08:40:21.792243+0000","last_fullsized":"2024-05-10T08:40:21.792243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793673+0000","last_change":"2024-05-10T08:40:15.719640+0000","last_active":"2024-05-10T08:40:21.793673+0000","last_peered":"2024-05-10T08:40:21.793673+0000","last_clean":"2024-05-10T08:40:21.793673+0000","last_became_active":"2024-05-10T08:40:15.719365+0000","last_became_peered":"2024-05-10T08:40:15.719365+0000","last_unstale":"2024-05-10T08:40:21.793673+0000","last_undegraded":"2024-05-10T08:40:21.793673+0000","last_fullsized":"2024-05-10T08:40:21.793673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:13.730427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794444+0000","last_change":"2024-05-10T08:40:15.720838+0000","last_active":"2024-05-10T08:40:21.794444+0000","last_peered":"2024-05-10T08:40:21.794444+0000","last_clean":"2024-05-10T08:40:21.794444+0000","last_became_active":"2024-05-10T08:40:15.720001+0000","last_became_peered":"2024-05-10T08:40:15.720001+0000","last_unstale":"2024-05-10T08:40:21.794444+0000","last_undegraded":"2024-05-10T08:40:21.794444+0000","last_fullsized":"2024-05-10T08:40:21.794444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:33.337354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792361+0000","last_change":"2024-05-10T08:40:15.718557+0000","last_active":"2024-05-10T08:40:21.792361+0000","last_peered":"2024-05-10T08:40:21.792361+0000","last_clean":"2024-05-10T08:40:21.792361+0000","last_became_active":"2024-05-10T08:40:15.718245+0000","last_became_peered":"2024-05-10T08:40:15.718245+0000","last_unstale":"2024-05-10T08:40:21.792361+0000","last_undegraded":"2024-05-10T08:40:21.792361+0000","last_fullsized":"2024-05-10T08:40:21.792361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:58.260494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793531+0000","last_change":"2024-05-10T08:40:15.731367+0000","last_active":"2024-05-10T08:40:21.793531+0000","last_peered":"2024-05-10T08:40:21.793531+0000","last_clean":"2024-05-10T08:40:21.793531+0000","last_became_active":"2024-05-10T08:40:15.731074+0000","last_became_peered":"2024-05-10T08:40:15.731074+0000","last_unstale":"2024-05-10T08:40:21.793531+0000","last_undegraded":"2024-05-10T08:40:21.793531+0000","last_fullsized":"2024-05-10T08:40:21.793531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792246+0000","last_change":"2024-05-10T08:40:15.732380+0000","last_active":"2024-05-10T08:40:21.792246+0000","last_peered":"2024-05-10T08:40:21.792246+0000","last_clean":"2024-05-10T08:40:21.792246+0000","last_became_active":"2024-05-10T08:40:15.732090+0000","last_became_peered":"2024-05-10T08:40:15.732090+0000","last_unstale":"2024-05-10T08:40:21.792246+0000","last_undegraded":"2024-05-10T08:40:21.792246+0000","last_fullsized":"2024-05-10T08:40:21.792246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:28:53.919886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.735458+0000","last_change":"2024-05-10T08:40:15.710587+0000","last_active":"2024-05-10T08:40:21.735458+0000","last_peered":"2024-05-10T08:40:21.735458+0000","last_clean":"2024-05-10T08:40:21.735458+0000","last_became_active":"2024-05-10T08:40:15.710276+0000","last_became_peered":"2024-05-10T08:40:15.710276+0000","last_unstale":"2024-05-10T08:40:21.735458+0000","last_undegraded":"2024-05-10T08:40:21.735458+0000","last_fullsized":"2024-05-10T08:40:21.735458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792150+0000","last_change":"2024-05-10T08:40:15.725581+0000","last_active":"2024-05-10T08:40:21.792150+0000","last_peered":"2024-05-10T08:40:21.792150+0000","last_clean":"2024-05-10T08:40:21.792150+0000","last_became_active":"2024-05-10T08:40:15.725302+0000","last_became_peered":"2024-05-10T08:40:15.725302+0000","last_unstale":"2024-05-10T08:40:21.792150+0000","last_undegraded":"2024-05-10T08:40:21.792150+0000","last_fullsized":"2024-05-10T08:40:21.792150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:06:34.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736194+0000","last_change":"2024-05-10T08:40:15.719950+0000","last_active":"2024-05-10T08:40:21.736194+0000","last_peered":"2024-05-10T08:40:21.736194+0000","last_clean":"2024-05-10T08:40:21.736194+0000","last_became_active":"2024-05-10T08:40:15.719681+0000","last_became_peered":"2024-05-10T08:40:15.719681+0000","last_unstale":"2024-05-10T08:40:21.736194+0000","last_undegraded":"2024-05-10T08:40:21.736194+0000","last_fullsized":"2024-05-10T08:40:21.736194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736919+0000","last_change":"2024-05-10T08:40:15.716857+0000","last_active":"2024-05-10T08:40:21.736919+0000","last_peered":"2024-05-10T08:40:21.736919+0000","last_clean":"2024-05-10T08:40:21.736919+0000","last_became_active":"2024-05-10T08:40:15.716582+0000","last_became_peered":"2024-05-10T08:40:15.716582+0000","last_unstale":"2024-05-10T08:40:21.736919+0000","last_undegraded":"2024-05-10T08:40:21.736919+0000","last_fullsized":"2024-05-10T08:40:21.736919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:27.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793884+0000","last_change":"2024-05-10T08:40:15.728928+0000","last_active":"2024-05-10T08:40:21.793884+0000","last_peered":"2024-05-10T08:40:21.793884+0000","last_clean":"2024-05-10T08:40:21.793884+0000","last_became_active":"2024-05-10T08:40:15.728156+0000","last_became_peered":"2024-05-10T08:40:15.728156+0000","last_unstale":"2024-05-10T08:40:21.793884+0000","last_undegraded":"2024-05-10T08:40:21.793884+0000","last_fullsized":"2024-05-10T08:40:21.793884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:33.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793898+0000","last_change":"2024-05-10T08:40:15.722176+0000","last_active":"2024-05-10T08:40:21.793898+0000","last_peered":"2024-05-10T08:40:21.793898+0000","last_clean":"2024-05-10T08:40:21.793898+0000","last_became_active":"2024-05-10T08:40:15.721908+0000","last_became_peered":"2024-05-10T08:40:15.721908+0000","last_unstale":"2024-05-10T08:40:21.793898+0000","last_undegraded":"2024-05-10T08:40:21.793898+0000","last_fullsized":"2024-05-10T08:40:21.793898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794390+0000","last_change":"2024-05-10T08:40:15.725446+0000","last_active":"2024-05-10T08:40:21.794390+0000","last_peered":"2024-05-10T08:40:21.794390+0000","last_clean":"2024-05-10T08:40:21.794390+0000","last_became_active":"2024-05-10T08:40:15.725178+0000","last_became_peered":"2024-05-10T08:40:15.725178+0000","last_unstale":"2024-05-10T08:40:21.794390+0000","last_undegraded":"2024-05-10T08:40:21.794390+0000","last_fullsized":"2024-05-10T08:40:21.794390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:54.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736627+0000","last_change":"2024-05-10T08:40:15.730664+0000","last_active":"2024-05-10T08:40:21.736627+0000","last_peered":"2024-05-10T08:40:21.736627+0000","last_clean":"2024-05-10T08:40:21.736627+0000","last_became_active":"2024-05-10T08:40:15.729235+0000","last_became_peered":"2024-05-10T08:40:15.729235+0000","last_unstale":"2024-05-10T08:40:21.736627+0000","last_undegraded":"2024-05-10T08:40:21.736627+0000","last_fullsized":"2024-05-10T08:40:21.736627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:05.016071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792606+0000","last_change":"2024-05-10T08:40:15.727662+0000","last_active":"2024-05-10T08:40:21.792606+0000","last_peered":"2024-05-10T08:40:21.792606+0000","last_clean":"2024-05-10T08:40:21.792606+0000","last_became_active":"2024-05-10T08:40:15.727391+0000","last_became_peered":"2024-05-10T08:40:15.727391+0000","last_unstale":"2024-05-10T08:40:21.792606+0000","last_undegraded":"2024-05-10T08:40:21.792606+0000","last_fullsized":"2024-05-10T08:40:21.792606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793064+0000","last_change":"2024-05-10T08:40:15.726033+0000","last_active":"2024-05-10T08:40:21.793064+0000","last_peered":"2024-05-10T08:40:21.793064+0000","last_clean":"2024-05-10T08:40:21.793064+0000","last_became_active":"2024-05-10T08:40:15.725410+0000","last_became_peered":"2024-05-10T08:40:15.725410+0000","last_unstale":"2024-05-10T08:40:21.793064+0000","last_undegraded":"2024-05-10T08:40:21.793064+0000","last_fullsized":"2024-05-10T08:40:21.793064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:19.213399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.793970+0000","last_change":"2024-05-10T08:40:15.721088+0000","last_active":"2024-05-10T08:40:21.793970+0000","last_peered":"2024-05-10T08:40:21.793970+0000","last_clean":"2024-05-10T08:40:21.793970+0000","last_became_active":"2024-05-10T08:40:15.720831+0000","last_became_peered":"2024-05-10T08:40:15.720831+0000","last_unstale":"2024-05-10T08:40:21.793970+0000","last_undegraded":"2024-05-10T08:40:21.793970+0000","last_fullsized":"2024-05-10T08:40:21.793970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:07:43.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.792673+0000","last_change":"2024-05-10T08:40:15.738191+0000","last_active":"2024-05-10T08:40:21.792673+0000","last_peered":"2024-05-10T08:40:21.792673+0000","last_clean":"2024-05-10T08:40:21.792673+0000","last_became_active":"2024-05-10T08:40:15.737931+0000","last_became_peered":"2024-05-10T08:40:15.737931+0000","last_unstale":"2024-05-10T08:40:21.792673+0000","last_undegraded":"2024-05-10T08:40:21.792673+0000","last_fullsized":"2024-05-10T08:40:21.792673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:46.387160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.791744+0000","last_change":"2024-05-10T08:40:15.723463+0000","last_active":"2024-05-10T08:40:21.791744+0000","last_peered":"2024-05-10T08:40:21.791744+0000","last_clean":"2024-05-10T08:40:21.791744+0000","last_became_active":"2024-05-10T08:40:15.723178+0000","last_became_peered":"2024-05-10T08:40:15.723178+0000","last_unstale":"2024-05-10T08:40:21.791744+0000","last_undegraded":"2024-05-10T08:40:21.791744+0000","last_fullsized":"2024-05-10T08:40:21.791744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:12:48.869113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.736554+0000","last_change":"2024-05-10T08:40:15.724998+0000","last_active":"2024-05-10T08:40:21.736554+0000","last_peered":"2024-05-10T08:40:21.736554+0000","last_clean":"2024-05-10T08:40:21.736554+0000","last_became_active":"2024-05-10T08:40:15.724639+0000","last_became_peered":"2024-05-10T08:40:15.724639+0000","last_unstale":"2024-05-10T08:40:21.736554+0000","last_undegraded":"2024-05-10T08:40:21.736554+0000","last_fullsized":"2024-05-10T08:40:21.736554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:23.367500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T08:40:21.794309+0000","last_change":"2024-05-10T08:40:15.723566+0000","last_active":"2024-05-10T08:40:21.794309+0000","last_peered":"2024-05-10T08:40:21.794309+0000","last_clean":"2024-05-10T08:40:21.794309+0000","last_became_active":"2024-05-10T08:40:15.719857+0000","last_became_peered":"2024-05-10T08:40:15.719857+0000","last_unstale":"2024-05-10T08:40:21.794309+0000","last_undegraded":"2024-05-10T08:40:21.794309+0000","last_fullsized":"2024-05-10T08:40:21.794309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:14.692714+0000","last_clean_scrub_stamp":"2024-05-10T08:40:14.692714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:42.339941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":697957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":110849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":107007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:40:34.758 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:40:34.758 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T08:40:34.759 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T08:40:34.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T08:40:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.898+0000 7fcb1593f640 1 Processor -- start 2024-05-10T08:40:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.898+0000 7fcb1593f640 1 -- start start 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.898+0000 7fcb1593f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb100b2490 0x7fcb10070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.898+0000 7fcb1593f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.898+0000 7fcb1593f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb1006e110 con 0x7fcb101629b0 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.898+0000 7fcb1593f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcb1006dec0 con 0x7fcb100b2490 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.898+0000 7fcb1593f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1006e3f0 con 0x7fcb10070d20 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0e7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb100b2490 0x7fcb10070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0e7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb100b2490 0x7fcb10070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58190/0 (socket says 172.21.15.37:58190) 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb101629b0 0x7fcb1006eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41014/0 (socket says 172.21.15.37:41014) 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/1027958209 learned_addr learned my addr 172.21.15.37:0/1027958209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0f7fe640 1 --2- 172.21.15.37:0/1027958209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/1027958209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 msgr2=0x7fcb100711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0e7fc640 1 --2- 172.21.15.37:0/1027958209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/1027958209 >> v1:172.21.15.37:6789/0 conn(0x7fcb101629b0 legacy=0x7fcb1006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0dffb640 1 -- 172.21.15.37:0/1027958209 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284235646 0 0) 0x7fcb1006e110 con 0x7fcb101629b0 2024-05-10T08:40:34.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.899+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/1027958209 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1006e6d0 con 0x7fcb100b2490 2024-05-10T08:40:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb0e7fc640 1 --2- 172.21.15.37:0/1027958209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb10070330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009870 tx=0x7fcb0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0cd462986469fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb0dffb640 1 -- 172.21.15.37:0/1027958209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04037070 con 0x7fcb100b2490 2024-05-10T08:40:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb0dffb640 1 -- 172.21.15.37:0/1027958209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb04032440 con 0x7fcb100b2490 2024-05-10T08:40:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb0dffb640 1 -- 172.21.15.37:0/1027958209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04032810 con 0x7fcb100b2490 2024-05-10T08:40:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 -- 172.21.15.37:0/1027958209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 msgr2=0x7fcb10070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 --2- 172.21.15.37:0/1027958209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb10070330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009870 tx=0x7fcb0402a270 comp rx=0 tx=0).stop 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 -- 172.21.15.37:0/1027958209 shutdown_connections 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 --2- 172.21.15.37:0/1027958209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 --2- 172.21.15.37:0/1027958209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb10070330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 -- 172.21.15.37:0/1027958209 >> 172.21.15.37:0/1027958209 conn(0x7fcb100b49d0 msgr2=0x7fcb100b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 -- 172.21.15.37:0/1027958209 shutdown_connections 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.900+0000 7fcb1593f640 1 -- 172.21.15.37:0/1027958209 wait complete. 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.902+0000 7fcb1593f640 1 Processor -- start 2024-05-10T08:40:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.902+0000 7fcb1593f640 1 -- start start 2024-05-10T08:40:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb100d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb101629b0 0x7fcb100b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb100709f0 con 0x7fcb100b2490 2024-05-10T08:40:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10070870 con 0x7fcb101629b0 2024-05-10T08:40:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcb100afcb0 con 0x7fcb10070d20 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb100d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb100d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58206/0 (socket says 172.21.15.37:58206) 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/436505400 learned_addr learned my addr 172.21.15.37:0/436505400 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0effd640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0f7fe640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb101629b0 0x7fcb100b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 msgr2=0x7fcb100c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb101629b0 msgr2=0x7fcb100b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb101629b0 0x7fcb100b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 -- 172.21.15.37:0/436505400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb100c69c0 con 0x7fcb100b2490 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0f7fe640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb101629b0 0x7fcb100b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb0e7fc640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb100d0000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb040097c0 tx=0x7fcb040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcaf7fff640 1 -- 172.21.15.37:0/436505400 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04037040 con 0x7fcb100b2490 2024-05-10T08:40:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcaf7fff640 1 -- 172.21.15.37:0/436505400 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb04004030 con 0x7fcb100b2490 2024-05-10T08:40:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb100b8860 con 0x7fcb100b2490 2024-05-10T08:40:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcaf7fff640 1 -- 172.21.15.37:0/436505400 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb040043e0 con 0x7fcb100b2490 2024-05-10T08:40:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.903+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb100c6f40 con 0x7fcb100b2490 2024-05-10T08:40:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.905+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb100693f0 con 0x7fcb100b2490 2024-05-10T08:40:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.905+0000 7fcaf7fff640 1 -- 172.21.15.37:0/436505400 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcb0403a070 con 0x7fcb100b2490 2024-05-10T08:40:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.906+0000 7fcaf7fff640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcafc0762d0 0x7fcafc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.906+0000 7fcaf7fff640 1 -- 172.21.15.37:0/436505400 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcb040b7f30 con 0x7fcb100b2490 2024-05-10T08:40:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.906+0000 7fcb0effd640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcafc0762d0 0x7fcafc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.906+0000 7fcb0effd640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcafc0762d0 0x7fcafc078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb00007fd0 tx=0x7fcb00007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:34.910+0000 7fcaf7fff640 1 -- 172.21.15.37:0/436505400 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcb04041020 con 0x7fcb100b2490 2024-05-10T08:40:35.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.142+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcb1015f880 con 0x7fcb100b2490 2024-05-10T08:40:35.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.142+0000 7fcaf7fff640 1 -- 172.21.15.37:0/436505400 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcb04080e60 con 0x7fcb100b2490 2024-05-10T08:40:35.142 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:35.142 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T08:40:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcafc0762d0 msgr2=0x7fcafc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcafc0762d0 0x7fcafc078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb00007fd0 tx=0x7fcb00007de0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 msgr2=0x7fcb100d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb100d0000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb040097c0 tx=0x7fcb040046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 shutdown_connections 2024-05-10T08:40:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcafc0762d0 0x7fcafc078790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb101629b0 0x7fcb100b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100b2490 0x7fcb100d0000 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 --2- 172.21.15.37:0/436505400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcb10070d20 0x7fcb100c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 >> 172.21.15.37:0/436505400 conn(0x7fcb100b49d0 msgr2=0x7fcb10161840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 shutdown_connections 2024-05-10T08:40:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.144+0000 7fcb1593f640 1 -- 172.21.15.37:0/436505400 wait complete. 2024-05-10T08:40:35.155 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T08:40:35.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.259+0000 7f850c159640 1 Processor -- start 2024-05-10T08:40:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.259+0000 7f850c159640 1 -- start start 2024-05-10T08:40:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.260+0000 7f850c159640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f850415f420 0x7f85040d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.260+0000 7f850c159640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85041630b0 con 0x7f85040d2080 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.260+0000 7f850c159640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85040d2550 con 0x7f85040d3ca0 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.260+0000 7f850c159640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f85040d2c80 con 0x7f850415f420 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.260+0000 7f850a6f6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85040d2080 0x7f85040d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41026/0 (socket says 172.21.15.37:41026) 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.260+0000 7f850a6f6640 1 -- 172.21.15.37:0/3985774371 learned_addr learned my addr 172.21.15.37:0/3985774371 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8509ef5640 1 --2- 172.21.15.37:0/3985774371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f850415f420 0x7f85040d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8508ef3640 1 -- 172.21.15.37:0/3985774371 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277006002 0 0) 0x7f84f4001490 con 0x7f85040d2080 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8508ef3640 1 -- 172.21.15.37:0/3985774371 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84ec003520 con 0x7f85040d2080 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8508ef3640 1 -- 172.21.15.37:0/3985774371 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008123590 0 0) 0x7f85040d2550 con 0x7f85040d3ca0 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8508ef3640 1 -- 172.21.15.37:0/3985774371 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84f4001490 con 0x7f85040d3ca0 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8509ef5640 1 -- 172.21.15.37:0/3985774371 >> v1:172.21.15.82:6789/0 conn(0x7f85040d3ca0 legacy=0x7f85040d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8509ef5640 1 -- 172.21.15.37:0/3985774371 >> v1:172.21.15.37:6789/0 conn(0x7f85040d2080 legacy=0x7f85040d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.261+0000 7f8509ef5640 1 -- 172.21.15.37:0/3985774371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85040d2f60 con 0x7f850415f420 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f8509ef5640 1 --2- 172.21.15.37:0/3985774371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f850415f420 0x7f85040d3760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0097d0 tx=0x7f84fc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46745d38e9586c58 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f8508ef3640 1 -- 172.21.15.37:0/3985774371 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc037070 con 0x7f850415f420 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f8508ef3640 1 -- 172.21.15.37:0/3985774371 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc032440 con 0x7f850415f420 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f8508ef3640 1 -- 172.21.15.37:0/3985774371 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0327f0 con 0x7f850415f420 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f850c159640 1 -- 172.21.15.37:0/3985774371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f850415f420 msgr2=0x7f85040d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f850c159640 1 --2- 172.21.15.37:0/3985774371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f850415f420 0x7f85040d3760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0097d0 tx=0x7f84fc02a210 comp rx=0 tx=0).stop 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f850c159640 1 -- 172.21.15.37:0/3985774371 shutdown_connections 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f850c159640 1 --2- 172.21.15.37:0/3985774371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f850415f420 0x7f85040d3760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.262+0000 7f850c159640 1 -- 172.21.15.37:0/3985774371 >> 172.21.15.37:0/3985774371 conn(0x7f850408eac0 msgr2=0x7f850409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.263+0000 7f850c159640 1 -- 172.21.15.37:0/3985774371 shutdown_connections 2024-05-10T08:40:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.263+0000 7f850c159640 1 -- 172.21.15.37:0/3985774371 wait complete. 2024-05-10T08:40:35.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 Processor -- start 2024-05-10T08:40:35.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 -- start start 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85040d2080 0x7f85040ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85041f5e20 0x7f85040c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85040d0ed0 0x7f85040caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85040d53d0 con 0x7f85040d0ed0 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85040d2830 con 0x7f85040d2080 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.264+0000 7f850c159640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f85040d5550 con 0x7f85041f5e20 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85040d0ed0 0x7f85040caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85040d0ed0 0x7f85040caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58218/0 (socket says 172.21.15.37:58218) 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 -- 172.21.15.37:0/1040460894 learned_addr learned my addr 172.21.15.37:0/1040460894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f8509ef5640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85040d2080 0x7f85040ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f85096f4640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85041f5e20 0x7f85040c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 -- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85041f5e20 msgr2=0x7f85040c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85041f5e20 0x7f85040c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 -- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85040d2080 msgr2=0x7f85040ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85040d2080 0x7f85040ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 -- 172.21.15.37:0/1040460894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85040c9b30 con 0x7f85040d0ed0 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f85096f4640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85041f5e20 0x7f85040c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f8509ef5640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85040d2080 0x7f85040ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850a6f6640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85040d0ed0 0x7f85040caf40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84f400cfb0 tx=0x7f84f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f85027fc640 1 -- 172.21.15.37:0/1040460894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4017070 con 0x7f85040d0ed0 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f85027fc640 1 -- 172.21.15.37:0/1040460894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f4012400 con 0x7f85040d0ed0 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85041f6320 con 0x7f85040d0ed0 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f85027fc640 1 -- 172.21.15.37:0/1040460894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40127b0 con 0x7f85040d0ed0 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.265+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85041f68e0 con 0x7f85040d0ed0 2024-05-10T08:40:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.266+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85040693f0 con 0x7f85040d0ed0 2024-05-10T08:40:35.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.267+0000 7f85027fc640 1 -- 172.21.15.37:0/1040460894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84f401a070 con 0x7f85040d0ed0 2024-05-10T08:40:35.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.267+0000 7f85027fc640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84f0076300 0x7f84f00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.268+0000 7f85027fc640 1 -- 172.21.15.37:0/1040460894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84f4097880 con 0x7f85040d0ed0 2024-05-10T08:40:35.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.268+0000 7f8509ef5640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84f0076300 0x7f84f00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.268+0000 7f8509ef5640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84f0076300 0x7f84f00787c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84fc034000 tx=0x7f84fc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.272+0000 7f85027fc640 1 -- 172.21.15.37:0/1040460894 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f85041630b0 con 0x7f85040d0ed0 2024-05-10T08:40:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.504+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85040b4c50 con 0x7f85040d0ed0 2024-05-10T08:40:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.504+0000 7f85027fc640 1 -- 172.21.15.37:0/1040460894 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f84f40607b0 con 0x7f85040d0ed0 2024-05-10T08:40:35.504 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:35.504 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84f0076300 msgr2=0x7f84f00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84f0076300 0x7f84f00787c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84fc034000 tx=0x7f84fc02e000 comp rx=0 tx=0).stop 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85040d0ed0 msgr2=0x7f85040caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85040d0ed0 0x7f85040caf40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84f400cfb0 tx=0x7f84f400a430 comp rx=0 tx=0).stop 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 shutdown_connections 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84f0076300 0x7f84f00787c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85040d0ed0 0x7f85040caf40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85041f5e20 0x7f85040c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 --2- 172.21.15.37:0/1040460894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85040d2080 0x7f85040ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 >> 172.21.15.37:0/1040460894 conn(0x7f850408eac0 msgr2=0x7f850406e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 shutdown_connections 2024-05-10T08:40:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.507+0000 7f850c159640 1 -- 172.21.15.37:0/1040460894 wait complete. 2024-05-10T08:40:35.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:35.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.621+0000 7fd69fb40640 1 Processor -- start 2024-05-10T08:40:35.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.622+0000 7fd69fb40640 1 -- start start 2024-05-10T08:40:35.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.622+0000 7fd69fb40640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd69815f420 0x7fd6980d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.622+0000 7fd69fb40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6980d2080 0x7fd6980d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.622+0000 7fd69fb40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6981630b0 con 0x7fd6980d3ca0 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.622+0000 7fd69fb40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd6980d2550 con 0x7fd6980d2080 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.622+0000 7fd69fb40640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd6980d2c80 con 0x7fd69815f420 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69e0dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6980d2080 0x7fd6980d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69e0dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6980d2080 0x7fd6980d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58224/0 (socket says 172.21.15.37:58224) 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69e0dd640 1 -- 172.21.15.37:0/3362098983 learned_addr learned my addr 172.21.15.37:0/3362098983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69d8dc640 1 --2- 172.21.15.37:0/3362098983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd69815f420 0x7fd6980d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69e0dd640 1 -- 172.21.15.37:0/3362098983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd69815f420 msgr2=0x7fd6980d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69e0dd640 1 --2- 172.21.15.37:0/3362098983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd69815f420 0x7fd6980d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69e0dd640 1 -- 172.21.15.37:0/3362098983 >> v1:172.21.15.82:6789/0 conn(0x7fd6980d3ca0 legacy=0x7fd6980d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.623+0000 7fd69e0dd640 1 -- 172.21.15.37:0/3362098983 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6980d2f60 con 0x7fd6980d2080 2024-05-10T08:40:35.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69e0dd640 1 --2- 172.21.15.37:0/3362098983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6980d4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd688009e50 tx=0x7fd68802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5f4c7023aa6932 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69c8da640 1 -- 172.21.15.37:0/3362098983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688036070 con 0x7fd6980d2080 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69c8da640 1 -- 172.21.15.37:0/3362098983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688031600 con 0x7fd6980d2080 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69c8da640 1 -- 172.21.15.37:0/3362098983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880319d0 con 0x7fd6980d2080 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 -- 172.21.15.37:0/3362098983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 msgr2=0x7fd6980d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3362098983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6980d4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd688009e50 tx=0x7fd68802a710 comp rx=0 tx=0).stop 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 -- 172.21.15.37:0/3362098983 shutdown_connections 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3362098983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6980d4cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3362098983 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd69815f420 0x7fd6980d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 -- 172.21.15.37:0/3362098983 >> 172.21.15.37:0/3362098983 conn(0x7fd69808eac0 msgr2=0x7fd69809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 -- 172.21.15.37:0/3362098983 shutdown_connections 2024-05-10T08:40:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.624+0000 7fd69fb40640 1 -- 172.21.15.37:0/3362098983 wait complete. 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 Processor -- start 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 -- start start 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6981f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6980cadb0 0x7fd6980ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6980ba9b0 0x7fd6980d1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980d5200 con 0x7fd6980d2080 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980d2830 con 0x7fd6980ba9b0 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69fb40640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd6980d5380 con 0x7fd6980cadb0 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69d8dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6981f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69d8dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6981f92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58236/0 (socket says 172.21.15.37:58236) 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.626+0000 7fd69d8dc640 1 -- 172.21.15.37:0/3699757913 learned_addr learned my addr 172.21.15.37:0/3699757913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69d0db640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6980cadb0 0x7fd6980ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69e0dd640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6980ba9b0 0x7fd6980d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69d8dc640 1 -- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6980cadb0 msgr2=0x7fd6980ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69d8dc640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6980cadb0 0x7fd6980ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69d8dc640 1 -- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6980ba9b0 msgr2=0x7fd6980d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69d8dc640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6980ba9b0 0x7fd6980d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69d8dc640 1 -- 172.21.15.37:0/3699757913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6980b7f70 con 0x7fd6980d2080 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69d8dc640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6981f92a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd69000e870 tx=0x7fd69000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd6967fc640 1 -- 172.21.15.37:0/3699757913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690017070 con 0x7fd6980d2080 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd6967fc640 1 -- 172.21.15.37:0/3699757913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69000c940 con 0x7fd6980d2080 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd6967fc640 1 -- 172.21.15.37:0/3699757913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69000cd30 con 0x7fd6980d2080 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6980b9990 con 0x7fd6980d2080 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.627+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6980b9f50 con 0x7fd6980d2080 2024-05-10T08:40:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.628+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6980d4ad0 con 0x7fd6980d2080 2024-05-10T08:40:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.629+0000 7fd6967fc640 1 -- 172.21.15.37:0/3699757913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd69001a070 con 0x7fd6980d2080 2024-05-10T08:40:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.629+0000 7fd6967fc640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd6840762d0 0x7fd684078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.629+0000 7fd6967fc640 1 -- 172.21.15.37:0/3699757913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd690097a40 con 0x7fd6980d2080 2024-05-10T08:40:35.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.629+0000 7fd69d0db640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd6840762d0 0x7fd684078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.630+0000 7fd69d0db640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd6840762d0 0x7fd684078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001780 tx=0x7fd68c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.634+0000 7fd6967fc640 1 -- 172.21.15.37:0/3699757913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd690060aa0 con 0x7fd6980d2080 2024-05-10T08:40:35.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.865+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6980693f0 con 0x7fd6980d2080 2024-05-10T08:40:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.865+0000 7fd6967fc640 1 -- 172.21.15.37:0/3699757913 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7fd690064da0 con 0x7fd6980d2080 2024-05-10T08:40:35.865 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:35.865 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:35.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd6840762d0 msgr2=0x7fd684078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd6840762d0 0x7fd684078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001780 tx=0x7fd68c009040 comp rx=0 tx=0).stop 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 msgr2=0x7fd6981f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6981f92a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd69000e870 tx=0x7fd69000ed30 comp rx=0 tx=0).stop 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 shutdown_connections 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd6840762d0 0x7fd684078790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6980ba9b0 0x7fd6980d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6980cadb0 0x7fd6980ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 --2- 172.21.15.37:0/3699757913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6980d2080 0x7fd6981f92a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 >> 172.21.15.37:0/3699757913 conn(0x7fd69808eac0 msgr2=0x7fd69815e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 shutdown_connections 2024-05-10T08:40:35.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.867+0000 7fd69fb40640 1 -- 172.21.15.37:0/3699757913 wait complete. 2024-05-10T08:40:35.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:35.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.981+0000 7fc43bbe4640 1 Processor -- start 2024-05-10T08:40:35.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.982+0000 7fc43bbe4640 1 -- start start 2024-05-10T08:40:35.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43bbe4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 0x7fc4341633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43bbe4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4340d0500 con 0x7fc434162f50 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43bbe4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43406da60 con 0x7fc4340b21f0 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43bbe4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc43406d810 con 0x7fc4340cfea0 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43917f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc434162f50 0x7fc4340cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41032/0 (socket says 172.21.15.37:41032) 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43917f640 1 -- 172.21.15.37:0/417221460 learned_addr learned my addr 172.21.15.37:0/417221460 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43a181640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 0x7fc4341633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668253772 0 0) 0x7fc4340d0500 con 0x7fc434162f50 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc420003520 con 0x7fc434162f50 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1053381399 0 0) 0x7fc420003520 con 0x7fc434162f50 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 msgr2=0x7fc4341633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 0x7fc4341633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 >> v1:172.21.15.82:6789/0 conn(0x7fc4340b21f0 legacy=0x7fc43406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43406dd40 con 0x7fc434162f50 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fc424001670 con 0x7fc434162f50 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 >> v1:172.21.15.37:6789/0 conn(0x7fc434162f50 legacy=0x7fc4340cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 0x7fc4200039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc420003fb0 0x7fc420004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420004d40 0x7fc4200051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc43406d810 con 0x7fc420004d40 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc42000bc50 con 0x7fc420003fb0 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc42000be50 con 0x7fc4340cfea0 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc43a181640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420004d40 0x7fc4200051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.983+0000 7fc439980640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 0x7fc4200039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc43917f640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc420003fb0 0x7fc420004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc43a181640 1 -- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 msgr2=0x7fc4200039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc43a181640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 0x7fc4200039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc43a181640 1 -- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc420003fb0 msgr2=0x7fc420004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc43a181640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc420003fb0 0x7fc420004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc43a181640 1 -- 172.21.15.37:0/417221460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc420003520 con 0x7fc420004d40 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc439980640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4340cfea0 0x7fc4200039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.984+0000 7fc43a181640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420004d40 0x7fc4200051a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009fc0 tx=0x7fc420005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e134a31d88b2f82b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c009c10 con 0x7fc420004d40 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c036070 con 0x7fc420004d40 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43897e640 1 -- 172.21.15.37:0/417221460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c031880 con 0x7fc420004d40 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43bbe4640 1 -- 172.21.15.37:0/417221460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420004d40 msgr2=0x7fc4200051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43bbe4640 1 --2- 172.21.15.37:0/417221460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420004d40 0x7fc4200051a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009fc0 tx=0x7fc420005830 comp rx=0 tx=0).stop 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43a181640 1 -- 172.21.15.37:0/417221460 reap_dead start 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43bbe4640 1 -- 172.21.15.37:0/417221460 shutdown_connections 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43bbe4640 1 -- 172.21.15.37:0/417221460 >> 172.21.15.37:0/417221460 conn(0x7fc43409ba40 msgr2=0x7fc43409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43bbe4640 1 -- 172.21.15.37:0/417221460 shutdown_connections 2024-05-10T08:40:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.985+0000 7fc43bbe4640 1 -- 172.21.15.37:0/417221460 wait complete. 2024-05-10T08:40:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.986+0000 7fc43bbe4640 1 Processor -- start 2024-05-10T08:40:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43bbe4640 1 -- start start 2024-05-10T08:40:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43bbe4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc420004d40 0x7fc434158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43bbe4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc43409cd20 0x7fc4340a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43bbe4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4340a09a0 0x7fc4340d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43bbe4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4341633e0 con 0x7fc4340a09a0 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43bbe4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc43406e0b0 con 0x7fc43409cd20 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43bbe4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc434163560 con 0x7fc420004d40 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43a181640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4340a09a0 0x7fc4340d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43a181640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4340a09a0 0x7fc4340d2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58250/0 (socket says 172.21.15.37:58250) 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.987+0000 7fc43a181640 1 -- 172.21.15.37:0/2429894205 learned_addr learned my addr 172.21.15.37:0/2429894205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43917f640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc43409cd20 0x7fc4340a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc439980640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc420004d40 0x7fc434158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43a181640 1 -- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc420004d40 msgr2=0x7fc434158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43a181640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc420004d40 0x7fc434158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43a181640 1 -- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc43409cd20 msgr2=0x7fc4340a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43a181640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc43409cd20 0x7fc4340a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43a181640 1 -- 172.21.15.37:0/2429894205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4341586a0 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43917f640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc43409cd20 0x7fc4340a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43a181640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4340a09a0 0x7fc4340d2ee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc42c033040 tx=0x7fc42c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc42a7fc640 1 -- 172.21.15.37:0/2429894205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430001370 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc42a7fc640 1 -- 172.21.15.37:0/2429894205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c031df0 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc42a7fc640 1 -- 172.21.15.37:0/2429894205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c009c10 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4340b71d0 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.988+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4340b7790 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.989+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc434069b00 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.990+0000 7fc42a7fc640 1 -- 172.21.15.37:0/2429894205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc42c005d10 con 0x7fc4340a09a0 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.990+0000 7fc42a7fc640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4180762d0 0x7fc418078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.990+0000 7fc42a7fc640 1 -- 172.21.15.37:0/2429894205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc42c0b8a70 con 0x7fc4340a09a0 2024-05-10T08:40:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.990+0000 7fc439980640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4180762d0 0x7fc418078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.991+0000 7fc439980640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4180762d0 0x7fc418078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc4340d3b70 tx=0x7fc430009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:35.994+0000 7fc42a7fc640 1 -- 172.21.15.37:0/2429894205 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc42c04a060 con 0x7fc4340a09a0 2024-05-10T08:40:36.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.189+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc43406d5f0 con 0x7fc4340a09a0 2024-05-10T08:40:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.190+0000 7fc42a7fc640 1 -- 172.21.15.37:0/2429894205 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fc42c082120 con 0x7fc4340a09a0 2024-05-10T08:40:36.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:36.190 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:36.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4180762d0 msgr2=0x7fc418078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:36.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4180762d0 0x7fc418078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc4340d3b70 tx=0x7fc430009040 comp rx=0 tx=0).stop 2024-05-10T08:40:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4340a09a0 msgr2=0x7fc4340d2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4340a09a0 0x7fc4340d2ee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc42c033040 tx=0x7fc42c009750 comp rx=0 tx=0).stop 2024-05-10T08:40:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 shutdown_connections 2024-05-10T08:40:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4180762d0 0x7fc418078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4340a09a0 0x7fc4340d2ee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc43409cd20 0x7fc4340a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 --2- 172.21.15.37:0/2429894205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc420004d40 0x7fc434158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.192+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 >> 172.21.15.37:0/2429894205 conn(0x7fc43409ba40 msgr2=0x7fc4340711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.193+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 shutdown_connections 2024-05-10T08:40:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.193+0000 7fc43bbe4640 1 -- 172.21.15.37:0/2429894205 wait complete. 2024-05-10T08:40:36.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.308+0000 7f69f9c59640 1 Processor -- start 2024-05-10T08:40:36.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.308+0000 7f69f9c59640 1 -- start start 2024-05-10T08:40:36.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f9c59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69f40b3fc0 0x7f69f40b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:36.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f9c59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f40b0840 0x7f69f40b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:36.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f9c59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69f409ed30 0x7f69f415fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:36.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f9c59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f69f40b48e0 con 0x7f69f409ed30 2024-05-10T08:40:36.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f9c59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f69f415c820 con 0x7f69f40b3fc0 2024-05-10T08:40:36.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f9c59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69f415cb00 con 0x7f69f40b0840 2024-05-10T08:40:36.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69f409ed30 0x7f69f415fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:36.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69f409ed30 0x7f69f415fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58260/0 (socket says 172.21.15.37:58260) 2024-05-10T08:40:36.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 -- 172.21.15.37:0/1161436277 learned_addr learned my addr 172.21.15.37:0/1161436277 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:36.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f2ffd640 1 --2- 172.21.15.37:0/1161436277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f40b0840 0x7f69f40b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:36.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f37fe640 1 --2- 172.21.15.37:0/1161436277 >> v2:172.21.15.82:3300/0 conn(0x7f69f40b3fc0 0x7f69f40b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 -- 172.21.15.37:0/1161436277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f40b0840 msgr2=0x7f69f40b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 --2- 172.21.15.37:0/1161436277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f40b0840 0x7f69f40b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 -- 172.21.15.37:0/1161436277 >> v2:172.21.15.82:3300/0 conn(0x7f69f40b3fc0 msgr2=0x7f69f40b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 --2- 172.21.15.37:0/1161436277 >> v2:172.21.15.82:3300/0 conn(0x7f69f40b3fc0 0x7f69f40b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f3fff640 1 -- 172.21.15.37:0/1161436277 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f415cde0 con 0x7f69f409ed30 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f37fe640 1 --2- 172.21.15.37:0/1161436277 >> v2:172.21.15.82:3300/0 conn(0x7f69f40b3fc0 0x7f69f40b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.309+0000 7f69f2ffd640 1 --2- 172.21.15.37:0/1161436277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f40b0840 0x7f69f40b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.310+0000 7f69f3fff640 1 --2- 172.21.15.37:0/1161436277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f409ed30 0x7f69f415fac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f69f4068fd0 tx=0x7f69ec02c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c31abb9913c3057 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:36.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.310+0000 7f69f27fc640 1 -- 172.21.15.37:0/1161436277 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec039070 con 0x7f69f409ed30 2024-05-10T08:40:36.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.310+0000 7f69f27fc640 1 -- 172.21.15.37:0/1161436277 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec009600 con 0x7f69f409ed30 2024-05-10T08:40:36.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.310+0000 7f69f27fc640 1 -- 172.21.15.37:0/1161436277 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0099f0 con 0x7f69f409ed30 2024-05-10T08:40:36.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 -- 172.21.15.37:0/1161436277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f409ed30 msgr2=0x7f69f415fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:36.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 --2- 172.21.15.37:0/1161436277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f409ed30 0x7f69f415fac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f69f4068fd0 tx=0x7f69ec02c810 comp rx=0 tx=0).stop 2024-05-10T08:40:36.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 -- 172.21.15.37:0/1161436277 shutdown_connections 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 --2- 172.21.15.37:0/1161436277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f409ed30 0x7f69f415fac0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 --2- 172.21.15.37:0/1161436277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f40b0840 0x7f69f40b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 --2- 172.21.15.37:0/1161436277 >> v2:172.21.15.82:3300/0 conn(0x7f69f40b3fc0 0x7f69f40b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 -- 172.21.15.37:0/1161436277 >> 172.21.15.37:0/1161436277 conn(0x7f69f40b2cc0 msgr2=0x7f69f40b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 -- 172.21.15.37:0/1161436277 shutdown_connections 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.311+0000 7f69f9c59640 1 -- 172.21.15.37:0/1161436277 wait complete. 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.312+0000 7f69f9c59640 1 Processor -- start 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.312+0000 7f69f9c59640 1 -- start start 2024-05-10T08:40:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f9c59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f409ed30 0x7f69f415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f9c59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f40b3fc0 0x7f69f414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f9c59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f415b1d0 0x7f69f40cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f9c59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69f415c600 con 0x7f69f415b1d0 2024-05-10T08:40:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f9c59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69f415c480 con 0x7f69f40b3fc0 2024-05-10T08:40:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f9c59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69f4072480 con 0x7f69f409ed30 2024-05-10T08:40:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f415b1d0 0x7f69f40cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:36.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f415b1d0 0x7f69f40cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58262/0 (socket says 172.21.15.37:58262) 2024-05-10T08:40:36.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 -- 172.21.15.37:0/638804645 learned_addr learned my addr 172.21.15.37:0/638804645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:36.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f37fe640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f409ed30 0x7f69f415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:36.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f2ffd640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f40b3fc0 0x7f69f414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:36.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 -- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f409ed30 msgr2=0x7f69f415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:36.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f409ed30 0x7f69f415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 -- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f40b3fc0 msgr2=0x7f69f414c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f40b3fc0 0x7f69f414c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.313+0000 7f69f3fff640 1 -- 172.21.15.37:0/638804645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f4154da0 con 0x7f69f415b1d0 2024-05-10T08:40:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.314+0000 7f69f3fff640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f415b1d0 0x7f69f40cefd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00d240 tx=0x7f69ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.314+0000 7f69dbfff640 1 -- 172.21.15.37:0/638804645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec039040 con 0x7f69f415b1d0 2024-05-10T08:40:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.314+0000 7f69dbfff640 1 -- 172.21.15.37:0/638804645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec044070 con 0x7f69f415b1d0 2024-05-10T08:40:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.314+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f4155080 con 0x7f69f415b1d0 2024-05-10T08:40:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.314+0000 7f69dbfff640 1 -- 172.21.15.37:0/638804645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00b720 con 0x7f69f415b1d0 2024-05-10T08:40:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.314+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f415acb0 con 0x7f69f415b1d0 2024-05-10T08:40:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.315+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f415aeb0 con 0x7f69f415b1d0 2024-05-10T08:40:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.316+0000 7f69dbfff640 1 -- 172.21.15.37:0/638804645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69ec004040 con 0x7f69f415b1d0 2024-05-10T08:40:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.316+0000 7f69dbfff640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69e0076300 0x7f69e00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.316+0000 7f69dbfff640 1 -- 172.21.15.37:0/638804645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f69ec0ba330 con 0x7f69f415b1d0 2024-05-10T08:40:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.316+0000 7f69f37fe640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69e0076300 0x7f69e00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.317+0000 7f69f37fe640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69e0076300 0x7f69e00787c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69e4006fd0 tx=0x7f69e4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.320+0000 7f69dbfff640 1 -- 172.21.15.37:0/638804645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f69ec083950 con 0x7f69f415b1d0 2024-05-10T08:40:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.548+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69f40693f0 con 0x7f69f415b1d0 2024-05-10T08:40:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.549+0000 7f69dbfff640 1 -- 172.21.15.37:0/638804645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f69ec083250 con 0x7f69f415b1d0 2024-05-10T08:40:36.548 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:36.549 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69e0076300 msgr2=0x7f69e00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69e0076300 0x7f69e00787c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69e4006fd0 tx=0x7f69e4008040 comp rx=0 tx=0).stop 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f415b1d0 msgr2=0x7f69f40cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f415b1d0 0x7f69f40cefd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00d240 tx=0x7f69ec004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 shutdown_connections 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69e0076300 0x7f69e00787c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f415b1d0 0x7f69f40cefd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f40b3fc0 0x7f69f414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 --2- 172.21.15.37:0/638804645 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69f409ed30 0x7f69f415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 >> 172.21.15.37:0/638804645 conn(0x7f69f40b2cc0 msgr2=0x7f69f4156760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 shutdown_connections 2024-05-10T08:40:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:36.551+0000 7f69f9c59640 1 -- 172.21.15.37:0/638804645 wait complete. 2024-05-10T08:40:36.964 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:40:15.092985+0000', 'modified': '2024-05-10T08:40:28.123575+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/665979516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 665979516}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 665979516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4260, 'qdb_cluster': [4260]} 2024-05-10T08:40:36.964 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:40:36.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T08:40:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.074+0000 7fefb502c640 1 Processor -- start 2024-05-10T08:40:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.074+0000 7fefb502c640 1 -- start start 2024-05-10T08:40:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.074+0000 7fefb502c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fefb00d56d0 0x7fefb00b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.074+0000 7fefb502c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefb00d1c00 0x7fefb00d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.074+0000 7fefb502c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb01606c0 con 0x7fefb015f2d0 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.074+0000 7fefb502c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fefb00b5810 con 0x7fefb00d1c00 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.074+0000 7fefb502c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fefb00b4f00 con 0x7fefb00d56d0 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefaf59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefb00d1c00 0x7fefb00d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefaed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fefb015f2d0 0x7fefb00d4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41034/0 (socket says 172.21.15.37:41034) 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefaed9d640 1 -- 172.21.15.37:0/4279129909 learned_addr learned my addr 172.21.15.37:0/4279129909 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefa7fff640 1 --2- 172.21.15.37:0/4279129909 >> v2:172.21.15.82:3300/0 conn(0x7fefb00d56d0 0x7fefb00b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefaf59e640 1 -- 172.21.15.37:0/4279129909 >> v2:172.21.15.82:3300/0 conn(0x7fefb00d56d0 msgr2=0x7fefb00b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefaf59e640 1 --2- 172.21.15.37:0/4279129909 >> v2:172.21.15.82:3300/0 conn(0x7fefb00d56d0 0x7fefb00b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefaf59e640 1 -- 172.21.15.37:0/4279129909 >> v1:172.21.15.37:6789/0 conn(0x7fefb015f2d0 legacy=0x7fefb00d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefaf59e640 1 -- 172.21.15.37:0/4279129909 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb00b51c0 con 0x7fefb00d1c00 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.075+0000 7fefae59c640 1 -- 172.21.15.37:0/4279129909 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029256437 0 0) 0x7fefb01606c0 con 0x7fefb015f2d0 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefaf59e640 1 --2- 172.21.15.37:0/4279129909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d1c00 0x7fefb00d2050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefb008e9b0 tx=0x7fefa802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2279d8385113a91 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefae59c640 1 -- 172.21.15.37:0/4279129909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8007740 con 0x7fefb00d1c00 2024-05-10T08:40:37.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefae59c640 1 -- 172.21.15.37:0/4279129909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa80078e0 con 0x7fefb00d1c00 2024-05-10T08:40:37.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefae59c640 1 -- 172.21.15.37:0/4279129909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8007cb0 con 0x7fefb00d1c00 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefb502c640 1 -- 172.21.15.37:0/4279129909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d1c00 msgr2=0x7fefb00d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefb502c640 1 --2- 172.21.15.37:0/4279129909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d1c00 0x7fefb00d2050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefb008e9b0 tx=0x7fefa802a680 comp rx=0 tx=0).stop 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefb502c640 1 -- 172.21.15.37:0/4279129909 shutdown_connections 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefb502c640 1 --2- 172.21.15.37:0/4279129909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d1c00 0x7fefb00d2050 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefb502c640 1 --2- 172.21.15.37:0/4279129909 >> v2:172.21.15.82:3300/0 conn(0x7fefb00d56d0 0x7fefb00b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.076+0000 7fefb502c640 1 -- 172.21.15.37:0/4279129909 >> 172.21.15.37:0/4279129909 conn(0x7fefb00746d0 msgr2=0x7fefb009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.077+0000 7fefb502c640 1 -- 172.21.15.37:0/4279129909 shutdown_connections 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.077+0000 7fefb502c640 1 -- 172.21.15.37:0/4279129909 wait complete. 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.078+0000 7fefb502c640 1 Processor -- start 2024-05-10T08:40:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.078+0000 7fefb502c640 1 -- start start 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefb502c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fefb00d1c00 0x7fefb01f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefb502c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d56d0 0x7fefb014f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefb502c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb015f2d0 0x7fefb014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefb502c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fefb00d2710 con 0x7fefb00d56d0 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefb502c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefb00d2590 con 0x7fefb015f2d0 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefb502c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fefb00d2c00 con 0x7fefb00d1c00 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d56d0 0x7fefb014f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d56d0 0x7fefb014f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58276/0 (socket says 172.21.15.37:58276) 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 -- 172.21.15.37:0/4044955484 learned_addr learned my addr 172.21.15.37:0/4044955484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefaf59e640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb015f2d0 0x7fefb014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefaed9d640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fefb00d1c00 0x7fefb01f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 -- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fefb00d1c00 msgr2=0x7fefb01f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fefb00d1c00 0x7fefb01f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 -- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb015f2d0 msgr2=0x7fefb014f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb015f2d0 0x7fefb014f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 -- 172.21.15.37:0/4044955484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb00b2c90 con 0x7fefb00d56d0 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefaf59e640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb015f2d0 0x7fefb014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa7fff640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d56d0 0x7fefb014f1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d800 tx=0x7fef9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa77fe640 1 -- 172.21.15.37:0/4044955484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800b6c0 con 0x7fefb00d56d0 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa77fe640 1 -- 172.21.15.37:0/4044955484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef98019070 con 0x7fefb00d56d0 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefa77fe640 1 -- 172.21.15.37:0/4044955484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800ba80 con 0x7fefb00d56d0 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.079+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb01534f0 con 0x7fefb00d56d0 2024-05-10T08:40:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.080+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb00b2f50 con 0x7fefb00d56d0 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.081+0000 7fefa77fe640 1 -- 172.21.15.37:0/4044955484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef9800bc20 con 0x7fefb00d56d0 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.082+0000 7fefa77fe640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef900762d0 0x7fef90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.082+0000 7fefa77fe640 1 -- 172.21.15.37:0/4044955484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fef98097e10 con 0x7fefb00d56d0 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.082+0000 7fefaed9d640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef900762d0 0x7fef90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 Processor -- start 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefaed9d640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef900762d0 0x7fef90078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000f60 tx=0x7fefa0007c00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 -- start start 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ebd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ebdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5e8dbb0 0x55f4e5e913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f4e5df78d0 con 0x55f4e5e8dbb0 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4e5db0c10 con 0x55f4e5ebaf50 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.083+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f4e5df3890 con 0x55f4e5ebb330 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5e8dbb0 0x55f4e5e913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5e8dbb0 0x55f4e5e913c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58282/0 (socket says 172.21.15.37:58282) 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ebd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 -- 172.21.15.37:0/2427809236 learned_addr learned my addr 172.21.15.37:0/2427809236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefa7fff640 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ebdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 -- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 msgr2=0x55f4e5ebdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ebdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 -- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 msgr2=0x55f4e5ebd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ebd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 -- 172.21.15.37:0/2427809236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e5db85d0 con 0x55f4e5e8dbb0 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaed9d640 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ebd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefaf59e640 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5e8dbb0 0x55f4e5e913c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009e80 tx=0x7fefa802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8503b23d5774ea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2427809236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa80078f0 con 0x55f4e5e8dbb0 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2427809236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa8007a90 con 0x55f4e5e8dbb0 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.084+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2427809236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8007e80 con 0x55f4e5e8dbb0 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 -- 172.21.15.37:0/2427809236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5e8dbb0 msgr2=0x55f4e5e913c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5e8dbb0 0x55f4e5e913c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009e80 tx=0x7fefa802e000 comp rx=0 tx=0).stop 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 -- 172.21.15.37:0/2427809236 shutdown_connections 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5e8dbb0 0x55f4e5e913c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ebdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/2427809236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ebd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 -- 172.21.15.37:0/2427809236 >> 172.21.15.37:0/2427809236 conn(0x55f4e5e8fe20 msgr2=0x55f4e5ed8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 -- 172.21.15.37:0/2427809236 shutdown_connections 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.085+0000 7fefb7e1f740 1 -- 172.21.15.37:0/2427809236 wait complete. 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.086+0000 7fefb7e1f740 1 -- start start 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.086+0000 7fefb7e1f740 1 Processor -- start 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.086+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5ebaf50 0x55f4e5eb4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.086+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5edbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.086+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5eb2290 0x55f4e5eda9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.086+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f4e5e92fd0 con 0x55f4e5ebaf50 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4e5db4760 con 0x55f4e5ebb330 2024-05-10T08:40:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f4e5e932b0 con 0x55f4e5eb2290 2024-05-10T08:40:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefb7e1f740 10 client.0 _ll_register_callbacks cb 0x55f4e5dedcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:40:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5ebaf50 0x55f4e5eb4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5ebaf50 0x55f4e5eb4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58294/0 (socket says 172.21.15.37:58294) 2024-05-10T08:40:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 -- 172.21.15.37:0/992621771 learned_addr learned my addr 172.21.15.37:0/992621771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefa7fff640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5edbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaf59e640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5eb2290 0x55f4e5eda9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 -- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5eb2290 msgr2=0x55f4e5eda9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5eb2290 0x55f4e5eda9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 -- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 msgr2=0x55f4e5edbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5edbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 -- 172.21.15.37:0/992621771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e5b092d0 con 0x55f4e5ebaf50 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefa7fff640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5edbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefaed9d640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5ebaf50 0x55f4e5eb4a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fefa0001d50 tx=0x7fefa0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a6b20dd74e1504 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fef8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fef8dffb640 1 -- 172.21.15.37:0/992621771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0022430 con 0x55f4e5ebaf50 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fef8dffb640 1 -- 172.21.15.37:0/992621771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fefa0010040 con 0x55f4e5ebaf50 2024-05-10T08:40:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefa8007a90 con 0x55f4e5ebaf50 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fef8dffb640 1 -- 172.21.15.37:0/992621771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fefa002c050 con 0x55f4e5ebaf50 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefb7e1f740 10 client.4680 fetch_fsmap learned FSMap version 9 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f4e5bd36b0 con 0x55f4e5ebaf50 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.087+0000 7fef8dffb640 1 -- 172.21.15.37:0/992621771 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa8007a90 con 0x55f4e5ebaf50 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fef8dffb640 1 -- 172.21.15.37:0/992621771 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fefa002f020 con 0x55f4e5ebaf50 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefb7e1f740 10 client.4680 fetch_fsmap finished waiting for FSMap version 9 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefb7e1f740 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefb7e1f740 20 client.4680 populate_metadata read hostname 'smithi037' 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5eb2c50 0x55f4e5eec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefb7e1f740 4 client.4680 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 --> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4e5d7b760 con 0x55f4e5eb2c50 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefa7fff640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5eb2c50 0x55f4e5eec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fefa7fff640 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5eb2c50 0x55f4e5eec5d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efe193ae45cac423 server_cookie=7035814a50a23a61 in_seq=0 out_seq=0 2024-05-10T08:40:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.088+0000 7fef8dffb640 10 client.4680 ms_handle_connect on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fef8dffb640 1 -- 172.21.15.37:0/992621771 <== mds.0 v2:172.21.15.37:6833/665979516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f4e5d7b760 con 0x55f4e5eb2c50 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fef8dffb640 10 client.4680 handle_command_reply: tid=0 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 client.4680 shutdown 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5ebaf50 msgr2=0x55f4e5eb4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5ebaf50 0x55f4e5eb4a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fefa0001d50 tx=0x7fefa0000ed0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 shutdown_connections 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5eb2290 0x55f4e5eda9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5eb2c50 0x55f4e5eec5d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5edbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/992621771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5ebaf50 0x55f4e5eb4a50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fef8dffb640 0 client.4680 ms_handle_reset on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 >> 172.21.15.37:0/992621771 conn(0x55f4e5e8dbb0 msgr2=0x55f4e5eba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 shutdown_connections 2024-05-10T08:40:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 1 -- 172.21.15.37:0/992621771 wait complete. 2024-05-10T08:40:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.089+0000 7fefb7e1f740 20 client.4680 trim_cache size 0 max 16384 2024-05-10T08:40:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.108+0000 7fefb7e1f740 1 Processor -- start 2024-05-10T08:40:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.108+0000 7fefb7e1f740 1 -- start start 2024-05-10T08:40:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5e91480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebaf50 0x55f4e5ef25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5ef2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0201ab0 con 0x55f4e5eb2290 2024-05-10T08:40:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefb00b4310 con 0x55f4e5ebb330 2024-05-10T08:40:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fefb0201460 con 0x55f4e5ebaf50 2024-05-10T08:40:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5e91480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5e91480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58304/0 (socket says 172.21.15.37:58304) 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 -- 172.21.15.37:0/1147274772 learned_addr learned my addr 172.21.15.37:0/1147274772 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefa7fff640 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebaf50 0x55f4e5ef25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaf59e640 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5ef2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 -- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebaf50 msgr2=0x55f4e5ef25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebaf50 0x55f4e5ef25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 -- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 msgr2=0x55f4e5ef2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5ef2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 -- 172.21.15.37:0/1147274772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e5eb28a0 con 0x55f4e5eb2290 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaf59e640 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5ef2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fefaed9d640 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5e91480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005eb0 tx=0x7fefa001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815edbd4efeb992b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fef8ffff640 1 -- 172.21.15.37:0/1147274772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0035070 con 0x55f4e5eb2290 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fef8ffff640 1 -- 172.21.15.37:0/1147274772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa0018030 con 0x55f4e5eb2290 2024-05-10T08:40:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.109+0000 7fef8ffff640 1 -- 172.21.15.37:0/1147274772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0022b80 con 0x55f4e5eb2290 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 -- 172.21.15.37:0/1147274772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 msgr2=0x55f4e5e91480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5e91480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005eb0 tx=0x7fefa001f000 comp rx=0 tx=0).stop 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 -- 172.21.15.37:0/1147274772 shutdown_connections 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebb330 0x55f4e5ef2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebaf50 0x55f4e5ef25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/1147274772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5e91480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 -- 172.21.15.37:0/1147274772 >> 172.21.15.37:0/1147274772 conn(0x55f4e5e8dbb0 msgr2=0x55f4e5eba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 -- 172.21.15.37:0/1147274772 shutdown_connections 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 -- 172.21.15.37:0/1147274772 wait complete. 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.110+0000 7fefb7e1f740 1 -- start start 2024-05-10T08:40:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 1 Processor -- start 2024-05-10T08:40:37.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5eebc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ece0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ece630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f4e5eb2ad0 con 0x55f4e5eb2290 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4e5eda1d0 con 0x55f4e5ebaf50 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f4e5eb3090 con 0x55f4e5ebb330 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefb7e1f740 10 client.0 _ll_register_callbacks cb 0x7fefa0005c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5eebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5eebc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58320/0 (socket says 172.21.15.37:58320) 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefaed9d640 1 -- 172.21.15.37:0/3122561561 learned_addr learned my addr 172.21.15.37:0/3122561561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.111+0000 7fefa7fff640 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ece0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefaf59e640 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ece630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefaed9d640 1 -- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 msgr2=0x55f4e5ece630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefaed9d640 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ece630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefaed9d640 1 -- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 msgr2=0x55f4e5ece0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefaed9d640 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ece0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefaed9d640 1 -- 172.21.15.37:0/3122561561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e5e8f9f0 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefaed9d640 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5eebc90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fefa0001d50 tx=0x7fefa000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e3f1ce30a3a6eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fef8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fef8dffb640 1 -- 172.21.15.37:0/3122561561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0040060 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fef8dffb640 1 -- 172.21.15.37:0/3122561561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fefa00239a0 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefa0018030 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fef8dffb640 1 -- 172.21.15.37:0/3122561561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fefa0046050 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefb7e1f740 10 client.4686 fetch_fsmap learned FSMap version 9 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f4e5eceb70 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fef8dffb640 1 -- 172.21.15.37:0/3122561561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa0018030 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fef8dffb640 1 -- 172.21.15.37:0/3122561561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fefa0049020 con 0x55f4e5eb2290 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.112+0000 7fefb7e1f740 10 client.4686 fetch_fsmap finished waiting for FSMap version 9 2024-05-10T08:40:37.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 10 client.4686 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 20 client.4686 populate_metadata read hostname 'smithi037' 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5efb9e0 0x55f4e5efbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 4 client.4686 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 --> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] -- command(tid 0: {"prefix": "status"}) -- 0x55f4e5e054e0 con 0x55f4e5efb9e0 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefa7fff640 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5efb9e0 0x55f4e5efbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fef8dffb640 10 client.4686 ms_handle_connect on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefa7fff640 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5efb9e0 0x55f4e5efbdc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ac0dd80ed1b7492 server_cookie=34a63055c2c6b42a in_seq=0 out_seq=0 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fef8dffb640 1 -- 172.21.15.37:0/3122561561 <== mds.0 v2:172.21.15.37:6833/665979516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55f4e5e054e0 con 0x55f4e5efb9e0 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fef8dffb640 10 client.4686 handle_command_reply: tid=0 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 client.4686 shutdown 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 msgr2=0x55f4e5eebc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5eebc90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fefa0001d50 tx=0x7fefa000a000 comp rx=0 tx=0).stop 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 shutdown_connections 2024-05-10T08:40:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f4e5ebb330 0x55f4e5ece630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:6833/665979516,v1:172.21.15.37:6835/665979516] conn(0x55f4e5efb9e0 0x55f4e5efbdc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4e5ebaf50 0x55f4e5ece0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fef8dffb640 0 client.4686 ms_handle_reset on v2:172.21.15.37:6833/665979516 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 --2- 172.21.15.37:0/3122561561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f4e5eb2290 0x55f4e5eebc90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 >> 172.21.15.37:0/3122561561 conn(0x55f4e5e8dbb0 msgr2=0x55f4e5e91480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 shutdown_connections 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 1 -- 172.21.15.37:0/3122561561 wait complete. 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.113+0000 7fefb7e1f740 20 client.4686 trim_cache size 0 max 16384 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:40:37.120 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4260, 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 21.406283775999999, 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 9, 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 25, 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 25, 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 27.583931504999999 2024-05-10T08:40:37.121 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:40:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef900762d0 msgr2=0x7fef90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef900762d0 0x7fef90078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000f60 tx=0x7fefa0007c00 comp rx=0 tx=0).stop 2024-05-10T08:40:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d56d0 msgr2=0x7fefb014f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d56d0 0x7fefb014f1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d800 tx=0x7fef9800dcc0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 shutdown_connections 2024-05-10T08:40:37.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef900762d0 0x7fef90078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb015f2d0 0x7fefb014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefb00d56d0 0x7fefb014f1d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 --2- 172.21.15.37:0/4044955484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fefb00d1c00 0x7fefb01f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 >> 172.21.15.37:0/4044955484 conn(0x7fefb00746d0 msgr2=0x7fefb015fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:37.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 shutdown_connections 2024-05-10T08:40:37.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.114+0000 7fefb502c640 1 -- 172.21.15.37:0/4044955484 wait complete. 2024-05-10T08:40:37.125 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T08:40:37.136 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T08:40:37.136 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T08:40:37.136 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T08:40:37.136 INFO:teuthology.run_tasks:Running task kclient... 2024-05-10T08:40:37.172 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T08:40:37.172 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-10T08:40:37.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.173 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:40:37.189 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-10T08:40:37.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T08:40:37.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-10T08:40:37.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.352 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:40:37.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-10T08:40:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-05-10T08:40:37.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:40:37.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.438 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T08:40:37.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.458 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T08:40:37.531 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-05-10T08:40:37.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:40:37.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.533 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T08:40:37.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:37.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T08:40:37.660 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-05-10T08:40:37.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:40:37.661 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-10T08:40:37.662 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T08:40:37.662 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:40:37.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:40:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.767+0000 7fe95b5c1640 1 Processor -- start 2024-05-10T08:40:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.767+0000 7fe95b5c1640 1 -- start start 2024-05-10T08:40:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.768+0000 7fe95b5c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 0x7fe9540cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.768+0000 7fe95b5c1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9540d3330 con 0x7fe9541629a0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.768+0000 7fe95b5c1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9540d2170 con 0x7fe9540c9ee0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.768+0000 7fe95b5c1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe9540d2450 con 0x7fe9540d3cd0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.768+0000 7fe95935d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe9541629a0 0x7fe9540d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35166/0 (socket says 172.21.15.37:35166) 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.768+0000 7fe95935d640 1 -- 172.21.15.37:0/4103831908 learned_addr learned my addr 172.21.15.37:0/4103831908 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.768+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173837337 0 0) 0x7fe9540d3330 con 0x7fe9541629a0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe940003520 con 0x7fe9541629a0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe958b5c640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 0x7fe9540cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3067440610 0 0) 0x7fe940003520 con 0x7fe9541629a0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 msgr2=0x7fe9540cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 0x7fe9540cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 >> v1:172.21.15.82:6789/0 conn(0x7fe9540c9ee0 legacy=0x7fe9540d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9540d2730 con 0x7fe9541629a0 2024-05-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fe950001670 con 0x7fe9541629a0 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 >> v1:172.21.15.37:6789/0 conn(0x7fe9541629a0 legacy=0x7fe9540d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 0x7fe9400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940003fb0 0x7fe940004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe940004d40 0x7fe9400051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9540d2450 con 0x7fe940004d40 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe94000bc50 con 0x7fe940003fb0 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe94000be50 con 0x7fe9540d3cd0 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe959b5e640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe940004d40 0x7fe9400051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe95935d640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 0x7fe9400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe958b5c640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940003fb0 0x7fe940004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe959b5e640 1 -- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 msgr2=0x7fe9400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe959b5e640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9540d3cd0 0x7fe9400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe959b5e640 1 -- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940003fb0 msgr2=0x7fe940004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe959b5e640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940003fb0 0x7fe940004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.769+0000 7fe959b5e640 1 -- 172.21.15.37:0/4103831908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe940003520 con 0x7fe940004d40 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.770+0000 7fe959b5e640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe940004d40 0x7fe9400051a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001e50 tx=0x7fe940005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f57ffd777978df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.770+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c001a70 con 0x7fe940004d40 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.770+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94c003970 con 0x7fe940004d40 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.770+0000 7fe94bfff640 1 -- 172.21.15.37:0/4103831908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c003d60 con 0x7fe940004d40 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.771+0000 7fe95b5c1640 1 -- 172.21.15.37:0/4103831908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe940004d40 msgr2=0x7fe9400051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.771+0000 7fe95b5c1640 1 --2- 172.21.15.37:0/4103831908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe940004d40 0x7fe9400051a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001e50 tx=0x7fe940005830 comp rx=0 tx=0).stop 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.771+0000 7fe959b5e640 1 -- 172.21.15.37:0/4103831908 reap_dead start 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.771+0000 7fe95b5c1640 1 -- 172.21.15.37:0/4103831908 shutdown_connections 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.771+0000 7fe95b5c1640 1 -- 172.21.15.37:0/4103831908 >> 172.21.15.37:0/4103831908 conn(0x7fe9540d4fe0 msgr2=0x7fe9540d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.771+0000 7fe95b5c1640 1 -- 172.21.15.37:0/4103831908 shutdown_connections 2024-05-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.771+0000 7fe95b5c1640 1 -- 172.21.15.37:0/4103831908 wait complete. 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.772+0000 7fe95b5c1640 1 Processor -- start 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.772+0000 7fe95b5c1640 1 -- start start 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe95b5c1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940004d40 0x7fe95406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe95b5c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe954152da0 0x7fe95406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe95b5c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9540b9750 0x7fe9540b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe95b5c1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9540cf440 con 0x7fe9540b9750 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe95b5c1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9540cf2c0 con 0x7fe940004d40 2024-05-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe95b5c1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe9540d2dc0 con 0x7fe954152da0 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9540b9750 0x7fe9540b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9540b9750 0x7fe9540b9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58394/0 (socket says 172.21.15.37:58394) 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 -- 172.21.15.37:0/1646989857 learned_addr learned my addr 172.21.15.37:0/1646989857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe958b5c640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe954152da0 0x7fe95406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe95935d640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940004d40 0x7fe95406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 -- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe954152da0 msgr2=0x7fe95406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe954152da0 0x7fe95406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 -- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940004d40 msgr2=0x7fe95406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940004d40 0x7fe95406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 -- 172.21.15.37:0/1646989857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9540cd2a0 con 0x7fe9540b9750 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.773+0000 7fe959b5e640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9540b9750 0x7fe9540b9c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001f70 tx=0x7fe94c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.774+0000 7fe949ffb640 1 -- 172.21.15.37:0/1646989857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c037040 con 0x7fe9540b9750 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.774+0000 7fe949ffb640 1 -- 172.21.15.37:0/1646989857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94c003e50 con 0x7fe9540b9750 2024-05-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.774+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9540cd580 con 0x7fe9540b9750 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.774+0000 7fe949ffb640 1 -- 172.21.15.37:0/1646989857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c007db0 con 0x7fe9540b9750 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.774+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9540cdb40 con 0x7fe9540b9750 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.775+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9540693f0 con 0x7fe9540b9750 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.776+0000 7fe949ffb640 1 -- 172.21.15.37:0/1646989857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe94c042020 con 0x7fe9540b9750 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.776+0000 7fe949ffb640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe938076300 0x7fe9380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.776+0000 7fe949ffb640 1 -- 172.21.15.37:0/1646989857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe94c0b6d80 con 0x7fe9540b9750 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.776+0000 7fe95935d640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe938076300 0x7fe9380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.777+0000 7fe95935d640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe938076300 0x7fe9380787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe950007ce0 tx=0x7fe950001020 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:37.781+0000 7fe949ffb640 1 -- 172.21.15.37:0/1646989857 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe94c080480 con 0x7fe9540b9750 2024-05-10T08:40:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.010+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe9540d5640 con 0x7fe9540b9750 2024-05-10T08:40:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.010+0000 7fe949ffb640 1 -- 172.21.15.37:0/1646989857 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fe94c0b8070 con 0x7fe9540b9750 2024-05-10T08:40:38.010 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T08:40:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe938076300 msgr2=0x7fe9380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe938076300 0x7fe9380787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe950007ce0 tx=0x7fe950001020 comp rx=0 tx=0).stop 2024-05-10T08:40:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9540b9750 msgr2=0x7fe9540b9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9540b9750 0x7fe9540b9c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001f70 tx=0x7fe94c0014a0 comp rx=0 tx=0).stop 2024-05-10T08:40:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 shutdown_connections 2024-05-10T08:40:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe938076300 0x7fe9380787c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9540b9750 0x7fe9540b9c00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe954152da0 0x7fe95406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 --2- 172.21.15.37:0/1646989857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe940004d40 0x7fe95406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 >> 172.21.15.37:0/1646989857 conn(0x7fe9540d4fe0 msgr2=0x7fe9540b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 shutdown_connections 2024-05-10T08:40:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38.012+0000 7fe95b5c1640 1 -- 172.21.15.37:0/1646989857 wait complete. 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:40:38.023 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:40:38.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:38.023 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:40:38.039 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:38.039 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:40:38.040 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42724sec preferred_lft 42724sec 2024-05-10T08:40:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:40:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:38.041 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:38.041 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:40:38.041 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T08:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-05-10T08:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-05-10T08:40:38.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-05-10T08:40:38.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T08:40:38.042 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:38.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:38.183 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:40:38.207 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:40:38.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:38.209 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:40:38.266 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:40:38.266 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:40:38.267 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:40:38.267 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:40:38.267 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:40:38.267 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:38.267 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:38.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:40:38.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:40:38.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:40:38.267 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:38.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:38.397 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:40:38.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:38.414 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-05-10T08:40:38.469 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:38.469 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:38.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:40:38.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T08:40:38.470 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:38.589 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T08:40:38.589 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:38.590 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:38.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T08:40:38.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T08:40:38.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T08:40:38.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T08:40:38.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T08:40:38.590 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:38.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:38.707 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:38.707 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:38.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:40:38.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T08:40:38.708 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:38.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:38.790 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:40:38.805 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:40:38.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:38.806 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:40:38.861 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:40:38.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:38.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:40:38.947 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:40:38.947 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:40:38.947 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:40:39.073 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:40:39.073 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:40:39.073 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:40:39.073 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:39.073 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:39.089 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:40:39.089 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:40:39.089 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:40:39.089 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:39.089 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:40:39.090 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:40:39.092 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:40:39.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:39.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:40:39.118 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:39.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:39.216 INFO:teuthology.orchestra.run.smithi037.stdout:client4603 2024-05-10T08:40:39.217 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:39.217 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:39.235 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:client4603 2024-05-10T08:40:39.334 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:39.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:39.393 INFO:teuthology.orchestra.run.smithi037.stdout:client4603 2024-05-10T08:40:39.393 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ef49677-880e-4a90-bdff-f8e0a7cb5aaa.client4603/status') 2024-05-10T08:40:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4603 (3)172.21.15.37:0/619048237 2024-05-10T08:40:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-05-10T08:40:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-05-10T08:40:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-05-10T08:40:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:69 bytes copied, 2.7982e-05 s, 2.5 MB/s 2024-05-10T08:40:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:39.462 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-10T08:40:39.462 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T08:40:39.462 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T08:40:39.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:40:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.569+0000 7faf2d272640 1 Processor -- start 2024-05-10T08:40:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.569+0000 7faf2d272640 1 -- start start 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf2d272640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf2806e0f0 0x7faf2815c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf2d272640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2815c920 con 0x7faf28072840 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf2d272640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2815cc00 con 0x7faf2806e4d0 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf2d272640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7faf2815cee0 con 0x7faf2806e0f0 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf1e7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf28072840 0x7faf280d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35168/0 (socket says 172.21.15.37:35168) 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf1e7fc640 1 -- 172.21.15.37:0/1717543422 learned_addr learned my addr 172.21.15.37:0/1717543422 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf26ffd640 1 --2- 172.21.15.37:0/1717543422 >> v2:172.21.15.82:3300/0 conn(0x7faf2806e0f0 0x7faf2815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf267fc640 1 -- 172.21.15.37:0/1717543422 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124821051 0 0) 0x7faf2815c920 con 0x7faf28072840 2024-05-10T08:40:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.570+0000 7faf267fc640 1 -- 172.21.15.37:0/1717543422 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf14003520 con 0x7faf28072840 2024-05-10T08:40:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.571+0000 7faf26ffd640 1 -- 172.21.15.37:0/1717543422 >> v1:172.21.15.82:6789/0 conn(0x7faf2806e4d0 legacy=0x7faf280aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.571+0000 7faf26ffd640 1 -- 172.21.15.37:0/1717543422 >> v1:172.21.15.37:6789/0 conn(0x7faf28072840 legacy=0x7faf280d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.571+0000 7faf26ffd640 1 -- 172.21.15.37:0/1717543422 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2815d1c0 con 0x7faf2806e0f0 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.571+0000 7faf26ffd640 1 --2- 172.21.15.37:0/1717543422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2806e0f0 0x7faf2815c340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf180097a0 tx=0x7faf1802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51282b0d83a5b43f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf267fc640 1 -- 172.21.15.37:0/1717543422 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18037070 con 0x7faf2806e0f0 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf267fc640 1 -- 172.21.15.37:0/1717543422 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18032440 con 0x7faf2806e0f0 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf267fc640 1 -- 172.21.15.37:0/1717543422 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf180327f0 con 0x7faf2806e0f0 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf2d272640 1 -- 172.21.15.37:0/1717543422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2806e0f0 msgr2=0x7faf2815c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf2d272640 1 --2- 172.21.15.37:0/1717543422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2806e0f0 0x7faf2815c340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf180097a0 tx=0x7faf1802a230 comp rx=0 tx=0).stop 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf2d272640 1 -- 172.21.15.37:0/1717543422 shutdown_connections 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf2d272640 1 --2- 172.21.15.37:0/1717543422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2806e0f0 0x7faf2815c340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf2d272640 1 -- 172.21.15.37:0/1717543422 >> 172.21.15.37:0/1717543422 conn(0x7faf2806c3a0 msgr2=0x7faf2806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:39.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf2d272640 1 -- 172.21.15.37:0/1717543422 shutdown_connections 2024-05-10T08:40:39.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.572+0000 7faf2d272640 1 -- 172.21.15.37:0/1717543422 wait complete. 2024-05-10T08:40:39.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.573+0000 7faf2d272640 1 Processor -- start 2024-05-10T08:40:39.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf2d272640 1 -- start start 2024-05-10T08:40:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf2d272640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf2806e0f0 0x7faf2814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf2d272640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf2806e4d0 0x7faf280ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf2d272640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf28072840 0x7faf2815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf2d272640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf280ae7d0 con 0x7faf2806e0f0 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf2d272640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf280ae650 con 0x7faf28072840 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf2d272640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7faf281530b0 con 0x7faf2806e4d0 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf26ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf2806e0f0 0x7faf2814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf26ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf2806e0f0 0x7faf2814e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58400/0 (socket says 172.21.15.37:58400) 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.574+0000 7faf26ffd640 1 -- 172.21.15.37:0/923826191 learned_addr learned my addr 172.21.15.37:0/923826191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf277fe640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf28072840 0x7faf2815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf1e7fc640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf2806e4d0 0x7faf280ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf26ffd640 1 -- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf2806e4d0 msgr2=0x7faf280ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf26ffd640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf2806e4d0 0x7faf280ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf26ffd640 1 -- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf28072840 msgr2=0x7faf2815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf26ffd640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf28072840 0x7faf2815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf26ffd640 1 -- 172.21.15.37:0/923826191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf280cd9d0 con 0x7faf2806e0f0 2024-05-10T08:40:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf277fe640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf28072840 0x7faf2815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf1e7fc640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf2806e4d0 0x7faf280ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf26ffd640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf2806e0f0 0x7faf2814e6e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf180097a0 tx=0x7faf180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf1ffff640 1 -- 172.21.15.37:0/923826191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18037050 con 0x7faf2806e0f0 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf1ffff640 1 -- 172.21.15.37:0/923826191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18038040 con 0x7faf2806e0f0 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf280cdcb0 con 0x7faf2806e0f0 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf1ffff640 1 -- 172.21.15.37:0/923826191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18004470 con 0x7faf2806e0f0 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.575+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf280ce270 con 0x7faf2806e0f0 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.576+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf280693f0 con 0x7faf2806e0f0 2024-05-10T08:40:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.577+0000 7faf1ffff640 1 -- 172.21.15.37:0/923826191 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf1803c6d0 con 0x7faf2806e0f0 2024-05-10T08:40:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.577+0000 7faf1ffff640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf080762d0 0x7faf08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.577+0000 7faf1ffff640 1 -- 172.21.15.37:0/923826191 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faf180b8380 con 0x7faf2806e0f0 2024-05-10T08:40:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.578+0000 7faf1e7fc640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf080762d0 0x7faf08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.578+0000 7faf1e7fc640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf080762d0 0x7faf08078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faf10007fd0 tx=0x7faf10009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.582+0000 7faf1ffff640 1 -- 172.21.15.37:0/923826191 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7faf18081990 con 0x7faf2806e0f0 2024-05-10T08:40:39.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.820+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faf28151f40 con 0x7faf2806e0f0 2024-05-10T08:40:39.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.821+0000 7faf1ffff640 1 -- 172.21.15.37:0/923826191 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7faf18081290 con 0x7faf2806e0f0 2024-05-10T08:40:39.820 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T08:40:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf080762d0 msgr2=0x7faf08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf080762d0 0x7faf08078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faf10007fd0 tx=0x7faf10009040 comp rx=0 tx=0).stop 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf2806e0f0 msgr2=0x7faf2814e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf2806e0f0 0x7faf2814e6e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf180097a0 tx=0x7faf180046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 shutdown_connections 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf080762d0 0x7faf08078790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf28072840 0x7faf2815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf2806e4d0 0x7faf280ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 --2- 172.21.15.37:0/923826191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf2806e0f0 0x7faf2814e6e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 >> 172.21.15.37:0/923826191 conn(0x7faf2806c3a0 msgr2=0x7faf2806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 shutdown_connections 2024-05-10T08:40:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:39.823+0000 7faf2d272640 1 -- 172.21.15.37:0/923826191 wait complete. 2024-05-10T08:40:39.833 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T08:40:39.833 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:40:39.833 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:40:39.833 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-10T08:40:39.833 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T08:40:39.834 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T08:40:39.834 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T08:40:39.834 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:40:39.834 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-10T08:40:39.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:39.834 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:40:39.851 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42722sec preferred_lft 42722sec 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:39.852 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link tentative 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link tentative 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:39.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:39.854 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:40:39.916 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:40:39.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:39.918 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:40:39.974 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:40:39.974 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:40:39.974 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:40:39.974 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:40:39.974 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:40:39.975 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:39.975 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:39.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:40:39.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:40:39.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:40:39.975 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:40.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:40.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:40.104 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:40:40.119 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:40:40.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:40.120 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-05-10T08:40:40.175 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-10T08:40:40.176 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:40.176 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:40.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:40:40.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-10T08:40:40.176 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:40.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:40.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:40.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5a:a7:0d:c7:ed:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T08:40:40.322 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.323 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::58a7:dff:fec7:edb6/64 scope link 2024-05-10T08:40:40.323 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:40.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5a:a7:0d:c7:ed:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T08:40:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.391 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::58a7:dff:fec7:edb6/64 scope link 2024-05-10T08:40:40.391 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:40.391 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-10T08:40:40.391 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:40.391 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:40.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-10T08:40:40.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T08:40:40.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-10T08:40:40.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-10T08:40:40.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-10T08:40:40.392 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:40.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:40.549 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:40.549 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:40:40.549 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2024-05-10T08:40:40.549 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T08:40:40.549 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:40:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:40.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:40.628 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-10T08:40:40.656 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-10T08:40:40.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:40.657 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-10T08:40:40.711 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:40:40.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:40.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T08:40:40.797 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T08:40:40.798 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T08:40:40.798 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:40:40.805 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T08:40:40.805 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T08:40:40.805 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:40:40.805 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:40.805 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:40:40.811 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:40:40.812 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-10T08:40:40.812 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:40:40.812 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:40:40.812 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:40:40.812 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:40:40.814 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:40:40.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:40.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-10T08:40:40.839 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:40.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:40.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:40.937 INFO:teuthology.orchestra.run.smithi037.stdout:client4615 2024-05-10T08:40:40.938 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:40.938 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:40.955 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:41.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:41.052 INFO:teuthology.orchestra.run.smithi037.stdout:client4615 2024-05-10T08:40:41.053 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:41.110 INFO:teuthology.orchestra.run.smithi037.stdout:client4615 2024-05-10T08:40:41.111 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ef49677-880e-4a90-bdff-f8e0a7cb5aaa.client4615/status') 2024-05-10T08:40:41.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:41.170 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4615 (3)172.21.15.37:0/536501036 2024-05-10T08:40:41.171 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-05-10T08:40:41.171 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-05-10T08:40:41.171 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-05-10T08:40:41.171 INFO:teuthology.orchestra.run.smithi037.stderr:69 bytes copied, 2.446e-05 s, 2.8 MB/s 2024-05-10T08:40:41.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:41.178 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-10T08:40:41.178 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T08:40:41.178 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T08:40:41.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:40:41.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.283+0000 7f3933475640 1 Processor -- start 2024-05-10T08:40:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.283+0000 7f3933475640 1 -- start start 2024-05-10T08:40:41.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3933475640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 0x7f392c0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3933475640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c163d80 con 0x7f392c071110 2024-05-10T08:40:41.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3933475640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c0d1300 con 0x7f392c163920 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3933475640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0d10d0 con 0x7f392c070d30 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3931a12640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f392c071110 0x7f392c06d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35184/0 (socket says 172.21.15.37:35184) 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3931a12640 1 -- 172.21.15.37:0/345973222 learned_addr learned my addr 172.21.15.37:0/345973222 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3931211640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 0x7f392c0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179751737 0 0) 0x7f392c163d80 con 0x7f392c071110 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3914003520 con 0x7f392c071110 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84769663 0 0) 0x7f392c0d1300 con 0x7f392c163920 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f392c163d80 con 0x7f392c163920 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1121710862 0 0) 0x7f3914003520 con 0x7f392c071110 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 msgr2=0x7f392c0d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 0x7f392c0d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 >> v1:172.21.15.82:6789/0 conn(0x7f392c163920 legacy=0x7f392c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0d15e0 con 0x7f392c071110 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f391c0019f0 con 0x7f392c071110 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 >> v1:172.21.15.37:6789/0 conn(0x7f392c071110 legacy=0x7f392c06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 0x7f3914003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f3914004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914004d40 0x7f39140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f391400ba70 con 0x7f39140040d0 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f391400bc20 con 0x7f3914004d40 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f391400be20 con 0x7f392c070d30 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3930a10640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f3914004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3931211640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 0x7f3914003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3931a12640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914004d40 0x7f39140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3930a10640 1 -- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 msgr2=0x7f3914003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3930a10640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c070d30 0x7f3914003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3930a10640 1 -- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914004d40 msgr2=0x7f39140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3930a10640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914004d40 0x7f39140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.284+0000 7f3930a10640 1 -- 172.21.15.37:0/345973222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3914003520 con 0x7f39140040d0 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.285+0000 7f3930a10640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f3914004800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f39200018a0 tx=0x7f3914005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a66b7719199a30 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.285+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39200014f0 con 0x7f39140040d0 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.285+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39200052d0 con 0x7f39140040d0 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.285+0000 7f392bfff640 1 -- 172.21.15.37:0/345973222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392002ac60 con 0x7f39140040d0 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.285+0000 7f3933475640 1 -- 172.21.15.37:0/345973222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 msgr2=0x7f3914004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.285+0000 7f3933475640 1 --2- 172.21.15.37:0/345973222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f3914004800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f39200018a0 tx=0x7f3914005830 comp rx=0 tx=0).stop 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.285+0000 7f3931a12640 1 -- 172.21.15.37:0/345973222 reap_dead start 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.286+0000 7f3933475640 1 -- 172.21.15.37:0/345973222 shutdown_connections 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.286+0000 7f3933475640 1 -- 172.21.15.37:0/345973222 >> 172.21.15.37:0/345973222 conn(0x7f392c0d2e90 msgr2=0x7f392c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.286+0000 7f3933475640 1 -- 172.21.15.37:0/345973222 shutdown_connections 2024-05-10T08:40:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.286+0000 7f3933475640 1 -- 172.21.15.37:0/345973222 wait complete. 2024-05-10T08:40:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.287+0000 7f3933475640 1 Processor -- start 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.287+0000 7f3933475640 1 -- start start 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3933475640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f392c0b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3933475640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c0b6fd0 0x7f392c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3933475640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c0b78e0 0x7f392c161bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3933475640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0d1c30 con 0x7f39140040d0 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3933475640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f392c070b80 con 0x7f392c0b6fd0 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3933475640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0715a0 con 0x7f392c0b78e0 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f392c0b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f392c0b87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58422/0 (socket says 172.21.15.37:58422) 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 -- 172.21.15.37:0/171188508 learned_addr learned my addr 172.21.15.37:0/171188508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931a12640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c0b78e0 0x7f392c161bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3930a10640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c0b6fd0 0x7f392c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 -- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c0b78e0 msgr2=0x7f392c161bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c0b78e0 0x7f392c161bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 -- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c0b6fd0 msgr2=0x7f392c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c0b6fd0 0x7f392c156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 -- 172.21.15.37:0/171188508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0b5f30 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.288+0000 7f3931211640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f392c0b87d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39240119a0 tx=0x7f3924011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.289+0000 7f3929ffb640 1 -- 172.21.15.37:0/171188508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392400fa90 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.289+0000 7f3929ffb640 1 -- 172.21.15.37:0/171188508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392400fc30 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.289+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c0b6210 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.289+0000 7f3929ffb640 1 -- 172.21.15.37:0/171188508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924014440 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.289+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c0b67d0 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.290+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c06fc30 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.290+0000 7f3929ffb640 1 -- 172.21.15.37:0/171188508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3924012040 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.291+0000 7f3929ffb640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3918076300 0x7f39180787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.291+0000 7f3929ffb640 1 -- 172.21.15.37:0/171188508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3924097dc0 con 0x7f39140040d0 2024-05-10T08:40:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.291+0000 7f3930a10640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3918076300 0x7f39180787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.292+0000 7f3930a10640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3918076300 0x7f39180787c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3920032000 tx=0x7f3920009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.296+0000 7f3929ffb640 1 -- 172.21.15.37:0/171188508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f392c06fc30 con 0x7f39140040d0 2024-05-10T08:40:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.532+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f392c0693f0 con 0x7f39140040d0 2024-05-10T08:40:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.532+0000 7f3929ffb640 1 -- 172.21.15.37:0/171188508 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f3924019030 con 0x7f39140040d0 2024-05-10T08:40:41.531 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T08:40:41.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.534+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3918076300 msgr2=0x7f39180787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:41.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3918076300 0x7f39180787c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3920032000 tx=0x7f3920009030 comp rx=0 tx=0).stop 2024-05-10T08:40:41.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 msgr2=0x7f392c0b87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f392c0b87d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39240119a0 tx=0x7f3924011e60 comp rx=0 tx=0).stop 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 shutdown_connections 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3918076300 0x7f39180787c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f392c0b78e0 0x7f392c161bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c0b6fd0 0x7f392c156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 --2- 172.21.15.37:0/171188508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140040d0 0x7f392c0b87d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 >> 172.21.15.37:0/171188508 conn(0x7f392c0d2e90 msgr2=0x7f392c06e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 shutdown_connections 2024-05-10T08:40:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:41.535+0000 7f3933475640 1 -- 172.21.15.37:0/171188508 wait complete. 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:40:41.544 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-10T08:40:41.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:41.545 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-10T08:40:41.564 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:41.564 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:41.564 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:41.565 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:41.566 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:40:41.566 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:41.566 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T08:40:41.566 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42634sec preferred_lft 42634sec 2024-05-10T08:40:41.566 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-10T08:40:41.566 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:41.566 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T08:40:41.566 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:41.566 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:41.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-05-10T08:40:41.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-05-10T08:40:41.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-05-10T08:40:41.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T08:40:41.567 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:41.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:41.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:41.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:41.846 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:40:41.871 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-10T08:40:41.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:41.873 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-10T08:40:41.940 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-10T08:40:41.940 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:40:41.940 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T08:40:41.940 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T08:40:41.940 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:40:41.940 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:41.941 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:41.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T08:40:41.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T08:40:41.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T08:40:41.941 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:42.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:42.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:42.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:42.231 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T08:40:42.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:42.247 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-05-10T08:40:42.303 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:42.303 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:42.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T08:40:42.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-10T08:40:42.303 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:42.421 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-10T08:40:42.421 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:42.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:42.549 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:42.549 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:42.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-05-10T08:40:42.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T08:40:42.549 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:42.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:42.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:42.627 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-10T08:40:42.642 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-10T08:40:42.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:42.642 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-10T08:40:42.697 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:40:42.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:42.698 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T08:40:42.792 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T08:40:43.000 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T08:40:43.000 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T08:40:43.001 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T08:40:43.001 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T08:40:43.001 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T08:40:43.001 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:40:43.002 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:40:43.003 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:40:43.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:40:43.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:43.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-10T08:40:43.028 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:43.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:43.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:43.125 INFO:teuthology.orchestra.run.smithi082.stdout:client4707 2024-05-10T08:40:43.125 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:43.125 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:43.141 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:43.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:43.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:43.237 INFO:teuthology.orchestra.run.smithi082.stdout:client4707 2024-05-10T08:40:43.237 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:43.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:43.293 INFO:teuthology.orchestra.run.smithi082.stdout:client4707 2024-05-10T08:40:43.293 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ef49677-880e-4a90-bdff-f8e0a7cb5aaa.client4707/status') 2024-05-10T08:40:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:43.352 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4707 (3)172.21.15.82:0/709200032 2024-05-10T08:40:43.352 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-05-10T08:40:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-05-10T08:40:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-05-10T08:40:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:69 bytes copied, 2.2695e-05 s, 3.0 MB/s 2024-05-10T08:40:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:43.359 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-10T08:40:43.359 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T08:40:43.359 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T08:40:43.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:40:43.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.476+0000 7f6a5c1af640 1 Processor -- start 2024-05-10T08:40:43.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.476+0000 7f6a5c1af640 1 -- start start 2024-05-10T08:40:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.477+0000 7f6a5c1af640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6a540d3cd0 0x7f6a540cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.477+0000 7f6a5c1af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a540d3330 con 0x7f6a540c9ee0 2024-05-10T08:40:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.477+0000 7f6a5c1af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a540d2170 con 0x7f6a541629a0 2024-05-10T08:40:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.477+0000 7f6a5c1af640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6a540d2450 con 0x7f6a540d3cd0 2024-05-10T08:40:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.477+0000 7f6a5a74c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6a540c9ee0 0x7f6a540d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35186/0 (socket says 172.21.15.37:35186) 2024-05-10T08:40:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.477+0000 7f6a5a74c640 1 -- 172.21.15.37:0/2913833343 learned_addr learned my addr 172.21.15.37:0/2913833343 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.477+0000 7f6a5974a640 1 --2- 172.21.15.37:0/2913833343 >> v2:172.21.15.82:3300/0 conn(0x7f6a540d3cd0 0x7f6a540cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.478+0000 7f6a58f49640 1 -- 172.21.15.37:0/2913833343 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565256675 0 0) 0x7f6a540d3330 con 0x7f6a540c9ee0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.478+0000 7f6a58f49640 1 -- 172.21.15.37:0/2913833343 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a40003520 con 0x7f6a540c9ee0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.478+0000 7f6a58f49640 1 -- 172.21.15.37:0/2913833343 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1784202330 0 0) 0x7f6a540d2170 con 0x7f6a541629a0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.478+0000 7f6a58f49640 1 -- 172.21.15.37:0/2913833343 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a540d3330 con 0x7f6a541629a0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.478+0000 7f6a5974a640 1 -- 172.21.15.37:0/2913833343 >> v1:172.21.15.82:6789/0 conn(0x7f6a541629a0 legacy=0x7f6a540d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.478+0000 7f6a5974a640 1 -- 172.21.15.37:0/2913833343 >> v1:172.21.15.37:6789/0 conn(0x7f6a540c9ee0 legacy=0x7f6a540d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.478+0000 7f6a5974a640 1 -- 172.21.15.37:0/2913833343 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540d2730 con 0x7f6a540d3cd0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a5974a640 1 --2- 172.21.15.37:0/2913833343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a540d3cd0 0x7f6a540cfca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097a0 tx=0x7f6a4402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba2d0b24ddf1ce1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a58f49640 1 -- 172.21.15.37:0/2913833343 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037070 con 0x7f6a540d3cd0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a58f49640 1 -- 172.21.15.37:0/2913833343 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44032440 con 0x7f6a540d3cd0 2024-05-10T08:40:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a58f49640 1 -- 172.21.15.37:0/2913833343 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4402ae60 con 0x7f6a540d3cd0 2024-05-10T08:40:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a5c1af640 1 -- 172.21.15.37:0/2913833343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a540d3cd0 msgr2=0x7f6a540cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/2913833343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a540d3cd0 0x7f6a540cfca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097a0 tx=0x7f6a4402a110 comp rx=0 tx=0).stop 2024-05-10T08:40:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a5c1af640 1 -- 172.21.15.37:0/2913833343 shutdown_connections 2024-05-10T08:40:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/2913833343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a540d3cd0 0x7f6a540cfca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a5c1af640 1 -- 172.21.15.37:0/2913833343 >> 172.21.15.37:0/2913833343 conn(0x7f6a540d4fe0 msgr2=0x7f6a540d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.479+0000 7f6a5c1af640 1 -- 172.21.15.37:0/2913833343 shutdown_connections 2024-05-10T08:40:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.480+0000 7f6a5c1af640 1 -- 172.21.15.37:0/2913833343 wait complete. 2024-05-10T08:40:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.481+0000 7f6a5c1af640 1 Processor -- start 2024-05-10T08:40:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.481+0000 7f6a5c1af640 1 -- start start 2024-05-10T08:40:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.481+0000 7f6a5c1af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a540c9ee0 0x7f6a541f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5c1af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a540d3cd0 0x7f6a540a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5c1af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a541629a0 0x7f6a541f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5c1af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540cf440 con 0x7f6a540d3cd0 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5c1af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540cf2c0 con 0x7f6a541629a0 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5c1af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6a540d2dc0 con 0x7f6a540c9ee0 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a540d3cd0 0x7f6a540a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a540d3cd0 0x7f6a540a27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58428/0 (socket says 172.21.15.37:58428) 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 -- 172.21.15.37:0/3540099364 learned_addr learned my addr 172.21.15.37:0/3540099364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5a74c640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a541629a0 0x7f6a541f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a59f4b640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a540c9ee0 0x7f6a541f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 -- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a540c9ee0 msgr2=0x7f6a541f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a540c9ee0 0x7f6a541f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 -- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a541629a0 msgr2=0x7f6a541f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a541629a0 0x7f6a541f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 -- 172.21.15.37:0/3540099364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a541f84d0 con 0x7f6a540d3cd0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5974a640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a540d3cd0 0x7f6a540a27e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a44035040 tx=0x7f6a440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a4a7fc640 1 -- 172.21.15.37:0/3540099364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037040 con 0x7f6a540d3cd0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a4a7fc640 1 -- 172.21.15.37:0/3540099364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44042070 con 0x7f6a540d3cd0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a540b87b0 con 0x7f6a540d3cd0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.482+0000 7f6a4a7fc640 1 -- 172.21.15.37:0/3540099364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44030940 con 0x7f6a540d3cd0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.483+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a540b8a50 con 0x7f6a540d3cd0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.483+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a540693f0 con 0x7f6a540d3cd0 2024-05-10T08:40:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.484+0000 7f6a4a7fc640 1 -- 172.21.15.37:0/3540099364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a44030ae0 con 0x7f6a540d3cd0 2024-05-10T08:40:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.485+0000 7f6a4a7fc640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6a38076300 0x7f6a380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.485+0000 7f6a4a7fc640 1 -- 172.21.15.37:0/3540099364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6a440b80b0 con 0x7f6a540d3cd0 2024-05-10T08:40:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.485+0000 7f6a59f4b640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6a38076300 0x7f6a380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.486+0000 7f6a59f4b640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6a38076300 0x7f6a380787c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a50007fd0 tx=0x7f6a50009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.489+0000 7f6a4a7fc640 1 -- 172.21.15.37:0/3540099364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6a44081080 con 0x7f6a540d3cd0 2024-05-10T08:40:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.717+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6a540cb4e0 con 0x7f6a540d3cd0 2024-05-10T08:40:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.718+0000 7f6a4a7fc640 1 -- 172.21.15.37:0/3540099364 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f6a44085380 con 0x7f6a540d3cd0 2024-05-10T08:40:43.717 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T08:40:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6a38076300 msgr2=0x7f6a380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6a38076300 0x7f6a380787c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a50007fd0 tx=0x7f6a50009040 comp rx=0 tx=0).stop 2024-05-10T08:40:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a540d3cd0 msgr2=0x7f6a540a27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a540d3cd0 0x7f6a540a27e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a44035040 tx=0x7f6a440046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 shutdown_connections 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6a38076300 0x7f6a380787c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a541629a0 0x7f6a541f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a540d3cd0 0x7f6a540a27e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 --2- 172.21.15.37:0/3540099364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a540c9ee0 0x7f6a541f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.719+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 >> 172.21.15.37:0/3540099364 conn(0x7f6a540d4fe0 msgr2=0x7f6a5415d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.720+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 shutdown_connections 2024-05-10T08:40:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:43.720+0000 7f6a5c1af640 1 -- 172.21.15.37:0/3540099364 wait complete. 2024-05-10T08:40:43.730 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T08:40:43.730 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:40:43.730 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-10T08:40:43.730 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-10T08:40:43.730 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T08:40:43.731 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T08:40:43.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T08:40:43.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:40:43.731 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-10T08:40:43.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:43.731 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-10T08:40:43.748 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:43.748 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42632sec preferred_lft 42632sec 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:40:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ca:ff:95:bd:64:6c brd ff:ff:ff:ff:ff:ff 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4b4:35ff:fe2c:3e0d/64 scope link 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ca:ff:95:bd:64:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c8ff:95ff:febd:646c/64 scope link 2024-05-10T08:40:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:43.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:43.751 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:40:43.812 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-10T08:40:43.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:43.814 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-10T08:40:43.871 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-10T08:40:43.872 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:40:43.872 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T08:40:43.872 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T08:40:43.872 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:40:43.872 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:43.872 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:43.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T08:40:43.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T08:40:43.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T08:40:43.872 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:43.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:43.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:43.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:43.997 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T08:40:44.013 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T08:40:44.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:44.014 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-05-10T08:40:44.069 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-10T08:40:44.069 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:44.069 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:44.069 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T08:40:44.069 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-10T08:40:44.069 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:44.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:44.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:44.187 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7a:a2:91:36:d6:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::78a2:91ff:fe36:d652/64 scope link tentative 2024-05-10T08:40:44.211 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:44.212 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7a:a2:91:36:d6:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T08:40:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T08:40:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::78a2:91ff:fe36:d652/64 scope link tentative 2024-05-10T08:40:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:40:44.279 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-10T08:40:44.279 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:44.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:44.431 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:40:44.432 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T08:40:44.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2024-05-10T08:40:44.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T08:40:44.432 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T08:40:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:44.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:44.509 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-10T08:40:44.524 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-10T08:40:44.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:40:44.525 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-10T08:40:44.580 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:40:44.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:44.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T08:40:44.664 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T08:40:44.664 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T08:40:44.665 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T08:40:44.673 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T08:40:44.673 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T08:40:44.673 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T08:40:44.673 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:44.673 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:40:44.688 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:40:44.689 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-10T08:40:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:40:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:40:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:40:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:40:44.690 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:40:44.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:44.690 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-10T08:40:44.755 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:44.854 INFO:teuthology.orchestra.run.smithi082.stdout:client4633 2024-05-10T08:40:44.855 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:44.855 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:44.871 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:44.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:44.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:44.967 INFO:teuthology.orchestra.run.smithi082.stdout:client4633 2024-05-10T08:40:44.968 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:40:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:40:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:45.026 INFO:teuthology.orchestra.run.smithi082.stdout:client4633 2024-05-10T08:40:45.026 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ef49677-880e-4a90-bdff-f8e0a7cb5aaa.client4633/status') 2024-05-10T08:40:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:40:45.084 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4633 (3)192.168.0.2:0/1185590673 2024-05-10T08:40:45.084 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-05-10T08:40:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-05-10T08:40:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-05-10T08:40:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:69 bytes copied, 3.8466e-05 s, 1.8 MB/s 2024-05-10T08:40:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T08:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:40:45.092 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-10T08:40:45.189 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T08:40:45.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:45.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.306+0000 7f3e71722640 1 Processor -- start 2024-05-10T08:40:45.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.306+0000 7f3e71722640 1 -- start start 2024-05-10T08:40:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.307+0000 7f3e71722640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3e6c15d180 0x7f3e6c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.307+0000 7f3e71722640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e6c09ff30 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.307+0000 7f3e71722640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e6c15d750 con 0x7f3e6c0aedf0 2024-05-10T08:40:45.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.307+0000 7f3e71722640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3e6c15e360 con 0x7f3e6c15d180 2024-05-10T08:40:45.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.307+0000 7f3e6affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3e6c06c3a0 0x7f3e6c06c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35188/0 (socket says 172.21.15.37:35188) 2024-05-10T08:40:45.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.307+0000 7f3e6affd640 1 -- 172.21.15.37:0/2697085422 learned_addr learned my addr 172.21.15.37:0/2697085422 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.308+0000 7f3e6b7fe640 1 --2- 172.21.15.37:0/2697085422 >> v2:172.21.15.82:3300/0 conn(0x7f3e6c15d180 0x7f3e6c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.308+0000 7f3e69ffb640 1 -- 172.21.15.37:0/2697085422 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019492157 0 0) 0x7f3e6c09ff30 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.308+0000 7f3e69ffb640 1 -- 172.21.15.37:0/2697085422 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e58003520 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.308+0000 7f3e6b7fe640 1 -- 172.21.15.37:0/2697085422 >> v1:172.21.15.82:6789/0 conn(0x7f3e6c0aedf0 legacy=0x7f3e6c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.308+0000 7f3e69ffb640 1 -- 172.21.15.37:0/2697085422 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2754096912 0 0) 0x7f3e58003520 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.308+0000 7f3e6b7fe640 1 -- 172.21.15.37:0/2697085422 >> v1:172.21.15.37:6789/0 conn(0x7f3e6c06c3a0 legacy=0x7f3e6c06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.308+0000 7f3e6b7fe640 1 -- 172.21.15.37:0/2697085422 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c15da30 con 0x7f3e6c15d180 2024-05-10T08:40:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e6b7fe640 1 --2- 172.21.15.37:0/2697085422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c0b13f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009d90 tx=0x7f3e5c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=751cd7021c5decf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e69ffb640 1 -- 172.21.15.37:0/2697085422 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64001670 con 0x7f3e6c15d180 2024-05-10T08:40:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e69ffb640 1 -- 172.21.15.37:0/2697085422 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c007540 con 0x7f3e6c15d180 2024-05-10T08:40:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e69ffb640 1 -- 172.21.15.37:0/2697085422 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c007910 con 0x7f3e6c15d180 2024-05-10T08:40:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e71722640 1 -- 172.21.15.37:0/2697085422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 msgr2=0x7f3e6c0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e71722640 1 --2- 172.21.15.37:0/2697085422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c0b13f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009d90 tx=0x7f3e5c02a680 comp rx=0 tx=0).stop 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e71722640 1 -- 172.21.15.37:0/2697085422 shutdown_connections 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.309+0000 7f3e71722640 1 --2- 172.21.15.37:0/2697085422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c0b13f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.310+0000 7f3e71722640 1 -- 172.21.15.37:0/2697085422 >> 172.21.15.37:0/2697085422 conn(0x7f3e6c0b3b10 msgr2=0x7f3e6c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.310+0000 7f3e71722640 1 -- 172.21.15.37:0/2697085422 shutdown_connections 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.310+0000 7f3e71722640 1 -- 172.21.15.37:0/2697085422 wait complete. 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.311+0000 7f3e71722640 1 Processor -- start 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.311+0000 7f3e71722640 1 -- start start 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e71722640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c06c3a0 0x7f3e6c156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e71722640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3e6c0aedf0 0x7f3e6c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e71722640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e71722640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c0b6130 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e71722640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c15dff0 con 0x7f3e6c15d180 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e71722640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6c0b62b0 con 0x7f3e6c0aedf0 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c06c3a0 0x7f3e6c156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c06c3a0 0x7f3e6c156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58430/0 (socket says 172.21.15.37:58430) 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 -- 172.21.15.37:0/933170794 learned_addr learned my addr 172.21.15.37:0/933170794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6b7fe640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6a7fc640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3e6c0aedf0 0x7f3e6c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 -- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3e6c0aedf0 msgr2=0x7f3e6c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3e6c0aedf0 0x7f3e6c15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 -- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 msgr2=0x7f3e6c154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 -- 172.21.15.37:0/933170794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c06fac0 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6b7fe640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6a7fc640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3e6c0aedf0 0x7f3e6c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.312+0000 7f3e6affd640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c06c3a0 0x7f3e6c156700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400c750 tx=0x7f3e6400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.313+0000 7f3e637fe640 1 -- 172.21.15.37:0/933170794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64017070 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.313+0000 7f3e637fe640 1 -- 172.21.15.37:0/933170794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e64005ad0 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.313+0000 7f3e637fe640 1 -- 172.21.15.37:0/933170794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64007070 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.313+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c06fda0 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.313+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c070360 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.314+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6c06a8f0 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.315+0000 7f3e637fe640 1 -- 172.21.15.37:0/933170794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e6401a070 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.315+0000 7f3e637fe640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3e4c0762d0 0x7f3e4c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.315+0000 7f3e637fe640 1 -- 172.21.15.37:0/933170794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e64096e70 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.315+0000 7f3e6a7fc640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3e4c0762d0 0x7f3e4c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.316+0000 7f3e6a7fc640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3e4c0762d0 0x7f3e4c078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e54007fd0 tx=0x7f3e54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.320+0000 7f3e637fe640 1 -- 172.21.15.37:0/933170794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3e64060490 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.516+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e6c0af8b0 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.518+0000 7f3e637fe640 1 -- 172.21.15.37:0/933170794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f3e6405fd90 con 0x7f3e6c06c3a0 2024-05-10T08:40:45.517 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:45.517 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:45.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3e4c0762d0 msgr2=0x7f3e4c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3e4c0762d0 0x7f3e4c078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e54007fd0 tx=0x7f3e54009040 comp rx=0 tx=0).stop 2024-05-10T08:40:45.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c06c3a0 msgr2=0x7f3e6c156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c06c3a0 0x7f3e6c156700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400c750 tx=0x7f3e6400cc10 comp rx=0 tx=0).stop 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 shutdown_connections 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3e4c0762d0 0x7f3e4c078790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c15d180 0x7f3e6c154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3e6c0aedf0 0x7f3e6c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 --2- 172.21.15.37:0/933170794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c06c3a0 0x7f3e6c156700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 >> 172.21.15.37:0/933170794 conn(0x7f3e6c0b3b10 msgr2=0x7f3e6c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 shutdown_connections 2024-05-10T08:40:45.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.520+0000 7f3e71722640 1 -- 172.21.15.37:0/933170794 wait complete. 2024-05-10T08:40:45.531 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T08:40:11.341540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T08:40:12.841074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T08:40:14.034037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T08:40:17.723570+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T08:40:45.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T08:40:45.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.638+0000 7f9cbe3c8640 1 Processor -- start 2024-05-10T08:40:45.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.638+0000 7f9cbe3c8640 1 -- start start 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbe3c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9cb815f450 0x7f9cb806d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbe3c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cb806df40 0x7f9cb80d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbe3c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb80d0cb0 con 0x7f9cb815f830 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbe3c8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb806d690 con 0x7f9cb806df40 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbe3c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb80d0f90 con 0x7f9cb815f450 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbc965640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cb806df40 0x7f9cb80d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbc965640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cb806df40 0x7f9cb80d3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58436/0 (socket says 172.21.15.37:58436) 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cbc965640 1 -- 172.21.15.37:0/1419910393 learned_addr learned my addr 172.21.15.37:0/1419910393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.639+0000 7f9cb7fff640 1 --2- 172.21.15.37:0/1419910393 >> v2:172.21.15.82:3300/0 conn(0x7f9cb815f450 0x7f9cb806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.640+0000 7f9cbc965640 1 -- 172.21.15.37:0/1419910393 >> v2:172.21.15.82:3300/0 conn(0x7f9cb815f450 msgr2=0x7f9cb806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:45.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.640+0000 7f9cbc965640 1 --2- 172.21.15.37:0/1419910393 >> v2:172.21.15.82:3300/0 conn(0x7f9cb815f450 0x7f9cb806d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.640+0000 7f9cbc965640 1 -- 172.21.15.37:0/1419910393 >> v1:172.21.15.82:6789/0 conn(0x7f9cb815f830 legacy=0x7f9cb806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.640+0000 7f9cbc965640 1 -- 172.21.15.37:0/1419910393 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb80d2fe0 con 0x7f9cb806df40 2024-05-10T08:40:45.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.640+0000 7f9cbc965640 1 --2- 172.21.15.37:0/1419910393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb806df40 0x7f9cb80d3ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9cb808d6d0 tx=0x7f9cb002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f20493844cdd7e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.640+0000 7f9cb6ffd640 1 -- 172.21.15.37:0/1419910393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0036070 con 0x7f9cb806df40 2024-05-10T08:40:45.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.640+0000 7f9cb6ffd640 1 -- 172.21.15.37:0/1419910393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb0031600 con 0x7f9cb806df40 2024-05-10T08:40:45.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cb6ffd640 1 -- 172.21.15.37:0/1419910393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00319d0 con 0x7f9cb806df40 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/1419910393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb806df40 msgr2=0x7f9cb80d3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/1419910393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb806df40 0x7f9cb80d3ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9cb808d6d0 tx=0x7f9cb002a730 comp rx=0 tx=0).stop 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/1419910393 shutdown_connections 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/1419910393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb806df40 0x7f9cb80d3ac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/1419910393 >> v2:172.21.15.82:3300/0 conn(0x7f9cb815f450 0x7f9cb806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/1419910393 >> 172.21.15.37:0/1419910393 conn(0x7f9cb80d5040 msgr2=0x7f9cb80d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/1419910393 shutdown_connections 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.641+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/1419910393 wait complete. 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.642+0000 7f9cbe3c8640 1 Processor -- start 2024-05-10T08:40:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.642+0000 7f9cbe3c8640 1 -- start start 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cbe3c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb806df40 0x7f9cb80ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cbe3c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb815f450 0x7f9cb80ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cbe3c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb815f830 0x7f9cb80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cbe3c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb80d0880 con 0x7f9cb815f450 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cbe3c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb80d0700 con 0x7f9cb806df40 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cbe3c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb80d0a00 con 0x7f9cb815f830 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cb77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb815f450 0x7f9cb80ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cb77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb815f450 0x7f9cb80ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58452/0 (socket says 172.21.15.37:58452) 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.643+0000 7f9cb77fe640 1 -- 172.21.15.37:0/981849551 learned_addr learned my addr 172.21.15.37:0/981849551 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb7fff640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb806df40 0x7f9cb80ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cbc965640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb815f830 0x7f9cb80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb77fe640 1 -- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb815f830 msgr2=0x7f9cb80ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb77fe640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb815f830 0x7f9cb80ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb77fe640 1 -- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb806df40 msgr2=0x7f9cb80ba2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb77fe640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb806df40 0x7f9cb80ba2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb77fe640 1 -- 172.21.15.37:0/981849551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb80b3010 con 0x7f9cb815f450 2024-05-10T08:40:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb77fe640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb815f450 0x7f9cb80ccb20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c470 tx=0x7f9cac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb4ff9640 1 -- 172.21.15.37:0/981849551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0052d0 con 0x7f9cb815f450 2024-05-10T08:40:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb4ff9640 1 -- 172.21.15.37:0/981849551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cac005470 con 0x7f9cb815f450 2024-05-10T08:40:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb80b32f0 con 0x7f9cb815f450 2024-05-10T08:40:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cb4ff9640 1 -- 172.21.15.37:0/981849551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac007260 con 0x7f9cb815f450 2024-05-10T08:40:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.644+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb80b38b0 con 0x7f9cb815f450 2024-05-10T08:40:45.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.645+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb80693f0 con 0x7f9cb815f450 2024-05-10T08:40:45.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.646+0000 7f9cb4ff9640 1 -- 172.21.15.37:0/981849551 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9cac007400 con 0x7f9cb815f450 2024-05-10T08:40:45.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.646+0000 7f9cb4ff9640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ca40762d0 0x7f9ca4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.647+0000 7f9cb4ff9640 1 -- 172.21.15.37:0/981849551 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9cac096e00 con 0x7f9cb815f450 2024-05-10T08:40:45.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.647+0000 7f9cb7fff640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ca40762d0 0x7f9ca4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.647+0000 7f9cb7fff640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ca40762d0 0x7f9ca4078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80bafc0 tx=0x7f9ca8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.651+0000 7f9cb4ff9640 1 -- 172.21.15.37:0/981849551 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9cac060420 con 0x7f9cb815f450 2024-05-10T08:40:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.843+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9cb80d04c0 con 0x7f9cb815f450 2024-05-10T08:40:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.844+0000 7f9cb4ff9640 1 -- 172.21.15.37:0/981849551 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9cac068410 con 0x7f9cb815f450 2024-05-10T08:40:45.843 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-10T08:40:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ca40762d0 msgr2=0x7f9ca4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ca40762d0 0x7f9ca4078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80bafc0 tx=0x7f9ca8008040 comp rx=0 tx=0).stop 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb815f450 msgr2=0x7f9cb80ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb815f450 0x7f9cb80ccb20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c470 tx=0x7f9cac001e70 comp rx=0 tx=0).stop 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 shutdown_connections 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ca40762d0 0x7f9ca4078790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9cb815f830 0x7f9cb80ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cb815f450 0x7f9cb80ccb20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 --2- 172.21.15.37:0/981849551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb806df40 0x7f9cb80ba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 >> 172.21.15.37:0/981849551 conn(0x7f9cb80d5040 msgr2=0x7f9cb80cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 shutdown_connections 2024-05-10T08:40:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.846+0000 7f9cbe3c8640 1 -- 172.21.15.37:0/981849551 wait complete. 2024-05-10T08:40:45.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T08:40:45.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.963+0000 7efcbbe85640 1 Processor -- start 2024-05-10T08:40:45.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.963+0000 7efcbbe85640 1 -- start start 2024-05-10T08:40:45.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.964+0000 7efcbbe85640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 0x7efcb40d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.964+0000 7efcbbe85640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb40d3320 con 0x7efcb40b6590 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.964+0000 7efcbbe85640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb40d3600 con 0x7efcb4163460 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.964+0000 7efcbbe85640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efcb40d38e0 con 0x7efcb40b9080 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.964+0000 7efcb9c21640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efcb40b6590 0x7efcb4162d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35192/0 (socket says 172.21.15.37:35192) 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.964+0000 7efcb9c21640 1 -- 172.21.15.37:0/387950094 learned_addr learned my addr 172.21.15.37:0/387950094 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcba422640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 0x7efcb40d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767368632 0 0) 0x7efcb40d3320 con 0x7efcb40b6590 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc9c003520 con 0x7efcb40b6590 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1579464746 0 0) 0x7efc9c003520 con 0x7efcb40b6590 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 msgr2=0x7efcb40d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 0x7efcb40d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 >> v1:172.21.15.82:6789/0 conn(0x7efcb4163460 legacy=0x7efcb415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb40d3bc0 con 0x7efcb40b6590 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7efcac001670 con 0x7efcb40b6590 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 >> v1:172.21.15.37:6789/0 conn(0x7efcb40b6590 legacy=0x7efcb4162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc9c0039e0 0x7efc9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc9c004800 0x7efc9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 0x7efc9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40d38e0 con 0x7efc9c0039e0 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c00baa0 con 0x7efc9c004800 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c00bca0 con 0x7efcb40b9080 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb9c21640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc9c0039e0 0x7efc9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcba422640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 0x7efc9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb9420640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc9c004800 0x7efc9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb9c21640 1 -- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 msgr2=0x7efc9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb9c21640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcb40b9080 0x7efc9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb9c21640 1 -- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc9c004800 msgr2=0x7efc9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb9c21640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc9c004800 0x7efc9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.965+0000 7efcb9c21640 1 -- 172.21.15.37:0/387950094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c003520 con 0x7efc9c0039e0 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.966+0000 7efcb9c21640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc9c0039e0 0x7efc9c003e00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c210 tx=0x7efc9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d084dcacc357b763 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.966+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac007cf0 con 0x7efc9c0039e0 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.966+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcac005ad0 con 0x7efc9c0039e0 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.966+0000 7efcb8c1f640 1 -- 172.21.15.37:0/387950094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac007070 con 0x7efc9c0039e0 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.967+0000 7efcbbe85640 1 -- 172.21.15.37:0/387950094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc9c0039e0 msgr2=0x7efc9c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.967+0000 7efcbbe85640 1 --2- 172.21.15.37:0/387950094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc9c0039e0 0x7efc9c003e00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c210 tx=0x7efc9c005830 comp rx=0 tx=0).stop 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.967+0000 7efcba422640 1 -- 172.21.15.37:0/387950094 reap_dead start 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.967+0000 7efcbbe85640 1 -- 172.21.15.37:0/387950094 shutdown_connections 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.967+0000 7efcbbe85640 1 -- 172.21.15.37:0/387950094 >> 172.21.15.37:0/387950094 conn(0x7efcb40d4fe0 msgr2=0x7efcb40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.967+0000 7efcbbe85640 1 -- 172.21.15.37:0/387950094 shutdown_connections 2024-05-10T08:40:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.967+0000 7efcbbe85640 1 -- 172.21.15.37:0/387950094 wait complete. 2024-05-10T08:40:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.968+0000 7efcbbe85640 1 Processor -- start 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.968+0000 7efcbbe85640 1 -- start start 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcbbe85640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc9c0039e0 0x7efcb4154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcbbe85640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcb41e8760 0x7efcb40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcbbe85640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb41e8be0 0x7efcb40cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcbbe85640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efcb415f4c0 con 0x7efcb41e8760 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcbbe85640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efcb415f340 con 0x7efcb41e8be0 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcbbe85640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efcb415f640 con 0x7efc9c0039e0 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcb41e8760 0x7efcb40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcb41e8760 0x7efcb40cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58476/0 (socket says 172.21.15.37:58476) 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 -- 172.21.15.37:0/464737386 learned_addr learned my addr 172.21.15.37:0/464737386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9c21640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc9c0039e0 0x7efcb4154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcba422640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb41e8be0 0x7efcb40cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 -- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc9c0039e0 msgr2=0x7efcb4154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc9c0039e0 0x7efcb4154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 -- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb41e8be0 msgr2=0x7efcb40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb41e8be0 0x7efcb40cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 -- 172.21.15.37:0/464737386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb41554c0 con 0x7efcb41e8760 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb9420640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcb41e8760 0x7efcb40cd940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efca800f5f0 tx=0x7efca800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb27fc640 1 -- 172.21.15.37:0/464737386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca80052e0 con 0x7efcb41e8760 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb27fc640 1 -- 172.21.15.37:0/464737386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca8018070 con 0x7efcb41e8760 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb41e9d30 con 0x7efcb41e8760 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.969+0000 7efcb27fc640 1 -- 172.21.15.37:0/464737386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca8003810 con 0x7efcb41e8760 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.970+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41e9490 con 0x7efcb41e8760 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.971+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb4069d10 con 0x7efcb41e8760 2024-05-10T08:40:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.971+0000 7efcb27fc640 1 -- 172.21.15.37:0/464737386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efca80039b0 con 0x7efcb41e8760 2024-05-10T08:40:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.972+0000 7efcb27fc640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca00762d0 0x7efca0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.972+0000 7efcb27fc640 1 -- 172.21.15.37:0/464737386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efca80976a0 con 0x7efcb41e8760 2024-05-10T08:40:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.972+0000 7efcb9c21640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca00762d0 0x7efca0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.973+0000 7efcb9c21640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca00762d0 0x7efca0078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efcac032000 tx=0x7efcac009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:45.976+0000 7efcb27fc640 1 -- 172.21.15.37:0/464737386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efcb41554c0 con 0x7efcb41e8760 2024-05-10T08:40:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.166+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efcb40693f0 con 0x7efcb41e8760 2024-05-10T08:40:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.166+0000 7efcb27fc640 1 -- 172.21.15.37:0/464737386 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7efca8060cc0 con 0x7efcb41e8760 2024-05-10T08:40:46.166 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-10T08:40:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.168+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca00762d0 msgr2=0x7efca0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.168+0000 7efcbbe85640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca00762d0 0x7efca0078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efcac032000 tx=0x7efcac009030 comp rx=0 tx=0).stop 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcb41e8760 msgr2=0x7efcb40cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcb41e8760 0x7efcb40cd940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efca800f5f0 tx=0x7efca800fab0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 shutdown_connections 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca00762d0 0x7efca0078790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb41e8be0 0x7efcb40cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcb41e8760 0x7efcb40cd940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 --2- 172.21.15.37:0/464737386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efc9c0039e0 0x7efcb4154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 >> 172.21.15.37:0/464737386 conn(0x7efcb40d4fe0 msgr2=0x7efcb40d53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 shutdown_connections 2024-05-10T08:40:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.169+0000 7efcbbe85640 1 -- 172.21.15.37:0/464737386 wait complete. 2024-05-10T08:40:46.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T08:40:46.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.287+0000 7f79fcd19640 1 Processor -- start 2024-05-10T08:40:46.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.287+0000 7f79fcd19640 1 -- start start 2024-05-10T08:40:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.288+0000 7f79fcd19640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79f815bdc0 0x7f79f80b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.288+0000 7f79fcd19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 0x7f79f80732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.288+0000 7f79fcd19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f80b6840 con 0x7f79f80b4f40 2024-05-10T08:40:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.288+0000 7f79fcd19640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f79f80710d0 con 0x7f79f815bdc0 2024-05-10T08:40:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.288+0000 7f79fcd19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f79f806fc30 con 0x7f79f80cf370 2024-05-10T08:40:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.288+0000 7f79f6d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f79f80b4f40 0x7f79f815f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35194/0 (socket says 172.21.15.37:35194) 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.288+0000 7f79f6d9d640 1 -- 172.21.15.37:0/1850674383 learned_addr learned my addr 172.21.15.37:0/1850674383 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f659c640 1 --2- 172.21.15.37:0/1850674383 >> v2:172.21.15.82:3300/0 conn(0x7f79f815bdc0 0x7f79f80b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274450145 0 0) 0x7f79f80b6840 con 0x7f79f80b4f40 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f5d9b640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 0x7f79f80732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79e4003520 con 0x7f79f80b4f40 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812204614 0 0) 0x7f79e4003520 con 0x7f79f80b4f40 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 msgr2=0x7f79f80732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 0x7f79f80732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 >> v2:172.21.15.82:3300/0 conn(0x7f79f815bdc0 msgr2=0x7f79f80b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 --2- 172.21.15.37:0/1850674383 >> v2:172.21.15.82:3300/0 conn(0x7f79f815bdc0 0x7f79f80b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f80b6560 con 0x7f79f80b4f40 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f79e8001670 con 0x7f79f80b4f40 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 >> v1:172.21.15.37:6789/0 conn(0x7f79f80b4f40 legacy=0x7f79f815f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40039b0 0x7f79e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e4004800 0x7f79e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 0x7f79e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79f806fc30 con 0x7f79e40039b0 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79e400b9c0 con 0x7f79e4004800 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f79e400bb40 con 0x7f79f80cf370 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f659c640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40039b0 0x7f79e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f5d9b640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e4004800 0x7f79e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.289+0000 7f79f6d9d640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 0x7f79e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f659c640 1 -- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 msgr2=0x7f79e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f659c640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f80cf370 0x7f79e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f659c640 1 -- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e4004800 msgr2=0x7f79e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f659c640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e4004800 0x7f79e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f659c640 1 -- 172.21.15.37:0/1850674383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e4003520 con 0x7f79e40039b0 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f659c640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40039b0 0x7f79e4003dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009fc0 tx=0x7f79e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdddccd601f5b2a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0009c10 con 0x7f79e40039b0 2024-05-10T08:40:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f0036070 con 0x7f79e40039b0 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.290+0000 7f79f559a640 1 -- 172.21.15.37:0/1850674383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f002d070 con 0x7f79e40039b0 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.291+0000 7f79fcd19640 1 -- 172.21.15.37:0/1850674383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40039b0 msgr2=0x7f79e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.291+0000 7f79fcd19640 1 --2- 172.21.15.37:0/1850674383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40039b0 0x7f79e4003dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009fc0 tx=0x7f79e4005830 comp rx=0 tx=0).stop 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.291+0000 7f79f6d9d640 1 -- 172.21.15.37:0/1850674383 reap_dead start 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.291+0000 7f79fcd19640 1 -- 172.21.15.37:0/1850674383 shutdown_connections 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.291+0000 7f79fcd19640 1 -- 172.21.15.37:0/1850674383 >> 172.21.15.37:0/1850674383 conn(0x7f79f80b3c40 msgr2=0x7f79f80b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.291+0000 7f79fcd19640 1 -- 172.21.15.37:0/1850674383 shutdown_connections 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.291+0000 7f79fcd19640 1 -- 172.21.15.37:0/1850674383 wait complete. 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.292+0000 7f79fcd19640 1 Processor -- start 2024-05-10T08:40:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.292+0000 7f79fcd19640 1 -- start start 2024-05-10T08:40:46.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79fcd19640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e40039b0 0x7f79f814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79fcd19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8150330 0x7f79f80d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79fcd19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f81507b0 0x7f79f80d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79fcd19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79f815c1a0 con 0x7f79f8150330 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79fcd19640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79f806f8c0 con 0x7f79e40039b0 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79fcd19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f79f81600a0 con 0x7f79f81507b0 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8150330 0x7f79f80d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8150330 0x7f79f80d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58482/0 (socket says 172.21.15.37:58482) 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.293+0000 7f79f5d9b640 1 -- 172.21.15.37:0/2385273431 learned_addr learned my addr 172.21.15.37:0/2385273431 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f659c640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e40039b0 0x7f79f814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f6d9d640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f81507b0 0x7f79f80d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f5d9b640 1 -- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f81507b0 msgr2=0x7f79f80d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f5d9b640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f81507b0 0x7f79f80d13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f5d9b640 1 -- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e40039b0 msgr2=0x7f79f814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f5d9b640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e40039b0 0x7f79f814cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f5d9b640 1 -- 172.21.15.37:0/2385273431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f814f290 con 0x7f79f8150330 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79f5d9b640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8150330 0x7f79f80d0e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f79e0011960 tx=0x7f79e0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79eeffd640 1 -- 172.21.15.37:0/2385273431 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0019070 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79eeffd640 1 -- 172.21.15.37:0/2385273431 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e0004240 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f814f570 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79eeffd640 1 -- 172.21.15.37:0/2385273431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e000f820 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.294+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f814fb30 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.295+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f8069b00 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.296+0000 7f79eeffd640 1 -- 172.21.15.37:0/2385273431 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f79e001c070 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.296+0000 7f79eeffd640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79d8076300 0x7f79d80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.296+0000 7f79eeffd640 1 -- 172.21.15.37:0/2385273431 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f79e0097d40 con 0x7f79f8150330 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.296+0000 7f79f659c640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79d8076300 0x7f79d80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.297+0000 7f79f659c640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79d8076300 0x7f79d80787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f79f0035000 tx=0x7f79f002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.300+0000 7f79eeffd640 1 -- 172.21.15.37:0/2385273431 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f79e0061360 con 0x7f79f8150330 2024-05-10T08:40:46.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.493+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f79f80b2030 con 0x7f79f8150330 2024-05-10T08:40:46.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.493+0000 7f79eeffd640 1 -- 172.21.15.37:0/2385273431 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f79e0060c60 con 0x7f79f8150330 2024-05-10T08:40:46.493 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-10T08:40:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79d8076300 msgr2=0x7f79d80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79d8076300 0x7f79d80787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f79f0035000 tx=0x7f79f002f000 comp rx=0 tx=0).stop 2024-05-10T08:40:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8150330 msgr2=0x7f79f80d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8150330 0x7f79f80d0e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f79e0011960 tx=0x7f79e0011e20 comp rx=0 tx=0).stop 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 shutdown_connections 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79d8076300 0x7f79d80787c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79f81507b0 0x7f79f80d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8150330 0x7f79f80d0e80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 --2- 172.21.15.37:0/2385273431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e40039b0 0x7f79f814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 >> 172.21.15.37:0/2385273431 conn(0x7f79f80b3c40 msgr2=0x7f79f80732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 shutdown_connections 2024-05-10T08:40:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.496+0000 7f79fcd19640 1 -- 172.21.15.37:0/2385273431 wait complete. 2024-05-10T08:40:46.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T08:40:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.614+0000 7f9050340640 1 Processor -- start 2024-05-10T08:40:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.614+0000 7f9050340640 1 -- start start 2024-05-10T08:40:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f9050340640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f904815f4e0 0x7f90480cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f9050340640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90480d3aa0 0x7f90480d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f9050340640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90480d0320 con 0x7f90480d3f00 2024-05-10T08:40:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f9050340640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f90480d0600 con 0x7f904815f4e0 2024-05-10T08:40:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f9050340640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f90480d08e0 con 0x7f90480d3aa0 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f904d8db640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90480d3aa0 0x7f90480d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f904e0dc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f904815f4e0 0x7f90480cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f904d8db640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90480d3aa0 0x7f90480d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:54574/0 (socket says 172.21.15.37:54574) 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f904e8dd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f90480d3f00 0x7f90480b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:48508/0 (socket says 172.21.15.37:48508) 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f904d8db640 1 -- 172.21.15.37:0/3388583177 learned_addr learned my addr 172.21.15.37:0/3388583177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.615+0000 7f904e0dc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f904815f4e0 0x7f90480cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:57776/0 (socket says 172.21.15.37:57776) 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.616+0000 7f904e0dc640 1 -- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90480d3aa0 msgr2=0x7f90480d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.616+0000 7f904e0dc640 1 --2- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90480d3aa0 0x7f90480d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.616+0000 7f904e0dc640 1 -- 172.21.15.37:0/3388583177 >> v1:172.21.15.82:6789/0 conn(0x7f90480d3f00 legacy=0x7f90480b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.616+0000 7f904e0dc640 1 -- 172.21.15.37:0/3388583177 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90480d0bc0 con 0x7f904815f4e0 2024-05-10T08:40:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.616+0000 7f904d8db640 1 --2- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90480d3aa0 0x7f90480d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.616+0000 7f904e0dc640 1 --2- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f904815f4e0 0x7f90480cfcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90440097a0 tx=0x7f904402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c93fc70acf4d4774 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.616+0000 7f904d0da640 1 -- 172.21.15.37:0/3388583177 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044037070 con 0x7f904815f4e0 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f904d0da640 1 -- 172.21.15.37:0/3388583177 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9044032440 con 0x7f904815f4e0 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f904d0da640 1 -- 172.21.15.37:0/3388583177 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044032810 con 0x7f904815f4e0 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 -- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f904815f4e0 msgr2=0x7f90480cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 --2- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f904815f4e0 0x7f90480cfcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90440097a0 tx=0x7f904402a180 comp rx=0 tx=0).stop 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 -- 172.21.15.37:0/3388583177 shutdown_connections 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 --2- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90480d3aa0 0x7f90480d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 --2- 172.21.15.37:0/3388583177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f904815f4e0 0x7f90480cfcd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 -- 172.21.15.37:0/3388583177 >> 172.21.15.37:0/3388583177 conn(0x7f904808eac0 msgr2=0x7f904809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 -- 172.21.15.37:0/3388583177 shutdown_connections 2024-05-10T08:40:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.617+0000 7f9050340640 1 -- 172.21.15.37:0/3388583177 wait complete. 2024-05-10T08:40:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.618+0000 7f9050340640 1 Processor -- start 2024-05-10T08:40:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.618+0000 7f9050340640 1 -- start start 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f9050340640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480d3aa0 0x7f904814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f9050340640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90480d3f00 0x7f9048162110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f9050340640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f904815f4e0 0x7f9048162650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f9050340640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90480d23d0 con 0x7f90480d3f00 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f9050340640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f904815f8c0 con 0x7f90480d3aa0 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f9050340640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f90480d2550 con 0x7f904815f4e0 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f904d8db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90480d3f00 0x7f9048162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f904d8db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90480d3f00 0x7f9048162110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58488/0 (socket says 172.21.15.37:58488) 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f904d8db640 1 -- 172.21.15.37:0/3716314219 learned_addr learned my addr 172.21.15.37:0/3716314219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f904e0dc640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480d3aa0 0x7f904814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.619+0000 7f904e8dd640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f904815f4e0 0x7f9048162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f904d8db640 1 -- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f904815f4e0 msgr2=0x7f9048162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f904d8db640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f904815f4e0 0x7f9048162650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f904d8db640 1 -- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480d3aa0 msgr2=0x7f904814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f904d8db640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480d3aa0 0x7f904814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f904d8db640 1 -- 172.21.15.37:0/3716314219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9048161070 con 0x7f90480d3f00 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f904d8db640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90480d3f00 0x7f9048162110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f903800e9b0 tx=0x7f903800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f903effd640 1 -- 172.21.15.37:0/3716314219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038017070 con 0x7f90480d3f00 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f903effd640 1 -- 172.21.15.37:0/3716314219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903800c9a0 con 0x7f90480d3f00 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9048161350 con 0x7f90480d3f00 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f903effd640 1 -- 172.21.15.37:0/3716314219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903800cd50 con 0x7f90480d3f00 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.620+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9048161910 con 0x7f90480d3f00 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.621+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90480693f0 con 0x7f90480d3f00 2024-05-10T08:40:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.622+0000 7f903effd640 1 -- 172.21.15.37:0/3716314219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f903801a070 con 0x7f90480d3f00 2024-05-10T08:40:46.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.622+0000 7f903effd640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f902c0762d0 0x7f902c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.622+0000 7f903effd640 1 -- 172.21.15.37:0/3716314219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9038097be0 con 0x7f90480d3f00 2024-05-10T08:40:46.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.623+0000 7f904e0dc640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f902c0762d0 0x7f902c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.623+0000 7f904e0dc640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f902c0762d0 0x7f902c078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9044034000 tx=0x7f904402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.627+0000 7f903effd640 1 -- 172.21.15.37:0/3716314219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9038061200 con 0x7f90480d3f00 2024-05-10T08:40:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.821+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f90480b7490 con 0x7f90480d3f00 2024-05-10T08:40:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.821+0000 7f903effd640 1 -- 172.21.15.37:0/3716314219 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f9038060b00 con 0x7f90480d3f00 2024-05-10T08:40:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-10T08:40:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f902c0762d0 msgr2=0x7f902c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f902c0762d0 0x7f902c078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9044034000 tx=0x7f904402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90480d3f00 msgr2=0x7f9048162110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90480d3f00 0x7f9048162110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f903800e9b0 tx=0x7f903800ee70 comp rx=0 tx=0).stop 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 shutdown_connections 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f902c0762d0 0x7f902c078790 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f904815f4e0 0x7f9048162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90480d3f00 0x7f9048162110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 --2- 172.21.15.37:0/3716314219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90480d3aa0 0x7f904814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 >> 172.21.15.37:0/3716314219 conn(0x7f904808eac0 msgr2=0x7f90480d2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 shutdown_connections 2024-05-10T08:40:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.824+0000 7f9050340640 1 -- 172.21.15.37:0/3716314219 wait complete. 2024-05-10T08:40:46.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-05-10T08:40:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.939+0000 7ff620875640 1 Processor -- start 2024-05-10T08:40:46.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.939+0000 7ff620875640 1 -- start start 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff620875640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff620875640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61c163920 0x7ff61c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff620875640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff61c071110 0x7ff61c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff620875640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff61c0d10d0 con 0x7ff61c163920 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff620875640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff61c070b80 con 0x7ff61c071110 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff620875640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c0d1c30 con 0x7ff61c070d30 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61c163920 0x7ff61c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61c163920 0x7ff61c0703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58504/0 (socket says 172.21.15.37:58504) 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 -- 172.21.15.37:0/29143985 learned_addr learned my addr 172.21.15.37:0/29143985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/29143985 >> v2:172.21.15.82:3300/0 conn(0x7ff61c071110 0x7ff61c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff61a59c640 1 --2- 172.21.15.37:0/29143985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 -- 172.21.15.37:0/29143985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 msgr2=0x7ff61c0d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 --2- 172.21.15.37:0/29143985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c0d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 -- 172.21.15.37:0/29143985 >> v2:172.21.15.82:3300/0 conn(0x7ff61c071110 msgr2=0x7ff61c06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 --2- 172.21.15.37:0/29143985 >> v2:172.21.15.82:3300/0 conn(0x7ff61c071110 0x7ff61c06d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.940+0000 7ff611d9b640 1 -- 172.21.15.37:0/29143985 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c163d80 con 0x7ff61c163920 2024-05-10T08:40:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff611d9b640 1 --2- 172.21.15.37:0/29143985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0703a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff61c073310 tx=0x7ff60402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9917be1fe729bdd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff619d9b640 1 -- 172.21.15.37:0/29143985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604037070 con 0x7ff61c163920 2024-05-10T08:40:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff619d9b640 1 -- 172.21.15.37:0/29143985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff604032440 con 0x7ff61c163920 2024-05-10T08:40:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff619d9b640 1 -- 172.21.15.37:0/29143985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604032810 con 0x7ff61c163920 2024-05-10T08:40:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff620875640 1 -- 172.21.15.37:0/29143985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 msgr2=0x7ff61c0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff620875640 1 --2- 172.21.15.37:0/29143985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0703a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff61c073310 tx=0x7ff60402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff620875640 1 -- 172.21.15.37:0/29143985 shutdown_connections 2024-05-10T08:40:46.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff620875640 1 --2- 172.21.15.37:0/29143985 >> v2:172.21.15.82:3300/0 conn(0x7ff61c071110 0x7ff61c06d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff620875640 1 --2- 172.21.15.37:0/29143985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0703a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.941+0000 7ff620875640 1 --2- 172.21.15.37:0/29143985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c0d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.942+0000 7ff620875640 1 -- 172.21.15.37:0/29143985 >> 172.21.15.37:0/29143985 conn(0x7ff61c0d2e90 msgr2=0x7ff61c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:46.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.942+0000 7ff620875640 1 -- 172.21.15.37:0/29143985 shutdown_connections 2024-05-10T08:40:46.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.942+0000 7ff620875640 1 -- 172.21.15.37:0/29143985 wait complete. 2024-05-10T08:40:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.943+0000 7ff620875640 1 Processor -- start 2024-05-10T08:40:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.943+0000 7ff620875640 1 -- start start 2024-05-10T08:40:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff620875640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff620875640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff61c071110 0x7ff61c0b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff620875640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff620875640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0d15e0 con 0x7ff61c163920 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff620875640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0708e0 con 0x7ff61c071110 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff620875640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c0d18c0 con 0x7ff61c070d30 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58518/0 (socket says 172.21.15.37:58518) 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 -- 172.21.15.37:0/2953915982 learned_addr learned my addr 172.21.15.37:0/2953915982 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61a59c640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 -- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 msgr2=0x7ff61c162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c162c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 -- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff61c071110 msgr2=0x7ff61c0b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff611d9b640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff61c071110 0x7ff61c0b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff61c071110 0x7ff61c0b8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 -- 172.21.15.37:0/2953915982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c0b6ad0 con 0x7ff61c163920 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.944+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0cafb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff614007e90 tx=0x7ff61400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.945+0000 7ff6137fe640 1 -- 172.21.15.37:0/2953915982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614014420 con 0x7ff61c163920 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.945+0000 7ff6137fe640 1 -- 172.21.15.37:0/2953915982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff614019070 con 0x7ff61c163920 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.945+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c0b6db0 con 0x7ff61c163920 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.945+0000 7ff6137fe640 1 -- 172.21.15.37:0/2953915982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614014800 con 0x7ff61c163920 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.945+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c0b7370 con 0x7ff61c163920 2024-05-10T08:40:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.946+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c0693f0 con 0x7ff61c163920 2024-05-10T08:40:46.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.946+0000 7ff6137fe640 1 -- 172.21.15.37:0/2953915982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6140149a0 con 0x7ff61c163920 2024-05-10T08:40:46.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.947+0000 7ff6137fe640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff5fc0762d0 0x7ff5fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:46.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.947+0000 7ff6137fe640 1 -- 172.21.15.37:0/2953915982 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff614098150 con 0x7ff61c163920 2024-05-10T08:40:46.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.947+0000 7ff61a59c640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff5fc0762d0 0x7ff5fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:46.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.948+0000 7ff61a59c640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff5fc0762d0 0x7ff5fc078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006fd0 tx=0x7ff60c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:46.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:46.951+0000 7ff6137fe640 1 -- 172.21.15.37:0/2953915982 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff6140611b0 con 0x7ff61c163920 2024-05-10T08:40:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.218+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7ff61c0d3d70 con 0x7ff61c163920 2024-05-10T08:40:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.839+0000 7ff6137fe640 1 -- 172.21.15.37:0/2953915982 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v46) ==== 145+0+0 (secure 0 0 0) 0x7ff6140654b0 con 0x7ff61c163920 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff5fc0762d0 msgr2=0x7ff5fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff5fc0762d0 0x7ff5fc078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006fd0 tx=0x7ff60c008040 comp rx=0 tx=0).stop 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 msgr2=0x7ff61c0cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0cafb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff614007e90 tx=0x7ff61400e4b0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 shutdown_connections 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff5fc0762d0 0x7ff5fc078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c163920 0x7ff61c0cafb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff61c071110 0x7ff61c0b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 --2- 172.21.15.37:0/2953915982 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff61c070d30 0x7ff61c162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 >> 172.21.15.37:0/2953915982 conn(0x7ff61c0d2e90 msgr2=0x7ff61c0b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 shutdown_connections 2024-05-10T08:40:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.842+0000 7ff620875640 1 -- 172.21.15.37:0/2953915982 wait complete. 2024-05-10T08:40:47.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T08:40:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.969+0000 7f5a14a59640 1 Processor -- start 2024-05-10T08:40:47.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.969+0000 7f5a14a59640 1 -- start start 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a14a59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a10072840 0x7f5a1015c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a14a59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a1006e4d0 0x7f5a100aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a14a59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1015c920 con 0x7f5a1006e0f0 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a14a59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1015cc00 con 0x7f5a1006e4d0 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a14a59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1015cee0 con 0x7f5a10072840 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a1006e4d0 0x7f5a100aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5a1006e0f0 0x7f5a100d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54704/0 (socket says 172.21.15.37:54704) 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0e59c640 1 -- 172.21.15.37:0/205831672 learned_addr learned my addr 172.21.15.37:0/205831672 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0dd9b640 1 --2- 172.21.15.37:0/205831672 >> v2:172.21.15.82:3300/0 conn(0x7f5a10072840 0x7f5a1015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0ed9d640 1 -- 172.21.15.37:0/205831672 >> v2:172.21.15.82:3300/0 conn(0x7f5a10072840 msgr2=0x7f5a1015c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0ed9d640 1 --2- 172.21.15.37:0/205831672 >> v2:172.21.15.82:3300/0 conn(0x7f5a10072840 0x7f5a1015c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0ed9d640 1 -- 172.21.15.37:0/205831672 >> v1:172.21.15.37:6789/0 conn(0x7f5a1006e0f0 legacy=0x7f5a100d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0d59a640 1 -- 172.21.15.37:0/205831672 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41085697 0 0) 0x7f5a1015c920 con 0x7f5a1006e0f0 2024-05-10T08:40:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0ed9d640 1 -- 172.21.15.37:0/205831672 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1015d1c0 con 0x7f5a1006e4d0 2024-05-10T08:40:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.970+0000 7f5a0dd9b640 1 --2- 172.21.15.37:0/205831672 >> v2:172.21.15.82:3300/0 conn(0x7f5a10072840 0x7f5a1015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.971+0000 7f5a0ed9d640 1 --2- 172.21.15.37:0/205831672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100aec30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5a100727d0 tx=0x7f5a0802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4608ada0b36448 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.971+0000 7f5a0d59a640 1 -- 172.21.15.37:0/205831672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08037070 con 0x7f5a1006e4d0 2024-05-10T08:40:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.971+0000 7f5a0d59a640 1 -- 172.21.15.37:0/205831672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a08032440 con 0x7f5a1006e4d0 2024-05-10T08:40:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.971+0000 7f5a0d59a640 1 -- 172.21.15.37:0/205831672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08032810 con 0x7f5a1006e4d0 2024-05-10T08:40:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 -- 172.21.15.37:0/205831672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 msgr2=0x7f5a100aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 --2- 172.21.15.37:0/205831672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100aec30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5a100727d0 tx=0x7f5a0802a1a0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 -- 172.21.15.37:0/205831672 shutdown_connections 2024-05-10T08:40:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 --2- 172.21.15.37:0/205831672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100aec30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 --2- 172.21.15.37:0/205831672 >> v2:172.21.15.82:3300/0 conn(0x7f5a10072840 0x7f5a1015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 -- 172.21.15.37:0/205831672 >> 172.21.15.37:0/205831672 conn(0x7f5a1006c3a0 msgr2=0x7f5a1006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 -- 172.21.15.37:0/205831672 shutdown_connections 2024-05-10T08:40:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.972+0000 7f5a14a59640 1 -- 172.21.15.37:0/205831672 wait complete. 2024-05-10T08:40:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.973+0000 7f5a14a59640 1 Processor -- start 2024-05-10T08:40:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.973+0000 7f5a14a59640 1 -- start start 2024-05-10T08:40:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a14a59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006e0f0 0x7f5a1014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a14a59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a14a59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10072840 0x7f5a100b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a14a59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100ae7d0 con 0x7f5a1006e4d0 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a14a59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100ae650 con 0x7f5a10072840 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a14a59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5a101530b0 con 0x7f5a1006e0f0 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a0dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a0dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39236/0 (socket says 172.21.15.37:39236) 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a0dd9b640 1 -- 172.21.15.37:0/2327651251 learned_addr learned my addr 172.21.15.37:0/2327651251 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a0e59c640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006e0f0 0x7f5a1014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.974+0000 7f5a0ed9d640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10072840 0x7f5a100b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0dd9b640 1 -- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006e0f0 msgr2=0x7f5a1014f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0dd9b640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006e0f0 0x7f5a1014f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0dd9b640 1 -- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10072840 msgr2=0x7f5a100b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0dd9b640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10072840 0x7f5a100b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0dd9b640 1 -- 172.21.15.37:0/2327651251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a100b2ea0 con 0x7f5a1006e4d0 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0e59c640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006e0f0 0x7f5a1014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0ed9d640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10072840 0x7f5a100b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a0dd9b640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100b0d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007f10 tx=0x7f5a0400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f59feffd640 1 -- 172.21.15.37:0/2327651251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0401a070 con 0x7f5a1006e4d0 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f59feffd640 1 -- 172.21.15.37:0/2327651251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a04003b90 con 0x7f5a1006e4d0 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a101f60d0 con 0x7f5a1006e4d0 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f59feffd640 1 -- 172.21.15.37:0/2327651251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04004030 con 0x7f5a1006e4d0 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.975+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a101f6690 con 0x7f5a1006e4d0 2024-05-10T08:40:47.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.976+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a100693f0 con 0x7f5a1006e4d0 2024-05-10T08:40:47.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.977+0000 7f59feffd640 1 -- 172.21.15.37:0/2327651251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a0401d070 con 0x7f5a1006e4d0 2024-05-10T08:40:47.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.977+0000 7f59feffd640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59f00762d0 0x7f59f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:47.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.977+0000 7f59feffd640 1 -- 172.21.15.37:0/2327651251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5a04097a00 con 0x7f5a1006e4d0 2024-05-10T08:40:47.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.977+0000 7f5a0e59c640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59f00762d0 0x7f59f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:47.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.978+0000 7f5a0e59c640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59f00762d0 0x7f59f0078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5a00000f60 tx=0x7f5a00009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:47.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:47.981+0000 7f59feffd640 1 -- 172.21.15.37:0/2327651251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5a04010070 con 0x7f5a1006e4d0 2024-05-10T08:40:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.174+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5a100af700 con 0x7f5a1006e4d0 2024-05-10T08:40:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.178+0000 7f59feffd640 1 -- 172.21.15.37:0/2327651251 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f5a04060a60 con 0x7f5a1006e4d0 2024-05-10T08:40:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59f00762d0 msgr2=0x7f59f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59f00762d0 0x7f59f0078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5a00000f60 tx=0x7f5a00009040 comp rx=0 tx=0).stop 2024-05-10T08:40:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 msgr2=0x7f5a100b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100b0d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007f10 tx=0x7f5a0400d4a0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 shutdown_connections 2024-05-10T08:40:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59f00762d0 0x7f59f0078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10072840 0x7f5a100b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a1006e4d0 0x7f5a100b0d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 --2- 172.21.15.37:0/2327651251 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006e0f0 0x7f5a1014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 >> 172.21.15.37:0/2327651251 conn(0x7f5a1006c3a0 msgr2=0x7f5a10073520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 shutdown_connections 2024-05-10T08:40:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.180+0000 7f5a14a59640 1 -- 172.21.15.37:0/2327651251 wait complete. 2024-05-10T08:40:48.190 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:40:48.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:40:48.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:40:48.297 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:40:48.297 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:48.297 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:48.313 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:48.314 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:48.370 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:48.370 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:48.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:40:48.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.572+0000 7fb75a79e640 1 Processor -- start 2024-05-10T08:40:48.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.572+0000 7fb75a79e640 1 -- start start 2024-05-10T08:40:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.573+0000 7fb75a79e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb75415b420 0x7fb75406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.573+0000 7fb75a79e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75406fba0 0x7fb7540ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.573+0000 7fb75a79e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb75406c830 con 0x7fb75406c3a0 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.573+0000 7fb75a79e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb75406cb10 con 0x7fb75406fba0 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.573+0000 7fb75a79e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb75406cdf0 con 0x7fb75415b420 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb759f9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75406fba0 0x7fb7540ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb759f9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75406fba0 0x7fb7540ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39240/0 (socket says 172.21.15.37:39240) 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb759f9d640 1 -- 172.21.15.37:0/857476118 learned_addr learned my addr 172.21.15.37:0/857476118 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb75979c640 1 --2- 172.21.15.37:0/857476118 >> v2:172.21.15.82:3300/0 conn(0x7fb75415b420 0x7fb75406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb759f9d640 1 -- 172.21.15.37:0/857476118 >> v2:172.21.15.82:3300/0 conn(0x7fb75415b420 msgr2=0x7fb75406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb759f9d640 1 --2- 172.21.15.37:0/857476118 >> v2:172.21.15.82:3300/0 conn(0x7fb75415b420 0x7fb75406d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb759f9d640 1 -- 172.21.15.37:0/857476118 >> v1:172.21.15.82:6789/0 conn(0x7fb75406c3a0 legacy=0x7fb75406f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.574+0000 7fb759f9d640 1 -- 172.21.15.37:0/857476118 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75406d0d0 con 0x7fb75406fba0 2024-05-10T08:40:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb759f9d640 1 --2- 172.21.15.37:0/857476118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75406fba0 0x7fb7540ce110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7540d25b0 tx=0x7fb74402b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d75b4311f64c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb753fff640 1 -- 172.21.15.37:0/857476118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744037070 con 0x7fb75406fba0 2024-05-10T08:40:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb753fff640 1 -- 172.21.15.37:0/857476118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744032600 con 0x7fb75406fba0 2024-05-10T08:40:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb753fff640 1 -- 172.21.15.37:0/857476118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440329f0 con 0x7fb75406fba0 2024-05-10T08:40:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb75a79e640 1 -- 172.21.15.37:0/857476118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75406fba0 msgr2=0x7fb7540ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb75a79e640 1 --2- 172.21.15.37:0/857476118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75406fba0 0x7fb7540ce110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7540d25b0 tx=0x7fb74402b800 comp rx=0 tx=0).stop 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb75a79e640 1 -- 172.21.15.37:0/857476118 shutdown_connections 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb75a79e640 1 --2- 172.21.15.37:0/857476118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75406fba0 0x7fb7540ce110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb75a79e640 1 --2- 172.21.15.37:0/857476118 >> v2:172.21.15.82:3300/0 conn(0x7fb75415b420 0x7fb75406d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb75a79e640 1 -- 172.21.15.37:0/857476118 >> 172.21.15.37:0/857476118 conn(0x7fb7540d14b0 msgr2=0x7fb7540d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.575+0000 7fb75a79e640 1 -- 172.21.15.37:0/857476118 shutdown_connections 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.576+0000 7fb75a79e640 1 -- 172.21.15.37:0/857476118 wait complete. 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.577+0000 7fb75a79e640 1 Processor -- start 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.577+0000 7fb75a79e640 1 -- start start 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb75a79e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75406fba0 0x7fb754156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb75a79e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75415b420 0x7fb7540ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb75a79e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7540d04d0 0x7fb7540b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb75a79e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb75415b980 con 0x7fb7540d04d0 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb75a79e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb75415b800 con 0x7fb75415b420 2024-05-10T08:40:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb75a79e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb75406f120 con 0x7fb75406fba0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7540d04d0 0x7fb7540b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7540d04d0 0x7fb7540b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39252/0 (socket says 172.21.15.37:39252) 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 -- 172.21.15.37:0/2371418491 learned_addr learned my addr 172.21.15.37:0/2371418491 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 -- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75406fba0 msgr2=0x7fb754156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75406fba0 0x7fb754156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 -- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75415b420 msgr2=0x7fb7540ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb758f9b640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75415b420 0x7fb7540ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75415b420 0x7fb7540ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 -- 172.21.15.37:0/2371418491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7540c7950 con 0x7fb7540d04d0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb759f9d640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7540d04d0 0x7fb7540b5820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb744009f40 tx=0x7fb744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb751ffb640 1 -- 172.21.15.37:0/2371418491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744037040 con 0x7fb7540d04d0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb751ffb640 1 -- 172.21.15.37:0/2371418491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744040070 con 0x7fb7540d04d0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb754156760 con 0x7fb7540d04d0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.578+0000 7fb751ffb640 1 -- 172.21.15.37:0/2371418491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744009510 con 0x7fb7540d04d0 2024-05-10T08:40:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.579+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7540cf480 con 0x7fb7540d04d0 2024-05-10T08:40:48.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.580+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb754076460 con 0x7fb7540d04d0 2024-05-10T08:40:48.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.580+0000 7fb751ffb640 1 -- 172.21.15.37:0/2371418491 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb744004280 con 0x7fb7540d04d0 2024-05-10T08:40:48.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.581+0000 7fb751ffb640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7400762d0 0x7fb740078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.581+0000 7fb751ffb640 1 -- 172.21.15.37:0/2371418491 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7440b7a70 con 0x7fb7540d04d0 2024-05-10T08:40:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.581+0000 7fb75979c640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7400762d0 0x7fb740078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.582+0000 7fb75979c640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7400762d0 0x7fb740078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb74c006fd0 tx=0x7fb74c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.585+0000 7fb751ffb640 1 -- 172.21.15.37:0/2371418491 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb754156760 con 0x7fb7540d04d0 2024-05-10T08:40:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.789+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb754050740 con 0x7fb7540d04d0 2024-05-10T08:40:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.789+0000 7fb751ffb640 1 -- 172.21.15.37:0/2371418491 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fb744081120 con 0x7fb7540d04d0 2024-05-10T08:40:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:40:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7400762d0 msgr2=0x7fb740078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7400762d0 0x7fb740078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb74c006fd0 tx=0x7fb74c008040 comp rx=0 tx=0).stop 2024-05-10T08:40:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7540d04d0 msgr2=0x7fb7540b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7540d04d0 0x7fb7540b5820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb744009f40 tx=0x7fb744004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 shutdown_connections 2024-05-10T08:40:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7400762d0 0x7fb740078790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7540d04d0 0x7fb7540b5820 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb75415b420 0x7fb7540ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 --2- 172.21.15.37:0/2371418491 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb75406fba0 0x7fb754156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 >> 172.21.15.37:0/2371418491 conn(0x7fb7540d14b0 msgr2=0x7fb7540b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 shutdown_connections 2024-05-10T08:40:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:48.791+0000 7fb75a79e640 1 -- 172.21.15.37:0/2371418491 wait complete. 2024-05-10T08:40:48.802 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:40:48.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:48.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-10T08:40:48.828 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:40:48.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:48.829 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:40:48.886 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:48.886 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:48.906 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:48.906 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:48.966 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:48.966 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:49.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:40:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.130+0000 7fcf3a4b4640 1 Processor -- start 2024-05-10T08:40:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.130+0000 7fcf3a4b4640 1 -- start start 2024-05-10T08:40:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf3a4b4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf340d0ec0 0x7fcf340d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf3a4b4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf340d3b00 0x7fcf340b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf3a4b4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf340d1760 con 0x7fcf3415f380 2024-05-10T08:40:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf3a4b4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcf340d30f0 con 0x7fcf340d3b00 2024-05-10T08:40:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf3a4b4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcf340d2370 con 0x7fcf340d0ec0 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf38a51640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf340d3b00 0x7fcf340b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf38a51640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf340d3b00 0x7fcf340b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39262/0 (socket says 172.21.15.37:39262) 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf38a51640 1 -- 172.21.15.37:0/3342644947 learned_addr learned my addr 172.21.15.37:0/3342644947 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf337fe640 1 --2- 172.21.15.37:0/3342644947 >> v2:172.21.15.82:3300/0 conn(0x7fcf340d0ec0 0x7fcf340d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf38a51640 1 -- 172.21.15.37:0/3342644947 >> v2:172.21.15.82:3300/0 conn(0x7fcf340d0ec0 msgr2=0x7fcf340d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf38a51640 1 --2- 172.21.15.37:0/3342644947 >> v2:172.21.15.82:3300/0 conn(0x7fcf340d0ec0 0x7fcf340d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf38a51640 1 -- 172.21.15.37:0/3342644947 >> v1:172.21.15.82:6789/0 conn(0x7fcf3415f380 legacy=0x7fcf340d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.131+0000 7fcf38a51640 1 -- 172.21.15.37:0/3342644947 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf340d1a40 con 0x7fcf340d3b00 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.132+0000 7fcf38a51640 1 --2- 172.21.15.37:0/3342644947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d3b00 0x7fcf340b7e30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf340b7b00 tx=0x7fcf2c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f904b9d569f29c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.132+0000 7fcf32ffd640 1 -- 172.21.15.37:0/3342644947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c036070 con 0x7fcf340d3b00 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.132+0000 7fcf32ffd640 1 -- 172.21.15.37:0/3342644947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c031600 con 0x7fcf340d3b00 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.132+0000 7fcf32ffd640 1 -- 172.21.15.37:0/3342644947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0319d0 con 0x7fcf340d3b00 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/3342644947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d3b00 msgr2=0x7fcf340b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/3342644947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d3b00 0x7fcf340b7e30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf340b7b00 tx=0x7fcf2c02a730 comp rx=0 tx=0).stop 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/3342644947 shutdown_connections 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/3342644947 >> v2:172.21.15.82:3300/0 conn(0x7fcf340d0ec0 0x7fcf340d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/3342644947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d3b00 0x7fcf340b7e30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/3342644947 >> 172.21.15.37:0/3342644947 conn(0x7fcf340d4fe0 msgr2=0x7fcf340d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:49.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/3342644947 shutdown_connections 2024-05-10T08:40:49.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.133+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/3342644947 wait complete. 2024-05-10T08:40:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.134+0000 7fcf3a4b4640 1 Processor -- start 2024-05-10T08:40:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.134+0000 7fcf3a4b4640 1 -- start start 2024-05-10T08:40:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf3a4b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d0ec0 0x7fcf3409f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf3a4b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf340d3b00 0x7fcf34152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf3a4b4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf3415f380 0x7fcf34153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf3a4b4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf340d2000 con 0x7fcf340d0ec0 2024-05-10T08:40:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf3a4b4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf340d3f30 con 0x7fcf340d3b00 2024-05-10T08:40:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf3a4b4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3415f760 con 0x7fcf3415f380 2024-05-10T08:40:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d0ec0 0x7fcf3409f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d0ec0 0x7fcf3409f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39276/0 (socket says 172.21.15.37:39276) 2024-05-10T08:40:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 -- 172.21.15.37:0/1776945947 learned_addr learned my addr 172.21.15.37:0/1776945947 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf337fe640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf340d3b00 0x7fcf34152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf38a51640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf3415f380 0x7fcf34153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 -- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf3415f380 msgr2=0x7fcf34153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf3415f380 0x7fcf34153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 -- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf340d3b00 msgr2=0x7fcf34152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf340d3b00 0x7fcf34152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 -- 172.21.15.37:0/1776945947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf34152e60 con 0x7fcf340d0ec0 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf38a51640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf3415f380 0x7fcf34153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.135+0000 7fcf33fff640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d0ec0 0x7fcf3409f710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c400 tx=0x7fcf2400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.136+0000 7fcf30ff9640 1 -- 172.21.15.37:0/1776945947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf240052d0 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.136+0000 7fcf30ff9640 1 -- 172.21.15.37:0/1776945947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf24005490 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.136+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf34153140 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.136+0000 7fcf30ff9640 1 -- 172.21.15.37:0/1776945947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24007260 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.136+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf34153700 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.137+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf340693f0 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.137+0000 7fcf30ff9640 1 -- 172.21.15.37:0/1776945947 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf24007400 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.138+0000 7fcf30ff9640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf200762d0 0x7fcf20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.138+0000 7fcf30ff9640 1 -- 172.21.15.37:0/1776945947 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcf24096e90 con 0x7fcf340d0ec0 2024-05-10T08:40:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.138+0000 7fcf337fe640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf200762d0 0x7fcf20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.138+0000 7fcf337fe640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf200762d0 0x7fcf20078790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf3406e470 tx=0x7fcf28008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.142+0000 7fcf30ff9640 1 -- 172.21.15.37:0/1776945947 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcf240604b0 con 0x7fcf340d0ec0 2024-05-10T08:40:49.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.347+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcf3406e1c0 con 0x7fcf340d0ec0 2024-05-10T08:40:49.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.347+0000 7fcf30ff9640 1 -- 172.21.15.37:0/1776945947 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fcf2405fdb0 con 0x7fcf340d0ec0 2024-05-10T08:40:49.347 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:40:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf200762d0 msgr2=0x7fcf20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf200762d0 0x7fcf20078790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf3406e470 tx=0x7fcf28008040 comp rx=0 tx=0).stop 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d0ec0 msgr2=0x7fcf3409f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d0ec0 0x7fcf3409f710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c400 tx=0x7fcf2400c8c0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 shutdown_connections 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf200762d0 0x7fcf20078790 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf3415f380 0x7fcf34153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf340d3b00 0x7fcf34152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 --2- 172.21.15.37:0/1776945947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf340d0ec0 0x7fcf3409f710 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 >> 172.21.15.37:0/1776945947 conn(0x7fcf340d4fe0 msgr2=0x7fcf3406e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 shutdown_connections 2024-05-10T08:40:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.350+0000 7fcf3a4b4640 1 -- 172.21.15.37:0/1776945947 wait complete. 2024-05-10T08:40:49.360 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-10T08:40:49.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:49.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-10T08:40:49.392 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:40:49.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:49.393 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-10T08:40:49.459 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:49.459 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:49.476 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:49.476 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:49.533 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:40:49.533 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:49.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:40:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.734+0000 7fccf4daf640 1 Processor -- start 2024-05-10T08:40:49.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.734+0000 7fccf4daf640 1 -- start start 2024-05-10T08:40:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccf4daf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccf015f450 0x7fccf006d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccf4daf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f830 0x7fccf006d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccf4daf640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf00d0cb0 con 0x7fccf00d0700 2024-05-10T08:40:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccf4daf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fccf006d690 con 0x7fccf015f450 2024-05-10T08:40:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccf4daf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fccf00d0f90 con 0x7fccf015f830 2024-05-10T08:40:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccee59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccf015f450 0x7fccf006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccee59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccf015f450 0x7fccf006d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39288/0 (socket says 172.21.15.37:39288) 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccee59c640 1 -- 172.21.15.37:0/2454167830 learned_addr learned my addr 172.21.15.37:0/2454167830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccedd9b640 1 --2- 172.21.15.37:0/2454167830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f830 0x7fccf006d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccee59c640 1 -- 172.21.15.37:0/2454167830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f830 msgr2=0x7fccf006d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.735+0000 7fccee59c640 1 --2- 172.21.15.37:0/2454167830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f830 0x7fccf006d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.736+0000 7fccee59c640 1 -- 172.21.15.37:0/2454167830 >> v1:172.21.15.82:6789/0 conn(0x7fccf00d0700 legacy=0x7fccf00d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.736+0000 7fccee59c640 1 -- 172.21.15.37:0/2454167830 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf00d2fe0 con 0x7fccf015f450 2024-05-10T08:40:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.736+0000 7fccedd9b640 1 --2- 172.21.15.37:0/2454167830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f830 0x7fccf006d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.736+0000 7fccee59c640 1 --2- 172.21.15.37:0/2454167830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f450 0x7fccf006d150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009870 tx=0x7fcce002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf38b0cfe8e0f12c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.736+0000 7fcced59a640 1 -- 172.21.15.37:0/2454167830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0037070 con 0x7fccf015f450 2024-05-10T08:40:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fcced59a640 1 -- 172.21.15.37:0/2454167830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0032440 con 0x7fccf015f450 2024-05-10T08:40:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fcced59a640 1 -- 172.21.15.37:0/2454167830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0032810 con 0x7fccf015f450 2024-05-10T08:40:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 -- 172.21.15.37:0/2454167830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f450 msgr2=0x7fccf006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 --2- 172.21.15.37:0/2454167830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f450 0x7fccf006d150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009870 tx=0x7fcce002a270 comp rx=0 tx=0).stop 2024-05-10T08:40:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 -- 172.21.15.37:0/2454167830 shutdown_connections 2024-05-10T08:40:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 --2- 172.21.15.37:0/2454167830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f830 0x7fccf006d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 --2- 172.21.15.37:0/2454167830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f450 0x7fccf006d150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 -- 172.21.15.37:0/2454167830 >> 172.21.15.37:0/2454167830 conn(0x7fccf00d5040 msgr2=0x7fccf00d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 -- 172.21.15.37:0/2454167830 shutdown_connections 2024-05-10T08:40:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.737+0000 7fccf4daf640 1 -- 172.21.15.37:0/2454167830 wait complete. 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 Processor -- start 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 -- start start 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccf00d0700 0x7fccf00b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f450 0x7fccf015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f830 0x7fccf0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00d4c50 con 0x7fccf015f830 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00d4ad0 con 0x7fccf00d0700 2024-05-10T08:40:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fccf4daf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fccf00d4dd0 con 0x7fccf015f450 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.739+0000 7fcceed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f830 0x7fccf0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f830 0x7fccf0155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39294/0 (socket says 172.21.15.37:39294) 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 -- 172.21.15.37:0/1805113911 learned_addr learned my addr 172.21.15.37:0/1805113911 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fccedd9b640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f450 0x7fccf015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fccee59c640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccf00d0700 0x7fccf00b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 -- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f450 msgr2=0x7fccf015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f450 0x7fccf015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 -- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccf00d0700 msgr2=0x7fccf00b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccf00d0700 0x7fccf00b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 -- 172.21.15.37:0/1805113911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf015cbc0 con 0x7fccf015f830 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fcceed9d640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f830 0x7fccf0155370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcce800c730 tx=0x7fcce800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fccdeffd640 1 -- 172.21.15.37:0/1805113911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8016020 con 0x7fccf015f830 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fccdeffd640 1 -- 172.21.15.37:0/1805113911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce8006d50 con 0x7fccf015f830 2024-05-10T08:40:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf015cea0 con 0x7fccf015f830 2024-05-10T08:40:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fccdeffd640 1 -- 172.21.15.37:0/1805113911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8003bb0 con 0x7fccf015f830 2024-05-10T08:40:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.740+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf015d460 con 0x7fccf015f830 2024-05-10T08:40:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.741+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf015d940 con 0x7fccf015f830 2024-05-10T08:40:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.742+0000 7fccdeffd640 1 -- 172.21.15.37:0/1805113911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcce80050d0 con 0x7fccf015f830 2024-05-10T08:40:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.742+0000 7fccdeffd640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fccd0076300 0x7fccd00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.743+0000 7fccdeffd640 1 -- 172.21.15.37:0/1805113911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcce8097400 con 0x7fccf015f830 2024-05-10T08:40:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.743+0000 7fccee59c640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fccd0076300 0x7fccd00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.743+0000 7fccee59c640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fccd0076300 0x7fccd00787c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcce0034000 tx=0x7fcce002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.747+0000 7fccdeffd640 1 -- 172.21.15.37:0/1805113911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fccf015d940 con 0x7fccf015f830 2024-05-10T08:40:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.955+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fccf00ca8c0 con 0x7fccf015f830 2024-05-10T08:40:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.956+0000 7fccdeffd640 1 -- 172.21.15.37:0/1805113911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fcce8020020 con 0x7fccf015f830 2024-05-10T08:40:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fccd0076300 msgr2=0x7fccd00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fccd0076300 0x7fccd00787c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcce0034000 tx=0x7fcce002e000 comp rx=0 tx=0).stop 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f830 msgr2=0x7fccf0155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f830 0x7fccf0155370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcce800c730 tx=0x7fcce800cb30 comp rx=0 tx=0).stop 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 shutdown_connections 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fccd0076300 0x7fccd00787c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015f830 0x7fccf0155370 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccf015f450 0x7fccf015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 --2- 172.21.15.37:0/1805113911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccf00d0700 0x7fccf00b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 >> 172.21.15.37:0/1805113911 conn(0x7fccf00d5040 msgr2=0x7fccf00cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 shutdown_connections 2024-05-10T08:40:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:49.958+0000 7fccf4daf640 1 -- 172.21.15.37:0/1805113911 wait complete. 2024-05-10T08:40:49.969 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-10T08:40:49.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:49.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-10T08:40:49.997 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:40:49.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:49.997 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-10T08:40:50.053 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:50.054 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:50.073 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:50.073 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:50.132 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:40:50.132 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:40:50.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:40:50.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.296+0000 7f4bd62da640 1 Processor -- start 2024-05-10T08:40:50.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.296+0000 7f4bd62da640 1 -- start start 2024-05-10T08:40:50.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd62da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bd0070d30 0x7f4bd00d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd62da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0163920 0x7f4bd00703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd62da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bd0071110 0x7f4bd006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd62da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd00d10d0 con 0x7f4bd0071110 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd62da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd0070b80 con 0x7f4bd0070d30 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd62da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd00d1c30 con 0x7f4bd0163920 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd4877640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bd0071110 0x7f4bd006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd4877640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bd0071110 0x7f4bd006d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39306/0 (socket says 172.21.15.37:39306) 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bd4877640 1 -- 172.21.15.37:0/707808967 learned_addr learned my addr 172.21.15.37:0/707808967 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bcffff640 1 --2- 172.21.15.37:0/707808967 >> v2:172.21.15.82:3300/0 conn(0x7f4bd0070d30 0x7f4bd00d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.297+0000 7f4bcf7fe640 1 --2- 172.21.15.37:0/707808967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0163920 0x7f4bd00703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.298+0000 7f4bd4877640 1 -- 172.21.15.37:0/707808967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0163920 msgr2=0x7f4bd00703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.298+0000 7f4bd4877640 1 --2- 172.21.15.37:0/707808967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0163920 0x7f4bd00703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.298+0000 7f4bd4877640 1 -- 172.21.15.37:0/707808967 >> v2:172.21.15.82:3300/0 conn(0x7f4bd0070d30 msgr2=0x7f4bd00d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.298+0000 7f4bd4877640 1 --2- 172.21.15.37:0/707808967 >> v2:172.21.15.82:3300/0 conn(0x7f4bd0070d30 0x7f4bd00d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.298+0000 7f4bd4877640 1 -- 172.21.15.37:0/707808967 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd0163d80 con 0x7f4bd0071110 2024-05-10T08:40:50.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.298+0000 7f4bd4877640 1 --2- 172.21.15.37:0/707808967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0071110 0x7f4bd006d4b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00d3f90 tx=0x7f4bc802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b37225114aa0c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:50.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.298+0000 7f4bceffd640 1 -- 172.21.15.37:0/707808967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8036070 con 0x7f4bd0071110 2024-05-10T08:40:50.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bceffd640 1 -- 172.21.15.37:0/707808967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc8031600 con 0x7f4bd0071110 2024-05-10T08:40:50.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bceffd640 1 -- 172.21.15.37:0/707808967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80319d0 con 0x7f4bd0071110 2024-05-10T08:40:50.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 -- 172.21.15.37:0/707808967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0071110 msgr2=0x7f4bd006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 --2- 172.21.15.37:0/707808967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0071110 0x7f4bd006d4b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00d3f90 tx=0x7f4bc802a6a0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 -- 172.21.15.37:0/707808967 shutdown_connections 2024-05-10T08:40:50.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 --2- 172.21.15.37:0/707808967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0071110 0x7f4bd006d4b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 --2- 172.21.15.37:0/707808967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0163920 0x7f4bd00703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 --2- 172.21.15.37:0/707808967 >> v2:172.21.15.82:3300/0 conn(0x7f4bd0070d30 0x7f4bd00d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 -- 172.21.15.37:0/707808967 >> 172.21.15.37:0/707808967 conn(0x7f4bd00d2e90 msgr2=0x7f4bd00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:50.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 -- 172.21.15.37:0/707808967 shutdown_connections 2024-05-10T08:40:50.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.299+0000 7f4bd62da640 1 -- 172.21.15.37:0/707808967 wait complete. 2024-05-10T08:40:50.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.300+0000 7f4bd62da640 1 Processor -- start 2024-05-10T08:40:50.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.300+0000 7f4bd62da640 1 -- start start 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd62da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd0070d30 0x7f4bd0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd62da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0071110 0x7f4bd00b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd62da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0163920 0x7f4bd00c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd62da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd00d15e0 con 0x7f4bd0163920 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd62da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd00708e0 con 0x7f4bd0070d30 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd62da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd00d18c0 con 0x7f4bd0071110 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd4877640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0163920 0x7f4bd00c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd4877640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0163920 0x7f4bd00c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39316/0 (socket says 172.21.15.37:39316) 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.301+0000 7f4bd4877640 1 -- 172.21.15.37:0/1588492480 learned_addr learned my addr 172.21.15.37:0/1588492480 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bcf7fe640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0071110 0x7f4bd00b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd4877640 1 -- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0071110 msgr2=0x7f4bd00b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd4877640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0071110 0x7f4bd00b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd4877640 1 -- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd0070d30 msgr2=0x7f4bd0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bcffff640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd0070d30 0x7f4bd0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd4877640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd0070d30 0x7f4bd0159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd4877640 1 -- 172.21.15.37:0/1588492480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd00b66c0 con 0x7f4bd0163920 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd4877640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0163920 0x7f4bd00c8b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8034040 tx=0x7f4bc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bccff9640 1 -- 172.21.15.37:0/1588492480 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8036050 con 0x7f4bd0163920 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bccff9640 1 -- 172.21.15.37:0/1588492480 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc8042070 con 0x7f4bd0163920 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd00b69a0 con 0x7f4bd0163920 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bccff9640 1 -- 172.21.15.37:0/1588492480 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8009510 con 0x7f4bd0163920 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.302+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd00b6f60 con 0x7f4bd0163920 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.303+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd00693f0 con 0x7f4bd0163920 2024-05-10T08:40:50.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.304+0000 7f4bccff9640 1 -- 172.21.15.37:0/1588492480 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4bc8007bf0 con 0x7f4bd0163920 2024-05-10T08:40:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.304+0000 7f4bccff9640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4bbc0762d0 0x7f4bbc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.304+0000 7f4bccff9640 1 -- 172.21.15.37:0/1588492480 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4bc80b8590 con 0x7f4bd0163920 2024-05-10T08:40:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.305+0000 7f4bcffff640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4bbc0762d0 0x7f4bbc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.305+0000 7f4bcffff640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4bbc0762d0 0x7f4bbc078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b54d0 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:50.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.309+0000 7f4bccff9640 1 -- 172.21.15.37:0/1588492480 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4bc8081c40 con 0x7f4bd0163920 2024-05-10T08:40:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.513+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4bd00d3d70 con 0x7f4bd0163920 2024-05-10T08:40:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.513+0000 7f4bccff9640 1 -- 172.21.15.37:0/1588492480 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f4bc8081540 con 0x7f4bd0163920 2024-05-10T08:40:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:40:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.515+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4bbc0762d0 msgr2=0x7f4bbc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.515+0000 7f4bd62da640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4bbc0762d0 0x7f4bbc078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b54d0 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.515+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0163920 msgr2=0x7f4bd00c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.515+0000 7f4bd62da640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0163920 0x7f4bd00c8b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8034040 tx=0x7f4bc8004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 shutdown_connections 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4bbc0762d0 0x7f4bbc078790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd0163920 0x7f4bd00c8b90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4bd0071110 0x7f4bd00b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 --2- 172.21.15.37:0/1588492480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd0070d30 0x7f4bd0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 >> 172.21.15.37:0/1588492480 conn(0x7f4bd00d2e90 msgr2=0x7f4bd00b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 shutdown_connections 2024-05-10T08:40:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.516+0000 7f4bd62da640 1 -- 172.21.15.37:0/1588492480 wait complete. 2024-05-10T08:40:50.526 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-10T08:40:50.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:50.527 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-10T08:40:50.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:40:50.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:40:50.559 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-10T08:40:50.618 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T08:40:50.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.722+0000 7f6e68771640 1 Processor -- start 2024-05-10T08:40:50.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.722+0000 7f6e68771640 1 -- start start 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e68771640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e600d3cd0 0x7f6e6016a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e68771640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e600d1760 con 0x7f6e600d0ec0 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e68771640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e600d1a40 con 0x7f6e6015f380 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e68771640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6e600d30f0 con 0x7f6e600d3cd0 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e66d0e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e600d3cd0 0x7f6e6016a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e65d0c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6e600d0ec0 0x7f6e600d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54718/0 (socket says 172.21.15.37:54718) 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e65d0c640 1 -- 172.21.15.37:0/1105572439 learned_addr learned my addr 172.21.15.37:0/1105572439 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e66d0e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e600d3cd0 0x7f6e6016a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39326/0 (socket says 172.21.15.37:39326) 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e66d0e640 1 -- 172.21.15.37:0/1105572439 >> v1:172.21.15.82:6789/0 conn(0x7f6e6015f380 legacy=0x7f6e600d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e66d0e640 1 -- 172.21.15.37:0/1105572439 >> v1:172.21.15.37:6789/0 conn(0x7f6e600d0ec0 legacy=0x7f6e600d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e66d0e640 1 -- 172.21.15.37:0/1105572439 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e600d1d20 con 0x7f6e600d3cd0 2024-05-10T08:40:50.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.723+0000 7f6e6550b640 1 -- 172.21.15.37:0/1105572439 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815849343 0 0) 0x7f6e600d1760 con 0x7f6e600d0ec0 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.724+0000 7f6e66d0e640 1 --2- 172.21.15.37:0/1105572439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d3cd0 0x7f6e6016a1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009d90 tx=0x7f6e5802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae4a6e947852d04 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.724+0000 7f6e6550b640 1 -- 172.21.15.37:0/1105572439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58007740 con 0x7f6e600d3cd0 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.724+0000 7f6e6550b640 1 -- 172.21.15.37:0/1105572439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e580078e0 con 0x7f6e600d3cd0 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.724+0000 7f6e6550b640 1 -- 172.21.15.37:0/1105572439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58007cb0 con 0x7f6e600d3cd0 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.725+0000 7f6e68771640 1 -- 172.21.15.37:0/1105572439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d3cd0 msgr2=0x7f6e6016a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.725+0000 7f6e68771640 1 --2- 172.21.15.37:0/1105572439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d3cd0 0x7f6e6016a1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009d90 tx=0x7f6e5802a6f0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.725+0000 7f6e68771640 1 -- 172.21.15.37:0/1105572439 shutdown_connections 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.725+0000 7f6e68771640 1 --2- 172.21.15.37:0/1105572439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d3cd0 0x7f6e6016a1f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.725+0000 7f6e68771640 1 -- 172.21.15.37:0/1105572439 >> 172.21.15.37:0/1105572439 conn(0x7f6e600d4fe0 msgr2=0x7f6e600d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:50.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.725+0000 7f6e68771640 1 -- 172.21.15.37:0/1105572439 shutdown_connections 2024-05-10T08:40:50.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.725+0000 7f6e68771640 1 -- 172.21.15.37:0/1105572439 wait complete. 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.726+0000 7f6e68771640 1 Processor -- start 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.726+0000 7f6e68771640 1 -- start start 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e68771640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d0ec0 0x7f6e600a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e68771640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600d3cd0 0x7f6e600cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e68771640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e6015f380 0x7f6e600ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e68771640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e600b8e40 con 0x7f6e600d0ec0 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e68771640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e600d2370 con 0x7f6e600d3cd0 2024-05-10T08:40:50.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e68771640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6e6015f760 con 0x7f6e6015f380 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d0ec0 0x7f6e600a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d0ec0 0x7f6e600a20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39342/0 (socket says 172.21.15.37:39342) 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 -- 172.21.15.37:0/3535754280 learned_addr learned my addr 172.21.15.37:0/3535754280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e65d0c640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600d3cd0 0x7f6e600cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e66d0e640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e6015f380 0x7f6e600ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 -- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e6015f380 msgr2=0x7f6e600ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e6015f380 0x7f6e600ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 -- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600d3cd0 msgr2=0x7f6e600cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600d3cd0 0x7f6e600cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 -- 172.21.15.37:0/3535754280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6009f590 con 0x7f6e600d0ec0 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e65d0c640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600d3cd0 0x7f6e600cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e6650d640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d0ec0 0x7f6e600a20b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00c400 tx=0x7f6e5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.727+0000 7f6e56ffd640 1 -- 172.21.15.37:0/3535754280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c017070 con 0x7f6e600d0ec0 2024-05-10T08:40:50.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.728+0000 7f6e56ffd640 1 -- 172.21.15.37:0/3535754280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c0052d0 con 0x7f6e600d0ec0 2024-05-10T08:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.728+0000 7f6e56ffd640 1 -- 172.21.15.37:0/3535754280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c003830 con 0x7f6e600d0ec0 2024-05-10T08:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.728+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6009f870 con 0x7f6e600d0ec0 2024-05-10T08:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.728+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6009fe30 con 0x7f6e600d0ec0 2024-05-10T08:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.729+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e600693f0 con 0x7f6e600d0ec0 2024-05-10T08:40:50.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.729+0000 7f6e56ffd640 1 -- 172.21.15.37:0/3535754280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e5c01a070 con 0x7f6e600d0ec0 2024-05-10T08:40:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.730+0000 7f6e56ffd640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e440762d0 0x7f6e44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.730+0000 7f6e56ffd640 1 -- 172.21.15.37:0/3535754280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6e5c096cd0 con 0x7f6e600d0ec0 2024-05-10T08:40:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.730+0000 7f6e65d0c640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e440762d0 0x7f6e44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.730+0000 7f6e65d0c640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e440762d0 0x7f6e44078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ced20 tx=0x7f6e50007c50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.734+0000 7f6e56ffd640 1 -- 172.21.15.37:0/3535754280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6e5c0602f0 con 0x7f6e600d0ec0 2024-05-10T08:40:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.965+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e600d3660 con 0x7f6e600d0ec0 2024-05-10T08:40:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.965+0000 7f6e56ffd640 1 -- 172.21.15.37:0/3535754280 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f6e5c0682e0 con 0x7f6e600d0ec0 2024-05-10T08:40:50.965 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:50.965 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e440762d0 msgr2=0x7f6e44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e440762d0 0x7f6e44078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ced20 tx=0x7f6e50007c50 comp rx=0 tx=0).stop 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d0ec0 msgr2=0x7f6e600a20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d0ec0 0x7f6e600a20b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00c400 tx=0x7f6e5c00c8c0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 shutdown_connections 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e440762d0 0x7f6e44078790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e6015f380 0x7f6e600ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e600d3cd0 0x7f6e600cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 --2- 172.21.15.37:0/3535754280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e600d0ec0 0x7f6e600a20b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 >> 172.21.15.37:0/3535754280 conn(0x7f6e600d4fe0 msgr2=0x7f6e600b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 shutdown_connections 2024-05-10T08:40:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:50.967+0000 7f6e68771640 1 -- 172.21.15.37:0/3535754280 wait complete. 2024-05-10T08:40:50.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.081+0000 7f139e71c640 1 Processor -- start 2024-05-10T08:40:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.081+0000 7f139e71c640 1 -- start start 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f139e71c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1398070d20 0x7f13980711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f139e71c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f139806e110 con 0x7f13980b2490 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f139e71c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f139806e3f0 con 0x7f13981629b0 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f139e71c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1398070a40 con 0x7f1398070d20 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f139ccb9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1398070d20 0x7f13980711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f139ccb9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1398070d20 0x7f13980711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39352/0 (socket says 172.21.15.37:39352) 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f13977fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f13980b2490 0x7f1398070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54734/0 (socket says 172.21.15.37:54734) 2024-05-10T08:40:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.082+0000 7f139ccb9640 1 -- 172.21.15.37:0/1727084372 learned_addr learned my addr 172.21.15.37:0/1727084372 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.083+0000 7f139ccb9640 1 -- 172.21.15.37:0/1727084372 >> v1:172.21.15.82:6789/0 conn(0x7f13981629b0 legacy=0x7f139806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.083+0000 7f139ccb9640 1 -- 172.21.15.37:0/1727084372 >> v1:172.21.15.37:6789/0 conn(0x7f13980b2490 legacy=0x7f1398070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.083+0000 7f1396ffd640 1 -- 172.21.15.37:0/1727084372 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665136710 0 0) 0x7f139806e110 con 0x7f13980b2490 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.083+0000 7f139ccb9640 1 -- 172.21.15.37:0/1727084372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139806e6d0 con 0x7f1398070d20 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.083+0000 7f139ccb9640 1 --2- 172.21.15.37:0/1727084372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980711d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1390009e50 tx=0x7f139002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21e374a7309deee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.083+0000 7f1396ffd640 1 -- 172.21.15.37:0/1727084372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390036070 con 0x7f1398070d20 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f1396ffd640 1 -- 172.21.15.37:0/1727084372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1390031600 con 0x7f1398070d20 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f1396ffd640 1 -- 172.21.15.37:0/1727084372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13900319d0 con 0x7f1398070d20 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f139e71c640 1 -- 172.21.15.37:0/1727084372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 msgr2=0x7f13980711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f139e71c640 1 --2- 172.21.15.37:0/1727084372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980711d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1390009e50 tx=0x7f139002a760 comp rx=0 tx=0).stop 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f139e71c640 1 -- 172.21.15.37:0/1727084372 shutdown_connections 2024-05-10T08:40:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f139e71c640 1 --2- 172.21.15.37:0/1727084372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980711d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f139e71c640 1 -- 172.21.15.37:0/1727084372 >> 172.21.15.37:0/1727084372 conn(0x7f13980b49d0 msgr2=0x7f13980b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f139e71c640 1 -- 172.21.15.37:0/1727084372 shutdown_connections 2024-05-10T08:40:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.084+0000 7f139e71c640 1 -- 172.21.15.37:0/1727084372 wait complete. 2024-05-10T08:40:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.085+0000 7f139e71c640 1 Processor -- start 2024-05-10T08:40:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f139e71c640 1 -- start start 2024-05-10T08:40:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f139e71c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f139e71c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13980b2490 0x7f139815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f139e71c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13981629b0 0x7f139815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f139e71c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13980afcb0 con 0x7f1398070d20 2024-05-10T08:40:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f139e71c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f139806dec0 con 0x7f13981629b0 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f139e71c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f13980afe30 con 0x7f13980b2490 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f1397fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f1397fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39366/0 (socket says 172.21.15.37:39366) 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.086+0000 7f1397fff640 1 -- 172.21.15.37:0/1781197438 learned_addr learned my addr 172.21.15.37:0/1781197438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f13977fe640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13980b2490 0x7f139815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f139ccb9640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13981629b0 0x7f139815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1397fff640 1 -- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13980b2490 msgr2=0x7f139815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1397fff640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13980b2490 0x7f139815e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1397fff640 1 -- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13981629b0 msgr2=0x7f139815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1397fff640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13981629b0 0x7f139815e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1397fff640 1 -- 172.21.15.37:0/1781197438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13980c9f10 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f139ccb9640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13981629b0 0x7f139815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1397fff640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980c9190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f138800b3f0 tx=0x7f138800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1394ff9640 1 -- 172.21.15.37:0/1781197438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388015020 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1394ff9640 1 -- 172.21.15.37:0/1781197438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388011830 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13980ca1f0 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f1394ff9640 1 -- 172.21.15.37:0/1781197438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388011c20 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.087+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13980ca7b0 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.088+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13980693f0 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.089+0000 7f1394ff9640 1 -- 172.21.15.37:0/1781197438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1388018020 con 0x7f1398070d20 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.089+0000 7f1394ff9640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13840762d0 0x7f1384078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.089+0000 7f1394ff9640 1 -- 172.21.15.37:0/1781197438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1388097570 con 0x7f1398070d20 2024-05-10T08:40:51.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.089+0000 7f13977fe640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13840762d0 0x7f1384078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.090+0000 7f13977fe640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13840762d0 0x7f1384078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1398071280 tx=0x7f138c007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.093+0000 7f1394ff9640 1 -- 172.21.15.37:0/1781197438 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f138801f030 con 0x7f1398070d20 2024-05-10T08:40:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.324+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f139815f8a0 con 0x7f1398070d20 2024-05-10T08:40:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.324+0000 7f1394ff9640 1 -- 172.21.15.37:0/1781197438 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f1388060b90 con 0x7f1398070d20 2024-05-10T08:40:51.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:51.324 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13840762d0 msgr2=0x7f1384078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13840762d0 0x7f1384078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1398071280 tx=0x7f138c007d50 comp rx=0 tx=0).stop 2024-05-10T08:40:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 msgr2=0x7f13980c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980c9190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f138800b3f0 tx=0x7f138800b8b0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 shutdown_connections 2024-05-10T08:40:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13840762d0 0x7f1384078790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13981629b0 0x7f139815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13980b2490 0x7f139815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 --2- 172.21.15.37:0/1781197438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398070d20 0x7f13980c9190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.326+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 >> 172.21.15.37:0/1781197438 conn(0x7f13980b49d0 msgr2=0x7f13980d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.327+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 shutdown_connections 2024-05-10T08:40:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.327+0000 7f139e71c640 1 -- 172.21.15.37:0/1781197438 wait complete. 2024-05-10T08:40:51.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:51.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.442+0000 7fcd5d180640 1 Processor -- start 2024-05-10T08:40:51.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.442+0000 7fcd5d180640 1 -- start start 2024-05-10T08:40:51.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd5d180640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd5815f420 0x7fcd580d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd5d180640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd581630b0 con 0x7fcd580d3ca0 2024-05-10T08:40:51.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd5d180640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd580d2550 con 0x7fcd580d2080 2024-05-10T08:40:51.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd5d180640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcd580d2c80 con 0x7fcd5815f420 2024-05-10T08:40:51.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd56d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd5815f420 0x7fcd580d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd5659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcd580d3ca0 0x7fcd580d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54750/0 (socket says 172.21.15.37:54750) 2024-05-10T08:40:51.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd56d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd5815f420 0x7fcd580d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39368/0 (socket says 172.21.15.37:39368) 2024-05-10T08:40:51.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.443+0000 7fcd5659c640 1 -- 172.21.15.37:0/692203580 learned_addr learned my addr 172.21.15.37:0/692203580 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:51.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.444+0000 7fcd56d9d640 1 -- 172.21.15.37:0/692203580 >> v1:172.21.15.82:6789/0 conn(0x7fcd580d2080 legacy=0x7fcd580d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:51.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.444+0000 7fcd56d9d640 1 -- 172.21.15.37:0/692203580 >> v1:172.21.15.37:6789/0 conn(0x7fcd580d3ca0 legacy=0x7fcd580d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.444+0000 7fcd56d9d640 1 -- 172.21.15.37:0/692203580 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd580d2f60 con 0x7fcd5815f420 2024-05-10T08:40:51.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.444+0000 7fcd56d9d640 1 --2- 172.21.15.37:0/692203580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5815f420 0x7fcd580d3760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd500097a0 tx=0x7fcd5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cd73302557400d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.444+0000 7fcd55d9b640 1 -- 172.21.15.37:0/692203580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50037070 con 0x7fcd5815f420 2024-05-10T08:40:51.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.444+0000 7fcd55d9b640 1 -- 172.21.15.37:0/692203580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd50032440 con 0x7fcd5815f420 2024-05-10T08:40:51.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.444+0000 7fcd55d9b640 1 -- 172.21.15.37:0/692203580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50032810 con 0x7fcd5815f420 2024-05-10T08:40:51.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.445+0000 7fcd5d180640 1 -- 172.21.15.37:0/692203580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5815f420 msgr2=0x7fcd580d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.445+0000 7fcd5d180640 1 --2- 172.21.15.37:0/692203580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5815f420 0x7fcd580d3760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd500097a0 tx=0x7fcd5002a1e0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.445+0000 7fcd5d180640 1 -- 172.21.15.37:0/692203580 shutdown_connections 2024-05-10T08:40:51.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.445+0000 7fcd5d180640 1 --2- 172.21.15.37:0/692203580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5815f420 0x7fcd580d3760 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.445+0000 7fcd5d180640 1 -- 172.21.15.37:0/692203580 >> 172.21.15.37:0/692203580 conn(0x7fcd5808eac0 msgr2=0x7fcd5809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:51.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.445+0000 7fcd5d180640 1 -- 172.21.15.37:0/692203580 shutdown_connections 2024-05-10T08:40:51.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.445+0000 7fcd5d180640 1 -- 172.21.15.37:0/692203580 wait complete. 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.446+0000 7fcd5d180640 1 Processor -- start 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5d180640 1 -- start start 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5d180640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd580d2080 0x7fcd58154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5d180640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd580cb390 0x7fcd581f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5d180640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd581f8fb0 0x7fcd580ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5d180640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd580d53d0 con 0x7fcd581f8fb0 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5d180640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd580d2830 con 0x7fcd580d2080 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5d180640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcd580d5550 con 0x7fcd580cb390 2024-05-10T08:40:51.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd581f8fb0 0x7fcd580ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd581f8fb0 0x7fcd580ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39378/0 (socket says 172.21.15.37:39378) 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.447+0000 7fcd5759e640 1 -- 172.21.15.37:0/3295103721 learned_addr learned my addr 172.21.15.37:0/3295103721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5659c640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd580cb390 0x7fcd581f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd56d9d640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd580d2080 0x7fcd58154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5759e640 1 -- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd580cb390 msgr2=0x7fcd581f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5759e640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd580cb390 0x7fcd581f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5759e640 1 -- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd580d2080 msgr2=0x7fcd58154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5759e640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd580d2080 0x7fcd58154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5759e640 1 -- 172.21.15.37:0/3295103721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd581f9450 con 0x7fcd581f8fb0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5759e640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd581f8fb0 0x7fcd580ce350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c730 tx=0x7fcd4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/3295103721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48016020 con 0x7fcd581f8fb0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/3295103721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4800aa50 con 0x7fcd581f8fb0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/3295103721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800ce40 con 0x7fcd581f8fb0 2024-05-10T08:40:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd581f9730 con 0x7fcd581f8fb0 2024-05-10T08:40:51.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.448+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd580cb810 con 0x7fcd581f8fb0 2024-05-10T08:40:51.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.449+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd58161c90 con 0x7fcd581f8fb0 2024-05-10T08:40:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.450+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/3295103721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcd48019020 con 0x7fcd581f8fb0 2024-05-10T08:40:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.450+0000 7fcd4f7fe640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd380762d0 0x7fcd38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.450+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/3295103721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcd480978c0 con 0x7fcd581f8fb0 2024-05-10T08:40:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.450+0000 7fcd56d9d640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd380762d0 0x7fcd38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.451+0000 7fcd56d9d640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd380762d0 0x7fcd38078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd50034000 tx=0x7fcd5002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.454+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/3295103721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcd48020030 con 0x7fcd581f8fb0 2024-05-10T08:40:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.646+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd580693f0 con 0x7fcd581f8fb0 2024-05-10T08:40:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.647+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/3295103721 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fcd48060ee0 con 0x7fcd581f8fb0 2024-05-10T08:40:51.647 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:51.648 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd380762d0 msgr2=0x7fcd38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd380762d0 0x7fcd38078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd50034000 tx=0x7fcd5002e000 comp rx=0 tx=0).stop 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd581f8fb0 msgr2=0x7fcd580ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd581f8fb0 0x7fcd580ce350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c730 tx=0x7fcd4800cbf0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 shutdown_connections 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd380762d0 0x7fcd38078790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd581f8fb0 0x7fcd580ce350 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd580cb390 0x7fcd581f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 --2- 172.21.15.37:0/3295103721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd580d2080 0x7fcd58154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 >> 172.21.15.37:0/3295103721 conn(0x7fcd5808eac0 msgr2=0x7fcd58163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 shutdown_connections 2024-05-10T08:40:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.650+0000 7fcd5d180640 1 -- 172.21.15.37:0/3295103721 wait complete. 2024-05-10T08:40:51.661 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:40:51.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:51.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.767+0000 7f9505d9d640 1 Processor -- start 2024-05-10T08:40:51.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.767+0000 7f9505d9d640 1 -- start start 2024-05-10T08:40:51.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f9505d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f95000cf8a0 0x7f950015e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f9505d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95000d39b0 0x7f95000cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f9505d9d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95000d01c0 con 0x7f95000d0f10 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f9505d9d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f950015d5f0 con 0x7f95000d39b0 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f9505d9d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9500161920 con 0x7f95000cf8a0 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94feffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95000d39b0 0x7f95000cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94fffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f95000d0f10 0x7f95000d1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54754/0 (socket says 172.21.15.37:54754) 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94fffff640 1 -- 172.21.15.37:0/2296802865 learned_addr learned my addr 172.21.15.37:0/2296802865 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94ff7fe640 1 --2- 172.21.15.37:0/2296802865 >> v2:172.21.15.82:3300/0 conn(0x7f95000cf8a0 0x7f950015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94feffd640 1 -- 172.21.15.37:0/2296802865 >> v2:172.21.15.82:3300/0 conn(0x7f95000cf8a0 msgr2=0x7f950015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94feffd640 1 --2- 172.21.15.37:0/2296802865 >> v2:172.21.15.82:3300/0 conn(0x7f95000cf8a0 0x7f950015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94feffd640 1 -- 172.21.15.37:0/2296802865 >> v1:172.21.15.37:6789/0 conn(0x7f95000d0f10 legacy=0x7f95000d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.768+0000 7f94feffd640 1 -- 172.21.15.37:0/2296802865 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9500160d10 con 0x7f95000d39b0 2024-05-10T08:40:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f94feffd640 1 --2- 172.21.15.37:0/2296802865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000d39b0 0x7f95000cfc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95000701d0 tx=0x7f94f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ea9a058ea41bd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f94fe7fc640 1 -- 172.21.15.37:0/2296802865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4037070 con 0x7f95000d39b0 2024-05-10T08:40:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f94fe7fc640 1 -- 172.21.15.37:0/2296802865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f4032440 con 0x7f95000d39b0 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f94fe7fc640 1 -- 172.21.15.37:0/2296802865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4032810 con 0x7f95000d39b0 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f9505d9d640 1 -- 172.21.15.37:0/2296802865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000d39b0 msgr2=0x7f95000cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f9505d9d640 1 --2- 172.21.15.37:0/2296802865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000d39b0 0x7f95000cfc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95000701d0 tx=0x7f94f402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f9505d9d640 1 -- 172.21.15.37:0/2296802865 shutdown_connections 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f9505d9d640 1 --2- 172.21.15.37:0/2296802865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000d39b0 0x7f95000cfc80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f9505d9d640 1 --2- 172.21.15.37:0/2296802865 >> v2:172.21.15.82:3300/0 conn(0x7f95000cf8a0 0x7f950015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.769+0000 7f9505d9d640 1 -- 172.21.15.37:0/2296802865 >> 172.21.15.37:0/2296802865 conn(0x7f95000d2e90 msgr2=0x7f95000d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.770+0000 7f9505d9d640 1 -- 172.21.15.37:0/2296802865 shutdown_connections 2024-05-10T08:40:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.770+0000 7f9505d9d640 1 -- 172.21.15.37:0/2296802865 wait complete. 2024-05-10T08:40:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.771+0000 7f9505d9d640 1 Processor -- start 2024-05-10T08:40:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.771+0000 7f9505d9d640 1 -- start start 2024-05-10T08:40:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000cf8a0 0x7f95001f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95000d0f10 0x7f95000c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95000d39b0 0x7f95000ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95001612d0 con 0x7f95000cf8a0 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95000d0700 con 0x7f95000d39b0 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f95001615b0 con 0x7f95000d0f10 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000cf8a0 0x7f95001f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000cf8a0 0x7f95001f2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39404/0 (socket says 172.21.15.37:39404) 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 -- 172.21.15.37:0/4163397587 learned_addr learned my addr 172.21.15.37:0/4163397587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94feffd640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95000d0f10 0x7f95000c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94fffff640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95000d39b0 0x7f95000ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 -- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95000d0f10 msgr2=0x7f95000c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95000d0f10 0x7f95000c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 -- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95000d39b0 msgr2=0x7f95000ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95000d39b0 0x7f95000ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 -- 172.21.15.37:0/4163397587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95000b77c0 con 0x7f95000cf8a0 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94feffd640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95000d0f10 0x7f95000c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94fffff640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95000d39b0 0x7f95000ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94ff7fe640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000cf8a0 0x7f95001f2fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94f000d5f0 tx=0x7f94f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94e7fff640 1 -- 172.21.15.37:0/4163397587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00125f0 con 0x7f95000cf8a0 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94e7fff640 1 -- 172.21.15.37:0/4163397587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f0019070 con 0x7f95000cf8a0 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95000caad0 con 0x7f95000cf8a0 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f94e7fff640 1 -- 172.21.15.37:0/4163397587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00129d0 con 0x7f95000cf8a0 2024-05-10T08:40:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.772+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95000cb090 con 0x7f95000cf8a0 2024-05-10T08:40:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.774+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95000693f0 con 0x7f95000cf8a0 2024-05-10T08:40:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.774+0000 7f94e7fff640 1 -- 172.21.15.37:0/4163397587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f94f0012b70 con 0x7f95000cf8a0 2024-05-10T08:40:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.775+0000 7f94e7fff640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f94ec0762d0 0x7f94ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.775+0000 7f94e7fff640 1 -- 172.21.15.37:0/4163397587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f94f0097d70 con 0x7f95000cf8a0 2024-05-10T08:40:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.775+0000 7f94feffd640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f94ec0762d0 0x7f94ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.776+0000 7f94feffd640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f94ec0762d0 0x7f94ec078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94f4034000 tx=0x7f94f402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:51.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:51.779+0000 7f94e7fff640 1 -- 172.21.15.37:0/4163397587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f94f0061390 con 0x7f95000cf8a0 2024-05-10T08:40:52.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.007+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95000cf680 con 0x7f95000cf8a0 2024-05-10T08:40:52.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.008+0000 7f94e7fff640 1 -- 172.21.15.37:0/4163397587 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f94f0060c90 con 0x7f95000cf8a0 2024-05-10T08:40:52.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:52.008 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f94ec0762d0 msgr2=0x7f94ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f94ec0762d0 0x7f94ec078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94f4034000 tx=0x7f94f402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000cf8a0 msgr2=0x7f95001f2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000cf8a0 0x7f95001f2fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94f000d5f0 tx=0x7f94f000dab0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 shutdown_connections 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f94ec0762d0 0x7f94ec078790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95000d39b0 0x7f95000ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95000d0f10 0x7f95000c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 --2- 172.21.15.37:0/4163397587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95000cf8a0 0x7f95001f2fb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 >> 172.21.15.37:0/4163397587 conn(0x7f95000d2e90 msgr2=0x7f95000d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:52.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 shutdown_connections 2024-05-10T08:40:52.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.010+0000 7f9505d9d640 1 -- 172.21.15.37:0/4163397587 wait complete. 2024-05-10T08:40:52.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:40:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.125+0000 7f4f25a64640 1 Processor -- start 2024-05-10T08:40:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.125+0000 7f4f25a64640 1 -- start start 2024-05-10T08:40:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f25a64640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 0x7f4f200d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f25a64640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f20071110 0x7f4f2006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f25a64640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f20163d80 con 0x7f4f20163920 2024-05-10T08:40:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f25a64640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4f200d10d0 con 0x7f4f20071110 2024-05-10T08:40:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f25a64640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4f20070b80 con 0x7f4f20070d30 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f1effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4f20163920 0x7f4f200703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54770/0 (socket says 172.21.15.37:54770) 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f1effd640 1 -- 172.21.15.37:0/1774239737 learned_addr learned my addr 172.21.15.37:0/1774239737 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f1ffff640 1 --2- 172.21.15.37:0/1774239737 >> v2:172.21.15.82:3300/0 conn(0x7f4f20071110 0x7f4f2006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 0x7f4f200d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516458455 0 0) 0x7f4f20163d80 con 0x7f4f20163920 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.126+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f08003520 con 0x7f4f20163920 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3332607139 0 0) 0x7f4f08003520 con 0x7f4f20163920 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 msgr2=0x7f4f200d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 0x7f4f200d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 >> v2:172.21.15.82:3300/0 conn(0x7f4f20071110 msgr2=0x7f4f2006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 --2- 172.21.15.37:0/1774239737 >> v2:172.21.15.82:3300/0 conn(0x7f4f20071110 0x7f4f2006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f200d1300 con 0x7f4f20163920 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f4f14001670 con 0x7f4f20163920 2024-05-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 >> v1:172.21.15.37:6789/0 conn(0x7f4f20163920 legacy=0x7f4f200703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 0x7f4f08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f08004d40 0x7f4f080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20070b80 con 0x7f4f080039b0 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0800b9c0 con 0x7f4f08004d40 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0800bb40 con 0x7f4f20070d30 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1effd640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 0x7f4f08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1ffff640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f08004d40 0x7f4f080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1f7fe640 1 -- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 msgr2=0x7f4f08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f20070d30 0x7f4f08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1f7fe640 1 -- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f08004d40 msgr2=0x7f4f080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f08004d40 0x7f4f080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1f7fe640 1 -- 172.21.15.37:0/1774239737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f08003520 con 0x7f4f080039b0 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.127+0000 7f4f1ffff640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f08004d40 0x7f4f080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.128+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f08003dd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009ac0 tx=0x7f4f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfd7ec9af2b247a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.128+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10036070 con 0x7f4f080039b0 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.128+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f10031400 con 0x7f4f080039b0 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.128+0000 7f4f1e7fc640 1 -- 172.21.15.37:0/1774239737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10009690 con 0x7f4f080039b0 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.129+0000 7f4f25a64640 1 -- 172.21.15.37:0/1774239737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 msgr2=0x7f4f08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.129+0000 7f4f25a64640 1 --2- 172.21.15.37:0/1774239737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f08003dd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009ac0 tx=0x7f4f08005830 comp rx=0 tx=0).stop 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.129+0000 7f4f1ffff640 1 -- 172.21.15.37:0/1774239737 reap_dead start 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.129+0000 7f4f25a64640 1 -- 172.21.15.37:0/1774239737 shutdown_connections 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.129+0000 7f4f25a64640 1 -- 172.21.15.37:0/1774239737 >> 172.21.15.37:0/1774239737 conn(0x7f4f200d2e90 msgr2=0x7f4f200d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.129+0000 7f4f25a64640 1 -- 172.21.15.37:0/1774239737 shutdown_connections 2024-05-10T08:40:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.129+0000 7f4f25a64640 1 -- 172.21.15.37:0/1774239737 wait complete. 2024-05-10T08:40:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.130+0000 7f4f25a64640 1 Processor -- start 2024-05-10T08:40:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.130+0000 7f4f25a64640 1 -- start start 2024-05-10T08:40:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f25a64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f200b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f25a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f200b88c0 0x7f4f201f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f25a64640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f200ca2e0 0x7f4f201f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f25a64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200d18c0 con 0x7f4f080039b0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f25a64640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200d1c30 con 0x7f4f200b88c0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f25a64640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4f200715a0 con 0x7f4f200ca2e0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f200b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f200b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39412/0 (socket says 172.21.15.37:39412) 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 -- 172.21.15.37:0/466837398 learned_addr learned my addr 172.21.15.37:0/466837398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1effd640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f200b88c0 0x7f4f201f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1ffff640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f200ca2e0 0x7f4f201f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 -- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f200ca2e0 msgr2=0x7f4f201f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f200ca2e0 0x7f4f201f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 -- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f200b88c0 msgr2=0x7f4f201f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f200b88c0 0x7f4f201f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 -- 172.21.15.37:0/466837398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f200c7180 con 0x7f4f080039b0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f1f7fe640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f200b5e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009ac0 tx=0x7f4f10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.131+0000 7f4f07fff640 1 -- 172.21.15.37:0/466837398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10040020 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.132+0000 7f4f07fff640 1 -- 172.21.15.37:0/466837398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f10003bc0 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.132+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f200c7460 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.132+0000 7f4f07fff640 1 -- 172.21.15.37:0/466837398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10036040 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.132+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f200c7a20 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.133+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f200693f0 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.133+0000 7f4f07fff640 1 -- 172.21.15.37:0/466837398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f10043020 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.134+0000 7f4f07fff640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f0c076300 0x7f4f0c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.134+0000 7f4f07fff640 1 -- 172.21.15.37:0/466837398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f100b7b40 con 0x7f4f080039b0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.134+0000 7f4f1effd640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f0c076300 0x7f4f0c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.134+0000 7f4f1effd640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f0c076300 0x7f4f0c0787c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f200c8c30 tx=0x7f4f14009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.138+0000 7f4f07fff640 1 -- 172.21.15.37:0/466837398 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4f1004a070 con 0x7f4f080039b0 2024-05-10T08:40:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.370+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f200d3d70 con 0x7f4f080039b0 2024-05-10T08:40:52.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.371+0000 7f4f07fff640 1 -- 172.21.15.37:0/466837398 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f4f100044e0 con 0x7f4f080039b0 2024-05-10T08:40:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:52.371 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6834/1438434187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1438434187},{"type":"v1","addr":"172.21.15.82:6834","nonce":1438434187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3187553938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3187553938},{"type":"v1","addr":"172.21.15.82:6837","nonce":3187553938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3095648814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3095648814},{"type":"v1","addr":"172.21.15.37:6834","nonce":3095648814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:40:15.092985+0000","modified":"2024-05-10T08:40:28.123575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/665979516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":665979516},{"type":"v1","addr":"172.21.15.37:6835","nonce":665979516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-10T08:40:52.371 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-05-10T08:40:52.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f0c076300 msgr2=0x7f4f0c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f0c076300 0x7f4f0c0787c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f200c8c30 tx=0x7f4f14009040 comp rx=0 tx=0).stop 2024-05-10T08:40:52.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 msgr2=0x7f4f200b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f200b5e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009ac0 tx=0x7f4f10004730 comp rx=0 tx=0).stop 2024-05-10T08:40:52.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 shutdown_connections 2024-05-10T08:40:52.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f0c076300 0x7f4f0c0787c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f200ca2e0 0x7f4f201f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f200b88c0 0x7f4f201f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 --2- 172.21.15.37:0/466837398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f080039b0 0x7f4f200b5e70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 >> 172.21.15.37:0/466837398 conn(0x7f4f200d2e90 msgr2=0x7f4f2015aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:52.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 shutdown_connections 2024-05-10T08:40:52.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.373+0000 7f4f25a64640 1 -- 172.21.15.37:0/466837398 wait complete. 2024-05-10T08:40:52.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:40:52.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.488+0000 7f49fdd51640 1 Processor -- start 2024-05-10T08:40:52.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.488+0000 7f49fdd51640 1 -- start start 2024-05-10T08:40:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49fdd51640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49f81629a0 0x7f49f80d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49fdd51640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80d2dc0 0x7f49f80d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49fdd51640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49f80c8ed0 0x7f49f80c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49fdd51640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f49f80d3330 con 0x7f49f80c8ed0 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49fdd51640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f49f80d2170 con 0x7f49f81629a0 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49fdd51640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f49f80d2450 con 0x7f49f80d2dc0 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49f7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49f80c8ed0 0x7f49f80c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49f7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49f80c8ed0 0x7f49f80c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39428/0 (socket says 172.21.15.37:39428) 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49f7fff640 1 -- 172.21.15.37:0/236508205 learned_addr learned my addr 172.21.15.37:0/236508205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49f6ffd640 1 --2- 172.21.15.37:0/236508205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80d2dc0 0x7f49f80d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49f7fff640 1 -- 172.21.15.37:0/236508205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80d2dc0 msgr2=0x7f49f80d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49f77fe640 1 --2- 172.21.15.37:0/236508205 >> v2:172.21.15.82:3300/0 conn(0x7f49f81629a0 0x7f49f80d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.489+0000 7f49f7fff640 1 --2- 172.21.15.37:0/236508205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80d2dc0 0x7f49f80d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f7fff640 1 -- 172.21.15.37:0/236508205 >> v2:172.21.15.82:3300/0 conn(0x7f49f81629a0 msgr2=0x7f49f80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f7fff640 1 --2- 172.21.15.37:0/236508205 >> v2:172.21.15.82:3300/0 conn(0x7f49f81629a0 0x7f49f80d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f7fff640 1 -- 172.21.15.37:0/236508205 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f80d2730 con 0x7f49f80c8ed0 2024-05-10T08:40:52.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f6ffd640 1 --2- 172.21.15.37:0/236508205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80d2dc0 0x7f49f80d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:52.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f77fe640 1 --2- 172.21.15.37:0/236508205 >> v2:172.21.15.82:3300/0 conn(0x7f49f81629a0 0x7f49f80d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:52.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f7fff640 1 --2- 172.21.15.37:0/236508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f80c8ed0 0x7f49f80c9360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f49f80768a0 tx=0x7f49f002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c5309fd2e56a6d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f67fc640 1 -- 172.21.15.37:0/236508205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0036070 con 0x7f49f80c8ed0 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f67fc640 1 -- 172.21.15.37:0/236508205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f0031600 con 0x7f49f80c8ed0 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.490+0000 7f49f67fc640 1 -- 172.21.15.37:0/236508205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f00319d0 con 0x7f49f80c8ed0 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 -- 172.21.15.37:0/236508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f80c8ed0 msgr2=0x7f49f80c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 --2- 172.21.15.37:0/236508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f80c8ed0 0x7f49f80c9360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f49f80768a0 tx=0x7f49f002a570 comp rx=0 tx=0).stop 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 -- 172.21.15.37:0/236508205 shutdown_connections 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 --2- 172.21.15.37:0/236508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f80c8ed0 0x7f49f80c9360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 --2- 172.21.15.37:0/236508205 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80d2dc0 0x7f49f80d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 --2- 172.21.15.37:0/236508205 >> v2:172.21.15.82:3300/0 conn(0x7f49f81629a0 0x7f49f80d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 -- 172.21.15.37:0/236508205 >> 172.21.15.37:0/236508205 conn(0x7f49f80d4fe0 msgr2=0x7f49f80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:52.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 -- 172.21.15.37:0/236508205 shutdown_connections 2024-05-10T08:40:52.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.491+0000 7f49fdd51640 1 -- 172.21.15.37:0/236508205 wait complete. 2024-05-10T08:40:52.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.492+0000 7f49fdd51640 1 Processor -- start 2024-05-10T08:40:52.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.492+0000 7f49fdd51640 1 -- start start 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49fdd51640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80c8ed0 0x7f49f815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49fdd51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f80d2dc0 0x7f49f8157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49fdd51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f81629a0 0x7f49f8158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49fdd51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80cf440 con 0x7f49f81629a0 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49fdd51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80cf2c0 con 0x7f49f80d2dc0 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49fdd51640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f49f80c98a0 con 0x7f49f80c8ed0 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f81629a0 0x7f49f8158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f81629a0 0x7f49f8158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39432/0 (socket says 172.21.15.37:39432) 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.493+0000 7f49f7fff640 1 -- 172.21.15.37:0/1326983375 learned_addr learned my addr 172.21.15.37:0/1326983375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f77fe640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80c8ed0 0x7f49f815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f6ffd640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f80d2dc0 0x7f49f8157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f7fff640 1 -- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80c8ed0 msgr2=0x7f49f815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f7fff640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80c8ed0 0x7f49f815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f7fff640 1 -- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f80d2dc0 msgr2=0x7f49f8157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f7fff640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f80d2dc0 0x7f49f8157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f7fff640 1 -- 172.21.15.37:0/1326983375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f80b9060 con 0x7f49f81629a0 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f77fe640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80c8ed0 0x7f49f815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f6ffd640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f80d2dc0 0x7f49f8157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49f7fff640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f81629a0 0x7f49f8158540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f49f0034040 tx=0x7f49f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49dffff640 1 -- 172.21.15.37:0/1326983375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0041020 con 0x7f49f81629a0 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49dffff640 1 -- 172.21.15.37:0/1326983375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f0007780 con 0x7f49f81629a0 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49dffff640 1 -- 172.21.15.37:0/1326983375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0036040 con 0x7f49f81629a0 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f80b9300 con 0x7f49f81629a0 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.494+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f80b98c0 con 0x7f49f81629a0 2024-05-10T08:40:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.495+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8068c40 con 0x7f49f81629a0 2024-05-10T08:40:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.496+0000 7f49dffff640 1 -- 172.21.15.37:0/1326983375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f49f0044020 con 0x7f49f81629a0 2024-05-10T08:40:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.496+0000 7f49dffff640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49e40762d0 0x7f49e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.496+0000 7f49dffff640 1 -- 172.21.15.37:0/1326983375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f49f00b8810 con 0x7f49f81629a0 2024-05-10T08:40:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.497+0000 7f49f77fe640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49e40762d0 0x7f49e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.497+0000 7f49f77fe640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49e40762d0 0x7f49e4078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49f81f8710 tx=0x7f49e8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.501+0000 7f49dffff640 1 -- 172.21.15.37:0/1326983375 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f49f8068c40 con 0x7f49f81629a0 2024-05-10T08:40:52.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.692+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49f80c9660 con 0x7f49f81629a0 2024-05-10T08:40:52.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.693+0000 7f49dffff640 1 -- 172.21.15.37:0/1326983375 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f49f80c9660 con 0x7f49f81629a0 2024-05-10T08:40:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:52.693 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:40:21.732139+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:40:12.841074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T08:40:14.034037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T08:40:17.723570+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49e40762d0 msgr2=0x7f49e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49e40762d0 0x7f49e4078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49f81f8710 tx=0x7f49e8008040 comp rx=0 tx=0).stop 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f81629a0 msgr2=0x7f49f8158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f81629a0 0x7f49f8158540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f49f0034040 tx=0x7f49f0004a40 comp rx=0 tx=0).stop 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 shutdown_connections 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49e40762d0 0x7f49e4078790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49f81629a0 0x7f49f8158540 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49f80d2dc0 0x7f49f8157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 --2- 172.21.15.37:0/1326983375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49f80c8ed0 0x7f49f815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 >> 172.21.15.37:0/1326983375 conn(0x7f49f80d4fe0 msgr2=0x7f49f80d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:52.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 shutdown_connections 2024-05-10T08:40:52.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.695+0000 7f49fdd51640 1 -- 172.21.15.37:0/1326983375 wait complete. 2024-05-10T08:40:52.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:40:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.811+0000 7f0b2e41c640 1 Processor -- start 2024-05-10T08:40:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.811+0000 7f0b2e41c640 1 -- start start 2024-05-10T08:40:52.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2e41c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b280d3cd0 0x7f0b280cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2e41c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b280c9ee0 0x7f0b280d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2e41c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b280d3330 con 0x7f0b281629a0 2024-05-10T08:40:52.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2e41c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0b280d2170 con 0x7f0b280c9ee0 2024-05-10T08:40:52.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2e41c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0b280d2450 con 0x7f0b280d3cd0 2024-05-10T08:40:52.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2c9b9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b280c9ee0 0x7f0b280d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2c9b9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b280c9ee0 0x7f0b280d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39444/0 (socket says 172.21.15.37:39444) 2024-05-10T08:40:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.812+0000 7f0b2c9b9640 1 -- 172.21.15.37:0/3379074129 learned_addr learned my addr 172.21.15.37:0/3379074129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.813+0000 7f0b277fe640 1 --2- 172.21.15.37:0/3379074129 >> v2:172.21.15.82:3300/0 conn(0x7f0b280d3cd0 0x7f0b280cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.813+0000 7f0b2c9b9640 1 -- 172.21.15.37:0/3379074129 >> v2:172.21.15.82:3300/0 conn(0x7f0b280d3cd0 msgr2=0x7f0b280cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.813+0000 7f0b2c9b9640 1 --2- 172.21.15.37:0/3379074129 >> v2:172.21.15.82:3300/0 conn(0x7f0b280d3cd0 0x7f0b280cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.813+0000 7f0b2c9b9640 1 -- 172.21.15.37:0/3379074129 >> v1:172.21.15.82:6789/0 conn(0x7f0b281629a0 legacy=0x7f0b280d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.813+0000 7f0b2c9b9640 1 -- 172.21.15.37:0/3379074129 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b280d2730 con 0x7f0b280c9ee0 2024-05-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.813+0000 7f0b2c9b9640 1 --2- 172.21.15.37:0/3379074129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280c9ee0 0x7f0b280d01e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b280b7ae0 tx=0x7f0b2002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc909b35c16055e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b26ffd640 1 -- 172.21.15.37:0/3379074129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20036070 con 0x7f0b280c9ee0 2024-05-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b26ffd640 1 -- 172.21.15.37:0/3379074129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b20031600 con 0x7f0b280c9ee0 2024-05-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b26ffd640 1 -- 172.21.15.37:0/3379074129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b200319d0 con 0x7f0b280c9ee0 2024-05-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 -- 172.21.15.37:0/3379074129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280c9ee0 msgr2=0x7f0b280d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/3379074129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280c9ee0 0x7f0b280d01e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b280b7ae0 tx=0x7f0b2002a610 comp rx=0 tx=0).stop 2024-05-10T08:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 -- 172.21.15.37:0/3379074129 shutdown_connections 2024-05-10T08:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/3379074129 >> v2:172.21.15.82:3300/0 conn(0x7f0b280d3cd0 0x7f0b280cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/3379074129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280c9ee0 0x7f0b280d01e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 -- 172.21.15.37:0/3379074129 >> 172.21.15.37:0/3379074129 conn(0x7f0b280d4fe0 msgr2=0x7f0b280d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 -- 172.21.15.37:0/3379074129 shutdown_connections 2024-05-10T08:40:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.814+0000 7f0b2e41c640 1 -- 172.21.15.37:0/3379074129 wait complete. 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.815+0000 7f0b2e41c640 1 Processor -- start 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b2e41c640 1 -- start start 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b2e41c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b280c9ee0 0x7f0b280b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b2e41c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280d3cd0 0x7f0b2806e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b2e41c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b281629a0 0x7f0b2806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b2e41c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b280cf440 con 0x7f0b280d3cd0 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b2e41c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0b280cf2c0 con 0x7f0b280c9ee0 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b2e41c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0b280d2dc0 con 0x7f0b281629a0 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280d3cd0 0x7f0b2806e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280d3cd0 0x7f0b2806e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39452/0 (socket says 172.21.15.37:39452) 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.816+0000 7f0b277fe640 1 -- 172.21.15.37:0/1352627875 learned_addr learned my addr 172.21.15.37:0/1352627875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b277fe640 1 -- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b281629a0 msgr2=0x7f0b2806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b277fe640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b281629a0 0x7f0b2806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b27fff640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b280c9ee0 0x7f0b280b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b277fe640 1 -- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b280c9ee0 msgr2=0x7f0b280b8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b277fe640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b280c9ee0 0x7f0b280b8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b277fe640 1 -- 172.21.15.37:0/1352627875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b281f4cb0 con 0x7f0b280d3cd0 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b277fe640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280d3cd0 0x7f0b2806e1e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00d800 tx=0x7f0b1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b24ff9640 1 -- 172.21.15.37:0/1352627875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00b6c0 con 0x7f0b280d3cd0 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b24ff9640 1 -- 172.21.15.37:0/1352627875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1c019070 con 0x7f0b280d3cd0 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b280ceba0 con 0x7f0b280d3cd0 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b24ff9640 1 -- 172.21.15.37:0/1352627875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00ba80 con 0x7f0b280d3cd0 2024-05-10T08:40:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.817+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b280b80d0 con 0x7f0b280d3cd0 2024-05-10T08:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.818+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b280693f0 con 0x7f0b280d3cd0 2024-05-10T08:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.819+0000 7f0b24ff9640 1 -- 172.21.15.37:0/1352627875 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b1c00bc20 con 0x7f0b280d3cd0 2024-05-10T08:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.819+0000 7f0b24ff9640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0b140762d0 0x7f0b14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.820+0000 7f0b24ff9640 1 -- 172.21.15.37:0/1352627875 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0b1c097d80 con 0x7f0b280d3cd0 2024-05-10T08:40:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.820+0000 7f0b27fff640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0b140762d0 0x7f0b14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.820+0000 7f0b27fff640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0b140762d0 0x7f0b14078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b18001500 tx=0x7f0b18009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:52.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:40:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:52.824+0000 7f0b24ff9640 1 -- 172.21.15.37:0/1352627875 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0b280ceba0 con 0x7f0b280d3cd0 2024-05-10T08:40:52.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:40:53.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.053+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0b280763f0 con 0x7f0b280d3cd0 2024-05-10T08:40:53.053 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:40:53.054+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:40:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.056+0000 7f0b24ff9640 1 -- 172.21.15.37:0/1352627875 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f0b1c061430 con 0x7f0b280d3cd0 2024-05-10T08:40:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:40:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0b140762d0 msgr2=0x7f0b14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0b140762d0 0x7f0b14078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b18001500 tx=0x7f0b18009040 comp rx=0 tx=0).stop 2024-05-10T08:40:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280d3cd0 msgr2=0x7f0b2806e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280d3cd0 0x7f0b2806e1e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00d800 tx=0x7f0b1c00dcc0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 shutdown_connections 2024-05-10T08:40:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0b140762d0 0x7f0b14078790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b281629a0 0x7f0b2806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b280d3cd0 0x7f0b2806e1e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 --2- 172.21.15.37:0/1352627875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b280c9ee0 0x7f0b280b8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 >> 172.21.15.37:0/1352627875 conn(0x7f0b280d4fe0 msgr2=0x7f0b280b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 shutdown_connections 2024-05-10T08:40:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.058+0000 7f0b2e41c640 1 -- 172.21.15.37:0/1352627875 wait complete. 2024-05-10T08:40:53.060 INFO:tasks.ceph.mds.a.smithi037.stderr: -4090> 2024-05-10T08:40:20.540+0000 7f4173321640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:40:53.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:40:53.092 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:40:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.178+0000 7f45a7d0a640 1 Processor -- start 2024-05-10T08:40:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.178+0000 7f45a7d0a640 1 -- start start 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a7d0a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45a01629a0 0x7f45a00d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a7d0a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a00d0cb0 0x7f45a00d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a7d0a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a00d3330 con 0x7f45a00d2dc0 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a7d0a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f45a00d2170 con 0x7f45a01629a0 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a7d0a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45a00d2450 con 0x7f45a00d0cb0 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a5aa6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45a01629a0 0x7f45a00d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a5aa6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45a01629a0 0x7f45a00d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39460/0 (socket says 172.21.15.37:39460) 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a5aa6640 1 -- 172.21.15.37:0/532476634 learned_addr learned my addr 172.21.15.37:0/532476634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.179+0000 7f45a52a5640 1 --1- 172.21.15.37:0/532476634 >> v1:172.21.15.37:6789/0 conn(0x7f45a00d2dc0 0x7f45a00c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54774/0 (socket says 172.21.15.37:54774) 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.180+0000 7f45a62a7640 1 --2- 172.21.15.37:0/532476634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a00d0cb0 0x7f45a00d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.180+0000 7f45a5aa6640 1 -- 172.21.15.37:0/532476634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a00d0cb0 msgr2=0x7f45a00d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.180+0000 7f45a5aa6640 1 --2- 172.21.15.37:0/532476634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a00d0cb0 0x7f45a00d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.180+0000 7f45a5aa6640 1 -- 172.21.15.37:0/532476634 >> v1:172.21.15.37:6789/0 conn(0x7f45a00d2dc0 legacy=0x7f45a00c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.180+0000 7f45a5aa6640 1 -- 172.21.15.37:0/532476634 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a00d2730 con 0x7f45a01629a0 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.180+0000 7f45a4aa4640 1 -- 172.21.15.37:0/532476634 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742470263 0 0) 0x7f45a00d3330 con 0x7f45a00d2dc0 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.180+0000 7f45a5aa6640 1 --2- 172.21.15.37:0/532476634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a01629a0 0x7f45a00d35c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4598009870 tx=0x7f459802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1174b5d1c4f22b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a4aa4640 1 -- 172.21.15.37:0/532476634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598037070 con 0x7f45a01629a0 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a4aa4640 1 -- 172.21.15.37:0/532476634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598032440 con 0x7f45a01629a0 2024-05-10T08:40:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a4aa4640 1 -- 172.21.15.37:0/532476634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598032810 con 0x7f45a01629a0 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 -- 172.21.15.37:0/532476634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a01629a0 msgr2=0x7f45a00d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/532476634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a01629a0 0x7f45a00d35c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4598009870 tx=0x7f459802a130 comp rx=0 tx=0).stop 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 -- 172.21.15.37:0/532476634 shutdown_connections 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/532476634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a00d0cb0 0x7f45a00d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/532476634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a01629a0 0x7f45a00d35c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 -- 172.21.15.37:0/532476634 >> 172.21.15.37:0/532476634 conn(0x7f45a00d4fe0 msgr2=0x7f45a00d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 -- 172.21.15.37:0/532476634 shutdown_connections 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.181+0000 7f45a7d0a640 1 -- 172.21.15.37:0/532476634 wait complete. 2024-05-10T08:40:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.182+0000 7f45a7d0a640 1 Processor -- start 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a7d0a640 1 -- start start 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a7d0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a00d0cb0 0x7f45a01557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a7d0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00d2dc0 0x7f45a00cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a7d0a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a01629a0 0x7f45a00ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a7d0a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45a00cf440 con 0x7f45a00d2dc0 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a7d0a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45a00cf2c0 con 0x7f45a00d0cb0 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a7d0a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45a00c95e0 con 0x7f45a01629a0 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a52a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00d2dc0 0x7f45a00cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a52a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00d2dc0 0x7f45a00cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39462/0 (socket says 172.21.15.37:39462) 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a52a5640 1 -- 172.21.15.37:0/466382482 learned_addr learned my addr 172.21.15.37:0/466382482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a62a7640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a01629a0 0x7f45a00ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.183+0000 7f45a5aa6640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a00d0cb0 0x7f45a01557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a52a5640 1 -- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a01629a0 msgr2=0x7f45a00ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a52a5640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a01629a0 0x7f45a00ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a52a5640 1 -- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a00d0cb0 msgr2=0x7f45a01557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a52a5640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a00d0cb0 0x7f45a01557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a52a5640 1 -- 172.21.15.37:0/466382482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a01f4aa0 con 0x7f45a00d2dc0 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a52a5640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00d2dc0 0x7f45a00cdea0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f459000c4d0 tx=0x7f459000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45967fc640 1 -- 172.21.15.37:0/466382482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590018070 con 0x7f45a00d2dc0 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45967fc640 1 -- 172.21.15.37:0/466382482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4590007500 con 0x7f45a00d2dc0 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a01562f0 con 0x7f45a00d2dc0 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45967fc640 1 -- 172.21.15.37:0/466382482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590004a20 con 0x7f45a00d2dc0 2024-05-10T08:40:53.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.184+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a00b2050 con 0x7f45a00d2dc0 2024-05-10T08:40:53.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.185+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a00693f0 con 0x7f45a00d2dc0 2024-05-10T08:40:53.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.186+0000 7f45967fc640 1 -- 172.21.15.37:0/466382482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f459001b070 con 0x7f45a00d2dc0 2024-05-10T08:40:53.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.186+0000 7f45967fc640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f45840762d0 0x7f4584078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:53.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.186+0000 7f45967fc640 1 -- 172.21.15.37:0/466382482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6618+0+0 (secure 0 0 0) 0x7f4590096be0 con 0x7f45a00d2dc0 2024-05-10T08:40:53.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.187+0000 7f45a5aa6640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f45840762d0 0x7f4584078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:53.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.187+0000 7f45a5aa6640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f45840762d0 0x7f4584078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4598034000 tx=0x7f459802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:53.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.191+0000 7f45967fc640 1 -- 172.21.15.37:0/466382482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f459005fb50 con 0x7f45a00d2dc0 2024-05-10T08:40:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:53.424+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f45a00b2760 con 0x7f45a00d2dc0 2024-05-10T08:40:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.057+0000 7f45967fc640 1 -- 172.21.15.37:0/466382482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f4590063e50 con 0x7f45a00d2dc0 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f45840762d0 msgr2=0x7f4584078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f45840762d0 0x7f4584078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4598034000 tx=0x7f459802e000 comp rx=0 tx=0).stop 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00d2dc0 msgr2=0x7f45a00cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00d2dc0 0x7f45a00cdea0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f459000c4d0 tx=0x7f459000c990 comp rx=0 tx=0).stop 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 shutdown_connections 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f45840762d0 0x7f4584078790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45a01629a0 0x7f45a00ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00d2dc0 0x7f45a00cdea0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 --2- 172.21.15.37:0/466382482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a00d0cb0 0x7f45a01557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 >> 172.21.15.37:0/466382482 conn(0x7f45a00d4fe0 msgr2=0x7f45a006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 shutdown_connections 2024-05-10T08:40:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.060+0000 7f45a7d0a640 1 -- 172.21.15.37:0/466382482 wait complete. 2024-05-10T08:40:54.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:40:54.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.231+0000 7f3072c93640 1 Processor -- start 2024-05-10T08:40:54.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.231+0000 7f3072c93640 1 -- start start 2024-05-10T08:40:54.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3072c93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c162b70 0x7f306c0d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:54.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3072c93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306c162f50 con 0x7f306c0d3480 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3072c93640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306c0d3ee0 con 0x7f306c0d38e0 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3072c93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f306c0d1f60 con 0x7f306c162b70 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f306bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f306c0d3480 0x7f306c0b4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54782/0 (socket says 172.21.15.37:54782) 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f306bfff640 1 -- 172.21.15.37:0/954548847 learned_addr learned my addr 172.21.15.37:0/954548847 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3070a2f640 1 --2- 172.21.15.37:0/954548847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c162b70 0x7f306c0d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f306b7fe640 1 -- 172.21.15.37:0/954548847 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857801648 0 0) 0x7f3054001490 con 0x7f306c0d3480 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f306b7fe640 1 -- 172.21.15.37:0/954548847 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3058003520 con 0x7f306c0d3480 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f306b7fe640 1 -- 172.21.15.37:0/954548847 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3177906537 0 0) 0x7f306c0d3ee0 con 0x7f306c0d38e0 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f306b7fe640 1 -- 172.21.15.37:0/954548847 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3054001490 con 0x7f306c0d38e0 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3070a2f640 1 -- 172.21.15.37:0/954548847 >> v1:172.21.15.82:6789/0 conn(0x7f306c0d38e0 legacy=0x7f306c0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:54.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3070a2f640 1 -- 172.21.15.37:0/954548847 >> v1:172.21.15.37:6789/0 conn(0x7f306c0d3480 legacy=0x7f306c0b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.232+0000 7f3070a2f640 1 -- 172.21.15.37:0/954548847 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c0d21b0 con 0x7f306c162b70 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.233+0000 7f3070a2f640 1 --2- 172.21.15.37:0/954548847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c162b70 0x7f306c0d2f40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f305c0097d0 tx=0x7f305c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25444c30b8bb810b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.233+0000 7f306b7fe640 1 -- 172.21.15.37:0/954548847 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c037070 con 0x7f306c162b70 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.233+0000 7f306b7fe640 1 -- 172.21.15.37:0/954548847 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c032440 con 0x7f306c162b70 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.233+0000 7f306b7fe640 1 -- 172.21.15.37:0/954548847 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0327f0 con 0x7f306c162b70 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.234+0000 7f3072c93640 1 -- 172.21.15.37:0/954548847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c162b70 msgr2=0x7f306c0d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.234+0000 7f3072c93640 1 --2- 172.21.15.37:0/954548847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c162b70 0x7f306c0d2f40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f305c0097d0 tx=0x7f305c02a210 comp rx=0 tx=0).stop 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.234+0000 7f3072c93640 1 -- 172.21.15.37:0/954548847 shutdown_connections 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.234+0000 7f3072c93640 1 --2- 172.21.15.37:0/954548847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c162b70 0x7f306c0d2f40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.234+0000 7f3072c93640 1 -- 172.21.15.37:0/954548847 >> 172.21.15.37:0/954548847 conn(0x7f306c0d5040 msgr2=0x7f306c0d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:54.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.234+0000 7f3072c93640 1 -- 172.21.15.37:0/954548847 shutdown_connections 2024-05-10T08:40:54.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.234+0000 7f3072c93640 1 -- 172.21.15.37:0/954548847 wait complete. 2024-05-10T08:40:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.235+0000 7f3072c93640 1 Processor -- start 2024-05-10T08:40:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.235+0000 7f3072c93640 1 -- start start 2024-05-10T08:40:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3072c93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c0d3480 0x7f306c1f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3072c93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0d38e0 0x7f306c1e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3072c93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f306c162b70 0x7f306c1e9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3072c93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f306c0b42f0 con 0x7f306c162b70 2024-05-10T08:40:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3072c93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f306c0b4170 con 0x7f306c0d38e0 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3072c93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f306c0b5860 con 0x7f306c0d3480 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f306c162b70 0x7f306c1e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f306c162b70 0x7f306c1e9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39472/0 (socket says 172.21.15.37:39472) 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 -- 172.21.15.37:0/3290544643 learned_addr learned my addr 172.21.15.37:0/3290544643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f306bfff640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0d38e0 0x7f306c1e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3070a2f640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c0d3480 0x7f306c1f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 -- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c0d3480 msgr2=0x7f306c1f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:54.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c0d3480 0x7f306c1f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 -- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0d38e0 msgr2=0x7f306c1e8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0d38e0 0x7f306c1e8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 -- 172.21.15.37:0/3290544643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c15ffb0 con 0x7f306c162b70 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.236+0000 7f3071230640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f306c162b70 0x7f306c1e9500 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f306400c430 tx=0x7f306400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.237+0000 7f30697fa640 1 -- 172.21.15.37:0/3290544643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064017070 con 0x7f306c162b70 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.237+0000 7f30697fa640 1 -- 172.21.15.37:0/3290544643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30640052d0 con 0x7f306c162b70 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.237+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c15f1f0 con 0x7f306c162b70 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.237+0000 7f30697fa640 1 -- 172.21.15.37:0/3290544643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640037f0 con 0x7f306c162b70 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.237+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c15f7b0 con 0x7f306c162b70 2024-05-10T08:40:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.238+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c0d1680 con 0x7f306c162b70 2024-05-10T08:40:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.238+0000 7f30697fa640 1 -- 172.21.15.37:0/3290544643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f306401a070 con 0x7f306c162b70 2024-05-10T08:40:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.239+0000 7f30697fa640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f304c0762d0 0x7f304c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.239+0000 7f30697fa640 1 -- 172.21.15.37:0/3290544643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6618+0+0 (secure 0 0 0) 0x7f3064096c90 con 0x7f306c162b70 2024-05-10T08:40:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.239+0000 7f3070a2f640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f304c0762d0 0x7f304c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.240+0000 7f3070a2f640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f304c0762d0 0x7f304c078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f305c034000 tx=0x7f305c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:54.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.243+0000 7f30697fa640 1 -- 172.21.15.37:0/3290544643 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f306c0d1680 con 0x7f306c162b70 2024-05-10T08:40:54.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:54.435+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f306c0d2970 con 0x7f306c162b70 2024-05-10T08:40:55.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.062+0000 7f30697fa640 1 -- 172.21.15.37:0/3290544643 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f306c0d2970 con 0x7f306c162b70 2024-05-10T08:40:55.062 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:40:55.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f304c0762d0 msgr2=0x7f304c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:55.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f304c0762d0 0x7f304c078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f305c034000 tx=0x7f305c02e000 comp rx=0 tx=0).stop 2024-05-10T08:40:55.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f306c162b70 msgr2=0x7f306c1e9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:55.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f306c162b70 0x7f306c1e9500 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f306400c430 tx=0x7f306400c8f0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 shutdown_connections 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f304c0762d0 0x7f304c078790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f306c162b70 0x7f306c1e9500 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0d38e0 0x7f306c1e8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 --2- 172.21.15.37:0/3290544643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f306c0d3480 0x7f306c1f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 >> 172.21.15.37:0/3290544643 conn(0x7f306c0d5040 msgr2=0x7f306c15e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 shutdown_connections 2024-05-10T08:40:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.067+0000 7f3072c93640 1 -- 172.21.15.37:0/3290544643 wait complete. 2024-05-10T08:40:55.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:40:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.196+0000 7f3a0ee1c640 1 Processor -- start 2024-05-10T08:40:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.196+0000 7f3a0ee1c640 1 -- start start 2024-05-10T08:40:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.196+0000 7f3a0ee1c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a080d3d00 0x7f3a080d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.196+0000 7f3a0ee1c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3a080d1f30 0x7f3a0806cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.196+0000 7f3a0ee1c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a080d4160 con 0x7f3a0815f430 2024-05-10T08:40:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.196+0000 7f3a0ee1c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3a0815f810 con 0x7f3a080d3d00 2024-05-10T08:40:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.196+0000 7f3a0ee1c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3a080d2cf0 con 0x7f3a080d1f30 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a07fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a080d3d00 0x7f3a080d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a0cbb8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3a0815f430 0x7f3a080d07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54796/0 (socket says 172.21.15.37:54796) 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a0cbb8640 1 -- 172.21.15.37:0/48259743 learned_addr learned my addr 172.21.15.37:0/48259743 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a0d3b9640 1 --2- 172.21.15.37:0/48259743 >> v2:172.21.15.82:3300/0 conn(0x7f3a080d1f30 0x7f3a0806cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a077fe640 1 -- 172.21.15.37:0/48259743 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280920962 0 0) 0x7f3a080d4160 con 0x7f3a0815f430 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a077fe640 1 -- 172.21.15.37:0/48259743 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39f8003520 con 0x7f3a0815f430 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a07fff640 1 -- 172.21.15.37:0/48259743 >> v2:172.21.15.82:3300/0 conn(0x7f3a080d1f30 msgr2=0x7f3a0806cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a07fff640 1 --2- 172.21.15.37:0/48259743 >> v2:172.21.15.82:3300/0 conn(0x7f3a080d1f30 0x7f3a0806cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a07fff640 1 -- 172.21.15.37:0/48259743 >> v1:172.21.15.37:6789/0 conn(0x7f3a0815f430 legacy=0x7f3a080d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.197+0000 7f3a07fff640 1 -- 172.21.15.37:0/48259743 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a080d2f40 con 0x7f3a080d3d00 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.198+0000 7f3a07fff640 1 --2- 172.21.15.37:0/48259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d3d00 0x7f3a080d19f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3a08162dd0 tx=0x7f39f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1258864f9a51d5f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.198+0000 7f3a077fe640 1 -- 172.21.15.37:0/48259743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4037070 con 0x7f3a080d3d00 2024-05-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.198+0000 7f3a077fe640 1 -- 172.21.15.37:0/48259743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f4032440 con 0x7f3a080d3d00 2024-05-10T08:40:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.198+0000 7f3a077fe640 1 -- 172.21.15.37:0/48259743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f402ae60 con 0x7f3a080d3d00 2024-05-10T08:40:55.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.198+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/48259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d3d00 msgr2=0x7f3a080d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.198+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/48259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d3d00 0x7f3a080d19f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3a08162dd0 tx=0x7f39f402a110 comp rx=0 tx=0).stop 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.199+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/48259743 shutdown_connections 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.199+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/48259743 >> v2:172.21.15.82:3300/0 conn(0x7f3a080d1f30 0x7f3a0806cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.199+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/48259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d3d00 0x7f3a080d19f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.199+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/48259743 >> 172.21.15.37:0/48259743 conn(0x7f3a0809e3f0 msgr2=0x7f3a080d5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.199+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/48259743 shutdown_connections 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.199+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/48259743 wait complete. 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.200+0000 7f3a0ee1c640 1 Processor -- start 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.200+0000 7f3a0ee1c640 1 -- start start 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0ee1c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d1f30 0x7f3a08153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0ee1c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a080d3d00 0x7f3a080b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0ee1c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0815f430 0x7f3a0815d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0ee1c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a080d37e0 con 0x7f3a080d1f30 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0ee1c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3a080d3500 con 0x7f3a0815f430 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0ee1c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3a080d0ee0 con 0x7f3a080d3d00 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d1f30 0x7f3a08153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d1f30 0x7f3a08153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39494/0 (socket says 172.21.15.37:39494) 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 -- 172.21.15.37:0/3497518353 learned_addr learned my addr 172.21.15.37:0/3497518353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0d3b9640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0815f430 0x7f3a0815d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a07fff640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a080d3d00 0x7f3a080b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 -- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a080d3d00 msgr2=0x7f3a080b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a080d3d00 0x7f3a080b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 -- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0815f430 msgr2=0x7f3a0815d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0815f430 0x7f3a0815d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 -- 172.21.15.37:0/3497518353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a080ba920 con 0x7f3a080d1f30 2024-05-10T08:40:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a0cbb8640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d1f30 0x7f3a08153360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00c390 tx=0x7f39fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a057fa640 1 -- 172.21.15.37:0/3497518353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc017070 con 0x7f3a080d1f30 2024-05-10T08:40:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.201+0000 7f3a057fa640 1 -- 172.21.15.37:0/3497518353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc005ce0 con 0x7f3a080d1f30 2024-05-10T08:40:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.202+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a080b9da0 con 0x7f3a080d1f30 2024-05-10T08:40:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.202+0000 7f3a057fa640 1 -- 172.21.15.37:0/3497518353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0072f0 con 0x7f3a080d1f30 2024-05-10T08:40:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.202+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a080ba360 con 0x7f3a080d1f30 2024-05-10T08:40:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.203+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a08069b00 con 0x7f3a080d1f30 2024-05-10T08:40:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.203+0000 7f3a057fa640 1 -- 172.21.15.37:0/3497518353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f39fc01a070 con 0x7f3a080d1f30 2024-05-10T08:40:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.204+0000 7f3a057fa640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f39ec076300 0x7f39ec0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.204+0000 7f3a057fa640 1 -- 172.21.15.37:0/3497518353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6180+0+0 (secure 0 0 0) 0x7f39fc096a50 con 0x7f3a080d1f30 2024-05-10T08:40:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.204+0000 7f3a07fff640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f39ec076300 0x7f39ec0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.204+0000 7f3a07fff640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f39ec076300 0x7f39ec0787c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f39f4034000 tx=0x7f39f402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.208+0000 7f3a057fa640 1 -- 172.21.15.37:0/3497518353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f39fc05fc10 con 0x7f3a080d1f30 2024-05-10T08:40:55.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:55.405+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3a080d15c0 con 0x7f3a080d1f30 2024-05-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.068+0000 7f3a057fa640 1 -- 172.21.15.37:0/3497518353 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f39fc063f10 con 0x7f3a080d1f30 2024-05-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.072+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f39ec076300 msgr2=0x7f39ec0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.072+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f39ec076300 0x7f39ec0787c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f39f4034000 tx=0x7f39f402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.072+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d1f30 msgr2=0x7f3a08153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.072+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d1f30 0x7f3a08153360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00c390 tx=0x7f39fc00c850 comp rx=0 tx=0).stop 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 shutdown_connections 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f39ec076300 0x7f39ec0787c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0815f430 0x7f3a0815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3a080d3d00 0x7f3a080b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 --2- 172.21.15.37:0/3497518353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a080d1f30 0x7f3a08153360 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 >> 172.21.15.37:0/3497518353 conn(0x7f3a0809e3f0 msgr2=0x7f3a080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 shutdown_connections 2024-05-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.073+0000 7f3a0ee1c640 1 -- 172.21.15.37:0/3497518353 wait complete. 2024-05-10T08:40:56.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-10T08:40:56.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.202+0000 7fe0e7e75640 1 Processor -- start 2024-05-10T08:40:56.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.203+0000 7fe0e7e75640 1 -- start start 2024-05-10T08:40:56.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.203+0000 7fe0e7e75640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0e015d2a0 0x7fe0e00cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:56.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.203+0000 7fe0e7e75640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0e015d680 0x7fe0e00cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:56.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.203+0000 7fe0e7e75640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e00c9600 0x7fe0e00d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:56.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.203+0000 7fe0e7e75640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e00cec40 con 0x7fe0e015d2a0 2024-05-10T08:40:56.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.203+0000 7fe0e7e75640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e00cef20 con 0x7fe0e015d680 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.203+0000 7fe0e7e75640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e00c6b10 con 0x7fe0e00c9600 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0e015d2a0 0x7fe0e00cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0e015d2a0 0x7fe0e00cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39510/0 (socket says 172.21.15.37:39510) 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 -- 172.21.15.37:0/2305982962 learned_addr learned my addr 172.21.15.37:0/2305982962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e6412640 1 --2- 172.21.15.37:0/2305982962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e00c9600 0x7fe0e00d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5410640 1 --2- 172.21.15.37:0/2305982962 >> v2:172.21.15.82:3300/0 conn(0x7fe0e015d680 0x7fe0e00cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 -- 172.21.15.37:0/2305982962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e00c9600 msgr2=0x7fe0e00d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 --2- 172.21.15.37:0/2305982962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e00c9600 0x7fe0e00d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 -- 172.21.15.37:0/2305982962 >> v2:172.21.15.82:3300/0 conn(0x7fe0e015d680 msgr2=0x7fe0e00cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 --2- 172.21.15.37:0/2305982962 >> v2:172.21.15.82:3300/0 conn(0x7fe0e015d680 0x7fe0e00cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.204+0000 7fe0e5c11640 1 -- 172.21.15.37:0/2305982962 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e00c6df0 con 0x7fe0e015d2a0 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e5c11640 1 --2- 172.21.15.37:0/2305982962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00cf670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00d2e80 tx=0x7fe0dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b233483a40cb9464 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e4c0f640 1 -- 172.21.15.37:0/2305982962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc037070 con 0x7fe0e015d2a0 2024-05-10T08:40:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e4c0f640 1 -- 172.21.15.37:0/2305982962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0dc032440 con 0x7fe0e015d2a0 2024-05-10T08:40:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e4c0f640 1 -- 172.21.15.37:0/2305982962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc032810 con 0x7fe0e015d2a0 2024-05-10T08:40:56.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e7e75640 1 -- 172.21.15.37:0/2305982962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 msgr2=0x7fe0e00cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/2305982962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00cf670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00d2e80 tx=0x7fe0dc02a270 comp rx=0 tx=0).stop 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e7e75640 1 -- 172.21.15.37:0/2305982962 shutdown_connections 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/2305982962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e00c9600 0x7fe0e00d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/2305982962 >> v2:172.21.15.82:3300/0 conn(0x7fe0e015d680 0x7fe0e00cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/2305982962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00cf670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.205+0000 7fe0e7e75640 1 -- 172.21.15.37:0/2305982962 >> 172.21.15.37:0/2305982962 conn(0x7fe0e00d2f20 msgr2=0x7fe0e00d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.206+0000 7fe0e7e75640 1 -- 172.21.15.37:0/2305982962 shutdown_connections 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.206+0000 7fe0e7e75640 1 -- 172.21.15.37:0/2305982962 wait complete. 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 Processor -- start 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 -- start start 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e00c9600 0x7fe0e0152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e015d680 0x7fe0e006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e00ce870 con 0x7fe0e015d2a0 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e00ce6f0 con 0x7fe0e00c9600 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.207+0000 7fe0e7e75640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e00ce9f0 con 0x7fe0e015d680 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39514/0 (socket says 172.21.15.37:39514) 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 -- 172.21.15.37:0/1479680246 learned_addr learned my addr 172.21.15.37:0/1479680246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e6412640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e015d680 0x7fe0e006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5c11640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e00c9600 0x7fe0e0152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 -- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e015d680 msgr2=0x7fe0e006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e015d680 0x7fe0e006e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 -- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e00c9600 msgr2=0x7fe0e0152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e00c9600 0x7fe0e0152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 -- 172.21.15.37:0/1479680246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e0160920 con 0x7fe0e015d2a0 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5c11640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e00c9600 0x7fe0e0152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e5410640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00b3fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d5f0 tx=0x7fe0d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0d67fc640 1 -- 172.21.15.37:0/1479680246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00125f0 con 0x7fe0e015d2a0 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0d67fc640 1 -- 172.21.15.37:0/1479680246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0019070 con 0x7fe0e015d2a0 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e00cb180 con 0x7fe0e015d2a0 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0d67fc640 1 -- 172.21.15.37:0/1479680246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00129d0 con 0x7fe0e015d2a0 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.208+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e00cb740 con 0x7fe0e015d2a0 2024-05-10T08:40:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.209+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e0069b00 con 0x7fe0e015d2a0 2024-05-10T08:40:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.210+0000 7fe0d67fc640 1 -- 172.21.15.37:0/1479680246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe0d0012b70 con 0x7fe0e015d2a0 2024-05-10T08:40:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.210+0000 7fe0d67fc640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0c4076300 0x7fe0c40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.210+0000 7fe0d67fc640 1 -- 172.21.15.37:0/1479680246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5766+0+0 (secure 0 0 0) 0x7fe0d0097910 con 0x7fe0e015d2a0 2024-05-10T08:40:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.211+0000 7fe0e5c11640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0c4076300 0x7fe0c40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.211+0000 7fe0e5c11640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0c4076300 0x7fe0c40787c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc034000 tx=0x7fe0dc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.215+0000 7fe0d67fc640 1 -- 172.21.15.37:0/1479680246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe0d0061230 con 0x7fe0e015d2a0 2024-05-10T08:40:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:56.404+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0e00685c0 con 0x7fe0e015d2a0 2024-05-10T08:40:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.075+0000 7fe0d67fc640 1 -- 172.21.15.37:0/1479680246 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v29) ==== 178+0+0 (secure 0 0 0) 0x7fe0d0060b30 con 0x7fe0e015d2a0 2024-05-10T08:40:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2024-05-10T08:40:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0c4076300 msgr2=0x7fe0c40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0c4076300 0x7fe0c40787c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc034000 tx=0x7fe0dc02e000 comp rx=0 tx=0).stop 2024-05-10T08:40:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 msgr2=0x7fe0e00b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00b3fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d5f0 tx=0x7fe0d000dab0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 shutdown_connections 2024-05-10T08:40:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0c4076300 0x7fe0c40787c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0e015d680 0x7fe0e006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e015d2a0 0x7fe0e00b3fb0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d5f0 tx=0x7fe0d000dab0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 --2- 172.21.15.37:0/1479680246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e00c9600 0x7fe0e0152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.081+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 >> 172.21.15.37:0/1479680246 conn(0x7fe0e00d2f20 msgr2=0x7fe0e00b8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.082+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 shutdown_connections 2024-05-10T08:40:57.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.083+0000 7fe0e7e75640 1 -- 172.21.15.37:0/1479680246 wait complete. 2024-05-10T08:40:57.102 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:40:57.102 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T08:40:57.102 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:40:57.103 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:40:57.103 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:40:57.103 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T08:40:57.103 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:40:57.103 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:40:57.103 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:40:57.103 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T08:40:57.104 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:40:57.104 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:40:57.104 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:40:57.104 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T08:40:57.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:40:57.104 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:40:57.114 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:40:57.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:40:57.114 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:40:57.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:40:57.117 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:40:57.117 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:40:57.118 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:40:57.118 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:40:57.157 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:40:57.157 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:57.159 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:40:57.159 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:57.160 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:40:57.160 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:57.161 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:40:57.161 DEBUG:teuthology.parallel:result is None 2024-05-10T08:40:57.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T08:40:57.243 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:40:57.243 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:40:57.246 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:40:57.246 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:40:57.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.277+0000 7f37e3bda640 1 Processor -- start 2024-05-10T08:40:57.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.277+0000 7f37e3bda640 1 -- start start 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e3bda640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37dc0d20c0 0x7f37dc163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e3bda640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc071110 0x7f37dc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e3bda640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37dc0d1300 con 0x7f37dc070d30 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e3bda640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc0d10d0 con 0x7f37dc0d20c0 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e3bda640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc070b80 con 0x7f37dc071110 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e1976640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f37dc070d30 0x7f37dc0703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54802/0 (socket says 172.21.15.37:54802) 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e1976640 1 -- 172.21.15.37:0/4005981682 learned_addr learned my addr 172.21.15.37:0/4005981682 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e1175640 1 --2- 172.21.15.37:0/4005981682 >> v2:172.21.15.37:3300/0 conn(0x7f37dc0d20c0 0x7f37dc163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e2177640 1 --2- 172.21.15.37:0/4005981682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc071110 0x7f37dc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e0974640 1 -- 172.21.15.37:0/4005981682 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552895207 0 0) 0x7f37dc0d1300 con 0x7f37dc070d30 2024-05-10T08:40:57.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e0974640 1 -- 172.21.15.37:0/4005981682 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c8003520 con 0x7f37dc070d30 2024-05-10T08:40:57.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e1175640 1 -- 172.21.15.37:0/4005981682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc071110 msgr2=0x7f37dc06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:57.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e1175640 1 --2- 172.21.15.37:0/4005981682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc071110 0x7f37dc06d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e1175640 1 -- 172.21.15.37:0/4005981682 >> v1:172.21.15.37:6789/0 conn(0x7f37dc070d30 legacy=0x7f37dc0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:57.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e1175640 1 -- 172.21.15.37:0/4005981682 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc0d15e0 con 0x7f37dc0d20c0 2024-05-10T08:40:57.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.278+0000 7f37e2177640 1 --2- 172.21.15.37:0/4005981682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc071110 0x7f37dc06d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:57.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.279+0000 7f37e1175640 1 --2- 172.21.15.37:0/4005981682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc0d20c0 0x7f37dc163920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0097a0 tx=0x7f37cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48c065b77be030c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:57.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.279+0000 7f37e0974640 1 -- 172.21.15.37:0/4005981682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc037070 con 0x7f37dc0d20c0 2024-05-10T08:40:57.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.279+0000 7f37e0974640 1 -- 172.21.15.37:0/4005981682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc032440 con 0x7f37dc0d20c0 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.279+0000 7f37e0974640 1 -- 172.21.15.37:0/4005981682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0327f0 con 0x7f37dc0d20c0 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 -- 172.21.15.37:0/4005981682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc0d20c0 msgr2=0x7f37dc163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 --2- 172.21.15.37:0/4005981682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc0d20c0 0x7f37dc163920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0097a0 tx=0x7f37cc02a180 comp rx=0 tx=0).stop 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 -- 172.21.15.37:0/4005981682 shutdown_connections 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 --2- 172.21.15.37:0/4005981682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc071110 0x7f37dc06d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 --2- 172.21.15.37:0/4005981682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc0d20c0 0x7f37dc163920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 -- 172.21.15.37:0/4005981682 >> 172.21.15.37:0/4005981682 conn(0x7f37dc0d2e90 msgr2=0x7f37dc0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 -- 172.21.15.37:0/4005981682 shutdown_connections 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.280+0000 7f37e3bda640 1 -- 172.21.15.37:0/4005981682 wait complete. 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.281+0000 7f37e3bda640 1 Processor -- start 2024-05-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.281+0000 7f37e3bda640 1 -- start start 2024-05-10T08:40:57.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e3bda640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc070d30 0x7f37dc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc070d30 0x7f37dc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e3bda640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc071110 0x7f37dc1f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc070d30 0x7f37dc0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39544/0 (socket says 172.21.15.37:39544) 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 -- 172.21.15.37:0/1004479622 learned_addr learned my addr 172.21.15.37:0/1004479622 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e3bda640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc0d20c0 0x7f37dc1f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc071560 con 0x7f37dc070d30 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0d1c30 con 0x7f37dc071110 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0716e0 con 0x7f37dc0d20c0 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 -- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc0d20c0 msgr2=0x7f37dc1f97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc0d20c0 0x7f37dc1f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 -- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc071110 msgr2=0x7f37dc1f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc071110 0x7f37dc1f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc14de90 con 0x7f37dc070d30 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.282+0000 7f37e1976640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc070d30 0x7f37dc0c9fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c410 tx=0x7f37d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.283+0000 7f37d27fc640 1 -- 172.21.15.37:0/1004479622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8017070 con 0x7f37dc070d30 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.283+0000 7f37d27fc640 1 -- 172.21.15.37:0/1004479622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8005ce0 con 0x7f37dc070d30 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.283+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc0b6dd0 con 0x7f37dc070d30 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.283+0000 7f37d27fc640 1 -- 172.21.15.37:0/1004479622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d80072f0 con 0x7f37dc070d30 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.283+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc0b7070 con 0x7f37dc070d30 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.284+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc0693f0 con 0x7f37dc070d30 2024-05-10T08:40:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.284+0000 7f37d27fc640 1 -- 172.21.15.37:0/1004479622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37d801a070 con 0x7f37dc070d30 2024-05-10T08:40:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.285+0000 7f37d27fc640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f37c00762d0 0x7f37c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.285+0000 7f37d27fc640 1 -- 172.21.15.37:0/1004479622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5335+0+0 (secure 0 0 0) 0x7f37d8096900 con 0x7f37dc070d30 2024-05-10T08:40:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.285+0000 7f37e1175640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f37c00762d0 0x7f37c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.286+0000 7f37e1175640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f37c00762d0 0x7f37c0078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f37cc034000 tx=0x7f37cc02c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:57.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.289+0000 7f37d27fc640 1 -- 172.21.15.37:0/1004479622 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f37d8060490 con 0x7f37dc070d30 2024-05-10T08:40:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:57.493+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f37dc15ba40 con 0x7f37dc070d30 2024-05-10T08:40:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.091+0000 7f37d27fc640 1 -- 172.21.15.37:0/1004479622 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) ==== 97+0+0 (secure 0 0 0) 0x7f37d805fd90 con 0x7f37dc070d30 2024-05-10T08:40:58.091 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-10T08:40:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f37c00762d0 msgr2=0x7f37c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f37c00762d0 0x7f37c0078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f37cc034000 tx=0x7f37cc02c000 comp rx=0 tx=0).stop 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc070d30 msgr2=0x7f37dc0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc070d30 0x7f37dc0c9fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c410 tx=0x7f37d800c8d0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 shutdown_connections 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f37c00762d0 0x7f37c0078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37dc0d20c0 0x7f37dc1f97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc071110 0x7f37dc1f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 --2- 172.21.15.37:0/1004479622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37dc070d30 0x7f37dc0c9fd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 >> 172.21.15.37:0/1004479622 conn(0x7f37dc0d2e90 msgr2=0x7f37dc06e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 shutdown_connections 2024-05-10T08:40:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.094+0000 7f37e3bda640 1 -- 172.21.15.37:0/1004479622 wait complete. 2024-05-10T08:40:58.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T08:40:58.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.215+0000 7fea9015f640 1 Processor -- start 2024-05-10T08:40:58.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.215+0000 7fea9015f640 1 -- start start 2024-05-10T08:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea9015f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea8815f380 0x7fea880d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea9015f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 0x7fea880d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea9015f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea880d1760 con 0x7fea880d3b00 2024-05-10T08:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea9015f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fea880d30f0 con 0x7fea8815f380 2024-05-10T08:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea9015f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea880d1150 con 0x7fea880d0cf0 2024-05-10T08:40:58.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8e6fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fea880d3b00 0x7fea88162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45832/0 (socket says 172.21.15.37:45832) 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8e6fc640 1 -- 172.21.15.37:0/612100603 learned_addr learned my addr 172.21.15.37:0/612100603 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8d6fa640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 0x7fea880d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8defb640 1 --2- 172.21.15.37:0/612100603 >> v2:172.21.15.82:3300/0 conn(0x7fea8815f380 0x7fea880d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909158474 0 0) 0x7fea880d1760 con 0x7fea880d3b00 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea74003520 con 0x7fea880d3b00 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 791559206 0 0) 0x7fea74003520 con 0x7fea880d3b00 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 msgr2=0x7fea880d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 0x7fea880d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 >> v2:172.21.15.82:3300/0 conn(0x7fea8815f380 msgr2=0x7fea880d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 --2- 172.21.15.37:0/612100603 >> v2:172.21.15.82:3300/0 conn(0x7fea8815f380 0x7fea880d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea880d1a40 con 0x7fea880d3b00 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.216+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fea800019f0 con 0x7fea880d3b00 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8defb640 1 --2- 172.21.15.37:0/612100603 >> v2:172.21.15.82:3300/0 conn(0x7fea8815f380 0x7fea880d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 >> v1:172.21.15.37:6789/0 conn(0x7fea880d3b00 legacy=0x7fea88162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8cef9640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea740039b0 0x7fea74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8cef9640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 0x7fea74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8cef9640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea74004d40 0x7fea740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea880d30f0 con 0x7fea74004d40 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea7400b9c0 con 0x7fea740039b0 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea7400bb40 con 0x7fea880d0cf0 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8e6fc640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea74004d40 0x7fea740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8d6fa640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 0x7fea74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8defb640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea740039b0 0x7fea74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8e6fc640 1 -- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 msgr2=0x7fea74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8e6fc640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea880d0cf0 0x7fea74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8e6fc640 1 -- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea740039b0 msgr2=0x7fea74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8e6fc640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea740039b0 0x7fea74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.217+0000 7fea8e6fc640 1 -- 172.21.15.37:0/612100603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea74003520 con 0x7fea74004d40 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea8e6fc640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea74004d40 0x7fea740051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea8000a870 tx=0x7fea74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cb7531e9c9d50e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8000a4c0 con 0x7fea74004d40 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8002f070 con 0x7fea74004d40 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea8cef9640 1 -- 172.21.15.37:0/612100603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8002bcc0 con 0x7fea74004d40 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea9015f640 1 -- 172.21.15.37:0/612100603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea74004d40 msgr2=0x7fea740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea9015f640 1 --2- 172.21.15.37:0/612100603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea74004d40 0x7fea740051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea8000a870 tx=0x7fea74005830 comp rx=0 tx=0).stop 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea8e6fc640 1 -- 172.21.15.37:0/612100603 reap_dead start 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea9015f640 1 -- 172.21.15.37:0/612100603 shutdown_connections 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea9015f640 1 -- 172.21.15.37:0/612100603 >> 172.21.15.37:0/612100603 conn(0x7fea880d4fe0 msgr2=0x7fea880d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea9015f640 1 -- 172.21.15.37:0/612100603 shutdown_connections 2024-05-10T08:40:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.218+0000 7fea9015f640 1 -- 172.21.15.37:0/612100603 wait complete. 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 Processor -- start 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 -- start start 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea74004d40 0x7fea880b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea8809f6a0 0x7fea88159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea881f5290 0x7fea881f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea880b8e40 con 0x7fea881f5290 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea880d2370 con 0x7fea8809f6a0 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.220+0000 7fea9015f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea880d2000 con 0x7fea74004d40 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea881f5290 0x7fea881f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea881f5290 0x7fea881f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36754/0 (socket says 172.21.15.37:36754) 2024-05-10T08:40:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 -- 172.21.15.37:0/3939297791 learned_addr learned my addr 172.21.15.37:0/3939297791 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8d6fa640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea8809f6a0 0x7fea88159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8defb640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea74004d40 0x7fea880b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 -- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea74004d40 msgr2=0x7fea880b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea74004d40 0x7fea880b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 -- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea8809f6a0 msgr2=0x7fea88159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea8809f6a0 0x7fea88159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 -- 172.21.15.37:0/3939297791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea881f5c50 con 0x7fea881f5290 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea8e6fc640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea881f5290 0x7fea881f5710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea80000f80 tx=0x7fea80001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea7e7fc640 1 -- 172.21.15.37:0/3939297791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8000a4c0 con 0x7fea881f5290 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea7e7fc640 1 -- 172.21.15.37:0/3939297791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea80034470 con 0x7fea881f5290 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea880a1f00 con 0x7fea881f5290 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea7e7fc640 1 -- 172.21.15.37:0/3939297791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea80002030 con 0x7fea881f5290 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.221+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea880a24c0 con 0x7fea881f5290 2024-05-10T08:40:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.222+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea880693f0 con 0x7fea881f5290 2024-05-10T08:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.223+0000 7fea7e7fc640 1 -- 172.21.15.37:0/3939297791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea80034840 con 0x7fea881f5290 2024-05-10T08:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.223+0000 7fea7e7fc640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea6c0762d0 0x7fea6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.224+0000 7fea7e7fc640 1 -- 172.21.15.37:0/3939297791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fea800b7310 con 0x7fea881f5290 2024-05-10T08:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.224+0000 7fea8defb640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea6c0762d0 0x7fea6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.224+0000 7fea8defb640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea6c0762d0 0x7fea6c078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea88159e50 tx=0x7fea84009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.228+0000 7fea7e7fc640 1 -- 172.21.15.37:0/3939297791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fea881f5c50 con 0x7fea881f5290 2024-05-10T08:40:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.489+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fea880d36e0 con 0x7fea881f5290 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.490+0000 7fea7e7fc640 1 -- 172.21.15.37:0/3939297791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fea800b5e20 con 0x7fea881f5290 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg==", 2024-05-10T08:40:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ==", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:40:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA==", 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw==", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw==", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw==", 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg==", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ==", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g==", 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-10T08:40:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA==", 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w==", 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.497 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg==", 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.498 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A==", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg==", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:40:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw==", 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.500 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA==", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA83T1mpCEPLBAAZlDinj6hQh8Ccd9D/MMUDw==", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:40:58.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBe3T1mEifBNRAAiODOIWdD9Czxth/YC2iEQg==", 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2024-05-10T08:40:58.502 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBe3T1mhy/BNRAArQF3MlfPBJAPxf3BmieyXA==", 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBe3T1m8zbBNRAAFkn8lHlkTjfinkSXbRaXTw==", 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBe3T1mLT7BNRAAeNdqRfVsaP+bxtWxtiVVCg==", 2024-05-10T08:40:58.503 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBe3T1mjUXBNRAAvt2s3qs2qhqBFd6TEYxG4w==", 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBe3T1mLU3BNRAABhnHXCx9t+x5V25I/hW/6g==", 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA==", 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A==", 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:40:58.506 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:40:58.506 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:40:58.506 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.506 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:40:58.506 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:40:58.506 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:40:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea6c0762d0 msgr2=0x7fea6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea6c0762d0 0x7fea6c078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea88159e50 tx=0x7fea84009190 comp rx=0 tx=0).stop 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea881f5290 msgr2=0x7fea881f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea881f5290 0x7fea881f5710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea80000f80 tx=0x7fea80001360 comp rx=0 tx=0).stop 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 shutdown_connections 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea6c0762d0 0x7fea6c078790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea881f5290 0x7fea881f5710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea8809f6a0 0x7fea88159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 --2- 172.21.15.37:0/3939297791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea74004d40 0x7fea880b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 >> 172.21.15.37:0/3939297791 conn(0x7fea880d4fe0 msgr2=0x7fea880cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 shutdown_connections 2024-05-10T08:40:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.492+0000 7fea9015f640 1 -- 172.21.15.37:0/3939297791 wait complete. 2024-05-10T08:40:58.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-10T08:40:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.614+0000 7f3d6179e640 1 Processor -- start 2024-05-10T08:40:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.614+0000 7f3d6179e640 1 -- start start 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.615+0000 7f3d6179e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d5c15f5c0 0x7f3d5c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.615+0000 7f3d6179e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c0d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.615+0000 7f3d6179e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5c0d5d80 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.615+0000 7f3d6179e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5c0d3180 con 0x7f3d5c15f5c0 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.615+0000 7f3d6179e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c0d1170 con 0x7f3d5c0b44c0 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d53fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c0d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d5bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d5c15f5c0 0x7f3d5c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d60f9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3d5c0b3f70 0x7f3d5c0cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:60896/0 (socket says 172.21.15.37:60896) 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d5bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d5c15f5c0 0x7f3d5c0d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:54644/0 (socket says 172.21.15.37:54644) 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d53fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c0d1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:36400/0 (socket says 172.21.15.37:36400) 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d60f9d640 1 -- 172.21.15.37:0/2520728340 learned_addr learned my addr 172.21.15.37:0/2520728340 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:40:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d5bfff640 1 -- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 msgr2=0x7f3d5c0d1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d5bfff640 1 --2- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c0d1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d5bfff640 1 -- 172.21.15.37:0/2520728340 >> v1:172.21.15.82:6789/0 conn(0x7f3d5c0b3f70 legacy=0x7f3d5c0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d5bfff640 1 -- 172.21.15.37:0/2520728340 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c0d2ee0 con 0x7f3d5c15f5c0 2024-05-10T08:40:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d5b7fe640 1 -- 172.21.15.37:0/2520728340 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518411890 0 0) 0x7f3d5c0d5d80 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.616+0000 7f3d53fff640 1 --2- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c0d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d5bfff640 1 --2- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 0x7f3d5c0d1970 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0097a0 tx=0x7f3d4c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=802c35a22c3bb5d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d5b7fe640 1 -- 172.21.15.37:0/2520728340 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c037070 con 0x7f3d5c15f5c0 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d5b7fe640 1 -- 172.21.15.37:0/2520728340 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c032440 con 0x7f3d5c15f5c0 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d5b7fe640 1 -- 172.21.15.37:0/2520728340 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c032810 con 0x7f3d5c15f5c0 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 -- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 msgr2=0x7f3d5c0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 0x7f3d5c0d1970 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0097a0 tx=0x7f3d4c02a210 comp rx=0 tx=0).stop 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 -- 172.21.15.37:0/2520728340 shutdown_connections 2024-05-10T08:40:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c0d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2520728340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 0x7f3d5c0d1970 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 -- 172.21.15.37:0/2520728340 >> 172.21.15.37:0/2520728340 conn(0x7f3d5c0d4f60 msgr2=0x7f3d5c0d5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 -- 172.21.15.37:0/2520728340 shutdown_connections 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.617+0000 7f3d6179e640 1 -- 172.21.15.37:0/2520728340 wait complete. 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.619+0000 7f3d6179e640 1 Processor -- start 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.619+0000 7f3d6179e640 1 -- start start 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.619+0000 7f3d6179e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5c0b3f70 0x7f3d5c0ba690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.619+0000 7f3d6179e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.619+0000 7f3d6179e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 0x7f3d5c0c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d6179e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c06cfc0 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d6179e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c06e670 con 0x7f3d5c15f5c0 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d6179e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c0d0ed0 con 0x7f3d5c0b44c0 2024-05-10T08:40:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5c0b3f70 0x7f3d5c0ba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5c0b3f70 0x7f3d5c0ba690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36770/0 (socket says 172.21.15.37:36770) 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 -- 172.21.15.37:0/2660716258 learned_addr learned my addr 172.21.15.37:0/2660716258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d53fff640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d60f9d640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 0x7f3d5c0c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 -- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 msgr2=0x7f3d5c155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 -- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 msgr2=0x7f3d5c0c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 0x7f3d5c0c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 -- 172.21.15.37:0/2660716258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c1558d0 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d5bfff640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5c0b3f70 0x7f3d5c0ba690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0097a0 tx=0x7f3d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d597fa640 1 -- 172.21.15.37:0/2660716258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c037050 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d597fa640 1 -- 172.21.15.37:0/2660716258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c038040 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d597fa640 1 -- 172.21.15.37:0/2660716258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c004490 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5c0cb310 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.620+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d5c0c8b60 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.621+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d5c0cb830 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.622+0000 7f3d597fa640 1 -- 172.21.15.37:0/2660716258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d4c03c6d0 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.622+0000 7f3d597fa640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d3c0762d0 0x7f3d3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:58.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.623+0000 7f3d597fa640 1 -- 172.21.15.37:0/2660716258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f3d4c0b7c50 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.623+0000 7f3d53fff640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d3c0762d0 0x7f3d3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:58.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.623+0000 7f3d53fff640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d3c0762d0 0x7f3d3c078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009560 tx=0x7f3d44009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:58.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.627+0000 7f3d597fa640 1 -- 172.21.15.37:0/2660716258 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3d5c0cb830 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.892+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f3d5c050740 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.894+0000 7f3d597fa640 1 -- 172.21.15.37:0/2660716258 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f3d4c0bd020 con 0x7f3d5c0b3f70 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d3c0762d0 msgr2=0x7f3d3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d3c0762d0 0x7f3d3c078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009560 tx=0x7f3d44009190 comp rx=0 tx=0).stop 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5c0b3f70 msgr2=0x7f3d5c0ba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5c0b3f70 0x7f3d5c0ba690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0097a0 tx=0x7f3d4c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 shutdown_connections 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d3c0762d0 0x7f3d3c078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d5c15f5c0 0x7f3d5c0c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d5c0b44c0 0x7f3d5c155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 --2- 172.21.15.37:0/2660716258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5c0b3f70 0x7f3d5c0ba690 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:58.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 >> 172.21.15.37:0/2660716258 conn(0x7f3d5c0d4f60 msgr2=0x7f3d5c0d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:58.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 shutdown_connections 2024-05-10T08:40:58.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:58.896+0000 7f3d6179e640 1 -- 172.21.15.37:0/2660716258 wait complete. 2024-05-10T08:40:58.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-10T08:40:59.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.012+0000 7f1acb324640 1 Processor -- start 2024-05-10T08:40:59.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.012+0000 7f1acb324640 1 -- start start 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1acb324640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ac40d0ec0 0x7f1ac40d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1acb324640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac40b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1acb324640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac40d1760 con 0x7f1ac415f380 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1acb324640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac40d30f0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1acb324640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac40d3f70 con 0x7f1ac40d3b00 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac88bf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ac40d0ec0 0x7f1ac40d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac88bf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ac40d0ec0 0x7f1ac40d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36784/0 (socket says 172.21.15.37:36784) 2024-05-10T08:40:59.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac88bf640 1 -- 172.21.15.37:0/3943577421 learned_addr learned my addr 172.21.15.37:0/3943577421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:59.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac98c1640 1 --2- 172.21.15.37:0/3943577421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac40b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac88bf640 1 -- 172.21.15.37:0/3943577421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 msgr2=0x7f1ac40b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:59.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac88bf640 1 --2- 172.21.15.37:0/3943577421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac40b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac88bf640 1 -- 172.21.15.37:0/3943577421 >> v1:172.21.15.82:6789/0 conn(0x7f1ac415f380 legacy=0x7f1ac40d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.013+0000 7f1ac88bf640 1 -- 172.21.15.37:0/3943577421 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac40d1a40 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.014+0000 7f1ac88bf640 1 --2- 172.21.15.37:0/3943577421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac40d35c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009870 tx=0x7f1ab402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e507e49f41ffcf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.014+0000 7f1abbfff640 1 -- 172.21.15.37:0/3943577421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4037070 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.014+0000 7f1abbfff640 1 -- 172.21.15.37:0/3943577421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab4032440 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.014+0000 7f1abbfff640 1 -- 172.21.15.37:0/3943577421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4032810 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 -- 172.21.15.37:0/3943577421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 msgr2=0x7f1ac40d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 --2- 172.21.15.37:0/3943577421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac40d35c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009870 tx=0x7f1ab402a270 comp rx=0 tx=0).stop 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 -- 172.21.15.37:0/3943577421 shutdown_connections 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 --2- 172.21.15.37:0/3943577421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac40b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 --2- 172.21.15.37:0/3943577421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac40d35c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 -- 172.21.15.37:0/3943577421 >> 172.21.15.37:0/3943577421 conn(0x7f1ac40d4fe0 msgr2=0x7f1ac40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 -- 172.21.15.37:0/3943577421 shutdown_connections 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.015+0000 7f1acb324640 1 -- 172.21.15.37:0/3943577421 wait complete. 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.016+0000 7f1acb324640 1 Processor -- start 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.016+0000 7f1acb324640 1 -- start start 2024-05-10T08:40:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1acb324640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac4163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1acb324640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac406e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1acb324640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ac415f380 0x7f1ac414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1acb324640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac40d2000 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1acb324640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac40d2370 con 0x7f1ac415f380 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1acb324640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac415f760 con 0x7f1ac40d3b00 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac4163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac4163260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36794/0 (socket says 172.21.15.37:36794) 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 -- 172.21.15.37:0/3663774698 learned_addr learned my addr 172.21.15.37:0/3663774698 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac88bf640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac406e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac98c1640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ac415f380 0x7f1ac414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 -- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 msgr2=0x7f1ac406e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac406e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 -- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ac415f380 msgr2=0x7f1ac414efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ac415f380 0x7f1ac414efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 -- 172.21.15.37:0/3663774698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac41f96f0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ac90c0640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac4163260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000c3c0 tx=0x7f1ac000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.017+0000 7f1ab9ffb640 1 -- 172.21.15.37:0/3663774698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00052d0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.018+0000 7f1ab9ffb640 1 -- 172.21.15.37:0/3663774698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac0005490 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.018+0000 7f1ab9ffb640 1 -- 172.21.15.37:0/3663774698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0007260 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.018+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac41627e0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.018+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac41637a0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.019+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac40693f0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.019+0000 7f1ab9ffb640 1 -- 172.21.15.37:0/3663774698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ac0007400 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.020+0000 7f1ab9ffb640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1aa80762d0 0x7f1aa8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.020+0000 7f1ab9ffb640 1 -- 172.21.15.37:0/3663774698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f1ac00968b0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.020+0000 7f1ac88bf640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1aa80762d0 0x7f1aa8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.020+0000 7f1ac88bf640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1aa80762d0 0x7f1aa8078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4034000 tx=0x7f1ab402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.024+0000 7f1ab9ffb640 1 -- 172.21.15.37:0/3663774698 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1ac41627e0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.294+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f1ac408cfd0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.296+0000 7f1ab9ffb640 1 -- 172.21.15.37:0/3663774698 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f1ac00603d0 con 0x7f1ac40d0ec0 2024-05-10T08:40:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.298+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1aa80762d0 msgr2=0x7f1aa8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.298+0000 7f1acb324640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1aa80762d0 0x7f1aa8078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4034000 tx=0x7f1ab402e000 comp rx=0 tx=0).stop 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.298+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 msgr2=0x7f1ac4163260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.298+0000 7f1acb324640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac4163260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000c3c0 tx=0x7f1ac000c880 comp rx=0 tx=0).stop 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 shutdown_connections 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1aa80762d0 0x7f1aa8078790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ac415f380 0x7f1ac414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ac40d3b00 0x7f1ac406e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 --2- 172.21.15.37:0/3663774698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac40d0ec0 0x7f1ac4163260 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 >> 172.21.15.37:0/3663774698 conn(0x7f1ac40d4fe0 msgr2=0x7f1ac40d53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 shutdown_connections 2024-05-10T08:40:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.299+0000 7f1acb324640 1 -- 172.21.15.37:0/3663774698 wait complete. 2024-05-10T08:40:59.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-10T08:40:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.415+0000 7f38ffd58640 1 Processor -- start 2024-05-10T08:40:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.415+0000 7f38ffd58640 1 -- start start 2024-05-10T08:40:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38ffd58640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f81629a0 0x7f38f80d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38ffd58640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f80d0cb0 0x7f38f80d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38ffd58640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38f80d3330 con 0x7f38f80d2dc0 2024-05-10T08:40:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38ffd58640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f38f80d2170 con 0x7f38f81629a0 2024-05-10T08:40:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38ffd58640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f38f80d2450 con 0x7f38f80d0cb0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fdaf4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f81629a0 0x7f38f80d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fdaf4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f81629a0 0x7f38f80d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36796/0 (socket says 172.21.15.37:36796) 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fdaf4640 1 -- 172.21.15.37:0/3296180067 learned_addr learned my addr 172.21.15.37:0/3296180067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fe2f5640 1 --2- 172.21.15.37:0/3296180067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f80d0cb0 0x7f38f80d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fdaf4640 1 -- 172.21.15.37:0/3296180067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f80d0cb0 msgr2=0x7f38f80d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fdaf4640 1 --2- 172.21.15.37:0/3296180067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f80d0cb0 0x7f38f80d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fdaf4640 1 -- 172.21.15.37:0/3296180067 >> v1:172.21.15.82:6789/0 conn(0x7f38f80d2dc0 legacy=0x7f38f80c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.416+0000 7f38fdaf4640 1 -- 172.21.15.37:0/3296180067 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f80d2730 con 0x7f38f81629a0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.417+0000 7f38fdaf4640 1 --2- 172.21.15.37:0/3296180067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f81629a0 0x7f38f80d35c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009870 tx=0x7f38f402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1df780ca546516 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.417+0000 7f38fcaf2640 1 -- 172.21.15.37:0/3296180067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4037070 con 0x7f38f81629a0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.417+0000 7f38fcaf2640 1 -- 172.21.15.37:0/3296180067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f4032440 con 0x7f38f81629a0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.417+0000 7f38fcaf2640 1 -- 172.21.15.37:0/3296180067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4032810 con 0x7f38f81629a0 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 -- 172.21.15.37:0/3296180067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f81629a0 msgr2=0x7f38f80d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 --2- 172.21.15.37:0/3296180067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f81629a0 0x7f38f80d35c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009870 tx=0x7f38f402a130 comp rx=0 tx=0).stop 2024-05-10T08:40:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 -- 172.21.15.37:0/3296180067 shutdown_connections 2024-05-10T08:40:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 --2- 172.21.15.37:0/3296180067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f80d0cb0 0x7f38f80d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 --2- 172.21.15.37:0/3296180067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f81629a0 0x7f38f80d35c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 -- 172.21.15.37:0/3296180067 >> 172.21.15.37:0/3296180067 conn(0x7f38f80d4fe0 msgr2=0x7f38f80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 -- 172.21.15.37:0/3296180067 shutdown_connections 2024-05-10T08:40:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.418+0000 7f38ffd58640 1 -- 172.21.15.37:0/3296180067 wait complete. 2024-05-10T08:40:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.419+0000 7f38ffd58640 1 Processor -- start 2024-05-10T08:40:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.419+0000 7f38ffd58640 1 -- start start 2024-05-10T08:40:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f80d0cb0 0x7f38f80ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f80d2dc0 0x7f38f815b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f81629a0 0x7f38f815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38f80cf440 con 0x7f38f80d0cb0 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38f80cf2c0 con 0x7f38f80d2dc0 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f38f80c95e0 con 0x7f38f81629a0 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f80d0cb0 0x7f38f80ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f80d0cb0 0x7f38f80ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36804/0 (socket says 172.21.15.37:36804) 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 -- 172.21.15.37:0/535032574 learned_addr learned my addr 172.21.15.37:0/535032574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fe2f5640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f81629a0 0x7f38f815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fd2f3640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f80d2dc0 0x7f38f815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 -- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f81629a0 msgr2=0x7f38f815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f81629a0 0x7f38f815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 -- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f80d2dc0 msgr2=0x7f38f815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f80d2dc0 0x7f38f815b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 -- 172.21.15.37:0/535032574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f81f8180 con 0x7f38f80d0cb0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fd2f3640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f80d2dc0 0x7f38f815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38fdaf4640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f80d0cb0 0x7f38f80ca920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38f4000c00 tx=0x7f38f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ea7fc640 1 -- 172.21.15.37:0/535032574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4041020 con 0x7f38f80d0cb0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ea7fc640 1 -- 172.21.15.37:0/535032574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f40306c0 con 0x7f38f80d0cb0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f81f92b0 con 0x7f38f80d0cb0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ea7fc640 1 -- 172.21.15.37:0/535032574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4037040 con 0x7f38f80d0cb0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.420+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f80b66b0 con 0x7f38f80d0cb0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.421+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f80693f0 con 0x7f38f80d0cb0 2024-05-10T08:40:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.422+0000 7f38ea7fc640 1 -- 172.21.15.37:0/535032574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38f4044020 con 0x7f38f80d0cb0 2024-05-10T08:40:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.423+0000 7f38ea7fc640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38dc0762d0 0x7f38dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.423+0000 7f38ea7fc640 1 -- 172.21.15.37:0/535032574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f38f40b7bc0 con 0x7f38f80d0cb0 2024-05-10T08:40:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.423+0000 7f38fd2f3640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38dc0762d0 0x7f38dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.424+0000 7f38fd2f3640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38dc0762d0 0x7f38dc078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f38ec001680 tx=0x7f38ec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.427+0000 7f38ea7fc640 1 -- 172.21.15.37:0/535032574 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f38f404b030 con 0x7f38f80d0cb0 2024-05-10T08:40:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.692+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f38f80d58e0 con 0x7f38f80d0cb0 2024-05-10T08:40:59.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.696+0000 7f38ea7fc640 1 -- 172.21.15.37:0/535032574 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f38f4081770 con 0x7f38f80d0cb0 2024-05-10T08:40:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38dc0762d0 msgr2=0x7f38dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38dc0762d0 0x7f38dc078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f38ec001680 tx=0x7f38ec009040 comp rx=0 tx=0).stop 2024-05-10T08:40:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f80d0cb0 msgr2=0x7f38f80ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f80d0cb0 0x7f38f80ca920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38f4000c00 tx=0x7f38f40046c0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 shutdown_connections 2024-05-10T08:40:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38dc0762d0 0x7f38dc078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38f81629a0 0x7f38f815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f80d2dc0 0x7f38f815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 --2- 172.21.15.37:0/535032574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f80d0cb0 0x7f38f80ca920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 >> 172.21.15.37:0/535032574 conn(0x7f38f80d4fe0 msgr2=0x7f38f80c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 shutdown_connections 2024-05-10T08:40:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.698+0000 7f38ffd58640 1 -- 172.21.15.37:0/535032574 wait complete. 2024-05-10T08:40:59.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-10T08:40:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.813+0000 7f2c402d1640 1 Processor -- start 2024-05-10T08:40:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.814+0000 7f2c402d1640 1 -- start start 2024-05-10T08:40:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.814+0000 7f2c402d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c3815f420 0x7f2c380d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.814+0000 7f2c402d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d3ca0 0x7f2c380d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.814+0000 7f2c402d1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c381630b0 con 0x7f2c380d1eb0 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c402d1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2c380d22f0 con 0x7f2c3815f420 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c402d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2c380d2550 con 0x7f2c380d3ca0 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3e06d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c3815f420 0x7f2c380d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3e06d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c3815f420 0x7f2c380d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36818/0 (socket says 172.21.15.37:36818) 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3e06d640 1 -- 172.21.15.37:0/3647502032 learned_addr learned my addr 172.21.15.37:0/3647502032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3d86c640 1 --2- 172.21.15.37:0/3647502032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d3ca0 0x7f2c380d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3e06d640 1 -- 172.21.15.37:0/3647502032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d3ca0 msgr2=0x7f2c380d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3e06d640 1 --2- 172.21.15.37:0/3647502032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d3ca0 0x7f2c380d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3e06d640 1 -- 172.21.15.37:0/3647502032 >> v1:172.21.15.82:6789/0 conn(0x7f2c380d1eb0 legacy=0x7f2c380d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3e06d640 1 -- 172.21.15.37:0/3647502032 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c380d2c80 con 0x7f2c3815f420 2024-05-10T08:40:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.815+0000 7f2c3d86c640 1 --2- 172.21.15.37:0/3647502032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d3ca0 0x7f2c380d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.816+0000 7f2c3e06d640 1 --2- 172.21.15.37:0/3647502032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c3815f420 0x7f2c380d3760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009870 tx=0x7f2c3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1163022730b8e7c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.816+0000 7f2c3d06b640 1 -- 172.21.15.37:0/3647502032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34037070 con 0x7f2c3815f420 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.816+0000 7f2c3d06b640 1 -- 172.21.15.37:0/3647502032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c34032440 con 0x7f2c3815f420 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.816+0000 7f2c3d06b640 1 -- 172.21.15.37:0/3647502032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34032810 con 0x7f2c3815f420 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.816+0000 7f2c402d1640 1 -- 172.21.15.37:0/3647502032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c3815f420 msgr2=0x7f2c380d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.816+0000 7f2c402d1640 1 --2- 172.21.15.37:0/3647502032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c3815f420 0x7f2c380d3760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009870 tx=0x7f2c3402a270 comp rx=0 tx=0).stop 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.817+0000 7f2c402d1640 1 -- 172.21.15.37:0/3647502032 shutdown_connections 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.817+0000 7f2c402d1640 1 --2- 172.21.15.37:0/3647502032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d3ca0 0x7f2c380d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.817+0000 7f2c402d1640 1 --2- 172.21.15.37:0/3647502032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c3815f420 0x7f2c380d3760 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.817+0000 7f2c402d1640 1 -- 172.21.15.37:0/3647502032 >> 172.21.15.37:0/3647502032 conn(0x7f2c3808eac0 msgr2=0x7f2c3809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.817+0000 7f2c402d1640 1 -- 172.21.15.37:0/3647502032 shutdown_connections 2024-05-10T08:40:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.817+0000 7f2c402d1640 1 -- 172.21.15.37:0/3647502032 wait complete. 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.818+0000 7f2c402d1640 1 Processor -- start 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.818+0000 7f2c402d1640 1 -- start start 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d1eb0 0x7f2c38154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380c9940 0x7f2c380c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c380b9880 0x7f2c380b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380d2830 con 0x7f2c380c9940 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380d3240 con 0x7f2c380b9880 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2c380d53d0 con 0x7f2c380d1eb0 2024-05-10T08:40:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380c9940 0x7f2c380c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380c9940 0x7f2c380c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36820/0 (socket says 172.21.15.37:36820) 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 -- 172.21.15.37:0/62565933 learned_addr learned my addr 172.21.15.37:0/62565933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3e06d640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d1eb0 0x7f2c38154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3e86e640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c380b9880 0x7f2c380b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 -- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d1eb0 msgr2=0x7f2c38154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d1eb0 0x7f2c38154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 -- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c380b9880 msgr2=0x7f2c380b9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c380b9880 0x7f2c380b9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 -- 172.21.15.37:0/62565933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c380b87e0 con 0x7f2c380c9940 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3e06d640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d1eb0 0x7f2c38154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3e86e640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c380b9880 0x7f2c380b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c3d86c640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380c9940 0x7f2c380c8b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800e7e0 tx=0x7f2c2800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c2effd640 1 -- 172.21.15.37:0/62565933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800f040 con 0x7f2c380c9940 2024-05-10T08:40:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c2effd640 1 -- 172.21.15.37:0/62565933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c28004030 con 0x7f2c380c9940 2024-05-10T08:40:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c2effd640 1 -- 172.21.15.37:0/62565933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28004400 con 0x7f2c380c9940 2024-05-10T08:40:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c380b8ac0 con 0x7f2c380c9940 2024-05-10T08:40:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.819+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c380b9080 con 0x7f2c380c9940 2024-05-10T08:40:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.821+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c380693f0 con 0x7f2c380c9940 2024-05-10T08:40:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.821+0000 7f2c2effd640 1 -- 172.21.15.37:0/62565933 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c2800c6d0 con 0x7f2c380c9940 2024-05-10T08:40:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.822+0000 7f2c2effd640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c1c0762d0 0x7f2c1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:40:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.822+0000 7f2c2effd640 1 -- 172.21.15.37:0/62565933 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f2c280971f0 con 0x7f2c380c9940 2024-05-10T08:40:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.822+0000 7f2c3e06d640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c1c0762d0 0x7f2c1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:40:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.822+0000 7f2c3e06d640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c1c0762d0 0x7f2c1c078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c34034000 tx=0x7f2c3402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:40:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:40:59.826+0000 7f2c2effd640 1 -- 172.21.15.37:0/62565933 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2c28017020 con 0x7f2c380c9940 2024-05-10T08:41:00.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.097+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f2c380b4c50 con 0x7f2c380c9940 2024-05-10T08:41:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.104+0000 7f2c2effd640 1 -- 172.21.15.37:0/62565933 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f2c28060d10 con 0x7f2c380c9940 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c1c0762d0 msgr2=0x7f2c1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c1c0762d0 0x7f2c1c078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c34034000 tx=0x7f2c3402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380c9940 msgr2=0x7f2c380c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380c9940 0x7f2c380c8b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800e7e0 tx=0x7f2c2800eca0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 shutdown_connections 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c1c0762d0 0x7f2c1c078790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c380b9880 0x7f2c380b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380c9940 0x7f2c380c8b00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 --2- 172.21.15.37:0/62565933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c380d1eb0 0x7f2c38154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 >> 172.21.15.37:0/62565933 conn(0x7f2c3808eac0 msgr2=0x7f2c3806d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 shutdown_connections 2024-05-10T08:41:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.106+0000 7f2c402d1640 1 -- 172.21.15.37:0/62565933 wait complete. 2024-05-10T08:41:00.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-10T08:41:00.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.221+0000 7f6c46571640 1 Processor -- start 2024-05-10T08:41:00.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.221+0000 7f6c46571640 1 -- start start 2024-05-10T08:41:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.222+0000 7f6c46571640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c400d1970 0x7f6c400d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.222+0000 7f6c46571640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c401630b0 con 0x7f6c4015f420 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.222+0000 7f6c46571640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c400d3e70 con 0x7f6c400d4cc0 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.222+0000 7f6c46571640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6c400d2550 con 0x7f6c400d1970 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.222+0000 7f6c3ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6c4015f420 0x7f6c400d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45838/0 (socket says 172.21.15.37:45838) 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.222+0000 7f6c3ffff640 1 -- 172.21.15.37:0/1118527074 learned_addr learned my addr 172.21.15.37:0/1118527074 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/1118527074 >> v2:172.21.15.82:3300/0 conn(0x7f6c400d1970 0x7f6c400d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523268130 0 0) 0x7f6c30001110 con 0x7f6c4015f420 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c28003520 con 0x7f6c4015f420 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2199035721 0 0) 0x7f6c28003520 con 0x7f6c4015f420 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 >> v2:172.21.15.82:3300/0 conn(0x7f6c400d1970 msgr2=0x7f6c400d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 --2- 172.21.15.37:0/1118527074 >> v2:172.21.15.82:3300/0 conn(0x7f6c400d1970 0x7f6c400d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 >> v1:172.21.15.82:6789/0 conn(0x7f6c400d4cc0 legacy=0x7f6c400d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c400d2c80 con 0x7f6c4015f420 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f6c30001840 con 0x7f6c4015f420 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 >> v1:172.21.15.37:6789/0 conn(0x7f6c4015f420 legacy=0x7f6c400d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c280039b0 0x7f6c28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c280051c0 0x7f6c2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400d2550 con 0x7f6c28004800 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2800c060 con 0x7f6c280039b0 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2800c260 con 0x7f6c280051c0 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/1118527074 >> v2:172.21.15.82:3300/0 conn(0x7f6c400d1970 0x7f6c400d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3ffff640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c280039b0 0x7f6c28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.223+0000 7f6c44b0e640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c280051c0 0x7f6c2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c3f7fe640 1 -- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c280051c0 msgr2=0x7f6c2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c280051c0 0x7f6c2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c3f7fe640 1 -- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c280039b0 msgr2=0x7f6c28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c280039b0 0x7f6c28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c3f7fe640 1 -- 172.21.15.37:0/1118527074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28003520 con 0x7f6c28004800 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c44b0e640 1 -- 172.21.15.37:0/1118527074 reap_dead start 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009c70 tx=0x7f6c28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978b4e6f976a21b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.224+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34009840 con 0x7f6c28004800 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34004020 con 0x7f6c28004800 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c3effd640 1 -- 172.21.15.37:0/1118527074 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c340043d0 con 0x7f6c28004800 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c46571640 1 -- 172.21.15.37:0/1118527074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c28004800 msgr2=0x7f6c28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c46571640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009c70 tx=0x7f6c28005830 comp rx=0 tx=0).stop 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c46571640 1 -- 172.21.15.37:0/1118527074 shutdown_connections 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c46571640 1 --2- 172.21.15.37:0/1118527074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c46571640 1 -- 172.21.15.37:0/1118527074 >> 172.21.15.37:0/1118527074 conn(0x7f6c4008eac0 msgr2=0x7f6c4009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c46571640 1 -- 172.21.15.37:0/1118527074 shutdown_connections 2024-05-10T08:41:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.225+0000 7f6c46571640 1 -- 172.21.15.37:0/1118527074 wait complete. 2024-05-10T08:41:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.226+0000 7f6c46571640 1 Processor -- start 2024-05-10T08:41:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.226+0000 7f6c46571640 1 -- start start 2024-05-10T08:41:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c46571640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c28004800 0x7f6c400c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c46571640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400ca470 0x7f6c4015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c46571640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400ca8f0 0x7f6c4015da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c46571640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400d2830 con 0x7f6c400ca470 2024-05-10T08:41:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c46571640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400d3240 con 0x7f6c400ca8f0 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c46571640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6c400d1e20 con 0x7f6c28004800 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400ca470 0x7f6c4015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400ca470 0x7f6c4015d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36836/0 (socket says 172.21.15.37:36836) 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.227+0000 7f6c3f7fe640 1 -- 172.21.15.37:0/3387837037 learned_addr learned my addr 172.21.15.37:0/3387837037 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c44b0e640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400ca8f0 0x7f6c4015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3ffff640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c28004800 0x7f6c400c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3f7fe640 1 -- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c28004800 msgr2=0x7f6c400c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c28004800 0x7f6c400c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3f7fe640 1 -- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400ca8f0 msgr2=0x7f6c4015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400ca8f0 0x7f6c4015da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3f7fe640 1 -- 172.21.15.37:0/3387837037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c400c80a0 con 0x7f6c400ca470 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3ffff640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c28004800 0x7f6c400c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3f7fe640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400ca470 0x7f6c4015d530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009c70 tx=0x7f6c34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3cff9640 1 -- 172.21.15.37:0/3387837037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34040070 con 0x7f6c400ca470 2024-05-10T08:41:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3cff9640 1 -- 172.21.15.37:0/3387837037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34003610 con 0x7f6c400ca470 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c400caea0 con 0x7f6c400ca470 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c3cff9640 1 -- 172.21.15.37:0/3387837037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34006e10 con 0x7f6c400ca470 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.228+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c400cb460 con 0x7f6c400ca470 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.229+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c400693f0 con 0x7f6c400ca470 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.230+0000 7f6c3cff9640 1 -- 172.21.15.37:0/3387837037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c34043070 con 0x7f6c400ca470 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.230+0000 7f6c3cff9640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c2c0762d0 0x7f6c2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.230+0000 7f6c3cff9640 1 -- 172.21.15.37:0/3387837037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f6c340b7d80 con 0x7f6c400ca470 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.231+0000 7f6c3ffff640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c2c0762d0 0x7f6c2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.231+0000 7f6c3ffff640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c2c0762d0 0x7f6c2c078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c30001050 tx=0x7f6c30009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.235+0000 7f6c3cff9640 1 -- 172.21.15.37:0/3387837037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6c400c80a0 con 0x7f6c400ca470 2024-05-10T08:41:00.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.500+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f6c400b4c50 con 0x7f6c400ca470 2024-05-10T08:41:00.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.504+0000 7f6c3cff9640 1 -- 172.21.15.37:0/3387837037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f6c34081890 con 0x7f6c400ca470 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c2c0762d0 msgr2=0x7f6c2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c2c0762d0 0x7f6c2c078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c30001050 tx=0x7f6c30009040 comp rx=0 tx=0).stop 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400ca470 msgr2=0x7f6c4015d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400ca470 0x7f6c4015d530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009c70 tx=0x7f6c34004730 comp rx=0 tx=0).stop 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 shutdown_connections 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c2c0762d0 0x7f6c2c078790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c400ca8f0 0x7f6c4015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400ca470 0x7f6c4015d530 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 --2- 172.21.15.37:0/3387837037 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c28004800 0x7f6c400c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 >> 172.21.15.37:0/3387837037 conn(0x7f6c4008eac0 msgr2=0x7f6c4006e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 shutdown_connections 2024-05-10T08:41:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.506+0000 7f6c46571640 1 -- 172.21.15.37:0/3387837037 wait complete. 2024-05-10T08:41:00.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-10T08:41:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.622+0000 7f0ed2333640 1 Processor -- start 2024-05-10T08:41:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.622+0000 7f0ed2333640 1 -- start start 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed2333640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ecc06f060 0x7f0ecc06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed2333640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06fe30 0x7f0ecc0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed2333640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ecc0d0360 0x7f0ecc0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed2333640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc0d07c0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed2333640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc06f440 con 0x7f0ecc06f060 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed2333640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc15d2a0 con 0x7f0ecc06fe30 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ecc0d0360 0x7f0ecc0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ecc0d0360 0x7f0ecc0b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36848/0 (socket says 172.21.15.37:36848) 2024-05-10T08:41:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 -- 172.21.15.37:0/1130686161 learned_addr learned my addr 172.21.15.37:0/1130686161 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ecbfff640 1 --2- 172.21.15.37:0/1130686161 >> v2:172.21.15.82:3300/0 conn(0x7f0ecc06f060 0x7f0ecc06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ecb7fe640 1 --2- 172.21.15.37:0/1130686161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06fe30 0x7f0ecc0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 -- 172.21.15.37:0/1130686161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06fe30 msgr2=0x7f0ecc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 --2- 172.21.15.37:0/1130686161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06fe30 0x7f0ecc0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 -- 172.21.15.37:0/1130686161 >> v2:172.21.15.82:3300/0 conn(0x7f0ecc06f060 msgr2=0x7f0ecc06e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 --2- 172.21.15.37:0/1130686161 >> v2:172.21.15.82:3300/0 conn(0x7f0ecc06f060 0x7f0ecc06e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ed08d0640 1 -- 172.21.15.37:0/1130686161 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc1609b0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.623+0000 7f0ecb7fe640 1 --2- 172.21.15.37:0/1130686161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06fe30 0x7f0ecc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.624+0000 7f0ed08d0640 1 --2- 172.21.15.37:0/1130686161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0b3f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0b5470 tx=0x7f0ec402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84f34e4cef94371 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.624+0000 7f0ecaffd640 1 -- 172.21.15.37:0/1130686161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4036070 con 0x7f0ecc0d0360 2024-05-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.624+0000 7f0ecaffd640 1 -- 172.21.15.37:0/1130686161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4031600 con 0x7f0ecc0d0360 2024-05-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.624+0000 7f0ecaffd640 1 -- 172.21.15.37:0/1130686161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40319d0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 -- 172.21.15.37:0/1130686161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 msgr2=0x7f0ecc0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 --2- 172.21.15.37:0/1130686161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0b3f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0b5470 tx=0x7f0ec402a6a0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 -- 172.21.15.37:0/1130686161 shutdown_connections 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 --2- 172.21.15.37:0/1130686161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0b3f00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 --2- 172.21.15.37:0/1130686161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06fe30 0x7f0ecc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 --2- 172.21.15.37:0/1130686161 >> v2:172.21.15.82:3300/0 conn(0x7f0ecc06f060 0x7f0ecc06e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 -- 172.21.15.37:0/1130686161 >> 172.21.15.37:0/1130686161 conn(0x7f0ecc06c3a0 msgr2=0x7f0ecc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 -- 172.21.15.37:0/1130686161 shutdown_connections 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.625+0000 7f0ed2333640 1 -- 172.21.15.37:0/1130686161 wait complete. 2024-05-10T08:41:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.626+0000 7f0ed2333640 1 Processor -- start 2024-05-10T08:41:00.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.626+0000 7f0ed2333640 1 -- start start 2024-05-10T08:41:00.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed2333640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06f060 0x7f0ecc1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed2333640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ecc06fe30 0x7f0ecc1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed2333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed2333640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc161250 con 0x7f0ecc0d0360 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed2333640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc160f70 con 0x7f0ecc06fe30 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed2333640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc161530 con 0x7f0ecc06f060 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36852/0 (socket says 172.21.15.37:36852) 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 -- 172.21.15.37:0/2251569653 learned_addr learned my addr 172.21.15.37:0/2251569653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ecb7fe640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ecc06fe30 0x7f0ecc1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ecbfff640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06f060 0x7f0ecc1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 -- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06f060 msgr2=0x7f0ecc1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06f060 0x7f0ecc1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 -- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ecc06fe30 msgr2=0x7f0ecc1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ecc06fe30 0x7f0ecc1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.627+0000 7f0ed08d0640 1 -- 172.21.15.37:0/2251569653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc15a820 con 0x7f0ecc0d0360 2024-05-10T08:41:00.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.628+0000 7f0ed08d0640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0ca430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ec402ac90 tx=0x7f0ec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:00.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.628+0000 7f0ec8ff9640 1 -- 172.21.15.37:0/2251569653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec403f020 con 0x7f0ecc0d0360 2024-05-10T08:41:00.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.628+0000 7f0ec8ff9640 1 -- 172.21.15.37:0/2251569653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4037040 con 0x7f0ecc0d0360 2024-05-10T08:41:00.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.628+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc15ab00 con 0x7f0ecc0d0360 2024-05-10T08:41:00.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.628+0000 7f0ec8ff9640 1 -- 172.21.15.37:0/2251569653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4036070 con 0x7f0ecc0d0360 2024-05-10T08:41:00.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.628+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc158ff0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.629+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc1591f0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.630+0000 7f0ec8ff9640 1 -- 172.21.15.37:0/2251569653 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ec4042020 con 0x7f0ecc0d0360 2024-05-10T08:41:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.630+0000 7f0ec8ff9640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0eb80762d0 0x7f0eb8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.630+0000 7f0ec8ff9640 1 -- 172.21.15.37:0/2251569653 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f0ec40b76e0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.631+0000 7f0ecbfff640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0eb80762d0 0x7f0eb8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.631+0000 7f0ecbfff640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0eb80762d0 0x7f0eb8078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc157060 tx=0x7f0ebc009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.635+0000 7f0ec8ff9640 1 -- 172.21.15.37:0/2251569653 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0ecc1591f0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.899+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f0ecc0693f0 con 0x7f0ecc0d0360 2024-05-10T08:41:00.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.903+0000 7f0ec8ff9640 1 -- 172.21.15.37:0/2251569653 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f0ec4049030 con 0x7f0ecc0d0360 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0eb80762d0 msgr2=0x7f0eb8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0eb80762d0 0x7f0eb8078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc157060 tx=0x7f0ebc009190 comp rx=0 tx=0).stop 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 msgr2=0x7f0ecc0ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0ca430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ec402ac90 tx=0x7f0ec4004a40 comp rx=0 tx=0).stop 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 shutdown_connections 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0eb80762d0 0x7f0eb8078790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc0d0360 0x7f0ecc0ca430 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ecc06fe30 0x7f0ecc1570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 --2- 172.21.15.37:0/2251569653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ecc06f060 0x7f0ecc1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 >> 172.21.15.37:0/2251569653 conn(0x7f0ecc06c3a0 msgr2=0x7f0ecc15f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 shutdown_connections 2024-05-10T08:41:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:00.905+0000 7f0ed2333640 1 -- 172.21.15.37:0/2251569653 wait complete. 2024-05-10T08:41:00.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:41:01.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.020+0000 7f97d022a640 1 Processor -- start 2024-05-10T08:41:01.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.020+0000 7f97d022a640 1 -- start start 2024-05-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97d022a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 0x7f97c8070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97d022a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f97c806d3b0 0x7f97c806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97d022a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c8071280 con 0x7f97c80733e0 2024-05-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97d022a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f97c806dd60 con 0x7f97c806d3b0 2024-05-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97d022a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f97c80d1390 con 0x7f97c815ce90 2024-05-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97cd7c5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f97c80733e0 0x7f97c80d0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45842/0 (socket says 172.21.15.37:45842) 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97cd7c5640 1 -- 172.21.15.37:0/165950603 learned_addr learned my addr 172.21.15.37:0/165950603 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97ce7c7640 1 --2- 172.21.15.37:0/165950603 >> v2:172.21.15.82:3300/0 conn(0x7f97c806d3b0 0x7f97c806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97cdfc6640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 0x7f97c8070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082417874 0 0) 0x7f97c8071280 con 0x7f97c80733e0 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.021+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b0003520 con 0x7f97c80733e0 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3442780189 0 0) 0x7f97b0003520 con 0x7f97c80733e0 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 msgr2=0x7f97c8070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 0x7f97c8070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 >> v2:172.21.15.82:3300/0 conn(0x7f97c806d3b0 msgr2=0x7f97c806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 --2- 172.21.15.37:0/165950603 >> v2:172.21.15.82:3300/0 conn(0x7f97c806d3b0 0x7f97c806d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c80cff00 con 0x7f97c80733e0 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f97bc001670 con 0x7f97c80733e0 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 >> v1:172.21.15.37:6789/0 conn(0x7f97c80733e0 legacy=0x7f97c80d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 0x7f97b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b0003f30 0x7f97b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0004d40 0x7f97b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97c806dd60 con 0x7f97b0003f30 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80d1390 con 0x7f97b0004d40 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f97b000b9c0 con 0x7f97c815ce90 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97cd7c5640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b0003f30 0x7f97b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97cdfc6640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 0x7f97b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97ce7c7640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0004d40 0x7f97b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97cd7c5640 1 -- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 msgr2=0x7f97b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97cd7c5640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815ce90 0x7f97b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97cd7c5640 1 -- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0004d40 msgr2=0x7f97b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97cd7c5640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0004d40 0x7f97b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.022+0000 7f97cd7c5640 1 -- 172.21.15.37:0/165950603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b0003520 con 0x7f97b0003f30 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.023+0000 7f97cd7c5640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b0003f30 0x7f97b0004800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f97bc001050 tx=0x7f97b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab247cc1246d410 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.023+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc007d70 con 0x7f97b0003f30 2024-05-10T08:41:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.023+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97bc005af0 con 0x7f97b0003f30 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.023+0000 7f97ccfc4640 1 -- 172.21.15.37:0/165950603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc007070 con 0x7f97b0003f30 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.024+0000 7f97d022a640 1 -- 172.21.15.37:0/165950603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b0003f30 msgr2=0x7f97b0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.024+0000 7f97d022a640 1 --2- 172.21.15.37:0/165950603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b0003f30 0x7f97b0004800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f97bc001050 tx=0x7f97b0005830 comp rx=0 tx=0).stop 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.024+0000 7f97ce7c7640 1 -- 172.21.15.37:0/165950603 reap_dead start 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.024+0000 7f97d022a640 1 -- 172.21.15.37:0/165950603 shutdown_connections 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.024+0000 7f97d022a640 1 -- 172.21.15.37:0/165950603 >> 172.21.15.37:0/165950603 conn(0x7f97c80728c0 msgr2=0x7f97c8072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.024+0000 7f97d022a640 1 -- 172.21.15.37:0/165950603 shutdown_connections 2024-05-10T08:41:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.024+0000 7f97d022a640 1 -- 172.21.15.37:0/165950603 wait complete. 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.025+0000 7f97d022a640 1 Processor -- start 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.025+0000 7f97d022a640 1 -- start start 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97d022a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0003f30 0x7f97c8153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97d022a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815d9d0 0x7f97c8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97d022a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c815f2e0 0x7f97c815f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97d022a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80d0480 con 0x7f97c815f2e0 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97d022a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80d01a0 con 0x7f97b0003f30 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97d022a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f97c80d0760 con 0x7f97c815d9d0 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c815f2e0 0x7f97c815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c815f2e0 0x7f97c815f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36876/0 (socket says 172.21.15.37:36876) 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 -- 172.21.15.37:0/199006721 learned_addr learned my addr 172.21.15.37:0/199006721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97cdfc6640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0003f30 0x7f97c8153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97cd7c5640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815d9d0 0x7f97c8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 -- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815d9d0 msgr2=0x7f97c8150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815d9d0 0x7f97c8150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 -- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0003f30 msgr2=0x7f97c8153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0003f30 0x7f97c8153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 -- 172.21.15.37:0/199006721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c815e1b0 con 0x7f97c815f2e0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97cd7c5640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815d9d0 0x7f97c8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97ce7c7640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c815f2e0 0x7f97c815f760 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97c80d1510 tx=0x7f97b800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97c67fc640 1 -- 172.21.15.37:0/199006721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b800fde0 con 0x7f97c815f2e0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97c67fc640 1 -- 172.21.15.37:0/199006721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b801d070 con 0x7f97c815f2e0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c815e490 con 0x7f97c815f2e0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.026+0000 7f97c67fc640 1 -- 172.21.15.37:0/199006721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8015670 con 0x7f97c815f2e0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.027+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c815ea50 con 0x7f97c815f2e0 2024-05-10T08:41:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.028+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c80693f0 con 0x7f97c815f2e0 2024-05-10T08:41:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.028+0000 7f97c67fc640 1 -- 172.21.15.37:0/199006721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f97b8015810 con 0x7f97c815f2e0 2024-05-10T08:41:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.029+0000 7f97c67fc640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b4076300 0x7f97b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.029+0000 7f97c67fc640 1 -- 172.21.15.37:0/199006721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f97b8097d10 con 0x7f97c815f2e0 2024-05-10T08:41:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.029+0000 7f97cdfc6640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b4076300 0x7f97b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.030+0000 7f97cdfc6640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b4076300 0x7f97b40787c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f97c806f480 tx=0x7f97c0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.033+0000 7f97c67fc640 1 -- 172.21.15.37:0/199006721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f97b8010040 con 0x7f97c815f2e0 2024-05-10T08:41:01.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.225+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f97c81578f0 con 0x7f97c815f2e0 2024-05-10T08:41:01.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.226+0000 7f97c67fc640 1 -- 172.21.15.37:0/199006721 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) ==== 84+0+65 (secure 0 0 0) 0x7f97b8061830 con 0x7f97c815f2e0 2024-05-10T08:41:01.226 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:01.226 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:41:01.226 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:01.226 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:41:01.226 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:41:01.226 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:01.226 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:41:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b4076300 msgr2=0x7f97b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b4076300 0x7f97b40787c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f97c806f480 tx=0x7f97c0008040 comp rx=0 tx=0).stop 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c815f2e0 msgr2=0x7f97c815f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c815f2e0 0x7f97c815f760 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97c80d1510 tx=0x7f97b800f580 comp rx=0 tx=0).stop 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 shutdown_connections 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b4076300 0x7f97b40787c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c815f2e0 0x7f97c815f760 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c815d9d0 0x7f97c8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 --2- 172.21.15.37:0/199006721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b0003f30 0x7f97c8153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 >> 172.21.15.37:0/199006721 conn(0x7f97c80728c0 msgr2=0x7f97c80b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 shutdown_connections 2024-05-10T08:41:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.228+0000 7f97d022a640 1 -- 172.21.15.37:0/199006721 wait complete. 2024-05-10T08:41:01.238 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:41:01.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:41:01.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.346+0000 7fc0fb899640 1 Processor -- start 2024-05-10T08:41:01.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.347+0000 7fc0fb899640 1 -- start start 2024-05-10T08:41:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.347+0000 7fc0fb899640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 0x7fc0f40b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.347+0000 7fc0fb899640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f40cfc00 con 0x7fc0f40d3a50 2024-05-10T08:41:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.347+0000 7fc0fb899640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f40cfea0 con 0x7fc0f40d1050 2024-05-10T08:41:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.347+0000 7fc0fb899640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f40d2a10 con 0x7fc0f40d3670 2024-05-10T08:41:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0f8e34640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc0f40d3a50 0x7fc0f40d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45858/0 (socket says 172.21.15.37:45858) 2024-05-10T08:41:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0f8e34640 1 -- 172.21.15.37:0/2755394341 learned_addr learned my addr 172.21.15.37:0/2755394341 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0f9635640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 0x7fc0f40b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960881062 0 0) 0x7fc0f40cfc00 con 0x7fc0f40d3a50 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0e0003520 con 0x7fc0f40d3a50 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902122161 0 0) 0x7fc0f40cfea0 con 0x7fc0f40d1050 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0f40cfc00 con 0x7fc0f40d1050 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1371520932 0 0) 0x7fc0e0003520 con 0x7fc0f40d3a50 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 msgr2=0x7fc0f40b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 0x7fc0f40b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 >> v1:172.21.15.82:6789/0 conn(0x7fc0f40d1050 legacy=0x7fc0f4162920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f40d2730 con 0x7fc0f40d3a50 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fc0e4001670 con 0x7fc0f40d3a50 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0f9635640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 0x7fc0f40b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 >> v1:172.21.15.37:6789/0 conn(0x7fc0f40d3a50 legacy=0x7fc0f40d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0003b70 0x7fc0e0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 0x7fc0e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e0004d40 0x7fc0e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f40d2a10 con 0x7fc0e0004d40 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e000ba70 con 0x7fc0e0003b70 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e000bbf0 con 0x7fc0f40d3670 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0f9e36640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e0004d40 0x7fc0e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0f8e34640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 0x7fc0e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.348+0000 7fc0f9635640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0003b70 0x7fc0e0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.349+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 msgr2=0x7fc0e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.349+0000 7fc0f9e36640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40d3670 0x7fc0e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.349+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0003b70 msgr2=0x7fc0e0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.349+0000 7fc0f9e36640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0003b70 0x7fc0e0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.349+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2755394341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e0003520 con 0x7fc0e0004d40 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.349+0000 7fc0f9e36640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e0004d40 0x7fc0e00051c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec001fe0 tx=0x7fc0e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717361a4565323ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec001c00 con 0x7fc0e0004d40 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ec003b90 con 0x7fc0e0004d40 2024-05-10T08:41:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0ebfff640 1 -- 172.21.15.37:0/2755394341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec0050d0 con 0x7fc0e0004d40 2024-05-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0fb899640 1 -- 172.21.15.37:0/2755394341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e0004d40 msgr2=0x7fc0e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0fb899640 1 --2- 172.21.15.37:0/2755394341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e0004d40 0x7fc0e00051c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec001fe0 tx=0x7fc0e0005830 comp rx=0 tx=0).stop 2024-05-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2755394341 reap_dead start 2024-05-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0fb899640 1 -- 172.21.15.37:0/2755394341 shutdown_connections 2024-05-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0fb899640 1 -- 172.21.15.37:0/2755394341 >> 172.21.15.37:0/2755394341 conn(0x7fc0f409e390 msgr2=0x7fc0f40d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0fb899640 1 -- 172.21.15.37:0/2755394341 shutdown_connections 2024-05-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.350+0000 7fc0fb899640 1 -- 172.21.15.37:0/2755394341 wait complete. 2024-05-10T08:41:01.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.351+0000 7fc0fb899640 1 Processor -- start 2024-05-10T08:41:01.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.351+0000 7fc0fb899640 1 -- start start 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0fb899640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0004d40 0x7fc0f4157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0fb899640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40a28e0 0x7fc0f406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0fb899640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0f406dca0 0x7fc0f409f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0fb899640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f40b49c0 con 0x7fc0f406dca0 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0fb899640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f40d04b0 con 0x7fc0e0004d40 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0fb899640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f40b4b40 con 0x7fc0f40a28e0 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0f9e36640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0f406dca0 0x7fc0f409f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0f9e36640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0f406dca0 0x7fc0f409f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36882/0 (socket says 172.21.15.37:36882) 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2242372356 learned_addr learned my addr 172.21.15.37:0/2242372356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.352+0000 7fc0f9635640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0004d40 0x7fc0f4157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40a28e0 msgr2=0x7fc0f406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f8e34640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40a28e0 0x7fc0f406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f9e36640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40a28e0 0x7fc0f406d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0004d40 msgr2=0x7fc0f4157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f9e36640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0004d40 0x7fc0f4157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f9e36640 1 -- 172.21.15.37:0/2242372356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f40a1880 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f9635640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0004d40 0x7fc0f4157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f8e34640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40a28e0 0x7fc0f406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0f9e36640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0f406dca0 0x7fc0f409f6d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec005040 tx=0x7fc0ec001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0e9ffb640 1 -- 172.21.15.37:0/2242372356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec007dd0 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0e9ffb640 1 -- 172.21.15.37:0/2242372356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ec044070 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f40a1b20 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0e9ffb640 1 -- 172.21.15.37:0/2242372356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec03b830 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.353+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f40a20e0 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.354+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f40693f0 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.355+0000 7fc0e9ffb640 1 -- 172.21.15.37:0/2242372356 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0ec03b9d0 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.355+0000 7fc0e9ffb640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0d80762d0 0x7fc0d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.356+0000 7fc0e9ffb640 1 -- 172.21.15.37:0/2242372356 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fc0ec0b7b70 con 0x7fc0f406dca0 2024-05-10T08:41:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.356+0000 7fc0f9635640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0d80762d0 0x7fc0d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:01.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.356+0000 7fc0f9635640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0d80762d0 0x7fc0d8078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40d5f50 tx=0x7fc0f0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:01.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.360+0000 7fc0e9ffb640 1 -- 172.21.15.37:0/2242372356 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc0ec081690 con 0x7fc0f406dca0 2024-05-10T08:41:01.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:01.553+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc0f4160f10 con 0x7fc0f406dca0 2024-05-10T08:41:02.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.108+0000 7fc0e9ffb640 1 -- 172.21.15.37:0/2242372356 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) ==== 138+0+0 (secure 0 0 0) 0x7fc0ec080f90 con 0x7fc0f406dca0 2024-05-10T08:41:02.108 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0d80762d0 msgr2=0x7fc0d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0d80762d0 0x7fc0d8078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40d5f50 tx=0x7fc0f0008040 comp rx=0 tx=0).stop 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0f406dca0 msgr2=0x7fc0f409f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0f406dca0 0x7fc0f409f6d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec005040 tx=0x7fc0ec001670 comp rx=0 tx=0).stop 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 shutdown_connections 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0d80762d0 0x7fc0d8078790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0f406dca0 0x7fc0f409f6d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0f40a28e0 0x7fc0f406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 --2- 172.21.15.37:0/2242372356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e0004d40 0x7fc0f4157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 >> 172.21.15.37:0/2242372356 conn(0x7fc0f409e390 msgr2=0x7fc0f415ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 shutdown_connections 2024-05-10T08:41:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.111+0000 7fc0fb899640 1 -- 172.21.15.37:0/2242372356 wait complete. 2024-05-10T08:41:02.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:41:02.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.242+0000 7f109b751640 1 Processor -- start 2024-05-10T08:41:02.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.242+0000 7f109b751640 1 -- start start 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f109b751640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10940b6590 0x7f10940d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f109b751640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1094163460 0x7f109415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f109b751640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10940d3320 con 0x7f10940d2bb0 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f109b751640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f10940d3600 con 0x7f10940b6590 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f109b751640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f10940d38e0 con 0x7f1094163460 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f10994ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10940b6590 0x7f10940d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f1098cec640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10940d2bb0 0x7f1094162d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45868/0 (socket says 172.21.15.37:45868) 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f1098cec640 1 -- 172.21.15.37:0/3019792145 learned_addr learned my addr 172.21.15.37:0/3019792145 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f1099cee640 1 --2- 172.21.15.37:0/3019792145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1094163460 0x7f109415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f10994ed640 1 -- 172.21.15.37:0/3019792145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1094163460 msgr2=0x7f109415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f10994ed640 1 --2- 172.21.15.37:0/3019792145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1094163460 0x7f109415ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f10994ed640 1 -- 172.21.15.37:0/3019792145 >> v1:172.21.15.37:6789/0 conn(0x7f10940d2bb0 legacy=0x7f1094162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:02.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.243+0000 7f10994ed640 1 -- 172.21.15.37:0/3019792145 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10940d3bc0 con 0x7f10940b6590 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.244+0000 7f10994ed640 1 --2- 172.21.15.37:0/3019792145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940b6590 0x7f10940d0bd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1090009d90 tx=0x7f109002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3e44e6c745f4a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.244+0000 7f108bfff640 1 -- 172.21.15.37:0/3019792145 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090007740 con 0x7f10940b6590 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.244+0000 7f108bfff640 1 -- 172.21.15.37:0/3019792145 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10900078e0 con 0x7f10940b6590 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.244+0000 7f108bfff640 1 -- 172.21.15.37:0/3019792145 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090007cb0 con 0x7f10940b6590 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 -- 172.21.15.37:0/3019792145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940b6590 msgr2=0x7f10940d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 --2- 172.21.15.37:0/3019792145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940b6590 0x7f10940d0bd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1090009d90 tx=0x7f109002a660 comp rx=0 tx=0).stop 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 -- 172.21.15.37:0/3019792145 shutdown_connections 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 --2- 172.21.15.37:0/3019792145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1094163460 0x7f109415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 --2- 172.21.15.37:0/3019792145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940b6590 0x7f10940d0bd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 -- 172.21.15.37:0/3019792145 >> 172.21.15.37:0/3019792145 conn(0x7f10940d4fe0 msgr2=0x7f10940d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:02.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 -- 172.21.15.37:0/3019792145 shutdown_connections 2024-05-10T08:41:02.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.245+0000 7f109b751640 1 -- 172.21.15.37:0/3019792145 wait complete. 2024-05-10T08:41:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.246+0000 7f109b751640 1 Processor -- start 2024-05-10T08:41:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.246+0000 7f109b751640 1 -- start start 2024-05-10T08:41:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f109b751640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10940b6590 0x7f1094152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f109b751640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10940d2bb0 0x7f1094160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f109b751640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094163460 0x7f1094161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f109b751640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f109415f170 con 0x7f1094163460 2024-05-10T08:41:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f109b751640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10940d3010 con 0x7f10940b6590 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f109b751640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f109415f2f0 con 0x7f10940d2bb0 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094163460 0x7f1094161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094163460 0x7f1094161cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36894/0 (socket says 172.21.15.37:36894) 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 -- 172.21.15.37:0/897518309 learned_addr learned my addr 172.21.15.37:0/897518309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1098cec640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10940d2bb0 0x7f1094160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f10994ed640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10940b6590 0x7f1094152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 -- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10940d2bb0 msgr2=0x7f1094160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10940d2bb0 0x7f1094160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 -- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10940b6590 msgr2=0x7f1094152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10940b6590 0x7f1094152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 -- 172.21.15.37:0/897518309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109415f700 con 0x7f1094163460 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1098cec640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10940d2bb0 0x7f1094160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1099cee640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094163460 0x7f1094161cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f108c00d5d0 tx=0x7f108c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1089ffb640 1 -- 172.21.15.37:0/897518309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c0125f0 con 0x7f1094163460 2024-05-10T08:41:02.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1089ffb640 1 -- 172.21.15.37:0/897518309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c019070 con 0x7f1094163460 2024-05-10T08:41:02.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109415fc80 con 0x7f1094163460 2024-05-10T08:41:02.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.247+0000 7f1089ffb640 1 -- 172.21.15.37:0/897518309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c0129f0 con 0x7f1094163460 2024-05-10T08:41:02.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.248+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1094160240 con 0x7f1094163460 2024-05-10T08:41:02.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.249+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10940693f0 con 0x7f1094163460 2024-05-10T08:41:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.250+0000 7f1089ffb640 1 -- 172.21.15.37:0/897518309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f108c012b90 con 0x7f1094163460 2024-05-10T08:41:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.250+0000 7f1089ffb640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f10780762d0 0x7f1078078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.251+0000 7f1089ffb640 1 -- 172.21.15.37:0/897518309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5619+0+0 (secure 0 0 0) 0x7f108c098430 con 0x7f1094163460 2024-05-10T08:41:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.251+0000 7f10994ed640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f10780762d0 0x7f1078078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.251+0000 7f10994ed640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f10780762d0 0x7f1078078790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1090034000 tx=0x7f109002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.255+0000 7f1089ffb640 1 -- 172.21.15.37:0/897518309 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f108c061e70 con 0x7f1094163460 2024-05-10T08:41:02.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:02.448+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1094163240 con 0x7f1094163460 2024-05-10T08:41:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.111+0000 7f1089ffb640 1 -- 172.21.15.37:0/897518309 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) ==== 170+0+0 (secure 0 0 0) 0x7f108c061770 con 0x7f1094163460 2024-05-10T08:41:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:41:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f10780762d0 msgr2=0x7f1078078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f10780762d0 0x7f1078078790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1090034000 tx=0x7f109002f000 comp rx=0 tx=0).stop 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094163460 msgr2=0x7f1094161cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094163460 0x7f1094161cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f108c00d5d0 tx=0x7f108c00da90 comp rx=0 tx=0).stop 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 shutdown_connections 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f10780762d0 0x7f1078078790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094163460 0x7f1094161cf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10940d2bb0 0x7f1094160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 --2- 172.21.15.37:0/897518309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10940b6590 0x7f1094152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 >> 172.21.15.37:0/897518309 conn(0x7f10940d4fe0 msgr2=0x7f1094153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 shutdown_connections 2024-05-10T08:41:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.114+0000 7f109b751640 1 -- 172.21.15.37:0/897518309 wait complete. 2024-05-10T08:41:03.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:41:03.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.250+0000 7f98b6250640 1 Processor -- start 2024-05-10T08:41:03.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.251+0000 7f98b6250640 1 -- start start 2024-05-10T08:41:03.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.251+0000 7f98b6250640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b00cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:03.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.251+0000 7f98b6250640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b00d0320 con 0x7f98b00d56b0 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.251+0000 7f98b6250640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b00d0600 con 0x7f98b00d3aa0 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.251+0000 7f98b6250640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f98b00d08e0 con 0x7f98b015f4e0 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98affff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98b00d56b0 0x7f98b00d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45872/0 (socket says 172.21.15.37:45872) 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98affff640 1 -- 172.21.15.37:0/1669150670 learned_addr learned my addr 172.21.15.37:0/1669150670 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98af7fe640 1 --2- 172.21.15.37:0/1669150670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b00cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98ae7fc640 1 -- 172.21.15.37:0/1669150670 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396565028 0 0) 0x7f98b00d0320 con 0x7f98b00d56b0 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98ae7fc640 1 -- 172.21.15.37:0/1669150670 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9898003520 con 0x7f98b00d56b0 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98af7fe640 1 -- 172.21.15.37:0/1669150670 >> v1:172.21.15.82:6789/0 conn(0x7f98b00d3aa0 legacy=0x7f98b00d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98af7fe640 1 -- 172.21.15.37:0/1669150670 >> v1:172.21.15.37:6789/0 conn(0x7f98b00d56b0 legacy=0x7f98b00d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.252+0000 7f98af7fe640 1 -- 172.21.15.37:0/1669150670 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b00d0bc0 con 0x7f98b015f4e0 2024-05-10T08:41:03.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.253+0000 7f98af7fe640 1 --2- 172.21.15.37:0/1669150670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b00cfcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98a00097d0 tx=0x7f98a002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cc6caf3eb53e27a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.253+0000 7f98ae7fc640 1 -- 172.21.15.37:0/1669150670 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0037070 con 0x7f98b015f4e0 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.253+0000 7f98ae7fc640 1 -- 172.21.15.37:0/1669150670 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a0032440 con 0x7f98b015f4e0 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.253+0000 7f98ae7fc640 1 -- 172.21.15.37:0/1669150670 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00327f0 con 0x7f98b015f4e0 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.254+0000 7f98b6250640 1 -- 172.21.15.37:0/1669150670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 msgr2=0x7f98b00cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.254+0000 7f98b6250640 1 --2- 172.21.15.37:0/1669150670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b00cfcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98a00097d0 tx=0x7f98a002a210 comp rx=0 tx=0).stop 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.254+0000 7f98b6250640 1 -- 172.21.15.37:0/1669150670 shutdown_connections 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.254+0000 7f98b6250640 1 --2- 172.21.15.37:0/1669150670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b00cfcd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.254+0000 7f98b6250640 1 -- 172.21.15.37:0/1669150670 >> 172.21.15.37:0/1669150670 conn(0x7f98b008eac0 msgr2=0x7f98b009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.254+0000 7f98b6250640 1 -- 172.21.15.37:0/1669150670 shutdown_connections 2024-05-10T08:41:03.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.254+0000 7f98b6250640 1 -- 172.21.15.37:0/1669150670 wait complete. 2024-05-10T08:41:03.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.255+0000 7f98b6250640 1 Processor -- start 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.255+0000 7f98b6250640 1 -- start start 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98b6250640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b00d3aa0 0x7f98b00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98b6250640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b00d56b0 0x7f98b00ba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98b6250640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98b6250640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98b00d3f00 con 0x7f98b00d3aa0 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98b6250640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f98b015f8c0 con 0x7f98b00d56b0 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98b6250640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f98b00d4080 con 0x7f98b015f4e0 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b00d3aa0 0x7f98b00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b00d3aa0 0x7f98b00b8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36910/0 (socket says 172.21.15.37:36910) 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 -- 172.21.15.37:0/2617634548 learned_addr learned my addr 172.21.15.37:0/2617634548 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98affff640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98aeffd640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b00d56b0 0x7f98b00ba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 -- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 msgr2=0x7f98b01548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b01548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:03.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 -- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b00d56b0 msgr2=0x7f98b00ba5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b00d56b0 0x7f98b00ba5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 -- 172.21.15.37:0/2617634548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b0154e00 con 0x7f98b00d3aa0 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98aeffd640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b00d56b0 0x7f98b00ba5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.256+0000 7f98af7fe640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b00d3aa0 0x7f98b00b8bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f98a00097d0 tx=0x7f98a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.257+0000 7f9897fff640 1 -- 172.21.15.37:0/2617634548 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0037040 con 0x7f98b00d3aa0 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.257+0000 7f9897fff640 1 -- 172.21.15.37:0/2617634548 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a0004230 con 0x7f98b00d3aa0 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.257+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b00b92f0 con 0x7f98b00d3aa0 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.257+0000 7f9897fff640 1 -- 172.21.15.37:0/2617634548 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0003610 con 0x7f98b00d3aa0 2024-05-10T08:41:03.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.257+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b00b98b0 con 0x7f98b00d3aa0 2024-05-10T08:41:03.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.258+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b00693f0 con 0x7f98b00d3aa0 2024-05-10T08:41:03.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.258+0000 7f9897fff640 1 -- 172.21.15.37:0/2617634548 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f98a00037b0 con 0x7f98b00d3aa0 2024-05-10T08:41:03.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.259+0000 7f9897fff640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f989c0762d0 0x7f989c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:03.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.259+0000 7f9897fff640 1 -- 172.21.15.37:0/2617634548 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6001+0+0 (secure 0 0 0) 0x7f98a00b8760 con 0x7f98b00d3aa0 2024-05-10T08:41:03.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.259+0000 7f98aeffd640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f989c0762d0 0x7f989c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:03.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.260+0000 7f98aeffd640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f989c0762d0 0x7f989c078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98b01613b0 tx=0x7f98a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:03.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.264+0000 7f9897fff640 1 -- 172.21.15.37:0/2617634548 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f98a0082020 con 0x7f98b00d3aa0 2024-05-10T08:41:03.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:03.493+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f98b00cf3a0 con 0x7f98b00d3aa0 2024-05-10T08:41:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.132+0000 7f9897fff640 1 -- 172.21.15.37:0/2617634548 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f98a0081920 con 0x7f98b00d3aa0 2024-05-10T08:41:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 5 and data pool 6 2024-05-10T08:41:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f989c0762d0 msgr2=0x7f989c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f989c0762d0 0x7f989c078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98b01613b0 tx=0x7f98a4009040 comp rx=0 tx=0).stop 2024-05-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b00d3aa0 msgr2=0x7f98b00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b00d3aa0 0x7f98b00b8bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f98a00097d0 tx=0x7f98a00046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 shutdown_connections 2024-05-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f989c0762d0 0x7f989c078790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98b015f4e0 0x7f98b01548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b00d56b0 0x7f98b00ba5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 --2- 172.21.15.37:0/2617634548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b00d3aa0 0x7f98b00b8bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.148+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 >> 172.21.15.37:0/2617634548 conn(0x7f98b008eac0 msgr2=0x7f98b006d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.153+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 shutdown_connections 2024-05-10T08:41:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.153+0000 7f98b6250640 1 -- 172.21.15.37:0/2617634548 wait complete. 2024-05-10T08:41:04.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:04.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.280+0000 7f8d89e83640 1 Processor -- start 2024-05-10T08:41:04.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.280+0000 7f8d89e83640 1 -- start start 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d89e83640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d841629a0 0x7f8d840d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d89e83640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d0cb0 0x7f8d840d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d89e83640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d840d3330 con 0x7f8d840d2dc0 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d89e83640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8d840d2170 con 0x7f8d841629a0 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d89e83640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840d2450 con 0x7f8d840d0cb0 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d837fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d841629a0 0x7f8d840d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d0cb0 0x7f8d840d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d82ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8d840d2dc0 0x7f8d840c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:60968/0 (socket says 172.21.15.37:60968) 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d82ffd640 1 -- 172.21.15.37:0/2301809978 learned_addr learned my addr 172.21.15.37:0/2301809978 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:04.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d837fe640 1 -- 172.21.15.37:0/2301809978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d0cb0 msgr2=0x7f8d840d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:04.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d837fe640 1 --2- 172.21.15.37:0/2301809978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d0cb0 0x7f8d840d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d837fe640 1 -- 172.21.15.37:0/2301809978 >> v1:172.21.15.82:6789/0 conn(0x7f8d840d2dc0 legacy=0x7f8d840c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d827fc640 1 -- 172.21.15.37:0/2301809978 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272583264 0 0) 0x7f8d840d3330 con 0x7f8d840d2dc0 2024-05-10T08:41:04.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.281+0000 7f8d837fe640 1 -- 172.21.15.37:0/2301809978 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d840d2730 con 0x7f8d841629a0 2024-05-10T08:41:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.282+0000 7f8d837fe640 1 --2- 172.21.15.37:0/2301809978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 0x7f8d840d35c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d7402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b64194ac3e2256f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.282+0000 7f8d827fc640 1 -- 172.21.15.37:0/2301809978 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74037070 con 0x7f8d841629a0 2024-05-10T08:41:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.282+0000 7f8d827fc640 1 -- 172.21.15.37:0/2301809978 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d7402adb0 con 0x7f8d841629a0 2024-05-10T08:41:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.282+0000 7f8d827fc640 1 -- 172.21.15.37:0/2301809978 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74032660 con 0x7f8d841629a0 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 -- 172.21.15.37:0/2301809978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 msgr2=0x7f8d840d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 --2- 172.21.15.37:0/2301809978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 0x7f8d840d35c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d7402a060 comp rx=0 tx=0).stop 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 -- 172.21.15.37:0/2301809978 shutdown_connections 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 --2- 172.21.15.37:0/2301809978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d0cb0 0x7f8d840d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 --2- 172.21.15.37:0/2301809978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 0x7f8d840d35c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 -- 172.21.15.37:0/2301809978 >> 172.21.15.37:0/2301809978 conn(0x7f8d840d4fe0 msgr2=0x7f8d840d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 -- 172.21.15.37:0/2301809978 shutdown_connections 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.283+0000 7f8d89e83640 1 -- 172.21.15.37:0/2301809978 wait complete. 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.284+0000 7f8d89e83640 1 Processor -- start 2024-05-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.284+0000 7f8d89e83640 1 -- start start 2024-05-10T08:41:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d89e83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d840d0cb0 0x7f8d8414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d89e83640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d2dc0 0x7f8d840b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d89e83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 0x7f8d840b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d89e83640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d840cf440 con 0x7f8d840d0cb0 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d89e83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d840cf2c0 con 0x7f8d841629a0 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d89e83640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840c95e0 con 0x7f8d840d2dc0 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d840d0cb0 0x7f8d8414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d840d0cb0 0x7f8d8414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36922/0 (socket says 172.21.15.37:36922) 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 -- 172.21.15.37:0/1078850959 learned_addr learned my addr 172.21.15.37:0/1078850959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d83fff640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 0x7f8d840b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d2dc0 0x7f8d840b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 -- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d2dc0 msgr2=0x7f8d840b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d2dc0 0x7f8d840b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 -- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 msgr2=0x7f8d840b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 0x7f8d840b8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.285+0000 7f8d837fe640 1 -- 172.21.15.37:0/1078850959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d840b9660 con 0x7f8d840d0cb0 2024-05-10T08:41:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.286+0000 7f8d837fe640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d840d0cb0 0x7f8d8414f500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.286+0000 7f8d6bfff640 1 -- 172.21.15.37:0/1078850959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74037040 con 0x7f8d840d0cb0 2024-05-10T08:41:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.286+0000 7f8d6bfff640 1 -- 172.21.15.37:0/1078850959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74004030 con 0x7f8d840d0cb0 2024-05-10T08:41:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.286+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d840b9940 con 0x7f8d840d0cb0 2024-05-10T08:41:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.286+0000 7f8d6bfff640 1 -- 172.21.15.37:0/1078850959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74004420 con 0x7f8d840d0cb0 2024-05-10T08:41:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.286+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8409efe0 con 0x7f8d840d0cb0 2024-05-10T08:41:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.287+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d840d58f0 con 0x7f8d840d0cb0 2024-05-10T08:41:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.287+0000 7f8d6bfff640 1 -- 172.21.15.37:0/1078850959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d74003610 con 0x7f8d840d0cb0 2024-05-10T08:41:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.288+0000 7f8d6bfff640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d700762d0 0x7f8d70078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.288+0000 7f8d6bfff640 1 -- 172.21.15.37:0/1078850959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f8d740b8410 con 0x7f8d840d0cb0 2024-05-10T08:41:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.288+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d700762d0 0x7f8d70078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.289+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d700762d0 0x7f8d70078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8d841f8550 tx=0x7f8d78007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.292+0000 7f8d6bfff640 1 -- 172.21.15.37:0/1078850959 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8d840d58f0 con 0x7f8d840d0cb0 2024-05-10T08:41:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.486+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d840693f0 con 0x7f8d840d0cb0 2024-05-10T08:41:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.488+0000 7f8d6bfff640 1 -- 172.21.15.37:0/1078850959 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16895 (secure 0 0 0) 0x7f8d740814f0 con 0x7f8d840d0cb0 2024-05-10T08:41:04.487 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:04.488 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:03.495309+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:01.557859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:02.453059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d700762d0 msgr2=0x7f8d70078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d700762d0 0x7f8d70078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8d841f8550 tx=0x7f8d78007d50 comp rx=0 tx=0).stop 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d840d0cb0 msgr2=0x7f8d8414f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d840d0cb0 0x7f8d8414f500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d740046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 shutdown_connections 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d700762d0 0x7f8d70078790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d841629a0 0x7f8d840b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d840d2dc0 0x7f8d840b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 --2- 172.21.15.37:0/1078850959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d840d0cb0 0x7f8d8414f500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 >> 172.21.15.37:0/1078850959 conn(0x7f8d840d4fe0 msgr2=0x7f8d8406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 shutdown_connections 2024-05-10T08:41:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.490+0000 7f8d89e83640 1 -- 172.21.15.37:0/1078850959 wait complete. 2024-05-10T08:41:04.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:04.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.605+0000 7f69b2771640 1 Processor -- start 2024-05-10T08:41:04.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.605+0000 7f69b2771640 1 -- start start 2024-05-10T08:41:04.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69b2771640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 0x7f69ac15e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69b2771640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac15e550 con 0x7f69ac0b48a0 2024-05-10T08:41:04.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69b2771640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac0701d0 con 0x7f69ac06fc30 2024-05-10T08:41:04.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69b2771640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69ac0b3dc0 con 0x7f69ac157540 2024-05-10T08:41:04.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69b0d0e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f69ac0b48a0 0x7f69ac0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45884/0 (socket says 172.21.15.37:45884) 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69b0d0e640 1 -- 172.21.15.37:0/1896974355 learned_addr learned my addr 172.21.15.37:0/1896974355 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69abfff640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 0x7f69ac15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979704804 0 0) 0x7f69a4001490 con 0x7f69ac0b48a0 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6994003520 con 0x7f69ac0b48a0 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277702719 0 0) 0x7f69ac0701d0 con 0x7f69ac06fc30 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a4001490 con 0x7f69ac06fc30 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.606+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 865755333 0 0) 0x7f6994003520 con 0x7f69ac0b48a0 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 msgr2=0x7f69ac15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 0x7f69ac15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 >> v1:172.21.15.82:6789/0 conn(0x7f69ac06fc30 legacy=0x7f69ac0af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac0b40a0 con 0x7f69ac0b48a0 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f69a4001bc0 con 0x7f69ac0b48a0 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69abfff640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 0x7f69ac15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 >> v1:172.21.15.37:6789/0 conn(0x7f69ac0b48a0 legacy=0x7f69ac0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f6994003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 0x7f6994004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6994004d40 0x7f69940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac0b3dc0 con 0x7f6994003b70 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f699400ba70 con 0x7f6994004d40 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f699400bbf0 con 0x7f69ac157540 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69abfff640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f6994003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69b0d0e640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6994004d40 0x7f69940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69ab7fe640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 0x7f6994004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69abfff640 1 -- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 msgr2=0x7f6994004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69abfff640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac157540 0x7f6994004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69abfff640 1 -- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6994004d40 msgr2=0x7f69940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69abfff640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6994004d40 0x7f69940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.607+0000 7f69abfff640 1 -- 172.21.15.37:0/1896974355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6994003520 con 0x7f6994003b70 2024-05-10T08:41:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69abfff640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f6994003f70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f699c009cc0 tx=0x7f6994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ab67652375e148 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c036070 con 0x7f6994003b70 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c031400 con 0x7f6994003b70 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69aaffd640 1 -- 172.21.15.37:0/1896974355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c009860 con 0x7f6994003b70 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69b2771640 1 -- 172.21.15.37:0/1896974355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 msgr2=0x7f6994003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69b2771640 1 --2- 172.21.15.37:0/1896974355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f6994003f70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f699c009cc0 tx=0x7f6994005830 comp rx=0 tx=0).stop 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69b0d0e640 1 -- 172.21.15.37:0/1896974355 reap_dead start 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69b2771640 1 -- 172.21.15.37:0/1896974355 shutdown_connections 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69b2771640 1 -- 172.21.15.37:0/1896974355 >> 172.21.15.37:0/1896974355 conn(0x7f69ac06c3a0 msgr2=0x7f69ac06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.608+0000 7f69b2771640 1 -- 172.21.15.37:0/1896974355 shutdown_connections 2024-05-10T08:41:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.609+0000 7f69b2771640 1 -- 172.21.15.37:0/1896974355 wait complete. 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.610+0000 7f69b2771640 1 Processor -- start 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.610+0000 7f69b2771640 1 -- start start 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f69ac155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69ac0b1ab0 0x7f69ac0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac09dc10 0x7f69ac09e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac157aa0 con 0x7f6994003b70 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac157920 con 0x7f69ac0b1ab0 2024-05-10T08:41:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69ac0afe50 con 0x7f69ac09dc10 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f69ac155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f69ac155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36940/0 (socket says 172.21.15.37:36940) 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 -- 172.21.15.37:0/2993231005 learned_addr learned my addr 172.21.15.37:0/2993231005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69ab7fe640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69ac0b1ab0 0x7f69ac0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b0d0e640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac09dc10 0x7f69ac09e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 -- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac09dc10 msgr2=0x7f69ac09e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac09dc10 0x7f69ac09e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 -- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69ac0b1ab0 msgr2=0x7f69ac0b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69ac0b1ab0 0x7f69ac0b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 -- 172.21.15.37:0/2993231005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac0b33b0 con 0x7f6994003b70 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b0d0e640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac09dc10 0x7f69ac09e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69abfff640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f69ac155bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f699c009cc0 tx=0x7f699c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69a8ff9640 1 -- 172.21.15.37:0/2993231005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c041020 con 0x7f6994003b70 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69a8ff9640 1 -- 172.21.15.37:0/2993231005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c0093e0 con 0x7f6994003b70 2024-05-10T08:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac0b0a10 con 0x7f6994003b70 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69a8ff9640 1 -- 172.21.15.37:0/2993231005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c036040 con 0x7f6994003b70 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.611+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac0b0fd0 con 0x7f6994003b70 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.612+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ac0693f0 con 0x7f6994003b70 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.613+0000 7f69a8ff9640 1 -- 172.21.15.37:0/2993231005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f699c044020 con 0x7f6994003b70 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.613+0000 7f69a8ff9640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69980762d0 0x7f6998078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.614+0000 7f69a8ff9640 1 -- 172.21.15.37:0/2993231005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f699c0b7ab0 con 0x7f6994003b70 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.614+0000 7f69ab7fe640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69980762d0 0x7f6998078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.614+0000 7f69ab7fe640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69980762d0 0x7f6998078790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69ac1f5bb0 tx=0x7f69a0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.618+0000 7f69a8ff9640 1 -- 172.21.15.37:0/2993231005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f699c04b070 con 0x7f6994003b70 2024-05-10T08:41:04.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.814+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69ac0765b0 con 0x7f6994003b70 2024-05-10T08:41:04.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.815+0000 7f69a8ff9640 1 -- 172.21.15.37:0/2993231005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16895 (secure 0 0 0) 0x7f699c081280 con 0x7f6994003b70 2024-05-10T08:41:04.815 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:04.815 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:03.495309+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:01.557859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:02.453059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69980762d0 msgr2=0x7f6998078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69980762d0 0x7f6998078790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69ac1f5bb0 tx=0x7f69a0009040 comp rx=0 tx=0).stop 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 msgr2=0x7f69ac155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f69ac155bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f699c009cc0 tx=0x7f699c004730 comp rx=0 tx=0).stop 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 shutdown_connections 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69980762d0 0x7f6998078790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69ac09dc10 0x7f69ac09e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69ac0b1ab0 0x7f69ac0b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 --2- 172.21.15.37:0/2993231005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6994003b70 0x7f69ac155bf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 >> 172.21.15.37:0/2993231005 conn(0x7f69ac06c3a0 msgr2=0x7f69ac15d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 shutdown_connections 2024-05-10T08:41:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.818+0000 7f69b2771640 1 -- 172.21.15.37:0/2993231005 wait complete. 2024-05-10T08:41:04.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:41:04.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.937+0000 7fc4242c8640 1 Processor -- start 2024-05-10T08:41:04.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.937+0000 7fc4242c8640 1 -- start start 2024-05-10T08:41:04.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc4242c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc41c0b9080 0x7fc41c0d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc4242c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41c0d3320 con 0x7fc41c163460 2024-05-10T08:41:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc4242c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41c0d3600 con 0x7fc41c0b6590 2024-05-10T08:41:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc4242c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc41c0d38e0 con 0x7fc41c0b9080 2024-05-10T08:41:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421863640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc41c163460 0x7fc41c15ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45898/0 (socket says 172.21.15.37:45898) 2024-05-10T08:41:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421863640 1 -- 172.21.15.37:0/331692947 learned_addr learned my addr 172.21.15.37:0/331692947 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508125069 0 0) 0x7fc41c0d3320 con 0x7fc41c163460 2024-05-10T08:41:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc422865640 1 --2- 172.21.15.37:0/331692947 >> v2:172.21.15.82:3300/0 conn(0x7fc41c0b9080 0x7fc41c0d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc408003520 con 0x7fc41c163460 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1763832018 0 0) 0x7fc408003520 con 0x7fc41c163460 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 >> v2:172.21.15.82:3300/0 conn(0x7fc41c0b9080 msgr2=0x7fc41c0d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421062640 1 --2- 172.21.15.37:0/331692947 >> v2:172.21.15.82:3300/0 conn(0x7fc41c0b9080 0x7fc41c0d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.938+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 >> v1:172.21.15.82:6789/0 conn(0x7fc41c0b6590 legacy=0x7fc41c162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c0d3bc0 con 0x7fc41c163460 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fc40c001670 con 0x7fc41c163460 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 >> v1:172.21.15.37:6789/0 conn(0x7fc41c163460 legacy=0x7fc41c15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080039b0 0x7fc408003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc408004800 0x7fc408004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4080051c0 0x7fc40800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0d38e0 con 0x7fc408004800 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc40800c060 con 0x7fc4080039b0 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc40800c260 con 0x7fc4080051c0 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421863640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc408004800 0x7fc408004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc422064640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080039b0 0x7fc408003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc422865640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4080051c0 0x7fc40800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421863640 1 -- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4080051c0 msgr2=0x7fc40800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421863640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4080051c0 0x7fc40800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421863640 1 -- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080039b0 msgr2=0x7fc408003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421863640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080039b0 0x7fc408003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc422865640 1 -- 172.21.15.37:0/331692947 reap_dead start 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.939+0000 7fc421863640 1 -- 172.21.15.37:0/331692947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc408003520 con 0x7fc408004800 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.940+0000 7fc421863640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc408004800 0x7fc408004c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00c240 tx=0x7fc408005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e392e207f2d5e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.940+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c007cf0 con 0x7fc408004800 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.940+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c005af0 con 0x7fc408004800 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.940+0000 7fc421062640 1 -- 172.21.15.37:0/331692947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c007070 con 0x7fc408004800 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.940+0000 7fc4242c8640 1 -- 172.21.15.37:0/331692947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc408004800 msgr2=0x7fc408004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.940+0000 7fc4242c8640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc408004800 0x7fc408004c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00c240 tx=0x7fc408005830 comp rx=0 tx=0).stop 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.941+0000 7fc4242c8640 1 -- 172.21.15.37:0/331692947 shutdown_connections 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.941+0000 7fc4242c8640 1 --2- 172.21.15.37:0/331692947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc408004800 0x7fc408004c80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.941+0000 7fc4242c8640 1 -- 172.21.15.37:0/331692947 >> 172.21.15.37:0/331692947 conn(0x7fc41c0d4fe0 msgr2=0x7fc41c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.941+0000 7fc4242c8640 1 -- 172.21.15.37:0/331692947 shutdown_connections 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.941+0000 7fc4242c8640 1 -- 172.21.15.37:0/331692947 wait complete. 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.942+0000 7fc4242c8640 1 Processor -- start 2024-05-10T08:41:04.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.942+0000 7fc4242c8640 1 -- start start 2024-05-10T08:41:04.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.942+0000 7fc4242c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc408004800 0x7fc41c158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc4242c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc41c0ce260 0x7fc41c0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc4242c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc41c0cc0b0 0x7fc41c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc4242c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0d0d50 con 0x7fc41c0ce260 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc4242c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0d0bd0 con 0x7fc41c0cc0b0 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc4242c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c0d0ed0 con 0x7fc408004800 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc41c0ce260 0x7fc41c0ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc41c0ce260 0x7fc41c0ce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36964/0 (socket says 172.21.15.37:36964) 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 -- 172.21.15.37:0/2812620484 learned_addr learned my addr 172.21.15.37:0/2812620484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc422064640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc408004800 0x7fc41c158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc422865640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc41c0cc0b0 0x7fc41c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 -- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc408004800 msgr2=0x7fc41c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc408004800 0x7fc41c158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 -- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc41c0cc0b0 msgr2=0x7fc41c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc41c0cc0b0 0x7fc41c0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 -- 172.21.15.37:0/2812620484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c0cee20 con 0x7fc41c0ce260 2024-05-10T08:41:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc421863640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc41c0ce260 0x7fc41c0ce6e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc40c001970 tx=0x7fc41c0d37d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc412ffd640 1 -- 172.21.15.37:0/2812620484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c037040 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc412ffd640 1 -- 172.21.15.37:0/2812620484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c041070 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c0cf100 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc412ffd640 1 -- 172.21.15.37:0/2812620484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c001670 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.943+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c15d820 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.944+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41c0693f0 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.945+0000 7fc412ffd640 1 -- 172.21.15.37:0/2812620484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc40c004a00 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.945+0000 7fc412ffd640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4000762d0 0x7fc400078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.946+0000 7fc412ffd640 1 -- 172.21.15.37:0/2812620484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fc40c0b7410 con 0x7fc41c0ce260 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.946+0000 7fc422064640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4000762d0 0x7fc400078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:04.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.946+0000 7fc422064640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4000762d0 0x7fc400078790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc418000c00 tx=0x7fc418009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:04.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:04.950+0000 7fc412ffd640 1 -- 172.21.15.37:0/2812620484 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc40c080bd0 con 0x7fc41c0ce260 2024-05-10T08:41:05.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:05.183+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc41c0d14c0 con 0x7fc41c0ce260 2024-05-10T08:41:06.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.147+0000 7fc412ffd640 1 -- 172.21.15.37:0/2812620484 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc40c0804d0 con 0x7fc41c0ce260 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4000762d0 msgr2=0x7fc400078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4000762d0 0x7fc400078790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc418000c00 tx=0x7fc418009040 comp rx=0 tx=0).stop 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc41c0ce260 msgr2=0x7fc41c0ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc41c0ce260 0x7fc41c0ce6e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc40c001970 tx=0x7fc41c0d37d0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 shutdown_connections 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc4000762d0 0x7fc400078790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc41c0cc0b0 0x7fc41c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc41c0ce260 0x7fc41c0ce6e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 --2- 172.21.15.37:0/2812620484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc408004800 0x7fc41c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 >> 172.21.15.37:0/2812620484 conn(0x7fc41c0d4fe0 msgr2=0x7fc41c0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 shutdown_connections 2024-05-10T08:41:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.151+0000 7fc4242c8640 1 -- 172.21.15.37:0/2812620484 wait complete. 2024-05-10T08:41:06.164 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T08:41:06.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:41:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.278+0000 7feeb4546640 1 Processor -- start 2024-05-10T08:41:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.278+0000 7feeb4546640 1 -- start start 2024-05-10T08:41:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb4546640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feeac15f2d0 0x7feeac0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb4546640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb4546640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeac15f6b0 con 0x7feeac0d4f90 2024-05-10T08:41:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb4546640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7feeac0b51c0 con 0x7feeac15f2d0 2024-05-10T08:41:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb4546640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7feeac0b54a0 con 0x7feeac0d25f0 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb22e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feeac15f2d0 0x7feeac0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb2ae3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feeac0d4f90 0x7feeac0d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45906/0 (socket says 172.21.15.37:45906) 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb2ae3640 1 -- 172.21.15.37:0/3111693673 learned_addr learned my addr 172.21.15.37:0/3111693673 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.279+0000 7feeb1ae1640 1 --2- 172.21.15.37:0/3111693673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb22e2640 1 -- 172.21.15.37:0/3111693673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 msgr2=0x7feeac0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb22e2640 1 --2- 172.21.15.37:0/3111693673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb22e2640 1 -- 172.21.15.37:0/3111693673 >> v1:172.21.15.37:6789/0 conn(0x7feeac0d4f90 legacy=0x7feeac0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb12e0640 1 -- 172.21.15.37:0/3111693673 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624461640 0 0) 0x7feeac15f6b0 con 0x7feeac0d4f90 2024-05-10T08:41:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb22e2640 1 -- 172.21.15.37:0/3111693673 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac0b5780 con 0x7feeac15f2d0 2024-05-10T08:41:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb22e2640 1 --2- 172.21.15.37:0/3111693673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac0b5f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feea40097a0 tx=0x7feea402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adfb38ebd8c718e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb12e0640 1 -- 172.21.15.37:0/3111693673 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4037070 con 0x7feeac15f2d0 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb12e0640 1 -- 172.21.15.37:0/3111693673 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea402ae50 con 0x7feeac15f2d0 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.280+0000 7feeb12e0640 1 -- 172.21.15.37:0/3111693673 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4032660 con 0x7feeac15f2d0 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 -- 172.21.15.37:0/3111693673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 msgr2=0x7feeac0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 --2- 172.21.15.37:0/3111693673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac0b5f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feea40097a0 tx=0x7feea402a100 comp rx=0 tx=0).stop 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 -- 172.21.15.37:0/3111693673 shutdown_connections 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 --2- 172.21.15.37:0/3111693673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 --2- 172.21.15.37:0/3111693673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac0b5f80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 -- 172.21.15.37:0/3111693673 >> 172.21.15.37:0/3111693673 conn(0x7feeac0746d0 msgr2=0x7feeac09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 -- 172.21.15.37:0/3111693673 shutdown_connections 2024-05-10T08:41:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.281+0000 7feeb4546640 1 -- 172.21.15.37:0/3111693673 wait complete. 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.282+0000 7feeb4546640 1 Processor -- start 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.282+0000 7feeb4546640 1 -- start start 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb4546640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb4546640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac0d4f90 0x7feeac0cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb4546640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb4546640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feeac0d0d40 con 0x7feeac15f2d0 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb4546640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feeac0b64c0 con 0x7feeac0d4f90 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb4546640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7feeac0d0ec0 con 0x7feeac0d25f0 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb2ae3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb2ae3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36974/0 (socket says 172.21.15.37:36974) 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb2ae3640 1 -- 172.21.15.37:0/3872682129 learned_addr learned my addr 172.21.15.37:0/3872682129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.283+0000 7feeb22e2640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb1ae1640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac0d4f90 0x7feeac0cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb2ae3640 1 -- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 msgr2=0x7feeac161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb2ae3640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb2ae3640 1 -- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac0d4f90 msgr2=0x7feeac0cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb2ae3640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac0d4f90 0x7feeac0cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb2ae3640 1 -- 172.21.15.37:0/3872682129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac1606a0 con 0x7feeac15f2d0 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb1ae1640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac0d4f90 0x7feeac0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb2ae3640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac153180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c700 tx=0x7fee9c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeaaffd640 1 -- 172.21.15.37:0/3872682129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c018070 con 0x7feeac15f2d0 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeaaffd640 1 -- 172.21.15.37:0/3872682129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c00ce10 con 0x7feeac15f2d0 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac160940 con 0x7feeac15f2d0 2024-05-10T08:41:06.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeaaffd640 1 -- 172.21.15.37:0/3872682129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00a860 con 0x7feeac15f2d0 2024-05-10T08:41:06.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.284+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac0ce120 con 0x7feeac15f2d0 2024-05-10T08:41:06.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.285+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeac069b00 con 0x7feeac15f2d0 2024-05-10T08:41:06.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.286+0000 7feeaaffd640 1 -- 172.21.15.37:0/3872682129 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee9c01b070 con 0x7feeac15f2d0 2024-05-10T08:41:06.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.286+0000 7feeaaffd640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee980762d0 0x7fee98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.286+0000 7feeaaffd640 1 -- 172.21.15.37:0/3872682129 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fee9c096c20 con 0x7feeac15f2d0 2024-05-10T08:41:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.286+0000 7feeb22e2640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee980762d0 0x7fee98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.287+0000 7feeb22e2640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee980762d0 0x7fee98078790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feea4034000 tx=0x7feea402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.291+0000 7feeaaffd640 1 -- 172.21.15.37:0/3872682129 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fee9c05fe30 con 0x7feeac15f2d0 2024-05-10T08:41:06.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:06.522+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feeac0b4c40 con 0x7feeac15f2d0 2024-05-10T08:41:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.149+0000 7feeaaffd640 1 -- 172.21.15.37:0/3872682129 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fee9c064130 con 0x7feeac15f2d0 2024-05-10T08:41:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.151+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee980762d0 msgr2=0x7fee98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.151+0000 7feeb4546640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee980762d0 0x7fee98078790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feea4034000 tx=0x7feea402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 msgr2=0x7feeac153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac153180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c700 tx=0x7fee9c00cbc0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 shutdown_connections 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee980762d0 0x7fee98078790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeac15f2d0 0x7feeac153180 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac0d4f90 0x7feeac0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 --2- 172.21.15.37:0/3872682129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeac0d25f0 0x7feeac161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 >> 172.21.15.37:0/3872682129 conn(0x7feeac0746d0 msgr2=0x7feeac0d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 shutdown_connections 2024-05-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.152+0000 7feeb4546640 1 -- 172.21.15.37:0/3872682129 wait complete. 2024-05-10T08:41:07.165 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:41:07.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:07.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.276+0000 7fce29a6b640 1 Processor -- start 2024-05-10T08:41:07.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.276+0000 7fce29a6b640 1 -- start start 2024-05-10T08:41:07.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce29a6b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fce2415f380 0x7fce240d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce29a6b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce240d0cf0 0x7fce240d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce29a6b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce240d1760 con 0x7fce240d3b00 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce29a6b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fce240d30f0 con 0x7fce2415f380 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce29a6b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fce240d3f50 con 0x7fce240d0cf0 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce237fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fce2415f380 0x7fce240d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce237fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fce2415f380 0x7fce240d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36976/0 (socket says 172.21.15.37:36976) 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce237fe640 1 -- 172.21.15.37:0/2783009506 learned_addr learned my addr 172.21.15.37:0/2783009506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce22ffd640 1 --2- 172.21.15.37:0/2783009506 >> v2:172.21.15.82:3300/0 conn(0x7fce240d0cf0 0x7fce240d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce237fe640 1 -- 172.21.15.37:0/2783009506 >> v2:172.21.15.82:3300/0 conn(0x7fce240d0cf0 msgr2=0x7fce240d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce237fe640 1 --2- 172.21.15.37:0/2783009506 >> v2:172.21.15.82:3300/0 conn(0x7fce240d0cf0 0x7fce240d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce237fe640 1 -- 172.21.15.37:0/2783009506 >> v1:172.21.15.82:6789/0 conn(0x7fce240d3b00 legacy=0x7fce24162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce237fe640 1 -- 172.21.15.37:0/2783009506 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce240d1a40 con 0x7fce2415f380 2024-05-10T08:41:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.277+0000 7fce22ffd640 1 --2- 172.21.15.37:0/2783009506 >> v2:172.21.15.82:3300/0 conn(0x7fce240d0cf0 0x7fce240d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.278+0000 7fce237fe640 1 --2- 172.21.15.37:0/2783009506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2415f380 0x7fce240d07b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce240b7b00 tx=0x7fce1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78581e23e0e6e618 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.278+0000 7fce227fc640 1 -- 172.21.15.37:0/2783009506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14037070 con 0x7fce2415f380 2024-05-10T08:41:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.278+0000 7fce227fc640 1 -- 172.21.15.37:0/2783009506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce14032440 con 0x7fce2415f380 2024-05-10T08:41:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.278+0000 7fce227fc640 1 -- 172.21.15.37:0/2783009506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14032810 con 0x7fce2415f380 2024-05-10T08:41:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 -- 172.21.15.37:0/2783009506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2415f380 msgr2=0x7fce240d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 --2- 172.21.15.37:0/2783009506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2415f380 0x7fce240d07b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce240b7b00 tx=0x7fce1402a270 comp rx=0 tx=0).stop 2024-05-10T08:41:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 -- 172.21.15.37:0/2783009506 shutdown_connections 2024-05-10T08:41:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 --2- 172.21.15.37:0/2783009506 >> v2:172.21.15.82:3300/0 conn(0x7fce240d0cf0 0x7fce240d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 --2- 172.21.15.37:0/2783009506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2415f380 0x7fce240d07b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 -- 172.21.15.37:0/2783009506 >> 172.21.15.37:0/2783009506 conn(0x7fce240d4fe0 msgr2=0x7fce240d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 -- 172.21.15.37:0/2783009506 shutdown_connections 2024-05-10T08:41:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.279+0000 7fce29a6b640 1 -- 172.21.15.37:0/2783009506 wait complete. 2024-05-10T08:41:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.280+0000 7fce29a6b640 1 Processor -- start 2024-05-10T08:41:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.280+0000 7fce29a6b640 1 -- start start 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce29a6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240d0cf0 0x7fce240c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce29a6b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce240d3b00 0x7fce2415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce29a6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce2415f380 0x7fce2415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce29a6b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce240b8e40 con 0x7fce240d0cf0 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce29a6b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce240d2370 con 0x7fce2415f380 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce29a6b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fce240d2000 con 0x7fce240d3b00 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240d0cf0 0x7fce240c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240d0cf0 0x7fce240c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36990/0 (socket says 172.21.15.37:36990) 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 -- 172.21.15.37:0/3072080524 learned_addr learned my addr 172.21.15.37:0/3072080524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce22ffd640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce240d3b00 0x7fce2415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce23fff640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce2415f380 0x7fce2415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 -- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce240d3b00 msgr2=0x7fce2415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce240d3b00 0x7fce2415aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 -- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce2415f380 msgr2=0x7fce2415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce2415f380 0x7fce2415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce237fe640 1 -- 172.21.15.37:0/3072080524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce240cb330 con 0x7fce240d0cf0 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.281+0000 7fce23fff640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce2415f380 0x7fce2415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.282+0000 7fce237fe640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240d0cf0 0x7fce240c76e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce1402a2b0 tx=0x7fce140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.282+0000 7fce0bfff640 1 -- 172.21.15.37:0/3072080524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14041020 con 0x7fce240d0cf0 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.282+0000 7fce0bfff640 1 -- 172.21.15.37:0/3072080524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce140306c0 con 0x7fce240d0cf0 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.282+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce240ca290 con 0x7fce240d0cf0 2024-05-10T08:41:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.282+0000 7fce0bfff640 1 -- 172.21.15.37:0/3072080524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14037040 con 0x7fce240d0cf0 2024-05-10T08:41:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.282+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce240ca850 con 0x7fce240d0cf0 2024-05-10T08:41:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.283+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce240d4310 con 0x7fce240d0cf0 2024-05-10T08:41:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.284+0000 7fce0bfff640 1 -- 172.21.15.37:0/3072080524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce14044020 con 0x7fce240d0cf0 2024-05-10T08:41:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.284+0000 7fce0bfff640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce100762d0 0x7fce10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.284+0000 7fce0bfff640 1 -- 172.21.15.37:0/3072080524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fce140b8040 con 0x7fce240d0cf0 2024-05-10T08:41:07.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.284+0000 7fce22ffd640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce100762d0 0x7fce10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.285+0000 7fce22ffd640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce100762d0 0x7fce10078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce240cbbe0 tx=0x7fce18008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.288+0000 7fce0bfff640 1 -- 172.21.15.37:0/3072080524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fce240d4310 con 0x7fce240d0cf0 2024-05-10T08:41:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.517+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce2408cfd0 con 0x7fce240d0cf0 2024-05-10T08:41:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.517+0000 7fce0bfff640 1 -- 172.21.15.37:0/3072080524 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7fce140a2020 con 0x7fce240d0cf0 2024-05-10T08:41:07.517 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:07.517 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.519+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce100762d0 msgr2=0x7fce10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.519+0000 7fce29a6b640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce100762d0 0x7fce10078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce240cbbe0 tx=0x7fce18008040 comp rx=0 tx=0).stop 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.519+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240d0cf0 msgr2=0x7fce240c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.519+0000 7fce29a6b640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240d0cf0 0x7fce240c76e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce1402a2b0 tx=0x7fce140046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 shutdown_connections 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce100762d0 0x7fce10078790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce2415f380 0x7fce2415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce240d3b00 0x7fce2415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 --2- 172.21.15.37:0/3072080524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240d0cf0 0x7fce240c76e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 >> 172.21.15.37:0/3072080524 conn(0x7fce240d4fe0 msgr2=0x7fce2406ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 shutdown_connections 2024-05-10T08:41:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.520+0000 7fce29a6b640 1 -- 172.21.15.37:0/3072080524 wait complete. 2024-05-10T08:41:07.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.635+0000 7ff3c8c72640 1 Processor -- start 2024-05-10T08:41:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.635+0000 7ff3c8c72640 1 -- start start 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.635+0000 7ff3c8c72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3c40d1970 0x7ff3c40d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.635+0000 7ff3c8c72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d4cc0 0x7ff3c40d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c8c72640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c41630b0 con 0x7ff3c415f420 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c8c72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c40d3e70 con 0x7ff3c40d1970 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c8c72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40d5670 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff3c415f420 0x7ff3c40d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45920/0 (socket says 172.21.15.37:45920) 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c259c640 1 -- 172.21.15.37:0/4174499013 learned_addr learned my addr 172.21.15.37:0/4174499013 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c2d9d640 1 --2- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d4cc0 0x7ff3c40d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c1d9b640 1 --2- 172.21.15.37:0/4174499013 >> v2:172.21.15.82:3300/0 conn(0x7ff3c40d1970 0x7ff3c40d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c159a640 1 -- 172.21.15.37:0/4174499013 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586661092 0 0) 0x7ff3bc001110 con 0x7ff3c415f420 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c159a640 1 -- 172.21.15.37:0/4174499013 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3b0003520 con 0x7ff3c415f420 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c159a640 1 -- 172.21.15.37:0/4174499013 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2280842943 0 0) 0x7ff3b0003520 con 0x7ff3c415f420 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c1d9b640 1 -- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d4cc0 msgr2=0x7ff3c40d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c1d9b640 1 --2- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d4cc0 0x7ff3c40d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c1d9b640 1 -- 172.21.15.37:0/4174499013 >> v1:172.21.15.37:6789/0 conn(0x7ff3c415f420 legacy=0x7ff3c40d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c1d9b640 1 -- 172.21.15.37:0/4174499013 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40d2550 con 0x7ff3c40d1970 2024-05-10T08:41:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.636+0000 7ff3c2d9d640 1 --2- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d4cc0 0x7ff3c40d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.637+0000 7ff3c1d9b640 1 --2- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c40d1970 0x7ff3c40d1e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0097a0 tx=0x7ff3ac02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c297c7aaeb0f4ee0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.637+0000 7ff3c159a640 1 -- 172.21.15.37:0/4174499013 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac037070 con 0x7ff3c40d1970 2024-05-10T08:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.637+0000 7ff3c159a640 1 -- 172.21.15.37:0/4174499013 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac02aba0 con 0x7ff3c40d1970 2024-05-10T08:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.637+0000 7ff3c159a640 1 -- 172.21.15.37:0/4174499013 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc001860 con 0x7ff3c40d1970 2024-05-10T08:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 -- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c40d1970 msgr2=0x7ff3c40d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c40d1970 0x7ff3c40d1e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0097a0 tx=0x7ff3ac02a110 comp rx=0 tx=0).stop 2024-05-10T08:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 -- 172.21.15.37:0/4174499013 shutdown_connections 2024-05-10T08:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d4cc0 0x7ff3c40d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/4174499013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c40d1970 0x7ff3c40d1e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 -- 172.21.15.37:0/4174499013 >> 172.21.15.37:0/4174499013 conn(0x7ff3c408eac0 msgr2=0x7ff3c409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 -- 172.21.15.37:0/4174499013 shutdown_connections 2024-05-10T08:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.638+0000 7ff3c8c72640 1 -- 172.21.15.37:0/4174499013 wait complete. 2024-05-10T08:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.639+0000 7ff3c8c72640 1 Processor -- start 2024-05-10T08:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.639+0000 7ff3c8c72640 1 -- start start 2024-05-10T08:41:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c8c72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d1970 0x7ff3c4161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c8c72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3c40d4cc0 0x7ff3c40cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c8c72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c41550f0 0x7ff3c40b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c8c72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40d3240 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c8c72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40d2f60 con 0x7ff3c41550f0 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c8c72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40d2830 con 0x7ff3c40d1970 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3c40d4cc0 0x7ff3c40cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3c40d4cc0 0x7ff3c40cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37004/0 (socket says 172.21.15.37:37004) 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c1d9b640 1 -- 172.21.15.37:0/3550755417 learned_addr learned my addr 172.21.15.37:0/3550755417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c2d9d640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c41550f0 0x7ff3c40b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c259c640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d1970 0x7ff3c4161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c1d9b640 1 -- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d1970 msgr2=0x7ff3c4161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c1d9b640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d1970 0x7ff3c4161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c1d9b640 1 -- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c41550f0 msgr2=0x7ff3c40b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.640+0000 7ff3c1d9b640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c41550f0 0x7ff3c40b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3c1d9b640 1 -- 172.21.15.37:0/3550755417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c4161850 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3c259c640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d1970 0x7ff3c4161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3c1d9b640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3c40d4cc0 0x7ff3c40cb4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0098c0 tx=0x7ff3ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3baffd640 1 -- 172.21.15.37:0/3550755417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac037050 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3baffd640 1 -- 172.21.15.37:0/3550755417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac043070 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3baffd640 1 -- 172.21.15.37:0/3550755417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac006e10 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c4161b30 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.641+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c41620f0 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.642+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c40693f0 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.642+0000 7ff3baffd640 1 -- 172.21.15.37:0/3550755417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff3ac048460 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.643+0000 7ff3baffd640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a4076300 0x7ff3a40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.643+0000 7ff3baffd640 1 -- 172.21.15.37:0/3550755417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff3ac0b7ea0 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.643+0000 7ff3c259c640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a4076300 0x7ff3a40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.644+0000 7ff3c259c640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a4076300 0x7ff3a40787c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc001eb0 tx=0x7ff3bc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.648+0000 7ff3baffd640 1 -- 172.21.15.37:0/3550755417 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff3ac081700 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.840+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3c40b4c50 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.841+0000 7ff3baffd640 1 -- 172.21.15.37:0/3550755417 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16882 (secure 0 0 0) 0x7ff3ac081000 con 0x7ff3c40d4cc0 2024-05-10T08:41:07.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:07.841 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:05.124192+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:01.557859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:02.453059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a4076300 msgr2=0x7ff3a40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a4076300 0x7ff3a40787c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc001eb0 tx=0x7ff3bc009040 comp rx=0 tx=0).stop 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3c40d4cc0 msgr2=0x7ff3c40cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3c40d4cc0 0x7ff3c40cb4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0098c0 tx=0x7ff3ac0046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 shutdown_connections 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff3a4076300 0x7ff3a40787c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3c41550f0 0x7ff3c40b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3c40d4cc0 0x7ff3c40cb4c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 --2- 172.21.15.37:0/3550755417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3c40d1970 0x7ff3c4161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 >> 172.21.15.37:0/3550755417 conn(0x7ff3c408eac0 msgr2=0x7ff3c4163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 shutdown_connections 2024-05-10T08:41:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.843+0000 7ff3c8c72640 1 -- 172.21.15.37:0/3550755417 wait complete. 2024-05-10T08:41:07.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:41:07.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:41:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.958+0000 7f1a2d89c640 1 Processor -- start 2024-05-10T08:41:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.958+0000 7f1a2d89c640 1 -- start start 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a2d89c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a281629b0 0x7f1a2806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a2d89c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2806e110 con 0x7f1a28070d20 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a2d89c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2806e3f0 con 0x7f1a280b2490 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a2d89c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1a28070a40 con 0x7f1a281629b0 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a26ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a281629b0 0x7f1a2806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a277fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a28070d20 0x7f1a280afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52886/0 (socket says 172.21.15.37:52886) 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a277fe640 1 -- 172.21.15.37:0/813873317 learned_addr learned my addr 172.21.15.37:0/813873317 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a26ffd640 1 -- 172.21.15.37:0/813873317 >> v1:172.21.15.82:6789/0 conn(0x7f1a280b2490 legacy=0x7f1a28070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a25ffb640 1 -- 172.21.15.37:0/813873317 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2733933293 0 0) 0x7f1a2806e110 con 0x7f1a28070d20 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a26ffd640 1 -- 172.21.15.37:0/813873317 >> v1:172.21.15.37:6789/0 conn(0x7f1a28070d20 legacy=0x7f1a280afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.959+0000 7f1a26ffd640 1 -- 172.21.15.37:0/813873317 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2806e6d0 con 0x7f1a281629b0 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.960+0000 7f1a26ffd640 1 --2- 172.21.15.37:0/813873317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a2806eed0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009d90 tx=0x7f1a2002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01fece0df74aff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.960+0000 7f1a25ffb640 1 -- 172.21.15.37:0/813873317 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20007740 con 0x7f1a281629b0 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.960+0000 7f1a25ffb640 1 -- 172.21.15.37:0/813873317 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a200078e0 con 0x7f1a281629b0 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.960+0000 7f1a25ffb640 1 -- 172.21.15.37:0/813873317 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20007cb0 con 0x7f1a281629b0 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.961+0000 7f1a2d89c640 1 -- 172.21.15.37:0/813873317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 msgr2=0x7f1a2806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.961+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/813873317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a2806eed0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009d90 tx=0x7f1a2002a6f0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.961+0000 7f1a2d89c640 1 -- 172.21.15.37:0/813873317 shutdown_connections 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.961+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/813873317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a2806eed0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.961+0000 7f1a2d89c640 1 -- 172.21.15.37:0/813873317 >> 172.21.15.37:0/813873317 conn(0x7f1a280b49d0 msgr2=0x7f1a280b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.961+0000 7f1a2d89c640 1 -- 172.21.15.37:0/813873317 shutdown_connections 2024-05-10T08:41:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.961+0000 7f1a2d89c640 1 -- 172.21.15.37:0/813873317 wait complete. 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.962+0000 7f1a2d89c640 1 Processor -- start 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.962+0000 7f1a2d89c640 1 -- start start 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a2d89c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a28070d20 0x7f1a280cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a2d89c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a280b2490 0x7f1a281594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a2d89c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a280d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a2d89c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2806f410 con 0x7f1a281629b0 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a2d89c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2806dec0 con 0x7f1a28070d20 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a2d89c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a280b03c0 con 0x7f1a280b2490 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a280d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a280d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41400/0 (socket says 172.21.15.37:41400) 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 -- 172.21.15.37:0/3813060321 learned_addr learned my addr 172.21.15.37:0/3813060321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a26ffd640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a28070d20 0x7f1a280cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a267fc640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a280b2490 0x7f1a281594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 -- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a280b2490 msgr2=0x7f1a281594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a280b2490 0x7f1a281594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 -- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a28070d20 msgr2=0x7f1a280cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a28070d20 0x7f1a280cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a277fe640 1 -- 172.21.15.37:0/3813060321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a280cd9c0 con 0x7f1a281629b0 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.963+0000 7f1a26ffd640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a28070d20 0x7f1a280cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.964+0000 7f1a277fe640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a280d2650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c450 tx=0x7f1a1800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.964+0000 7f1a1ffff640 1 -- 172.21.15.37:0/3813060321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18018070 con 0x7f1a281629b0 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.964+0000 7f1a1ffff640 1 -- 172.21.15.37:0/3813060321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a18007500 con 0x7f1a281629b0 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.964+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a280cdd00 con 0x7f1a281629b0 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.964+0000 7f1a1ffff640 1 -- 172.21.15.37:0/3813060321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18004a20 con 0x7f1a281629b0 2024-05-10T08:41:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.964+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a280ce540 con 0x7f1a281629b0 2024-05-10T08:41:07.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.965+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a280ce740 con 0x7f1a281629b0 2024-05-10T08:41:07.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.965+0000 7f1a1ffff640 1 -- 172.21.15.37:0/3813060321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a1801b070 con 0x7f1a281629b0 2024-05-10T08:41:07.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.966+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a080762d0 0x7f1a08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:07.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.966+0000 7f1a1ffff640 1 -- 172.21.15.37:0/3813060321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f1a18096990 con 0x7f1a281629b0 2024-05-10T08:41:07.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.966+0000 7f1a26ffd640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a080762d0 0x7f1a08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:07.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.967+0000 7f1a26ffd640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a080762d0 0x7f1a08078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a20034000 tx=0x7f1a20033040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:07.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:07.971+0000 7f1a1ffff640 1 -- 172.21.15.37:0/3813060321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1a280cdd00 con 0x7f1a281629b0 2024-05-10T08:41:08.091 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:41:08.091+0000 7f4d3afe4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:41:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.160+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a280cdee0 con 0x7f1a080762d0 2024-05-10T08:41:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.167+0000 7f1a1ffff640 1 -- 172.21.15.37:0/3813060321 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7f1a280cdee0 con 0x7f1a080762d0 2024-05-10T08:41:08.169 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a080762d0 msgr2=0x7f1a08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a080762d0 0x7f1a08078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a20034000 tx=0x7f1a20033040 comp rx=0 tx=0).stop 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 msgr2=0x7f1a280d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a280d2650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c450 tx=0x7f1a1800c910 comp rx=0 tx=0).stop 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 shutdown_connections 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a080762d0 0x7f1a08078790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a281629b0 0x7f1a280d2650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a280b2490 0x7f1a281594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 --2- 172.21.15.37:0/3813060321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a28070d20 0x7f1a280cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 >> 172.21.15.37:0/3813060321 conn(0x7f1a280b49d0 msgr2=0x7f1a280b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 shutdown_connections 2024-05-10T08:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.170+0000 7f1a2d89c640 1 -- 172.21.15.37:0/3813060321 wait complete. 2024-05-10T08:41:08.180 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-05-10T08:41:07.336199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220676,"kb_used_data":4468,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754044,"statfs":{"total":773094113280,"available":772868141056,"internally_reserved":0,"allocated":4575232,"data_stored":2595208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.225791"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133266+0000","last_change":"2024-05-10T08:41:04.150684+0000","last_active":"2024-05-10T08:41:05.133266+0000","last_peered":"2024-05-10T08:41:05.133266+0000","last_clean":"2024-05-10T08:41:05.133266+0000","last_became_active":"2024-05-10T08:41:04.150374+0000","last_became_peered":"2024-05-10T08:41:04.150374+0000","last_unstale":"2024-05-10T08:41:05.133266+0000","last_undegraded":"2024-05-10T08:41:05.133266+0000","last_fullsized":"2024-05-10T08:41:05.133266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:14.919064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133160+0000","last_change":"2024-05-10T08:41:04.142397+0000","last_active":"2024-05-10T08:41:05.133160+0000","last_peered":"2024-05-10T08:41:05.133160+0000","last_clean":"2024-05-10T08:41:05.133160+0000","last_became_active":"2024-05-10T08:41:04.142101+0000","last_became_peered":"2024-05-10T08:41:04.142101+0000","last_unstale":"2024-05-10T08:41:05.133160+0000","last_undegraded":"2024-05-10T08:41:05.133160+0000","last_fullsized":"2024-05-10T08:41:05.133160+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:45.026606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137100+0000","last_change":"2024-05-10T08:41:04.155940+0000","last_active":"2024-05-10T08:41:05.137100+0000","last_peered":"2024-05-10T08:41:05.137100+0000","last_clean":"2024-05-10T08:41:05.137100+0000","last_became_active":"2024-05-10T08:41:04.155650+0000","last_became_peered":"2024-05-10T08:41:04.155650+0000","last_unstale":"2024-05-10T08:41:05.137100+0000","last_undegraded":"2024-05-10T08:41:05.137100+0000","last_fullsized":"2024-05-10T08:41:05.137100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:05:55.029926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127630+0000","last_change":"2024-05-10T08:41:04.142837+0000","last_active":"2024-05-10T08:41:05.127630+0000","last_peered":"2024-05-10T08:41:05.127630+0000","last_clean":"2024-05-10T08:41:05.127630+0000","last_became_active":"2024-05-10T08:41:04.141945+0000","last_became_peered":"2024-05-10T08:41:04.141945+0000","last_unstale":"2024-05-10T08:41:05.127630+0000","last_undegraded":"2024-05-10T08:41:05.127630+0000","last_fullsized":"2024-05-10T08:41:05.127630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:14.334583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127644+0000","last_change":"2024-05-10T08:41:04.144520+0000","last_active":"2024-05-10T08:41:05.127644+0000","last_peered":"2024-05-10T08:41:05.127644+0000","last_clean":"2024-05-10T08:41:05.127644+0000","last_became_active":"2024-05-10T08:41:04.144069+0000","last_became_peered":"2024-05-10T08:41:04.144069+0000","last_unstale":"2024-05-10T08:41:05.127644+0000","last_undegraded":"2024-05-10T08:41:05.127644+0000","last_fullsized":"2024-05-10T08:41:05.127644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:22.389379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147439+0000","last_change":"2024-05-10T08:41:04.137419+0000","last_active":"2024-05-10T08:41:04.147439+0000","last_peered":"2024-05-10T08:41:04.147439+0000","last_clean":"2024-05-10T08:41:04.147439+0000","last_became_active":"2024-05-10T08:41:04.137121+0000","last_became_peered":"2024-05-10T08:41:04.137121+0000","last_unstale":"2024-05-10T08:41:04.147439+0000","last_undegraded":"2024-05-10T08:41:04.147439+0000","last_fullsized":"2024-05-10T08:41:04.147439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:49.363316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132736+0000","last_change":"2024-05-10T08:41:04.153439+0000","last_active":"2024-05-10T08:41:05.132736+0000","last_peered":"2024-05-10T08:41:05.132736+0000","last_clean":"2024-05-10T08:41:05.132736+0000","last_became_active":"2024-05-10T08:41:04.153153+0000","last_became_peered":"2024-05-10T08:41:04.153153+0000","last_unstale":"2024-05-10T08:41:05.132736+0000","last_undegraded":"2024-05-10T08:41:05.132736+0000","last_fullsized":"2024-05-10T08:41:05.132736+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:19.608972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132687+0000","last_change":"2024-05-10T08:41:04.147518+0000","last_active":"2024-05-10T08:41:05.132687+0000","last_peered":"2024-05-10T08:41:05.132687+0000","last_clean":"2024-05-10T08:41:05.132687+0000","last_became_active":"2024-05-10T08:41:04.147203+0000","last_became_peered":"2024-05-10T08:41:04.147203+0000","last_unstale":"2024-05-10T08:41:05.132687+0000","last_undegraded":"2024-05-10T08:41:05.132687+0000","last_fullsized":"2024-05-10T08:41:05.132687+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:38.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137381+0000","last_change":"2024-05-10T08:41:04.155651+0000","last_active":"2024-05-10T08:41:05.137381+0000","last_peered":"2024-05-10T08:41:05.137381+0000","last_clean":"2024-05-10T08:41:05.137381+0000","last_became_active":"2024-05-10T08:41:04.155362+0000","last_became_peered":"2024-05-10T08:41:04.155362+0000","last_unstale":"2024-05-10T08:41:05.137381+0000","last_undegraded":"2024-05-10T08:41:05.137381+0000","last_fullsized":"2024-05-10T08:41:05.137381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:37.953978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133000+0000","last_change":"2024-05-10T08:41:04.149544+0000","last_active":"2024-05-10T08:41:05.133000+0000","last_peered":"2024-05-10T08:41:05.133000+0000","last_clean":"2024-05-10T08:41:05.133000+0000","last_became_active":"2024-05-10T08:41:04.146890+0000","last_became_peered":"2024-05-10T08:41:04.146890+0000","last_unstale":"2024-05-10T08:41:05.133000+0000","last_undegraded":"2024-05-10T08:41:05.133000+0000","last_fullsized":"2024-05-10T08:41:05.133000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:38.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132986+0000","last_change":"2024-05-10T08:41:04.150366+0000","last_active":"2024-05-10T08:41:05.132986+0000","last_peered":"2024-05-10T08:41:05.132986+0000","last_clean":"2024-05-10T08:41:05.132986+0000","last_became_active":"2024-05-10T08:41:04.147812+0000","last_became_peered":"2024-05-10T08:41:04.147812+0000","last_unstale":"2024-05-10T08:41:05.132986+0000","last_undegraded":"2024-05-10T08:41:05.132986+0000","last_fullsized":"2024-05-10T08:41:05.132986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:41:51.313547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137052+0000","last_change":"2024-05-10T08:41:04.150497+0000","last_active":"2024-05-10T08:41:05.137052+0000","last_peered":"2024-05-10T08:41:05.137052+0000","last_clean":"2024-05-10T08:41:05.137052+0000","last_became_active":"2024-05-10T08:41:04.150147+0000","last_became_peered":"2024-05-10T08:41:04.150147+0000","last_unstale":"2024-05-10T08:41:05.137052+0000","last_undegraded":"2024-05-10T08:41:05.137052+0000","last_fullsized":"2024-05-10T08:41:05.137052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:57.286585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132712+0000","last_change":"2024-05-10T08:41:04.150376+0000","last_active":"2024-05-10T08:41:05.132712+0000","last_peered":"2024-05-10T08:41:05.132712+0000","last_clean":"2024-05-10T08:41:05.132712+0000","last_became_active":"2024-05-10T08:41:04.147340+0000","last_became_peered":"2024-05-10T08:41:04.147340+0000","last_unstale":"2024-05-10T08:41:05.132712+0000","last_undegraded":"2024-05-10T08:41:05.132712+0000","last_fullsized":"2024-05-10T08:41:05.132712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:49.606339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144447+0000","last_change":"2024-05-10T08:41:04.140644+0000","last_active":"2024-05-10T08:41:04.144447+0000","last_peered":"2024-05-10T08:41:04.144447+0000","last_clean":"2024-05-10T08:41:04.144447+0000","last_became_active":"2024-05-10T08:41:04.139648+0000","last_became_peered":"2024-05-10T08:41:04.139648+0000","last_unstale":"2024-05-10T08:41:04.144447+0000","last_undegraded":"2024-05-10T08:41:04.144447+0000","last_fullsized":"2024-05-10T08:41:04.144447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:45.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132552+0000","last_change":"2024-05-10T08:41:04.150231+0000","last_active":"2024-05-10T08:41:05.132552+0000","last_peered":"2024-05-10T08:41:05.132552+0000","last_clean":"2024-05-10T08:41:05.132552+0000","last_became_active":"2024-05-10T08:41:04.149950+0000","last_became_peered":"2024-05-10T08:41:04.149950+0000","last_unstale":"2024-05-10T08:41:05.132552+0000","last_undegraded":"2024-05-10T08:41:05.132552+0000","last_fullsized":"2024-05-10T08:41:05.132552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:48:35.229933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.151062+0000","last_change":"2024-05-10T08:41:04.148505+0000","last_active":"2024-05-10T08:41:04.151062+0000","last_peered":"2024-05-10T08:41:04.151062+0000","last_clean":"2024-05-10T08:41:04.151062+0000","last_became_active":"2024-05-10T08:41:04.148156+0000","last_became_peered":"2024-05-10T08:41:04.148156+0000","last_unstale":"2024-05-10T08:41:04.151062+0000","last_undegraded":"2024-05-10T08:41:04.151062+0000","last_fullsized":"2024-05-10T08:41:04.151062+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:13.276597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158697+0000","last_change":"2024-05-10T08:41:04.154284+0000","last_active":"2024-05-10T08:41:04.158697+0000","last_peered":"2024-05-10T08:41:04.158697+0000","last_clean":"2024-05-10T08:41:04.158697+0000","last_became_active":"2024-05-10T08:41:04.153990+0000","last_became_peered":"2024-05-10T08:41:04.153990+0000","last_unstale":"2024-05-10T08:41:04.158697+0000","last_undegraded":"2024-05-10T08:41:04.158697+0000","last_fullsized":"2024-05-10T08:41:04.158697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:49.313394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.146111+0000","last_change":"2024-05-10T08:41:04.145162+0000","last_active":"2024-05-10T08:41:04.146111+0000","last_peered":"2024-05-10T08:41:04.146111+0000","last_clean":"2024-05-10T08:41:04.146111+0000","last_became_active":"2024-05-10T08:41:04.144896+0000","last_became_peered":"2024-05-10T08:41:04.144896+0000","last_unstale":"2024-05-10T08:41:04.146111+0000","last_undegraded":"2024-05-10T08:41:04.146111+0000","last_fullsized":"2024-05-10T08:41:04.146111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:56.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127869+0000","last_change":"2024-05-10T08:41:04.132491+0000","last_active":"2024-05-10T08:41:05.127869+0000","last_peered":"2024-05-10T08:41:05.127869+0000","last_clean":"2024-05-10T08:41:05.127869+0000","last_became_active":"2024-05-10T08:41:04.131838+0000","last_became_peered":"2024-05-10T08:41:04.131838+0000","last_unstale":"2024-05-10T08:41:05.127869+0000","last_undegraded":"2024-05-10T08:41:05.127869+0000","last_fullsized":"2024-05-10T08:41:05.127869+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:13:04.657920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.146141+0000","last_change":"2024-05-10T08:41:04.145208+0000","last_active":"2024-05-10T08:41:04.146141+0000","last_peered":"2024-05-10T08:41:04.146141+0000","last_clean":"2024-05-10T08:41:04.146141+0000","last_became_active":"2024-05-10T08:41:04.144933+0000","last_became_peered":"2024-05-10T08:41:04.144933+0000","last_unstale":"2024-05-10T08:41:04.146141+0000","last_undegraded":"2024-05-10T08:41:04.146141+0000","last_fullsized":"2024-05-10T08:41:04.146141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:38.792162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132675+0000","last_change":"2024-05-10T08:41:04.149571+0000","last_active":"2024-05-10T08:41:05.132675+0000","last_peered":"2024-05-10T08:41:05.132675+0000","last_clean":"2024-05-10T08:41:05.132675+0000","last_became_active":"2024-05-10T08:41:04.147697+0000","last_became_peered":"2024-05-10T08:41:04.147697+0000","last_unstale":"2024-05-10T08:41:05.132675+0000","last_undegraded":"2024-05-10T08:41:05.132675+0000","last_fullsized":"2024-05-10T08:41:05.132675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:40.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144410+0000","last_change":"2024-05-10T08:41:04.134140+0000","last_active":"2024-05-10T08:41:04.144410+0000","last_peered":"2024-05-10T08:41:04.144410+0000","last_clean":"2024-05-10T08:41:04.144410+0000","last_became_active":"2024-05-10T08:41:04.133794+0000","last_became_peered":"2024-05-10T08:41:04.133794+0000","last_unstale":"2024-05-10T08:41:04.144410+0000","last_undegraded":"2024-05-10T08:41:04.144410+0000","last_fullsized":"2024-05-10T08:41:04.144410+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:07.351668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.139708+0000","last_change":"2024-05-10T08:41:04.136697+0000","last_active":"2024-05-10T08:41:04.139708+0000","last_peered":"2024-05-10T08:41:04.139708+0000","last_clean":"2024-05-10T08:41:04.139708+0000","last_became_active":"2024-05-10T08:41:04.136385+0000","last_became_peered":"2024-05-10T08:41:04.136385+0000","last_unstale":"2024-05-10T08:41:04.139708+0000","last_undegraded":"2024-05-10T08:41:04.139708+0000","last_fullsized":"2024-05-10T08:41:04.139708+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:01.315133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127451+0000","last_change":"2024-05-10T08:41:04.132160+0000","last_active":"2024-05-10T08:41:05.127451+0000","last_peered":"2024-05-10T08:41:05.127451+0000","last_clean":"2024-05-10T08:41:05.127451+0000","last_became_active":"2024-05-10T08:41:04.131748+0000","last_became_peered":"2024-05-10T08:41:04.131748+0000","last_unstale":"2024-05-10T08:41:05.127451+0000","last_undegraded":"2024-05-10T08:41:05.127451+0000","last_fullsized":"2024-05-10T08:41:05.127451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:43.309543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.153297+0000","last_change":"2024-05-10T08:41:04.149732+0000","last_active":"2024-05-10T08:41:04.153297+0000","last_peered":"2024-05-10T08:41:04.153297+0000","last_clean":"2024-05-10T08:41:04.153297+0000","last_became_active":"2024-05-10T08:41:04.149156+0000","last_became_peered":"2024-05-10T08:41:04.149156+0000","last_unstale":"2024-05-10T08:41:04.153297+0000","last_undegraded":"2024-05-10T08:41:04.153297+0000","last_fullsized":"2024-05-10T08:41:04.153297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:15.486202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.152031+0000","last_change":"2024-05-10T08:41:04.148170+0000","last_active":"2024-05-10T08:41:04.152031+0000","last_peered":"2024-05-10T08:41:04.152031+0000","last_clean":"2024-05-10T08:41:04.152031+0000","last_became_active":"2024-05-10T08:41:04.147884+0000","last_became_peered":"2024-05-10T08:41:04.147884+0000","last_unstale":"2024-05-10T08:41:04.152031+0000","last_undegraded":"2024-05-10T08:41:04.152031+0000","last_fullsized":"2024-05-10T08:41:04.152031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:13.276597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.141497+0000","last_change":"2024-05-10T08:41:04.140387+0000","last_active":"2024-05-10T08:41:04.141497+0000","last_peered":"2024-05-10T08:41:04.141497+0000","last_clean":"2024-05-10T08:41:04.141497+0000","last_became_active":"2024-05-10T08:41:04.140099+0000","last_became_peered":"2024-05-10T08:41:04.140099+0000","last_unstale":"2024-05-10T08:41:04.141497+0000","last_undegraded":"2024-05-10T08:41:04.141497+0000","last_fullsized":"2024-05-10T08:41:04.141497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:35.390079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132810+0000","last_change":"2024-05-10T08:41:04.147458+0000","last_active":"2024-05-10T08:41:05.132810+0000","last_peered":"2024-05-10T08:41:05.132810+0000","last_clean":"2024-05-10T08:41:05.132810+0000","last_became_active":"2024-05-10T08:41:04.146886+0000","last_became_peered":"2024-05-10T08:41:04.146886+0000","last_unstale":"2024-05-10T08:41:05.132810+0000","last_undegraded":"2024-05-10T08:41:05.132810+0000","last_fullsized":"2024-05-10T08:41:05.132810+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:23.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.139169+0000","last_change":"2024-05-10T08:41:04.136943+0000","last_active":"2024-05-10T08:41:04.139169+0000","last_peered":"2024-05-10T08:41:04.139169+0000","last_clean":"2024-05-10T08:41:04.139169+0000","last_became_active":"2024-05-10T08:41:04.136683+0000","last_became_peered":"2024-05-10T08:41:04.136683+0000","last_unstale":"2024-05-10T08:41:04.139169+0000","last_undegraded":"2024-05-10T08:41:04.139169+0000","last_fullsized":"2024-05-10T08:41:04.139169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:03.695634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.139398+0000","last_change":"2024-05-10T08:41:04.137965+0000","last_active":"2024-05-10T08:41:04.139398+0000","last_peered":"2024-05-10T08:41:04.139398+0000","last_clean":"2024-05-10T08:41:04.139398+0000","last_became_active":"2024-05-10T08:41:04.137619+0000","last_became_peered":"2024-05-10T08:41:04.137619+0000","last_unstale":"2024-05-10T08:41:04.139398+0000","last_undegraded":"2024-05-10T08:41:04.139398+0000","last_fullsized":"2024-05-10T08:41:04.139398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:00:21.653777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.143539+0000","last_change":"2024-05-10T08:41:04.140425+0000","last_active":"2024-05-10T08:41:04.143539+0000","last_peered":"2024-05-10T08:41:04.143539+0000","last_clean":"2024-05-10T08:41:04.143539+0000","last_became_active":"2024-05-10T08:41:04.140174+0000","last_became_peered":"2024-05-10T08:41:04.140174+0000","last_unstale":"2024-05-10T08:41:04.143539+0000","last_undegraded":"2024-05-10T08:41:04.143539+0000","last_fullsized":"2024-05-10T08:41:04.143539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:49.430953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147399+0000","last_change":"2024-05-10T08:41:04.136629+0000","last_active":"2024-05-10T08:41:04.147399+0000","last_peered":"2024-05-10T08:41:04.147399+0000","last_clean":"2024-05-10T08:41:04.147399+0000","last_became_active":"2024-05-10T08:41:04.136276+0000","last_became_peered":"2024-05-10T08:41:04.136276+0000","last_unstale":"2024-05-10T08:41:04.147399+0000","last_undegraded":"2024-05-10T08:41:04.147399+0000","last_fullsized":"2024-05-10T08:41:04.147399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:45.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.155262+0000","last_change":"2024-05-10T08:41:04.151267+0000","last_active":"2024-05-10T08:41:04.155262+0000","last_peered":"2024-05-10T08:41:04.155262+0000","last_clean":"2024-05-10T08:41:04.155262+0000","last_became_active":"2024-05-10T08:41:04.150956+0000","last_became_peered":"2024-05-10T08:41:04.150956+0000","last_unstale":"2024-05-10T08:41:04.155262+0000","last_undegraded":"2024-05-10T08:41:04.155262+0000","last_fullsized":"2024-05-10T08:41:04.155262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:08.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158925+0000","last_change":"2024-05-10T08:41:03.129487+0000","last_active":"2024-05-10T08:41:04.158925+0000","last_peered":"2024-05-10T08:41:04.158925+0000","last_clean":"2024-05-10T08:41:04.158925+0000","last_became_active":"2024-05-10T08:41:03.129181+0000","last_became_peered":"2024-05-10T08:41:03.129181+0000","last_unstale":"2024-05-10T08:41:04.158925+0000","last_undegraded":"2024-05-10T08:41:04.158925+0000","last_fullsized":"2024-05-10T08:41:04.158925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:35.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.155878+0000","last_change":"2024-05-10T08:41:04.153544+0000","last_active":"2024-05-10T08:41:04.155878+0000","last_peered":"2024-05-10T08:41:04.155878+0000","last_clean":"2024-05-10T08:41:04.155878+0000","last_became_active":"2024-05-10T08:41:04.153310+0000","last_became_peered":"2024-05-10T08:41:04.153310+0000","last_unstale":"2024-05-10T08:41:04.155878+0000","last_undegraded":"2024-05-10T08:41:04.155878+0000","last_fullsized":"2024-05-10T08:41:04.155878+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:49.313394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137206+0000","last_change":"2024-05-10T08:41:03.133582+0000","last_active":"2024-05-10T08:41:05.137206+0000","last_peered":"2024-05-10T08:41:05.137206+0000","last_clean":"2024-05-10T08:41:05.137206+0000","last_became_active":"2024-05-10T08:41:03.133228+0000","last_became_peered":"2024-05-10T08:41:03.133228+0000","last_unstale":"2024-05-10T08:41:05.137206+0000","last_undegraded":"2024-05-10T08:41:05.137206+0000","last_fullsized":"2024-05-10T08:41:05.137206+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:55.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144139+0000","last_change":"2024-05-10T08:41:04.141110+0000","last_active":"2024-05-10T08:41:04.144139+0000","last_peered":"2024-05-10T08:41:04.144139+0000","last_clean":"2024-05-10T08:41:04.144139+0000","last_became_active":"2024-05-10T08:41:04.140804+0000","last_became_peered":"2024-05-10T08:41:04.140804+0000","last_unstale":"2024-05-10T08:41:04.144139+0000","last_undegraded":"2024-05-10T08:41:04.144139+0000","last_fullsized":"2024-05-10T08:41:04.144139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:49.363316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.161624+0000","last_change":"2024-05-10T08:41:03.130103+0000","last_active":"2024-05-10T08:41:04.161624+0000","last_peered":"2024-05-10T08:41:04.161624+0000","last_clean":"2024-05-10T08:41:04.161624+0000","last_became_active":"2024-05-10T08:41:03.129793+0000","last_became_peered":"2024-05-10T08:41:03.129793+0000","last_unstale":"2024-05-10T08:41:04.161624+0000","last_undegraded":"2024-05-10T08:41:04.161624+0000","last_fullsized":"2024-05-10T08:41:04.161624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:48.424099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133122+0000","last_change":"2024-05-10T08:41:04.141361+0000","last_active":"2024-05-10T08:41:05.133122+0000","last_peered":"2024-05-10T08:41:05.133122+0000","last_clean":"2024-05-10T08:41:05.133122+0000","last_became_active":"2024-05-10T08:41:04.141098+0000","last_became_peered":"2024-05-10T08:41:04.141098+0000","last_unstale":"2024-05-10T08:41:05.133122+0000","last_undegraded":"2024-05-10T08:41:05.133122+0000","last_fullsized":"2024-05-10T08:41:05.133122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:30.043763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158731+0000","last_change":"2024-05-10T08:41:03.141206+0000","last_active":"2024-05-10T08:41:04.158731+0000","last_peered":"2024-05-10T08:41:04.158731+0000","last_clean":"2024-05-10T08:41:04.158731+0000","last_became_active":"2024-05-10T08:41:03.140954+0000","last_became_peered":"2024-05-10T08:41:03.140954+0000","last_unstale":"2024-05-10T08:41:04.158731+0000","last_undegraded":"2024-05-10T08:41:04.158731+0000","last_fullsized":"2024-05-10T08:41:04.158731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:34.383225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.136908+0000","last_change":"2024-05-10T08:41:04.150864+0000","last_active":"2024-05-10T08:41:05.136908+0000","last_peered":"2024-05-10T08:41:05.136908+0000","last_clean":"2024-05-10T08:41:05.136908+0000","last_became_active":"2024-05-10T08:41:04.150590+0000","last_became_peered":"2024-05-10T08:41:04.150590+0000","last_unstale":"2024-05-10T08:41:05.136908+0000","last_undegraded":"2024-05-10T08:41:05.136908+0000","last_fullsized":"2024-05-10T08:41:05.136908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:00.565667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132831+0000","last_change":"2024-05-10T08:41:03.137748+0000","last_active":"2024-05-10T08:41:05.132831+0000","last_peered":"2024-05-10T08:41:05.132831+0000","last_clean":"2024-05-10T08:41:05.132831+0000","last_became_active":"2024-05-10T08:41:03.137455+0000","last_became_peered":"2024-05-10T08:41:03.137455+0000","last_unstale":"2024-05-10T08:41:05.132831+0000","last_undegraded":"2024-05-10T08:41:05.132831+0000","last_fullsized":"2024-05-10T08:41:05.132831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:06.344814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132739+0000","last_change":"2024-05-10T08:41:04.149721+0000","last_active":"2024-05-10T08:41:05.132739+0000","last_peered":"2024-05-10T08:41:05.132739+0000","last_clean":"2024-05-10T08:41:05.132739+0000","last_became_active":"2024-05-10T08:41:04.148057+0000","last_became_peered":"2024-05-10T08:41:04.148057+0000","last_unstale":"2024-05-10T08:41:05.132739+0000","last_undegraded":"2024-05-10T08:41:05.132739+0000","last_fullsized":"2024-05-10T08:41:05.132739+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:50.727450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158855+0000","last_change":"2024-05-10T08:41:03.127423+0000","last_active":"2024-05-10T08:41:04.158855+0000","last_peered":"2024-05-10T08:41:04.158855+0000","last_clean":"2024-05-10T08:41:04.158855+0000","last_became_active":"2024-05-10T08:41:03.126405+0000","last_became_peered":"2024-05-10T08:41:03.126405+0000","last_unstale":"2024-05-10T08:41:04.158855+0000","last_undegraded":"2024-05-10T08:41:04.158855+0000","last_fullsized":"2024-05-10T08:41:04.158855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:37.785308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.149511+0000","last_change":"2024-05-10T08:41:04.147222+0000","last_active":"2024-05-10T08:41:04.149511+0000","last_peered":"2024-05-10T08:41:04.149511+0000","last_clean":"2024-05-10T08:41:04.149511+0000","last_became_active":"2024-05-10T08:41:04.146960+0000","last_became_peered":"2024-05-10T08:41:04.146960+0000","last_unstale":"2024-05-10T08:41:04.149511+0000","last_undegraded":"2024-05-10T08:41:04.149511+0000","last_fullsized":"2024-05-10T08:41:04.149511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:27.517416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129450+0000","last_change":"2024-05-10T08:41:03.125317+0000","last_active":"2024-05-10T08:41:04.129450+0000","last_peered":"2024-05-10T08:41:04.129450+0000","last_clean":"2024-05-10T08:41:04.129450+0000","last_became_active":"2024-05-10T08:41:03.124972+0000","last_became_peered":"2024-05-10T08:41:03.124972+0000","last_unstale":"2024-05-10T08:41:04.129450+0000","last_undegraded":"2024-05-10T08:41:04.129450+0000","last_fullsized":"2024-05-10T08:41:04.129450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:06.344814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132827+0000","last_change":"2024-05-10T08:41:04.139749+0000","last_active":"2024-05-10T08:41:05.132827+0000","last_peered":"2024-05-10T08:41:05.132827+0000","last_clean":"2024-05-10T08:41:05.132827+0000","last_became_active":"2024-05-10T08:41:04.139477+0000","last_became_peered":"2024-05-10T08:41:04.139477+0000","last_unstale":"2024-05-10T08:41:05.132827+0000","last_undegraded":"2024-05-10T08:41:05.132827+0000","last_fullsized":"2024-05-10T08:41:05.132827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:23.594111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.130142+0000","last_change":"2024-05-10T08:41:03.128811+0000","last_active":"2024-05-10T08:41:04.130142+0000","last_peered":"2024-05-10T08:41:04.130142+0000","last_clean":"2024-05-10T08:41:04.130142+0000","last_became_active":"2024-05-10T08:41:03.128487+0000","last_became_peered":"2024-05-10T08:41:03.128487+0000","last_unstale":"2024-05-10T08:41:04.130142+0000","last_undegraded":"2024-05-10T08:41:04.130142+0000","last_fullsized":"2024-05-10T08:41:04.130142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:55.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127696+0000","last_change":"2024-05-10T08:41:04.141535+0000","last_active":"2024-05-10T08:41:05.127696+0000","last_peered":"2024-05-10T08:41:05.127696+0000","last_clean":"2024-05-10T08:41:05.127696+0000","last_became_active":"2024-05-10T08:41:04.141266+0000","last_became_peered":"2024-05-10T08:41:04.141266+0000","last_unstale":"2024-05-10T08:41:05.127696+0000","last_undegraded":"2024-05-10T08:41:05.127696+0000","last_fullsized":"2024-05-10T08:41:05.127696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:17.485922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133260+0000","last_change":"2024-05-10T08:41:03.133406+0000","last_active":"2024-05-10T08:41:05.133260+0000","last_peered":"2024-05-10T08:41:05.133260+0000","last_clean":"2024-05-10T08:41:05.133260+0000","last_became_active":"2024-05-10T08:41:03.133148+0000","last_became_peered":"2024-05-10T08:41:03.133148+0000","last_unstale":"2024-05-10T08:41:05.133260+0000","last_undegraded":"2024-05-10T08:41:05.133260+0000","last_fullsized":"2024-05-10T08:41:05.133260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:54.953672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.145390+0000","last_change":"2024-05-10T08:41:04.143203+0000","last_active":"2024-05-10T08:41:04.145390+0000","last_peered":"2024-05-10T08:41:04.145390+0000","last_clean":"2024-05-10T08:41:04.145390+0000","last_became_active":"2024-05-10T08:41:04.142958+0000","last_became_peered":"2024-05-10T08:41:04.142958+0000","last_unstale":"2024-05-10T08:41:04.145390+0000","last_undegraded":"2024-05-10T08:41:04.145390+0000","last_fullsized":"2024-05-10T08:41:04.145390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:49.363316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133102+0000","last_change":"2024-05-10T08:41:03.132287+0000","last_active":"2024-05-10T08:41:05.133102+0000","last_peered":"2024-05-10T08:41:05.133102+0000","last_clean":"2024-05-10T08:41:05.133102+0000","last_became_active":"2024-05-10T08:41:03.132016+0000","last_became_peered":"2024-05-10T08:41:03.132016+0000","last_unstale":"2024-05-10T08:41:05.133102+0000","last_undegraded":"2024-05-10T08:41:05.133102+0000","last_fullsized":"2024-05-10T08:41:05.133102+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:48.356462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137081+0000","last_change":"2024-05-10T08:41:04.144650+0000","last_active":"2024-05-10T08:41:05.137081+0000","last_peered":"2024-05-10T08:41:05.137081+0000","last_clean":"2024-05-10T08:41:05.137081+0000","last_became_active":"2024-05-10T08:41:04.144372+0000","last_became_peered":"2024-05-10T08:41:04.144372+0000","last_unstale":"2024-05-10T08:41:05.137081+0000","last_undegraded":"2024-05-10T08:41:05.137081+0000","last_fullsized":"2024-05-10T08:41:05.137081+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:55.960526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133115+0000","last_change":"2024-05-10T08:41:03.133388+0000","last_active":"2024-05-10T08:41:05.133115+0000","last_peered":"2024-05-10T08:41:05.133115+0000","last_clean":"2024-05-10T08:41:05.133115+0000","last_became_active":"2024-05-10T08:41:03.133063+0000","last_became_peered":"2024-05-10T08:41:03.133063+0000","last_unstale":"2024-05-10T08:41:05.133115+0000","last_undegraded":"2024-05-10T08:41:05.133115+0000","last_fullsized":"2024-05-10T08:41:05.133115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:48.424099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144032+0000","last_change":"2024-05-10T08:41:04.134050+0000","last_active":"2024-05-10T08:41:04.144032+0000","last_peered":"2024-05-10T08:41:04.144032+0000","last_clean":"2024-05-10T08:41:04.144032+0000","last_became_active":"2024-05-10T08:41:04.133699+0000","last_became_peered":"2024-05-10T08:41:04.133699+0000","last_unstale":"2024-05-10T08:41:04.144032+0000","last_undegraded":"2024-05-10T08:41:04.144032+0000","last_fullsized":"2024-05-10T08:41:04.144032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:01.315133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133073+0000","last_change":"2024-05-10T08:41:03.135666+0000","last_active":"2024-05-10T08:41:05.133073+0000","last_peered":"2024-05-10T08:41:05.133073+0000","last_clean":"2024-05-10T08:41:05.133073+0000","last_became_active":"2024-05-10T08:41:03.134783+0000","last_became_peered":"2024-05-10T08:41:03.134783+0000","last_unstale":"2024-05-10T08:41:05.133073+0000","last_undegraded":"2024-05-10T08:41:05.133073+0000","last_fullsized":"2024-05-10T08:41:05.133073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:56.279731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.136887+0000","last_change":"2024-05-10T08:41:04.153751+0000","last_active":"2024-05-10T08:41:05.136887+0000","last_peered":"2024-05-10T08:41:05.136887+0000","last_clean":"2024-05-10T08:41:05.136887+0000","last_became_active":"2024-05-10T08:41:04.153486+0000","last_became_peered":"2024-05-10T08:41:04.153486+0000","last_unstale":"2024-05-10T08:41:05.136887+0000","last_undegraded":"2024-05-10T08:41:05.136887+0000","last_fullsized":"2024-05-10T08:41:05.136887+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:49.313394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133005+0000","last_change":"2024-05-10T08:41:03.136456+0000","last_active":"2024-05-10T08:41:05.133005+0000","last_peered":"2024-05-10T08:41:05.133005+0000","last_clean":"2024-05-10T08:41:05.133005+0000","last_became_active":"2024-05-10T08:41:03.136182+0000","last_became_peered":"2024-05-10T08:41:03.136182+0000","last_unstale":"2024-05-10T08:41:05.133005+0000","last_undegraded":"2024-05-10T08:41:05.133005+0000","last_fullsized":"2024-05-10T08:41:05.133005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:05:54.023072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132720+0000","last_change":"2024-05-10T08:41:04.146579+0000","last_active":"2024-05-10T08:41:05.132720+0000","last_peered":"2024-05-10T08:41:05.132720+0000","last_clean":"2024-05-10T08:41:05.132720+0000","last_became_active":"2024-05-10T08:41:04.146193+0000","last_became_peered":"2024-05-10T08:41:04.146193+0000","last_unstale":"2024-05-10T08:41:05.132720+0000","last_undegraded":"2024-05-10T08:41:05.132720+0000","last_fullsized":"2024-05-10T08:41:05.132720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:05.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.130316+0000","last_change":"2024-05-10T08:41:03.125841+0000","last_active":"2024-05-10T08:41:04.130316+0000","last_peered":"2024-05-10T08:41:04.130316+0000","last_clean":"2024-05-10T08:41:04.130316+0000","last_became_active":"2024-05-10T08:41:03.125561+0000","last_became_peered":"2024-05-10T08:41:03.125561+0000","last_unstale":"2024-05-10T08:41:04.130316+0000","last_undegraded":"2024-05-10T08:41:04.130316+0000","last_fullsized":"2024-05-10T08:41:04.130316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:46.977983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147256+0000","last_change":"2024-05-10T08:41:04.145618+0000","last_active":"2024-05-10T08:41:04.147256+0000","last_peered":"2024-05-10T08:41:04.147256+0000","last_clean":"2024-05-10T08:41:04.147256+0000","last_became_active":"2024-05-10T08:41:04.145210+0000","last_became_peered":"2024-05-10T08:41:04.145210+0000","last_unstale":"2024-05-10T08:41:04.147256+0000","last_undegraded":"2024-05-10T08:41:04.147256+0000","last_fullsized":"2024-05-10T08:41:04.147256+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:27.517416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.138713+0000","last_change":"2024-05-10T08:41:03.131598+0000","last_active":"2024-05-10T08:41:04.138713+0000","last_peered":"2024-05-10T08:41:04.138713+0000","last_clean":"2024-05-10T08:41:04.138713+0000","last_became_active":"2024-05-10T08:41:03.131286+0000","last_became_peered":"2024-05-10T08:41:03.131286+0000","last_unstale":"2024-05-10T08:41:04.138713+0000","last_undegraded":"2024-05-10T08:41:04.138713+0000","last_fullsized":"2024-05-10T08:41:04.138713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:41:44.187788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132884+0000","last_change":"2024-05-10T08:41:04.149903+0000","last_active":"2024-05-10T08:41:05.132884+0000","last_peered":"2024-05-10T08:41:05.132884+0000","last_clean":"2024-05-10T08:41:05.132884+0000","last_became_active":"2024-05-10T08:41:04.149554+0000","last_became_peered":"2024-05-10T08:41:04.149554+0000","last_unstale":"2024-05-10T08:41:05.132884+0000","last_undegraded":"2024-05-10T08:41:05.132884+0000","last_fullsized":"2024-05-10T08:41:05.132884+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:31.838126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.161909+0000","last_change":"2024-05-10T08:41:03.128689+0000","last_active":"2024-05-10T08:41:04.161909+0000","last_peered":"2024-05-10T08:41:04.161909+0000","last_clean":"2024-05-10T08:41:04.161909+0000","last_became_active":"2024-05-10T08:41:03.128435+0000","last_became_peered":"2024-05-10T08:41:03.128435+0000","last_unstale":"2024-05-10T08:41:04.161909+0000","last_undegraded":"2024-05-10T08:41:04.161909+0000","last_fullsized":"2024-05-10T08:41:04.161909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:14.479348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132943+0000","last_change":"2024-05-10T08:41:04.140533+0000","last_active":"2024-05-10T08:41:05.132943+0000","last_peered":"2024-05-10T08:41:05.132943+0000","last_clean":"2024-05-10T08:41:05.132943+0000","last_became_active":"2024-05-10T08:41:04.140229+0000","last_became_peered":"2024-05-10T08:41:04.140229+0000","last_unstale":"2024-05-10T08:41:05.132943+0000","last_undegraded":"2024-05-10T08:41:05.132943+0000","last_fullsized":"2024-05-10T08:41:05.132943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:40.784453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133167+0000","last_change":"2024-05-10T08:41:03.130437+0000","last_active":"2024-05-10T08:41:05.133167+0000","last_peered":"2024-05-10T08:41:05.133167+0000","last_clean":"2024-05-10T08:41:05.133167+0000","last_became_active":"2024-05-10T08:41:03.130149+0000","last_became_peered":"2024-05-10T08:41:03.130149+0000","last_unstale":"2024-05-10T08:41:05.133167+0000","last_undegraded":"2024-05-10T08:41:05.133167+0000","last_fullsized":"2024-05-10T08:41:05.133167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:46.977983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133118+0000","last_change":"2024-05-10T08:41:04.150303+0000","last_active":"2024-05-10T08:41:05.133118+0000","last_peered":"2024-05-10T08:41:05.133118+0000","last_clean":"2024-05-10T08:41:05.133118+0000","last_became_active":"2024-05-10T08:41:04.150020+0000","last_became_peered":"2024-05-10T08:41:04.150020+0000","last_unstale":"2024-05-10T08:41:05.133118+0000","last_undegraded":"2024-05-10T08:41:05.133118+0000","last_fullsized":"2024-05-10T08:41:05.133118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:05.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.161552+0000","last_change":"2024-05-10T08:41:03.127623+0000","last_active":"2024-05-10T08:41:04.161552+0000","last_peered":"2024-05-10T08:41:04.161552+0000","last_clean":"2024-05-10T08:41:04.161552+0000","last_became_active":"2024-05-10T08:41:03.127384+0000","last_became_peered":"2024-05-10T08:41:03.127384+0000","last_unstale":"2024-05-10T08:41:04.161552+0000","last_undegraded":"2024-05-10T08:41:04.161552+0000","last_fullsized":"2024-05-10T08:41:04.161552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:37.785308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144115+0000","last_change":"2024-05-10T08:41:04.134276+0000","last_active":"2024-05-10T08:41:04.144115+0000","last_peered":"2024-05-10T08:41:04.144115+0000","last_clean":"2024-05-10T08:41:04.144115+0000","last_became_active":"2024-05-10T08:41:04.133951+0000","last_became_peered":"2024-05-10T08:41:04.133951+0000","last_unstale":"2024-05-10T08:41:04.144115+0000","last_undegraded":"2024-05-10T08:41:04.144115+0000","last_fullsized":"2024-05-10T08:41:04.144115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:49.430953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127952+0000","last_change":"2024-05-10T08:41:03.130212+0000","last_active":"2024-05-10T08:41:05.127952+0000","last_peered":"2024-05-10T08:41:05.127952+0000","last_clean":"2024-05-10T08:41:05.127952+0000","last_became_active":"2024-05-10T08:41:03.129922+0000","last_became_peered":"2024-05-10T08:41:03.129922+0000","last_unstale":"2024-05-10T08:41:05.127952+0000","last_undegraded":"2024-05-10T08:41:05.127952+0000","last_fullsized":"2024-05-10T08:41:05.127952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.391751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127924+0000","last_change":"2024-05-10T08:41:04.138484+0000","last_active":"2024-05-10T08:41:05.127924+0000","last_peered":"2024-05-10T08:41:05.127924+0000","last_clean":"2024-05-10T08:41:05.127924+0000","last_became_active":"2024-05-10T08:41:04.138143+0000","last_became_peered":"2024-05-10T08:41:04.138143+0000","last_unstale":"2024-05-10T08:41:05.127924+0000","last_undegraded":"2024-05-10T08:41:05.127924+0000","last_fullsized":"2024-05-10T08:41:05.127924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:42.426585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129326+0000","last_change":"2024-05-10T08:41:03.130565+0000","last_active":"2024-05-10T08:41:04.129326+0000","last_peered":"2024-05-10T08:41:04.129326+0000","last_clean":"2024-05-10T08:41:04.129326+0000","last_became_active":"2024-05-10T08:41:03.129762+0000","last_became_peered":"2024-05-10T08:41:03.129762+0000","last_unstale":"2024-05-10T08:41:04.129326+0000","last_undegraded":"2024-05-10T08:41:04.129326+0000","last_fullsized":"2024-05-10T08:41:04.129326+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:00.308279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.143413+0000","last_change":"2024-05-10T08:41:04.142024+0000","last_active":"2024-05-10T08:41:04.143413+0000","last_peered":"2024-05-10T08:41:04.143413+0000","last_clean":"2024-05-10T08:41:04.143413+0000","last_became_active":"2024-05-10T08:41:04.141581+0000","last_became_peered":"2024-05-10T08:41:04.141581+0000","last_unstale":"2024-05-10T08:41:04.143413+0000","last_undegraded":"2024-05-10T08:41:04.143413+0000","last_fullsized":"2024-05-10T08:41:04.143413+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:47.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127646+0000","last_change":"2024-05-10T08:41:03.135460+0000","last_active":"2024-05-10T08:41:05.127646+0000","last_peered":"2024-05-10T08:41:05.127646+0000","last_clean":"2024-05-10T08:41:05.127646+0000","last_became_active":"2024-05-10T08:41:03.135177+0000","last_became_peered":"2024-05-10T08:41:03.135177+0000","last_unstale":"2024-05-10T08:41:05.127646+0000","last_undegraded":"2024-05-10T08:41:05.127646+0000","last_fullsized":"2024-05-10T08:41:05.127646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:23.898640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.136932+0000","last_change":"2024-05-10T08:41:04.145432+0000","last_active":"2024-05-10T08:41:05.136932+0000","last_peered":"2024-05-10T08:41:05.136932+0000","last_clean":"2024-05-10T08:41:05.136932+0000","last_became_active":"2024-05-10T08:41:04.145169+0000","last_became_peered":"2024-05-10T08:41:04.145169+0000","last_unstale":"2024-05-10T08:41:05.136932+0000","last_undegraded":"2024-05-10T08:41:05.136932+0000","last_fullsized":"2024-05-10T08:41:05.136932+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:39.735061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127541+0000","last_change":"2024-05-10T08:41:03.126660+0000","last_active":"2024-05-10T08:41:05.127541+0000","last_peered":"2024-05-10T08:41:05.127541+0000","last_clean":"2024-05-10T08:41:05.127541+0000","last_became_active":"2024-05-10T08:41:03.126392+0000","last_became_peered":"2024-05-10T08:41:03.126392+0000","last_unstale":"2024-05-10T08:41:05.127541+0000","last_undegraded":"2024-05-10T08:41:05.127541+0000","last_fullsized":"2024-05-10T08:41:05.127541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:29.749889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132658+0000","last_change":"2024-05-10T08:41:04.142410+0000","last_active":"2024-05-10T08:41:05.132658+0000","last_peered":"2024-05-10T08:41:05.132658+0000","last_clean":"2024-05-10T08:41:05.132658+0000","last_became_active":"2024-05-10T08:41:04.142144+0000","last_became_peered":"2024-05-10T08:41:04.142144+0000","last_unstale":"2024-05-10T08:41:05.132658+0000","last_undegraded":"2024-05-10T08:41:05.132658+0000","last_fullsized":"2024-05-10T08:41:05.132658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:49.179025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129534+0000","last_change":"2024-05-10T08:41:03.125984+0000","last_active":"2024-05-10T08:41:04.129534+0000","last_peered":"2024-05-10T08:41:04.129534+0000","last_clean":"2024-05-10T08:41:04.129534+0000","last_became_active":"2024-05-10T08:41:03.125701+0000","last_became_peered":"2024-05-10T08:41:03.125701+0000","last_unstale":"2024-05-10T08:41:04.129534+0000","last_undegraded":"2024-05-10T08:41:04.129534+0000","last_fullsized":"2024-05-10T08:41:04.129534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:55.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132986+0000","last_change":"2024-05-10T08:41:04.140592+0000","last_active":"2024-05-10T08:41:05.132986+0000","last_peered":"2024-05-10T08:41:05.132986+0000","last_clean":"2024-05-10T08:41:05.132986+0000","last_became_active":"2024-05-10T08:41:04.140284+0000","last_became_peered":"2024-05-10T08:41:04.140284+0000","last_unstale":"2024-05-10T08:41:05.132986+0000","last_undegraded":"2024-05-10T08:41:05.132986+0000","last_fullsized":"2024-05-10T08:41:05.132986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:57:35.970797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127414+0000","last_change":"2024-05-10T08:41:03.135442+0000","last_active":"2024-05-10T08:41:05.127414+0000","last_peered":"2024-05-10T08:41:05.127414+0000","last_clean":"2024-05-10T08:41:05.127414+0000","last_became_active":"2024-05-10T08:41:03.135131+0000","last_became_peered":"2024-05-10T08:41:03.135131+0000","last_unstale":"2024-05-10T08:41:05.127414+0000","last_undegraded":"2024-05-10T08:41:05.127414+0000","last_fullsized":"2024-05-10T08:41:05.127414+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:41.635240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.154334+0000","last_change":"2024-05-10T08:41:04.152816+0000","last_active":"2024-05-10T08:41:04.154334+0000","last_peered":"2024-05-10T08:41:04.154334+0000","last_clean":"2024-05-10T08:41:04.154334+0000","last_became_active":"2024-05-10T08:41:04.152529+0000","last_became_peered":"2024-05-10T08:41:04.152529+0000","last_unstale":"2024-05-10T08:41:04.154334+0000","last_undegraded":"2024-05-10T08:41:04.154334+0000","last_fullsized":"2024-05-10T08:41:04.154334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:08.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133332+0000","last_change":"2024-05-10T08:41:03.133606+0000","last_active":"2024-05-10T08:41:05.133332+0000","last_peered":"2024-05-10T08:41:05.133332+0000","last_clean":"2024-05-10T08:41:05.133332+0000","last_became_active":"2024-05-10T08:41:03.133190+0000","last_became_peered":"2024-05-10T08:41:03.133190+0000","last_unstale":"2024-05-10T08:41:05.133332+0000","last_undegraded":"2024-05-10T08:41:05.133332+0000","last_fullsized":"2024-05-10T08:41:05.133332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:44.622496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.145370+0000","last_change":"2024-05-10T08:41:04.143118+0000","last_active":"2024-05-10T08:41:04.145370+0000","last_peered":"2024-05-10T08:41:04.145370+0000","last_clean":"2024-05-10T08:41:04.145370+0000","last_became_active":"2024-05-10T08:41:04.142849+0000","last_became_peered":"2024-05-10T08:41:04.142849+0000","last_unstale":"2024-05-10T08:41:04.145370+0000","last_undegraded":"2024-05-10T08:41:04.145370+0000","last_fullsized":"2024-05-10T08:41:04.145370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:45.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.147651+0000","last_change":"2024-05-10T08:41:03.133424+0000","last_active":"2024-05-10T08:41:05.147651+0000","last_peered":"2024-05-10T08:41:05.147651+0000","last_clean":"2024-05-10T08:41:05.147651+0000","last_became_active":"2024-05-10T08:41:03.133071+0000","last_became_peered":"2024-05-10T08:41:03.133071+0000","last_unstale":"2024-05-10T08:41:05.147651+0000","last_undegraded":"2024-05-10T08:41:05.147651+0000","last_fullsized":"2024-05-10T08:41:05.147651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:33:20.747301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133233+0000","last_change":"2024-05-10T08:41:04.145798+0000","last_active":"2024-05-10T08:41:05.133233+0000","last_peered":"2024-05-10T08:41:05.133233+0000","last_clean":"2024-05-10T08:41:05.133233+0000","last_became_active":"2024-05-10T08:41:04.145525+0000","last_became_peered":"2024-05-10T08:41:04.145525+0000","last_unstale":"2024-05-10T08:41:05.133233+0000","last_undegraded":"2024-05-10T08:41:05.133233+0000","last_fullsized":"2024-05-10T08:41:05.133233+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:22.292235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137120+0000","last_change":"2024-05-10T08:41:03.137161+0000","last_active":"2024-05-10T08:41:05.137120+0000","last_peered":"2024-05-10T08:41:05.137120+0000","last_clean":"2024-05-10T08:41:05.137120+0000","last_became_active":"2024-05-10T08:41:03.136907+0000","last_became_peered":"2024-05-10T08:41:03.136907+0000","last_unstale":"2024-05-10T08:41:05.137120+0000","last_undegraded":"2024-05-10T08:41:05.137120+0000","last_fullsized":"2024-05-10T08:41:05.137120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:37.785308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137770+0000","last_change":"2024-05-10T08:41:04.152507+0000","last_active":"2024-05-10T08:41:05.137770+0000","last_peered":"2024-05-10T08:41:05.137770+0000","last_clean":"2024-05-10T08:41:05.137770+0000","last_became_active":"2024-05-10T08:41:04.152228+0000","last_became_peered":"2024-05-10T08:41:04.152228+0000","last_unstale":"2024-05-10T08:41:05.137770+0000","last_undegraded":"2024-05-10T08:41:05.137770+0000","last_fullsized":"2024-05-10T08:41:05.137770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.012039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137223+0000","last_change":"2024-05-10T08:41:03.133718+0000","last_active":"2024-05-10T08:41:05.137223+0000","last_peered":"2024-05-10T08:41:05.137223+0000","last_clean":"2024-05-10T08:41:05.137223+0000","last_became_active":"2024-05-10T08:41:03.133195+0000","last_became_peered":"2024-05-10T08:41:03.133195+0000","last_unstale":"2024-05-10T08:41:05.137223+0000","last_undegraded":"2024-05-10T08:41:05.137223+0000","last_fullsized":"2024-05-10T08:41:05.137223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:06.344814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147092+0000","last_change":"2024-05-10T08:41:04.139698+0000","last_active":"2024-05-10T08:41:04.147092+0000","last_peered":"2024-05-10T08:41:04.147092+0000","last_clean":"2024-05-10T08:41:04.147092+0000","last_became_active":"2024-05-10T08:41:04.139440+0000","last_became_peered":"2024-05-10T08:41:04.139440+0000","last_unstale":"2024-05-10T08:41:04.147092+0000","last_undegraded":"2024-05-10T08:41:04.147092+0000","last_fullsized":"2024-05-10T08:41:04.147092+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:27.517416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.134576+0000","last_change":"2024-05-10T08:41:03.134395+0000","last_active":"2024-05-10T08:41:04.134576+0000","last_peered":"2024-05-10T08:41:04.134576+0000","last_clean":"2024-05-10T08:41:04.134576+0000","last_became_active":"2024-05-10T08:41:03.134052+0000","last_became_peered":"2024-05-10T08:41:03.134052+0000","last_unstale":"2024-05-10T08:41:04.134576+0000","last_undegraded":"2024-05-10T08:41:04.134576+0000","last_fullsized":"2024-05-10T08:41:04.134576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:41.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144430+0000","last_change":"2024-05-10T08:41:04.136999+0000","last_active":"2024-05-10T08:41:04.144430+0000","last_peered":"2024-05-10T08:41:04.144430+0000","last_clean":"2024-05-10T08:41:04.144430+0000","last_became_active":"2024-05-10T08:41:04.136732+0000","last_became_peered":"2024-05-10T08:41:04.136732+0000","last_unstale":"2024-05-10T08:41:04.144430+0000","last_undegraded":"2024-05-10T08:41:04.144430+0000","last_fullsized":"2024-05-10T08:41:04.144430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:47.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.131466+0000","last_change":"2024-05-10T08:41:03.132590+0000","last_active":"2024-05-10T08:41:04.131466+0000","last_peered":"2024-05-10T08:41:04.131466+0000","last_clean":"2024-05-10T08:41:04.131466+0000","last_became_active":"2024-05-10T08:41:03.132101+0000","last_became_peered":"2024-05-10T08:41:03.132101+0000","last_unstale":"2024-05-10T08:41:04.131466+0000","last_undegraded":"2024-05-10T08:41:04.131466+0000","last_fullsized":"2024-05-10T08:41:04.131466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:14.479348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.141582+0000","last_change":"2024-05-10T08:41:04.138859+0000","last_active":"2024-05-10T08:41:04.141582+0000","last_peered":"2024-05-10T08:41:04.141582+0000","last_clean":"2024-05-10T08:41:04.141582+0000","last_became_active":"2024-05-10T08:41:04.138584+0000","last_became_peered":"2024-05-10T08:41:04.138584+0000","last_unstale":"2024-05-10T08:41:04.141582+0000","last_undegraded":"2024-05-10T08:41:04.141582+0000","last_fullsized":"2024-05-10T08:41:04.141582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:07.351668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132756+0000","last_change":"2024-05-10T08:41:03.138459+0000","last_active":"2024-05-10T08:41:05.132756+0000","last_peered":"2024-05-10T08:41:05.132756+0000","last_clean":"2024-05-10T08:41:05.132756+0000","last_became_active":"2024-05-10T08:41:03.138191+0000","last_became_peered":"2024-05-10T08:41:03.138191+0000","last_unstale":"2024-05-10T08:41:05.132756+0000","last_undegraded":"2024-05-10T08:41:05.132756+0000","last_fullsized":"2024-05-10T08:41:05.132756+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:38.728207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133248+0000","last_change":"2024-05-10T08:41:04.153312+0000","last_active":"2024-05-10T08:41:05.133248+0000","last_peered":"2024-05-10T08:41:05.133248+0000","last_clean":"2024-05-10T08:41:05.133248+0000","last_became_active":"2024-05-10T08:41:04.153023+0000","last_became_peered":"2024-05-10T08:41:04.153023+0000","last_unstale":"2024-05-10T08:41:05.133248+0000","last_undegraded":"2024-05-10T08:41:05.133248+0000","last_fullsized":"2024-05-10T08:41:05.133248+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:23.594111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129325+0000","last_change":"2024-05-10T08:41:03.123187+0000","last_active":"2024-05-10T08:41:04.129325+0000","last_peered":"2024-05-10T08:41:04.129325+0000","last_clean":"2024-05-10T08:41:04.129325+0000","last_became_active":"2024-05-10T08:41:03.122902+0000","last_became_peered":"2024-05-10T08:41:03.122902+0000","last_unstale":"2024-05-10T08:41:04.129325+0000","last_undegraded":"2024-05-10T08:41:04.129325+0000","last_fullsized":"2024-05-10T08:41:04.129325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:34.383225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.130538+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:41:04.130538+0000","last_peered":"2024-05-10T08:41:04.130538+0000","last_clean":"2024-05-10T08:41:04.130538+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:41:04.130538+0000","last_undegraded":"2024-05-10T08:41:04.130538+0000","last_fullsized":"2024-05-10T08:41:04.130538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":767420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":175952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":175974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":177016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":175440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":175460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1011712,"data_stored":765772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:41:08.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:41:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.325+0000 7f50b2e6d640 1 Processor -- start 2024-05-10T08:41:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.325+0000 7f50b2e6d640 1 -- start start 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b2e6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50ac15f420 0x7f50ac0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b2e6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50ac0d3ca0 0x7f50ac0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b2e6d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac0d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b2e6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f50ac1630b0 con 0x7f50ac15f420 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b2e6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f50ac0d2550 con 0x7f50ac0d3ca0 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b2e6d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f50ac0d2c80 con 0x7f50ac0d1eb0 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b0c09640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50ac15f420 0x7f50ac0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b0c09640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50ac15f420 0x7f50ac0d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41412/0 (socket says 172.21.15.37:41412) 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.326+0000 7f50b0c09640 1 -- 172.21.15.37:0/781829188 learned_addr learned my addr 172.21.15.37:0/781829188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50abfff640 1 --2- 172.21.15.37:0/781829188 >> v2:172.21.15.82:3300/0 conn(0x7f50ac0d3ca0 0x7f50ac0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50b140a640 1 --2- 172.21.15.37:0/781829188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac0d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50b0c09640 1 -- 172.21.15.37:0/781829188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 msgr2=0x7f50ac0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50b0c09640 1 --2- 172.21.15.37:0/781829188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac0d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50b0c09640 1 -- 172.21.15.37:0/781829188 >> v2:172.21.15.82:3300/0 conn(0x7f50ac0d3ca0 msgr2=0x7f50ac0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50b0c09640 1 --2- 172.21.15.37:0/781829188 >> v2:172.21.15.82:3300/0 conn(0x7f50ac0d3ca0 0x7f50ac0d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50b0c09640 1 -- 172.21.15.37:0/781829188 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac0d2f60 con 0x7f50ac15f420 2024-05-10T08:41:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50abfff640 1 --2- 172.21.15.37:0/781829188 >> v2:172.21.15.82:3300/0 conn(0x7f50ac0d3ca0 0x7f50ac0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.327+0000 7f50b0c09640 1 --2- 172.21.15.37:0/781829188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15f420 0x7f50ac0d3760 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50ac08f380 tx=0x7f509c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8e269c12dcb384 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50ab7fe640 1 -- 172.21.15.37:0/781829188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c037070 con 0x7f50ac15f420 2024-05-10T08:41:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50ab7fe640 1 -- 172.21.15.37:0/781829188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c032440 con 0x7f50ac15f420 2024-05-10T08:41:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50ab7fe640 1 -- 172.21.15.37:0/781829188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c032810 con 0x7f50ac15f420 2024-05-10T08:41:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 -- 172.21.15.37:0/781829188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15f420 msgr2=0x7f50ac0d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/781829188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15f420 0x7f50ac0d3760 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50ac08f380 tx=0x7f509c02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 -- 172.21.15.37:0/781829188 shutdown_connections 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/781829188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac0d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/781829188 >> v2:172.21.15.82:3300/0 conn(0x7f50ac0d3ca0 0x7f50ac0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/781829188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15f420 0x7f50ac0d3760 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 -- 172.21.15.37:0/781829188 >> 172.21.15.37:0/781829188 conn(0x7f50ac08eac0 msgr2=0x7f50ac09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 -- 172.21.15.37:0/781829188 shutdown_connections 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.328+0000 7f50b2e6d640 1 -- 172.21.15.37:0/781829188 wait complete. 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.329+0000 7f50b2e6d640 1 Processor -- start 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.329+0000 7f50b2e6d640 1 -- start start 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b2e6d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b2e6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50ac0b8ac0 0x7f50ac15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b2e6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac1611b0 0x7f50ac0b9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b2e6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac0d5200 con 0x7f50ac1611b0 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b2e6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac0d2830 con 0x7f50ac0b8ac0 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b2e6d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f50ac0d5380 con 0x7f50ac0d1eb0 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b140a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac1611b0 0x7f50ac0b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b140a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac1611b0 0x7f50ac0b9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41422/0 (socket says 172.21.15.37:41422) 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.330+0000 7f50b140a640 1 -- 172.21.15.37:0/907002732 learned_addr learned my addr 172.21.15.37:0/907002732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50abfff640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50ac0b8ac0 0x7f50ac15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b0c09640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b140a640 1 -- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 msgr2=0x7f50ac154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b140a640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b140a640 1 -- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50ac0b8ac0 msgr2=0x7f50ac15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b140a640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50ac0b8ac0 0x7f50ac15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b140a640 1 -- 172.21.15.37:0/907002732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac160110 con 0x7f50ac1611b0 2024-05-10T08:41:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50abfff640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50ac0b8ac0 0x7f50ac15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b140a640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac1611b0 0x7f50ac0b9290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50a4007e60 tx=0x7f50a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50a97fa640 1 -- 172.21.15.37:0/907002732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4014620 con 0x7f50ac1611b0 2024-05-10T08:41:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50a97fa640 1 -- 172.21.15.37:0/907002732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a4019070 con 0x7f50ac1611b0 2024-05-10T08:41:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac1603f0 con 0x7f50ac1611b0 2024-05-10T08:41:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50a97fa640 1 -- 172.21.15.37:0/907002732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4014a20 con 0x7f50ac1611b0 2024-05-10T08:41:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.331+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ac1609b0 con 0x7f50ac1611b0 2024-05-10T08:41:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.332+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ac0693f0 con 0x7f50ac1611b0 2024-05-10T08:41:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.333+0000 7f50a97fa640 1 -- 172.21.15.37:0/907002732 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50a4014bc0 con 0x7f50ac1611b0 2024-05-10T08:41:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.333+0000 7f50a97fa640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f508c0762d0 0x7f508c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.333+0000 7f50a97fa640 1 -- 172.21.15.37:0/907002732 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f50a4097ff0 con 0x7f50ac1611b0 2024-05-10T08:41:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.333+0000 7f50b0c09640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f508c0762d0 0x7f508c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.334+0000 7f50b0c09640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f508c0762d0 0x7f508c078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f509c034000 tx=0x7f509c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.337+0000 7f50a97fa640 1 -- 172.21.15.37:0/907002732 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f50a40617c0 con 0x7f50ac1611b0 2024-05-10T08:41:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.524+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50ac0d3840 con 0x7f508c0762d0 2024-05-10T08:41:08.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.531+0000 7f50a97fa640 1 -- 172.21.15.37:0/907002732 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7f50ac0d3840 con 0x7f508c0762d0 2024-05-10T08:41:08.533 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:08.534 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:41:08.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f508c0762d0 msgr2=0x7f508c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f508c0762d0 0x7f508c078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f509c034000 tx=0x7f509c02e000 comp rx=0 tx=0).stop 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac1611b0 msgr2=0x7f50ac0b9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac1611b0 0x7f50ac0b9290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50a4007e60 tx=0x7f50a400e4b0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 shutdown_connections 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f508c0762d0 0x7f508c078790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac1611b0 0x7f50ac0b9290 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50ac0b8ac0 0x7f50ac15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 --2- 172.21.15.37:0/907002732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50ac0d1eb0 0x7f50ac154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 >> 172.21.15.37:0/907002732 conn(0x7f50ac08eac0 msgr2=0x7f50ac0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 shutdown_connections 2024-05-10T08:41:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.534+0000 7f50b2e6d640 1 -- 172.21.15.37:0/907002732 wait complete. 2024-05-10T08:41:08.544 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-05-10T08:41:07.336199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220676,"kb_used_data":4468,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754044,"statfs":{"total":773094113280,"available":772868141056,"internally_reserved":0,"allocated":4575232,"data_stored":2595208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.225791"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133266+0000","last_change":"2024-05-10T08:41:04.150684+0000","last_active":"2024-05-10T08:41:05.133266+0000","last_peered":"2024-05-10T08:41:05.133266+0000","last_clean":"2024-05-10T08:41:05.133266+0000","last_became_active":"2024-05-10T08:41:04.150374+0000","last_became_peered":"2024-05-10T08:41:04.150374+0000","last_unstale":"2024-05-10T08:41:05.133266+0000","last_undegraded":"2024-05-10T08:41:05.133266+0000","last_fullsized":"2024-05-10T08:41:05.133266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:14.919064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133160+0000","last_change":"2024-05-10T08:41:04.142397+0000","last_active":"2024-05-10T08:41:05.133160+0000","last_peered":"2024-05-10T08:41:05.133160+0000","last_clean":"2024-05-10T08:41:05.133160+0000","last_became_active":"2024-05-10T08:41:04.142101+0000","last_became_peered":"2024-05-10T08:41:04.142101+0000","last_unstale":"2024-05-10T08:41:05.133160+0000","last_undegraded":"2024-05-10T08:41:05.133160+0000","last_fullsized":"2024-05-10T08:41:05.133160+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:45.026606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137100+0000","last_change":"2024-05-10T08:41:04.155940+0000","last_active":"2024-05-10T08:41:05.137100+0000","last_peered":"2024-05-10T08:41:05.137100+0000","last_clean":"2024-05-10T08:41:05.137100+0000","last_became_active":"2024-05-10T08:41:04.155650+0000","last_became_peered":"2024-05-10T08:41:04.155650+0000","last_unstale":"2024-05-10T08:41:05.137100+0000","last_undegraded":"2024-05-10T08:41:05.137100+0000","last_fullsized":"2024-05-10T08:41:05.137100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:05:55.029926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127630+0000","last_change":"2024-05-10T08:41:04.142837+0000","last_active":"2024-05-10T08:41:05.127630+0000","last_peered":"2024-05-10T08:41:05.127630+0000","last_clean":"2024-05-10T08:41:05.127630+0000","last_became_active":"2024-05-10T08:41:04.141945+0000","last_became_peered":"2024-05-10T08:41:04.141945+0000","last_unstale":"2024-05-10T08:41:05.127630+0000","last_undegraded":"2024-05-10T08:41:05.127630+0000","last_fullsized":"2024-05-10T08:41:05.127630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:14.334583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127644+0000","last_change":"2024-05-10T08:41:04.144520+0000","last_active":"2024-05-10T08:41:05.127644+0000","last_peered":"2024-05-10T08:41:05.127644+0000","last_clean":"2024-05-10T08:41:05.127644+0000","last_became_active":"2024-05-10T08:41:04.144069+0000","last_became_peered":"2024-05-10T08:41:04.144069+0000","last_unstale":"2024-05-10T08:41:05.127644+0000","last_undegraded":"2024-05-10T08:41:05.127644+0000","last_fullsized":"2024-05-10T08:41:05.127644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:22.389379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147439+0000","last_change":"2024-05-10T08:41:04.137419+0000","last_active":"2024-05-10T08:41:04.147439+0000","last_peered":"2024-05-10T08:41:04.147439+0000","last_clean":"2024-05-10T08:41:04.147439+0000","last_became_active":"2024-05-10T08:41:04.137121+0000","last_became_peered":"2024-05-10T08:41:04.137121+0000","last_unstale":"2024-05-10T08:41:04.147439+0000","last_undegraded":"2024-05-10T08:41:04.147439+0000","last_fullsized":"2024-05-10T08:41:04.147439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:49.363316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132736+0000","last_change":"2024-05-10T08:41:04.153439+0000","last_active":"2024-05-10T08:41:05.132736+0000","last_peered":"2024-05-10T08:41:05.132736+0000","last_clean":"2024-05-10T08:41:05.132736+0000","last_became_active":"2024-05-10T08:41:04.153153+0000","last_became_peered":"2024-05-10T08:41:04.153153+0000","last_unstale":"2024-05-10T08:41:05.132736+0000","last_undegraded":"2024-05-10T08:41:05.132736+0000","last_fullsized":"2024-05-10T08:41:05.132736+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:19.608972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132687+0000","last_change":"2024-05-10T08:41:04.147518+0000","last_active":"2024-05-10T08:41:05.132687+0000","last_peered":"2024-05-10T08:41:05.132687+0000","last_clean":"2024-05-10T08:41:05.132687+0000","last_became_active":"2024-05-10T08:41:04.147203+0000","last_became_peered":"2024-05-10T08:41:04.147203+0000","last_unstale":"2024-05-10T08:41:05.132687+0000","last_undegraded":"2024-05-10T08:41:05.132687+0000","last_fullsized":"2024-05-10T08:41:05.132687+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:38.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137381+0000","last_change":"2024-05-10T08:41:04.155651+0000","last_active":"2024-05-10T08:41:05.137381+0000","last_peered":"2024-05-10T08:41:05.137381+0000","last_clean":"2024-05-10T08:41:05.137381+0000","last_became_active":"2024-05-10T08:41:04.155362+0000","last_became_peered":"2024-05-10T08:41:04.155362+0000","last_unstale":"2024-05-10T08:41:05.137381+0000","last_undegraded":"2024-05-10T08:41:05.137381+0000","last_fullsized":"2024-05-10T08:41:05.137381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:37.953978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133000+0000","last_change":"2024-05-10T08:41:04.149544+0000","last_active":"2024-05-10T08:41:05.133000+0000","last_peered":"2024-05-10T08:41:05.133000+0000","last_clean":"2024-05-10T08:41:05.133000+0000","last_became_active":"2024-05-10T08:41:04.146890+0000","last_became_peered":"2024-05-10T08:41:04.146890+0000","last_unstale":"2024-05-10T08:41:05.133000+0000","last_undegraded":"2024-05-10T08:41:05.133000+0000","last_fullsized":"2024-05-10T08:41:05.133000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:38.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132986+0000","last_change":"2024-05-10T08:41:04.150366+0000","last_active":"2024-05-10T08:41:05.132986+0000","last_peered":"2024-05-10T08:41:05.132986+0000","last_clean":"2024-05-10T08:41:05.132986+0000","last_became_active":"2024-05-10T08:41:04.147812+0000","last_became_peered":"2024-05-10T08:41:04.147812+0000","last_unstale":"2024-05-10T08:41:05.132986+0000","last_undegraded":"2024-05-10T08:41:05.132986+0000","last_fullsized":"2024-05-10T08:41:05.132986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:41:51.313547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137052+0000","last_change":"2024-05-10T08:41:04.150497+0000","last_active":"2024-05-10T08:41:05.137052+0000","last_peered":"2024-05-10T08:41:05.137052+0000","last_clean":"2024-05-10T08:41:05.137052+0000","last_became_active":"2024-05-10T08:41:04.150147+0000","last_became_peered":"2024-05-10T08:41:04.150147+0000","last_unstale":"2024-05-10T08:41:05.137052+0000","last_undegraded":"2024-05-10T08:41:05.137052+0000","last_fullsized":"2024-05-10T08:41:05.137052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:57.286585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132712+0000","last_change":"2024-05-10T08:41:04.150376+0000","last_active":"2024-05-10T08:41:05.132712+0000","last_peered":"2024-05-10T08:41:05.132712+0000","last_clean":"2024-05-10T08:41:05.132712+0000","last_became_active":"2024-05-10T08:41:04.147340+0000","last_became_peered":"2024-05-10T08:41:04.147340+0000","last_unstale":"2024-05-10T08:41:05.132712+0000","last_undegraded":"2024-05-10T08:41:05.132712+0000","last_fullsized":"2024-05-10T08:41:05.132712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:03:49.606339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144447+0000","last_change":"2024-05-10T08:41:04.140644+0000","last_active":"2024-05-10T08:41:04.144447+0000","last_peered":"2024-05-10T08:41:04.144447+0000","last_clean":"2024-05-10T08:41:04.144447+0000","last_became_active":"2024-05-10T08:41:04.139648+0000","last_became_peered":"2024-05-10T08:41:04.139648+0000","last_unstale":"2024-05-10T08:41:04.144447+0000","last_undegraded":"2024-05-10T08:41:04.144447+0000","last_fullsized":"2024-05-10T08:41:04.144447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:45.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132552+0000","last_change":"2024-05-10T08:41:04.150231+0000","last_active":"2024-05-10T08:41:05.132552+0000","last_peered":"2024-05-10T08:41:05.132552+0000","last_clean":"2024-05-10T08:41:05.132552+0000","last_became_active":"2024-05-10T08:41:04.149950+0000","last_became_peered":"2024-05-10T08:41:04.149950+0000","last_unstale":"2024-05-10T08:41:05.132552+0000","last_undegraded":"2024-05-10T08:41:05.132552+0000","last_fullsized":"2024-05-10T08:41:05.132552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:48:35.229933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.151062+0000","last_change":"2024-05-10T08:41:04.148505+0000","last_active":"2024-05-10T08:41:04.151062+0000","last_peered":"2024-05-10T08:41:04.151062+0000","last_clean":"2024-05-10T08:41:04.151062+0000","last_became_active":"2024-05-10T08:41:04.148156+0000","last_became_peered":"2024-05-10T08:41:04.148156+0000","last_unstale":"2024-05-10T08:41:04.151062+0000","last_undegraded":"2024-05-10T08:41:04.151062+0000","last_fullsized":"2024-05-10T08:41:04.151062+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:13.276597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158697+0000","last_change":"2024-05-10T08:41:04.154284+0000","last_active":"2024-05-10T08:41:04.158697+0000","last_peered":"2024-05-10T08:41:04.158697+0000","last_clean":"2024-05-10T08:41:04.158697+0000","last_became_active":"2024-05-10T08:41:04.153990+0000","last_became_peered":"2024-05-10T08:41:04.153990+0000","last_unstale":"2024-05-10T08:41:04.158697+0000","last_undegraded":"2024-05-10T08:41:04.158697+0000","last_fullsized":"2024-05-10T08:41:04.158697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:49.313394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.146111+0000","last_change":"2024-05-10T08:41:04.145162+0000","last_active":"2024-05-10T08:41:04.146111+0000","last_peered":"2024-05-10T08:41:04.146111+0000","last_clean":"2024-05-10T08:41:04.146111+0000","last_became_active":"2024-05-10T08:41:04.144896+0000","last_became_peered":"2024-05-10T08:41:04.144896+0000","last_unstale":"2024-05-10T08:41:04.146111+0000","last_undegraded":"2024-05-10T08:41:04.146111+0000","last_fullsized":"2024-05-10T08:41:04.146111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:56.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127869+0000","last_change":"2024-05-10T08:41:04.132491+0000","last_active":"2024-05-10T08:41:05.127869+0000","last_peered":"2024-05-10T08:41:05.127869+0000","last_clean":"2024-05-10T08:41:05.127869+0000","last_became_active":"2024-05-10T08:41:04.131838+0000","last_became_peered":"2024-05-10T08:41:04.131838+0000","last_unstale":"2024-05-10T08:41:05.127869+0000","last_undegraded":"2024-05-10T08:41:05.127869+0000","last_fullsized":"2024-05-10T08:41:05.127869+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:13:04.657920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.146141+0000","last_change":"2024-05-10T08:41:04.145208+0000","last_active":"2024-05-10T08:41:04.146141+0000","last_peered":"2024-05-10T08:41:04.146141+0000","last_clean":"2024-05-10T08:41:04.146141+0000","last_became_active":"2024-05-10T08:41:04.144933+0000","last_became_peered":"2024-05-10T08:41:04.144933+0000","last_unstale":"2024-05-10T08:41:04.146141+0000","last_undegraded":"2024-05-10T08:41:04.146141+0000","last_fullsized":"2024-05-10T08:41:04.146141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:38.792162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132675+0000","last_change":"2024-05-10T08:41:04.149571+0000","last_active":"2024-05-10T08:41:05.132675+0000","last_peered":"2024-05-10T08:41:05.132675+0000","last_clean":"2024-05-10T08:41:05.132675+0000","last_became_active":"2024-05-10T08:41:04.147697+0000","last_became_peered":"2024-05-10T08:41:04.147697+0000","last_unstale":"2024-05-10T08:41:05.132675+0000","last_undegraded":"2024-05-10T08:41:05.132675+0000","last_fullsized":"2024-05-10T08:41:05.132675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:40.291883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144410+0000","last_change":"2024-05-10T08:41:04.134140+0000","last_active":"2024-05-10T08:41:04.144410+0000","last_peered":"2024-05-10T08:41:04.144410+0000","last_clean":"2024-05-10T08:41:04.144410+0000","last_became_active":"2024-05-10T08:41:04.133794+0000","last_became_peered":"2024-05-10T08:41:04.133794+0000","last_unstale":"2024-05-10T08:41:04.144410+0000","last_undegraded":"2024-05-10T08:41:04.144410+0000","last_fullsized":"2024-05-10T08:41:04.144410+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:07.351668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.139708+0000","last_change":"2024-05-10T08:41:04.136697+0000","last_active":"2024-05-10T08:41:04.139708+0000","last_peered":"2024-05-10T08:41:04.139708+0000","last_clean":"2024-05-10T08:41:04.139708+0000","last_became_active":"2024-05-10T08:41:04.136385+0000","last_became_peered":"2024-05-10T08:41:04.136385+0000","last_unstale":"2024-05-10T08:41:04.139708+0000","last_undegraded":"2024-05-10T08:41:04.139708+0000","last_fullsized":"2024-05-10T08:41:04.139708+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:01.315133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127451+0000","last_change":"2024-05-10T08:41:04.132160+0000","last_active":"2024-05-10T08:41:05.127451+0000","last_peered":"2024-05-10T08:41:05.127451+0000","last_clean":"2024-05-10T08:41:05.127451+0000","last_became_active":"2024-05-10T08:41:04.131748+0000","last_became_peered":"2024-05-10T08:41:04.131748+0000","last_unstale":"2024-05-10T08:41:05.127451+0000","last_undegraded":"2024-05-10T08:41:05.127451+0000","last_fullsized":"2024-05-10T08:41:05.127451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:43.309543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.153297+0000","last_change":"2024-05-10T08:41:04.149732+0000","last_active":"2024-05-10T08:41:04.153297+0000","last_peered":"2024-05-10T08:41:04.153297+0000","last_clean":"2024-05-10T08:41:04.153297+0000","last_became_active":"2024-05-10T08:41:04.149156+0000","last_became_peered":"2024-05-10T08:41:04.149156+0000","last_unstale":"2024-05-10T08:41:04.153297+0000","last_undegraded":"2024-05-10T08:41:04.153297+0000","last_fullsized":"2024-05-10T08:41:04.153297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:15.486202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.152031+0000","last_change":"2024-05-10T08:41:04.148170+0000","last_active":"2024-05-10T08:41:04.152031+0000","last_peered":"2024-05-10T08:41:04.152031+0000","last_clean":"2024-05-10T08:41:04.152031+0000","last_became_active":"2024-05-10T08:41:04.147884+0000","last_became_peered":"2024-05-10T08:41:04.147884+0000","last_unstale":"2024-05-10T08:41:04.152031+0000","last_undegraded":"2024-05-10T08:41:04.152031+0000","last_fullsized":"2024-05-10T08:41:04.152031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:13.276597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.141497+0000","last_change":"2024-05-10T08:41:04.140387+0000","last_active":"2024-05-10T08:41:04.141497+0000","last_peered":"2024-05-10T08:41:04.141497+0000","last_clean":"2024-05-10T08:41:04.141497+0000","last_became_active":"2024-05-10T08:41:04.140099+0000","last_became_peered":"2024-05-10T08:41:04.140099+0000","last_unstale":"2024-05-10T08:41:04.141497+0000","last_undegraded":"2024-05-10T08:41:04.141497+0000","last_fullsized":"2024-05-10T08:41:04.141497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:35.390079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132810+0000","last_change":"2024-05-10T08:41:04.147458+0000","last_active":"2024-05-10T08:41:05.132810+0000","last_peered":"2024-05-10T08:41:05.132810+0000","last_clean":"2024-05-10T08:41:05.132810+0000","last_became_active":"2024-05-10T08:41:04.146886+0000","last_became_peered":"2024-05-10T08:41:04.146886+0000","last_unstale":"2024-05-10T08:41:05.132810+0000","last_undegraded":"2024-05-10T08:41:05.132810+0000","last_fullsized":"2024-05-10T08:41:05.132810+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:23.016680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.139169+0000","last_change":"2024-05-10T08:41:04.136943+0000","last_active":"2024-05-10T08:41:04.139169+0000","last_peered":"2024-05-10T08:41:04.139169+0000","last_clean":"2024-05-10T08:41:04.139169+0000","last_became_active":"2024-05-10T08:41:04.136683+0000","last_became_peered":"2024-05-10T08:41:04.136683+0000","last_unstale":"2024-05-10T08:41:04.139169+0000","last_undegraded":"2024-05-10T08:41:04.139169+0000","last_fullsized":"2024-05-10T08:41:04.139169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:03.695634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.139398+0000","last_change":"2024-05-10T08:41:04.137965+0000","last_active":"2024-05-10T08:41:04.139398+0000","last_peered":"2024-05-10T08:41:04.139398+0000","last_clean":"2024-05-10T08:41:04.139398+0000","last_became_active":"2024-05-10T08:41:04.137619+0000","last_became_peered":"2024-05-10T08:41:04.137619+0000","last_unstale":"2024-05-10T08:41:04.139398+0000","last_undegraded":"2024-05-10T08:41:04.139398+0000","last_fullsized":"2024-05-10T08:41:04.139398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:00:21.653777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.143539+0000","last_change":"2024-05-10T08:41:04.140425+0000","last_active":"2024-05-10T08:41:04.143539+0000","last_peered":"2024-05-10T08:41:04.143539+0000","last_clean":"2024-05-10T08:41:04.143539+0000","last_became_active":"2024-05-10T08:41:04.140174+0000","last_became_peered":"2024-05-10T08:41:04.140174+0000","last_unstale":"2024-05-10T08:41:04.143539+0000","last_undegraded":"2024-05-10T08:41:04.143539+0000","last_fullsized":"2024-05-10T08:41:04.143539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:49.430953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147399+0000","last_change":"2024-05-10T08:41:04.136629+0000","last_active":"2024-05-10T08:41:04.147399+0000","last_peered":"2024-05-10T08:41:04.147399+0000","last_clean":"2024-05-10T08:41:04.147399+0000","last_became_active":"2024-05-10T08:41:04.136276+0000","last_became_peered":"2024-05-10T08:41:04.136276+0000","last_unstale":"2024-05-10T08:41:04.147399+0000","last_undegraded":"2024-05-10T08:41:04.147399+0000","last_fullsized":"2024-05-10T08:41:04.147399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:45.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.155262+0000","last_change":"2024-05-10T08:41:04.151267+0000","last_active":"2024-05-10T08:41:04.155262+0000","last_peered":"2024-05-10T08:41:04.155262+0000","last_clean":"2024-05-10T08:41:04.155262+0000","last_became_active":"2024-05-10T08:41:04.150956+0000","last_became_peered":"2024-05-10T08:41:04.150956+0000","last_unstale":"2024-05-10T08:41:04.155262+0000","last_undegraded":"2024-05-10T08:41:04.155262+0000","last_fullsized":"2024-05-10T08:41:04.155262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:08.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158925+0000","last_change":"2024-05-10T08:41:03.129487+0000","last_active":"2024-05-10T08:41:04.158925+0000","last_peered":"2024-05-10T08:41:04.158925+0000","last_clean":"2024-05-10T08:41:04.158925+0000","last_became_active":"2024-05-10T08:41:03.129181+0000","last_became_peered":"2024-05-10T08:41:03.129181+0000","last_unstale":"2024-05-10T08:41:04.158925+0000","last_undegraded":"2024-05-10T08:41:04.158925+0000","last_fullsized":"2024-05-10T08:41:04.158925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:35.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.155878+0000","last_change":"2024-05-10T08:41:04.153544+0000","last_active":"2024-05-10T08:41:04.155878+0000","last_peered":"2024-05-10T08:41:04.155878+0000","last_clean":"2024-05-10T08:41:04.155878+0000","last_became_active":"2024-05-10T08:41:04.153310+0000","last_became_peered":"2024-05-10T08:41:04.153310+0000","last_unstale":"2024-05-10T08:41:04.155878+0000","last_undegraded":"2024-05-10T08:41:04.155878+0000","last_fullsized":"2024-05-10T08:41:04.155878+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:49.313394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137206+0000","last_change":"2024-05-10T08:41:03.133582+0000","last_active":"2024-05-10T08:41:05.137206+0000","last_peered":"2024-05-10T08:41:05.137206+0000","last_clean":"2024-05-10T08:41:05.137206+0000","last_became_active":"2024-05-10T08:41:03.133228+0000","last_became_peered":"2024-05-10T08:41:03.133228+0000","last_unstale":"2024-05-10T08:41:05.137206+0000","last_undegraded":"2024-05-10T08:41:05.137206+0000","last_fullsized":"2024-05-10T08:41:05.137206+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:55.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144139+0000","last_change":"2024-05-10T08:41:04.141110+0000","last_active":"2024-05-10T08:41:04.144139+0000","last_peered":"2024-05-10T08:41:04.144139+0000","last_clean":"2024-05-10T08:41:04.144139+0000","last_became_active":"2024-05-10T08:41:04.140804+0000","last_became_peered":"2024-05-10T08:41:04.140804+0000","last_unstale":"2024-05-10T08:41:04.144139+0000","last_undegraded":"2024-05-10T08:41:04.144139+0000","last_fullsized":"2024-05-10T08:41:04.144139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:49.363316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.161624+0000","last_change":"2024-05-10T08:41:03.130103+0000","last_active":"2024-05-10T08:41:04.161624+0000","last_peered":"2024-05-10T08:41:04.161624+0000","last_clean":"2024-05-10T08:41:04.161624+0000","last_became_active":"2024-05-10T08:41:03.129793+0000","last_became_peered":"2024-05-10T08:41:03.129793+0000","last_unstale":"2024-05-10T08:41:04.161624+0000","last_undegraded":"2024-05-10T08:41:04.161624+0000","last_fullsized":"2024-05-10T08:41:04.161624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:48.424099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133122+0000","last_change":"2024-05-10T08:41:04.141361+0000","last_active":"2024-05-10T08:41:05.133122+0000","last_peered":"2024-05-10T08:41:05.133122+0000","last_clean":"2024-05-10T08:41:05.133122+0000","last_became_active":"2024-05-10T08:41:04.141098+0000","last_became_peered":"2024-05-10T08:41:04.141098+0000","last_unstale":"2024-05-10T08:41:05.133122+0000","last_undegraded":"2024-05-10T08:41:05.133122+0000","last_fullsized":"2024-05-10T08:41:05.133122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:30.043763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158731+0000","last_change":"2024-05-10T08:41:03.141206+0000","last_active":"2024-05-10T08:41:04.158731+0000","last_peered":"2024-05-10T08:41:04.158731+0000","last_clean":"2024-05-10T08:41:04.158731+0000","last_became_active":"2024-05-10T08:41:03.140954+0000","last_became_peered":"2024-05-10T08:41:03.140954+0000","last_unstale":"2024-05-10T08:41:04.158731+0000","last_undegraded":"2024-05-10T08:41:04.158731+0000","last_fullsized":"2024-05-10T08:41:04.158731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:34.383225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.136908+0000","last_change":"2024-05-10T08:41:04.150864+0000","last_active":"2024-05-10T08:41:05.136908+0000","last_peered":"2024-05-10T08:41:05.136908+0000","last_clean":"2024-05-10T08:41:05.136908+0000","last_became_active":"2024-05-10T08:41:04.150590+0000","last_became_peered":"2024-05-10T08:41:04.150590+0000","last_unstale":"2024-05-10T08:41:05.136908+0000","last_undegraded":"2024-05-10T08:41:05.136908+0000","last_fullsized":"2024-05-10T08:41:05.136908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:00.565667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132831+0000","last_change":"2024-05-10T08:41:03.137748+0000","last_active":"2024-05-10T08:41:05.132831+0000","last_peered":"2024-05-10T08:41:05.132831+0000","last_clean":"2024-05-10T08:41:05.132831+0000","last_became_active":"2024-05-10T08:41:03.137455+0000","last_became_peered":"2024-05-10T08:41:03.137455+0000","last_unstale":"2024-05-10T08:41:05.132831+0000","last_undegraded":"2024-05-10T08:41:05.132831+0000","last_fullsized":"2024-05-10T08:41:05.132831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:06.344814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132739+0000","last_change":"2024-05-10T08:41:04.149721+0000","last_active":"2024-05-10T08:41:05.132739+0000","last_peered":"2024-05-10T08:41:05.132739+0000","last_clean":"2024-05-10T08:41:05.132739+0000","last_became_active":"2024-05-10T08:41:04.148057+0000","last_became_peered":"2024-05-10T08:41:04.148057+0000","last_unstale":"2024-05-10T08:41:05.132739+0000","last_undegraded":"2024-05-10T08:41:05.132739+0000","last_fullsized":"2024-05-10T08:41:05.132739+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:50.727450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.158855+0000","last_change":"2024-05-10T08:41:03.127423+0000","last_active":"2024-05-10T08:41:04.158855+0000","last_peered":"2024-05-10T08:41:04.158855+0000","last_clean":"2024-05-10T08:41:04.158855+0000","last_became_active":"2024-05-10T08:41:03.126405+0000","last_became_peered":"2024-05-10T08:41:03.126405+0000","last_unstale":"2024-05-10T08:41:04.158855+0000","last_undegraded":"2024-05-10T08:41:04.158855+0000","last_fullsized":"2024-05-10T08:41:04.158855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:37.785308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.149511+0000","last_change":"2024-05-10T08:41:04.147222+0000","last_active":"2024-05-10T08:41:04.149511+0000","last_peered":"2024-05-10T08:41:04.149511+0000","last_clean":"2024-05-10T08:41:04.149511+0000","last_became_active":"2024-05-10T08:41:04.146960+0000","last_became_peered":"2024-05-10T08:41:04.146960+0000","last_unstale":"2024-05-10T08:41:04.149511+0000","last_undegraded":"2024-05-10T08:41:04.149511+0000","last_fullsized":"2024-05-10T08:41:04.149511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:27.517416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129450+0000","last_change":"2024-05-10T08:41:03.125317+0000","last_active":"2024-05-10T08:41:04.129450+0000","last_peered":"2024-05-10T08:41:04.129450+0000","last_clean":"2024-05-10T08:41:04.129450+0000","last_became_active":"2024-05-10T08:41:03.124972+0000","last_became_peered":"2024-05-10T08:41:03.124972+0000","last_unstale":"2024-05-10T08:41:04.129450+0000","last_undegraded":"2024-05-10T08:41:04.129450+0000","last_fullsized":"2024-05-10T08:41:04.129450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:06.344814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132827+0000","last_change":"2024-05-10T08:41:04.139749+0000","last_active":"2024-05-10T08:41:05.132827+0000","last_peered":"2024-05-10T08:41:05.132827+0000","last_clean":"2024-05-10T08:41:05.132827+0000","last_became_active":"2024-05-10T08:41:04.139477+0000","last_became_peered":"2024-05-10T08:41:04.139477+0000","last_unstale":"2024-05-10T08:41:05.132827+0000","last_undegraded":"2024-05-10T08:41:05.132827+0000","last_fullsized":"2024-05-10T08:41:05.132827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:23.594111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.130142+0000","last_change":"2024-05-10T08:41:03.128811+0000","last_active":"2024-05-10T08:41:04.130142+0000","last_peered":"2024-05-10T08:41:04.130142+0000","last_clean":"2024-05-10T08:41:04.130142+0000","last_became_active":"2024-05-10T08:41:03.128487+0000","last_became_peered":"2024-05-10T08:41:03.128487+0000","last_unstale":"2024-05-10T08:41:04.130142+0000","last_undegraded":"2024-05-10T08:41:04.130142+0000","last_fullsized":"2024-05-10T08:41:04.130142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:55.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127696+0000","last_change":"2024-05-10T08:41:04.141535+0000","last_active":"2024-05-10T08:41:05.127696+0000","last_peered":"2024-05-10T08:41:05.127696+0000","last_clean":"2024-05-10T08:41:05.127696+0000","last_became_active":"2024-05-10T08:41:04.141266+0000","last_became_peered":"2024-05-10T08:41:04.141266+0000","last_unstale":"2024-05-10T08:41:05.127696+0000","last_undegraded":"2024-05-10T08:41:05.127696+0000","last_fullsized":"2024-05-10T08:41:05.127696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:17.485922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133260+0000","last_change":"2024-05-10T08:41:03.133406+0000","last_active":"2024-05-10T08:41:05.133260+0000","last_peered":"2024-05-10T08:41:05.133260+0000","last_clean":"2024-05-10T08:41:05.133260+0000","last_became_active":"2024-05-10T08:41:03.133148+0000","last_became_peered":"2024-05-10T08:41:03.133148+0000","last_unstale":"2024-05-10T08:41:05.133260+0000","last_undegraded":"2024-05-10T08:41:05.133260+0000","last_fullsized":"2024-05-10T08:41:05.133260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:54.953672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.145390+0000","last_change":"2024-05-10T08:41:04.143203+0000","last_active":"2024-05-10T08:41:04.145390+0000","last_peered":"2024-05-10T08:41:04.145390+0000","last_clean":"2024-05-10T08:41:04.145390+0000","last_became_active":"2024-05-10T08:41:04.142958+0000","last_became_peered":"2024-05-10T08:41:04.142958+0000","last_unstale":"2024-05-10T08:41:04.145390+0000","last_undegraded":"2024-05-10T08:41:04.145390+0000","last_fullsized":"2024-05-10T08:41:04.145390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:49.363316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133102+0000","last_change":"2024-05-10T08:41:03.132287+0000","last_active":"2024-05-10T08:41:05.133102+0000","last_peered":"2024-05-10T08:41:05.133102+0000","last_clean":"2024-05-10T08:41:05.133102+0000","last_became_active":"2024-05-10T08:41:03.132016+0000","last_became_peered":"2024-05-10T08:41:03.132016+0000","last_unstale":"2024-05-10T08:41:05.133102+0000","last_undegraded":"2024-05-10T08:41:05.133102+0000","last_fullsized":"2024-05-10T08:41:05.133102+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:48.356462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137081+0000","last_change":"2024-05-10T08:41:04.144650+0000","last_active":"2024-05-10T08:41:05.137081+0000","last_peered":"2024-05-10T08:41:05.137081+0000","last_clean":"2024-05-10T08:41:05.137081+0000","last_became_active":"2024-05-10T08:41:04.144372+0000","last_became_peered":"2024-05-10T08:41:04.144372+0000","last_unstale":"2024-05-10T08:41:05.137081+0000","last_undegraded":"2024-05-10T08:41:05.137081+0000","last_fullsized":"2024-05-10T08:41:05.137081+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:55.960526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133115+0000","last_change":"2024-05-10T08:41:03.133388+0000","last_active":"2024-05-10T08:41:05.133115+0000","last_peered":"2024-05-10T08:41:05.133115+0000","last_clean":"2024-05-10T08:41:05.133115+0000","last_became_active":"2024-05-10T08:41:03.133063+0000","last_became_peered":"2024-05-10T08:41:03.133063+0000","last_unstale":"2024-05-10T08:41:05.133115+0000","last_undegraded":"2024-05-10T08:41:05.133115+0000","last_fullsized":"2024-05-10T08:41:05.133115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:48.424099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144032+0000","last_change":"2024-05-10T08:41:04.134050+0000","last_active":"2024-05-10T08:41:04.144032+0000","last_peered":"2024-05-10T08:41:04.144032+0000","last_clean":"2024-05-10T08:41:04.144032+0000","last_became_active":"2024-05-10T08:41:04.133699+0000","last_became_peered":"2024-05-10T08:41:04.133699+0000","last_unstale":"2024-05-10T08:41:04.144032+0000","last_undegraded":"2024-05-10T08:41:04.144032+0000","last_fullsized":"2024-05-10T08:41:04.144032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:01.315133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133073+0000","last_change":"2024-05-10T08:41:03.135666+0000","last_active":"2024-05-10T08:41:05.133073+0000","last_peered":"2024-05-10T08:41:05.133073+0000","last_clean":"2024-05-10T08:41:05.133073+0000","last_became_active":"2024-05-10T08:41:03.134783+0000","last_became_peered":"2024-05-10T08:41:03.134783+0000","last_unstale":"2024-05-10T08:41:05.133073+0000","last_undegraded":"2024-05-10T08:41:05.133073+0000","last_fullsized":"2024-05-10T08:41:05.133073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:56.279731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.136887+0000","last_change":"2024-05-10T08:41:04.153751+0000","last_active":"2024-05-10T08:41:05.136887+0000","last_peered":"2024-05-10T08:41:05.136887+0000","last_clean":"2024-05-10T08:41:05.136887+0000","last_became_active":"2024-05-10T08:41:04.153486+0000","last_became_peered":"2024-05-10T08:41:04.153486+0000","last_unstale":"2024-05-10T08:41:05.136887+0000","last_undegraded":"2024-05-10T08:41:05.136887+0000","last_fullsized":"2024-05-10T08:41:05.136887+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:15:49.313394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133005+0000","last_change":"2024-05-10T08:41:03.136456+0000","last_active":"2024-05-10T08:41:05.133005+0000","last_peered":"2024-05-10T08:41:05.133005+0000","last_clean":"2024-05-10T08:41:05.133005+0000","last_became_active":"2024-05-10T08:41:03.136182+0000","last_became_peered":"2024-05-10T08:41:03.136182+0000","last_unstale":"2024-05-10T08:41:05.133005+0000","last_undegraded":"2024-05-10T08:41:05.133005+0000","last_fullsized":"2024-05-10T08:41:05.133005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:05:54.023072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132720+0000","last_change":"2024-05-10T08:41:04.146579+0000","last_active":"2024-05-10T08:41:05.132720+0000","last_peered":"2024-05-10T08:41:05.132720+0000","last_clean":"2024-05-10T08:41:05.132720+0000","last_became_active":"2024-05-10T08:41:04.146193+0000","last_became_peered":"2024-05-10T08:41:04.146193+0000","last_unstale":"2024-05-10T08:41:05.132720+0000","last_undegraded":"2024-05-10T08:41:05.132720+0000","last_fullsized":"2024-05-10T08:41:05.132720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:05.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.130316+0000","last_change":"2024-05-10T08:41:03.125841+0000","last_active":"2024-05-10T08:41:04.130316+0000","last_peered":"2024-05-10T08:41:04.130316+0000","last_clean":"2024-05-10T08:41:04.130316+0000","last_became_active":"2024-05-10T08:41:03.125561+0000","last_became_peered":"2024-05-10T08:41:03.125561+0000","last_unstale":"2024-05-10T08:41:04.130316+0000","last_undegraded":"2024-05-10T08:41:04.130316+0000","last_fullsized":"2024-05-10T08:41:04.130316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:46.977983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147256+0000","last_change":"2024-05-10T08:41:04.145618+0000","last_active":"2024-05-10T08:41:04.147256+0000","last_peered":"2024-05-10T08:41:04.147256+0000","last_clean":"2024-05-10T08:41:04.147256+0000","last_became_active":"2024-05-10T08:41:04.145210+0000","last_became_peered":"2024-05-10T08:41:04.145210+0000","last_unstale":"2024-05-10T08:41:04.147256+0000","last_undegraded":"2024-05-10T08:41:04.147256+0000","last_fullsized":"2024-05-10T08:41:04.147256+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:27.517416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.138713+0000","last_change":"2024-05-10T08:41:03.131598+0000","last_active":"2024-05-10T08:41:04.138713+0000","last_peered":"2024-05-10T08:41:04.138713+0000","last_clean":"2024-05-10T08:41:04.138713+0000","last_became_active":"2024-05-10T08:41:03.131286+0000","last_became_peered":"2024-05-10T08:41:03.131286+0000","last_unstale":"2024-05-10T08:41:04.138713+0000","last_undegraded":"2024-05-10T08:41:04.138713+0000","last_fullsized":"2024-05-10T08:41:04.138713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:41:44.187788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132884+0000","last_change":"2024-05-10T08:41:04.149903+0000","last_active":"2024-05-10T08:41:05.132884+0000","last_peered":"2024-05-10T08:41:05.132884+0000","last_clean":"2024-05-10T08:41:05.132884+0000","last_became_active":"2024-05-10T08:41:04.149554+0000","last_became_peered":"2024-05-10T08:41:04.149554+0000","last_unstale":"2024-05-10T08:41:05.132884+0000","last_undegraded":"2024-05-10T08:41:05.132884+0000","last_fullsized":"2024-05-10T08:41:05.132884+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:31.838126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.161909+0000","last_change":"2024-05-10T08:41:03.128689+0000","last_active":"2024-05-10T08:41:04.161909+0000","last_peered":"2024-05-10T08:41:04.161909+0000","last_clean":"2024-05-10T08:41:04.161909+0000","last_became_active":"2024-05-10T08:41:03.128435+0000","last_became_peered":"2024-05-10T08:41:03.128435+0000","last_unstale":"2024-05-10T08:41:04.161909+0000","last_undegraded":"2024-05-10T08:41:04.161909+0000","last_fullsized":"2024-05-10T08:41:04.161909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:14.479348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132943+0000","last_change":"2024-05-10T08:41:04.140533+0000","last_active":"2024-05-10T08:41:05.132943+0000","last_peered":"2024-05-10T08:41:05.132943+0000","last_clean":"2024-05-10T08:41:05.132943+0000","last_became_active":"2024-05-10T08:41:04.140229+0000","last_became_peered":"2024-05-10T08:41:04.140229+0000","last_unstale":"2024-05-10T08:41:05.132943+0000","last_undegraded":"2024-05-10T08:41:05.132943+0000","last_fullsized":"2024-05-10T08:41:05.132943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:40.784453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133167+0000","last_change":"2024-05-10T08:41:03.130437+0000","last_active":"2024-05-10T08:41:05.133167+0000","last_peered":"2024-05-10T08:41:05.133167+0000","last_clean":"2024-05-10T08:41:05.133167+0000","last_became_active":"2024-05-10T08:41:03.130149+0000","last_became_peered":"2024-05-10T08:41:03.130149+0000","last_unstale":"2024-05-10T08:41:05.133167+0000","last_undegraded":"2024-05-10T08:41:05.133167+0000","last_fullsized":"2024-05-10T08:41:05.133167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:46.977983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133118+0000","last_change":"2024-05-10T08:41:04.150303+0000","last_active":"2024-05-10T08:41:05.133118+0000","last_peered":"2024-05-10T08:41:05.133118+0000","last_clean":"2024-05-10T08:41:05.133118+0000","last_became_active":"2024-05-10T08:41:04.150020+0000","last_became_peered":"2024-05-10T08:41:04.150020+0000","last_unstale":"2024-05-10T08:41:05.133118+0000","last_undegraded":"2024-05-10T08:41:05.133118+0000","last_fullsized":"2024-05-10T08:41:05.133118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:05.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.161552+0000","last_change":"2024-05-10T08:41:03.127623+0000","last_active":"2024-05-10T08:41:04.161552+0000","last_peered":"2024-05-10T08:41:04.161552+0000","last_clean":"2024-05-10T08:41:04.161552+0000","last_became_active":"2024-05-10T08:41:03.127384+0000","last_became_peered":"2024-05-10T08:41:03.127384+0000","last_unstale":"2024-05-10T08:41:04.161552+0000","last_undegraded":"2024-05-10T08:41:04.161552+0000","last_fullsized":"2024-05-10T08:41:04.161552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:37.785308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144115+0000","last_change":"2024-05-10T08:41:04.134276+0000","last_active":"2024-05-10T08:41:04.144115+0000","last_peered":"2024-05-10T08:41:04.144115+0000","last_clean":"2024-05-10T08:41:04.144115+0000","last_became_active":"2024-05-10T08:41:04.133951+0000","last_became_peered":"2024-05-10T08:41:04.133951+0000","last_unstale":"2024-05-10T08:41:04.144115+0000","last_undegraded":"2024-05-10T08:41:04.144115+0000","last_fullsized":"2024-05-10T08:41:04.144115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:49.430953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127952+0000","last_change":"2024-05-10T08:41:03.130212+0000","last_active":"2024-05-10T08:41:05.127952+0000","last_peered":"2024-05-10T08:41:05.127952+0000","last_clean":"2024-05-10T08:41:05.127952+0000","last_became_active":"2024-05-10T08:41:03.129922+0000","last_became_peered":"2024-05-10T08:41:03.129922+0000","last_unstale":"2024-05-10T08:41:05.127952+0000","last_undegraded":"2024-05-10T08:41:05.127952+0000","last_fullsized":"2024-05-10T08:41:05.127952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:49.391751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127924+0000","last_change":"2024-05-10T08:41:04.138484+0000","last_active":"2024-05-10T08:41:05.127924+0000","last_peered":"2024-05-10T08:41:05.127924+0000","last_clean":"2024-05-10T08:41:05.127924+0000","last_became_active":"2024-05-10T08:41:04.138143+0000","last_became_peered":"2024-05-10T08:41:04.138143+0000","last_unstale":"2024-05-10T08:41:05.127924+0000","last_undegraded":"2024-05-10T08:41:05.127924+0000","last_fullsized":"2024-05-10T08:41:05.127924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:42.426585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129326+0000","last_change":"2024-05-10T08:41:03.130565+0000","last_active":"2024-05-10T08:41:04.129326+0000","last_peered":"2024-05-10T08:41:04.129326+0000","last_clean":"2024-05-10T08:41:04.129326+0000","last_became_active":"2024-05-10T08:41:03.129762+0000","last_became_peered":"2024-05-10T08:41:03.129762+0000","last_unstale":"2024-05-10T08:41:04.129326+0000","last_undegraded":"2024-05-10T08:41:04.129326+0000","last_fullsized":"2024-05-10T08:41:04.129326+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:00.308279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.143413+0000","last_change":"2024-05-10T08:41:04.142024+0000","last_active":"2024-05-10T08:41:04.143413+0000","last_peered":"2024-05-10T08:41:04.143413+0000","last_clean":"2024-05-10T08:41:04.143413+0000","last_became_active":"2024-05-10T08:41:04.141581+0000","last_became_peered":"2024-05-10T08:41:04.141581+0000","last_unstale":"2024-05-10T08:41:04.143413+0000","last_undegraded":"2024-05-10T08:41:04.143413+0000","last_fullsized":"2024-05-10T08:41:04.143413+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:47.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127646+0000","last_change":"2024-05-10T08:41:03.135460+0000","last_active":"2024-05-10T08:41:05.127646+0000","last_peered":"2024-05-10T08:41:05.127646+0000","last_clean":"2024-05-10T08:41:05.127646+0000","last_became_active":"2024-05-10T08:41:03.135177+0000","last_became_peered":"2024-05-10T08:41:03.135177+0000","last_unstale":"2024-05-10T08:41:05.127646+0000","last_undegraded":"2024-05-10T08:41:05.127646+0000","last_fullsized":"2024-05-10T08:41:05.127646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:23.898640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.136932+0000","last_change":"2024-05-10T08:41:04.145432+0000","last_active":"2024-05-10T08:41:05.136932+0000","last_peered":"2024-05-10T08:41:05.136932+0000","last_clean":"2024-05-10T08:41:05.136932+0000","last_became_active":"2024-05-10T08:41:04.145169+0000","last_became_peered":"2024-05-10T08:41:04.145169+0000","last_unstale":"2024-05-10T08:41:05.136932+0000","last_undegraded":"2024-05-10T08:41:05.136932+0000","last_fullsized":"2024-05-10T08:41:05.136932+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:39.735061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127541+0000","last_change":"2024-05-10T08:41:03.126660+0000","last_active":"2024-05-10T08:41:05.127541+0000","last_peered":"2024-05-10T08:41:05.127541+0000","last_clean":"2024-05-10T08:41:05.127541+0000","last_became_active":"2024-05-10T08:41:03.126392+0000","last_became_peered":"2024-05-10T08:41:03.126392+0000","last_unstale":"2024-05-10T08:41:05.127541+0000","last_undegraded":"2024-05-10T08:41:05.127541+0000","last_fullsized":"2024-05-10T08:41:05.127541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:29.749889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132658+0000","last_change":"2024-05-10T08:41:04.142410+0000","last_active":"2024-05-10T08:41:05.132658+0000","last_peered":"2024-05-10T08:41:05.132658+0000","last_clean":"2024-05-10T08:41:05.132658+0000","last_became_active":"2024-05-10T08:41:04.142144+0000","last_became_peered":"2024-05-10T08:41:04.142144+0000","last_unstale":"2024-05-10T08:41:05.132658+0000","last_undegraded":"2024-05-10T08:41:05.132658+0000","last_fullsized":"2024-05-10T08:41:05.132658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:49.179025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129534+0000","last_change":"2024-05-10T08:41:03.125984+0000","last_active":"2024-05-10T08:41:04.129534+0000","last_peered":"2024-05-10T08:41:04.129534+0000","last_clean":"2024-05-10T08:41:04.129534+0000","last_became_active":"2024-05-10T08:41:03.125701+0000","last_became_peered":"2024-05-10T08:41:03.125701+0000","last_unstale":"2024-05-10T08:41:04.129534+0000","last_undegraded":"2024-05-10T08:41:04.129534+0000","last_fullsized":"2024-05-10T08:41:04.129534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:55.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132986+0000","last_change":"2024-05-10T08:41:04.140592+0000","last_active":"2024-05-10T08:41:05.132986+0000","last_peered":"2024-05-10T08:41:05.132986+0000","last_clean":"2024-05-10T08:41:05.132986+0000","last_became_active":"2024-05-10T08:41:04.140284+0000","last_became_peered":"2024-05-10T08:41:04.140284+0000","last_unstale":"2024-05-10T08:41:05.132986+0000","last_undegraded":"2024-05-10T08:41:05.132986+0000","last_fullsized":"2024-05-10T08:41:05.132986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:57:35.970797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.127414+0000","last_change":"2024-05-10T08:41:03.135442+0000","last_active":"2024-05-10T08:41:05.127414+0000","last_peered":"2024-05-10T08:41:05.127414+0000","last_clean":"2024-05-10T08:41:05.127414+0000","last_became_active":"2024-05-10T08:41:03.135131+0000","last_became_peered":"2024-05-10T08:41:03.135131+0000","last_unstale":"2024-05-10T08:41:05.127414+0000","last_undegraded":"2024-05-10T08:41:05.127414+0000","last_fullsized":"2024-05-10T08:41:05.127414+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:41.635240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.154334+0000","last_change":"2024-05-10T08:41:04.152816+0000","last_active":"2024-05-10T08:41:04.154334+0000","last_peered":"2024-05-10T08:41:04.154334+0000","last_clean":"2024-05-10T08:41:04.154334+0000","last_became_active":"2024-05-10T08:41:04.152529+0000","last_became_peered":"2024-05-10T08:41:04.152529+0000","last_unstale":"2024-05-10T08:41:04.154334+0000","last_undegraded":"2024-05-10T08:41:04.154334+0000","last_fullsized":"2024-05-10T08:41:04.154334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:08.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133332+0000","last_change":"2024-05-10T08:41:03.133606+0000","last_active":"2024-05-10T08:41:05.133332+0000","last_peered":"2024-05-10T08:41:05.133332+0000","last_clean":"2024-05-10T08:41:05.133332+0000","last_became_active":"2024-05-10T08:41:03.133190+0000","last_became_peered":"2024-05-10T08:41:03.133190+0000","last_unstale":"2024-05-10T08:41:05.133332+0000","last_undegraded":"2024-05-10T08:41:05.133332+0000","last_fullsized":"2024-05-10T08:41:05.133332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:44.622496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.145370+0000","last_change":"2024-05-10T08:41:04.143118+0000","last_active":"2024-05-10T08:41:04.145370+0000","last_peered":"2024-05-10T08:41:04.145370+0000","last_clean":"2024-05-10T08:41:04.145370+0000","last_became_active":"2024-05-10T08:41:04.142849+0000","last_became_peered":"2024-05-10T08:41:04.142849+0000","last_unstale":"2024-05-10T08:41:04.145370+0000","last_undegraded":"2024-05-10T08:41:04.145370+0000","last_fullsized":"2024-05-10T08:41:04.145370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:45.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.147651+0000","last_change":"2024-05-10T08:41:03.133424+0000","last_active":"2024-05-10T08:41:05.147651+0000","last_peered":"2024-05-10T08:41:05.147651+0000","last_clean":"2024-05-10T08:41:05.147651+0000","last_became_active":"2024-05-10T08:41:03.133071+0000","last_became_peered":"2024-05-10T08:41:03.133071+0000","last_unstale":"2024-05-10T08:41:05.147651+0000","last_undegraded":"2024-05-10T08:41:05.147651+0000","last_fullsized":"2024-05-10T08:41:05.147651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:33:20.747301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133233+0000","last_change":"2024-05-10T08:41:04.145798+0000","last_active":"2024-05-10T08:41:05.133233+0000","last_peered":"2024-05-10T08:41:05.133233+0000","last_clean":"2024-05-10T08:41:05.133233+0000","last_became_active":"2024-05-10T08:41:04.145525+0000","last_became_peered":"2024-05-10T08:41:04.145525+0000","last_unstale":"2024-05-10T08:41:05.133233+0000","last_undegraded":"2024-05-10T08:41:05.133233+0000","last_fullsized":"2024-05-10T08:41:05.133233+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:22.292235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137120+0000","last_change":"2024-05-10T08:41:03.137161+0000","last_active":"2024-05-10T08:41:05.137120+0000","last_peered":"2024-05-10T08:41:05.137120+0000","last_clean":"2024-05-10T08:41:05.137120+0000","last_became_active":"2024-05-10T08:41:03.136907+0000","last_became_peered":"2024-05-10T08:41:03.136907+0000","last_unstale":"2024-05-10T08:41:05.137120+0000","last_undegraded":"2024-05-10T08:41:05.137120+0000","last_fullsized":"2024-05-10T08:41:05.137120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:37.785308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137770+0000","last_change":"2024-05-10T08:41:04.152507+0000","last_active":"2024-05-10T08:41:05.137770+0000","last_peered":"2024-05-10T08:41:05.137770+0000","last_clean":"2024-05-10T08:41:05.137770+0000","last_became_active":"2024-05-10T08:41:04.152228+0000","last_became_peered":"2024-05-10T08:41:04.152228+0000","last_unstale":"2024-05-10T08:41:05.137770+0000","last_undegraded":"2024-05-10T08:41:05.137770+0000","last_fullsized":"2024-05-10T08:41:05.137770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:20:21.012039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.137223+0000","last_change":"2024-05-10T08:41:03.133718+0000","last_active":"2024-05-10T08:41:05.137223+0000","last_peered":"2024-05-10T08:41:05.137223+0000","last_clean":"2024-05-10T08:41:05.137223+0000","last_became_active":"2024-05-10T08:41:03.133195+0000","last_became_peered":"2024-05-10T08:41:03.133195+0000","last_unstale":"2024-05-10T08:41:05.137223+0000","last_undegraded":"2024-05-10T08:41:05.137223+0000","last_fullsized":"2024-05-10T08:41:05.137223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:06.344814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.147092+0000","last_change":"2024-05-10T08:41:04.139698+0000","last_active":"2024-05-10T08:41:04.147092+0000","last_peered":"2024-05-10T08:41:04.147092+0000","last_clean":"2024-05-10T08:41:04.147092+0000","last_became_active":"2024-05-10T08:41:04.139440+0000","last_became_peered":"2024-05-10T08:41:04.139440+0000","last_unstale":"2024-05-10T08:41:04.147092+0000","last_undegraded":"2024-05-10T08:41:04.147092+0000","last_fullsized":"2024-05-10T08:41:04.147092+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:27.517416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.134576+0000","last_change":"2024-05-10T08:41:03.134395+0000","last_active":"2024-05-10T08:41:04.134576+0000","last_peered":"2024-05-10T08:41:04.134576+0000","last_clean":"2024-05-10T08:41:04.134576+0000","last_became_active":"2024-05-10T08:41:03.134052+0000","last_became_peered":"2024-05-10T08:41:03.134052+0000","last_unstale":"2024-05-10T08:41:04.134576+0000","last_undegraded":"2024-05-10T08:41:04.134576+0000","last_fullsized":"2024-05-10T08:41:04.134576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:41.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.144430+0000","last_change":"2024-05-10T08:41:04.136999+0000","last_active":"2024-05-10T08:41:04.144430+0000","last_peered":"2024-05-10T08:41:04.144430+0000","last_clean":"2024-05-10T08:41:04.144430+0000","last_became_active":"2024-05-10T08:41:04.136732+0000","last_became_peered":"2024-05-10T08:41:04.136732+0000","last_unstale":"2024-05-10T08:41:04.144430+0000","last_undegraded":"2024-05-10T08:41:04.144430+0000","last_fullsized":"2024-05-10T08:41:04.144430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:47.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.131466+0000","last_change":"2024-05-10T08:41:03.132590+0000","last_active":"2024-05-10T08:41:04.131466+0000","last_peered":"2024-05-10T08:41:04.131466+0000","last_clean":"2024-05-10T08:41:04.131466+0000","last_became_active":"2024-05-10T08:41:03.132101+0000","last_became_peered":"2024-05-10T08:41:03.132101+0000","last_unstale":"2024-05-10T08:41:04.131466+0000","last_undegraded":"2024-05-10T08:41:04.131466+0000","last_fullsized":"2024-05-10T08:41:04.131466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:14.479348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.141582+0000","last_change":"2024-05-10T08:41:04.138859+0000","last_active":"2024-05-10T08:41:04.141582+0000","last_peered":"2024-05-10T08:41:04.141582+0000","last_clean":"2024-05-10T08:41:04.141582+0000","last_became_active":"2024-05-10T08:41:04.138584+0000","last_became_peered":"2024-05-10T08:41:04.138584+0000","last_unstale":"2024-05-10T08:41:04.141582+0000","last_undegraded":"2024-05-10T08:41:04.141582+0000","last_fullsized":"2024-05-10T08:41:04.141582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:07.351668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.132756+0000","last_change":"2024-05-10T08:41:03.138459+0000","last_active":"2024-05-10T08:41:05.132756+0000","last_peered":"2024-05-10T08:41:05.132756+0000","last_clean":"2024-05-10T08:41:05.132756+0000","last_became_active":"2024-05-10T08:41:03.138191+0000","last_became_peered":"2024-05-10T08:41:03.138191+0000","last_unstale":"2024-05-10T08:41:05.132756+0000","last_undegraded":"2024-05-10T08:41:05.132756+0000","last_fullsized":"2024-05-10T08:41:05.132756+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:38.728207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T08:41:05.133248+0000","last_change":"2024-05-10T08:41:04.153312+0000","last_active":"2024-05-10T08:41:05.133248+0000","last_peered":"2024-05-10T08:41:05.133248+0000","last_clean":"2024-05-10T08:41:05.133248+0000","last_became_active":"2024-05-10T08:41:04.153023+0000","last_became_peered":"2024-05-10T08:41:04.153023+0000","last_unstale":"2024-05-10T08:41:05.133248+0000","last_undegraded":"2024-05-10T08:41:05.133248+0000","last_fullsized":"2024-05-10T08:41:05.133248+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:03.109516+0000","last_clean_scrub_stamp":"2024-05-10T08:41:03.109516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:23.594111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.129325+0000","last_change":"2024-05-10T08:41:03.123187+0000","last_active":"2024-05-10T08:41:04.129325+0000","last_peered":"2024-05-10T08:41:04.129325+0000","last_clean":"2024-05-10T08:41:04.129325+0000","last_became_active":"2024-05-10T08:41:03.122902+0000","last_became_peered":"2024-05-10T08:41:03.122902+0000","last_unstale":"2024-05-10T08:41:04.129325+0000","last_undegraded":"2024-05-10T08:41:04.129325+0000","last_fullsized":"2024-05-10T08:41:04.129325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:02.102661+0000","last_clean_scrub_stamp":"2024-05-10T08:41:02.102661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:34.383225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-10T08:41:04.130538+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:41:04.130538+0000","last_peered":"2024-05-10T08:41:04.130538+0000","last_clean":"2024-05-10T08:41:04.130538+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:41:04.130538+0000","last_undegraded":"2024-05-10T08:41:04.130538+0000","last_fullsized":"2024-05-10T08:41:04.130538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":767420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":175952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":175974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":177016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":175440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":175460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1011712,"data_stored":765772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:41:08.548 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:41:08.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T08:41:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.695+0000 7f7841aa0640 1 Processor -- start 2024-05-10T08:41:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.696+0000 7f7841aa0640 1 -- start start 2024-05-10T08:41:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.696+0000 7f7841aa0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f783c15f4e0 0x7f783c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.696+0000 7f7841aa0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.696+0000 7f7841aa0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c0d0320 con 0x7f783c0d3aa0 2024-05-10T08:41:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.696+0000 7f7841aa0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f783c0d0600 con 0x7f783c15f4e0 2024-05-10T08:41:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.696+0000 7f7841aa0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f783c0d08e0 con 0x7f783c0d56b0 2024-05-10T08:41:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.696+0000 7f783b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f783c15f4e0 0x7f783c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f783c15f4e0 0x7f783c0cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41438/0 (socket says 172.21.15.37:41438) 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783b7fe640 1 -- 172.21.15.37:0/3077015793 learned_addr learned my addr 172.21.15.37:0/3077015793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783bfff640 1 --2- 172.21.15.37:0/3077015793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783b7fe640 1 -- 172.21.15.37:0/3077015793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 msgr2=0x7f783c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783b7fe640 1 --2- 172.21.15.37:0/3077015793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c0d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783b7fe640 1 -- 172.21.15.37:0/3077015793 >> v1:172.21.15.82:6789/0 conn(0x7f783c0d3aa0 legacy=0x7f783c0d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783b7fe640 1 -- 172.21.15.37:0/3077015793 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c0d0bc0 con 0x7f783c15f4e0 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783bfff640 1 --2- 172.21.15.37:0/3077015793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.697+0000 7f783b7fe640 1 --2- 172.21.15.37:0/3077015793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c0cfcd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f782c009870 tx=0x7f782c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d743a39556463703 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f783a7fc640 1 -- 172.21.15.37:0/3077015793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c037070 con 0x7f783c15f4e0 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f783a7fc640 1 -- 172.21.15.37:0/3077015793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c032440 con 0x7f783c15f4e0 2024-05-10T08:41:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f783a7fc640 1 -- 172.21.15.37:0/3077015793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c032810 con 0x7f783c15f4e0 2024-05-10T08:41:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 -- 172.21.15.37:0/3077015793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 msgr2=0x7f783c0cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3077015793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c0cfcd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f782c009870 tx=0x7f782c02a270 comp rx=0 tx=0).stop 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 -- 172.21.15.37:0/3077015793 shutdown_connections 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3077015793 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3077015793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c0cfcd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 -- 172.21.15.37:0/3077015793 >> 172.21.15.37:0/3077015793 conn(0x7f783c08eac0 msgr2=0x7f783c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 -- 172.21.15.37:0/3077015793 shutdown_connections 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.698+0000 7f7841aa0640 1 -- 172.21.15.37:0/3077015793 wait complete. 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.699+0000 7f7841aa0640 1 Processor -- start 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f7841aa0640 1 -- start start 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f7841aa0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c0d3aa0 0x7f783c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f7841aa0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f7841aa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c162330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f7841aa0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0d3f00 con 0x7f783c15f4e0 2024-05-10T08:41:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f7841aa0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f783c15f8c0 con 0x7f783c0d3aa0 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f7841aa0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f783c0d4080 con 0x7f783c0d56b0 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f783bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.700+0000 7f783bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c162330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41440/0 (socket says 172.21.15.37:41440) 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783bfff640 1 -- 172.21.15.37:0/3833966956 learned_addr learned my addr 172.21.15.37:0/3833966956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783b7fe640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c0d3aa0 0x7f783c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783affd640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783bfff640 1 -- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 msgr2=0x7f783c15fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783bfff640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c15fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783bfff640 1 -- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c0d3aa0 msgr2=0x7f783c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783bfff640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c0d3aa0 0x7f783c0ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783bfff640 1 -- 172.21.15.37:0/3833966956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c1601b0 con 0x7f783c15f4e0 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783b7fe640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c0d3aa0 0x7f783c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f783bfff640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c162330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7834007f20 tx=0x7f783400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f7823fff640 1 -- 172.21.15.37:0/3833966956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783401a070 con 0x7f783c15f4e0 2024-05-10T08:41:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f7823fff640 1 -- 172.21.15.37:0/3833966956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834003b90 con 0x7f783c15f4e0 2024-05-10T08:41:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c160490 con 0x7f783c15f4e0 2024-05-10T08:41:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f7823fff640 1 -- 172.21.15.37:0/3833966956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834004030 con 0x7f783c15f4e0 2024-05-10T08:41:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.701+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c160a50 con 0x7f783c15f4e0 2024-05-10T08:41:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.702+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783c0693f0 con 0x7f783c15f4e0 2024-05-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.703+0000 7f7823fff640 1 -- 172.21.15.37:0/3833966956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f783401d070 con 0x7f783c15f4e0 2024-05-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.703+0000 7f7823fff640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78280762d0 0x7f7828078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.704+0000 7f7823fff640 1 -- 172.21.15.37:0/3833966956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f7834097a90 con 0x7f783c15f4e0 2024-05-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.704+0000 7f783b7fe640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78280762d0 0x7f7828078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.704+0000 7f783b7fe640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78280762d0 0x7f7828078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f782c034000 tx=0x7f782c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.708+0000 7f7823fff640 1 -- 172.21.15.37:0/3833966956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7834010070 con 0x7f783c15f4e0 2024-05-10T08:41:08.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.974+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f783c069bf0 con 0x7f783c15f4e0 2024-05-10T08:41:08.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.976+0000 7f7823fff640 1 -- 172.21.15.37:0/3833966956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f7834061260 con 0x7f783c15f4e0 2024-05-10T08:41:08.976 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:41:08.976 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:41:08.976 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-10T08:41:08.976 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-10T08:41:08.976 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T08:41:08.976 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-10T08:41:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78280762d0 msgr2=0x7f7828078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78280762d0 0x7f7828078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f782c034000 tx=0x7f782c02e000 comp rx=0 tx=0).stop 2024-05-10T08:41:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 msgr2=0x7f783c162330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c162330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7834007f20 tx=0x7f783400d560 comp rx=0 tx=0).stop 2024-05-10T08:41:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 shutdown_connections 2024-05-10T08:41:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78280762d0 0x7f7828078790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f783c15f4e0 0x7f783c162330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f783c0d56b0 0x7f783c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 --2- 172.21.15.37:0/3833966956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c0d3aa0 0x7f783c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:08.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 >> 172.21.15.37:0/3833966956 conn(0x7f783c08eac0 msgr2=0x7f783c15e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:08.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 shutdown_connections 2024-05-10T08:41:08.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:08.978+0000 7f7841aa0640 1 -- 172.21.15.37:0/3833966956 wait complete. 2024-05-10T08:41:08.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:09.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.092+0000 7f56b8322640 1 Processor -- start 2024-05-10T08:41:09.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.092+0000 7f56b8322640 1 -- start start 2024-05-10T08:41:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.093+0000 7f56b8322640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56b00d1970 0x7f56b00d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.093+0000 7f56b8322640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b00d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.093+0000 7f56b8322640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b01630b0 con 0x7f56b015f420 2024-05-10T08:41:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.093+0000 7f56b8322640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f56b00d3e70 con 0x7f56b00d1970 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.093+0000 7f56b8322640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f56b00d5670 con 0x7f56b00d4cc0 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.093+0000 7f56b58bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56b00d1970 0x7f56b00d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b58bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56b00d1970 0x7f56b00d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41446/0 (socket says 172.21.15.37:41446) 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b58bd640 1 -- 172.21.15.37:0/606223285 learned_addr learned my addr 172.21.15.37:0/606223285 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b68bf640 1 --2- 172.21.15.37:0/606223285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b00d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b58bd640 1 -- 172.21.15.37:0/606223285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 msgr2=0x7f56b00d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b58bd640 1 --2- 172.21.15.37:0/606223285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b00d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b58bd640 1 -- 172.21.15.37:0/606223285 >> v1:172.21.15.82:6789/0 conn(0x7f56b015f420 legacy=0x7f56b00d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b58bd640 1 -- 172.21.15.37:0/606223285 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b00d2550 con 0x7f56b00d1970 2024-05-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b68bf640 1 --2- 172.21.15.37:0/606223285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b00d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.094+0000 7f56b58bd640 1 --2- 172.21.15.37:0/606223285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b00d1970 0x7f56b00d1e20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f56b008f380 tx=0x7f56a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf04d98ab2c27f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b50bc640 1 -- 172.21.15.37:0/606223285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4037070 con 0x7f56b00d1970 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b50bc640 1 -- 172.21.15.37:0/606223285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a4032440 con 0x7f56b00d1970 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b50bc640 1 -- 172.21.15.37:0/606223285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4032810 con 0x7f56b00d1970 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 -- 172.21.15.37:0/606223285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b00d1970 msgr2=0x7f56b00d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 --2- 172.21.15.37:0/606223285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b00d1970 0x7f56b00d1e20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f56b008f380 tx=0x7f56a402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 -- 172.21.15.37:0/606223285 shutdown_connections 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 --2- 172.21.15.37:0/606223285 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b00d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 --2- 172.21.15.37:0/606223285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b00d1970 0x7f56b00d1e20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 -- 172.21.15.37:0/606223285 >> 172.21.15.37:0/606223285 conn(0x7f56b008eac0 msgr2=0x7f56b009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 -- 172.21.15.37:0/606223285 shutdown_connections 2024-05-10T08:41:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.095+0000 7f56b8322640 1 -- 172.21.15.37:0/606223285 wait complete. 2024-05-10T08:41:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 Processor -- start 2024-05-10T08:41:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 -- start start 2024-05-10T08:41:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b00d1970 0x7f56b0151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b01ea740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b01eac80 0x7f56b00c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56b00d3240 con 0x7f56b01eac80 2024-05-10T08:41:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56b00d2f60 con 0x7f56b00d1970 2024-05-10T08:41:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b8322640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f56b00d2830 con 0x7f56b00d4cc0 2024-05-10T08:41:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b68bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b01eac80 0x7f56b00c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b68bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b01eac80 0x7f56b00c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41452/0 (socket says 172.21.15.37:41452) 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.097+0000 7f56b68bf640 1 -- 172.21.15.37:0/1732009654 learned_addr learned my addr 172.21.15.37:0/1732009654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b60be640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b00d1970 0x7f56b0151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b58bd640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b01ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b68bf640 1 -- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 msgr2=0x7f56b01ea740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b68bf640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b01ea740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b68bf640 1 -- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b00d1970 msgr2=0x7f56b0151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b68bf640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b00d1970 0x7f56b0151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b68bf640 1 -- 172.21.15.37:0/1732009654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b0151940 con 0x7f56b01eac80 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b60be640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b00d1970 0x7f56b0151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b68bf640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b01eac80 0x7f56b00c8b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f56a000cef0 tx=0x7f56a000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56aeffd640 1 -- 172.21.15.37:0/1732009654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a001a070 con 0x7f56b01eac80 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56aeffd640 1 -- 172.21.15.37:0/1732009654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a000d860 con 0x7f56b01eac80 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b00c98c0 con 0x7f56b01eac80 2024-05-10T08:41:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56aeffd640 1 -- 172.21.15.37:0/1732009654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a000dc50 con 0x7f56b01eac80 2024-05-10T08:41:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.098+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b00c9e80 con 0x7f56b01eac80 2024-05-10T08:41:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.099+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b00b8730 con 0x7f56b01eac80 2024-05-10T08:41:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.100+0000 7f56aeffd640 1 -- 172.21.15.37:0/1732009654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f56a001d070 con 0x7f56b01eac80 2024-05-10T08:41:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.100+0000 7f56aeffd640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f569c076300 0x7f569c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.100+0000 7f56aeffd640 1 -- 172.21.15.37:0/1732009654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f56a0098050 con 0x7f56b01eac80 2024-05-10T08:41:09.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.100+0000 7f56b60be640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f569c076300 0x7f569c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.101+0000 7f56b60be640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f569c076300 0x7f569c0787c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56a8006fd0 tx=0x7f56a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.104+0000 7f56aeffd640 1 -- 172.21.15.37:0/1732009654 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f56a00618e0 con 0x7f56b01eac80 2024-05-10T08:41:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.336+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56b00b4c50 con 0x7f56b01eac80 2024-05-10T08:41:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.337+0000 7f56aeffd640 1 -- 172.21.15.37:0/1732009654 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7f56a00611e0 con 0x7f56b01eac80 2024-05-10T08:41:09.337 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:09.337 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f569c076300 msgr2=0x7f569c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f569c076300 0x7f569c0787c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56a8006fd0 tx=0x7f56a8008040 comp rx=0 tx=0).stop 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b01eac80 msgr2=0x7f56b00c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b01eac80 0x7f56b00c8b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f56a000cef0 tx=0x7f56a000a710 comp rx=0 tx=0).stop 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 shutdown_connections 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f569c076300 0x7f569c0787c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56b01eac80 0x7f56b00c8b70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f56b00d4cc0 0x7f56b01ea740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 --2- 172.21.15.37:0/1732009654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b00d1970 0x7f56b0151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 >> 172.21.15.37:0/1732009654 conn(0x7f56b008eac0 msgr2=0x7f56b006e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 shutdown_connections 2024-05-10T08:41:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.339+0000 7f56b8322640 1 -- 172.21.15.37:0/1732009654 wait complete. 2024-05-10T08:41:09.752 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:41:03.495274+0000', 'modified': '2024-05-10T08:41:06.523590+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4884': {'gid': 4884, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/3398451943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3398451943}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3398451943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4884, 'qdb_cluster': [4884]} 2024-05-10T08:41:09.752 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:41:09.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:41:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.864+0000 7f00ba90a640 1 Processor -- start 2024-05-10T08:41:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.864+0000 7f00ba90a640 1 -- start start 2024-05-10T08:41:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.865+0000 7f00ba90a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00b415bc80 0x7f00b406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.865+0000 7f00ba90a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b40b4590 con 0x7f00b406e8d0 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.865+0000 7f00ba90a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b40b4870 con 0x7f00b41524f0 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.865+0000 7f00ba90a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f00b406ed40 con 0x7f00b415bc80 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.865+0000 7f00b8ea7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f00b406e8d0 0x7f00b4073700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52894/0 (socket says 172.21.15.37:52894) 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.865+0000 7f00b8ea7640 1 -- 172.21.15.37:0/848621796 learned_addr learned my addr 172.21.15.37:0/848621796 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.865+0000 7f00b37fe640 1 --2- 172.21.15.37:0/848621796 >> v2:172.21.15.82:3300/0 conn(0x7f00b415bc80 0x7f00b406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.866+0000 7f00b2ffd640 1 -- 172.21.15.37:0/848621796 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768069435 0 0) 0x7f00b40b4590 con 0x7f00b406e8d0 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.866+0000 7f00b2ffd640 1 -- 172.21.15.37:0/848621796 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003520 con 0x7f00b406e8d0 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.866+0000 7f00b2ffd640 1 -- 172.21.15.37:0/848621796 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294062569 0 0) 0x7f00b40b4870 con 0x7f00b41524f0 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.866+0000 7f00b2ffd640 1 -- 172.21.15.37:0/848621796 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b40b4590 con 0x7f00b41524f0 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.866+0000 7f00b37fe640 1 -- 172.21.15.37:0/848621796 >> v1:172.21.15.82:6789/0 conn(0x7f00b41524f0 legacy=0x7f00b40b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.866+0000 7f00b37fe640 1 -- 172.21.15.37:0/848621796 >> v1:172.21.15.37:6789/0 conn(0x7f00b406e8d0 legacy=0x7f00b4073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.866+0000 7f00b37fe640 1 -- 172.21.15.37:0/848621796 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b40b4b50 con 0x7f00b415bc80 2024-05-10T08:41:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00b37fe640 1 --2- 172.21.15.37:0/848621796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b415bc80 0x7f00b406e390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00a80097a0 tx=0x7f00a802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d69fb491c39454d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00b2ffd640 1 -- 172.21.15.37:0/848621796 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8037070 con 0x7f00b415bc80 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00b2ffd640 1 -- 172.21.15.37:0/848621796 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a8032440 con 0x7f00b415bc80 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00b2ffd640 1 -- 172.21.15.37:0/848621796 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80327f0 con 0x7f00b415bc80 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00ba90a640 1 -- 172.21.15.37:0/848621796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b415bc80 msgr2=0x7f00b406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00ba90a640 1 --2- 172.21.15.37:0/848621796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b415bc80 0x7f00b406e390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00a80097a0 tx=0x7f00a802a230 comp rx=0 tx=0).stop 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00ba90a640 1 -- 172.21.15.37:0/848621796 shutdown_connections 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.867+0000 7f00ba90a640 1 --2- 172.21.15.37:0/848621796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b415bc80 0x7f00b406e390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.868+0000 7f00ba90a640 1 -- 172.21.15.37:0/848621796 >> 172.21.15.37:0/848621796 conn(0x7f00b406c3a0 msgr2=0x7f00b406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.868+0000 7f00ba90a640 1 -- 172.21.15.37:0/848621796 shutdown_connections 2024-05-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.868+0000 7f00ba90a640 1 -- 172.21.15.37:0/848621796 wait complete. 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.869+0000 7f00ba90a640 1 Processor -- start 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.869+0000 7f00ba90a640 1 -- start start 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00ba90a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b406e8d0 0x7f00b4147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00ba90a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b41524f0 0x7f00b41576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00ba90a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f00b415bc80 0x7f00b414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00ba90a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4073450 con 0x7f00b41524f0 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00ba90a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00b40b51a0 con 0x7f00b406e8d0 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00ba90a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f00b40b4330 con 0x7f00b415bc80 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b41524f0 0x7f00b41576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b41524f0 0x7f00b41576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41460/0 (socket says 172.21.15.37:41460) 2024-05-10T08:41:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 -- 172.21.15.37:0/2829646892 learned_addr learned my addr 172.21.15.37:0/2829646892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f00b415bc80 0x7f00b414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b3fff640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b406e8d0 0x7f00b4147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 -- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f00b415bc80 msgr2=0x7f00b414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f00b415bc80 0x7f00b414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 -- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b406e8d0 msgr2=0x7f00b4147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b406e8d0 0x7f00b4147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 -- 172.21.15.37:0/2829646892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b41581b0 con 0x7f00b41524f0 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.870+0000 7f00b37fe640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b41524f0 0x7f00b41576f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f00a802a270 tx=0x7f00a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.871+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2829646892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8041030 con 0x7f00b41524f0 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.871+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2829646892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a803d4e0 con 0x7f00b41524f0 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.871+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2829646892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8037040 con 0x7f00b41524f0 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.871+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b4158490 con 0x7f00b41524f0 2024-05-10T08:41:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.871+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b40b0cd0 con 0x7f00b41524f0 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.872+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2829646892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00a8044070 con 0x7f00b41524f0 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.873+0000 7f00b0ff9640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f00a0076300 0x7f00a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.873+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2829646892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f00a80b76d0 con 0x7f00b41524f0 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.873+0000 7f00b3fff640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f00a0076300 0x7f00a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.874+0000 7f00b3fff640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f00a0076300 0x7f00a00787c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00a40011e0 tx=0x7f00a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.874+0000 7f00bd627740 1 Processor -- start 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.874+0000 7f00bd627740 1 -- start start 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf67760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf67ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00bd627740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf37bb0 0x55bbedf3b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00bd627740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bbedea18d0 con 0x55bbedf37bb0 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bbede5ac10 con 0x55bbedf65330 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55bbede9d890 con 0x55bbedf64f50 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf37bb0 0x55bbedf3b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf37bb0 0x55bbedf3b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41476/0 (socket says 172.21.15.37:41476) 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 -- 172.21.15.37:0/466199608 learned_addr learned my addr 172.21.15.37:0/466199608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b3fff640 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf67760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b37fe640 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf67ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 -- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 msgr2=0x55bbedf67760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf67760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 -- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 msgr2=0x55bbedf67ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf67ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 -- 172.21.15.37:0/466199608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbede625d0 con 0x55bbedf37bb0 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf37bb0 0x55bbedf3b3c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f00ac002020 tx=0x7f00ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e828558dc1cc79 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f009a7fc640 1 -- 172.21.15.37:0/466199608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac019070 con 0x55bbedf37bb0 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f009a7fc640 1 -- 172.21.15.37:0/466199608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac00edf0 con 0x55bbedf37bb0 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.875+0000 7f009a7fc640 1 -- 172.21.15.37:0/466199608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac014680 con 0x55bbedf37bb0 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 -- 172.21.15.37:0/466199608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf37bb0 msgr2=0x55bbedf3b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf37bb0 0x55bbedf3b3c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f00ac002020 tx=0x7f00ac00e530 comp rx=0 tx=0).stop 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 -- 172.21.15.37:0/466199608 shutdown_connections 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf37bb0 0x55bbedf3b3c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf67ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 --2- 172.21.15.37:0/466199608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf67760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 -- 172.21.15.37:0/466199608 >> 172.21.15.37:0/466199608 conn(0x55bbedf39e20 msgr2=0x55bbedf82760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 -- 172.21.15.37:0/466199608 shutdown_connections 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.876+0000 7f00bd627740 1 -- 172.21.15.37:0/466199608 wait complete. 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 -- start start 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 Processor -- start 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf64f50 0x55bbedf68770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf65330 0x55bbedf62280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bbedf3cfd0 con 0x55bbedf5fa30 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bbede5e760 con 0x55bbedf64f50 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.877+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55bbedf3d2b0 con 0x55bbedf65330 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00bd627740 10 client.0 _ll_register_callbacks cb 0x55bbede97cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:09.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf85260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41486/0 (socket says 172.21.15.37:41486) 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 -- 172.21.15.37:0/401942375 learned_addr learned my addr 172.21.15.37:0/401942375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b3fff640 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf64f50 0x55bbedf68770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b37fe640 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf65330 0x55bbedf62280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 -- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf65330 msgr2=0x55bbedf62280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf65330 0x55bbedf62280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 -- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf64f50 msgr2=0x55bbedf68770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf64f50 0x55bbedf68770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 -- 172.21.15.37:0/401942375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbedbb32d0 con 0x55bbedf5fa30 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf85260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009010 tx=0x7f00ac001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb8e2adc7740645 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f0092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f0092ffd640 1 -- 172.21.15.37:0/401942375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac024060 con 0x55bbedf5fa30 2024-05-10T08:41:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f0092ffd640 1 -- 172.21.15.37:0/401942375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f00ac014a30 con 0x55bbedf5fa30 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00ac00edf0 con 0x55bbedf5fa30 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f0092ffd640 1 -- 172.21.15.37:0/401942375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f00ac02a050 con 0x55bbedf5fa30 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00bd627740 10 client.5040 fetch_fsmap learned FSMap version 18 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.878+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55bbedc7d6b0 con 0x55bbedf5fa30 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f0092ffd640 1 -- 172.21.15.37:0/401942375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac00edf0 con 0x55bbedf5fa30 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f0092ffd640 1 -- 172.21.15.37:0/401942375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f00ac02d020 con 0x55bbedf5fa30 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00bd627740 10 client.5040 fetch_fsmap finished waiting for FSMap version 18 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00bd627740 10 client.5040 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00bd627740 20 client.5040 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00bd627740 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf9ef70 0x55bbedfa1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00bd627740 4 client.5040 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 --> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbede25760 con 0x55bbedf9ef70 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00b3fff640 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf9ef70 0x55bbedfa1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f0092ffd640 10 client.5040 ms_handle_connect on v2:172.21.15.37:6833/3398451943 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.879+0000 7f00b3fff640 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf9ef70 0x55bbedfa1360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=409178e81aecf3e4 server_cookie=b39374b0dd59138e in_seq=0 out_seq=0 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f0092ffd640 1 -- 172.21.15.37:0/401942375 <== mds.0 v2:172.21.15.37:6833/3398451943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bbede25760 con 0x55bbedf9ef70 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f0092ffd640 10 client.5040 handle_command_reply: tid=0 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 client.5040 shutdown 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 msgr2=0x55bbedf85260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf85260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009010 tx=0x7f00ac001250 comp rx=0 tx=0).stop 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 shutdown_connections 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf9ef70 0x55bbedfa1360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf85260 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf65330 0x55bbedf62280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f0092ffd640 0 client.5040 ms_handle_reset on v2:172.21.15.37:6833/3398451943 2024-05-10T08:41:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 --2- 172.21.15.37:0/401942375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf64f50 0x55bbedf68770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 >> 172.21.15.37:0/401942375 conn(0x55bbedf37bb0 msgr2=0x55bbedf3c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 shutdown_connections 2024-05-10T08:41:09.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.880+0000 7f00bd627740 1 -- 172.21.15.37:0/401942375 wait complete. 2024-05-10T08:41:09.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.881+0000 7f00bd627740 20 client.5040 trim_cache size 0 max 16384 2024-05-10T08:41:09.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.922+0000 7f00bd627740 1 Processor -- start 2024-05-10T08:41:09.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.922+0000 7f00bd627740 1 -- start start 2024-05-10T08:41:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00bd627740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf8a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedff7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf84d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00bd627740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4200c20 con 0x55bbedf5fa30 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00b40b1b50 con 0x55bbedf65330 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f00b40b21a0 con 0x55bbedf64f50 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf8a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf8a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41498/0 (socket says 172.21.15.37:41498) 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 -- 172.21.15.37:0/2121037954 learned_addr learned my addr 172.21.15.37:0/2121037954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf84d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b37fe640 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedff7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 -- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 msgr2=0x55bbedff7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedff7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 -- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 msgr2=0x55bbedf84d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf84d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b3fff640 1 -- 172.21.15.37:0/2121037954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbedf62a80 con 0x55bbedf5fa30 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.923+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf84d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00b3fff640 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf8a040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00a4001d90 tx=0x7f00a4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebd78b5578a2626 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f0099ffb640 1 -- 172.21.15.37:0/2121037954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a402c070 con 0x55bbedf5fa30 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f0099ffb640 1 -- 172.21.15.37:0/2121037954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a40035f0 con 0x55bbedf5fa30 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f0099ffb640 1 -- 172.21.15.37:0/2121037954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a40037a0 con 0x55bbedf5fa30 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00bd627740 1 -- 172.21.15.37:0/2121037954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 msgr2=0x55bbedf8a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00bd627740 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf8a040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00a4001d90 tx=0x7f00a4012000 comp rx=0 tx=0).stop 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00bd627740 1 -- 172.21.15.37:0/2121037954 shutdown_connections 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00bd627740 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf84d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00bd627740 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedff7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00bd627740 1 --2- 172.21.15.37:0/2121037954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedf8a040 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.924+0000 7f00bd627740 1 -- 172.21.15.37:0/2121037954 >> 172.21.15.37:0/2121037954 conn(0x55bbedf37bb0 msgr2=0x55bbedf82760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.925+0000 7f00bd627740 1 -- 172.21.15.37:0/2121037954 shutdown_connections 2024-05-10T08:41:09.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.925+0000 7f00bd627740 1 -- 172.21.15.37:0/2121037954 wait complete. 2024-05-10T08:41:09.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.925+0000 7f00bd627740 1 -- start start 2024-05-10T08:41:09.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.925+0000 7f00bd627740 1 Processor -- start 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00bd627740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedff6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf78a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00bd627740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf8a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00bd627740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bbedf62900 con 0x55bbedf5fa30 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bbedf68d60 con 0x55bbedf65330 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00bd627740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55bbedf85a10 con 0x55bbedf64f50 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00bd627740 10 client.0 _ll_register_callbacks cb 0x7f00ac017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedff6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedff6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41514/0 (socket says 172.21.15.37:41514) 2024-05-10T08:41:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 -- 172.21.15.37:0/614146471 learned_addr learned my addr 172.21.15.37:0/614146471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b37fe640 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf78a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b8ea7640 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf8a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 -- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 msgr2=0x55bbedf78a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf78a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 -- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 msgr2=0x55bbedf8a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf8a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 -- 172.21.15.37:0/614146471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbedf8ac10 con 0x55bbedf5fa30 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f00b3fff640 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedff6fe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f00a402a040 tx=0x7f00a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd06201546481d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.926+0000 7f0092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f0092ffd640 1 -- 172.21.15.37:0/614146471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4035060 con 0x55bbedf5fa30 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f0092ffd640 1 -- 172.21.15.37:0/614146471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f00a4003de0 con 0x55bbedf5fa30 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a40035f0 con 0x55bbedf5fa30 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f0092ffd640 1 -- 172.21.15.37:0/614146471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f00a402c070 con 0x55bbedf5fa30 2024-05-10T08:41:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 10 client.5046 fetch_fsmap learned FSMap version 18 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55bbedf780f0 con 0x55bbedf5fa30 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f0092ffd640 1 -- 172.21.15.37:0/614146471 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a40035f0 con 0x55bbedf5fa30 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f0092ffd640 1 -- 172.21.15.37:0/614146471 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f00a40270e0 con 0x55bbedf5fa30 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 10 client.5046 fetch_fsmap finished waiting for FSMap version 18 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 10 client.5046 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 20 client.5046 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf8a580 0x55bbedf6ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 4 client.5046 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 --> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] -- command(tid 0: {"prefix": "status"}) -- 0x55bbedeaf4e0 con 0x55bbedf8a580 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.927+0000 7f00b37fe640 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf8a580 0x55bbedf6ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f0092ffd640 10 client.5046 ms_handle_connect on v2:172.21.15.37:6833/3398451943 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00b37fe640 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf8a580 0x55bbedf6ad30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f0624dffca7a700 server_cookie=df7ad03e7213a34a in_seq=0 out_seq=0 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f0092ffd640 1 -- 172.21.15.37:0/614146471 <== mds.0 v2:172.21.15.37:6833/3398451943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55bbedeaf4e0 con 0x55bbedf8a580 2024-05-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f0092ffd640 10 client.5046 handle_command_reply: tid=0 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 client.5046 shutdown 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 msgr2=0x55bbedff6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedff6fe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f00a402a040 tx=0x7f00a4000ed0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 shutdown_connections 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:6833/3398451943,v1:172.21.15.37:6835/3398451943] conn(0x55bbedf8a580 0x55bbedf6ad30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbedf65330 0x55bbedf8a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bbedf64f50 0x55bbedf78a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f0092ffd640 0 client.5046 ms_handle_reset on v2:172.21.15.37:6833/3398451943 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 --2- 172.21.15.37:0/614146471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbedf5fa30 0x55bbedff6fe0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 >> 172.21.15.37:0/614146471 conn(0x55bbedf37bb0 msgr2=0x55bbedf84c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 shutdown_connections 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 1 -- 172.21.15.37:0/614146471 wait complete. 2024-05-10T08:41:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.928+0000 7f00bd627740 20 client.5046 trim_cache size 0 max 16384 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4884, 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.7941632189999996, 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 18, 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 37, 2024-05-10T08:41:09.935 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 37, 2024-05-10T08:41:09.936 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 12.683098693 2024-05-10T08:41:09.936 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:41:09.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f00a0076300 msgr2=0x7f00a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f00a0076300 0x7f00a00787c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00a40011e0 tx=0x7f00a4009040 comp rx=0 tx=0).stop 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b41524f0 msgr2=0x7f00b41576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b41524f0 0x7f00b41576f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f00a802a270 tx=0x7f00a80046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 shutdown_connections 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f00a0076300 0x7f00a00787c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f00b415bc80 0x7f00b414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b41524f0 0x7f00b41576f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 --2- 172.21.15.37:0/2829646892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b406e8d0 0x7f00b4147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 >> 172.21.15.37:0/2829646892 conn(0x7f00b406c3a0 msgr2=0x7f00b4151710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 shutdown_connections 2024-05-10T08:41:09.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:09.929+0000 7f00ba90a640 1 -- 172.21.15.37:0/2829646892 wait complete. 2024-05-10T08:41:09.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:41:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.045+0000 7fc8f1409640 1 Processor -- start 2024-05-10T08:41:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.045+0000 7fc8f1409640 1 -- start start 2024-05-10T08:41:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.046+0000 7fc8f1409640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc8ec15f420 0x7fc8ec0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.046+0000 7fc8f1409640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8ec1630b0 con 0x7fc8ec0d3ca0 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.046+0000 7fc8f1409640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8ec0d2550 con 0x7fc8ec0d2080 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.046+0000 7fc8f1409640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc8ec0d2c80 con 0x7fc8ec15f420 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.046+0000 7fc8e3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc8ec0d3ca0 0x7fc8ec0d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52904/0 (socket says 172.21.15.37:52904) 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.046+0000 7fc8e3fff640 1 -- 172.21.15.37:0/1215415747 learned_addr learned my addr 172.21.15.37:0/1215415747 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.046+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1215415747 >> v2:172.21.15.82:3300/0 conn(0x7fc8ec15f420 0x7fc8ec0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283234628 0 0) 0x7fc8d4001110 con 0x7fc8ec0d3ca0 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8d8003520 con 0x7fc8ec0d3ca0 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 983200567 0 0) 0x7fc8d8003520 con 0x7fc8ec0d3ca0 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 >> v2:172.21.15.82:3300/0 conn(0x7fc8ec15f420 msgr2=0x7fc8ec0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 --2- 172.21.15.37:0/1215415747 >> v2:172.21.15.82:3300/0 conn(0x7fc8ec15f420 0x7fc8ec0d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 >> v1:172.21.15.82:6789/0 conn(0x7fc8ec0d2080 legacy=0x7fc8ec0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec0d2f60 con 0x7fc8ec0d3ca0 2024-05-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fc8d4001840 con 0x7fc8ec0d3ca0 2024-05-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 >> v1:172.21.15.37:6789/0 conn(0x7fc8ec0d3ca0 legacy=0x7fc8ec0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8d80039b0 0x7fc8d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80043b0 0x7fc8d8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d8005080 0x7fc8d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec0d2c80 con 0x7fc8d80039b0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d800bfe0 con 0x7fc8d8005080 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d800c1e0 con 0x7fc8d80043b0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8d80039b0 0x7fc8d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8e3fff640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80043b0 0x7fc8d8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eb7fe640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d8005080 0x7fc8d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eaffd640 1 -- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80043b0 msgr2=0x7fc8d8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80043b0 0x7fc8d8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eaffd640 1 -- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d8005080 msgr2=0x7fc8d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d8005080 0x7fc8d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eaffd640 1 -- 172.21.15.37:0/1215415747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d8003520 con 0x7fc8d80039b0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.047+0000 7fc8eb7fe640 1 -- 172.21.15.37:0/1215415747 reap_dead start 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.048+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8d80039b0 0x7fc8d8003d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009ac0 tx=0x7fc8d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a40b14fd1a5fba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.048+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc036070 con 0x7fc8d80039b0 2024-05-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.048+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8dc031400 con 0x7fc8d80039b0 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.048+0000 7fc8ea7fc640 1 -- 172.21.15.37:0/1215415747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc009690 con 0x7fc8d80039b0 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.049+0000 7fc8f1409640 1 -- 172.21.15.37:0/1215415747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8d80039b0 msgr2=0x7fc8d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.049+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8d80039b0 0x7fc8d8003d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009ac0 tx=0x7fc8d8005830 comp rx=0 tx=0).stop 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.049+0000 7fc8f1409640 1 -- 172.21.15.37:0/1215415747 shutdown_connections 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.049+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1215415747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8d80039b0 0x7fc8d8003d90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.049+0000 7fc8f1409640 1 -- 172.21.15.37:0/1215415747 >> 172.21.15.37:0/1215415747 conn(0x7fc8ec08eac0 msgr2=0x7fc8ec09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.049+0000 7fc8f1409640 1 -- 172.21.15.37:0/1215415747 shutdown_connections 2024-05-10T08:41:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.049+0000 7fc8f1409640 1 -- 172.21.15.37:0/1215415747 wait complete. 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.051+0000 7fc8f1409640 1 Processor -- start 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.051+0000 7fc8f1409640 1 -- start start 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8f1409640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80039b0 0x7fc8ec153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8f1409640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8ec15f880 0x7fc8ec0b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8f1409640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8ec0ca820 0x7fc8ec0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8f1409640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec0d3760 con 0x7fc8ec15f880 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8f1409640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec0d2830 con 0x7fc8ec0ca820 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8f1409640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec0d38e0 con 0x7fc8d80039b0 2024-05-10T08:41:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8ec15f880 0x7fc8ec0b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8ec15f880 0x7fc8ec0b7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41542/0 (socket says 172.21.15.37:41542) 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8e3fff640 1 -- 172.21.15.37:0/1243865609 learned_addr learned my addr 172.21.15.37:0/1243865609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80039b0 0x7fc8ec153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.052+0000 7fc8eb7fe640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8ec0ca820 0x7fc8ec0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e3fff640 1 -- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80039b0 msgr2=0x7fc8ec153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e3fff640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80039b0 0x7fc8ec153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e3fff640 1 -- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8ec0ca820 msgr2=0x7fc8ec0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e3fff640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8ec0ca820 0x7fc8ec0b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e3fff640 1 -- 172.21.15.37:0/1243865609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec15fd10 con 0x7fc8ec15f880 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e3fff640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8ec15f880 0x7fc8ec0b7e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4001290 tx=0x7fc8d40074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e37fe640 1 -- 172.21.15.37:0/1243865609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4007740 con 0x7fc8ec15f880 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e37fe640 1 -- 172.21.15.37:0/1243865609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8d4018070 con 0x7fc8ec15f880 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ec15fff0 con 0x7fc8ec15f880 2024-05-10T08:41:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8e37fe640 1 -- 172.21.15.37:0/1243865609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400fbe0 con 0x7fc8ec15f880 2024-05-10T08:41:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.053+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ec160890 con 0x7fc8ec15f880 2024-05-10T08:41:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.054+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8ec1603e0 con 0x7fc8ec15f880 2024-05-10T08:41:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.055+0000 7fc8e37fe640 1 -- 172.21.15.37:0/1243865609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc8d401d460 con 0x7fc8ec15f880 2024-05-10T08:41:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.055+0000 7fc8e37fe640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc8cc076470 0x7fc8cc078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.055+0000 7fc8e37fe640 1 -- 172.21.15.37:0/1243865609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fc8d4097780 con 0x7fc8ec15f880 2024-05-10T08:41:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.055+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc8cc076470 0x7fc8cc078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.056+0000 7fc8eaffd640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc8cc076470 0x7fc8cc078930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc033000 tx=0x7fc8dc008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.059+0000 7fc8e37fe640 1 -- 172.21.15.37:0/1243865609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc8ec1630b0 con 0x7fc8ec15f880 2024-05-10T08:41:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.326+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc8ec0693f0 con 0x7fc8ec15f880 2024-05-10T08:41:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.327+0000 7fc8e37fe640 1 -- 172.21.15.37:0/1243865609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fc8d4060900 con 0x7fc8ec15f880 2024-05-10T08:41:10.326 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:41:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc8cc076470 msgr2=0x7fc8cc078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc8cc076470 0x7fc8cc078930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc033000 tx=0x7fc8dc008030 comp rx=0 tx=0).stop 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8ec15f880 msgr2=0x7fc8ec0b7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8ec15f880 0x7fc8ec0b7e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4001290 tx=0x7fc8d40074f0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 shutdown_connections 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc8cc076470 0x7fc8cc078930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8ec0ca820 0x7fc8ec0b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8ec15f880 0x7fc8ec0b7e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 --2- 172.21.15.37:0/1243865609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc8d80039b0 0x7fc8ec153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 >> 172.21.15.37:0/1243865609 conn(0x7fc8ec08eac0 msgr2=0x7fc8ec163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 shutdown_connections 2024-05-10T08:41:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10.329+0000 7fc8f1409640 1 -- 172.21.15.37:0/1243865609 wait complete. 2024-05-10T08:41:10.339 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:41:10.340 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:41:10.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:10.340 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:10.357 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42691sec preferred_lft 42691sec 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:41:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:10.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:10.359 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:41:10.422 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:41:10.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:10.424 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:41:10.481 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:41:10.481 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:41:10.481 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:41:10.481 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:41:10.481 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:41:10.482 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:41:10.482 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:41:10.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:41:10.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:41:10.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:41:10.482 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:41:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:41:10.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:10.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:10.611 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:41:10.627 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:41:10.627 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:41:10.627 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:41:10.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:10.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:41:10.694 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:41:10.694 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:10.749 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:41:10.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:41:10.749 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:10.804 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:41:10.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:10.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:10.889 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:10.889 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:41:10.889 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:41:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:41:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:41:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:41:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:41:10.907 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:10.907 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:41:10.907 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:41:10.907 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:41:10.908 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:41:10.908 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:41:10.908 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:41:10.908 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:41:10.913 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:41:10.913 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:41:10.913 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:41:10.913 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:41:10.913 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:41:10.914 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:41:10.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:10.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:10.940 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:41:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:41:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:11.047 INFO:teuthology.orchestra.run.smithi037.stdout:client4736 2024-05-10T08:41:11.047 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:11.047 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:11.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:11.064 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-05-10T08:41:11.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:11.126 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-05-10T08:41:11.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:11.184 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-05-10T08:41:11.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:11.241 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-05-10T08:41:11.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:11.301 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-05-10T08:41:11.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:11.358 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T08:41:11.417 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2024-05-10T08:41:11.417 INFO:teuthology.orchestra.run.smithi037.stdout:./rfile 2024-05-10T08:41:11.417 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir 2024-05-10T08:41:11.418 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir/pfile 2024-05-10T08:41:11.418 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir/childdir 2024-05-10T08:41:11.418 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir/childdir/cfile 2024-05-10T08:41:11.419 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:41:11.419 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:41:11.419 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:41:11.419 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:41:11.419 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T08:41:11.419 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:41:11.527 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:41:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:11.536 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:41:11.536 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:41:11.536 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:41:11.536 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:41:11.536 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-05-10T08:41:11.536 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:41:11.644 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2024-05-10T08:41:11.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:11.653 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:41:11.653 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:41:11.653 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:41:11.653 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:41:11.653 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-05-10T08:41:11.653 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:41:11.761 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2024-05-10T08:41:11.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:11.771 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:41:11.771 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:41:11.771 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:41:11.771 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:41:11.771 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-05-10T08:41:11.771 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:41:11.879 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628279 2024-05-10T08:41:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:11.888 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:41:11.888 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:41:11.889 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:41:11.889 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:41:11.889 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-05-10T08:41:11.889 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:41:11.995 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2024-05-10T08:41:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:12.004 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:41:12.004 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:41:12.004 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:41:12.005 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:41:12.005 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-05-10T08:41:12.005 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:41:12.112 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2024-05-10T08:41:12.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:12.122 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:12.122 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:12.179 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:12.179 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:12.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:41:12.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.379+0000 7fc998b46640 1 Processor -- start 2024-05-10T08:41:12.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.379+0000 7fc998b46640 1 -- start start 2024-05-10T08:41:12.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.380+0000 7fc998b46640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc99406f060 0x7fc99406e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.380+0000 7fc998b46640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99415d2a0 con 0x7fc9940d0530 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.380+0000 7fc998b46640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9941609b0 con 0x7fc99406fe30 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.380+0000 7fc998b46640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc99406f440 con 0x7fc99406f060 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.381+0000 7fc99259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc99406f060 0x7fc99406e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.381+0000 7fc992d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc9940d0530 0x7fc9940b3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52912/0 (socket says 172.21.15.37:52912) 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.381+0000 7fc992d9d640 1 -- 172.21.15.37:0/1982721875 learned_addr learned my addr 172.21.15.37:0/1982721875 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.381+0000 7fc99259c640 1 -- 172.21.15.37:0/1982721875 >> v1:172.21.15.82:6789/0 conn(0x7fc99406fe30 legacy=0x7fc9940cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.381+0000 7fc99259c640 1 -- 172.21.15.37:0/1982721875 >> v1:172.21.15.37:6789/0 conn(0x7fc9940d0530 legacy=0x7fc9940b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.381+0000 7fc99259c640 1 -- 172.21.15.37:0/1982721875 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc994160c90 con 0x7fc99406f060 2024-05-10T08:41:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.381+0000 7fc99159a640 1 -- 172.21.15.37:0/1982721875 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345311166 0 0) 0x7fc99415d2a0 con 0x7fc9940d0530 2024-05-10T08:41:12.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.382+0000 7fc99259c640 1 --2- 172.21.15.37:0/1982721875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc99406f060 0x7fc99406e0f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc9840097a0 tx=0x7fc98402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d510600ef7e6dc60 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:12.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.382+0000 7fc99159a640 1 -- 172.21.15.37:0/1982721875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984037070 con 0x7fc99406f060 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.382+0000 7fc99159a640 1 -- 172.21.15.37:0/1982721875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc984032440 con 0x7fc99406f060 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.382+0000 7fc99159a640 1 -- 172.21.15.37:0/1982721875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984032810 con 0x7fc99406f060 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.382+0000 7fc998b46640 1 -- 172.21.15.37:0/1982721875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc99406f060 msgr2=0x7fc99406e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.382+0000 7fc998b46640 1 --2- 172.21.15.37:0/1982721875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc99406f060 0x7fc99406e0f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc9840097a0 tx=0x7fc98402a230 comp rx=0 tx=0).stop 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.383+0000 7fc998b46640 1 -- 172.21.15.37:0/1982721875 shutdown_connections 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.383+0000 7fc998b46640 1 --2- 172.21.15.37:0/1982721875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc99406f060 0x7fc99406e0f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.383+0000 7fc998b46640 1 -- 172.21.15.37:0/1982721875 >> 172.21.15.37:0/1982721875 conn(0x7fc99406c3a0 msgr2=0x7fc99406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.383+0000 7fc998b46640 1 -- 172.21.15.37:0/1982721875 shutdown_connections 2024-05-10T08:41:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.383+0000 7fc998b46640 1 -- 172.21.15.37:0/1982721875 wait complete. 2024-05-10T08:41:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.384+0000 7fc998b46640 1 Processor -- start 2024-05-10T08:41:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.384+0000 7fc998b46640 1 -- start start 2024-05-10T08:41:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc998b46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc99406f060 0x7fc9941f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc998b46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc99406fe30 0x7fc994149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc998b46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9940d0530 0x7fc99409d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc998b46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc994161530 con 0x7fc9940d0530 2024-05-10T08:41:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc998b46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc994161250 con 0x7fc99406fe30 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc998b46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc9940702c0 con 0x7fc99406f060 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9940d0530 0x7fc99409d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9940d0530 0x7fc99409d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41564/0 (socket says 172.21.15.37:41564) 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 -- 172.21.15.37:0/1966449563 learned_addr learned my addr 172.21.15.37:0/1966449563 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc991d9b640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc99406fe30 0x7fc994149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc99259c640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc99406f060 0x7fc9941f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 -- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc99406f060 msgr2=0x7fc9941f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc99406f060 0x7fc9941f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 -- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc99406fe30 msgr2=0x7fc994149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc99406fe30 0x7fc994149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 -- 172.21.15.37:0/1966449563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc994149aa0 con 0x7fc9940d0530 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc992d9d640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9940d0530 0x7fc99409d6b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00c700 tx=0x7fc98c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc982ffd640 1 -- 172.21.15.37:0/1966449563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c018070 con 0x7fc9940d0530 2024-05-10T08:41:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.385+0000 7fc982ffd640 1 -- 172.21.15.37:0/1966449563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98c00ce10 con 0x7fc9940d0530 2024-05-10T08:41:12.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.386+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9940ca310 con 0x7fc9940d0530 2024-05-10T08:41:12.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.386+0000 7fc982ffd640 1 -- 172.21.15.37:0/1966449563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00a880 con 0x7fc9940d0530 2024-05-10T08:41:12.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.386+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99409bc90 con 0x7fc9940d0530 2024-05-10T08:41:12.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.387+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99406ec10 con 0x7fc9940d0530 2024-05-10T08:41:12.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.387+0000 7fc982ffd640 1 -- 172.21.15.37:0/1966449563 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc98c01b070 con 0x7fc9940d0530 2024-05-10T08:41:12.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.388+0000 7fc982ffd640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9740762d0 0x7fc974078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.388+0000 7fc982ffd640 1 -- 172.21.15.37:0/1966449563 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fc98c096ca0 con 0x7fc9940d0530 2024-05-10T08:41:12.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.388+0000 7fc99259c640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9740762d0 0x7fc974078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.389+0000 7fc99259c640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9740762d0 0x7fc974078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc984034000 tx=0x7fc98402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.392+0000 7fc982ffd640 1 -- 172.21.15.37:0/1966449563 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc99406ec10 con 0x7fc9940d0530 2024-05-10T08:41:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.594+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc9940693f0 con 0x7fc9940d0530 2024-05-10T08:41:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.594+0000 7fc982ffd640 1 -- 172.21.15.37:0/1966449563 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7fc98c05fe20 con 0x7fc9940d0530 2024-05-10T08:41:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9740762d0 msgr2=0x7fc974078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9740762d0 0x7fc974078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc984034000 tx=0x7fc98402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9940d0530 msgr2=0x7fc99409d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9940d0530 0x7fc99409d6b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00c700 tx=0x7fc98c00cbc0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 shutdown_connections 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9740762d0 0x7fc974078790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9940d0530 0x7fc99409d6b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc99406fe30 0x7fc994149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 --2- 172.21.15.37:0/1966449563 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc99406f060 0x7fc9941f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 >> 172.21.15.37:0/1966449563 conn(0x7fc99406c3a0 msgr2=0x7fc99415d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:12.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 shutdown_connections 2024-05-10T08:41:12.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.596+0000 7fc998b46640 1 -- 172.21.15.37:0/1966449563 wait complete. 2024-05-10T08:41:12.606 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:41:12.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:12.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:12.652 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:41:12.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:12.653 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:41:12.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:12.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.826+0000 7f47e6df7640 1 Processor -- start 2024-05-10T08:41:12.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.826+0000 7f47e6df7640 1 -- start start 2024-05-10T08:41:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.826+0000 7f47e6df7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47e01629b0 0x7f47e006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e6df7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e006e110 con 0x7f47e0070d20 2024-05-10T08:41:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e6df7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e006e3f0 con 0x7f47e00b2490 2024-05-10T08:41:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e6df7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f47e0070a40 con 0x7f47e01629b0 2024-05-10T08:41:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e5394640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47e0070d20 0x7f47e00afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52922/0 (socket says 172.21.15.37:52922) 2024-05-10T08:41:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e5394640 1 -- 172.21.15.37:0/662773121 learned_addr learned my addr 172.21.15.37:0/662773121 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126848850 0 0) 0x7f47e006e110 con 0x7f47e0070d20 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d0003520 con 0x7f47e0070d20 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e4b93640 1 --2- 172.21.15.37:0/662773121 >> v2:172.21.15.82:3300/0 conn(0x7f47e01629b0 0x7f47e006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2389496286 0 0) 0x7f47d0003520 con 0x7f47e0070d20 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 >> v2:172.21.15.82:3300/0 conn(0x7f47e01629b0 msgr2=0x7f47e006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 --2- 172.21.15.37:0/662773121 >> v2:172.21.15.82:3300/0 conn(0x7f47e01629b0 0x7f47e006eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 >> v1:172.21.15.82:6789/0 conn(0x7f47e00b2490 legacy=0x7f47e0070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e006e6d0 con 0x7f47e0070d20 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f47d80019f0 con 0x7f47e0070d20 2024-05-10T08:41:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e4b93640 1 --2- 172.21.15.37:0/662773121 >> v2:172.21.15.82:3300/0 conn(0x7f47e01629b0 0x7f47e006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:12.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 >> v1:172.21.15.37:6789/0 conn(0x7f47e0070d20 legacy=0x7f47e00afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d00039b0 0x7f47d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d0004800 0x7f47d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d00051c0 0x7f47d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47e0070a40 con 0x7f47d00039b0 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47d000c110 con 0x7f47d00051c0 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f47d000c310 con 0x7f47d0004800 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.827+0000 7f47e4b93640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d00039b0 0x7f47d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e5394640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d00051c0 0x7f47d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47dffff640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d0004800 0x7f47d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e4b93640 1 -- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d0004800 msgr2=0x7f47d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e4b93640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d0004800 0x7f47d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e4b93640 1 -- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d00051c0 msgr2=0x7f47d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e4b93640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d00051c0 0x7f47d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e5394640 1 -- 172.21.15.37:0/662773121 reap_dead start 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e4b93640 1 -- 172.21.15.37:0/662773121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d0003520 con 0x7f47d00039b0 2024-05-10T08:41:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.828+0000 7f47e4b93640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d00039b0 0x7f47d0003dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47d40098a0 tx=0x7f47d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa5467658d8c9b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d400f040 con 0x7f47d00039b0 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d402ac30 con 0x7f47d00039b0 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47df7fe640 1 -- 172.21.15.37:0/662773121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4004030 con 0x7f47d00039b0 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47e6df7640 1 -- 172.21.15.37:0/662773121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d00039b0 msgr2=0x7f47d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47e6df7640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d00039b0 0x7f47d0003dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47d40098a0 tx=0x7f47d0005830 comp rx=0 tx=0).stop 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47e6df7640 1 -- 172.21.15.37:0/662773121 shutdown_connections 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47e6df7640 1 --2- 172.21.15.37:0/662773121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d00039b0 0x7f47d0003dd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47e6df7640 1 -- 172.21.15.37:0/662773121 >> 172.21.15.37:0/662773121 conn(0x7f47e00b49d0 msgr2=0x7f47e00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47e6df7640 1 -- 172.21.15.37:0/662773121 shutdown_connections 2024-05-10T08:41:12.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.829+0000 7f47e6df7640 1 -- 172.21.15.37:0/662773121 wait complete. 2024-05-10T08:41:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.830+0000 7f47e6df7640 1 Processor -- start 2024-05-10T08:41:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.831+0000 7f47e6df7640 1 -- start start 2024-05-10T08:41:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.831+0000 7f47e6df7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d00039b0 0x7f47e01503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.831+0000 7f47e6df7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e00b6bb0 0x7f47e00c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.831+0000 7f47e6df7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00b76a0 0x7f47e00b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.831+0000 7f47e6df7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47e00711d0 con 0x7f47e00b6bb0 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.831+0000 7f47e6df7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47e006dec0 con 0x7f47e00b76a0 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.831+0000 7f47e6df7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f47e0071350 con 0x7f47d00039b0 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e00b6bb0 0x7f47e00c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e00b6bb0 0x7f47e00c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41580/0 (socket says 172.21.15.37:41580) 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 -- 172.21.15.37:0/2269757575 learned_addr learned my addr 172.21.15.37:0/2269757575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47e5394640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00b76a0 0x7f47e00b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47e4b93640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d00039b0 0x7f47e01503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 -- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d00039b0 msgr2=0x7f47e01503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d00039b0 0x7f47e01503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 -- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00b76a0 msgr2=0x7f47e00b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00b76a0 0x7f47e00b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 -- 172.21.15.37:0/2269757575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e00c7380 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dffff640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e00b6bb0 0x7f47e00c8ed0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47cc00e480 tx=0x7f47cc00e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dd7fa640 1 -- 172.21.15.37:0/2269757575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc019070 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dd7fa640 1 -- 172.21.15.37:0/2269757575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47cc0052e0 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e00c7660 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47dd7fa640 1 -- 172.21.15.37:0/2269757575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0037f0 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.832+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e00c7c20 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.833+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e00d31a0 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.834+0000 7f47dd7fa640 1 -- 172.21.15.37:0/2269757575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47cc01c070 con 0x7f47e00b6bb0 2024-05-10T08:41:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.835+0000 7f47dd7fa640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47c40762d0 0x7f47c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.835+0000 7f47dd7fa640 1 -- 172.21.15.37:0/2269757575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f47cc096d40 con 0x7f47e00b6bb0 2024-05-10T08:41:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.835+0000 7f47e4b93640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47c40762d0 0x7f47c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.835+0000 7f47e4b93640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47c40762d0 0x7f47c4078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47d4033000 tx=0x7f47d402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:12.839+0000 7f47dd7fa640 1 -- 172.21.15.37:0/2269757575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f47e00d31a0 con 0x7f47e00b6bb0 2024-05-10T08:41:13.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.068+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47e00693f0 con 0x7f47e00b6bb0 2024-05-10T08:41:13.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.069+0000 7f47dd7fa640 1 -- 172.21.15.37:0/2269757575 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7f47cc05fd90 con 0x7f47e00b6bb0 2024-05-10T08:41:13.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:13.070 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47c40762d0 msgr2=0x7f47c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47c40762d0 0x7f47c4078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47d4033000 tx=0x7f47d402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e00b6bb0 msgr2=0x7f47e00c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e00b6bb0 0x7f47e00c8ed0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47cc00e480 tx=0x7f47cc00e880 comp rx=0 tx=0).stop 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 shutdown_connections 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47c40762d0 0x7f47c4078790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47e00b76a0 0x7f47e00b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e00b6bb0 0x7f47e00c8ed0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 --2- 172.21.15.37:0/2269757575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47d00039b0 0x7f47e01503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 >> 172.21.15.37:0/2269757575 conn(0x7f47e00b49d0 msgr2=0x7f47e00b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:13.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 shutdown_connections 2024-05-10T08:41:13.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.071+0000 7f47e6df7640 1 -- 172.21.15.37:0/2269757575 wait complete. 2024-05-10T08:41:13.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T08:41:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2024-05-10T08:41:13.217 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:41:13.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.321+0000 7f7347445640 1 Processor -- start 2024-05-10T08:41:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.321+0000 7f7347445640 1 -- start start 2024-05-10T08:41:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.322+0000 7f7347445640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f734015c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.322+0000 7f7347445640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f734006e4d0 0x7f73400aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.322+0000 7f7347445640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734015c920 con 0x7f7340072840 2024-05-10T08:41:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.322+0000 7f7347445640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f734015cc00 con 0x7f734006e4d0 2024-05-10T08:41:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.322+0000 7f7347445640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f734015cee0 con 0x7f734006e0f0 2024-05-10T08:41:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73459e2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f734006e4d0 0x7f73400aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73451e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f734015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73459e2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f734006e4d0 0x7f73400aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:54652/0 (socket says 172.21.15.37:54652) 2024-05-10T08:41:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73459e2640 1 -- 172.21.15.37:0/2010693639 learned_addr learned my addr 172.21.15.37:0/2010693639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73449e0640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7340072840 0x7f73400d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:49708/0 (socket says 172.21.15.37:49708) 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73451e1640 1 -- 172.21.15.37:0/2010693639 >> v2:172.21.15.82:3300/0 conn(0x7f734006e4d0 msgr2=0x7f73400aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73451e1640 1 --2- 172.21.15.37:0/2010693639 >> v2:172.21.15.82:3300/0 conn(0x7f734006e4d0 0x7f73400aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73451e1640 1 -- 172.21.15.37:0/2010693639 >> v1:172.21.15.82:6789/0 conn(0x7f7340072840 legacy=0x7f73400d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73451e1640 1 -- 172.21.15.37:0/2010693639 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734015d1c0 con 0x7f734006e0f0 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f7337fff640 1 -- 172.21.15.37:0/2010693639 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544870175 0 0) 0x7f734015c920 con 0x7f7340072840 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.323+0000 7f73459e2640 1 --2- 172.21.15.37:0/2010693639 >> v2:172.21.15.82:3300/0 conn(0x7f734006e4d0 0x7f73400aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.324+0000 7f73451e1640 1 --2- 172.21.15.37:0/2010693639 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f734015c340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f733c0097a0 tx=0x7f733c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6b687a77854fed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.324+0000 7f7337fff640 1 -- 172.21.15.37:0/2010693639 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c037070 con 0x7f734006e0f0 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.324+0000 7f7337fff640 1 -- 172.21.15.37:0/2010693639 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c032440 con 0x7f734006e0f0 2024-05-10T08:41:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.324+0000 7f7337fff640 1 -- 172.21.15.37:0/2010693639 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c032810 con 0x7f734006e0f0 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 -- 172.21.15.37:0/2010693639 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 msgr2=0x7f734015c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 --2- 172.21.15.37:0/2010693639 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f734015c340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f733c0097a0 tx=0x7f733c02a180 comp rx=0 tx=0).stop 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 -- 172.21.15.37:0/2010693639 shutdown_connections 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 --2- 172.21.15.37:0/2010693639 >> v2:172.21.15.82:3300/0 conn(0x7f734006e4d0 0x7f73400aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 --2- 172.21.15.37:0/2010693639 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f734015c340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 -- 172.21.15.37:0/2010693639 >> 172.21.15.37:0/2010693639 conn(0x7f734006c3a0 msgr2=0x7f734006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 -- 172.21.15.37:0/2010693639 shutdown_connections 2024-05-10T08:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.325+0000 7f7347445640 1 -- 172.21.15.37:0/2010693639 wait complete. 2024-05-10T08:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.326+0000 7f7347445640 1 Processor -- start 2024-05-10T08:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.326+0000 7f7347445640 1 -- start start 2024-05-10T08:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7347445640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f73400b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7347445640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734006e4d0 0x7f73400b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7347445640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340072840 0x7f7340144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7347445640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73400ae7d0 con 0x7f7340072840 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7347445640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f73400ae650 con 0x7f734006e4d0 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7347445640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f73401530b0 con 0x7f734006e0f0 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340072840 0x7f7340144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340072840 0x7f7340144c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41590/0 (socket says 172.21.15.37:41590) 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 -- 172.21.15.37:0/2906886091 learned_addr learned my addr 172.21.15.37:0/2906886091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73451e1640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f73400b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73449e0640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734006e4d0 0x7f73400b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 -- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 msgr2=0x7f73400b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f73400b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 -- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734006e4d0 msgr2=0x7f73400b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734006e4d0 0x7f73400b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 -- 172.21.15.37:0/2906886091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7340154bd0 con 0x7f7340072840 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f73459e2640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340072840 0x7f7340144c90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f733800efc0 tx=0x7f733800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7335ffb640 1 -- 172.21.15.37:0/2906886091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733800cbe0 con 0x7f7340072840 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7335ffb640 1 -- 172.21.15.37:0/2906886091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733800cd80 con 0x7f7340072840 2024-05-10T08:41:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7335ffb640 1 -- 172.21.15.37:0/2906886091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338003bb0 con 0x7f7340072840 2024-05-10T08:41:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.327+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7340154eb0 con 0x7f7340072840 2024-05-10T08:41:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.328+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73401451d0 con 0x7f7340072840 2024-05-10T08:41:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.329+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73400693f0 con 0x7f7340072840 2024-05-10T08:41:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.329+0000 7f7335ffb640 1 -- 172.21.15.37:0/2906886091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f733801b030 con 0x7f7340072840 2024-05-10T08:41:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.329+0000 7f7335ffb640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73240762d0 0x7f7324078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.330+0000 7f7335ffb640 1 -- 172.21.15.37:0/2906886091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f7338097a20 con 0x7f7340072840 2024-05-10T08:41:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.330+0000 7f73451e1640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73240762d0 0x7f7324078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.330+0000 7f73451e1640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73240762d0 0x7f7324078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f733c034000 tx=0x7f733c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.334+0000 7f7335ffb640 1 -- 172.21.15.37:0/2906886091 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7338022020 con 0x7f7340072840 2024-05-10T08:41:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.562+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73400765b0 con 0x7f7340072840 2024-05-10T08:41:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.563+0000 7f7335ffb640 1 -- 172.21.15.37:0/2906886091 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7f7338010040 con 0x7f7340072840 2024-05-10T08:41:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:13.597 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73240762d0 msgr2=0x7f7324078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73240762d0 0x7f7324078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f733c034000 tx=0x7f733c02e000 comp rx=0 tx=0).stop 2024-05-10T08:41:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340072840 msgr2=0x7f7340144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340072840 0x7f7340144c90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f733800efc0 tx=0x7f733800c490 comp rx=0 tx=0).stop 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 shutdown_connections 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73240762d0 0x7f7324078790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7340072840 0x7f7340144c90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734006e4d0 0x7f73400b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 --2- 172.21.15.37:0/2906886091 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734006e0f0 0x7f73400b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 >> 172.21.15.37:0/2906886091 conn(0x7f734006c3a0 msgr2=0x7f734014c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 shutdown_connections 2024-05-10T08:41:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:13.565+0000 7f7347445640 1 -- 172.21.15.37:0/2906886091 wait complete. 2024-05-10T08:41:13.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parentdir mytag 2024-05-10T08:41:13.725 INFO:teuthology.orchestra.run.smithi037.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-05-10T08:41:13.725 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-05-10T08:41:22.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:41:22.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:41:23.726 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-05-10T08:41:23.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.779+0000 7f728a08cf40 1 Processor -- start 2024-05-10T08:41:23.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.779+0000 7f728a08cf40 1 -- start start 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f728a08cf40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125ec0130 0x557125ef08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f728a08cf40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125f08990 0x557125f8b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f728a08cf40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f97550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f728a08cf40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557125ec2800 con 0x557125f08990 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f728a08cf40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557125e68f50 con 0x557125f986d0 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f728a08cf40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x557125ec2ae0 con 0x557125ec0130 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125f08990 0x557125f8b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125f08990 0x557125f8b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58794/0 (socket says 172.21.15.37:58794) 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 -- 172.21.15.37:0/4117853193 learned_addr learned my addr 172.21.15.37:0/4117853193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f7287b86640 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125ec0130 0x557125ef08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f7288387640 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f97550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 -- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125ec0130 msgr2=0x557125ef08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125ec0130 0x557125ef08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 -- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 msgr2=0x557125f97550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f97550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f727ffff640 1 -- 172.21.15.37:0/4117853193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557125f8fac0 con 0x557125f08990 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.780+0000 7f7288387640 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f97550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f727ffff640 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125f08990 0x557125f8b670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f727000b2c0 tx=0x7f727000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af9719c313fb320 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f7286b84640 1 -- 172.21.15.37:0/4117853193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270008070 con 0x557125f08990 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f7286b84640 1 -- 172.21.15.37:0/4117853193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727000d500 con 0x557125f08990 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f7286b84640 1 -- 172.21.15.37:0/4117853193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727000d930 con 0x557125f08990 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f728a08cf40 1 -- 172.21.15.37:0/4117853193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125f08990 msgr2=0x557125f8b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f728a08cf40 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125f08990 0x557125f8b670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f727000b2c0 tx=0x7f727000b780 comp rx=0 tx=0).stop 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f728a08cf40 1 -- 172.21.15.37:0/4117853193 shutdown_connections 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f728a08cf40 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f97550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f728a08cf40 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125f08990 0x557125f8b670 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f728a08cf40 1 --2- 172.21.15.37:0/4117853193 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125ec0130 0x557125ef08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.781+0000 7f728a08cf40 1 -- 172.21.15.37:0/4117853193 >> 172.21.15.37:0/4117853193 conn(0x557125ec0b30 msgr2=0x557125f939e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.782+0000 7f728a08cf40 1 -- 172.21.15.37:0/4117853193 shutdown_connections 2024-05-10T08:41:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.782+0000 7f728a08cf40 1 -- 172.21.15.37:0/4117853193 wait complete. 2024-05-10T08:41:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.782+0000 7f728a08cf40 1 Processor -- start 2024-05-10T08:41:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.782+0000 7f728a08cf40 1 -- start start 2024-05-10T08:41:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f728a08cf40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125ec0130 0x557125f855a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f728a08cf40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125f08990 0x557125f939e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f728a08cf40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f93f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f728a08cf40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557125f8f670 con 0x557125ec0130 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f728a08cf40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557125f95400 con 0x557125f986d0 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f728a08cf40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x557125f8bbb0 con 0x557125f08990 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f7287b86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125ec0130 0x557125f855a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f7287b86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125ec0130 0x557125f855a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58802/0 (socket says 172.21.15.37:58802) 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f7287b86640 1 -- 172.21.15.37:0/2822934936 learned_addr learned my addr 172.21.15.37:0/2822934936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f727ffff640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125f08990 0x557125f939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f7288387640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f93f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.783+0000 7f7287b86640 1 -- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125f08990 msgr2=0x557125f939e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7287b86640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557125f08990 0x557125f939e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7287b86640 1 -- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 msgr2=0x557125f93f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7287b86640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557125f986d0 0x557125f93f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7287b86640 1 -- 172.21.15.37:0/2822934936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557125f8a0a0 con 0x557125ec0130 2024-05-10T08:41:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7287b86640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125ec0130 0x557125f855a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72780086b0 tx=0x7f72780087a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7285b82640 1 -- 172.21.15.37:0/2822934936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278019020 con 0x557125ec0130 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7285b82640 1 -- 172.21.15.37:0/2822934936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7278015880 con 0x557125ec0130 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557125f8a380 con 0x557125ec0130 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f7285b82640 1 -- 172.21.15.37:0/2822934936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278015c30 con 0x557125ec0130 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.784+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557125f8a940 con 0x557125ec0130 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.786+0000 7f7285b82640 1 -- 172.21.15.37:0/2822934936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f727801c020 con 0x557125ec0130 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.786+0000 7f7285b82640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7268074ce0 0x7f72680771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.786+0000 7f7285b82640 1 -- 172.21.15.37:0/2822934936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f7278096c70 con 0x557125ec0130 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.786+0000 7f728a08cf40 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x557125f0ade0 0x557125f8d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.786+0000 7f727ffff640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7268074ce0 0x7f72680771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.786+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557125f8d9f0 con 0x557125f0ade0 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.787+0000 7f7288387640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x557125f0ade0 0x557125f8d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.787+0000 7f727ffff640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7268074ce0 0x7f72680771a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f727000b2c0 tx=0x7f7270009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.787+0000 7f7288387640 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x557125f0ade0 0x557125f8d4b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f7288387640 1 -- 172.21.15.37:0/2822934936 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f72800537c0 con 0x557125f0ade0 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x557125f0ade0 msgr2=0x557125f8d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x557125f0ade0 0x557125f8d4b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7268074ce0 msgr2=0x7f72680771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7268074ce0 0x7f72680771a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f727000b2c0 tx=0x7f7270009000 comp rx=0 tx=0).stop 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125ec0130 msgr2=0x557125f855a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 --2- 172.21.15.37:0/2822934936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557125ec0130 0x557125f855a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72780086b0 tx=0x7f72780087a0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f7288387640 1 -- 172.21.15.37:0/2822934936 reap_dead start 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 shutdown_connections 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 >> 172.21.15.37:0/2822934936 conn(0x557125ec0b30 msgr2=0x557125f88360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 shutdown_connections 2024-05-10T08:41:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.788+0000 7f728a08cf40 1 -- 172.21.15.37:0/2822934936 wait complete. 2024-05-10T08:41:23.791 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2024-05-10T08:41:23.792 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-05-10T08:41:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.840+0000 7f6789537f40 1 Processor -- start 2024-05-10T08:41:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.840+0000 7f6789537f40 1 -- start start 2024-05-10T08:41:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6789537f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c00a20 0x55fa22c310c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6789537f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22c49860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6789537f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c4a980 0x55fa22ccbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6789537f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa22c4ad60 con 0x55fa22c49200 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6789537f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fa22ba9f50 con 0x55fa22c4a980 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6789537f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fa22cd8720 con 0x55fa22c00a20 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22c49860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22c49860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58804/0 (socket says 172.21.15.37:58804) 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 -- 172.21.15.37:0/261282971 learned_addr learned my addr 172.21.15.37:0/261282971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6787031640 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c00a20 0x55fa22c310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6787832640 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c4a980 0x55fa22ccbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 -- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c00a20 msgr2=0x55fa22c310c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c00a20 0x55fa22c310c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 -- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c4a980 msgr2=0x55fa22ccbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c4a980 0x55fa22ccbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.841+0000 7f6786830640 1 -- 172.21.15.37:0/261282971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa22ccfd20 con 0x55fa22c49200 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6786830640 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22c49860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f677c0098e0 tx=0x7f677c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf49c4c18b04f77c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f678582e640 1 -- 172.21.15.37:0/261282971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c008950 con 0x55fa22c49200 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f678582e640 1 -- 172.21.15.37:0/261282971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c018070 con 0x55fa22c49200 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f678582e640 1 -- 172.21.15.37:0/261282971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c008d30 con 0x55fa22c49200 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 -- 172.21.15.37:0/261282971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 msgr2=0x55fa22c49860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22c49860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f677c0098e0 tx=0x7f677c005a00 comp rx=0 tx=0).stop 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 -- 172.21.15.37:0/261282971 shutdown_connections 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c4a980 0x55fa22ccbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22c49860 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 --2- 172.21.15.37:0/261282971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c00a20 0x55fa22c310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 -- 172.21.15.37:0/261282971 >> 172.21.15.37:0/261282971 conn(0x55fa22c01b30 msgr2=0x55fa22c2fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 -- 172.21.15.37:0/261282971 shutdown_connections 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.842+0000 7f6789537f40 1 -- 172.21.15.37:0/261282971 wait complete. 2024-05-10T08:41:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.843+0000 7f6789537f40 1 Processor -- start 2024-05-10T08:41:23.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.843+0000 7f6789537f40 1 -- start start 2024-05-10T08:41:23.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6789537f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c00a20 0x55fa22cc45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6789537f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22bffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6789537f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c4a980 0x55fa22c00430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6789537f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa22c30ba0 con 0x55fa22c49200 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6789537f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fa22cced40 con 0x55fa22c00a20 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6789537f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fa22c31b00 con 0x55fa22c4a980 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22bffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22bffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58810/0 (socket says 172.21.15.37:58810) 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 -- 172.21.15.37:0/3991855631 learned_addr learned my addr 172.21.15.37:0/3991855631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6787832640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c4a980 0x55fa22c00430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6787031640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c00a20 0x55fa22cc45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 -- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c4a980 msgr2=0x55fa22c00430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fa22c4a980 0x55fa22c00430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 -- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c00a20 msgr2=0x55fa22cc45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa22c00a20 0x55fa22cc45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 -- 172.21.15.37:0/3991855631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa22ccc2d0 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.844+0000 7f6786830640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22bffef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f677c006010 tx=0x7f677c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.845+0000 7f678482c640 1 -- 172.21.15.37:0/3991855631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c008d80 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.845+0000 7f678482c640 1 -- 172.21.15.37:0/3991855631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c026430 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.845+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa22ccc5b0 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.845+0000 7f678482c640 1 -- 172.21.15.37:0/3991855631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c026820 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.845+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa22cce9d0 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.846+0000 7f678482c640 1 -- 172.21.15.37:0/3991855631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f677c02f440 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.847+0000 7f678482c640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6774074ce0 0x7f67740771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.847+0000 7f678482c640 1 -- 172.21.15.37:0/3991855631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f677c097fa0 con 0x55fa22c49200 2024-05-10T08:41:23.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.847+0000 7f6787031640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6774074ce0 0x7f67740771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.847+0000 7f6789537f40 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55fa22ccf1d0 0x55fa22cc63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.847+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa22ccbe60 con 0x55fa22ccf1d0 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.847+0000 7f6787832640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55fa22ccf1d0 0x55fa22cc63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.847+0000 7f6787031640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6774074ce0 0x7f67740771a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f6778001690 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6787832640 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55fa22ccf1d0 0x55fa22cc63f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6787832640 1 -- 172.21.15.37:0/3991855631 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f67800518f0 con 0x55fa22ccf1d0 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55fa22ccf1d0 msgr2=0x55fa22cc63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55fa22ccf1d0 0x55fa22cc63f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6774074ce0 msgr2=0x7f67740771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6774074ce0 0x7f67740771a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f6778001690 comp rx=0 tx=0).stop 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 msgr2=0x55fa22bffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 --2- 172.21.15.37:0/3991855631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa22c49200 0x55fa22bffef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f677c006010 tx=0x7f677c003020 comp rx=0 tx=0).stop 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6787832640 1 -- 172.21.15.37:0/3991855631 reap_dead start 2024-05-10T08:41:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 shutdown_connections 2024-05-10T08:41:23.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 >> 172.21.15.37:0/3991855631 conn(0x55fa22c01b30 msgr2=0x55fa22cc8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 shutdown_connections 2024-05-10T08:41:23.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.848+0000 7f6789537f40 1 -- 172.21.15.37:0/3991855631 wait complete. 2024-05-10T08:41:23.855 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2024-05-10T08:41:23.855 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-05-10T08:41:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.901+0000 7fd0c1d25f40 1 Processor -- start 2024-05-10T08:41:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.901+0000 7fd0c1d25f40 1 -- start start 2024-05-10T08:41:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0c1d25f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 0x55e1553b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0c1d25f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c07b0 0x55e1553c1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0c1d25f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c0b90 0x55e1553c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0c1d25f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e1552e9f90 con 0x55e1553c07b0 2024-05-10T08:41:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0c1d25f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e155290f50 con 0x55e1553c0b90 2024-05-10T08:41:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0c1d25f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55e1552eb800 con 0x55e1552eb0a0 2024-05-10T08:41:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c07b0 0x55e1553c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c07b0 0x55e1553c1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58822/0 (socket says 172.21.15.37:58822) 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 -- 172.21.15.37:0/3108371915 learned_addr learned my addr 172.21.15.37:0/3108371915 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0bf552640 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c0b90 0x55e1553c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0bed51640 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 0x55e1553b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 -- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 msgr2=0x55e1553b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 0x55e1553b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 -- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c0b90 msgr2=0x55e1553c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c0b90 0x55e1553c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 -- 172.21.15.37:0/3108371915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e155331420 con 0x55e1553c07b0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.902+0000 7fd0be550640 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c07b0 0x55e1553c1110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4025cc0 tx=0x7fd0b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de2f0bc44ca6c4c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0bd54e640 1 -- 172.21.15.37:0/3108371915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4056660 con 0x55e1553c07b0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0bd54e640 1 -- 172.21.15.37:0/3108371915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b4056820 con 0x55e1553c07b0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0bd54e640 1 -- 172.21.15.37:0/3108371915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4056c10 con 0x55e1553c07b0 2024-05-10T08:41:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/3108371915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c07b0 msgr2=0x55e1553c1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c07b0 0x55e1553c1110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4025cc0 tx=0x7fd0b4051000 comp rx=0 tx=0).stop 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/3108371915 shutdown_connections 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c0b90 0x55e1553c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c07b0 0x55e1553c1110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/3108371915 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 0x55e1553b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/3108371915 >> 172.21.15.37:0/3108371915 conn(0x55e155316b40 msgr2=0x55e155318a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/3108371915 shutdown_connections 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.903+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/3108371915 wait complete. 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 Processor -- start 2024-05-10T08:41:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 -- start start 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 0x55e1552e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c07b0 0x55e15532f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c0b90 0x55e15532f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e1553bee00 con 0x55e1553c0b90 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e1553bf070 con 0x55e1553c07b0 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.904+0000 7fd0c1d25f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55e1553b8920 con 0x55e1552eb0a0 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c0b90 0x55e15532f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c0b90 0x55e15532f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58828/0 (socket says 172.21.15.37:58828) 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 -- 172.21.15.37:0/147642662 learned_addr learned my addr 172.21.15.37:0/147642662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0be550640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c07b0 0x55e15532f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bed51640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 0x55e1552e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 -- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 msgr2=0x55e1552e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55e1552eb0a0 0x55e1552e70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 -- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c07b0 msgr2=0x55e15532f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1553c07b0 0x55e15532f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 -- 172.21.15.37:0/147642662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e15532fed0 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0bf552640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c0b90 0x55e15532f830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009e20 tx=0x7fd0b8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0a7fff640 1 -- 172.21.15.37:0/147642662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80143f0 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0a7fff640 1 -- 172.21.15.37:0/147642662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b8019070 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0a7fff640 1 -- 172.21.15.37:0/147642662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80147d0 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1553301b0 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.905+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e155330770 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.907+0000 7fd0a7fff640 1 -- 172.21.15.37:0/147642662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd0b8014970 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.907+0000 7fd0a7fff640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0ac074cb0 0x7fd0ac077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.907+0000 7fd0a7fff640 1 -- 172.21.15.37:0/147642662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fd0b80961b0 con 0x55e1553c0b90 2024-05-10T08:41:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.908+0000 7fd0bed51640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0ac074cb0 0x7fd0ac077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.908+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55e1552e7620 0x55e15545b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.908+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e155457400 con 0x55e1552e7620 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.908+0000 7fd0be550640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55e1552e7620 0x55e15545b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.908+0000 7fd0bed51640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0ac074cb0 0x7fd0ac077170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55e1553c4030 tx=0x7fd0b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.908+0000 7fd0be550640 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55e1552e7620 0x55e15545b330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0be550640 1 -- 172.21.15.37:0/147642662 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fd0b40569d0 con 0x55e1552e7620 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55e1552e7620 msgr2=0x55e15545b330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55e1552e7620 0x55e15545b330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0ac074cb0 msgr2=0x7fd0ac077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0ac074cb0 0x7fd0ac077170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55e1553c4030 tx=0x7fd0b0008040 comp rx=0 tx=0).stop 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c0b90 msgr2=0x55e15532f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 --2- 172.21.15.37:0/147642662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e1553c0b90 0x55e15532f830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009e20 tx=0x7fd0b8009f10 comp rx=0 tx=0).stop 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0bf552640 1 -- 172.21.15.37:0/147642662 reap_dead start 2024-05-10T08:41:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 shutdown_connections 2024-05-10T08:41:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 >> 172.21.15.37:0/147642662 conn(0x55e155316b40 msgr2=0x55e1553c1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 shutdown_connections 2024-05-10T08:41:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.909+0000 7fd0c1d25f40 1 -- 172.21.15.37:0/147642662 wait complete. 2024-05-10T08:41:23.913 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2024-05-10T08:41:23.913 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-05-10T08:41:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.958+0000 7f86a488ef40 1 Processor -- start 2024-05-10T08:41:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.958+0000 7f86a488ef40 1 -- start start 2024-05-10T08:41:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a488ef40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 0x5576f4a26bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a488ef40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4afba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a488ef40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4afbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a488ef40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5576f49ccf50 con 0x5576f4ae5ae0 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a488ef40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5576f49d0f90 con 0x5576f4afa320 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a488ef40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5576f4a551a0 con 0x5576f4a531a0 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4afbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4afbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58852/0 (socket says 172.21.15.37:58852) 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 -- 172.21.15.37:0/2573017478 learned_addr learned my addr 172.21.15.37:0/2573017478 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a1b87640 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4afba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 -- 172.21.15.37:0/2573017478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 msgr2=0x5576f4a26bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 0x5576f4a26bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 -- 172.21.15.37:0/2573017478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 msgr2=0x5576f4afba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4afba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.959+0000 7f86a2b89640 1 -- 172.21.15.37:0/2573017478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f4ae2300 con 0x5576f4ae5ae0 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a2b89640 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4afbfc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f869c00a3b0 tx=0x7f869c00a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3831641884803585 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a0b85640 1 -- 172.21.15.37:0/2573017478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c00b8c0 con 0x5576f4ae5ae0 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a0b85640 1 -- 172.21.15.37:0/2573017478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c00f030 con 0x5576f4ae5ae0 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a0b85640 1 -- 172.21.15.37:0/2573017478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c00bcc0 con 0x5576f4ae5ae0 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 -- 172.21.15.37:0/2573017478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 msgr2=0x5576f4afbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4afbfc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f869c00a3b0 tx=0x7f869c00a870 comp rx=0 tx=0).stop 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 -- 172.21.15.37:0/2573017478 shutdown_connections 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4afbfc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4afba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 --2- 172.21.15.37:0/2573017478 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 0x5576f4a26bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 -- 172.21.15.37:0/2573017478 >> 172.21.15.37:0/2573017478 conn(0x5576f4a247e0 msgr2=0x5576f4a4e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 -- 172.21.15.37:0/2573017478 shutdown_connections 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.960+0000 7f86a488ef40 1 -- 172.21.15.37:0/2573017478 wait complete. 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.961+0000 7f86a488ef40 1 Processor -- start 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.961+0000 7f86a488ef40 1 -- start start 2024-05-10T08:41:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 0x5576f4af8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4ad9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4adbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5576f4afab10 con 0x5576f4ae5ae0 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5576f4a50f10 con 0x5576f4afa320 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5576f4afadf0 con 0x5576f4a531a0 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4ad9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4ad9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58862/0 (socket says 172.21.15.37:58862) 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 -- 172.21.15.37:0/3488675561 learned_addr learned my addr 172.21.15.37:0/3488675561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a2b89640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4adbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a2388640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 0x5576f4af8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 -- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 msgr2=0x5576f4af8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5576f4a531a0 0x5576f4af8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 -- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 msgr2=0x5576f4adbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4adbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 -- 172.21.15.37:0/3488675561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f4aff230 con 0x5576f4ae5ae0 2024-05-10T08:41:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a2b89640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576f4afa320 0x5576f4adbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a1b87640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4ad9540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8698000c00 tx=0x7f8698002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86937fe640 1 -- 172.21.15.37:0/3488675561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869806a070 con 0x5576f4ae5ae0 2024-05-10T08:41:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86937fe640 1 -- 172.21.15.37:0/3488675561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8698051990 con 0x5576f4ae5ae0 2024-05-10T08:41:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576f4af8c20 con 0x5576f4ae5ae0 2024-05-10T08:41:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86937fe640 1 -- 172.21.15.37:0/3488675561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698055040 con 0x5576f4ae5ae0 2024-05-10T08:41:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.962+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f4a6bb20 con 0x5576f4ae5ae0 2024-05-10T08:41:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.964+0000 7f86937fe640 1 -- 172.21.15.37:0/3488675561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f869806d070 con 0x5576f4ae5ae0 2024-05-10T08:41:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.964+0000 7f86937fe640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8684074cb0 0x7f8684077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.964+0000 7f86937fe640 1 -- 172.21.15.37:0/3488675561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f86980d9e20 con 0x5576f4ae5ae0 2024-05-10T08:41:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.965+0000 7f86a2388640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8684074cb0 0x7f8684077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.965+0000 7f86a488ef40 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x5576f4ad9a80 0x5576f4a6c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.965+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5576f4a691c0 con 0x5576f4ad9a80 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.965+0000 7f86a2b89640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x5576f4ad9a80 0x5576f4a6c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.965+0000 7f86a2388640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8684074cb0 0x7f8684077170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8694006fd0 tx=0x7f8694008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.965+0000 7f86a2b89640 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x5576f4ad9a80 0x5576f4a6c320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a2b89640 1 -- 172.21.15.37:0/3488675561 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f869c00ca50 con 0x5576f4ad9a80 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x5576f4ad9a80 msgr2=0x5576f4a6c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x5576f4ad9a80 0x5576f4a6c320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8684074cb0 msgr2=0x7f8684077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8684074cb0 0x7f8684077170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8694006fd0 tx=0x7f8694008040 comp rx=0 tx=0).stop 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 msgr2=0x5576f4ad9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 --2- 172.21.15.37:0/3488675561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576f4ae5ae0 0x5576f4ad9540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8698000c00 tx=0x7f8698002fb0 comp rx=0 tx=0).stop 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a2b89640 1 -- 172.21.15.37:0/3488675561 reap_dead start 2024-05-10T08:41:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 shutdown_connections 2024-05-10T08:41:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 >> 172.21.15.37:0/3488675561 conn(0x5576f4a247e0 msgr2=0x5576f4afc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 shutdown_connections 2024-05-10T08:41:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:23.966+0000 7f86a488ef40 1 -- 172.21.15.37:0/3488675561 wait complete. 2024-05-10T08:41:23.970 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2024-05-10T08:41:23.971 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-05-10T08:41:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 Processor -- start 2024-05-10T08:41:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 -- start start 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b988a20 0x56309ba577e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b9d1200 0x56309b988170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309b9b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56309b9d2d60 con 0x56309b988a20 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56309b931f50 con 0x56309b9d2980 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f88916d1f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56309ba60720 con 0x56309b9d1200 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.016+0000 7f888f1cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b988a20 0x56309ba577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b988a20 0x56309ba577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58890/0 (socket says 172.21.15.37:58890) 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 -- 172.21.15.37:0/1790950944 learned_addr learned my addr 172.21.15.37:0/1790950944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888e9ca640 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b9d1200 0x56309b988170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 -- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b9d1200 msgr2=0x56309b988170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b9d1200 0x56309b988170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f9cc640 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309b9b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 -- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 msgr2=0x56309b9b94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309b9b94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 -- 172.21.15.37:0/1790950944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309b9b7db0 con 0x56309b988a20 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888e9ca640 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b9d1200 0x56309b988170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888f1cb640 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b988a20 0x56309ba577e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f888000a430 tx=0x7f888000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794ed23e6660863e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888d9c8640 1 -- 172.21.15.37:0/1790950944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888000b920 con 0x56309b988a20 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888d9c8640 1 -- 172.21.15.37:0/1790950944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888000f030 con 0x56309b988a20 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.017+0000 7f888d9c8640 1 -- 172.21.15.37:0/1790950944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888000bd20 con 0x56309b988a20 2024-05-10T08:41:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 -- 172.21.15.37:0/1790950944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b988a20 msgr2=0x56309ba577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b988a20 0x56309ba577e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f888000a430 tx=0x7f888000a8f0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 -- 172.21.15.37:0/1790950944 shutdown_connections 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309b9b94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b9d1200 0x56309b988170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 --2- 172.21.15.37:0/1790950944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b988a20 0x56309ba577e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 -- 172.21.15.37:0/1790950944 >> 172.21.15.37:0/1790950944 conn(0x56309b989b30 msgr2=0x56309ba5f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 -- 172.21.15.37:0/1790950944 shutdown_connections 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 -- 172.21.15.37:0/1790950944 wait complete. 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 Processor -- start 2024-05-10T08:41:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.018+0000 7f88916d1f40 1 -- start start 2024-05-10T08:41:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f88916d1f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b988a20 0x56309ba57990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f88916d1f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b9d1200 0x56309ba50ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f88916d1f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309ba513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f88916d1f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56309ba54550 con 0x56309b9d1200 2024-05-10T08:41:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f88916d1f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56309b9d08b0 con 0x56309b9d2980 2024-05-10T08:41:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f88916d1f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56309b9b8e20 con 0x56309b988a20 2024-05-10T08:41:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b9d1200 0x56309ba50ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b9d1200 0x56309ba50ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58896/0 (socket says 172.21.15.37:58896) 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 -- 172.21.15.37:0/3361688668 learned_addr learned my addr 172.21.15.37:0/3361688668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888f9cc640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309ba513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888f1cb640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b988a20 0x56309ba57990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 -- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b988a20 msgr2=0x56309ba57990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56309b988a20 0x56309ba57990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 -- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 msgr2=0x56309ba513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309ba513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.019+0000 7f888e9ca640 1 -- 172.21.15.37:0/3361688668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309b9d1fb0 con 0x56309b9d1200 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.020+0000 7f888f9cc640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56309b9d2980 0x56309ba513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.020+0000 7f888e9ca640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b9d1200 0x56309ba50ea0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f888400a5a0 tx=0x7f8884002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.020+0000 7f888c9c6640 1 -- 172.21.15.37:0/3361688668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884063070 con 0x56309b9d1200 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.020+0000 7f888c9c6640 1 -- 172.21.15.37:0/3361688668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8884054c50 con 0x56309b9d1200 2024-05-10T08:41:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.020+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56309ba4ff90 con 0x56309b9d1200 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.020+0000 7f888c9c6640 1 -- 172.21.15.37:0/3361688668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884068460 con 0x56309b9d1200 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.020+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309b9d1cd0 con 0x56309b9d1200 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.022+0000 7f888c9c6640 1 -- 172.21.15.37:0/3361688668 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f888405c040 con 0x56309b9d1200 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.022+0000 7f888c9c6640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f887c074cb0 0x7f887c077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.022+0000 7f888c9c6640 1 -- 172.21.15.37:0/3361688668 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f88840da9e0 con 0x56309b9d1200 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.022+0000 7f888f1cb640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f887c074cb0 0x7f887c077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.022+0000 7f88916d1f40 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56309ba57ed0 0x56309ba51920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.022+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56309baef2f0 con 0x56309ba57ed0 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.022+0000 7f888f9cc640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56309ba57ed0 0x56309ba51920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f888f1cb640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f887c074cb0 0x7f887c077170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8880006010 tx=0x7f8880016040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f888f9cc640 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56309ba57ed0 0x56309ba51920 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f888f9cc640 1 -- 172.21.15.37:0/3361688668 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f888800c6e0 con 0x56309ba57ed0 2024-05-10T08:41:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56309ba57ed0 msgr2=0x56309ba51920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56309ba57ed0 0x56309ba51920 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f887c074cb0 msgr2=0x7f887c077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f887c074cb0 0x7f887c077170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8880006010 tx=0x7f8880016040 comp rx=0 tx=0).stop 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b9d1200 msgr2=0x56309ba50ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 --2- 172.21.15.37:0/3361688668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56309b9d1200 0x56309ba50ea0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f888400a5a0 tx=0x7f8884002fb0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f888f9cc640 1 -- 172.21.15.37:0/3361688668 reap_dead start 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 shutdown_connections 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 >> 172.21.15.37:0/3361688668 conn(0x56309b989b30 msgr2=0x56309b9b9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 shutdown_connections 2024-05-10T08:41:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.023+0000 7f88916d1f40 1 -- 172.21.15.37:0/3361688668 wait complete. 2024-05-10T08:41:24.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:41:24.028 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:41:24.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:41:24.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:41:24.118 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:41:24.118 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:41:24.118 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:24.118 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:24.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:41:24.135 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:41:24.135 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:41:24.135 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:24.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:41:24.154 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:41:24.154 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:24.154 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:24.191 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:41:24.191 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:41:24.192 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:41:24.192 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:24.214 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:41:24.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:24.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.335+0000 7f06539af640 1 Processor -- start 2024-05-10T08:41:24.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.335+0000 7f06539af640 1 -- start start 2024-05-10T08:41:24.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.336+0000 7f06539af640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f064c15f380 0x7f064c0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.336+0000 7f06539af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d0cf0 0x7f064c0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.336+0000 7f06539af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064c0d1760 con 0x7f064c0d3b00 2024-05-10T08:41:24.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.336+0000 7f06539af640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f064c0d30f0 con 0x7f064c15f380 2024-05-10T08:41:24.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.336+0000 7f06539af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f064c0d1150 con 0x7f064c0d0cf0 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f0650f4a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d0cf0 0x7f064c0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f0651f4c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f064c0d3b00 0x7f064c162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:43052/0 (socket says 172.21.15.37:43052) 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f065174b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f064c15f380 0x7f064c0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f0651f4c640 1 -- 172.21.15.37:0/1864063452 learned_addr learned my addr 172.21.15.37:0/1864063452 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f064bfff640 1 -- 172.21.15.37:0/1864063452 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962574162 0 0) 0x7f064c0d1760 con 0x7f064c0d3b00 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f064bfff640 1 -- 172.21.15.37:0/1864063452 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0634003520 con 0x7f064c0d3b00 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f0650f4a640 1 -- 172.21.15.37:0/1864063452 >> v2:172.21.15.82:3300/0 conn(0x7f064c15f380 msgr2=0x7f064c0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f0650f4a640 1 --2- 172.21.15.37:0/1864063452 >> v2:172.21.15.82:3300/0 conn(0x7f064c15f380 0x7f064c0d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f0650f4a640 1 -- 172.21.15.37:0/1864063452 >> v1:172.21.15.82:6789/0 conn(0x7f064c0d3b00 legacy=0x7f064c162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f0650f4a640 1 -- 172.21.15.37:0/1864063452 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c0d1a40 con 0x7f064c0d0cf0 2024-05-10T08:41:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.337+0000 7f065174b640 1 --2- 172.21.15.37:0/1864063452 >> v2:172.21.15.82:3300/0 conn(0x7f064c15f380 0x7f064c0d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.338+0000 7f0650f4a640 1 --2- 172.21.15.37:0/1864063452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d0cf0 0x7f064c0d35c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06400097a0 tx=0x7f064002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd905670e7f8436c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.338+0000 7f064bfff640 1 -- 172.21.15.37:0/1864063452 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640037070 con 0x7f064c0d0cf0 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.338+0000 7f064bfff640 1 -- 172.21.15.37:0/1864063452 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0640032440 con 0x7f064c0d0cf0 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.338+0000 7f064bfff640 1 -- 172.21.15.37:0/1864063452 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06400327f0 con 0x7f064c0d0cf0 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 -- 172.21.15.37:0/1864063452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d0cf0 msgr2=0x7f064c0d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 --2- 172.21.15.37:0/1864063452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d0cf0 0x7f064c0d35c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06400097a0 tx=0x7f064002a180 comp rx=0 tx=0).stop 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 -- 172.21.15.37:0/1864063452 shutdown_connections 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 --2- 172.21.15.37:0/1864063452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d0cf0 0x7f064c0d35c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 --2- 172.21.15.37:0/1864063452 >> v2:172.21.15.82:3300/0 conn(0x7f064c15f380 0x7f064c0d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 -- 172.21.15.37:0/1864063452 >> 172.21.15.37:0/1864063452 conn(0x7f064c0d4fe0 msgr2=0x7f064c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:24.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 -- 172.21.15.37:0/1864063452 shutdown_connections 2024-05-10T08:41:24.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.339+0000 7f06539af640 1 -- 172.21.15.37:0/1864063452 wait complete. 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.340+0000 7f06539af640 1 Processor -- start 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.340+0000 7f06539af640 1 -- start start 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f06539af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c0d0cf0 0x7f064c15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f06539af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d3b00 0x7f064c1f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f06539af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064c15f380 0x7f064c15fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f06539af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f064c0b8e40 con 0x7f064c15f380 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f06539af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f064c0d2370 con 0x7f064c0d0cf0 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f06539af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f064c0d2000 con 0x7f064c0d3b00 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064c15f380 0x7f064c15fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064c15f380 0x7f064c15fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58902/0 (socket says 172.21.15.37:58902) 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 -- 172.21.15.37:0/4142039211 learned_addr learned my addr 172.21.15.37:0/4142039211 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f065174b640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c0d0cf0 0x7f064c15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0650f4a640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d3b00 0x7f064c1f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 -- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d3b00 msgr2=0x7f064c1f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d3b00 0x7f064c1f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 -- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c0d0cf0 msgr2=0x7f064c15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c0d0cf0 0x7f064c15e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 -- 172.21.15.37:0/4142039211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c1605e0 con 0x7f064c15f380 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.341+0000 7f0651f4c640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064c15f380 0x7f064c15fe70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f063c00cb40 tx=0x7f063c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.342+0000 7f0649ffb640 1 -- 172.21.15.37:0/4142039211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c017070 con 0x7f064c15f380 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.342+0000 7f0649ffb640 1 -- 172.21.15.37:0/4142039211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c00aca0 con 0x7f064c15f380 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.342+0000 7f0649ffb640 1 -- 172.21.15.37:0/4142039211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c012620 con 0x7f064c15f380 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.342+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c1608c0 con 0x7f064c15f380 2024-05-10T08:41:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.342+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c160e80 con 0x7f064c15f380 2024-05-10T08:41:24.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.343+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c0693f0 con 0x7f064c15f380 2024-05-10T08:41:24.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.343+0000 7f0649ffb640 1 -- 172.21.15.37:0/4142039211 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f063c01a070 con 0x7f064c15f380 2024-05-10T08:41:24.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.344+0000 7f0649ffb640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06380762d0 0x7f0638078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.344+0000 7f0649ffb640 1 -- 172.21.15.37:0/4142039211 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f063c097490 con 0x7f064c15f380 2024-05-10T08:41:24.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.344+0000 7f065174b640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06380762d0 0x7f0638078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.345+0000 7f065174b640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06380762d0 0x7f0638078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0644009560 tx=0x7f0644009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.348+0000 7f0649ffb640 1 -- 172.21.15.37:0/4142039211 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f063c0606a0 con 0x7f064c15f380 2024-05-10T08:41:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.579+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f064c08cfd0 con 0x7f064c15f380 2024-05-10T08:41:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.579+0000 7f0649ffb640 1 -- 172.21.15.37:0/4142039211 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7f063c0649a0 con 0x7f064c15f380 2024-05-10T08:41:24.579 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:24.579 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.581+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06380762d0 msgr2=0x7f0638078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.581+0000 7f06539af640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06380762d0 0x7f0638078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0644009560 tx=0x7f0644009190 comp rx=0 tx=0).stop 2024-05-10T08:41:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064c15f380 msgr2=0x7f064c15fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064c15f380 0x7f064c15fe70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f063c00cb40 tx=0x7f063c00a060 comp rx=0 tx=0).stop 2024-05-10T08:41:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 shutdown_connections 2024-05-10T08:41:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06380762d0 0x7f0638078790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064c15f380 0x7f064c15fe70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f064c0d3b00 0x7f064c1f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 --2- 172.21.15.37:0/4142039211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c0d0cf0 0x7f064c15e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 >> 172.21.15.37:0/4142039211 conn(0x7f064c0d4fe0 msgr2=0x7f064c0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 shutdown_connections 2024-05-10T08:41:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.582+0000 7f06539af640 1 -- 172.21.15.37:0/4142039211 wait complete. 2024-05-10T08:41:24.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.696+0000 7f51292e1640 1 Processor -- start 2024-05-10T08:41:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.696+0000 7f51292e1640 1 -- start start 2024-05-10T08:41:24.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.697+0000 7f51292e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 0x7f51241633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.697+0000 7f51292e1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f51240cf790 0x7f51240cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.697+0000 7f51292e1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51240d0500 con 0x7f51240b21f0 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.697+0000 7f51292e1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f51241638f0 con 0x7f51240cf790 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.697+0000 7f51292e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f512406d810 con 0x7f5124162f50 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.697+0000 7f5122ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f51240b21f0 0x7f512406e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55364/0 (socket says 172.21.15.37:55364) 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.697+0000 7f5122ffd640 1 -- 172.21.15.37:0/1907272346 learned_addr learned my addr 172.21.15.37:0/1907272346 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509277522 0 0) 0x7f51240d0500 con 0x7f51240b21f0 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5110003520 con 0x7f51240b21f0 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f51237fe640 1 --2- 172.21.15.37:0/1907272346 >> v2:172.21.15.82:3300/0 conn(0x7f51240cf790 0x7f51240cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f51227fc640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 0x7f51241633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633039581 0 0) 0x7f5110003520 con 0x7f51240b21f0 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 msgr2=0x7f51241633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 0x7f51241633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 >> v2:172.21.15.82:3300/0 conn(0x7f51240cf790 msgr2=0x7f51240cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 --2- 172.21.15.37:0/1907272346 >> v2:172.21.15.82:3300/0 conn(0x7f51240cf790 0x7f51240cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512406da60 con 0x7f51240b21f0 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f511c0019f0 con 0x7f51240b21f0 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 >> v1:172.21.15.37:6789/0 conn(0x7f51240b21f0 legacy=0x7f512406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51100039b0 0x7f5110003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f5110004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 0x7f51100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f512406d810 con 0x7f5110004800 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f511000ba70 con 0x7f51100039b0 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f511000bc40 con 0x7f5124162f50 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f51227fc640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f5110004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f5122ffd640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51100039b0 0x7f5110003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.698+0000 7f51237fe640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 0x7f51100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f51227fc640 1 -- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 msgr2=0x7f51100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f51227fc640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5124162f50 0x7f51100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f51227fc640 1 -- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51100039b0 msgr2=0x7f5110003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f51227fc640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51100039b0 0x7f5110003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f51227fc640 1 -- 172.21.15.37:0/1907272346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5110003520 con 0x7f5110004800 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f51227fc640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f5110004c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f510c009ac0 tx=0x7f5110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edafdd27b304e9dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c036070 con 0x7f5110004800 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c031400 con 0x7f5110004800 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.699+0000 7f5121ffb640 1 -- 172.21.15.37:0/1907272346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c009690 con 0x7f5110004800 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.700+0000 7f51292e1640 1 -- 172.21.15.37:0/1907272346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 msgr2=0x7f5110004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.700+0000 7f51292e1640 1 --2- 172.21.15.37:0/1907272346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f5110004c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f510c009ac0 tx=0x7f5110005830 comp rx=0 tx=0).stop 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.700+0000 7f51237fe640 1 -- 172.21.15.37:0/1907272346 reap_dead start 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.700+0000 7f51292e1640 1 -- 172.21.15.37:0/1907272346 shutdown_connections 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.700+0000 7f51292e1640 1 -- 172.21.15.37:0/1907272346 >> 172.21.15.37:0/1907272346 conn(0x7f512409ba40 msgr2=0x7f512409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.700+0000 7f51292e1640 1 -- 172.21.15.37:0/1907272346 shutdown_connections 2024-05-10T08:41:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.700+0000 7f51292e1640 1 -- 172.21.15.37:0/1907272346 wait complete. 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.701+0000 7f51292e1640 1 Processor -- start 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.701+0000 7f51292e1640 1 -- start start 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51292e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f512415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51292e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51240b5980 0x7f51240b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51292e1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f512415d200 0x7f512415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51292e1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f51240b25d0 con 0x7f5110004800 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51292e1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f512406e0b0 con 0x7f512415d200 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51292e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f51240d0160 con 0x7f51240b5980 2024-05-10T08:41:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f512415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f512415f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58916/0 (socket says 172.21.15.37:58916) 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 -- 172.21.15.37:0/4202526017 learned_addr learned my addr 172.21.15.37:0/4202526017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51227fc640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51240b5980 0x7f51240b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f51237fe640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f512415d200 0x7f512415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 -- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51240b5980 msgr2=0x7f51240b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51240b5980 0x7f51240b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 -- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f512415d200 msgr2=0x7f512415d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f512415d200 0x7f512415d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.702+0000 7f5122ffd640 1 -- 172.21.15.37:0/4202526017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51240b6420 con 0x7f5110004800 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.703+0000 7f5122ffd640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f512415f070 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f511c0077a0 tx=0x7f511c00a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.703+0000 7f511b7fe640 1 -- 172.21.15.37:0/4202526017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c017020 con 0x7f5110004800 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.703+0000 7f511b7fe640 1 -- 172.21.15.37:0/4202526017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c00adc0 con 0x7f5110004800 2024-05-10T08:41:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.703+0000 7f511b7fe640 1 -- 172.21.15.37:0/4202526017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c013610 con 0x7f5110004800 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.703+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51240b6700 con 0x7f5110004800 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.703+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51240b71d0 con 0x7f5110004800 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.704+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5124069b00 con 0x7f5110004800 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.704+0000 7f511b7fe640 1 -- 172.21.15.37:0/4202526017 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f511c01a020 con 0x7f5110004800 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.705+0000 7f511b7fe640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51040762d0 0x7f5104078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.705+0000 7f511b7fe640 1 -- 172.21.15.37:0/4202526017 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f511c098260 con 0x7f5110004800 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.705+0000 7f51227fc640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51040762d0 0x7f5104078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.706+0000 7f51227fc640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51040762d0 0x7f5104078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f510c033000 tx=0x7f510c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.709+0000 7f511b7fe640 1 -- 172.21.15.37:0/4202526017 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f511c021020 con 0x7f5110004800 2024-05-10T08:41:24.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.937+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51240b68d0 con 0x7f5110004800 2024-05-10T08:41:24.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.938+0000 7f511b7fe640 1 -- 172.21.15.37:0/4202526017 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7f51240b68d0 con 0x7f5110004800 2024-05-10T08:41:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:24.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:24.938 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:24.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51040762d0 msgr2=0x7f5104078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51040762d0 0x7f5104078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f510c033000 tx=0x7f510c008030 comp rx=0 tx=0).stop 2024-05-10T08:41:24.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 msgr2=0x7f512415f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f512415f070 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f511c0077a0 tx=0x7f511c00a380 comp rx=0 tx=0).stop 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 shutdown_connections 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51040762d0 0x7f5104078790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f512415d200 0x7f512415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51240b5980 0x7f51240b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 --2- 172.21.15.37:0/4202526017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5110004800 0x7f512415f070 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 >> 172.21.15.37:0/4202526017 conn(0x7f512409ba40 msgr2=0x7f51241637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 shutdown_connections 2024-05-10T08:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:24.940+0000 7f51292e1640 1 -- 172.21.15.37:0/4202526017 wait complete. 2024-05-10T08:41:24.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.055+0000 7ffb20b19640 1 Processor -- start 2024-05-10T08:41:25.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.055+0000 7ffb20b19640 1 -- start start 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb20b19640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb1c06e0f0 0x7ffb1c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb20b19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c072840 0x7ffb1c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb20b19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb1c06e4d0 0x7ffb1c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb20b19640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1c0d14b0 con 0x7ffb1c06e4d0 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb20b19640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1c15c920 con 0x7ffb1c06e0f0 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb20b19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c15cc00 con 0x7ffb1c072840 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb1c06e4d0 0x7ffb1c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb1c06e4d0 0x7ffb1c0b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58922/0 (socket says 172.21.15.37:58922) 2024-05-10T08:41:25.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/543449769 learned_addr learned my addr 172.21.15.37:0/543449769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/543449769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c072840 msgr2=0x7ffb1c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 --2- 172.21.15.37:0/543449769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c072840 0x7ffb1c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/543449769 >> v2:172.21.15.82:3300/0 conn(0x7ffb1c06e0f0 msgr2=0x7ffb1c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 --2- 172.21.15.37:0/543449769 >> v2:172.21.15.82:3300/0 conn(0x7ffb1c06e0f0 0x7ffb1c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.056+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/543449769 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c15cee0 con 0x7ffb1c06e4d0 2024-05-10T08:41:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.057+0000 7ffb1ad9d640 1 --2- 172.21.15.37:0/543449769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c06e4d0 0x7ffb1c0b4e30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0d1cf0 tx=0x7ffb1402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d993e0b390be3e0e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.057+0000 7ffb1959a640 1 -- 172.21.15.37:0/543449769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14036070 con 0x7ffb1c06e4d0 2024-05-10T08:41:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.057+0000 7ffb1959a640 1 -- 172.21.15.37:0/543449769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14031600 con 0x7ffb1c06e4d0 2024-05-10T08:41:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.057+0000 7ffb1959a640 1 -- 172.21.15.37:0/543449769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140319d0 con 0x7ffb1c06e4d0 2024-05-10T08:41:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 -- 172.21.15.37:0/543449769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c06e4d0 msgr2=0x7ffb1c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 --2- 172.21.15.37:0/543449769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c06e4d0 0x7ffb1c0b4e30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0d1cf0 tx=0x7ffb1402a6a0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 -- 172.21.15.37:0/543449769 shutdown_connections 2024-05-10T08:41:25.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 --2- 172.21.15.37:0/543449769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c06e4d0 0x7ffb1c0b4e30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 --2- 172.21.15.37:0/543449769 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c072840 0x7ffb1c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 --2- 172.21.15.37:0/543449769 >> v2:172.21.15.82:3300/0 conn(0x7ffb1c06e0f0 0x7ffb1c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 -- 172.21.15.37:0/543449769 >> 172.21.15.37:0/543449769 conn(0x7ffb1c06c3a0 msgr2=0x7ffb1c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:25.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 -- 172.21.15.37:0/543449769 shutdown_connections 2024-05-10T08:41:25.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.058+0000 7ffb20b19640 1 -- 172.21.15.37:0/543449769 wait complete. 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.059+0000 7ffb20b19640 1 Processor -- start 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.059+0000 7ffb20b19640 1 -- start start 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb20b19640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1c06e0f0 0x7ffb1c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb20b19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c06e4d0 0x7ffb1c146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb20b19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c072840 0x7ffb1c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb20b19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0ae650 con 0x7ffb1c072840 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb20b19640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c06e980 con 0x7ffb1c06e0f0 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb20b19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c0ae7d0 con 0x7ffb1c06e4d0 2024-05-10T08:41:25.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb1ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c072840 0x7ffb1c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb1ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c072840 0x7ffb1c0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58932/0 (socket says 172.21.15.37:58932) 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/624597209 learned_addr learned my addr 172.21.15.37:0/624597209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb19d9b640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c06e4d0 0x7ffb1c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.060+0000 7ffb1a59c640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1c06e0f0 0x7ffb1c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c06e4d0 msgr2=0x7ffb1c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb1ad9d640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c06e4d0 0x7ffb1c146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1c06e0f0 msgr2=0x7ffb1c1477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb1ad9d640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1c06e0f0 0x7ffb1c1477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb1ad9d640 1 -- 172.21.15.37:0/624597209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c146a40 con 0x7ffb1c072840 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb1ad9d640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c072840 0x7ffb1c0b48d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009f40 tx=0x7ffb14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb0affd640 1 -- 172.21.15.37:0/624597209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14041020 con 0x7ffb1c072840 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb0affd640 1 -- 172.21.15.37:0/624597209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140077a0 con 0x7ffb1c072840 2024-05-10T08:41:25.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c147d00 con 0x7ffb1c072840 2024-05-10T08:41:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb0affd640 1 -- 172.21.15.37:0/624597209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14036040 con 0x7ffb1c072840 2024-05-10T08:41:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.061+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c146ce0 con 0x7ffb1c072840 2024-05-10T08:41:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.062+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c0693f0 con 0x7ffb1c072840 2024-05-10T08:41:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.063+0000 7ffb0affd640 1 -- 172.21.15.37:0/624597209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb14044020 con 0x7ffb1c072840 2024-05-10T08:41:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.063+0000 7ffb0affd640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffafc076300 0x7ffafc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.063+0000 7ffb0affd640 1 -- 172.21.15.37:0/624597209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ffb140b8480 con 0x7ffb1c072840 2024-05-10T08:41:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.063+0000 7ffb1a59c640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffafc076300 0x7ffafc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.064+0000 7ffb1a59c640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffafc076300 0x7ffafc0787c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009890 tx=0x7ffb0c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.067+0000 7ffb0affd640 1 -- 172.21.15.37:0/624597209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ffb1404b030 con 0x7ffb1c072840 2024-05-10T08:41:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.260+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb1c14af90 con 0x7ffb1c072840 2024-05-10T08:41:25.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.261+0000 7ffb0affd640 1 -- 172.21.15.37:0/624597209 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16882 (secure 0 0 0) 0x7ffb14081ce0 con 0x7ffb1c072840 2024-05-10T08:41:25.260 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:25.260 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:05.124192+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:01.557859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:02.453059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.262+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffafc076300 msgr2=0x7ffafc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.262+0000 7ffb20b19640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffafc076300 0x7ffafc0787c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009890 tx=0x7ffb0c008040 comp rx=0 tx=0).stop 2024-05-10T08:41:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c072840 msgr2=0x7ffb1c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c072840 0x7ffb1c0b48d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009f40 tx=0x7ffb14004a40 comp rx=0 tx=0).stop 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 shutdown_connections 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffafc076300 0x7ffafc0787c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb1c072840 0x7ffb1c0b48d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb1c06e4d0 0x7ffb1c146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 --2- 172.21.15.37:0/624597209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1c06e0f0 0x7ffb1c1477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 >> 172.21.15.37:0/624597209 conn(0x7ffb1c06c3a0 msgr2=0x7ffb1c15de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 shutdown_connections 2024-05-10T08:41:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.263+0000 7ffb20b19640 1 -- 172.21.15.37:0/624597209 wait complete. 2024-05-10T08:41:25.273 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:41:25.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:25.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.378+0000 7f4897e08640 1 Processor -- start 2024-05-10T08:41:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.378+0000 7f4897e08640 1 -- start start 2024-05-10T08:41:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f4897e08640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48900d1970 0x7f48900d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f4897e08640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48900d4cc0 0x7f48900d50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f4897e08640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48901630b0 con 0x7f489015f420 2024-05-10T08:41:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f4897e08640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f48900d3e70 con 0x7f48900d1970 2024-05-10T08:41:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f4897e08640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f48900d2550 con 0x7f48900d4cc0 2024-05-10T08:41:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f48953a3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48900d1970 0x7f48900d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f4895ba4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f489015f420 0x7f48900d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55366/0 (socket says 172.21.15.37:55366) 2024-05-10T08:41:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f4895ba4640 1 -- 172.21.15.37:0/3272803555 learned_addr learned my addr 172.21.15.37:0/3272803555 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.379+0000 7f48963a5640 1 --2- 172.21.15.37:0/3272803555 >> v2:172.21.15.82:3300/0 conn(0x7f48900d4cc0 0x7f48900d50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f48953a3640 1 -- 172.21.15.37:0/3272803555 >> v2:172.21.15.82:3300/0 conn(0x7f48900d4cc0 msgr2=0x7f48900d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f48953a3640 1 --2- 172.21.15.37:0/3272803555 >> v2:172.21.15.82:3300/0 conn(0x7f48900d4cc0 0x7f48900d50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f48953a3640 1 -- 172.21.15.37:0/3272803555 >> v1:172.21.15.37:6789/0 conn(0x7f489015f420 legacy=0x7f48900d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f48953a3640 1 -- 172.21.15.37:0/3272803555 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48900d2c80 con 0x7f48900d1970 2024-05-10T08:41:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f48963a5640 1 --2- 172.21.15.37:0/3272803555 >> v2:172.21.15.82:3300/0 conn(0x7f48900d4cc0 0x7f48900d50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f48953a3640 1 --2- 172.21.15.37:0/3272803555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900d1e20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48900d17a0 tx=0x7f488002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15088f50f5d037a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f4894ba2640 1 -- 172.21.15.37:0/3272803555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880037070 con 0x7f48900d1970 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f4894ba2640 1 -- 172.21.15.37:0/3272803555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4880032440 con 0x7f48900d1970 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.380+0000 7f4894ba2640 1 -- 172.21.15.37:0/3272803555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880032810 con 0x7f48900d1970 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 -- 172.21.15.37:0/3272803555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 msgr2=0x7f48900d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 --2- 172.21.15.37:0/3272803555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900d1e20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48900d17a0 tx=0x7f488002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 -- 172.21.15.37:0/3272803555 shutdown_connections 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 --2- 172.21.15.37:0/3272803555 >> v2:172.21.15.82:3300/0 conn(0x7f48900d4cc0 0x7f48900d50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 --2- 172.21.15.37:0/3272803555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900d1e20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 -- 172.21.15.37:0/3272803555 >> 172.21.15.37:0/3272803555 conn(0x7f489008eac0 msgr2=0x7f489009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 -- 172.21.15.37:0/3272803555 shutdown_connections 2024-05-10T08:41:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.381+0000 7f4897e08640 1 -- 172.21.15.37:0/3272803555 wait complete. 2024-05-10T08:41:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.382+0000 7f4897e08640 1 Processor -- start 2024-05-10T08:41:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.382+0000 7f4897e08640 1 -- start start 2024-05-10T08:41:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4897e08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4897e08640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48900d4cc0 0x7f48900b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4897e08640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4890155210 0x7f48900d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4897e08640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48900d2830 con 0x7f48900d1970 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4897e08640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48900d3240 con 0x7f4890155210 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4897e08640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f48900d5620 con 0x7f48900d4cc0 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4895ba4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4895ba4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900ba470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58950/0 (socket says 172.21.15.37:58950) 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4895ba4640 1 -- 172.21.15.37:0/2992460488 learned_addr learned my addr 172.21.15.37:0/2992460488 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f48963a5640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4890155210 0x7f48900d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f48953a3640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48900d4cc0 0x7f48900b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.383+0000 7f4895ba4640 1 -- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48900d4cc0 msgr2=0x7f48900b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f4895ba4640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48900d4cc0 0x7f48900b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f4895ba4640 1 -- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4890155210 msgr2=0x7f48900d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f4895ba4640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4890155210 0x7f48900d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f4895ba4640 1 -- 172.21.15.37:0/2992460488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48900b8ed0 con 0x7f48900d1970 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f4895ba4640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900ba470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c3f0 tx=0x7f488c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f48867fc640 1 -- 172.21.15.37:0/2992460488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c017070 con 0x7f48900d1970 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f48867fc640 1 -- 172.21.15.37:0/2992460488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f488c005ce0 con 0x7f48900d1970 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f48867fc640 1 -- 172.21.15.37:0/2992460488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c0072f0 con 0x7f48900d1970 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48900b82c0 con 0x7f48900d1970 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.384+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48900b8880 con 0x7f48900d1970 2024-05-10T08:41:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.385+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48900693f0 con 0x7f48900d1970 2024-05-10T08:41:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.386+0000 7f48867fc640 1 -- 172.21.15.37:0/2992460488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f488c01a070 con 0x7f48900d1970 2024-05-10T08:41:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.386+0000 7f48867fc640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4874076300 0x7f48740787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.386+0000 7f48867fc640 1 -- 172.21.15.37:0/2992460488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f488c0969a0 con 0x7f48900d1970 2024-05-10T08:41:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.386+0000 7f48953a3640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4874076300 0x7f48740787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.387+0000 7f48953a3640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4874076300 0x7f48740787c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4880034000 tx=0x7f488002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.391+0000 7f48867fc640 1 -- 172.21.15.37:0/2992460488 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f48901630b0 con 0x7f48900d1970 2024-05-10T08:41:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.620+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48900cd040 con 0x7f48900d1970 2024-05-10T08:41:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.620+0000 7f48867fc640 1 -- 172.21.15.37:0/2992460488 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7f488c05fbb0 con 0x7f48900d1970 2024-05-10T08:41:25.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4874076300 msgr2=0x7f48740787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4874076300 0x7f48740787c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4880034000 tx=0x7f488002e000 comp rx=0 tx=0).stop 2024-05-10T08:41:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 msgr2=0x7f48900ba470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900ba470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c3f0 tx=0x7f488c00c8b0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 shutdown_connections 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4874076300 0x7f48740787c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4890155210 0x7f48900d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48900d4cc0 0x7f48900b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 --2- 172.21.15.37:0/2992460488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48900d1970 0x7f48900ba470 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 >> 172.21.15.37:0/2992460488 conn(0x7f489008eac0 msgr2=0x7f4890075840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.622+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 shutdown_connections 2024-05-10T08:41:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.623+0000 7f4897e08640 1 -- 172.21.15.37:0/2992460488 wait complete. 2024-05-10T08:41:25.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.737+0000 7f8c74971640 1 Processor -- start 2024-05-10T08:41:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.737+0000 7f8c74971640 1 -- start start 2024-05-10T08:41:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c74971640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 0x7f8c700cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c74971640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c700d3330 con 0x7f8c700c9ee0 2024-05-10T08:41:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c74971640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c700d2170 con 0x7f8c701629a0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c74971640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700d2450 con 0x7f8c700d3cd0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8c700c9ee0 0x7f8c700d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55380/0 (socket says 172.21.15.37:55380) 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/549191290 learned_addr learned my addr 172.21.15.37:0/549191290 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c65d9b640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 0x7f8c700cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307923248 0 0) 0x7f8c700d3330 con 0x7f8c700c9ee0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c5c003520 con 0x7f8c700c9ee0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 288744819 0 0) 0x7f8c5c003520 con 0x7f8c700c9ee0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 msgr2=0x7f8c700cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 0x7f8c700cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 >> v1:172.21.15.82:6789/0 conn(0x7f8c701629a0 legacy=0x7f8c700d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c700d2730 con 0x7f8c700c9ee0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8c680019f0 con 0x7f8c700c9ee0 2024-05-10T08:41:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 >> v1:172.21.15.37:6789/0 conn(0x7f8c700c9ee0 legacy=0x7f8c700d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 0x7f8c5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c003f20 0x7f8c5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c004d40 0x7f8c5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c700d2450 con 0x7f8c5c004d40 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c00bb80 con 0x7f8c5c003f20 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.738+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c00bd80 con 0x7f8c700d3cd0 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c6ed9d640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c004d40 0x7f8c5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c6e59c640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 0x7f8c5c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c65d9b640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c003f20 0x7f8c5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 msgr2=0x7f8c5c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c6ed9d640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700d3cd0 0x7f8c5c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c003f20 msgr2=0x7f8c5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c6ed9d640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c003f20 0x7f8c5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.739+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/549191290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c003520 con 0x7f8c5c004d40 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c6ed9d640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c004d40 0x7f8c5c0051c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800a880 tx=0x7f8c5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89427b8ab2af798 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800a4a0 con 0x7f8c5c004d40 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6802f070 con 0x7f8c5c004d40 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c6dd9b640 1 -- 172.21.15.37:0/549191290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6802bd20 con 0x7f8c5c004d40 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c74971640 1 -- 172.21.15.37:0/549191290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c004d40 msgr2=0x7f8c5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c74971640 1 --2- 172.21.15.37:0/549191290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c004d40 0x7f8c5c0051c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800a880 tx=0x7f8c5c005830 comp rx=0 tx=0).stop 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/549191290 reap_dead start 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c74971640 1 -- 172.21.15.37:0/549191290 shutdown_connections 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c74971640 1 -- 172.21.15.37:0/549191290 >> 172.21.15.37:0/549191290 conn(0x7f8c700d4fe0 msgr2=0x7f8c700d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c74971640 1 -- 172.21.15.37:0/549191290 shutdown_connections 2024-05-10T08:41:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.740+0000 7f8c74971640 1 -- 172.21.15.37:0/549191290 wait complete. 2024-05-10T08:41:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.742+0000 7f8c74971640 1 Processor -- start 2024-05-10T08:41:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.742+0000 7f8c74971640 1 -- start start 2024-05-10T08:41:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c004d40 0x7f8c7015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700cd280 0x7f8c7006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c700cd700 0x7f8c700cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c700cf440 con 0x7f8c700cd700 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c700cf2c0 con 0x7f8c5c004d40 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700d2dc0 con 0x7f8c700cd280 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c700cd700 0x7f8c700cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c700cd700 0x7f8c700cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58976/0 (socket says 172.21.15.37:58976) 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/2825009137 learned_addr learned my addr 172.21.15.37:0/2825009137 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c65d9b640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700cd280 0x7f8c7006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6e59c640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c004d40 0x7f8c7015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700cd280 msgr2=0x7f8c7006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700cd280 0x7f8c7006ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c004d40 msgr2=0x7f8c7015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c004d40 0x7f8c7015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 -- 172.21.15.37:0/2825009137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c700cc1e0 con 0x7f8c700cd700 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6e59c640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c004d40 0x7f8c7015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c6ed9d640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c700cd700 0x7f8c700cdc80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800a9a0 tx=0x7f8c700b68d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c677fe640 1 -- 172.21.15.37:0/2825009137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800a4a0 con 0x7f8c700cd700 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c677fe640 1 -- 172.21.15.37:0/2825009137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c68004b60 con 0x7f8c700cd700 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c700cc4c0 con 0x7f8c700cd700 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c677fe640 1 -- 172.21.15.37:0/2825009137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68034470 con 0x7f8c700cd700 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.743+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c700cca80 con 0x7f8c700cd700 2024-05-10T08:41:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.744+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c700693f0 con 0x7f8c700cd700 2024-05-10T08:41:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.745+0000 7f8c677fe640 1 -- 172.21.15.37:0/2825009137 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c68046060 con 0x7f8c700cd700 2024-05-10T08:41:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.746+0000 7f8c677fe640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c500762d0 0x7f8c50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.746+0000 7f8c677fe640 1 -- 172.21.15.37:0/2825009137 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f8c680b7600 con 0x7f8c700cd700 2024-05-10T08:41:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.746+0000 7f8c6e59c640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c500762d0 0x7f8c50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.746+0000 7f8c6e59c640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c500762d0 0x7f8c50078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c60003700 tx=0x7f8c60009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.750+0000 7f8c677fe640 1 -- 172.21.15.37:0/2825009137 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8c68080e80 con 0x7f8c700cd700 2024-05-10T08:41:25.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.980+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c7006d280 con 0x7f8c700cd700 2024-05-10T08:41:25.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.981+0000 7f8c677fe640 1 -- 172.21.15.37:0/2825009137 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5175 (secure 0 0 0) 0x7f8c68087e20 con 0x7f8c700cd700 2024-05-10T08:41:25.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:25.981 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:03.495274+0000","modified":"2024-05-10T08:41:06.523590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3398451943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3398451943},{"type":"v1","addr":"172.21.15.37:6835","nonce":3398451943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-10T08:41:25.981 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-10T08:41:25.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c500762d0 msgr2=0x7f8c50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c500762d0 0x7f8c50078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c60003700 tx=0x7f8c60009040 comp rx=0 tx=0).stop 2024-05-10T08:41:25.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c700cd700 msgr2=0x7f8c700cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c700cd700 0x7f8c700cdc80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800a9a0 tx=0x7f8c700b68d0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 shutdown_connections 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c500762d0 0x7f8c50078790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c700cd700 0x7f8c700cdc80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c700cd280 0x7f8c7006ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 --2- 172.21.15.37:0/2825009137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c5c004d40 0x7f8c7015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 >> 172.21.15.37:0/2825009137 conn(0x7f8c700d4fe0 msgr2=0x7f8c700cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 shutdown_connections 2024-05-10T08:41:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:25.983+0000 7f8c74971640 1 -- 172.21.15.37:0/2825009137 wait complete. 2024-05-10T08:41:25.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.098+0000 7ff4ce854640 1 Processor -- start 2024-05-10T08:41:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.098+0000 7ff4ce854640 1 -- start start 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ce854640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ce854640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff4c80d0cf0 0x7ff4c80d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ce854640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c80d3b00 0x7ff4c8162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ce854640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c80d30f0 con 0x7ff4c80d3b00 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ce854640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c80d1150 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ce854640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c80d2370 con 0x7ff4c815f380 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c80d3b00 0x7ff4c8162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c80d3b00 0x7ff4c8162e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58992/0 (socket says 172.21.15.37:58992) 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 -- 172.21.15.37:0/3543093570 learned_addr learned my addr 172.21.15.37:0/3543093570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4c77fe640 1 --2- 172.21.15.37:0/3543093570 >> v2:172.21.15.82:3300/0 conn(0x7ff4c80d0cf0 0x7ff4c80d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4c7fff640 1 --2- 172.21.15.37:0/3543093570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 -- 172.21.15.37:0/3543093570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 msgr2=0x7ff4c80d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 --2- 172.21.15.37:0/3543093570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 -- 172.21.15.37:0/3543093570 >> v2:172.21.15.82:3300/0 conn(0x7ff4c80d0cf0 msgr2=0x7ff4c80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 --2- 172.21.15.37:0/3543093570 >> v2:172.21.15.82:3300/0 conn(0x7ff4c80d0cf0 0x7ff4c80d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4ccdf1640 1 -- 172.21.15.37:0/3543093570 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c80d1760 con 0x7ff4c80d3b00 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4c77fe640 1 --2- 172.21.15.37:0/3543093570 >> v2:172.21.15.82:3300/0 conn(0x7ff4c80d0cf0 0x7ff4c80d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.099+0000 7ff4c7fff640 1 --2- 172.21.15.37:0/3543093570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.100+0000 7ff4ccdf1640 1 --2- 172.21.15.37:0/3543093570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d3b00 0x7ff4c8162e90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff4c808f8b0 tx=0x7ff4c002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e22179267ec9179 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.100+0000 7ff4c6ffd640 1 -- 172.21.15.37:0/3543093570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0036070 con 0x7ff4c80d3b00 2024-05-10T08:41:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.100+0000 7ff4c6ffd640 1 -- 172.21.15.37:0/3543093570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c0031600 con 0x7ff4c80d3b00 2024-05-10T08:41:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.100+0000 7ff4c6ffd640 1 -- 172.21.15.37:0/3543093570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00319d0 con 0x7ff4c80d3b00 2024-05-10T08:41:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 -- 172.21.15.37:0/3543093570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d3b00 msgr2=0x7ff4c8162e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3543093570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d3b00 0x7ff4c8162e90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff4c808f8b0 tx=0x7ff4c002a6a0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 -- 172.21.15.37:0/3543093570 shutdown_connections 2024-05-10T08:41:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3543093570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d3b00 0x7ff4c8162e90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3543093570 >> v2:172.21.15.82:3300/0 conn(0x7ff4c80d0cf0 0x7ff4c80d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3543093570 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 -- 172.21.15.37:0/3543093570 >> 172.21.15.37:0/3543093570 conn(0x7ff4c80d4fe0 msgr2=0x7ff4c80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 -- 172.21.15.37:0/3543093570 shutdown_connections 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.101+0000 7ff4ce854640 1 -- 172.21.15.37:0/3543093570 wait complete. 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.102+0000 7ff4ce854640 1 Processor -- start 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.102+0000 7ff4ce854640 1 -- start start 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4ce854640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d0cf0 0x7ff4c81f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4ce854640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c80d3b00 0x7ff4c8160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4ce854640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4ce854640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c80d2000 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4ce854640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c80d1d20 con 0x7ff4c80d3b00 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4ce854640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c815f760 con 0x7ff4c815f380 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d0cf0 0x7ff4c81f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d0cf0 0x7ff4c81f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59000/0 (socket says 172.21.15.37:59000) 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 -- 172.21.15.37:0/3182909944 learned_addr learned my addr 172.21.15.37:0/3182909944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 -- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 msgr2=0x7ff4c80ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 -- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c80d3b00 msgr2=0x7ff4c8160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c80d3b00 0x7ff4c8160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.103+0000 7ff4c7fff640 1 -- 172.21.15.37:0/3182909944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c81f47e0 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.104+0000 7ff4c7fff640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d0cf0 0x7ff4c81f42a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c7f0 tx=0x7ff4b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.104+0000 7ff4c4ff9640 1 -- 172.21.15.37:0/3182909944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8015070 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.104+0000 7ff4c4ff9640 1 -- 172.21.15.37:0/3182909944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b8007a30 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.104+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c8151b70 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.104+0000 7ff4c4ff9640 1 -- 172.21.15.37:0/3182909944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8007de0 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.104+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c8152130 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.105+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c80693f0 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.106+0000 7ff4c4ff9640 1 -- 172.21.15.37:0/3182909944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4b8018070 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.106+0000 7ff4c4ff9640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4b40762d0 0x7ff4b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.106+0000 7ff4c4ff9640 1 -- 172.21.15.37:0/3182909944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff4b80976e0 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.106+0000 7ff4c77fe640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4b40762d0 0x7ff4b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.107+0000 7ff4c77fe640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4b40762d0 0x7ff4b4078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc006b10 tx=0x7ff4bc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.110+0000 7ff4c4ff9640 1 -- 172.21.15.37:0/3182909944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff4b8060eb0 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.302+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4c80008d0 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.303+0000 7ff4c4ff9640 1 -- 172.21.15.37:0/3182909944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16882 (secure 0 0 0) 0x7ff4b80607b0 con 0x7ff4c80d0cf0 2024-05-10T08:41:26.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:26.303 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:05.124192+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:01.557859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:02.453059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:26.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4b40762d0 msgr2=0x7ff4b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4b40762d0 0x7ff4b4078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc006b10 tx=0x7ff4bc008040 comp rx=0 tx=0).stop 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d0cf0 msgr2=0x7ff4c81f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d0cf0 0x7ff4c81f42a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c7f0 tx=0x7ff4b800cbf0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 shutdown_connections 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4b40762d0 0x7ff4b4078790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c815f380 0x7ff4c80ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c80d3b00 0x7ff4c8160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 --2- 172.21.15.37:0/3182909944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c80d0cf0 0x7ff4c81f42a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 >> 172.21.15.37:0/3182909944 conn(0x7ff4c80d4fe0 msgr2=0x7ff4c806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 shutdown_connections 2024-05-10T08:41:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.305+0000 7ff4ce854640 1 -- 172.21.15.37:0/3182909944 wait complete. 2024-05-10T08:41:26.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.423+0000 7f579c2a0640 1 Processor -- start 2024-05-10T08:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.423+0000 7f579c2a0640 1 -- start start 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579c2a0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940cf8a0 0x7f579415e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579c2a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f57940cd9a0 0x7f57940cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579c2a0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5794160d10 con 0x7f57940d39b0 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579c2a0640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f579415d5f0 con 0x7f57940cd9a0 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579c2a0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5794161920 con 0x7f57940cf8a0 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a03c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940cf8a0 0x7f579415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a83d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f57940cd9a0 0x7f57940cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a03c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940cf8a0 0x7f579415e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:56390/0 (socket says 172.21.15.37:56390) 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a03c640 1 -- 172.21.15.37:0/751226972 learned_addr learned my addr 172.21.15.37:0/751226972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579983b640 1 --1- 172.21.15.37:0/751226972 >> v1:172.21.15.82:6789/0 conn(0x7f57940d39b0 0x7f57940cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:43068/0 (socket says 172.21.15.37:43068) 2024-05-10T08:41:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a03c640 1 -- 172.21.15.37:0/751226972 >> v2:172.21.15.82:3300/0 conn(0x7f57940cd9a0 msgr2=0x7f57940cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a03c640 1 --2- 172.21.15.37:0/751226972 >> v2:172.21.15.82:3300/0 conn(0x7f57940cd9a0 0x7f57940cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a03c640 1 -- 172.21.15.37:0/751226972 >> v1:172.21.15.82:6789/0 conn(0x7f57940d39b0 legacy=0x7f57940cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a03c640 1 -- 172.21.15.37:0/751226972 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794160ff0 con 0x7f57940cf8a0 2024-05-10T08:41:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.424+0000 7f579a83d640 1 --2- 172.21.15.37:0/751226972 >> v2:172.21.15.82:3300/0 conn(0x7f57940cd9a0 0x7f57940cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.425+0000 7f579a03c640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940cf8a0 0x7f579415e180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5784009870 tx=0x7f578402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0197ecc73440e70 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.425+0000 7f579903a640 1 -- 172.21.15.37:0/751226972 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784037070 con 0x7f57940cf8a0 2024-05-10T08:41:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.425+0000 7f579903a640 1 -- 172.21.15.37:0/751226972 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5784032440 con 0x7f57940cf8a0 2024-05-10T08:41:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.425+0000 7f579903a640 1 -- 172.21.15.37:0/751226972 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784032810 con 0x7f57940cf8a0 2024-05-10T08:41:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 -- 172.21.15.37:0/751226972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940cf8a0 msgr2=0x7f579415e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940cf8a0 0x7f579415e180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5784009870 tx=0x7f578402a270 comp rx=0 tx=0).stop 2024-05-10T08:41:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 -- 172.21.15.37:0/751226972 shutdown_connections 2024-05-10T08:41:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 --2- 172.21.15.37:0/751226972 >> v2:172.21.15.82:3300/0 conn(0x7f57940cd9a0 0x7f57940cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940cf8a0 0x7f579415e180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 -- 172.21.15.37:0/751226972 >> 172.21.15.37:0/751226972 conn(0x7f57940d2e90 msgr2=0x7f57940d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 -- 172.21.15.37:0/751226972 shutdown_connections 2024-05-10T08:41:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.426+0000 7f579c2a0640 1 -- 172.21.15.37:0/751226972 wait complete. 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.427+0000 7f579c2a0640 1 Processor -- start 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.427+0000 7f579c2a0640 1 -- start start 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579c2a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57940cd9a0 0x7f57941554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579c2a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57940cf8a0 0x7f57940cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579c2a0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940d39b0 0x7f57940afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579c2a0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57941615b0 con 0x7f57940cd9a0 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579c2a0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57940d0700 con 0x7f57940cf8a0 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579c2a0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f57940ce370 con 0x7f57940d39b0 2024-05-10T08:41:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57940cd9a0 0x7f57941554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57940cd9a0 0x7f57941554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59012/0 (socket says 172.21.15.37:59012) 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 -- 172.21.15.37:0/3047733084 learned_addr learned my addr 172.21.15.37:0/3047733084 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579983b640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57940cf8a0 0x7f57940cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a83d640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940d39b0 0x7f57940afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 -- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940d39b0 msgr2=0x7f57940afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940d39b0 0x7f57940afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 -- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57940cf8a0 msgr2=0x7f57940cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57940cf8a0 0x7f57940cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a03c640 1 -- 172.21.15.37:0/3047733084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57940b30d0 con 0x7f57940cd9a0 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579a83d640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940d39b0 0x7f57940afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.428+0000 7f579983b640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57940cf8a0 0x7f57940cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.429+0000 7f579a03c640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57940cd9a0 0x7f57941554c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5784000c00 tx=0x7f57840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.429+0000 7f5792ffd640 1 -- 172.21.15.37:0/3047733084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784041070 con 0x7f57940cd9a0 2024-05-10T08:41:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.429+0000 7f5792ffd640 1 -- 172.21.15.37:0/3047733084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578403c890 con 0x7f57940cd9a0 2024-05-10T08:41:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.429+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5794071880 con 0x7f57940cd9a0 2024-05-10T08:41:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.429+0000 7f5792ffd640 1 -- 172.21.15.37:0/3047733084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784037040 con 0x7f57940cd9a0 2024-05-10T08:41:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.429+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5794071e40 con 0x7f57940cd9a0 2024-05-10T08:41:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.430+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57940693f0 con 0x7f57940cd9a0 2024-05-10T08:41:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.431+0000 7f5792ffd640 1 -- 172.21.15.37:0/3047733084 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5784044070 con 0x7f57940cd9a0 2024-05-10T08:41:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.431+0000 7f5792ffd640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f57800762d0 0x7f5780078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.431+0000 7f5792ffd640 1 -- 172.21.15.37:0/3047733084 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f57840b8100 con 0x7f57940cd9a0 2024-05-10T08:41:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.431+0000 7f579983b640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f57800762d0 0x7f5780078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.432+0000 7f579983b640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f57800762d0 0x7f5780078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5794160b10 tx=0x7f5788009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.435+0000 7f5792ffd640 1 -- 172.21.15.37:0/3047733084 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5784081960 con 0x7f57940cd9a0 2024-05-10T08:41:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.668+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f57940cf680 con 0x7f57940cd9a0 2024-05-10T08:41:26.668 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:41:26.668+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:41:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.670+0000 7f5792ffd640 1 -- 172.21.15.37:0/3047733084 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f5784081260 con 0x7f57940cd9a0 2024-05-10T08:41:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:41:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f57800762d0 msgr2=0x7f5780078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f57800762d0 0x7f5780078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5794160b10 tx=0x7f5788009040 comp rx=0 tx=0).stop 2024-05-10T08:41:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57940cd9a0 msgr2=0x7f57941554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57940cd9a0 0x7f57941554c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5784000c00 tx=0x7f57840046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 shutdown_connections 2024-05-10T08:41:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f57800762d0 0x7f5780078790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f57940d39b0 0x7f57940afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57940cf8a0 0x7f57940cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 --2- 172.21.15.37:0/3047733084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57940cd9a0 0x7f57941554c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 >> 172.21.15.37:0/3047733084 conn(0x7f57940d2e90 msgr2=0x7f57940b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 shutdown_connections 2024-05-10T08:41:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.673+0000 7f579c2a0640 1 -- 172.21.15.37:0/3047733084 wait complete. 2024-05-10T08:41:26.677 INFO:tasks.ceph.mds.c.smithi037.stderr: -6488> 2024-05-10T08:41:08.091+0000 7f4d3afe4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:41:26.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:41:26.709 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:41:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.793+0000 7f2ada8c8640 1 Processor -- start 2024-05-10T08:41:26.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.793+0000 7f2ada8c8640 1 -- start start 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ada8c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ad41606d0 0x7f2ad40cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ada8c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad40d15c0 con 0x7f2ad40cdf00 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ada8c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad40d18a0 con 0x7f2ad4071a00 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ada8c8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad40d1b80 con 0x7f2ad41606d0 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ad3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ad41606d0 0x7f2ad40cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ad3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ad41606d0 0x7f2ad40cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59020/0 (socket says 172.21.15.37:59020) 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ad37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ad40cdf00 0x7f2ad40cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55398/0 (socket says 172.21.15.37:55398) 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ad3fff640 1 -- 172.21.15.37:0/857809131 learned_addr learned my addr 172.21.15.37:0/857809131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ad3fff640 1 -- 172.21.15.37:0/857809131 >> v1:172.21.15.82:6789/0 conn(0x7f2ad4071a00 legacy=0x7f2ad40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ad3fff640 1 -- 172.21.15.37:0/857809131 >> v1:172.21.15.37:6789/0 conn(0x7f2ad40cdf00 legacy=0x7f2ad40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.794+0000 7f2ad3fff640 1 -- 172.21.15.37:0/857809131 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad40704d0 con 0x7f2ad41606d0 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.795+0000 7f2ad3fff640 1 --2- 172.21.15.37:0/857809131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad41606d0 0x7f2ad40cd9c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009870 tx=0x7f2ac402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a634b3508300be72 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.795+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/857809131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4037070 con 0x7f2ad41606d0 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.795+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/857809131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac4032440 con 0x7f2ad41606d0 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.795+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/857809131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4032810 con 0x7f2ad41606d0 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.796+0000 7f2ada8c8640 1 -- 172.21.15.37:0/857809131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad41606d0 msgr2=0x7f2ad40cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.796+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/857809131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad41606d0 0x7f2ad40cd9c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009870 tx=0x7f2ac402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.796+0000 7f2ada8c8640 1 -- 172.21.15.37:0/857809131 shutdown_connections 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.796+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/857809131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad41606d0 0x7f2ad40cd9c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.796+0000 7f2ada8c8640 1 -- 172.21.15.37:0/857809131 >> 172.21.15.37:0/857809131 conn(0x7f2ad40b49d0 msgr2=0x7f2ad40b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.796+0000 7f2ada8c8640 1 -- 172.21.15.37:0/857809131 shutdown_connections 2024-05-10T08:41:26.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.796+0000 7f2ada8c8640 1 -- 172.21.15.37:0/857809131 wait complete. 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.797+0000 7f2ada8c8640 1 Processor -- start 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.797+0000 7f2ada8c8640 1 -- start start 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ada8c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad4071a00 0x7f2ad4159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ada8c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40cdf00 0x7f2ad40cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ada8c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ad41606d0 0x7f2ad40cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ada8c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad40d0520 con 0x7f2ad40cdf00 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ada8c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad40d03a0 con 0x7f2ad4071a00 2024-05-10T08:41:26.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ada8c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad40d06a0 con 0x7f2ad41606d0 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40cdf00 0x7f2ad40cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40cdf00 0x7f2ad40cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59034/0 (socket says 172.21.15.37:59034) 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 -- 172.21.15.37:0/2647035497 learned_addr learned my addr 172.21.15.37:0/2647035497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad3fff640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad4071a00 0x7f2ad4159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad8e65640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ad41606d0 0x7f2ad40cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 -- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ad41606d0 msgr2=0x7f2ad40cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ad41606d0 0x7f2ad40cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 -- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad4071a00 msgr2=0x7f2ad4159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad4071a00 0x7f2ad4159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.798+0000 7f2ad37fe640 1 -- 172.21.15.37:0/2647035497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad40c6d40 con 0x7f2ad40cdf00 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.799+0000 7f2ad37fe640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40cdf00 0x7f2ad40cbab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800c410 tx=0x7f2ac800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.799+0000 7f2ad0ff9640 1 -- 172.21.15.37:0/2647035497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80074e0 con 0x7f2ad40cdf00 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.799+0000 7f2ad0ff9640 1 -- 172.21.15.37:0/2647035497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac8007680 con 0x7f2ad40cdf00 2024-05-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.799+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad4159dd0 con 0x7f2ad40cdf00 2024-05-10T08:41:26.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.799+0000 7f2ad0ff9640 1 -- 172.21.15.37:0/2647035497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80049e0 con 0x7f2ad40cdf00 2024-05-10T08:41:26.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.799+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad40b5ca0 con 0x7f2ad40cdf00 2024-05-10T08:41:26.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.800+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad40693f0 con 0x7f2ad40cdf00 2024-05-10T08:41:26.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.800+0000 7f2ad0ff9640 1 -- 172.21.15.37:0/2647035497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ac801a020 con 0x7f2ad40cdf00 2024-05-10T08:41:26.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.801+0000 7f2ad0ff9640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ac00762d0 0x7f2ac0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:26.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.801+0000 7f2ad0ff9640 1 -- 172.21.15.37:0/2647035497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6187+0+0 (secure 0 0 0) 0x7f2ac8096dd0 con 0x7f2ad40cdf00 2024-05-10T08:41:26.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.801+0000 7f2ad3fff640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ac00762d0 0x7f2ac0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:26.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.802+0000 7f2ad3fff640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ac00762d0 0x7f2ac0078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4034000 tx=0x7f2ac402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:26.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:26.805+0000 7f2ad0ff9640 1 -- 172.21.15.37:0/2647035497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2ad40c6d40 con 0x7f2ad40cdf00 2024-05-10T08:41:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.042+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2ad4076460 con 0x7f2ad40cdf00 2024-05-10T08:41:27.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.674+0000 7f2ad0ff9640 1 -- 172.21.15.37:0/2647035497 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f2ac805ff90 con 0x7f2ad40cdf00 2024-05-10T08:41:27.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ac00762d0 msgr2=0x7f2ac0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:27.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ac00762d0 0x7f2ac0078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4034000 tx=0x7f2ac402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40cdf00 msgr2=0x7f2ad40cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40cdf00 0x7f2ad40cbab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800c410 tx=0x7f2ac800c8d0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 shutdown_connections 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2ac00762d0 0x7f2ac0078790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ad41606d0 0x7f2ad40cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40cdf00 0x7f2ad40cbab0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 --2- 172.21.15.37:0/2647035497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad4071a00 0x7f2ad4159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 >> 172.21.15.37:0/2647035497 conn(0x7f2ad40b49d0 msgr2=0x7f2ad40b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 shutdown_connections 2024-05-10T08:41:27.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.678+0000 7f2ada8c8640 1 -- 172.21.15.37:0/2647035497 wait complete. 2024-05-10T08:41:27.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:41:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.848+0000 7fd2e9171640 1 Processor -- start 2024-05-10T08:41:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.848+0000 7fd2e9171640 1 -- start start 2024-05-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e9171640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2e4159920 0x7fd2e40ae650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e9171640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d0fc0 0x7fd2e406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e9171640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e40afa00 con 0x7fd2e40aeb90 2024-05-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e9171640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e40af160 con 0x7fd2e4159920 2024-05-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e9171640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e40af440 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e2d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2e4159920 0x7fd2e40ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2dbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd2e40aeb90 0x7fd2e40d08b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47442/0 (socket says 172.21.15.37:47442) 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2dbfff640 1 -- 172.21.15.37:0/1182287418 learned_addr learned my addr 172.21.15.37:0/1182287418 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e359e640 1 --2- 172.21.15.37:0/1182287418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d0fc0 0x7fd2e406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e2d9d640 1 -- 172.21.15.37:0/1182287418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d0fc0 msgr2=0x7fd2e406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e2d9d640 1 --2- 172.21.15.37:0/1182287418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d0fc0 0x7fd2e406e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e2d9d640 1 -- 172.21.15.37:0/1182287418 >> v1:172.21.15.37:6789/0 conn(0x7fd2e40aeb90 legacy=0x7fd2e40d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e2d9d640 1 -- 172.21.15.37:0/1182287418 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e40af720 con 0x7fd2e4159920 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.849+0000 7fd2e259c640 1 -- 172.21.15.37:0/1182287418 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108348172 0 0) 0x7fd2e40afa00 con 0x7fd2e40aeb90 2024-05-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.850+0000 7fd2e2d9d640 1 --2- 172.21.15.37:0/1182287418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e4159920 0x7fd2e40ae650 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40097a0 tx=0x7fd2d402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec8d1b2695cbf64 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.850+0000 7fd2e259c640 1 -- 172.21.15.37:0/1182287418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4037070 con 0x7fd2e4159920 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.850+0000 7fd2e259c640 1 -- 172.21.15.37:0/1182287418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d402ae50 con 0x7fd2e4159920 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.850+0000 7fd2e259c640 1 -- 172.21.15.37:0/1182287418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4032660 con 0x7fd2e4159920 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 -- 172.21.15.37:0/1182287418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e4159920 msgr2=0x7fd2e40ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 --2- 172.21.15.37:0/1182287418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e4159920 0x7fd2e40ae650 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40097a0 tx=0x7fd2d402a100 comp rx=0 tx=0).stop 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 -- 172.21.15.37:0/1182287418 shutdown_connections 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 --2- 172.21.15.37:0/1182287418 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d0fc0 0x7fd2e406e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 --2- 172.21.15.37:0/1182287418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e4159920 0x7fd2e40ae650 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 -- 172.21.15.37:0/1182287418 >> 172.21.15.37:0/1182287418 conn(0x7fd2e406c3a0 msgr2=0x7fd2e406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 -- 172.21.15.37:0/1182287418 shutdown_connections 2024-05-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.851+0000 7fd2e9171640 1 -- 172.21.15.37:0/1182287418 wait complete. 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.852+0000 7fd2e9171640 1 Processor -- start 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.852+0000 7fd2e9171640 1 -- start start 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e9171640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40aeb90 0x7fd2e415d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e9171640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d0fc0 0x7fd2e41472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e9171640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e4159920 0x7fd2e40b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e9171640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e415c5e0 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e9171640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e4159d00 con 0x7fd2e40aeb90 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e9171640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e415c760 con 0x7fd2e4159920 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d0fc0 0x7fd2e41472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d0fc0 0x7fd2e41472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46024/0 (socket says 172.21.15.37:46024) 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 -- 172.21.15.37:0/4256869472 learned_addr learned my addr 172.21.15.37:0/4256869472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e2d9d640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40aeb90 0x7fd2e415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2e359e640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e4159920 0x7fd2e40b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 -- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e4159920 msgr2=0x7fd2e40b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e4159920 0x7fd2e40b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 -- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40aeb90 msgr2=0x7fd2e415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40aeb90 0x7fd2e415d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.853+0000 7fd2dbfff640 1 -- 172.21.15.37:0/4256869472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e415da90 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.854+0000 7fd2dbfff640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d0fc0 0x7fd2e41472b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c500 tx=0x7fd2cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.854+0000 7fd2db7fe640 1 -- 172.21.15.37:0/4256869472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc018070 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.854+0000 7fd2db7fe640 1 -- 172.21.15.37:0/4256869472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc007580 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.854+0000 7fd2db7fe640 1 -- 172.21.15.37:0/4256869472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc004a20 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.854+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e414aab0 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.854+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e4149f30 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.855+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e40693f0 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.855+0000 7fd2db7fe640 1 -- 172.21.15.37:0/4256869472 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2cc01b070 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.856+0000 7fd2db7fe640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c40762d0 0x7fd2c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:27.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.856+0000 7fd2db7fe640 1 -- 172.21.15.37:0/4256869472 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6187+0+0 (secure 0 0 0) 0x7fd2cc096b20 con 0x7fd2e40d0fc0 2024-05-10T08:41:27.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.856+0000 7fd2e2d9d640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c40762d0 0x7fd2c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:27.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.857+0000 7fd2e2d9d640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c40762d0 0x7fd2c4078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4034000 tx=0x7fd2d402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:27.860+0000 7fd2db7fe640 1 -- 172.21.15.37:0/4256869472 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd2cc060290 con 0x7fd2e40d0fc0 2024-05-10T08:41:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.051+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd2e409ee80 con 0x7fd2e40d0fc0 2024-05-10T08:41:28.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.676+0000 7fd2db7fe640 1 -- 172.21.15.37:0/4256869472 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) ==== 181+0+0 (secure 0 0 0) 0x7fd2cc068280 con 0x7fd2e40d0fc0 2024-05-10T08:41:28.675 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:41:28.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c40762d0 msgr2=0x7fd2c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c40762d0 0x7fd2c4078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4034000 tx=0x7fd2d402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d0fc0 msgr2=0x7fd2e41472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d0fc0 0x7fd2e41472b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c500 tx=0x7fd2cc00c9c0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 shutdown_connections 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c40762d0 0x7fd2c4078790 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4034000 tx=0x7fd2d402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e4159920 0x7fd2e40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d0fc0 0x7fd2e41472b0 secure :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c500 tx=0x7fd2cc00c9c0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 --2- 172.21.15.37:0/4256869472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40aeb90 0x7fd2e415d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.680+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 >> 172.21.15.37:0/4256869472 conn(0x7fd2e406c3a0 msgr2=0x7fd2e40afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:28.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.681+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 shutdown_connections 2024-05-10T08:41:28.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.681+0000 7fd2e9171640 1 -- 172.21.15.37:0/4256869472 wait complete. 2024-05-10T08:41:28.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:41:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.806+0000 7fdbe0b2b640 1 Processor -- start 2024-05-10T08:41:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.806+0000 7fdbe0b2b640 1 -- start start 2024-05-10T08:41:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbe0b2b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdbdc0d13e0 0x7fdbdc0cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbe0b2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d3a00 0x7fdbdc0d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbe0b2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbdc0cd9d0 0x7fdbdc0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbe0b2b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdbdc0afb10 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbe0b2b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdbdc070ae0 con 0x7fdbdc0d13e0 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbe0b2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc0d0f30 con 0x7fdbdc0d3a00 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbdad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbdc0cd9d0 0x7fdbdc0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbdad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbdc0cd9d0 0x7fdbdc0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46030/0 (socket says 172.21.15.37:46030) 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.807+0000 7fdbdad9d640 1 -- 172.21.15.37:0/3681646087 learned_addr learned my addr 172.21.15.37:0/3681646087 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbd3fff640 1 --2- 172.21.15.37:0/3681646087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d3a00 0x7fdbdc0d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbda59c640 1 --2- 172.21.15.37:0/3681646087 >> v2:172.21.15.82:3300/0 conn(0x7fdbdc0d13e0 0x7fdbdc0cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbdad9d640 1 -- 172.21.15.37:0/3681646087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d3a00 msgr2=0x7fdbdc0d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbdad9d640 1 --2- 172.21.15.37:0/3681646087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d3a00 0x7fdbdc0d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbdad9d640 1 -- 172.21.15.37:0/3681646087 >> v2:172.21.15.82:3300/0 conn(0x7fdbdc0d13e0 msgr2=0x7fdbdc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbdad9d640 1 --2- 172.21.15.37:0/3681646087 >> v2:172.21.15.82:3300/0 conn(0x7fdbdc0d13e0 0x7fdbdc0cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbdad9d640 1 -- 172.21.15.37:0/3681646087 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc070490 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbda59c640 1 --2- 172.21.15.37:0/3681646087 >> v2:172.21.15.82:3300/0 conn(0x7fdbdc0d13e0 0x7fdbdc0cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.808+0000 7fdbdad9d640 1 --2- 172.21.15.37:0/3681646087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc0cde80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc073b20 tx=0x7fdbd402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e6275606a9bd84 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbd9d9b640 1 -- 172.21.15.37:0/3681646087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4036070 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbd9d9b640 1 -- 172.21.15.37:0/3681646087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd4031600 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbd9d9b640 1 -- 172.21.15.37:0/3681646087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40319d0 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/3681646087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 msgr2=0x7fdbdc0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/3681646087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc0cde80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc073b20 tx=0x7fdbd402a730 comp rx=0 tx=0).stop 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/3681646087 shutdown_connections 2024-05-10T08:41:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/3681646087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc0cde80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/3681646087 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d3a00 0x7fdbdc0d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/3681646087 >> v2:172.21.15.82:3300/0 conn(0x7fdbdc0d13e0 0x7fdbdc0cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/3681646087 >> 172.21.15.37:0/3681646087 conn(0x7fdbdc0d2e00 msgr2=0x7fdbdc0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/3681646087 shutdown_connections 2024-05-10T08:41:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.809+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/3681646087 wait complete. 2024-05-10T08:41:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.810+0000 7fdbe0b2b640 1 Processor -- start 2024-05-10T08:41:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbe0b2b640 1 -- start start 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbe0b2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc09d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbe0b2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d13e0 0x7fdbdc0afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbe0b2b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbdc0d3a00 0x7fdbdc14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbe0b2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc0d0be0 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbe0b2b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc15d660 con 0x7fdbdc0d3a00 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbe0b2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc0d1d00 con 0x7fdbdc0d13e0 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbda59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc09d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbda59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc09d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46034/0 (socket says 172.21.15.37:46034) 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.811+0000 7fdbda59c640 1 -- 172.21.15.37:0/1569543731 learned_addr learned my addr 172.21.15.37:0/1569543731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbd3fff640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d13e0 0x7fdbdc0afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbdad9d640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbdc0d3a00 0x7fdbdc14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbda59c640 1 -- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d13e0 msgr2=0x7fdbdc0afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbda59c640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d13e0 0x7fdbdc0afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbda59c640 1 -- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbdc0d3a00 msgr2=0x7fdbdc14e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbda59c640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbdc0d3a00 0x7fdbdc14e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbda59c640 1 -- 172.21.15.37:0/1569543731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc0b01e0 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbda59c640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc09d940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00e810 tx=0x7fdbcc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbd2ffd640 1 -- 172.21.15.37:0/1569543731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00f040 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbd2ffd640 1 -- 172.21.15.37:0/1569543731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc004030 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbdc14f390 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbd2ffd640 1 -- 172.21.15.37:0/1569543731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc004400 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.812+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbdc14f950 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.813+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbdc0693f0 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.814+0000 7fdbd2ffd640 1 -- 172.21.15.37:0/1569543731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdbcc00c6d0 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.814+0000 7fdbd2ffd640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdbbc076300 0x7fdbbc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.814+0000 7fdbd2ffd640 1 -- 172.21.15.37:0/1569543731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5749+0+0 (secure 0 0 0) 0x7fdbcc097290 con 0x7fdbdc0cd9d0 2024-05-10T08:41:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.815+0000 7fdbd3fff640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdbbc076300 0x7fdbbc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.815+0000 7fdbd3fff640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdbbc076300 0x7fdbbc0787c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc155920 tx=0x7fdbc4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:28.819+0000 7fdbd2ffd640 1 -- 172.21.15.37:0/1569543731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdbcc017020 con 0x7fdbdc0cd9d0 2024-05-10T08:41:29.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.009+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdbdc14eeb0 con 0x7fdbdc0cd9d0 2024-05-10T08:41:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.680+0000 7fdbd2ffd640 1 -- 172.21.15.37:0/1569543731 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) ==== 169+0+0 (secure 0 0 0) 0x7fdbcc0604e0 con 0x7fdbdc0cd9d0 2024-05-10T08:41:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:41:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdbbc076300 msgr2=0x7fdbbc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdbbc076300 0x7fdbbc0787c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc155920 tx=0x7fdbc4009190 comp rx=0 tx=0).stop 2024-05-10T08:41:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 msgr2=0x7fdbdc09d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc09d940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00e810 tx=0x7fdbcc00ecd0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 shutdown_connections 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdbbc076300 0x7fdbbc0787c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbdc0d3a00 0x7fdbdc14e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdbdc0d13e0 0x7fdbdc0afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 --2- 172.21.15.37:0/1569543731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cd9d0 0x7fdbdc09d940 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.684+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 >> 172.21.15.37:0/1569543731 conn(0x7fdbdc0d2e00 msgr2=0x7fdbdc071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.686+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 shutdown_connections 2024-05-10T08:41:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.686+0000 7fdbe0b2b640 1 -- 172.21.15.37:0/1569543731 wait complete. 2024-05-10T08:41:29.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T08:41:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.816+0000 7fd6124b0640 1 Processor -- start 2024-05-10T08:41:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.816+0000 7fd6124b0640 1 -- start start 2024-05-10T08:41:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.817+0000 7fd6124b0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 0x7fd60c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.817+0000 7fd6124b0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0d3330 con 0x7fd60c1629a0 2024-05-10T08:41:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.817+0000 7fd6124b0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0d2170 con 0x7fd60c0d3cd0 2024-05-10T08:41:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.817+0000 7fd6124b0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0d2450 con 0x7fd60c0c9ee0 2024-05-10T08:41:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.817+0000 7fd60bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd60c1629a0 0x7fd60c0d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47450/0 (socket says 172.21.15.37:47450) 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.817+0000 7fd60bfff640 1 -- 172.21.15.37:0/4106627692 learned_addr learned my addr 172.21.15.37:0/4106627692 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd610a4d640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 0x7fd60c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703353268 0 0) 0x7fd60c0d3330 con 0x7fd60c1629a0 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f4003520 con 0x7fd60c1629a0 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3839123346 0 0) 0x7fd5f4003520 con 0x7fd60c1629a0 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 msgr2=0x7fd60c0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 0x7fd60c0d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 >> v1:172.21.15.82:6789/0 conn(0x7fd60c0d3cd0 legacy=0x7fd60c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0d2730 con 0x7fd60c1629a0 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fd5fc001670 con 0x7fd60c1629a0 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 >> v1:172.21.15.37:6789/0 conn(0x7fd60c1629a0 legacy=0x7fd60c0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 0x7fd5f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f4004d40 0x7fd5f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0d2450 con 0x7fd5f40039e0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f400bb50 con 0x7fd5f4004d40 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f400bd20 con 0x7fd60c0c9ee0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60bfff640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd610a4d640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f4004d40 0x7fd5f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60b7fe640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 0x7fd5f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60bfff640 1 -- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 msgr2=0x7fd5f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60bfff640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd60c0c9ee0 0x7fd5f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60bfff640 1 -- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f4004d40 msgr2=0x7fd5f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60bfff640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f4004d40 0x7fd5f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd60bfff640 1 -- 172.21.15.37:0/4106627692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f4003520 con 0x7fd5f40039e0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.818+0000 7fd610a4d640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f4004d40 0x7fd5f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.819+0000 7fd60bfff640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c270 tx=0x7fd5f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caac045e9c027c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.819+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc007d30 con 0x7fd5f40039e0 2024-05-10T08:41:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.819+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc005af0 con 0x7fd5f40039e0 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.819+0000 7fd60affd640 1 -- 172.21.15.37:0/4106627692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc007070 con 0x7fd5f40039e0 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.820+0000 7fd6124b0640 1 -- 172.21.15.37:0/4106627692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f40039e0 msgr2=0x7fd5f4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.820+0000 7fd6124b0640 1 --2- 172.21.15.37:0/4106627692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f40039e0 0x7fd5f4003dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c270 tx=0x7fd5f4005830 comp rx=0 tx=0).stop 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.820+0000 7fd610a4d640 1 -- 172.21.15.37:0/4106627692 reap_dead start 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.820+0000 7fd6124b0640 1 -- 172.21.15.37:0/4106627692 shutdown_connections 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.820+0000 7fd6124b0640 1 -- 172.21.15.37:0/4106627692 >> 172.21.15.37:0/4106627692 conn(0x7fd60c0d4fe0 msgr2=0x7fd60c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.820+0000 7fd6124b0640 1 -- 172.21.15.37:0/4106627692 shutdown_connections 2024-05-10T08:41:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.820+0000 7fd6124b0640 1 -- 172.21.15.37:0/4106627692 wait complete. 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.821+0000 7fd6124b0640 1 Processor -- start 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.821+0000 7fd6124b0640 1 -- start start 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd6124b0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f40039e0 0x7fd60c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd6124b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0cddc0 0x7fd60c15ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd6124b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd60c15ae20 0x7fd60c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd6124b0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0cf440 con 0x7fd60c15ae20 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd6124b0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0cf2c0 con 0x7fd60c0cddc0 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd6124b0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0d2dc0 con 0x7fd5f40039e0 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd60c15ae20 0x7fd60c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd60c15ae20 0x7fd60c15cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46050/0 (socket says 172.21.15.37:46050) 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 -- 172.21.15.37:0/2046996625 learned_addr learned my addr 172.21.15.37:0/2046996625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd60bfff640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f40039e0 0x7fd60c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd60b7fe640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0cddc0 0x7fd60c15ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 -- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f40039e0 msgr2=0x7fd60c0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f40039e0 0x7fd60c0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 -- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0cddc0 msgr2=0x7fd60c15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0cddc0 0x7fd60c15ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.822+0000 7fd610a4d640 1 -- 172.21.15.37:0/2046996625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c15fd60 con 0x7fd60c15ae20 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.823+0000 7fd610a4d640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd60c15ae20 0x7fd60c15cf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0b7b70 tx=0x7fd604010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.823+0000 7fd608ff9640 1 -- 172.21.15.37:0/2046996625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604003990 con 0x7fd60c15ae20 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.823+0000 7fd608ff9640 1 -- 172.21.15.37:0/2046996625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd604003b50 con 0x7fd60c15ae20 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.823+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c15f4c0 con 0x7fd60c15ae20 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.823+0000 7fd608ff9640 1 -- 172.21.15.37:0/2046996625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604004020 con 0x7fd60c15ae20 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.823+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c15fa80 con 0x7fd60c15ae20 2024-05-10T08:41:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.824+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c0693f0 con 0x7fd60c15ae20 2024-05-10T08:41:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.824+0000 7fd608ff9640 1 -- 172.21.15.37:0/2046996625 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd60401e030 con 0x7fd60c15ae20 2024-05-10T08:41:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.825+0000 7fd608ff9640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5f80762d0 0x7fd5f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.825+0000 7fd608ff9640 1 -- 172.21.15.37:0/2046996625 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7fd604097a20 con 0x7fd60c15ae20 2024-05-10T08:41:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.825+0000 7fd60bfff640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5f80762d0 0x7fd5f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.826+0000 7fd60bfff640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5f80762d0 0x7fd5f8078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc033000 tx=0x7fd5fc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:29.829+0000 7fd608ff9640 1 -- 172.21.15.37:0/2046996625 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd604025020 con 0x7fd60c15ae20 2024-05-10T08:41:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.021+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd60c0763f0 con 0x7fd60c15ae20 2024-05-10T08:41:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.024+0000 7fd608ff9640 1 -- 172.21.15.37:0/2046996625 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fd604060f30 con 0x7fd60c15ae20 2024-05-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5f80762d0 msgr2=0x7fd5f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5f80762d0 0x7fd5f8078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc033000 tx=0x7fd5fc02e000 comp rx=0 tx=0).stop 2024-05-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd60c15ae20 msgr2=0x7fd60c15cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd60c15ae20 0x7fd60c15cf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0b7b70 tx=0x7fd604010590 comp rx=0 tx=0).stop 2024-05-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 shutdown_connections 2024-05-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5f80762d0 0x7fd5f8078790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd60c15ae20 0x7fd60c15cf30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd60c0cddc0 0x7fd60c15ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 --2- 172.21.15.37:0/2046996625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5f40039e0 0x7fd60c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 >> 172.21.15.37:0/2046996625 conn(0x7fd60c0d4fe0 msgr2=0x7fd60c0b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 shutdown_connections 2024-05-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.026+0000 7fd6124b0640 1 -- 172.21.15.37:0/2046996625 wait complete. 2024-05-10T08:41:30.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-05-10T08:41:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.144+0000 7f7931c59640 1 Processor -- start 2024-05-10T08:41:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.144+0000 7f7931c59640 1 -- start start 2024-05-10T08:41:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7931c59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f792c15f2d0 0x7f792c0b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7931c59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f792c0d4fc0 0x7f792c0d5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7931c59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f792c0d2730 con 0x7f792c0d1c00 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7931c59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f792c0d5960 con 0x7f792c0d4fc0 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7931c59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f792c0b5810 con 0x7f792c15f2d0 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f792bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f792c0d1c00 0x7f792c0d2020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47456/0 (socket says 172.21.15.37:47456) 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f792bfff640 1 -- 172.21.15.37:0/420100386 learned_addr learned my addr 172.21.15.37:0/420100386 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7923fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f792c0d4fc0 0x7f792c0d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f792b7fe640 1 --2- 172.21.15.37:0/420100386 >> v2:172.21.15.82:3300/0 conn(0x7f792c15f2d0 0x7f792c0b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f792affd640 1 -- 172.21.15.37:0/420100386 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112233790 0 0) 0x7f792c0d2730 con 0x7f792c0d1c00 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f792affd640 1 -- 172.21.15.37:0/420100386 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7918003520 con 0x7f792c0d1c00 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7923fff640 1 -- 172.21.15.37:0/420100386 >> v2:172.21.15.82:3300/0 conn(0x7f792c15f2d0 msgr2=0x7f792c0b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7923fff640 1 --2- 172.21.15.37:0/420100386 >> v2:172.21.15.82:3300/0 conn(0x7f792c15f2d0 0x7f792c0b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7923fff640 1 -- 172.21.15.37:0/420100386 >> v1:172.21.15.37:6789/0 conn(0x7f792c0d1c00 legacy=0x7f792c0d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f7923fff640 1 -- 172.21.15.37:0/420100386 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c1606c0 con 0x7f792c0d4fc0 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.145+0000 7f792b7fe640 1 --2- 172.21.15.37:0/420100386 >> v2:172.21.15.82:3300/0 conn(0x7f792c15f2d0 0x7f792c0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.146+0000 7f7923fff640 1 --2- 172.21.15.37:0/420100386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c0d4fc0 0x7f792c0d5420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f792c0d4f90 tx=0x7f791402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276b3ef24636b3af server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.146+0000 7f792affd640 1 -- 172.21.15.37:0/420100386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914037070 con 0x7f792c0d4fc0 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.146+0000 7f792affd640 1 -- 172.21.15.37:0/420100386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7914032440 con 0x7f792c0d4fc0 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.146+0000 7f792affd640 1 -- 172.21.15.37:0/420100386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914032810 con 0x7f792c0d4fc0 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 -- 172.21.15.37:0/420100386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c0d4fc0 msgr2=0x7f792c0d5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 --2- 172.21.15.37:0/420100386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c0d4fc0 0x7f792c0d5420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f792c0d4f90 tx=0x7f791402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 -- 172.21.15.37:0/420100386 shutdown_connections 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 --2- 172.21.15.37:0/420100386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c0d4fc0 0x7f792c0d5420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 --2- 172.21.15.37:0/420100386 >> v2:172.21.15.82:3300/0 conn(0x7f792c15f2d0 0x7f792c0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 -- 172.21.15.37:0/420100386 >> 172.21.15.37:0/420100386 conn(0x7f792c0746d0 msgr2=0x7f792c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 -- 172.21.15.37:0/420100386 shutdown_connections 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.147+0000 7f7931c59640 1 -- 172.21.15.37:0/420100386 wait complete. 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.148+0000 7f7931c59640 1 Processor -- start 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.148+0000 7f7931c59640 1 -- start start 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7931c59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f792c0d1c00 0x7f792c14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7931c59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f792c0d4fc0 0x7f792c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7931c59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c15f2d0 0x7f792c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7931c59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f792c0b54a0 con 0x7f792c15f2d0 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7931c59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f792c0b51c0 con 0x7f792c0d1c00 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7931c59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f792c0d2c00 con 0x7f792c0d4fc0 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c15f2d0 0x7f792c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c15f2d0 0x7f792c15d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46060/0 (socket says 172.21.15.37:46060) 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 -- 172.21.15.37:0/4212792993 learned_addr learned my addr 172.21.15.37:0/4212792993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792b7fe640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f792c0d1c00 0x7f792c14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7923fff640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f792c0d4fc0 0x7f792c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 -- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f792c0d4fc0 msgr2=0x7f792c15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f792c0d4fc0 0x7f792c15d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 -- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f792c0d1c00 msgr2=0x7f792c14e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f792c0d1c00 0x7f792c14e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 -- 172.21.15.37:0/4212792993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c1f94e0 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f792bfff640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c15f2d0 0x7f792c15d6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f792400cb70 tx=0x7f792400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.149+0000 7f7928ff9640 1 -- 172.21.15.37:0/4212792993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924017070 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.150+0000 7f7928ff9640 1 -- 172.21.15.37:0/4212792993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792400ace0 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.150+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792c0cc350 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.150+0000 7f7928ff9640 1 -- 172.21.15.37:0/4212792993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924012620 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.150+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792c1f87b0 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.151+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792c069b00 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.151+0000 7f7928ff9640 1 -- 172.21.15.37:0/4212792993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f792401a070 con 0x7f792c15f2d0 2024-05-10T08:41:30.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.152+0000 7f7928ff9640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f790c076300 0x7f790c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.152+0000 7f7928ff9640 1 -- 172.21.15.37:0/4212792993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f7924097240 con 0x7f792c15f2d0 2024-05-10T08:41:30.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.152+0000 7f792b7fe640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f790c076300 0x7f790c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.153+0000 7f792b7fe640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f790c076300 0x7f790c0787c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f791c006fd0 tx=0x7f791c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.156+0000 7f7928ff9640 1 -- 172.21.15.37:0/4212792993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7924060da0 con 0x7f792c15f2d0 2024-05-10T08:41:30.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.420+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f792c0b4330 con 0x7f792c15f2d0 2024-05-10T08:41:30.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.681+0000 7f7928ff9640 1 -- 172.21.15.37:0/4212792993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v84) ==== 142+0+0 (secure 0 0 0) 0x7f79240606a0 con 0x7f792c15f2d0 2024-05-10T08:41:30.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f790c076300 msgr2=0x7f790c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f790c076300 0x7f790c0787c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f791c006fd0 tx=0x7f791c008040 comp rx=0 tx=0).stop 2024-05-10T08:41:30.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c15f2d0 msgr2=0x7f792c15d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c15f2d0 0x7f792c15d6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f792400cb70 tx=0x7f792400a430 comp rx=0 tx=0).stop 2024-05-10T08:41:30.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 shutdown_connections 2024-05-10T08:41:30.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f790c076300 0x7f790c0787c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f792c15f2d0 0x7f792c15d6c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f792c0d4fc0 0x7f792c15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.683+0000 7f7931c59640 1 --2- 172.21.15.37:0/4212792993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f792c0d1c00 0x7f792c14e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.684+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 >> 172.21.15.37:0/4212792993 conn(0x7f792c0746d0 msgr2=0x7f792c0b6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.684+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 shutdown_connections 2024-05-10T08:41:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.684+0000 7f7931c59640 1 -- 172.21.15.37:0/4212792993 wait complete. 2024-05-10T08:41:30.695 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-05-10T08:41:30.695 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-05-10T08:41:30.695 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T08:41:30.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.801+0000 7f7ad7a93640 1 Processor -- start 2024-05-10T08:41:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.801+0000 7f7ad7a93640 1 -- start start 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad7a93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad015f0c0 0x7f7ad00b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad7a93640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ad01638e0 0x7f7ad00b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad7a93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad00b1260 con 0x7f7ad006c3a0 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad7a93640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad0163450 con 0x7f7ad01638e0 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad7a93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad01604b0 con 0x7f7ad015f0c0 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad502e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ad01638e0 0x7f7ad00b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad6030640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7ad006c3a0 0x7f7ad0073170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47468/0 (socket says 172.21.15.37:47468) 2024-05-10T08:41:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad6030640 1 -- 172.21.15.37:0/2176554964 learned_addr learned my addr 172.21.15.37:0/2176554964 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad582f640 1 --2- 172.21.15.37:0/2176554964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad015f0c0 0x7f7ad00b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad502e640 1 -- 172.21.15.37:0/2176554964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad015f0c0 msgr2=0x7f7ad00b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad502e640 1 --2- 172.21.15.37:0/2176554964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad015f0c0 0x7f7ad00b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad502e640 1 -- 172.21.15.37:0/2176554964 >> v1:172.21.15.37:6789/0 conn(0x7f7ad006c3a0 legacy=0x7f7ad0073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad502e640 1 -- 172.21.15.37:0/2176554964 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad00b14e0 con 0x7f7ad01638e0 2024-05-10T08:41:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad482d640 1 -- 172.21.15.37:0/2176554964 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869375770 0 0) 0x7f7ac8001110 con 0x7f7ad006c3a0 2024-05-10T08:41:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.802+0000 7f7ad582f640 1 --2- 172.21.15.37:0/2176554964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad015f0c0 0x7f7ad00b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.803+0000 7f7ad502e640 1 --2- 172.21.15.37:0/2176554964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad01638e0 0x7f7ad00b0d20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097a0 tx=0x7f7ac002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e89cef938f569c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.803+0000 7f7ad482d640 1 -- 172.21.15.37:0/2176554964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0037070 con 0x7f7ad01638e0 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.803+0000 7f7ad482d640 1 -- 172.21.15.37:0/2176554964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac0032440 con 0x7f7ad01638e0 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.803+0000 7f7ad482d640 1 -- 172.21.15.37:0/2176554964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0032810 con 0x7f7ad01638e0 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 -- 172.21.15.37:0/2176554964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad01638e0 msgr2=0x7f7ad00b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/2176554964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad01638e0 0x7f7ad00b0d20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097a0 tx=0x7f7ac002a180 comp rx=0 tx=0).stop 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 -- 172.21.15.37:0/2176554964 shutdown_connections 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/2176554964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad01638e0 0x7f7ad00b0d20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/2176554964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad015f0c0 0x7f7ad00b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 -- 172.21.15.37:0/2176554964 >> 172.21.15.37:0/2176554964 conn(0x7f7ad00b3b10 msgr2=0x7f7ad00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 -- 172.21.15.37:0/2176554964 shutdown_connections 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.804+0000 7f7ad7a93640 1 -- 172.21.15.37:0/2176554964 wait complete. 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.805+0000 7f7ad7a93640 1 Processor -- start 2024-05-10T08:41:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.805+0000 7f7ad7a93640 1 -- start start 2024-05-10T08:41:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad7a93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad006c3a0 0x7f7ad0156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad7a93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad015f0c0 0x7f7ad01f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad7a93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad01638e0 0x7f7ad01497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad7a93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad00b17c0 con 0x7f7ad015f0c0 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad7a93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad01630e0 con 0x7f7ad006c3a0 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad7a93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad006c830 con 0x7f7ad01638e0 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad015f0c0 0x7f7ad01f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad015f0c0 0x7f7ad01f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46080/0 (socket says 172.21.15.37:46080) 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 -- 172.21.15.37:0/546566526 learned_addr learned my addr 172.21.15.37:0/546566526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad6030640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad01638e0 0x7f7ad01497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad582f640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad006c3a0 0x7f7ad0156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 -- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad01638e0 msgr2=0x7f7ad01497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad01638e0 0x7f7ad01497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 -- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad006c3a0 msgr2=0x7f7ad0156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad006c3a0 0x7f7ad0156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.806+0000 7f7ad502e640 1 -- 172.21.15.37:0/546566526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad00b0c10 con 0x7f7ad015f0c0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.807+0000 7f7ad502e640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad015f0c0 0x7f7ad01f8e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097a0 tx=0x7f7ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.807+0000 7f7ac67fc640 1 -- 172.21.15.37:0/546566526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0037050 con 0x7f7ad015f0c0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.807+0000 7f7ac67fc640 1 -- 172.21.15.37:0/546566526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac0038040 con 0x7f7ad015f0c0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.807+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad00b0ef0 con 0x7f7ad015f0c0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.807+0000 7f7ac67fc640 1 -- 172.21.15.37:0/546566526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0004470 con 0x7f7ad015f0c0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.807+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad01f8960 con 0x7f7ad015f0c0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.808+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad006a8f0 con 0x7f7ad015f0c0 2024-05-10T08:41:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.808+0000 7f7ac67fc640 1 -- 172.21.15.37:0/546566526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ac0030900 con 0x7f7ad015f0c0 2024-05-10T08:41:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.809+0000 7f7ac67fc640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab40762d0 0x7f7ab4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.809+0000 7f7ac67fc640 1 -- 172.21.15.37:0/546566526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f7ac00b7f10 con 0x7f7ad015f0c0 2024-05-10T08:41:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.809+0000 7f7ad582f640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab40762d0 0x7f7ab4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.810+0000 7f7ad582f640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab40762d0 0x7f7ab4078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009f70 tx=0x7f7acc00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:30.813+0000 7f7ac67fc640 1 -- 172.21.15.37:0/546566526 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7ac0081a70 con 0x7f7ad015f0c0 2024-05-10T08:41:31.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.007+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ad00693f0 con 0x7f7ad015f0c0 2024-05-10T08:41:31.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.008+0000 7f7ac67fc640 1 -- 172.21.15.37:0/546566526 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+13233 (secure 0 0 0) 0x7f7ac0081370 con 0x7f7ad015f0c0 2024-05-10T08:41:31.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:31.008 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:29.677408+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3398451943":"2024-05-11T08:41:26.669541+0000","172.21.15.37:6833/3398451943":"2024-05-11T08:41:26.669541+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:31.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab40762d0 msgr2=0x7f7ab4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab40762d0 0x7f7ab4078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009f70 tx=0x7f7acc00b040 comp rx=0 tx=0).stop 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad015f0c0 msgr2=0x7f7ad01f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad015f0c0 0x7f7ad01f8e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097a0 tx=0x7f7ac00046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 shutdown_connections 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab40762d0 0x7f7ab4078790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ad01638e0 0x7f7ad01497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad015f0c0 0x7f7ad01f8e80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 --2- 172.21.15.37:0/546566526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ad006c3a0 0x7f7ad0156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 >> 172.21.15.37:0/546566526 conn(0x7f7ad00b3b10 msgr2=0x7f7ad0160910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 shutdown_connections 2024-05-10T08:41:31.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.010+0000 7f7ad7a93640 1 -- 172.21.15.37:0/546566526 wait complete. 2024-05-10T08:41:31.021 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T08:40:11.341540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T08:41:31.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T08:41:31.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.128+0000 7f218e946640 1 Processor -- start 2024-05-10T08:41:31.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.128+0000 7f218e946640 1 -- start start 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218e946640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f21880af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218e946640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21880b48a0 0x7f21880afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218e946640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21880701d0 con 0x7f2188157540 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218e946640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f21880b01c0 con 0x7f21880b48a0 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218e946640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f21880b3dc0 con 0x7f218806fc30 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218cee3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21880b48a0 0x7f21880afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218cee3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21880b48a0 0x7f21880afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46084/0 (socket says 172.21.15.37:46084) 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218cee3640 1 -- 172.21.15.37:0/4032656153 learned_addr learned my addr 172.21.15.37:0/4032656153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f21877fe640 1 --2- 172.21.15.37:0/4032656153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f21880af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218cee3640 1 -- 172.21.15.37:0/4032656153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 msgr2=0x7f21880af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218cee3640 1 --2- 172.21.15.37:0/4032656153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f21880af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218cee3640 1 -- 172.21.15.37:0/4032656153 >> v1:172.21.15.82:6789/0 conn(0x7f2188157540 legacy=0x7f218815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.129+0000 7f218cee3640 1 -- 172.21.15.37:0/4032656153 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21880b40a0 con 0x7f21880b48a0 2024-05-10T08:41:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.130+0000 7f218cee3640 1 --2- 172.21.15.37:0/4032656153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880b48a0 0x7f21880afc80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2180009e50 tx=0x7f218002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe46588affd4286 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.130+0000 7f2186ffd640 1 -- 172.21.15.37:0/4032656153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180036070 con 0x7f21880b48a0 2024-05-10T08:41:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.130+0000 7f2186ffd640 1 -- 172.21.15.37:0/4032656153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2180031600 con 0x7f21880b48a0 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.130+0000 7f2186ffd640 1 -- 172.21.15.37:0/4032656153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21800319d0 con 0x7f21880b48a0 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 -- 172.21.15.37:0/4032656153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880b48a0 msgr2=0x7f21880afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 --2- 172.21.15.37:0/4032656153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880b48a0 0x7f21880afc80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2180009e50 tx=0x7f218002a710 comp rx=0 tx=0).stop 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 -- 172.21.15.37:0/4032656153 shutdown_connections 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 --2- 172.21.15.37:0/4032656153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f21880af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 --2- 172.21.15.37:0/4032656153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880b48a0 0x7f21880afc80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 -- 172.21.15.37:0/4032656153 >> 172.21.15.37:0/4032656153 conn(0x7f218806c3a0 msgr2=0x7f218806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 -- 172.21.15.37:0/4032656153 shutdown_connections 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.131+0000 7f218e946640 1 -- 172.21.15.37:0/4032656153 wait complete. 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.132+0000 7f218e946640 1 Processor -- start 2024-05-10T08:41:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.132+0000 7f218e946640 1 -- start start 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218e946640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f218815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218e946640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880b48a0 0x7f21881f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218e946640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2188157540 0x7f21881f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218e946640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2188157aa0 con 0x7f2188157540 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218e946640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2188157920 con 0x7f21880b48a0 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218e946640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f21880ced20 con 0x7f218806fc30 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2188157540 0x7f21881f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2188157540 0x7f21881f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46098/0 (socket says 172.21.15.37:46098) 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 -- 172.21.15.37:0/3698147977 learned_addr learned my addr 172.21.15.37:0/3698147977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f21877fe640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880b48a0 0x7f21881f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f2187fff640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f218815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 -- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 msgr2=0x7f218815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f218815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 -- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880b48a0 msgr2=0x7f21881f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880b48a0 0x7f21881f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 -- 172.21.15.37:0/3698147977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21881f2bd0 con 0x7f2188157540 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.133+0000 7f218cee3640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2188157540 0x7f21881f3360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2180009f70 tx=0x7f2180004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.134+0000 7f2184ff9640 1 -- 172.21.15.37:0/3698147977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218003f020 con 0x7f2188157540 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.134+0000 7f2184ff9640 1 -- 172.21.15.37:0/3698147977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2180037040 con 0x7f2188157540 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.134+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218815ab00 con 0x7f2188157540 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.134+0000 7f2184ff9640 1 -- 172.21.15.37:0/3698147977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180036070 con 0x7f2188157540 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.134+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21881f6bc0 con 0x7f2188157540 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.135+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21880693f0 con 0x7f2188157540 2024-05-10T08:41:31.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.135+0000 7f2184ff9640 1 -- 172.21.15.37:0/3698147977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2180042020 con 0x7f2188157540 2024-05-10T08:41:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.136+0000 7f2184ff9640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21740762d0 0x7f2174078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.136+0000 7f2184ff9640 1 -- 172.21.15.37:0/3698147977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f21800b7830 con 0x7f2188157540 2024-05-10T08:41:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.136+0000 7f2187fff640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21740762d0 0x7f2174078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.137+0000 7f2187fff640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21740762d0 0x7f2174078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21780016e0 tx=0x7f2178009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:31.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.140+0000 7f2184ff9640 1 -- 172.21.15.37:0/3698147977 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2180049030 con 0x7f2188157540 2024-05-10T08:41:31.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.329+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2188156b60 con 0x7f2188157540 2024-05-10T08:41:31.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.330+0000 7f2184ff9640 1 -- 172.21.15.37:0/3698147977 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f2180089250 con 0x7f2188157540 2024-05-10T08:41:31.329 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-10T08:41:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21740762d0 msgr2=0x7f2174078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21740762d0 0x7f2174078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21780016e0 tx=0x7f2178009040 comp rx=0 tx=0).stop 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2188157540 msgr2=0x7f21881f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2188157540 0x7f21881f3360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2180009f70 tx=0x7f2180004a40 comp rx=0 tx=0).stop 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 shutdown_connections 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21740762d0 0x7f2174078790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2188157540 0x7f21881f3360 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880b48a0 0x7f21881f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 --2- 172.21.15.37:0/3698147977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806fc30 0x7f218815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.331+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 >> 172.21.15.37:0/3698147977 conn(0x7f218806c3a0 msgr2=0x7f21880b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.332+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 shutdown_connections 2024-05-10T08:41:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.332+0000 7f218e946640 1 -- 172.21.15.37:0/3698147977 wait complete. 2024-05-10T08:41:31.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-05-10T08:41:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.447+0000 7f2756724640 1 Processor -- start 2024-05-10T08:41:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.447+0000 7f2756724640 1 -- start start 2024-05-10T08:41:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f2756724640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 0x7f27500d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f2756724640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27500d3330 con 0x7f27500d3cd0 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f2756724640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27500d2170 con 0x7f27501629a0 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f2756724640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f27500d2450 con 0x7f27500c9ee0 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f274f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27500d3cd0 0x7f27500cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47472/0 (socket says 172.21.15.37:47472) 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f274f7fe640 1 -- 172.21.15.37:0/4080323764 learned_addr learned my addr 172.21.15.37:0/4080323764 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f2754cc1640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 0x7f27500d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719065899 0 0) 0x7f27500d3330 con 0x7f27500d3cd0 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.448+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2738003520 con 0x7f27500d3cd0 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3612188577 0 0) 0x7f2738003520 con 0x7f27500d3cd0 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 msgr2=0x7f27500d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 0x7f27500d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 >> v1:172.21.15.82:6789/0 conn(0x7f27501629a0 legacy=0x7f27500d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500d2730 con 0x7f27500d3cd0 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f2744001670 con 0x7f27500d3cd0 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 >> v1:172.21.15.37:6789/0 conn(0x7f27500d3cd0 legacy=0x7f27500cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f2738003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 0x7f2738004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738004d40 0x7f27380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27500d2450 con 0x7f27380039e0 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f273800bb80 con 0x7f2738004d40 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f273800bd80 con 0x7f27500c9ee0 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274ffff640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f2738003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274f7fe640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 0x7f2738004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f2754cc1640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738004d40 0x7f27380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274ffff640 1 -- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 msgr2=0x7f2738004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274ffff640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 0x7f2738004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274ffff640 1 -- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738004d40 msgr2=0x7f27380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274ffff640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2738004d40 0x7f27380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274ffff640 1 -- 172.21.15.37:0/4080323764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2738003520 con 0x7f27380039e0 2024-05-10T08:41:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.449+0000 7f274f7fe640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27500c9ee0 0x7f2738004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.450+0000 7f274ffff640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f2738003e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2740001750 tx=0x7f2738005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf663eab45df88b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.450+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740001370 con 0x7f27380039e0 2024-05-10T08:41:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.450+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27400052d0 con 0x7f27380039e0 2024-05-10T08:41:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.450+0000 7f274effd640 1 -- 172.21.15.37:0/4080323764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274002abe0 con 0x7f27380039e0 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.451+0000 7f2756724640 1 -- 172.21.15.37:0/4080323764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 msgr2=0x7f2738003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.451+0000 7f2756724640 1 --2- 172.21.15.37:0/4080323764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f2738003e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2740001750 tx=0x7f2738005830 comp rx=0 tx=0).stop 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.451+0000 7f2754cc1640 1 -- 172.21.15.37:0/4080323764 reap_dead start 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.451+0000 7f2756724640 1 -- 172.21.15.37:0/4080323764 shutdown_connections 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.451+0000 7f2756724640 1 -- 172.21.15.37:0/4080323764 >> 172.21.15.37:0/4080323764 conn(0x7f27500d4fe0 msgr2=0x7f27500d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.451+0000 7f2756724640 1 -- 172.21.15.37:0/4080323764 shutdown_connections 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.451+0000 7f2756724640 1 -- 172.21.15.37:0/4080323764 wait complete. 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.452+0000 7f2756724640 1 Processor -- start 2024-05-10T08:41:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.452+0000 7f2756724640 1 -- start start 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f2756724640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f27500ba940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f2756724640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275014de30 0x7f27500b9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f2756724640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f275014f490 0x7f275014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f2756724640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27500cf440 con 0x7f27380039e0 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f2756724640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27500cf2c0 con 0x7f275014de30 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f2756724640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f27500d2dc0 con 0x7f275014f490 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f27500ba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f27500ba940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46112/0 (socket says 172.21.15.37:46112) 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 -- 172.21.15.37:0/2293584409 learned_addr learned my addr 172.21.15.37:0/2293584409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f2754cc1640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f275014f490 0x7f275014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274f7fe640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275014de30 0x7f27500b9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 -- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f275014f490 msgr2=0x7f275014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f275014f490 0x7f275014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 -- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275014de30 msgr2=0x7f27500b9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275014de30 0x7f27500b9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274ffff640 1 -- 172.21.15.37:0/2293584409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500ce0b0 con 0x7f27380039e0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.453+0000 7f274f7fe640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275014de30 0x7f27500b9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.454+0000 7f274ffff640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f27500ba940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2740008fd0 tx=0x7f2740001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.454+0000 7f274cff9640 1 -- 172.21.15.37:0/2293584409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740037040 con 0x7f27380039e0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.454+0000 7f274cff9640 1 -- 172.21.15.37:0/2293584409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2740005480 con 0x7f27380039e0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.454+0000 7f274cff9640 1 -- 172.21.15.37:0/2293584409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740007a30 con 0x7f27380039e0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.454+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275014e3f0 con 0x7f27380039e0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.454+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275014e9b0 con 0x7f27380039e0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.455+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27500693f0 con 0x7f27380039e0 2024-05-10T08:41:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.455+0000 7f274cff9640 1 -- 172.21.15.37:0/2293584409 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2740044020 con 0x7f27380039e0 2024-05-10T08:41:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.456+0000 7f274cff9640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f273c076300 0x7f273c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.456+0000 7f274cff9640 1 -- 172.21.15.37:0/2293584409 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f27400b6e60 con 0x7f27380039e0 2024-05-10T08:41:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.456+0000 7f274f7fe640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f273c076300 0x7f273c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.457+0000 7f274f7fe640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f273c076300 0x7f273c0787c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f275015dc40 tx=0x7f2744009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.460+0000 7f274cff9640 1 -- 172.21.15.37:0/2293584409 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f274004b020 con 0x7f27380039e0 2024-05-10T08:41:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:31.724+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f275006ea30 con 0x7f27380039e0 2024-05-10T08:41:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.687+0000 7f274cff9640 1 -- 172.21.15.37:0/2293584409 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v86) ==== 152+0+0 (secure 0 0 0) 0x7f2740080930 con 0x7f27380039e0 2024-05-10T08:41:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f273c076300 msgr2=0x7f273c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f273c076300 0x7f273c0787c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f275015dc40 tx=0x7f2744009040 comp rx=0 tx=0).stop 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 msgr2=0x7f27500ba940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f27500ba940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2740008fd0 tx=0x7f2740001120 comp rx=0 tx=0).stop 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 shutdown_connections 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f273c076300 0x7f273c0787c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f275014f490 0x7f275014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275014de30 0x7f27500b9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 --2- 172.21.15.37:0/2293584409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27380039e0 0x7f27500ba940 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 >> 172.21.15.37:0/2293584409 conn(0x7f27500d4fe0 msgr2=0x7f27500ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 shutdown_connections 2024-05-10T08:41:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.690+0000 7f2756724640 1 -- 172.21.15.37:0/2293584409 wait complete. 2024-05-10T08:41:32.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T08:41:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.818+0000 7fdcd1c20640 1 Processor -- start 2024-05-10T08:41:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.818+0000 7fdcd1c20640 1 -- start start 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.818+0000 7fdcd1c20640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdccc0b9080 0x7fdccc0d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcd1c20640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc0d3320 con 0x7fdccc163460 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcd1c20640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc0d3600 con 0x7fdccc0b6590 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcd1c20640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc0d38e0 con 0x7fdccc0b9080 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdccaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdccc163460 0x7fdccc15ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47482/0 (socket says 172.21.15.37:47482) 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdccaffd640 1 -- 172.21.15.37:0/3386455943 learned_addr learned my addr 172.21.15.37:0/3386455943 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdccbfff640 1 --2- 172.21.15.37:0/3386455943 >> v2:172.21.15.82:3300/0 conn(0x7fdccc0b9080 0x7fdccc0d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403127124 0 0) 0x7fdccc0d3320 con 0x7fdccc163460 2024-05-10T08:41:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcb8003520 con 0x7fdccc163460 2024-05-10T08:41:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255173613 0 0) 0x7fdccc0d3600 con 0x7fdccc0b6590 2024-05-10T08:41:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdccc0d3320 con 0x7fdccc0b6590 2024-05-10T08:41:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3002080116 0 0) 0x7fdcb8003520 con 0x7fdccc163460 2024-05-10T08:41:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdccbfff640 1 -- 172.21.15.37:0/3386455943 >> v1:172.21.15.82:6789/0 conn(0x7fdccc0b6590 legacy=0x7fdccc162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdccbfff640 1 -- 172.21.15.37:0/3386455943 >> v1:172.21.15.37:6789/0 conn(0x7fdccc163460 legacy=0x7fdccc15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.819+0000 7fdccbfff640 1 -- 172.21.15.37:0/3386455943 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc0d3bc0 con 0x7fdccc0b9080 2024-05-10T08:41:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.820+0000 7fdccbfff640 1 --2- 172.21.15.37:0/3386455943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 0x7fdccc0d0bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009d90 tx=0x7fdcc402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e805fd15a240e8d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.820+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4001670 con 0x7fdccc0b9080 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.820+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4007540 con 0x7fdccc0b9080 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.820+0000 7fdcca7fc640 1 -- 172.21.15.37:0/3386455943 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40078f0 con 0x7fdccc0b9080 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.821+0000 7fdcd1c20640 1 -- 172.21.15.37:0/3386455943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 msgr2=0x7fdccc0d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.821+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/3386455943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 0x7fdccc0d0bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009d90 tx=0x7fdcc402a680 comp rx=0 tx=0).stop 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.821+0000 7fdcd1c20640 1 -- 172.21.15.37:0/3386455943 shutdown_connections 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.821+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/3386455943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 0x7fdccc0d0bd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.821+0000 7fdcd1c20640 1 -- 172.21.15.37:0/3386455943 >> 172.21.15.37:0/3386455943 conn(0x7fdccc0d4fe0 msgr2=0x7fdccc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.821+0000 7fdcd1c20640 1 -- 172.21.15.37:0/3386455943 shutdown_connections 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.821+0000 7fdcd1c20640 1 -- 172.21.15.37:0/3386455943 wait complete. 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.822+0000 7fdcd1c20640 1 Processor -- start 2024-05-10T08:41:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.822+0000 7fdcd1c20640 1 -- start start 2024-05-10T08:41:32.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdcd1c20640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdccc0b6590 0x7fdccc15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:32.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdcd1c20640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 0x7fdccc0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:32.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdcd1c20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdccc163460 0x7fdccc0d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:32.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdcd1c20640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc15f4c0 con 0x7fdccc163460 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdcd1c20640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc15f340 con 0x7fdccc0b9080 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdcd1c20640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc15f640 con 0x7fdccc0b6590 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdccc163460 0x7fdccc0d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdccc163460 0x7fdccc0d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46120/0 (socket says 172.21.15.37:46120) 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdccbfff640 1 -- 172.21.15.37:0/1332648522 learned_addr learned my addr 172.21.15.37:0/1332648522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdccaffd640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 0x7fdccc0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.823+0000 7fdccb7fe640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdccc0b6590 0x7fdccc15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdccbfff640 1 -- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdccc0b6590 msgr2=0x7fdccc15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdccbfff640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdccc0b6590 0x7fdccc15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdccbfff640 1 -- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 msgr2=0x7fdccc0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdccbfff640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 0x7fdccc0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdccbfff640 1 -- 172.21.15.37:0/1332648522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc0ccb50 con 0x7fdccc163460 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdccbfff640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdccc163460 0x7fdccc0d1bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009eb0 tx=0x7fdcc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:32.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1332648522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4040070 con 0x7fdccc163460 2024-05-10T08:41:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1332648522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4031c40 con 0x7fdccc163460 2024-05-10T08:41:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc0cce30 con 0x7fdccc163460 2024-05-10T08:41:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1332648522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4009450 con 0x7fdccc163460 2024-05-10T08:41:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.824+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc0cd3f0 con 0x7fdccc163460 2024-05-10T08:41:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.825+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc0693f0 con 0x7fdccc163460 2024-05-10T08:41:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.826+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1332648522 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdcc4039040 con 0x7fdccc163460 2024-05-10T08:41:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.826+0000 7fdcc3fff640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdcac0762d0 0x7fdcac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.826+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1332648522 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7fdcc40b8740 con 0x7fdccc163460 2024-05-10T08:41:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.826+0000 7fdccb7fe640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdcac0762d0 0x7fdcac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.827+0000 7fdccb7fe640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdcac0762d0 0x7fdcac078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0011e0 tx=0x7fdcbc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:32.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:32.830+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1332648522 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdcc4081b30 con 0x7fdccc163460 2024-05-10T08:41:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.021+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdccc0763f0 con 0x7fdccc163460 2024-05-10T08:41:33.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.024+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1332648522 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fdcc408a070 con 0x7fdccc163460 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdcac0762d0 msgr2=0x7fdcac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdcac0762d0 0x7fdcac078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0011e0 tx=0x7fdcbc009040 comp rx=0 tx=0).stop 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdccc163460 msgr2=0x7fdccc0d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdccc163460 0x7fdccc0d1bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009eb0 tx=0x7fdcc4004a40 comp rx=0 tx=0).stop 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 shutdown_connections 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdcac0762d0 0x7fdcac078790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdccc163460 0x7fdccc0d1bb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b9080 0x7fdccc0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 --2- 172.21.15.37:0/1332648522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdccc0b6590 0x7fdccc15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 >> 172.21.15.37:0/1332648522 conn(0x7fdccc0d4fe0 msgr2=0x7fdccc0d53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 shutdown_connections 2024-05-10T08:41:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.026+0000 7fdcd1c20640 1 -- 172.21.15.37:0/1332648522 wait complete. 2024-05-10T08:41:33.037 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:41:33.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:41:33.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:41:33.128 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:41:33.128 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:33.128 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:33.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:41:33.145 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:41:33.145 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:33.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:41:33.164 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:33.164 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:33.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:41:33.202 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:41:33.202 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:33.222 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:41:33.223 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T08:41:33.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.346+0000 7f2e25854640 1 Processor -- start 2024-05-10T08:41:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.346+0000 7f2e25854640 1 -- start start 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e25854640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e200c9ee0 0x7f2e200d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e25854640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e200d3330 con 0x7f2e200d3cd0 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e25854640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e200d2170 con 0x7f2e201629a0 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e25854640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2e200d2450 con 0x7f2e200c9ee0 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e167fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2e200d3cd0 0x7f2e200cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47494/0 (socket says 172.21.15.37:47494) 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e167fc640 1 -- 172.21.15.37:0/765100760 learned_addr learned my addr 172.21.15.37:0/765100760 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e1f7fe640 1 --2- 172.21.15.37:0/765100760 >> v2:172.21.15.37:3300/0 conn(0x7f2e200c9ee0 0x7f2e200d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e1e7fc640 1 -- 172.21.15.37:0/765100760 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196352295 0 0) 0x7f2e200d3330 con 0x7f2e200d3cd0 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e1e7fc640 1 -- 172.21.15.37:0/765100760 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0c003520 con 0x7f2e200d3cd0 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e1f7fe640 1 -- 172.21.15.37:0/765100760 >> v1:172.21.15.82:6789/0 conn(0x7f2e201629a0 legacy=0x7f2e200d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e1f7fe640 1 -- 172.21.15.37:0/765100760 >> v1:172.21.15.37:6789/0 conn(0x7f2e200d3cd0 legacy=0x7f2e200cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.347+0000 7f2e1f7fe640 1 -- 172.21.15.37:0/765100760 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e200d2730 con 0x7f2e200c9ee0 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.348+0000 7f2e1f7fe640 1 --2- 172.21.15.37:0/765100760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e200c9ee0 0x7f2e200d03b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009d90 tx=0x7f2e1802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325b0f0e27073aff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.348+0000 7f2e1e7fc640 1 -- 172.21.15.37:0/765100760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18031600 con 0x7f2e200c9ee0 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.348+0000 7f2e1e7fc640 1 -- 172.21.15.37:0/765100760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e180317a0 con 0x7f2e200c9ee0 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.348+0000 7f2e1e7fc640 1 -- 172.21.15.37:0/765100760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18031b70 con 0x7f2e200c9ee0 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.349+0000 7f2e25854640 1 -- 172.21.15.37:0/765100760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e200c9ee0 msgr2=0x7f2e200d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.349+0000 7f2e25854640 1 --2- 172.21.15.37:0/765100760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e200c9ee0 0x7f2e200d03b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009d90 tx=0x7f2e1802a5d0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.349+0000 7f2e25854640 1 -- 172.21.15.37:0/765100760 shutdown_connections 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.349+0000 7f2e25854640 1 --2- 172.21.15.37:0/765100760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e200c9ee0 0x7f2e200d03b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.349+0000 7f2e25854640 1 -- 172.21.15.37:0/765100760 >> 172.21.15.37:0/765100760 conn(0x7f2e200d4fe0 msgr2=0x7f2e200d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.349+0000 7f2e25854640 1 -- 172.21.15.37:0/765100760 shutdown_connections 2024-05-10T08:41:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.349+0000 7f2e25854640 1 -- 172.21.15.37:0/765100760 wait complete. 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.350+0000 7f2e25854640 1 Processor -- start 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.350+0000 7f2e25854640 1 -- start start 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e25854640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e200c9ee0 0x7f2e20152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e25854640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e200d3cd0 0x7f2e200b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e25854640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e201629a0 0x7f2e200b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e25854640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e200cf440 con 0x7f2e201629a0 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e25854640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e200cf2c0 con 0x7f2e200c9ee0 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e25854640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2e200d2dc0 con 0x7f2e200d3cd0 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e201629a0 0x7f2e200b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e201629a0 0x7f2e200b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46128/0 (socket says 172.21.15.37:46128) 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 -- 172.21.15.37:0/2109317575 learned_addr learned my addr 172.21.15.37:0/2109317575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1effd640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e200c9ee0 0x7f2e20152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e167fc640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e200d3cd0 0x7f2e200b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 -- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e200d3cd0 msgr2=0x7f2e200b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e200d3cd0 0x7f2e200b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 -- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e200c9ee0 msgr2=0x7f2e20152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e200c9ee0 0x7f2e20152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1f7fe640 1 -- 172.21.15.37:0/2109317575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e200cd100 con 0x7f2e201629a0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.351+0000 7f2e1effd640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e200c9ee0 0x7f2e20152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.352+0000 7f2e1f7fe640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e201629a0 0x7f2e200b6920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009eb0 tx=0x7f2e18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.352+0000 7f2e1cff9640 1 -- 172.21.15.37:0/2109317575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18040070 con 0x7f2e201629a0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.352+0000 7f2e1cff9640 1 -- 172.21.15.37:0/2109317575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e18030b60 con 0x7f2e201629a0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.352+0000 7f2e1cff9640 1 -- 172.21.15.37:0/2109317575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18009450 con 0x7f2e201629a0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.352+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e200cd440 con 0x7f2e201629a0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.352+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e200cdc80 con 0x7f2e201629a0 2024-05-10T08:41:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.353+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e200693f0 con 0x7f2e201629a0 2024-05-10T08:41:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.354+0000 7f2e1cff9640 1 -- 172.21.15.37:0/2109317575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e18039040 con 0x7f2e201629a0 2024-05-10T08:41:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.354+0000 7f2e1cff9640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e00076300 0x7f2e000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.354+0000 7f2e1cff9640 1 -- 172.21.15.37:0/2109317575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f2e180b8a60 con 0x7f2e201629a0 2024-05-10T08:41:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.354+0000 7f2e1effd640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e00076300 0x7f2e000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.355+0000 7f2e1effd640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e00076300 0x7f2e000787c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001660 tx=0x7f2e10009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.358+0000 7f2e1cff9640 1 -- 172.21.15.37:0/2109317575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2e200cd440 con 0x7f2e201629a0 2024-05-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.590+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e200d3760 con 0x7f2e201629a0 2024-05-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.590+0000 7f2e1cff9640 1 -- 172.21.15.37:0/2109317575 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3863 (secure 0 0 0) 0x7f2e180825c0 con 0x7f2e201629a0 2024-05-10T08:41:33.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:33.590 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/835313777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":835313777},{"type":"v1","addr":"172.21.15.82:6836","nonce":835313777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/287863678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":287863678},{"type":"v1","addr":"172.21.15.37:6834","nonce":287863678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2431966352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2431966352},{"type":"v1","addr":"172.21.15.82:6837","nonce":2431966352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5163,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2644543384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2644543384},{"type":"v1","addr":"172.21.15.37:6835","nonce":2644543384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-05-10T08:41:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e00076300 msgr2=0x7f2e000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e00076300 0x7f2e000787c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001660 tx=0x7f2e10009040 comp rx=0 tx=0).stop 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e201629a0 msgr2=0x7f2e200b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e201629a0 0x7f2e200b6920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009eb0 tx=0x7f2e18004a40 comp rx=0 tx=0).stop 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 shutdown_connections 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e00076300 0x7f2e000787c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e201629a0 0x7f2e200b6920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.592+0000 7f2e25854640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e200d3cd0 0x7f2e200b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.593+0000 7f2e25854640 1 --2- 172.21.15.37:0/2109317575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e200c9ee0 0x7f2e20152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.593+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 >> 172.21.15.37:0/2109317575 conn(0x7f2e200d4fe0 msgr2=0x7f2e200d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.593+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 shutdown_connections 2024-05-10T08:41:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.593+0000 7f2e25854640 1 -- 172.21.15.37:0/2109317575 wait complete. 2024-05-10T08:41:33.603 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:41:33.604 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T08:41:33.604 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:41:33.604 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:41:33.604 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:41:33.604 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T08:41:33.604 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:41:33.604 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:41:33.605 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:41:33.605 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T08:41:33.605 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:41:33.605 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:41:33.605 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:41:33.605 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T08:41:33.606 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:41:33.606 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:41:33.614 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:41:33.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:41:33.615 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:41:33.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:41:33.617 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:41:33.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:41:33.618 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:41:33.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:41:33.657 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:41:33.657 DEBUG:teuthology.parallel:result is None 2024-05-10T08:41:33.658 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:41:33.658 DEBUG:teuthology.parallel:result is None 2024-05-10T08:41:33.661 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:41:33.661 DEBUG:teuthology.parallel:result is None 2024-05-10T08:41:33.661 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:41:33.662 DEBUG:teuthology.parallel:result is None 2024-05-10T08:41:33.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T08:41:33.735 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:41:33.736 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:41:33.746 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:41:33.747 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:41:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.771+0000 7f887ce72640 1 Processor -- start 2024-05-10T08:41:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.771+0000 7f887ce72640 1 -- start start 2024-05-10T08:41:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f887ce72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d1970 0x7f88780d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f887ce72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88780d4cc0 0x7f88780d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f887ce72640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88781630b0 con 0x7f887815f420 2024-05-10T08:41:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f887ce72640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f88780d2330 con 0x7f88780d4cc0 2024-05-10T08:41:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f887ce72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88780d3e70 con 0x7f88780d1970 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f8876d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88780d4cc0 0x7f88780d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f887659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f887815f420 0x7f88780d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47510/0 (socket says 172.21.15.37:47510) 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.772+0000 7f887659c640 1 -- 172.21.15.37:0/3220876030 learned_addr learned my addr 172.21.15.37:0/3220876030 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.773+0000 7f8875d9b640 1 --2- 172.21.15.37:0/3220876030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d1970 0x7f88780d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.773+0000 7f8876d9d640 1 -- 172.21.15.37:0/3220876030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d1970 msgr2=0x7f88780d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.773+0000 7f8876d9d640 1 --2- 172.21.15.37:0/3220876030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d1970 0x7f88780d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.773+0000 7f8876d9d640 1 -- 172.21.15.37:0/3220876030 >> v1:172.21.15.37:6789/0 conn(0x7f887815f420 legacy=0x7f88780d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.773+0000 7f887559a640 1 -- 172.21.15.37:0/3220876030 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226199324 0 0) 0x7f8868001110 con 0x7f887815f420 2024-05-10T08:41:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.773+0000 7f8876d9d640 1 -- 172.21.15.37:0/3220876030 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88780d5670 con 0x7f88780d4cc0 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.773+0000 7f8876d9d640 1 --2- 172.21.15.37:0/3220876030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780d4cc0 0x7f88780d5130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c065bcffad22b632 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887559a640 1 -- 172.21.15.37:0/3220876030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870007740 con 0x7f88780d4cc0 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887559a640 1 -- 172.21.15.37:0/3220876030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700078e0 con 0x7f88780d4cc0 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887559a640 1 -- 172.21.15.37:0/3220876030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870007cb0 con 0x7f88780d4cc0 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 -- 172.21.15.37:0/3220876030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780d4cc0 msgr2=0x7f88780d5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 --2- 172.21.15.37:0/3220876030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780d4cc0 0x7f88780d5130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887002a660 comp rx=0 tx=0).stop 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 -- 172.21.15.37:0/3220876030 shutdown_connections 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 --2- 172.21.15.37:0/3220876030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780d4cc0 0x7f88780d5130 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 --2- 172.21.15.37:0/3220876030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d1970 0x7f88780d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 -- 172.21.15.37:0/3220876030 >> 172.21.15.37:0/3220876030 conn(0x7f887808eac0 msgr2=0x7f887809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 -- 172.21.15.37:0/3220876030 shutdown_connections 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.774+0000 7f887ce72640 1 -- 172.21.15.37:0/3220876030 wait complete. 2024-05-10T08:41:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 Processor -- start 2024-05-10T08:41:33.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 -- start start 2024-05-10T08:41:33.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88780d1970 0x7f88780cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d4cc0 0x7f8878157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780ba3e0 0x7f88780b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88780d2f60 con 0x7f88780ba3e0 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88780d2c80 con 0x7f88780d1970 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f887ce72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88780d3240 con 0x7f88780d4cc0 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f8876d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780ba3e0 0x7f88780b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f8876d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780ba3e0 0x7f88780b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46196/0 (socket says 172.21.15.37:46196) 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.776+0000 7f8876d9d640 1 -- 172.21.15.37:0/1857095699 learned_addr learned my addr 172.21.15.37:0/1857095699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8875d9b640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d4cc0 0x7f8878157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f887659c640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88780d1970 0x7f88780cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8876d9d640 1 -- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d4cc0 msgr2=0x7f8878157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8876d9d640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d4cc0 0x7f8878157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8876d9d640 1 -- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88780d1970 msgr2=0x7f88780cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8876d9d640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88780d1970 0x7f88780cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8876d9d640 1 -- 172.21.15.37:0/1857095699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88780cafd0 con 0x7f88780ba3e0 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8876d9d640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780ba3e0 0x7f88780b5cd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8870009eb0 tx=0x7f8870004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8866ffd640 1 -- 172.21.15.37:0/1857095699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870040070 con 0x7f88780ba3e0 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8866ffd640 1 -- 172.21.15.37:0/1857095699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8870031bc0 con 0x7f88780ba3e0 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88780cb2b0 con 0x7f88780ba3e0 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f8866ffd640 1 -- 172.21.15.37:0/1857095699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870045460 con 0x7f88780ba3e0 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.777+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88780c8d50 con 0x7f88780ba3e0 2024-05-10T08:41:33.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.778+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88780693f0 con 0x7f88780ba3e0 2024-05-10T08:41:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.779+0000 7f8866ffd640 1 -- 172.21.15.37:0/1857095699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8870039040 con 0x7f88780ba3e0 2024-05-10T08:41:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.780+0000 7f8866ffd640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88580762d0 0x7f8858078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.780+0000 7f8866ffd640 1 -- 172.21.15.37:0/1857095699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5335+0+0 (secure 0 0 0) 0x7f88700b8ce0 con 0x7f88780ba3e0 2024-05-10T08:41:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.780+0000 7f887659c640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88580762d0 0x7f8858078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.780+0000 7f887659c640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88580762d0 0x7f8858078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f88680013b0 tx=0x7f8868007b90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.784+0000 7f8866ffd640 1 -- 172.21.15.37:0/1857095699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8870082150 con 0x7f88780ba3e0 2024-05-10T08:41:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:33.990+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f88780b4c50 con 0x7f88780ba3e0 2024-05-10T08:41:35.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.039+0000 7f8866ffd640 1 -- 172.21.15.37:0/1857095699 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7f8870086450 con 0x7f88780ba3e0 2024-05-10T08:41:35.038 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-10T08:41:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88580762d0 msgr2=0x7f8858078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88580762d0 0x7f8858078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f88680013b0 tx=0x7f8868007b90 comp rx=0 tx=0).stop 2024-05-10T08:41:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780ba3e0 msgr2=0x7f88780b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780ba3e0 0x7f88780b5cd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8870009eb0 tx=0x7f8870004a40 comp rx=0 tx=0).stop 2024-05-10T08:41:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 shutdown_connections 2024-05-10T08:41:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88580762d0 0x7f8858078790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88780ba3e0 0x7f88780b5cd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88780d4cc0 0x7f8878157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 --2- 172.21.15.37:0/1857095699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88780d1970 0x7f88780cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 >> 172.21.15.37:0/1857095699 conn(0x7f887808eac0 msgr2=0x7f88780d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:35.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 shutdown_connections 2024-05-10T08:41:35.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.042+0000 7f887ce72640 1 -- 172.21.15.37:0/1857095699 wait complete. 2024-05-10T08:41:35.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T08:41:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.167+0000 7fbed0391640 1 Processor -- start 2024-05-10T08:41:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.167+0000 7fbed0391640 1 -- start start 2024-05-10T08:41:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbed0391640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbec815f420 0x7fbec80d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbed0391640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec80d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbed0391640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec81630b0 con 0x7fbec80d3ca0 2024-05-10T08:41:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbed0391640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbec80d2550 con 0x7fbec815f420 2024-05-10T08:41:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbed0391640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80d2c80 con 0x7fbec80d2080 2024-05-10T08:41:35.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbece12d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbec815f420 0x7fbec80d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbecd92c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbec80d3ca0 0x7fbec80d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47520/0 (socket says 172.21.15.37:47520) 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbecd92c640 1 -- 172.21.15.37:0/3299926953 learned_addr learned my addr 172.21.15.37:0/3299926953 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbece92e640 1 --2- 172.21.15.37:0/3299926953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec80d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbece12d640 1 -- 172.21.15.37:0/3299926953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 msgr2=0x7fbec80d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbece12d640 1 --2- 172.21.15.37:0/3299926953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec80d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbece12d640 1 -- 172.21.15.37:0/3299926953 >> v1:172.21.15.37:6789/0 conn(0x7fbec80d3ca0 legacy=0x7fbec80d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbece12d640 1 -- 172.21.15.37:0/3299926953 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80d2f60 con 0x7fbec815f420 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbecd12b640 1 -- 172.21.15.37:0/3299926953 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444326829 0 0) 0x7fbeb8001110 con 0x7fbec80d3ca0 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.168+0000 7fbece92e640 1 --2- 172.21.15.37:0/3299926953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec80d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.169+0000 7fbece12d640 1 --2- 172.21.15.37:0/3299926953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec815f420 0x7fbec80d3760 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbec40097a0 tx=0x7fbec402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ac3d30691a8adc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.169+0000 7fbecd12b640 1 -- 172.21.15.37:0/3299926953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4037070 con 0x7fbec815f420 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.169+0000 7fbecd12b640 1 -- 172.21.15.37:0/3299926953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4032440 con 0x7fbec815f420 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.169+0000 7fbecd12b640 1 -- 172.21.15.37:0/3299926953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4032810 con 0x7fbec815f420 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.169+0000 7fbed0391640 1 -- 172.21.15.37:0/3299926953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec815f420 msgr2=0x7fbec80d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.169+0000 7fbed0391640 1 --2- 172.21.15.37:0/3299926953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec815f420 0x7fbec80d3760 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbec40097a0 tx=0x7fbec402a180 comp rx=0 tx=0).stop 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.170+0000 7fbed0391640 1 -- 172.21.15.37:0/3299926953 shutdown_connections 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.170+0000 7fbed0391640 1 --2- 172.21.15.37:0/3299926953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec80d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.170+0000 7fbed0391640 1 --2- 172.21.15.37:0/3299926953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec815f420 0x7fbec80d3760 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.170+0000 7fbed0391640 1 -- 172.21.15.37:0/3299926953 >> 172.21.15.37:0/3299926953 conn(0x7fbec808eac0 msgr2=0x7fbec809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.170+0000 7fbed0391640 1 -- 172.21.15.37:0/3299926953 shutdown_connections 2024-05-10T08:41:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.170+0000 7fbed0391640 1 -- 172.21.15.37:0/3299926953 wait complete. 2024-05-10T08:41:35.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.171+0000 7fbed0391640 1 Processor -- start 2024-05-10T08:41:35.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.171+0000 7fbed0391640 1 -- start start 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbed0391640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbed0391640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80b7c00 0x7fbec80ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbed0391640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec80b2c90 0x7fbec80b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbed0391640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80d5200 con 0x7fbec80b2c90 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbed0391640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80d2830 con 0x7fbec80b7c00 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbed0391640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80d5380 con 0x7fbec80d2080 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec80b2c90 0x7fbec80b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec80b2c90 0x7fbec80b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46208/0 (socket says 172.21.15.37:46208) 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 -- 172.21.15.37:0/3572052719 learned_addr learned my addr 172.21.15.37:0/3572052719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece12d640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbecd92c640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80b7c00 0x7fbec80ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 -- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 msgr2=0x7fbec815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 -- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80b7c00 msgr2=0x7fbec80ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80b7c00 0x7fbec80ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 -- 172.21.15.37:0/3572052719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80b8090 con 0x7fbec80b2c90 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbecd92c640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80b7c00 0x7fbec80ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.172+0000 7fbece92e640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec80b2c90 0x7fbec80b3140 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbec000cf20 tx=0x7fbec000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.173+0000 7fbebeffd640 1 -- 172.21.15.37:0/3572052719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec001a070 con 0x7fbec80b2c90 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.173+0000 7fbebeffd640 1 -- 172.21.15.37:0/3572052719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec000d840 con 0x7fbec80b2c90 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.173+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec80b8370 con 0x7fbec80b2c90 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.173+0000 7fbebeffd640 1 -- 172.21.15.37:0/3572052719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec000dc30 con 0x7fbec80b2c90 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.173+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec80b8930 con 0x7fbec80b2c90 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.174+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec80693f0 con 0x7fbec80b2c90 2024-05-10T08:41:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.174+0000 7fbebeffd640 1 -- 172.21.15.37:0/3572052719 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbec001d070 con 0x7fbec80b2c90 2024-05-10T08:41:35.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.175+0000 7fbebeffd640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.175+0000 7fbebeffd640 1 -- 172.21.15.37:0/3572052719 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5249+0+0 (secure 0 0 0) 0x7fbec0097d20 con 0x7fbec80b2c90 2024-05-10T08:41:35.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.175+0000 7fbece12d640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.175+0000 7fbece12d640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbec4034000 tx=0x7fbec402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.179+0000 7fbebeffd640 1 -- 172.21.15.37:0/3572052719 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbec0061840 con 0x7fbec80b2c90 2024-05-10T08:41:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.444+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbec8075e80 con 0x7fbec80b2c90 2024-05-10T08:41:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.445+0000 7fbebeffd640 1 -- 172.21.15.37:0/3572052719 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fbec0061140 con 0x7fbec80b2c90 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg==", 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ==", 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.446 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA==", 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:41:35.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw==", 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.448 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw==", 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw==", 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg==", 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.450 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ==", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g==", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA==", 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w==", 2024-05-10T08:41:35.452 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg==", 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A==", 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg==", 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-10T08:41:35.455 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw==", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA==", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:41:35.456 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA83T1mpCEPLBAAZlDinj6hQh8Ccd9D/MMUDw==", 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA==", 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A==", 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:41:35.458 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:41:35.459 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:41:35.459 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:41:35.459 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.459 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.459 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:41:35.459 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:41:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 msgr2=0x7fbeac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbec4034000 tx=0x7fbec402e000 comp rx=0 tx=0).stop 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec80b2c90 msgr2=0x7fbec80b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec80b2c90 0x7fbec80b3140 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbec000cf20 tx=0x7fbec000a7d0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 shutdown_connections 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbec80b2c90 0x7fbec80b3140 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80b7c00 0x7fbec80ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 --2- 172.21.15.37:0/3572052719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbec80d2080 0x7fbec815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 >> 172.21.15.37:0/3572052719 conn(0x7fbec808eac0 msgr2=0x7fbec806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 shutdown_connections 2024-05-10T08:41:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.447+0000 7fbed0391640 1 -- 172.21.15.37:0/3572052719 wait complete. 2024-05-10T08:41:35.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:41:35.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.566+0000 7fe2c812b640 1 Processor -- start 2024-05-10T08:41:35.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.566+0000 7fe2c812b640 1 -- start start 2024-05-10T08:41:35.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c812b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00d3cd0 0x7fe2c00cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c812b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2c00c9ee0 0x7fe2c00d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c812b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c00d3330 con 0x7fe2c01629a0 2024-05-10T08:41:35.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c812b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c00d2170 con 0x7fe2c00c9ee0 2024-05-10T08:41:35.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c812b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c00d2450 con 0x7fe2c00d3cd0 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c66c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2c00c9ee0 0x7fe2c00d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c5ec7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe2c01629a0 0x7fe2c00d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47524/0 (socket says 172.21.15.37:47524) 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.567+0000 7fe2c5ec7640 1 -- 172.21.15.37:0/3614584247 learned_addr learned my addr 172.21.15.37:0/3614584247 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c4ec5640 1 -- 172.21.15.37:0/3614584247 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441522230 0 0) 0x7fe2c00d3330 con 0x7fe2c01629a0 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c4ec5640 1 -- 172.21.15.37:0/3614584247 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2ac003520 con 0x7fe2c01629a0 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c56c6640 1 --2- 172.21.15.37:0/3614584247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00d3cd0 0x7fe2c00cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c66c8640 1 -- 172.21.15.37:0/3614584247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00d3cd0 msgr2=0x7fe2c00cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c66c8640 1 --2- 172.21.15.37:0/3614584247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00d3cd0 0x7fe2c00cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c66c8640 1 -- 172.21.15.37:0/3614584247 >> v1:172.21.15.37:6789/0 conn(0x7fe2c01629a0 legacy=0x7fe2c00d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c66c8640 1 -- 172.21.15.37:0/3614584247 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c00d2730 con 0x7fe2c00c9ee0 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.568+0000 7fe2c66c8640 1 --2- 172.21.15.37:0/3614584247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c00c9ee0 0x7fe2c00d01e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009d90 tx=0x7fe2b802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f549265f57e8db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c4ec5640 1 -- 172.21.15.37:0/3614584247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8007740 con 0x7fe2c00c9ee0 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c4ec5640 1 -- 172.21.15.37:0/3614584247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b80078e0 con 0x7fe2c00c9ee0 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c4ec5640 1 -- 172.21.15.37:0/3614584247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8007c90 con 0x7fe2c00c9ee0 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 -- 172.21.15.37:0/3614584247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c00c9ee0 msgr2=0x7fe2c00d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 --2- 172.21.15.37:0/3614584247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c00c9ee0 0x7fe2c00d01e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009d90 tx=0x7fe2b802a530 comp rx=0 tx=0).stop 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 -- 172.21.15.37:0/3614584247 shutdown_connections 2024-05-10T08:41:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 --2- 172.21.15.37:0/3614584247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c00c9ee0 0x7fe2c00d01e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 --2- 172.21.15.37:0/3614584247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00d3cd0 0x7fe2c00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 -- 172.21.15.37:0/3614584247 >> 172.21.15.37:0/3614584247 conn(0x7fe2c00d4fe0 msgr2=0x7fe2c00d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 -- 172.21.15.37:0/3614584247 shutdown_connections 2024-05-10T08:41:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.569+0000 7fe2c812b640 1 -- 172.21.15.37:0/3614584247 wait complete. 2024-05-10T08:41:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.570+0000 7fe2c812b640 1 Processor -- start 2024-05-10T08:41:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.570+0000 7fe2c812b640 1 -- start start 2024-05-10T08:41:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c812b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00c9ee0 0x7fe2c01585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c812b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00d3cd0 0x7fe2c006e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c812b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c01629a0 0x7fe2c006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c812b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00cf440 con 0x7fe2c01629a0 2024-05-10T08:41:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c812b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00cf2c0 con 0x7fe2c00d3cd0 2024-05-10T08:41:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c812b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c00d2dc0 con 0x7fe2c00c9ee0 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c66c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c01629a0 0x7fe2c006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c66c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c01629a0 0x7fe2c006e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46222/0 (socket says 172.21.15.37:46222) 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c66c8640 1 -- 172.21.15.37:0/571851950 learned_addr learned my addr 172.21.15.37:0/571851950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.571+0000 7fe2c5ec7640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00c9ee0 0x7fe2c01585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c56c6640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00d3cd0 0x7fe2c006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c66c8640 1 -- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00c9ee0 msgr2=0x7fe2c01585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c66c8640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00c9ee0 0x7fe2c01585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c66c8640 1 -- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00d3cd0 msgr2=0x7fe2c006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c66c8640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00d3cd0 0x7fe2c006e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c66c8640 1 -- 172.21.15.37:0/571851950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c00b9b10 con 0x7fe2c01629a0 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c66c8640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c01629a0 0x7fe2c006e580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009d90 tx=0x7fe2b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2b67fc640 1 -- 172.21.15.37:0/571851950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8009450 con 0x7fe2c01629a0 2024-05-10T08:41:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2b67fc640 1 -- 172.21.15.37:0/571851950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b8004240 con 0x7fe2c01629a0 2024-05-10T08:41:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2b67fc640 1 -- 172.21.15.37:0/571851950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8004630 con 0x7fe2c01629a0 2024-05-10T08:41:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c00b9df0 con 0x7fe2c01629a0 2024-05-10T08:41:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.572+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c00ba690 con 0x7fe2c01629a0 2024-05-10T08:41:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.573+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c00ba1e0 con 0x7fe2c01629a0 2024-05-10T08:41:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.574+0000 7fe2b67fc640 1 -- 172.21.15.37:0/571851950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2b8039040 con 0x7fe2c01629a0 2024-05-10T08:41:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.574+0000 7fe2b67fc640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2a40762d0 0x7fe2a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.575+0000 7fe2b67fc640 1 -- 172.21.15.37:0/571851950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5249+0+0 (secure 0 0 0) 0x7fe2b80b83f0 con 0x7fe2c01629a0 2024-05-10T08:41:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.575+0000 7fe2c5ec7640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2a40762d0 0x7fe2a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.575+0000 7fe2c5ec7640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2a40762d0 0x7fe2a4078790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc007fd0 tx=0x7fe2bc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.579+0000 7fe2b67fc640 1 -- 172.21.15.37:0/571851950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe2b8040030 con 0x7fe2c01629a0 2024-05-10T08:41:35.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.773+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe2c00693f0 con 0x7fe2c01629a0 2024-05-10T08:41:35.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.773+0000 7fe2b67fc640 1 -- 172.21.15.37:0/571851950 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) ==== 84+0+65 (secure 0 0 0) 0x7fe2b8082060 con 0x7fe2c01629a0 2024-05-10T08:41:35.773 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:35.773 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:41:35.773 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:35.773 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:41:35.773 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:41:35.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:35.773 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2a40762d0 msgr2=0x7fe2a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2a40762d0 0x7fe2a4078790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc007fd0 tx=0x7fe2bc009040 comp rx=0 tx=0).stop 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c01629a0 msgr2=0x7fe2c006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c01629a0 0x7fe2c006e580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009d90 tx=0x7fe2b8004a40 comp rx=0 tx=0).stop 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 shutdown_connections 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2a40762d0 0x7fe2a4078790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c01629a0 0x7fe2c006e580 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2c00d3cd0 0x7fe2c006e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 --2- 172.21.15.37:0/571851950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2c00c9ee0 0x7fe2c01585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 >> 172.21.15.37:0/571851950 conn(0x7fe2c00d4fe0 msgr2=0x7fe2c0160a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:35.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 shutdown_connections 2024-05-10T08:41:35.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.775+0000 7fe2c812b640 1 -- 172.21.15.37:0/571851950 wait complete. 2024-05-10T08:41:35.785 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:41:35.786 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:41:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.893+0000 7f97a219d640 1 Processor -- start 2024-05-10T08:41:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.894+0000 7f97a219d640 1 -- start start 2024-05-10T08:41:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.894+0000 7f97a219d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 0x7f979c0d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.894+0000 7f97a219d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979c162f50 con 0x7f979c162b70 2024-05-10T08:41:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.894+0000 7f97a219d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979c0d3ee0 con 0x7f979c0cfc50 2024-05-10T08:41:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.894+0000 7f97a219d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f979c0d1f60 con 0x7f979c0b5a50 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.894+0000 7f979b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f979c162b70 0x7f979c0d2f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47536/0 (socket says 172.21.15.37:47536) 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979b7fe640 1 -- 172.21.15.37:0/3211127308 learned_addr learned my addr 172.21.15.37:0/3211127308 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291760243 0 0) 0x7f978c001110 con 0x7f979c162b70 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979affd640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 0x7f979c0d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9784003520 con 0x7f979c162b70 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127359203 0 0) 0x7f9784003520 con 0x7f979c162b70 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 msgr2=0x7f979c0d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 0x7f979c0d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 >> v1:172.21.15.82:6789/0 conn(0x7f979c0cfc50 legacy=0x7f979c0d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c0d21b0 con 0x7f979c162b70 2024-05-10T08:41:35.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f978c001840 con 0x7f979c162b70 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 >> v1:172.21.15.37:6789/0 conn(0x7f979c162b70 legacy=0x7f979c0d2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97840039e0 0x7f9784003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 0x7f9784004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784004d40 0x7f97840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f979c0d1f60 con 0x7f9784004d40 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f978400b9f0 con 0x7f97840039e0 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f978400bbf0 con 0x7f979c0b5a50 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979bfff640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784004d40 0x7f97840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979b7fe640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97840039e0 0x7f9784003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.895+0000 7f979affd640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 0x7f9784004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.896+0000 7f979bfff640 1 -- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 msgr2=0x7f9784004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.896+0000 7f979bfff640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0b5a50 0x7f9784004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.896+0000 7f979bfff640 1 -- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97840039e0 msgr2=0x7f9784003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.896+0000 7f979bfff640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97840039e0 0x7f9784003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.896+0000 7f979bfff640 1 -- 172.21.15.37:0/3211127308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9784003520 con 0x7f9784004d40 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.896+0000 7f979bfff640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784004d40 0x7f97840051c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9794001f60 tx=0x7f9784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb123552e4c1b19 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794001b30 con 0x7f9784004d40 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9794031620 con 0x7f9784004d40 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f979a7fc640 1 -- 172.21.15.37:0/3211127308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794031a10 con 0x7f9784004d40 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f97a219d640 1 -- 172.21.15.37:0/3211127308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784004d40 msgr2=0x7f97840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f97a219d640 1 --2- 172.21.15.37:0/3211127308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784004d40 0x7f97840051c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9794001f60 tx=0x7f9784005830 comp rx=0 tx=0).stop 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f979bfff640 1 -- 172.21.15.37:0/3211127308 reap_dead start 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f97a219d640 1 -- 172.21.15.37:0/3211127308 shutdown_connections 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f97a219d640 1 -- 172.21.15.37:0/3211127308 >> 172.21.15.37:0/3211127308 conn(0x7f979c0d5040 msgr2=0x7f979c0d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f97a219d640 1 -- 172.21.15.37:0/3211127308 shutdown_connections 2024-05-10T08:41:35.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.897+0000 7f97a219d640 1 -- 172.21.15.37:0/3211127308 wait complete. 2024-05-10T08:41:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.898+0000 7f97a219d640 1 Processor -- start 2024-05-10T08:41:35.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f97a219d640 1 -- start start 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f97a219d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0ce120 0x7f979c0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f97a219d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0cd060 0x7f979c1f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f97a219d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0ce500 0x7f979c1f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f97a219d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f979c0b42f0 con 0x7f979c0ce120 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f97a219d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f979c0b4170 con 0x7f979c0cd060 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f97a219d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f979c0d3650 con 0x7f979c0ce500 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.899+0000 7f979b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0ce120 0x7f979c0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0ce120 0x7f979c0ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46232/0 (socket says 172.21.15.37:46232) 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 -- 172.21.15.37:0/1892732913 learned_addr learned my addr 172.21.15.37:0/1892732913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979bfff640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0ce500 0x7f979c1f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979affd640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0cd060 0x7f979c1f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 -- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0ce500 msgr2=0x7f979c1f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0ce500 0x7f979c1f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 -- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0cd060 msgr2=0x7f979c1f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:35.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0cd060 0x7f979c1f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 -- 172.21.15.37:0/1892732913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c0cd5c0 con 0x7f979c0ce120 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f979b7fe640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0ce120 0x7f979c0ccb20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f978c0019b0 tx=0x7f978c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f9783fff640 1 -- 172.21.15.37:0/1892732913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c00f940 con 0x7f979c0ce120 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f9783fff640 1 -- 172.21.15.37:0/1892732913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c018070 con 0x7f979c0ce120 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c0cd8a0 con 0x7f979c0ce120 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f9783fff640 1 -- 172.21.15.37:0/1892732913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c00fd60 con 0x7f979c0ce120 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.900+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c0b7c30 con 0x7f979c0ce120 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.901+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c0b8070 con 0x7f979c0ce120 2024-05-10T08:41:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.902+0000 7f9783fff640 1 -- 172.21.15.37:0/1892732913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f978c01d460 con 0x7f979c0ce120 2024-05-10T08:41:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.903+0000 7f9783fff640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9788076300 0x7f97880787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.903+0000 7f9783fff640 1 -- 172.21.15.37:0/1892732913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5249+0+0 (secure 0 0 0) 0x7f978c097510 con 0x7f979c0ce120 2024-05-10T08:41:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.903+0000 7f979affd640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9788076300 0x7f97880787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.903+0000 7f979affd640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9788076300 0x7f97880787c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f979c06ec90 tx=0x7f9790008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:35.907+0000 7f9783fff640 1 -- 172.21.15.37:0/1892732913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f979c162f50 con 0x7f979c0ce120 2024-05-10T08:41:36.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:36.099+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f979c0d0690 con 0x7f979c0ce120 2024-05-10T08:41:37.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.044+0000 7f9783fff640 1 -- 172.21.15.37:0/1892732913 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) ==== 138+0+0 (secure 0 0 0) 0x7f978c061020 con 0x7f979c0ce120 2024-05-10T08:41:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9788076300 msgr2=0x7f97880787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9788076300 0x7f97880787c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f979c06ec90 tx=0x7f9790008040 comp rx=0 tx=0).stop 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0ce120 msgr2=0x7f979c0ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0ce120 0x7f979c0ccb20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f978c0019b0 tx=0x7f978c007720 comp rx=0 tx=0).stop 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 shutdown_connections 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9788076300 0x7f97880787c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0ce500 0x7f979c1f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0cd060 0x7f979c1f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 --2- 172.21.15.37:0/1892732913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0ce120 0x7f979c0ccb20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 >> 172.21.15.37:0/1892732913 conn(0x7f979c0d5040 msgr2=0x7f979c06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 shutdown_connections 2024-05-10T08:41:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.048+0000 7f97a219d640 1 -- 172.21.15.37:0/1892732913 wait complete. 2024-05-10T08:41:37.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:41:37.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.181+0000 7f9d9806d640 1 Processor -- start 2024-05-10T08:41:37.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.181+0000 7f9d9806d640 1 -- start start 2024-05-10T08:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d9806d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d9015f380 0x7f9d900d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d9806d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d900b1c90 con 0x7f9d900d2600 2024-05-10T08:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d9806d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d900d0a50 con 0x7f9d900b3f30 2024-05-10T08:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d9806d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9d900d2a00 con 0x7f9d9015f380 2024-05-10T08:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d9660a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d900d2600 0x7f9d900b2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47540/0 (socket says 172.21.15.37:47540) 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d9660a640 1 -- 172.21.15.37:0/2736203187 learned_addr learned my addr 172.21.15.37:0/2736203187 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d95e09640 1 --2- 172.21.15.37:0/2736203187 >> v2:172.21.15.82:3300/0 conn(0x7f9d9015f380 0x7f9d900d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508107994 0 0) 0x7f9d900b1c90 con 0x7f9d900d2600 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.182+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7c003520 con 0x7f9d900d2600 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.183+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236478372 0 0) 0x7f9d900d0a50 con 0x7f9d900b3f30 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.183+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d900b1c90 con 0x7f9d900b3f30 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.183+0000 7f9d95e09640 1 -- 172.21.15.37:0/2736203187 >> v1:172.21.15.82:6789/0 conn(0x7f9d900b3f30 legacy=0x7f9d900b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.183+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2324700136 0 0) 0x7f9d7c003520 con 0x7f9d900d2600 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.183+0000 7f9d95e09640 1 -- 172.21.15.37:0/2736203187 >> v1:172.21.15.37:6789/0 conn(0x7f9d900d2600 legacy=0x7f9d900b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.183+0000 7f9d95e09640 1 -- 172.21.15.37:0/2736203187 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d900d0d30 con 0x7f9d9015f380 2024-05-10T08:41:37.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d95e09640 1 --2- 172.21.15.37:0/2736203187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d900d35c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0097a0 tx=0x7f9d8c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9c8842eafc6890 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:37.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c037070 con 0x7f9d9015f380 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c02ac50 con 0x7f9d9015f380 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d94e07640 1 -- 172.21.15.37:0/2736203187 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d880019f0 con 0x7f9d9015f380 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d9806d640 1 -- 172.21.15.37:0/2736203187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 msgr2=0x7f9d900d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d9806d640 1 --2- 172.21.15.37:0/2736203187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d900d35c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0097a0 tx=0x7f9d8c02a1c0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d9806d640 1 -- 172.21.15.37:0/2736203187 shutdown_connections 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d9806d640 1 --2- 172.21.15.37:0/2736203187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d900d35c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d9806d640 1 -- 172.21.15.37:0/2736203187 >> 172.21.15.37:0/2736203187 conn(0x7f9d900d4fe0 msgr2=0x7f9d900d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d9806d640 1 -- 172.21.15.37:0/2736203187 shutdown_connections 2024-05-10T08:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.184+0000 7f9d9806d640 1 -- 172.21.15.37:0/2736203187 wait complete. 2024-05-10T08:41:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 Processor -- start 2024-05-10T08:41:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 -- start start 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d900b3f30 0x7f9d900b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d900d2600 0x7f9d900ba490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d901f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d900d1010 con 0x7f9d900b3f30 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9015f760 con 0x7f9d9015f380 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.186+0000 7f9d9806d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9d900d06e0 con 0x7f9d900d2600 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d900b3f30 0x7f9d900b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d900b3f30 0x7f9d900b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46236/0 (socket says 172.21.15.37:46236) 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 -- 172.21.15.37:0/3038634607 learned_addr learned my addr 172.21.15.37:0/3038634607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95608640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d900d2600 0x7f9d900ba490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d9660a640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d901f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 -- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d900d2600 msgr2=0x7f9d900ba490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d900d2600 0x7f9d900ba490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 -- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 msgr2=0x7f9d901f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d901f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 -- 172.21.15.37:0/3038634607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d900b5050 con 0x7f9d900b3f30 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95608640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d900d2600 0x7f9d900ba490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d9660a640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d901f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d95e09640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d900b3f30 0x7f9d900b60f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0098c0 tx=0x7f9d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d867fc640 1 -- 172.21.15.37:0/3038634607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c037050 con 0x7f9d900b3f30 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d867fc640 1 -- 172.21.15.37:0/3038634607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c043070 con 0x7f9d900b3f30 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d900b5330 con 0x7f9d900b3f30 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d867fc640 1 -- 172.21.15.37:0/3038634607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c006e10 con 0x7f9d900b3f30 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.187+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d900b58f0 con 0x7f9d900b3f30 2024-05-10T08:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.188+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d900693f0 con 0x7f9d900b3f30 2024-05-10T08:41:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.189+0000 7f9d867fc640 1 -- 172.21.15.37:0/3038634607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9d8c03c810 con 0x7f9d900b3f30 2024-05-10T08:41:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.190+0000 7f9d867fc640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d740762d0 0x7f9d74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.190+0000 7f9d867fc640 1 -- 172.21.15.37:0/3038634607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5619+0+0 (secure 0 0 0) 0x7f9d8c0b89b0 con 0x7f9d900b3f30 2024-05-10T08:41:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.190+0000 7f9d95608640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d740762d0 0x7f9d74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.190+0000 7f9d95608640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d740762d0 0x7f9d74078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d900b4c40 tx=0x7f9d80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.194+0000 7f9d867fc640 1 -- 172.21.15.37:0/3038634607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9d8c082460 con 0x7f9d900b3f30 2024-05-10T08:41:37.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:37.387+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9d900763f0 con 0x7f9d900b3f30 2024-05-10T08:41:38.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.049+0000 7f9d867fc640 1 -- 172.21.15.37:0/3038634607 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) ==== 170+0+0 (secure 0 0 0) 0x7f9d8c081d60 con 0x7f9d900b3f30 2024-05-10T08:41:38.049 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:41:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.053+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d740762d0 msgr2=0x7f9d74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.053+0000 7f9d9806d640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d740762d0 0x7f9d74078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d900b4c40 tx=0x7f9d80009040 comp rx=0 tx=0).stop 2024-05-10T08:41:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.053+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d900b3f30 msgr2=0x7f9d900b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.053+0000 7f9d9806d640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d900b3f30 0x7f9d900b60f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0098c0 tx=0x7f9d8c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.053+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 shutdown_connections 2024-05-10T08:41:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.054+0000 7f9d9806d640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d740762d0 0x7f9d74078790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.054+0000 7f9d9806d640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9015f380 0x7f9d901f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.054+0000 7f9d9806d640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d900d2600 0x7f9d900ba490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.054+0000 7f9d9806d640 1 --2- 172.21.15.37:0/3038634607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d900b3f30 0x7f9d900b60f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.054+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 >> 172.21.15.37:0/3038634607 conn(0x7f9d900d4fe0 msgr2=0x7f9d900b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.054+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 shutdown_connections 2024-05-10T08:41:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.054+0000 7f9d9806d640 1 -- 172.21.15.37:0/3038634607 wait complete. 2024-05-10T08:41:38.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:41:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.190+0000 7f8453d2b640 1 Processor -- start 2024-05-10T08:41:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.190+0000 7f8453d2b640 1 -- start start 2024-05-10T08:41:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8453d2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f844c0b6590 0x7f844c0d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8453d2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c163460 0x7f844c15ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8453d2b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844c0d3320 con 0x7f844c0d2bb0 2024-05-10T08:41:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8453d2b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f844c0d3600 con 0x7f844c0b6590 2024-05-10T08:41:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8453d2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f844c0d38e0 con 0x7f844c163460 2024-05-10T08:41:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8451ac7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f844c0b6590 0x7f844c0d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8451ac7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f844c0b6590 0x7f844c0d0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44304/0 (socket says 172.21.15.37:44304) 2024-05-10T08:41:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8451ac7640 1 -- 172.21.15.37:0/3552732935 learned_addr learned my addr 172.21.15.37:0/3552732935 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f84522c8640 1 --2- 172.21.15.37:0/3552732935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c163460 0x7f844c15ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8451ac7640 1 -- 172.21.15.37:0/3552732935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c163460 msgr2=0x7f844c15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8451ac7640 1 --2- 172.21.15.37:0/3552732935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c163460 0x7f844c15ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8451ac7640 1 -- 172.21.15.37:0/3552732935 >> v1:172.21.15.82:6789/0 conn(0x7f844c0d2bb0 legacy=0x7f844c162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.191+0000 7f8451ac7640 1 -- 172.21.15.37:0/3552732935 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c0d3bc0 con 0x7f844c0b6590 2024-05-10T08:41:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.192+0000 7f8451ac7640 1 --2- 172.21.15.37:0/3552732935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c0b6590 0x7f844c0d0bd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8448009870 tx=0x7f844802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f0f780e44fdfb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.192+0000 7f8450ac5640 1 -- 172.21.15.37:0/3552732935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448037070 con 0x7f844c0b6590 2024-05-10T08:41:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.192+0000 7f8450ac5640 1 -- 172.21.15.37:0/3552732935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8448032440 con 0x7f844c0b6590 2024-05-10T08:41:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.192+0000 7f8450ac5640 1 -- 172.21.15.37:0/3552732935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448032810 con 0x7f844c0b6590 2024-05-10T08:41:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 -- 172.21.15.37:0/3552732935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c0b6590 msgr2=0x7f844c0d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 --2- 172.21.15.37:0/3552732935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c0b6590 0x7f844c0d0bd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8448009870 tx=0x7f844802a270 comp rx=0 tx=0).stop 2024-05-10T08:41:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 -- 172.21.15.37:0/3552732935 shutdown_connections 2024-05-10T08:41:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 --2- 172.21.15.37:0/3552732935 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c163460 0x7f844c15ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 --2- 172.21.15.37:0/3552732935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c0b6590 0x7f844c0d0bd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 -- 172.21.15.37:0/3552732935 >> 172.21.15.37:0/3552732935 conn(0x7f844c0d4fe0 msgr2=0x7f844c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 -- 172.21.15.37:0/3552732935 shutdown_connections 2024-05-10T08:41:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.193+0000 7f8453d2b640 1 -- 172.21.15.37:0/3552732935 wait complete. 2024-05-10T08:41:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.194+0000 7f8453d2b640 1 Processor -- start 2024-05-10T08:41:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.194+0000 7f8453d2b640 1 -- start start 2024-05-10T08:41:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f8453d2b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c0b6590 0x7f844c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f8453d2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c0d2bb0 0x7f844c162030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f8453d2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c163460 0x7f844c0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f8453d2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f844c15f170 con 0x7f844c163460 2024-05-10T08:41:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f8453d2b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f844c0d3010 con 0x7f844c0b6590 2024-05-10T08:41:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f8453d2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f844c15f2f0 con 0x7f844c0d2bb0 2024-05-10T08:41:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c163460 0x7f844c0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c163460 0x7f844c0b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44310/0 (socket says 172.21.15.37:44310) 2024-05-10T08:41:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 -- 172.21.15.37:0/955859002 learned_addr learned my addr 172.21.15.37:0/955859002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84512c6640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c0d2bb0 0x7f844c162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f8451ac7640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c0b6590 0x7f844c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 -- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c0d2bb0 msgr2=0x7f844c162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c0d2bb0 0x7f844c162030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 -- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c0b6590 msgr2=0x7f844c153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c0b6590 0x7f844c153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 -- 172.21.15.37:0/955859002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c0cd8c0 con 0x7f844c163460 2024-05-10T08:41:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.195+0000 7f84522c8640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c163460 0x7f844c0b8610 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f844400efc0 tx=0x7f844400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.196+0000 7f84427fc640 1 -- 172.21.15.37:0/955859002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444018020 con 0x7f844c163460 2024-05-10T08:41:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.196+0000 7f84427fc640 1 -- 172.21.15.37:0/955859002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8444014480 con 0x7f844c163460 2024-05-10T08:41:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.196+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844c0cdba0 con 0x7f844c163460 2024-05-10T08:41:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.196+0000 7f84427fc640 1 -- 172.21.15.37:0/955859002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444014870 con 0x7f844c163460 2024-05-10T08:41:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.196+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f844c0ce160 con 0x7f844c163460 2024-05-10T08:41:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.197+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844c0693f0 con 0x7f844c163460 2024-05-10T08:41:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.197+0000 7f84427fc640 1 -- 172.21.15.37:0/955859002 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8444005d10 con 0x7f844c163460 2024-05-10T08:41:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.198+0000 7f84427fc640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84300762d0 0x7f8430078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.198+0000 7f84427fc640 1 -- 172.21.15.37:0/955859002 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6001+0+0 (secure 0 0 0) 0x7f8444098060 con 0x7f844c163460 2024-05-10T08:41:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.198+0000 7f8451ac7640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84300762d0 0x7f8430078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.199+0000 7f8451ac7640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84300762d0 0x7f8430078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8448034000 tx=0x7f844802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.203+0000 7f84427fc640 1 -- 172.21.15.37:0/955859002 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8444022070 con 0x7f844c163460 2024-05-10T08:41:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:38.433+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f844c0d1ae0 con 0x7f844c163460 2024-05-10T08:41:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.053+0000 7f84427fc640 1 -- 172.21.15.37:0/955859002 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) ==== 172+0+0 (secure 0 0 0) 0x7f8444010040 con 0x7f844c163460 2024-05-10T08:41:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 7 and data pool 8 2024-05-10T08:41:39.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.057+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84300762d0 msgr2=0x7f8430078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.057+0000 7f8453d2b640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84300762d0 0x7f8430078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8448034000 tx=0x7f844802e000 comp rx=0 tx=0).stop 2024-05-10T08:41:39.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.057+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c163460 msgr2=0x7f844c0b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.057+0000 7f8453d2b640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c163460 0x7f844c0b8610 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f844400efc0 tx=0x7f844400c490 comp rx=0 tx=0).stop 2024-05-10T08:41:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.059+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 shutdown_connections 2024-05-10T08:41:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.059+0000 7f8453d2b640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84300762d0 0x7f8430078790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.059+0000 7f8453d2b640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f844c163460 0x7f844c0b8610 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.059+0000 7f8453d2b640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f844c0d2bb0 0x7f844c162030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.059+0000 7f8453d2b640 1 --2- 172.21.15.37:0/955859002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c0b6590 0x7f844c153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.059+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 >> 172.21.15.37:0/955859002 conn(0x7f844c0d4fe0 msgr2=0x7f844c0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.067+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 shutdown_connections 2024-05-10T08:41:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.070+0000 7f8453d2b640 1 -- 172.21.15.37:0/955859002 wait complete. 2024-05-10T08:41:39.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:39.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.203+0000 7f5e0ef46640 1 Processor -- start 2024-05-10T08:41:39.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.203+0000 7f5e0ef46640 1 -- start start 2024-05-10T08:41:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.203+0000 7f5e0ef46640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e081629a0 0x7f5e080d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.203+0000 7f5e0ef46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080d2dc0 0x7f5e080d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0ef46640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e080d3330 con 0x7f5e080c8ed0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0ef46640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5e080d2170 con 0x7f5e081629a0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0ef46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5e080d2450 con 0x7f5e080d2dc0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0d4e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e080c8ed0 0x7f5e080c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44186/0 (socket says 172.21.15.37:44186) 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0d4e3640 1 -- 172.21.15.37:0/893139458 learned_addr learned my addr 172.21.15.37:0/893139458 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0cce2640 1 --2- 172.21.15.37:0/893139458 >> v2:172.21.15.82:3300/0 conn(0x7f5e081629a0 0x7f5e080d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e07fff640 1 --2- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080d2dc0 0x7f5e080d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e077fe640 1 -- 172.21.15.37:0/893139458 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260483051 0 0) 0x7f5e080d3330 con 0x7f5e080c8ed0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e077fe640 1 -- 172.21.15.37:0/893139458 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4003520 con 0x7f5e080c8ed0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e077fe640 1 -- 172.21.15.37:0/893139458 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3689451670 0 0) 0x7f5df4003520 con 0x7f5e080c8ed0 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0cce2640 1 -- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080d2dc0 msgr2=0x7f5e080d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0cce2640 1 --2- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080d2dc0 0x7f5e080d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0cce2640 1 -- 172.21.15.37:0/893139458 >> v1:172.21.15.37:6789/0 conn(0x7f5e080c8ed0 legacy=0x7f5e080c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e0cce2640 1 -- 172.21.15.37:0/893139458 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080d2730 con 0x7f5e081629a0 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.204+0000 7f5e07fff640 1 --2- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080d2dc0 0x7f5e080d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.205+0000 7f5e0cce2640 1 --2- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 0x7f5e080d35c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5df00097a0 tx=0x7f5df002a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c49e2ff5c89cba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.205+0000 7f5e077fe640 1 -- 172.21.15.37:0/893139458 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0037070 con 0x7f5e081629a0 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.205+0000 7f5e077fe640 1 -- 172.21.15.37:0/893139458 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df002aa90 con 0x7f5e081629a0 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.205+0000 7f5e077fe640 1 -- 172.21.15.37:0/893139458 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e000019f0 con 0x7f5e081629a0 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 -- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 msgr2=0x7f5e080d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 0x7f5e080d35c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5df00097a0 tx=0x7f5df002a000 comp rx=0 tx=0).stop 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 -- 172.21.15.37:0/893139458 shutdown_connections 2024-05-10T08:41:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080d2dc0 0x7f5e080d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/893139458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 0x7f5e080d35c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 -- 172.21.15.37:0/893139458 >> 172.21.15.37:0/893139458 conn(0x7f5e080d4fe0 msgr2=0x7f5e080d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 -- 172.21.15.37:0/893139458 shutdown_connections 2024-05-10T08:41:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.206+0000 7f5e0ef46640 1 -- 172.21.15.37:0/893139458 wait complete. 2024-05-10T08:41:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.207+0000 7f5e0ef46640 1 Processor -- start 2024-05-10T08:41:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.207+0000 7f5e0ef46640 1 -- start start 2024-05-10T08:41:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0ef46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080c8ed0 0x7f5e080cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0ef46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080d2dc0 0x7f5e081f8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0ef46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 0x7f5e081523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0ef46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e080cf440 con 0x7f5e080d2dc0 2024-05-10T08:41:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0ef46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e080cf2c0 con 0x7f5e081629a0 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0ef46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5e080d0cb0 con 0x7f5e080c8ed0 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080d2dc0 0x7f5e081f8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080d2dc0 0x7f5e081f8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44320/0 (socket says 172.21.15.37:44320) 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 -- 172.21.15.37:0/3147907637 learned_addr learned my addr 172.21.15.37:0/3147907637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0cce2640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080c8ed0 0x7f5e080cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e0d4e3640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 0x7f5e081523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 -- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080c8ed0 msgr2=0x7f5e080cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080c8ed0 0x7f5e080cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 -- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 msgr2=0x7f5e081523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 0x7f5e081523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.208+0000 7f5e07fff640 1 -- 172.21.15.37:0/3147907637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080cd050 con 0x7f5e080d2dc0 2024-05-10T08:41:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.209+0000 7f5e07fff640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080d2dc0 0x7f5e081f8e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5df800ec10 tx=0x7f5df800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.209+0000 7f5e057fa640 1 -- 172.21.15.37:0/3147907637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8017070 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.209+0000 7f5e057fa640 1 -- 172.21.15.37:0/3147907637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df800cc30 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.209+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e080cc7b0 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.209+0000 7f5e057fa640 1 -- 172.21.15.37:0/3147907637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8013470 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.209+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e080ccd70 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.210+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e080693f0 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.211+0000 7f5e057fa640 1 -- 172.21.15.37:0/3147907637 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5df801a070 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.211+0000 7f5e057fa640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5de80762d0 0x7f5de8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.211+0000 7f5e057fa640 1 -- 172.21.15.37:0/3147907637 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6101+0+0 (secure 0 0 0) 0x7f5df8097570 con 0x7f5e080d2dc0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.211+0000 7f5e0cce2640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5de80762d0 0x7f5de8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.212+0000 7f5e0cce2640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5de80762d0 0x7f5de8078790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5df0034000 tx=0x7f5df002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.215+0000 7f5e057fa640 1 -- 172.21.15.37:0/3147907637 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5df8060780 con 0x7f5e080d2dc0 2024-05-10T08:41:39.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.407+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e08160a10 con 0x7f5e080d2dc0 2024-05-10T08:41:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.408+0000 7f5e057fa640 1 -- 172.21.15.37:0/3147907637 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16895 (secure 0 0 0) 0x7f5df8064a80 con 0x7f5e080d2dc0 2024-05-10T08:41:39.408 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:38.434417+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:36.103494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:37.392261+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:39.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.410+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5de80762d0 msgr2=0x7f5de8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.410+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5de80762d0 0x7f5de8078790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5df0034000 tx=0x7f5df002e000 comp rx=0 tx=0).stop 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080d2dc0 msgr2=0x7f5e081f8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080d2dc0 0x7f5e081f8e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5df800ec10 tx=0x7f5df800c520 comp rx=0 tx=0).stop 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 shutdown_connections 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5de80762d0 0x7f5de8078790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e081629a0 0x7f5e081523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080d2dc0 0x7f5e081f8e90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 --2- 172.21.15.37:0/3147907637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e080c8ed0 0x7f5e080cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 >> 172.21.15.37:0/3147907637 conn(0x7f5e080d4fe0 msgr2=0x7f5e080d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 shutdown_connections 2024-05-10T08:41:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.411+0000 7f5e0ef46640 1 -- 172.21.15.37:0/3147907637 wait complete. 2024-05-10T08:41:39.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:39.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.526+0000 7f26f9e1d640 1 Processor -- start 2024-05-10T08:41:39.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.526+0000 7f26f9e1d640 1 -- start start 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f9e1d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26f40b2490 0x7f26f4070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f9e1d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26f4070d20 0x7f26f40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f9e1d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f406e110 con 0x7f26f41629b0 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f9e1d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f26f406dec0 con 0x7f26f4070d20 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f9e1d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f26f406e3f0 con 0x7f26f40b2490 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26f4070d20 0x7f26f40711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26f4070d20 0x7f26f40711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44328/0 (socket says 172.21.15.37:44328) 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f3fff640 1 -- 172.21.15.37:0/1319109375 learned_addr learned my addr 172.21.15.37:0/1319109375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f2ffd640 1 --2- 172.21.15.37:0/1319109375 >> v2:172.21.15.82:3300/0 conn(0x7f26f40b2490 0x7f26f4070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f3fff640 1 -- 172.21.15.37:0/1319109375 >> v2:172.21.15.82:3300/0 conn(0x7f26f40b2490 msgr2=0x7f26f4070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:39.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f3fff640 1 --2- 172.21.15.37:0/1319109375 >> v2:172.21.15.82:3300/0 conn(0x7f26f40b2490 0x7f26f4070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f27fc640 1 -- 172.21.15.37:0/1319109375 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125489229 0 0) 0x7f26f406e110 con 0x7f26f41629b0 2024-05-10T08:41:39.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f3fff640 1 -- 172.21.15.37:0/1319109375 >> v1:172.21.15.82:6789/0 conn(0x7f26f41629b0 legacy=0x7f26f406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.527+0000 7f26f3fff640 1 -- 172.21.15.37:0/1319109375 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f406e6d0 con 0x7f26f4070d20 2024-05-10T08:41:39.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.528+0000 7f26f3fff640 1 --2- 172.21.15.37:0/1319109375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f4070d20 0x7f26f40711d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f26f40b8fb0 tx=0x7f26ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34aaafd0914f3d17 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.528+0000 7f26f27fc640 1 -- 172.21.15.37:0/1319109375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec036070 con 0x7f26f4070d20 2024-05-10T08:41:39.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.528+0000 7f26f27fc640 1 -- 172.21.15.37:0/1319109375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec031600 con 0x7f26f4070d20 2024-05-10T08:41:39.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.528+0000 7f26f27fc640 1 -- 172.21.15.37:0/1319109375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0319d0 con 0x7f26f4070d20 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 -- 172.21.15.37:0/1319109375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f4070d20 msgr2=0x7f26f40711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/1319109375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f4070d20 0x7f26f40711d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f26f40b8fb0 tx=0x7f26ec02a730 comp rx=0 tx=0).stop 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 -- 172.21.15.37:0/1319109375 shutdown_connections 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/1319109375 >> v2:172.21.15.82:3300/0 conn(0x7f26f40b2490 0x7f26f4070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/1319109375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f4070d20 0x7f26f40711d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 -- 172.21.15.37:0/1319109375 >> 172.21.15.37:0/1319109375 conn(0x7f26f40b49d0 msgr2=0x7f26f40b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 -- 172.21.15.37:0/1319109375 shutdown_connections 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.529+0000 7f26f9e1d640 1 -- 172.21.15.37:0/1319109375 wait complete. 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.530+0000 7f26f9e1d640 1 Processor -- start 2024-05-10T08:41:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.530+0000 7f26f9e1d640 1 -- start start 2024-05-10T08:41:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f9e1d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f4070d20 0x7f26f415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f9e1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f40b2490 0x7f26f415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f9e1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41629b0 0x7f26f415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f9e1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26f40709f0 con 0x7f26f40b2490 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f9e1d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4070870 con 0x7f26f41629b0 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f9e1d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f26f40afcb0 con 0x7f26f4070d20 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f40b2490 0x7f26f415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f40b2490 0x7f26f415bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44338/0 (socket says 172.21.15.37:44338) 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 -- 172.21.15.37:0/3656742782 learned_addr learned my addr 172.21.15.37:0/3656742782 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f37fe640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f4070d20 0x7f26f415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f3fff640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41629b0 0x7f26f415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 -- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f4070d20 msgr2=0x7f26f415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f4070d20 0x7f26f415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 -- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41629b0 msgr2=0x7f26f415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41629b0 0x7f26f415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.531+0000 7f26f2ffd640 1 -- 172.21.15.37:0/3656742782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f415dc30 con 0x7f26f40b2490 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.532+0000 7f26f2ffd640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f40b2490 0x7f26f415bd10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f26e800e9b0 tx=0x7f26e800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.532+0000 7f26dbfff640 1 -- 172.21.15.37:0/3656742782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8017070 con 0x7f26f40b2490 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.532+0000 7f26dbfff640 1 -- 172.21.15.37:0/3656742782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e800c9a0 con 0x7f26f40b2490 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.532+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f415df10 con 0x7f26f40b2490 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.532+0000 7f26dbfff640 1 -- 172.21.15.37:0/3656742782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e800cd90 con 0x7f26f40b2490 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.532+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f415e4d0 con 0x7f26f40b2490 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.533+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f40693f0 con 0x7f26f40b2490 2024-05-10T08:41:39.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.533+0000 7f26dbfff640 1 -- 172.21.15.37:0/3656742782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f26e801a070 con 0x7f26f40b2490 2024-05-10T08:41:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.534+0000 7f26dbfff640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26e00762d0 0x7f26e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.534+0000 7f26dbfff640 1 -- 172.21.15.37:0/3656742782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6101+0+0 (secure 0 0 0) 0x7f26e8097ab0 con 0x7f26f40b2490 2024-05-10T08:41:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.534+0000 7f26f37fe640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26e00762d0 0x7f26e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.534+0000 7f26f37fe640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26e00762d0 0x7f26e0078790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26e4007fd0 tx=0x7f26e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.538+0000 7f26dbfff640 1 -- 172.21.15.37:0/3656742782 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f26e8061310 con 0x7f26f40b2490 2024-05-10T08:41:39.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.729+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26f40c6930 con 0x7f26f40b2490 2024-05-10T08:41:39.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.731+0000 7f26dbfff640 1 -- 172.21.15.37:0/3656742782 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16895 (secure 0 0 0) 0x7f26e8060c10 con 0x7f26f40b2490 2024-05-10T08:41:39.730 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:39.730 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:38.434417+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:36.103494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:37.392261+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:39.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26e00762d0 msgr2=0x7f26e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26e00762d0 0x7f26e0078790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26e4007fd0 tx=0x7f26e4009040 comp rx=0 tx=0).stop 2024-05-10T08:41:39.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f40b2490 msgr2=0x7f26f415bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f40b2490 0x7f26f415bd10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f26e800e9b0 tx=0x7f26e800ee70 comp rx=0 tx=0).stop 2024-05-10T08:41:39.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 shutdown_connections 2024-05-10T08:41:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26e00762d0 0x7f26e0078790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41629b0 0x7f26f415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f40b2490 0x7f26f415bd10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 --2- 172.21.15.37:0/3656742782 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f4070d20 0x7f26f415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 >> 172.21.15.37:0/3656742782 conn(0x7f26f40b49d0 msgr2=0x7f26f40d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 shutdown_connections 2024-05-10T08:41:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.733+0000 7f26f9e1d640 1 -- 172.21.15.37:0/3656742782 wait complete. 2024-05-10T08:41:39.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:41:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.850+0000 7f558e4c8640 1 Processor -- start 2024-05-10T08:41:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.850+0000 7f558e4c8640 1 -- start start 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f558e4c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55880b6590 0x7f55880d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f558e4c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55880d3320 con 0x7f55880d2bb0 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f558e4c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55880d3600 con 0x7f5588163460 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f558e4c8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f55880d38e0 con 0x7f55880b6590 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f5587fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55880b6590 0x7f55880d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f55877fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f55880d2bb0 0x7f5588162d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44196/0 (socket says 172.21.15.37:44196) 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f55877fe640 1 -- 172.21.15.37:0/1712412821 learned_addr learned my addr 172.21.15.37:0/1712412821 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f5587fff640 1 -- 172.21.15.37:0/1712412821 >> v1:172.21.15.82:6789/0 conn(0x7f5588163460 legacy=0x7f558815ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f5587fff640 1 -- 172.21.15.37:0/1712412821 >> v1:172.21.15.37:6789/0 conn(0x7f55880d2bb0 legacy=0x7f5588162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.851+0000 7f5587fff640 1 -- 172.21.15.37:0/1712412821 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55880d3bc0 con 0x7f55880b6590 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.852+0000 7f5587fff640 1 --2- 172.21.15.37:0/1712412821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880b6590 0x7f55880d0bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f55780097a0 tx=0x7f557802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc8b3386fbd7de0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.852+0000 7f5586ffd640 1 -- 172.21.15.37:0/1712412821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578037070 con 0x7f55880b6590 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.852+0000 7f5586ffd640 1 -- 172.21.15.37:0/1712412821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557802ae50 con 0x7f55880b6590 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.852+0000 7f5586ffd640 1 -- 172.21.15.37:0/1712412821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578032660 con 0x7f55880b6590 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.853+0000 7f558e4c8640 1 -- 172.21.15.37:0/1712412821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880b6590 msgr2=0x7f55880d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.853+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1712412821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880b6590 0x7f55880d0bd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f55780097a0 tx=0x7f557802a140 comp rx=0 tx=0).stop 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.853+0000 7f558e4c8640 1 -- 172.21.15.37:0/1712412821 shutdown_connections 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.853+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1712412821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880b6590 0x7f55880d0bd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.853+0000 7f558e4c8640 1 -- 172.21.15.37:0/1712412821 >> 172.21.15.37:0/1712412821 conn(0x7f55880d4fe0 msgr2=0x7f55880d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.853+0000 7f558e4c8640 1 -- 172.21.15.37:0/1712412821 shutdown_connections 2024-05-10T08:41:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.853+0000 7f558e4c8640 1 -- 172.21.15.37:0/1712412821 wait complete. 2024-05-10T08:41:39.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.854+0000 7f558e4c8640 1 Processor -- start 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.854+0000 7f558e4c8640 1 -- start start 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558e4c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55880b6590 0x7f5588159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558e4c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880d2bb0 0x7f558806e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558e4c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5588163460 0x7f558806e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558e4c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55880b9080 con 0x7f55880d2bb0 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558e4c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55880d3010 con 0x7f5588163460 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558e4c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f55880b9200 con 0x7f55880b6590 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880d2bb0 0x7f558806e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880d2bb0 0x7f558806e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44350/0 (socket says 172.21.15.37:44350) 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 -- 172.21.15.37:0/1906568115 learned_addr learned my addr 172.21.15.37:0/1906568115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f5587fff640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55880b6590 0x7f5588159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558ca65640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5588163460 0x7f558806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 -- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55880b6590 msgr2=0x7f5588159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55880b6590 0x7f5588159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 -- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5588163460 msgr2=0x7f558806e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5588163460 0x7f558806e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f55877fe640 1 -- 172.21.15.37:0/1906568115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5588159840 con 0x7f55880d2bb0 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.855+0000 7f558ca65640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5588163460 0x7f558806e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.856+0000 7f55877fe640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880d2bb0 0x7f558806e2e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c430 tx=0x7f557c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.856+0000 7f5584ff9640 1 -- 172.21.15.37:0/1906568115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c017070 con 0x7f55880d2bb0 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.856+0000 7f5584ff9640 1 -- 172.21.15.37:0/1906568115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557c005ce0 con 0x7f55880d2bb0 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.856+0000 7f5584ff9640 1 -- 172.21.15.37:0/1906568115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c0072f0 con 0x7f55880d2bb0 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.856+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558815fce0 con 0x7f55880d2bb0 2024-05-10T08:41:39.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.856+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55880cd630 con 0x7f55880d2bb0 2024-05-10T08:41:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.857+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55880693f0 con 0x7f55880d2bb0 2024-05-10T08:41:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.857+0000 7f5584ff9640 1 -- 172.21.15.37:0/1906568115 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f557c01a070 con 0x7f55880d2bb0 2024-05-10T08:41:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.858+0000 7f5584ff9640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55740762d0 0x7f5574078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.858+0000 7f5584ff9640 1 -- 172.21.15.37:0/1906568115 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6101+0+0 (secure 0 0 0) 0x7f557c096bb0 con 0x7f55880d2bb0 2024-05-10T08:41:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.858+0000 7f5587fff640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55740762d0 0x7f5574078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.859+0000 7f5587fff640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55740762d0 0x7f5574078790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5578034000 tx=0x7f557802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:39.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:39.862+0000 7f5584ff9640 1 -- 172.21.15.37:0/1906568115 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f557c060380 con 0x7f55880d2bb0 2024-05-10T08:41:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:40.095+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f55880cb9d0 con 0x7f55880d2bb0 2024-05-10T08:41:41.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.072+0000 7f5584ff9640 1 -- 172.21.15.37:0/1906568115 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f557c05fc80 con 0x7f55880d2bb0 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55740762d0 msgr2=0x7f5574078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55740762d0 0x7f5574078790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5578034000 tx=0x7f557802e000 comp rx=0 tx=0).stop 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880d2bb0 msgr2=0x7f558806e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880d2bb0 0x7f558806e2e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c430 tx=0x7f557c00c8f0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 shutdown_connections 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55740762d0 0x7f5574078790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5588163460 0x7f558806e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55880d2bb0 0x7f558806e2e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 --2- 172.21.15.37:0/1906568115 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55880b6590 0x7f5588159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 >> 172.21.15.37:0/1906568115 conn(0x7f55880d4fe0 msgr2=0x7f5588162890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 shutdown_connections 2024-05-10T08:41:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.075+0000 7f558e4c8640 1 -- 172.21.15.37:0/1906568115 wait complete. 2024-05-10T08:41:41.088 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T08:41:41.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:41:41.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.202+0000 7fbb25600640 1 Processor -- start 2024-05-10T08:41:41.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.202+0000 7fbb25600640 1 -- start start 2024-05-10T08:41:41.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.203+0000 7fbb25600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015f3b0 0x7fbb20163980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.203+0000 7fbb25600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb200d3d30 con 0x7fbb200d08b0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.203+0000 7fbb25600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb200cfdd0 con 0x7fbb2015efd0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.203+0000 7fbb25600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb200d00b0 con 0x7fbb2015f3b0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.203+0000 7fbb1f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb200d08b0 0x7fbb20162db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44202/0 (socket says 172.21.15.37:44202) 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.203+0000 7fbb1f7fe640 1 -- 172.21.15.37:0/3454885526 learned_addr learned my addr 172.21.15.37:0/3454885526 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.203+0000 7fbb1e7fc640 1 --2- 172.21.15.37:0/3454885526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015f3b0 0x7fbb20163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.204+0000 7fbb1dffb640 1 -- 172.21.15.37:0/3454885526 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918613789 0 0) 0x7fbb200d3d30 con 0x7fbb200d08b0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.204+0000 7fbb1dffb640 1 -- 172.21.15.37:0/3454885526 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb0c003520 con 0x7fbb200d08b0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.204+0000 7fbb1dffb640 1 -- 172.21.15.37:0/3454885526 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754938999 0 0) 0x7fbb200cfdd0 con 0x7fbb2015efd0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.204+0000 7fbb1dffb640 1 -- 172.21.15.37:0/3454885526 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb200d3d30 con 0x7fbb2015efd0 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.204+0000 7fbb1e7fc640 1 -- 172.21.15.37:0/3454885526 >> v1:172.21.15.82:6789/0 conn(0x7fbb2015efd0 legacy=0x7fbb200d3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.204+0000 7fbb1e7fc640 1 -- 172.21.15.37:0/3454885526 >> v1:172.21.15.37:6789/0 conn(0x7fbb200d08b0 legacy=0x7fbb20162db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.204+0000 7fbb1e7fc640 1 -- 172.21.15.37:0/3454885526 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb200cfa80 con 0x7fbb2015f3b0 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb1e7fc640 1 --2- 172.21.15.37:0/3454885526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015f3b0 0x7fbb20163980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb080097d0 tx=0x7fbb0802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c404ef7b2ffc841c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb1dffb640 1 -- 172.21.15.37:0/3454885526 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08037070 con 0x7fbb2015f3b0 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb1dffb640 1 -- 172.21.15.37:0/3454885526 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb08032440 con 0x7fbb2015f3b0 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb1dffb640 1 -- 172.21.15.37:0/3454885526 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb080327f0 con 0x7fbb2015f3b0 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb25600640 1 -- 172.21.15.37:0/3454885526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015f3b0 msgr2=0x7fbb20163980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb25600640 1 --2- 172.21.15.37:0/3454885526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015f3b0 0x7fbb20163980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb080097d0 tx=0x7fbb0802a290 comp rx=0 tx=0).stop 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb25600640 1 -- 172.21.15.37:0/3454885526 shutdown_connections 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb25600640 1 --2- 172.21.15.37:0/3454885526 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015f3b0 0x7fbb20163980 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb25600640 1 -- 172.21.15.37:0/3454885526 >> 172.21.15.37:0/3454885526 conn(0x7fbb200d4f70 msgr2=0x7fbb200d5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb25600640 1 -- 172.21.15.37:0/3454885526 shutdown_connections 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.205+0000 7fbb25600640 1 -- 172.21.15.37:0/3454885526 wait complete. 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.207+0000 7fbb25600640 1 Processor -- start 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.207+0000 7fbb25600640 1 -- start start 2024-05-10T08:41:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb25600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200d08b0 0x7fbb200ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb25600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015efd0 0x7fbb201e9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb25600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb2015f3b0 0x7fbb200c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb25600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb20163640 con 0x7fbb200d08b0 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb25600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb201634c0 con 0x7fbb2015f3b0 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb25600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2006cdb0 con 0x7fbb2015efd0 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200d08b0 0x7fbb200ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200d08b0 0x7fbb200ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44362/0 (socket says 172.21.15.37:44362) 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 -- 172.21.15.37:0/1473403593 learned_addr learned my addr 172.21.15.37:0/1473403593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1e7fc640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015efd0 0x7fbb201e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1f7fe640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb2015f3b0 0x7fbb200c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 -- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015efd0 msgr2=0x7fbb201e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015efd0 0x7fbb201e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 -- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb2015f3b0 msgr2=0x7fbb200c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb2015f3b0 0x7fbb200c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.208+0000 7fbb1effd640 1 -- 172.21.15.37:0/1473403593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb200cba00 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.209+0000 7fbb1effd640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200d08b0 0x7fbb200ce9c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c500 tx=0x7fbb1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.209+0000 7fbb177fe640 1 -- 172.21.15.37:0/1473403593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb180052d0 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.209+0000 7fbb177fe640 1 -- 172.21.15.37:0/1473403593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb18005490 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.209+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb200ca980 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.209+0000 7fbb177fe640 1 -- 172.21.15.37:0/1473403593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18012870 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.209+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb200caf40 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.210+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb20050740 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.210+0000 7fbb177fe640 1 -- 172.21.15.37:0/1473403593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb18012a10 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.211+0000 7fbb177fe640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb000762d0 0x7fbb00078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.211+0000 7fbb177fe640 1 -- 172.21.15.37:0/1473403593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fbb18097370 con 0x7fbb200d08b0 2024-05-10T08:41:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.211+0000 7fbb1e7fc640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb000762d0 0x7fbb00078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.212+0000 7fbb1e7fc640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb000762d0 0x7fbb00078790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb08034000 tx=0x7fbb0802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.215+0000 7fbb177fe640 1 -- 172.21.15.37:0/1473403593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbb18060500 con 0x7fbb200d08b0 2024-05-10T08:41:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:41.445+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbb2015c8f0 con 0x7fbb200d08b0 2024-05-10T08:41:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.077+0000 7fbb177fe640 1 -- 172.21.15.37:0/1473403593 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fbb18064800 con 0x7fbb200d08b0 2024-05-10T08:41:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb000762d0 msgr2=0x7fbb00078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb000762d0 0x7fbb00078790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb08034000 tx=0x7fbb0802e000 comp rx=0 tx=0).stop 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200d08b0 msgr2=0x7fbb200ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200d08b0 0x7fbb200ce9c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c500 tx=0x7fbb1800c9c0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 shutdown_connections 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb000762d0 0x7fbb00078790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb2015f3b0 0x7fbb200c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb2015efd0 0x7fbb201e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 --2- 172.21.15.37:0/1473403593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200d08b0 0x7fbb200ce9c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 >> 172.21.15.37:0/1473403593 conn(0x7fbb200d4f70 msgr2=0x7fbb200b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 shutdown_connections 2024-05-10T08:41:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.080+0000 7fbb25600640 1 -- 172.21.15.37:0/1473403593 wait complete. 2024-05-10T08:41:42.093 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:41:42.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:42.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.204+0000 7f657b940640 1 Processor -- start 2024-05-10T08:41:42.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.204+0000 7f657b940640 1 -- start start 2024-05-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f657b940640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 0x7f657406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f657b940640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657406e110 con 0x7f6574070d20 2024-05-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f657b940640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657406e3f0 con 0x7f65740b2490 2024-05-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f657b940640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6574070a40 con 0x7f65741629b0 2024-05-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f6579edd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6574070d20 0x7f65740afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44212/0 (socket says 172.21.15.37:44212) 2024-05-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f6579edd640 1 -- 172.21.15.37:0/1843185417 learned_addr learned my addr 172.21.15.37:0/1843185417 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257286645 0 0) 0x7f657406e110 con 0x7f6574070d20 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f65796dc640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 0x7f657406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6560003520 con 0x7f6574070d20 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203812570 0 0) 0x7f6560003520 con 0x7f6574070d20 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 msgr2=0x7f657406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 0x7f657406eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 >> v1:172.21.15.82:6789/0 conn(0x7f65740b2490 legacy=0x7f6574070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657406e6d0 con 0x7f6574070d20 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f656c0019f0 con 0x7f6574070d20 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 >> v1:172.21.15.37:6789/0 conn(0x7f6574070d20 legacy=0x7f65740afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65600039e0 0x7f6560003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6560004800 0x7f6560004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.205+0000 7f656bfff640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 0x7f65600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6574070a40 con 0x7f65600039e0 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f656000ba70 con 0x7f6560004800 2024-05-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f656000bc70 con 0x7f65741629b0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f65796dc640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65600039e0 0x7f6560003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f6578edb640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6560004800 0x7f6560004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f6579edd640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 0x7f65600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f65796dc640 1 -- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 msgr2=0x7f65600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f65796dc640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 0x7f65600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f65796dc640 1 -- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6560004800 msgr2=0x7f6560004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f65796dc640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6560004800 0x7f6560004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f65796dc640 1 -- 172.21.15.37:0/1843185417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6560003520 con 0x7f65600039e0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.206+0000 7f6579edd640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65741629b0 0x7f65600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f65796dc640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65600039e0 0x7f6560003e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6570009a90 tx=0x7f6560005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5fdb026cc85566 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570036070 con 0x7f65600039e0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6570031400 con 0x7f65600039e0 2024-05-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f656bfff640 1 -- 172.21.15.37:0/1843185417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570009690 con 0x7f65600039e0 2024-05-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f657b940640 1 -- 172.21.15.37:0/1843185417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65600039e0 msgr2=0x7f6560003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f657b940640 1 --2- 172.21.15.37:0/1843185417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65600039e0 0x7f6560003e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6570009a90 tx=0x7f6560005830 comp rx=0 tx=0).stop 2024-05-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f6579edd640 1 -- 172.21.15.37:0/1843185417 reap_dead start 2024-05-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f657b940640 1 -- 172.21.15.37:0/1843185417 shutdown_connections 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f657b940640 1 -- 172.21.15.37:0/1843185417 >> 172.21.15.37:0/1843185417 conn(0x7f65740b49d0 msgr2=0x7f65740b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f657b940640 1 -- 172.21.15.37:0/1843185417 shutdown_connections 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.207+0000 7f657b940640 1 -- 172.21.15.37:0/1843185417 wait complete. 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 Processor -- start 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 -- start start 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65600039e0 0x7f65740cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657414df60 0x7f65740cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f657414e820 0x7f657414eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f65740b03c0 con 0x7f657414df60 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f657406dec0 con 0x7f65600039e0 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.209+0000 7f657b940640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f65740b0540 con 0x7f657414e820 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657414df60 0x7f65740cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657414df60 0x7f65740cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44390/0 (socket says 172.21.15.37:44390) 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 -- 172.21.15.37:0/2312890949 learned_addr learned my addr 172.21.15.37:0/2312890949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f65796dc640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65600039e0 0x7f65740cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6579edd640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f657414e820 0x7f657414eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 -- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f657414e820 msgr2=0x7f657414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f657414e820 0x7f657414eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 -- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65600039e0 msgr2=0x7f65740cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65600039e0 0x7f65740cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 -- 172.21.15.37:0/2312890949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65740caf60 con 0x7f657414df60 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6579edd640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f657414e820 0x7f657414eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6578edb640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657414df60 0x7f65740cfc10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f656400f880 tx=0x7f656400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6569ffb640 1 -- 172.21.15.37:0/2312890949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564001d20 con 0x7f657414df60 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6569ffb640 1 -- 172.21.15.37:0/2312890949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6564018070 con 0x7f657414df60 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65740cb240 con 0x7f657414df60 2024-05-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.210+0000 7f6569ffb640 1 -- 172.21.15.37:0/2312890949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400d730 con 0x7f657414df60 2024-05-10T08:41:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.211+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65740cb800 con 0x7f657414df60 2024-05-10T08:41:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.212+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65740693f0 con 0x7f657414df60 2024-05-10T08:41:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.212+0000 7f6569ffb640 1 -- 172.21.15.37:0/2312890949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f656400d8d0 con 0x7f657414df60 2024-05-10T08:41:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.213+0000 7f6569ffb640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65580762d0 0x7f6558078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.213+0000 7f6569ffb640 1 -- 172.21.15.37:0/2312890949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f65640975c0 con 0x7f657414df60 2024-05-10T08:41:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.213+0000 7f65796dc640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65580762d0 0x7f6558078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.214+0000 7f65796dc640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65580762d0 0x7f6558078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6570033000 tx=0x7f6570008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.217+0000 7f6569ffb640 1 -- 172.21.15.37:0/2312890949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6564060cf0 con 0x7f657414df60 2024-05-10T08:41:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.445+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6574076460 con 0x7f657414df60 2024-05-10T08:41:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.446+0000 7f6569ffb640 1 -- 172.21.15.37:0/2312890949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7f65640605f0 con 0x7f657414df60 2024-05-10T08:41:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:42.445 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:41:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65580762d0 msgr2=0x7f6558078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65580762d0 0x7f6558078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6570033000 tx=0x7f6570008030 comp rx=0 tx=0).stop 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657414df60 msgr2=0x7f65740cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657414df60 0x7f65740cfc10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f656400f880 tx=0x7f656400fd40 comp rx=0 tx=0).stop 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 shutdown_connections 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65580762d0 0x7f6558078790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f657414e820 0x7f657414eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657414df60 0x7f65740cfc10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 --2- 172.21.15.37:0/2312890949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65600039e0 0x7f65740cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 >> 172.21.15.37:0/2312890949 conn(0x7f65740b49d0 msgr2=0x7f65740b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 shutdown_connections 2024-05-10T08:41:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.448+0000 7f657b940640 1 -- 172.21.15.37:0/2312890949 wait complete. 2024-05-10T08:41:42.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:41:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.563+0000 7f63577ac640 1 Processor -- start 2024-05-10T08:41:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.563+0000 7f63577ac640 1 -- start start 2024-05-10T08:41:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f63577ac640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6350072840 0x7f635015c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f63577ac640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f63577ac640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635015c920 con 0x7f635006e0f0 2024-05-10T08:41:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f63577ac640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f635015cc00 con 0x7f6350072840 2024-05-10T08:41:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f63577ac640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f635015cee0 con 0x7f635006e4d0 2024-05-10T08:41:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f6354d47640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6350072840 0x7f635015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f6355d49640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f6355548640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f635006e0f0 0x7f63500d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:53142/0 (socket says 172.21.15.37:53142) 2024-05-10T08:41:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f6355548640 1 -- 172.21.15.37:0/4031276520 learned_addr learned my addr 172.21.15.37:0/4031276520 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.564+0000 7f6347fff640 1 -- 172.21.15.37:0/4031276520 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190325845 0 0) 0x7f635015c920 con 0x7f635006e0f0 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6347fff640 1 -- 172.21.15.37:0/4031276520 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f633c003520 con 0x7f635006e0f0 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6354d47640 1 -- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 msgr2=0x7f63500aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6354d47640 1 --2- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6354d47640 1 -- 172.21.15.37:0/4031276520 >> v1:172.21.15.82:6789/0 conn(0x7f635006e0f0 legacy=0x7f63500d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6354d47640 1 -- 172.21.15.37:0/4031276520 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635015d1c0 con 0x7f6350072840 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6355d49640 1 --2- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6354d47640 1 --2- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f635015c340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63400097a0 tx=0x7f634002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bb4672e12f35f7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.565+0000 7f6347fff640 1 -- 172.21.15.37:0/4031276520 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340037070 con 0x7f6350072840 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f6347fff640 1 -- 172.21.15.37:0/4031276520 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6340032440 con 0x7f6350072840 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f6347fff640 1 -- 172.21.15.37:0/4031276520 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340032810 con 0x7f6350072840 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 -- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 msgr2=0x7f635015c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 --2- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f635015c340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63400097a0 tx=0x7f634002a180 comp rx=0 tx=0).stop 2024-05-10T08:41:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 -- 172.21.15.37:0/4031276520 shutdown_connections 2024-05-10T08:41:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 --2- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 --2- 172.21.15.37:0/4031276520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f635015c340 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 -- 172.21.15.37:0/4031276520 >> 172.21.15.37:0/4031276520 conn(0x7f635006c3a0 msgr2=0x7f635006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 -- 172.21.15.37:0/4031276520 shutdown_connections 2024-05-10T08:41:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.566+0000 7f63577ac640 1 -- 172.21.15.37:0/4031276520 wait complete. 2024-05-10T08:41:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.567+0000 7f63577ac640 1 Processor -- start 2024-05-10T08:41:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.567+0000 7f63577ac640 1 -- start start 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f63577ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f635006e0f0 0x7f6350149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f63577ac640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f63577ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f6350151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f63577ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f63500ae7d0 con 0x7f635006e0f0 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f63577ac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63500ae650 con 0x7f6350072840 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f63577ac640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f63501530b0 con 0x7f635006e4d0 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f6355548640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f635006e0f0 0x7f6350149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f6355548640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f635006e0f0 0x7f6350149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44396/0 (socket says 172.21.15.37:44396) 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.568+0000 7f6355548640 1 -- 172.21.15.37:0/1180451878 learned_addr learned my addr 172.21.15.37:0/1180451878 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355d49640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f6350151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6354d47640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355548640 1 -- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 msgr2=0x7f63500b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355548640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355548640 1 -- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 msgr2=0x7f6350151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355548640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f6350151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355548640 1 -- 172.21.15.37:0/1180451878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63500b3140 con 0x7f635006e0f0 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355d49640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f6350151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6354d47640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6355548640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f635006e0f0 0x7f6350149db0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f634c00cb40 tx=0x7f634c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6345ffb640 1 -- 172.21.15.37:0/1180451878 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c017070 con 0x7f635006e0f0 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6345ffb640 1 -- 172.21.15.37:0/1180451878 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c00aca0 con 0x7f635006e0f0 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63501f0b90 con 0x7f635006e0f0 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f6345ffb640 1 -- 172.21.15.37:0/1180451878 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c012620 con 0x7f635006e0f0 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.569+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63500b3420 con 0x7f635006e0f0 2024-05-10T08:41:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.570+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63500693f0 con 0x7f635006e0f0 2024-05-10T08:41:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.571+0000 7f6345ffb640 1 -- 172.21.15.37:0/1180451878 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f634c01a070 con 0x7f635006e0f0 2024-05-10T08:41:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.571+0000 7f6345ffb640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63340762d0 0x7f6334078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.571+0000 7f6345ffb640 1 -- 172.21.15.37:0/1180451878 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f634c0975b0 con 0x7f635006e0f0 2024-05-10T08:41:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.571+0000 7f6354d47640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63340762d0 0x7f6334078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.572+0000 7f6354d47640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63340762d0 0x7f6334078790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6340034000 tx=0x7f634002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.575+0000 7f6345ffb640 1 -- 172.21.15.37:0/1180451878 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f634c060e10 con 0x7f635006e0f0 2024-05-10T08:41:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.766+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f635015c9e0 con 0x7f635006e0f0 2024-05-10T08:41:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.768+0000 7f6345ffb640 1 -- 172.21.15.37:0/1180451878 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16882 (secure 0 0 0) 0x7f634c060710 con 0x7f635006e0f0 2024-05-10T08:41:42.767 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:42.767 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:41:40.063189+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:36.103494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:37.392261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:41:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.769+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63340762d0 msgr2=0x7f6334078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63340762d0 0x7f6334078790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6340034000 tx=0x7f634002e000 comp rx=0 tx=0).stop 2024-05-10T08:41:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f635006e0f0 msgr2=0x7f6350149db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f635006e0f0 0x7f6350149db0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f634c00cb40 tx=0x7f634c00a060 comp rx=0 tx=0).stop 2024-05-10T08:41:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 shutdown_connections 2024-05-10T08:41:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63340762d0 0x7f6334078790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6350072840 0x7f6350151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f635006e4d0 0x7f63500b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 --2- 172.21.15.37:0/1180451878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f635006e0f0 0x7f6350149db0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 >> 172.21.15.37:0/1180451878 conn(0x7f635006c3a0 msgr2=0x7f635006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 shutdown_connections 2024-05-10T08:41:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.770+0000 7f63577ac640 1 -- 172.21.15.37:0/1180451878 wait complete. 2024-05-10T08:41:42.780 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:41:42.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:41:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.884+0000 7f495cd33640 1 Processor -- start 2024-05-10T08:41:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.884+0000 7f495cd33640 1 -- start start 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f495cd33640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f495815f420 0x7f49580d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f495cd33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49580d3ca0 0x7f49580d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f495cd33640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49581630b0 con 0x7f49580d1eb0 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f495cd33640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f49580d22f0 con 0x7f495815f420 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f495cd33640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f49580d2550 con 0x7f49580d3ca0 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f495659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f495815f420 0x7f49580d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f4956d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f49580d1eb0 0x7f49580d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44220/0 (socket says 172.21.15.37:44220) 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.885+0000 7f4956d9d640 1 -- 172.21.15.37:0/3502881539 learned_addr learned my addr 172.21.15.37:0/3502881539 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.886+0000 7f4955d9b640 1 --2- 172.21.15.37:0/3502881539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49580d3ca0 0x7f49580d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.886+0000 7f495659c640 1 -- 172.21.15.37:0/3502881539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49580d3ca0 msgr2=0x7f49580d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.886+0000 7f495659c640 1 --2- 172.21.15.37:0/3502881539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49580d3ca0 0x7f49580d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.886+0000 7f495659c640 1 -- 172.21.15.37:0/3502881539 >> v1:172.21.15.37:6789/0 conn(0x7f49580d1eb0 legacy=0x7f49580d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.886+0000 7f495659c640 1 -- 172.21.15.37:0/3502881539 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49580d2c80 con 0x7f495815f420 2024-05-10T08:41:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.886+0000 7f495659c640 1 --2- 172.21.15.37:0/3502881539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f495815f420 0x7f49580d3760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4948009d90 tx=0x7f494802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8730475fc87cd651 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495559a640 1 -- 172.21.15.37:0/3502881539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948007740 con 0x7f495815f420 2024-05-10T08:41:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495559a640 1 -- 172.21.15.37:0/3502881539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49480078e0 con 0x7f495815f420 2024-05-10T08:41:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495559a640 1 -- 172.21.15.37:0/3502881539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948007cb0 con 0x7f495815f420 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 -- 172.21.15.37:0/3502881539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f495815f420 msgr2=0x7f49580d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 --2- 172.21.15.37:0/3502881539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f495815f420 0x7f49580d3760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4948009d90 tx=0x7f494802a660 comp rx=0 tx=0).stop 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 -- 172.21.15.37:0/3502881539 shutdown_connections 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 --2- 172.21.15.37:0/3502881539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f49580d3ca0 0x7f49580d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 --2- 172.21.15.37:0/3502881539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f495815f420 0x7f49580d3760 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 -- 172.21.15.37:0/3502881539 >> 172.21.15.37:0/3502881539 conn(0x7f495808eac0 msgr2=0x7f495809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 -- 172.21.15.37:0/3502881539 shutdown_connections 2024-05-10T08:41:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.887+0000 7f495cd33640 1 -- 172.21.15.37:0/3502881539 wait complete. 2024-05-10T08:41:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 Processor -- start 2024-05-10T08:41:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 -- start start 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49580d1eb0 0x7f495815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4958162090 0x7f49580cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49580cc620 0x7f49580caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49580d2830 con 0x7f49580cc620 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49580d3240 con 0x7f49580d1eb0 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f495cd33640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f49580d53d0 con 0x7f4958162090 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f4956d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49580cc620 0x7f49580caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.889+0000 7f4956d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49580cc620 0x7f49580caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44408/0 (socket says 172.21.15.37:44408) 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4956d9d640 1 -- 172.21.15.37:0/1808795997 learned_addr learned my addr 172.21.15.37:0/1808795997 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4955d9b640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4958162090 0x7f49580cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f495659c640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49580d1eb0 0x7f495815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4956d9d640 1 -- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4958162090 msgr2=0x7f49580cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4956d9d640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4958162090 0x7f49580cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4956d9d640 1 -- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49580d1eb0 msgr2=0x7f495815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4956d9d640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49580d1eb0 0x7f495815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4956d9d640 1 -- 172.21.15.37:0/1808795997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495815a4d0 con 0x7f49580cc620 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f495659c640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49580d1eb0 0x7f495815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4955d9b640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4958162090 0x7f49580cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f4956d9d640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49580cc620 0x7f49580caf70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f495000c420 tx=0x7f495000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f494effd640 1 -- 172.21.15.37:0/1808795997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950017070 con 0x7f49580cc620 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f494effd640 1 -- 172.21.15.37:0/1808795997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950005ce0 con 0x7f49580cc620 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49580c9ed0 con 0x7f49580cc620 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f494effd640 1 -- 172.21.15.37:0/1808795997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49500072d0 con 0x7f49580cc620 2024-05-10T08:41:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.890+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49580ca490 con 0x7f49580cc620 2024-05-10T08:41:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.891+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49580693f0 con 0x7f49580cc620 2024-05-10T08:41:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.892+0000 7f494effd640 1 -- 172.21.15.37:0/1808795997 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f495001a070 con 0x7f49580cc620 2024-05-10T08:41:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.892+0000 7f494effd640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49380762d0 0x7f4938078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.892+0000 7f494effd640 1 -- 172.21.15.37:0/1808795997 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f49500968f0 con 0x7f49580cc620 2024-05-10T08:41:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.893+0000 7f495659c640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49380762d0 0x7f4938078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.893+0000 7f495659c640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49380762d0 0x7f4938078790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4948034000 tx=0x7f4948033040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:42.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:42.897+0000 7f494effd640 1 -- 172.21.15.37:0/1808795997 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f49581630b0 con 0x7f49580cc620 2024-05-10T08:41:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.084+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49580763f0 con 0x7f49380762d0 2024-05-10T08:41:43.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.091+0000 7f494effd640 1 -- 172.21.15.37:0/1808795997 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251905 (secure 0 0 0) 0x7f49580763f0 con 0x7f49380762d0 2024-05-10T08:41:43.093 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49380762d0 msgr2=0x7f4938078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49380762d0 0x7f4938078790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4948034000 tx=0x7f4948033040 comp rx=0 tx=0).stop 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49580cc620 msgr2=0x7f49580caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49580cc620 0x7f49580caf70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f495000c420 tx=0x7f495000c8e0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 shutdown_connections 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f49380762d0 0x7f4938078790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49580cc620 0x7f49580caf70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4958162090 0x7f49580cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 --2- 172.21.15.37:0/1808795997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49580d1eb0 0x7f495815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 >> 172.21.15.37:0/1808795997 conn(0x7f495808eac0 msgr2=0x7f4958163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 shutdown_connections 2024-05-10T08:41:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.093+0000 7f495cd33640 1 -- 172.21.15.37:0/1808795997 wait complete. 2024-05-10T08:41:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-05-10T08:41:41.344618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221872,"kb_used_data":5684,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752848,"statfs":{"total":773094113280,"available":772866916352,"internally_reserved":0,"allocated":5820416,"data_stored":3180960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.294228"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069381+0000","last_change":"2024-05-10T08:41:39.066597+0000","last_active":"2024-05-10T08:41:40.069381+0000","last_peered":"2024-05-10T08:41:40.069381+0000","last_clean":"2024-05-10T08:41:40.069381+0000","last_became_active":"2024-05-10T08:41:39.066342+0000","last_became_peered":"2024-05-10T08:41:39.066342+0000","last_unstale":"2024-05-10T08:41:40.069381+0000","last_undegraded":"2024-05-10T08:41:40.069381+0000","last_fullsized":"2024-05-10T08:41:40.069381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:20.859498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.083016+0000","last_change":"2024-05-10T08:41:39.077126+0000","last_active":"2024-05-10T08:41:39.083016+0000","last_peered":"2024-05-10T08:41:39.083016+0000","last_clean":"2024-05-10T08:41:39.083016+0000","last_became_active":"2024-05-10T08:41:39.076298+0000","last_became_peered":"2024-05-10T08:41:39.076298+0000","last_unstale":"2024-05-10T08:41:39.083016+0000","last_undegraded":"2024-05-10T08:41:39.083016+0000","last_fullsized":"2024-05-10T08:41:39.083016+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:22:00.467154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070372+0000","last_change":"2024-05-10T08:41:39.073652+0000","last_active":"2024-05-10T08:41:40.070372+0000","last_peered":"2024-05-10T08:41:40.070372+0000","last_clean":"2024-05-10T08:41:40.070372+0000","last_became_active":"2024-05-10T08:41:39.073384+0000","last_became_peered":"2024-05-10T08:41:39.073384+0000","last_unstale":"2024-05-10T08:41:40.070372+0000","last_undegraded":"2024-05-10T08:41:40.070372+0000","last_fullsized":"2024-05-10T08:41:40.070372+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:57.443438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077913+0000","last_change":"2024-05-10T08:41:39.072236+0000","last_active":"2024-05-10T08:41:39.077913+0000","last_peered":"2024-05-10T08:41:39.077913+0000","last_clean":"2024-05-10T08:41:39.077913+0000","last_became_active":"2024-05-10T08:41:39.071953+0000","last_became_peered":"2024-05-10T08:41:39.071953+0000","last_unstale":"2024-05-10T08:41:39.077913+0000","last_undegraded":"2024-05-10T08:41:39.077913+0000","last_fullsized":"2024-05-10T08:41:39.077913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:47:14.263275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070308+0000","last_change":"2024-05-10T08:41:39.066586+0000","last_active":"2024-05-10T08:41:40.070308+0000","last_peered":"2024-05-10T08:41:40.070308+0000","last_clean":"2024-05-10T08:41:40.070308+0000","last_became_active":"2024-05-10T08:41:39.066276+0000","last_became_peered":"2024-05-10T08:41:39.066276+0000","last_unstale":"2024-05-10T08:41:40.070308+0000","last_undegraded":"2024-05-10T08:41:40.070308+0000","last_fullsized":"2024-05-10T08:41:40.070308+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:48.380787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069431+0000","last_change":"2024-05-10T08:41:39.071191+0000","last_active":"2024-05-10T08:41:40.069431+0000","last_peered":"2024-05-10T08:41:40.069431+0000","last_clean":"2024-05-10T08:41:40.069431+0000","last_became_active":"2024-05-10T08:41:39.070906+0000","last_became_peered":"2024-05-10T08:41:39.070906+0000","last_unstale":"2024-05-10T08:41:40.069431+0000","last_undegraded":"2024-05-10T08:41:40.069431+0000","last_fullsized":"2024-05-10T08:41:40.069431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:49.047140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070166+0000","last_change":"2024-05-10T08:41:39.078449+0000","last_active":"2024-05-10T08:41:40.070166+0000","last_peered":"2024-05-10T08:41:40.070166+0000","last_clean":"2024-05-10T08:41:40.070166+0000","last_became_active":"2024-05-10T08:41:39.076962+0000","last_became_peered":"2024-05-10T08:41:39.076962+0000","last_unstale":"2024-05-10T08:41:40.070166+0000","last_undegraded":"2024-05-10T08:41:40.070166+0000","last_fullsized":"2024-05-10T08:41:40.070166+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:51.380141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088559+0000","last_change":"2024-05-10T08:41:39.082308+0000","last_active":"2024-05-10T08:41:39.088559+0000","last_peered":"2024-05-10T08:41:39.088559+0000","last_clean":"2024-05-10T08:41:39.088559+0000","last_became_active":"2024-05-10T08:41:39.081961+0000","last_became_peered":"2024-05-10T08:41:39.081961+0000","last_unstale":"2024-05-10T08:41:39.088559+0000","last_undegraded":"2024-05-10T08:41:39.088559+0000","last_fullsized":"2024-05-10T08:41:39.088559+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:03.908737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088499+0000","last_change":"2024-05-10T08:41:39.083006+0000","last_active":"2024-05-10T08:41:39.088499+0000","last_peered":"2024-05-10T08:41:39.088499+0000","last_clean":"2024-05-10T08:41:39.088499+0000","last_became_active":"2024-05-10T08:41:39.081602+0000","last_became_peered":"2024-05-10T08:41:39.081602+0000","last_unstale":"2024-05-10T08:41:39.088499+0000","last_undegraded":"2024-05-10T08:41:39.088499+0000","last_fullsized":"2024-05-10T08:41:39.088499+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:57.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069435+0000","last_change":"2024-05-10T08:41:39.070830+0000","last_active":"2024-05-10T08:41:40.069435+0000","last_peered":"2024-05-10T08:41:40.069435+0000","last_clean":"2024-05-10T08:41:40.069435+0000","last_became_active":"2024-05-10T08:41:39.070529+0000","last_became_peered":"2024-05-10T08:41:39.070529+0000","last_unstale":"2024-05-10T08:41:40.069435+0000","last_undegraded":"2024-05-10T08:41:40.069435+0000","last_fullsized":"2024-05-10T08:41:40.069435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:15.558195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077397+0000","last_change":"2024-05-10T08:41:39.075833+0000","last_active":"2024-05-10T08:41:39.077397+0000","last_peered":"2024-05-10T08:41:39.077397+0000","last_clean":"2024-05-10T08:41:39.077397+0000","last_became_active":"2024-05-10T08:41:39.075538+0000","last_became_peered":"2024-05-10T08:41:39.075538+0000","last_unstale":"2024-05-10T08:41:39.077397+0000","last_undegraded":"2024-05-10T08:41:39.077397+0000","last_fullsized":"2024-05-10T08:41:39.077397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:42.944268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.089296+0000","last_change":"2024-05-10T08:41:39.087549+0000","last_active":"2024-05-10T08:41:39.089296+0000","last_peered":"2024-05-10T08:41:39.089296+0000","last_clean":"2024-05-10T08:41:39.089296+0000","last_became_active":"2024-05-10T08:41:39.087123+0000","last_became_peered":"2024-05-10T08:41:39.087123+0000","last_unstale":"2024-05-10T08:41:39.089296+0000","last_undegraded":"2024-05-10T08:41:39.089296+0000","last_fullsized":"2024-05-10T08:41:39.089296+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:41.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069164+0000","last_change":"2024-05-10T08:41:39.073614+0000","last_active":"2024-05-10T08:41:40.069164+0000","last_peered":"2024-05-10T08:41:40.069164+0000","last_clean":"2024-05-10T08:41:40.069164+0000","last_became_active":"2024-05-10T08:41:39.073356+0000","last_became_peered":"2024-05-10T08:41:39.073356+0000","last_unstale":"2024-05-10T08:41:40.069164+0000","last_undegraded":"2024-05-10T08:41:40.069164+0000","last_fullsized":"2024-05-10T08:41:40.069164+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.006313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070510+0000","last_change":"2024-05-10T08:41:39.076189+0000","last_active":"2024-05-10T08:41:40.070510+0000","last_peered":"2024-05-10T08:41:40.070510+0000","last_clean":"2024-05-10T08:41:40.070510+0000","last_became_active":"2024-05-10T08:41:39.075810+0000","last_became_peered":"2024-05-10T08:41:39.075810+0000","last_unstale":"2024-05-10T08:41:40.070510+0000","last_undegraded":"2024-05-10T08:41:40.070510+0000","last_fullsized":"2024-05-10T08:41:40.070510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:18.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.085436+0000","last_change":"2024-05-10T08:41:39.083194+0000","last_active":"2024-05-10T08:41:39.085436+0000","last_peered":"2024-05-10T08:41:39.085436+0000","last_clean":"2024-05-10T08:41:39.085436+0000","last_became_active":"2024-05-10T08:41:39.082924+0000","last_became_peered":"2024-05-10T08:41:39.082924+0000","last_unstale":"2024-05-10T08:41:39.085436+0000","last_undegraded":"2024-05-10T08:41:39.085436+0000","last_fullsized":"2024-05-10T08:41:39.085436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:02.956995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069046+0000","last_change":"2024-05-10T08:41:39.063291+0000","last_active":"2024-05-10T08:41:40.069046+0000","last_peered":"2024-05-10T08:41:40.069046+0000","last_clean":"2024-05-10T08:41:40.069046+0000","last_became_active":"2024-05-10T08:41:39.063006+0000","last_became_peered":"2024-05-10T08:41:39.063006+0000","last_unstale":"2024-05-10T08:41:40.069046+0000","last_undegraded":"2024-05-10T08:41:40.069046+0000","last_fullsized":"2024-05-10T08:41:40.069046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:10.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070863+0000","last_change":"2024-05-10T08:41:39.080430+0000","last_active":"2024-05-10T08:41:40.070863+0000","last_peered":"2024-05-10T08:41:40.070863+0000","last_clean":"2024-05-10T08:41:40.070863+0000","last_became_active":"2024-05-10T08:41:39.079532+0000","last_became_peered":"2024-05-10T08:41:39.079532+0000","last_unstale":"2024-05-10T08:41:40.070863+0000","last_undegraded":"2024-05-10T08:41:40.070863+0000","last_fullsized":"2024-05-10T08:41:40.070863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:06:09.345277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084611+0000","last_change":"2024-05-10T08:41:39.077900+0000","last_active":"2024-05-10T08:41:39.084611+0000","last_peered":"2024-05-10T08:41:39.084611+0000","last_clean":"2024-05-10T08:41:39.084611+0000","last_became_active":"2024-05-10T08:41:39.076671+0000","last_became_peered":"2024-05-10T08:41:39.076671+0000","last_unstale":"2024-05-10T08:41:39.084611+0000","last_undegraded":"2024-05-10T08:41:39.084611+0000","last_fullsized":"2024-05-10T08:41:39.084611+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:10.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070538+0000","last_change":"2024-05-10T08:41:39.073002+0000","last_active":"2024-05-10T08:41:40.070538+0000","last_peered":"2024-05-10T08:41:40.070538+0000","last_clean":"2024-05-10T08:41:40.070538+0000","last_became_active":"2024-05-10T08:41:39.072183+0000","last_became_peered":"2024-05-10T08:41:39.072183+0000","last_unstale":"2024-05-10T08:41:40.070538+0000","last_undegraded":"2024-05-10T08:41:40.070538+0000","last_fullsized":"2024-05-10T08:41:40.070538+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:35.118376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088443+0000","last_change":"2024-05-10T08:41:39.082515+0000","last_active":"2024-05-10T08:41:39.088443+0000","last_peered":"2024-05-10T08:41:39.088443+0000","last_clean":"2024-05-10T08:41:39.088443+0000","last_became_active":"2024-05-10T08:41:39.082192+0000","last_became_peered":"2024-05-10T08:41:39.082192+0000","last_unstale":"2024-05-10T08:41:39.088443+0000","last_undegraded":"2024-05-10T08:41:39.088443+0000","last_fullsized":"2024-05-10T08:41:39.088443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:10.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.085251+0000","last_change":"2024-05-10T08:41:39.076984+0000","last_active":"2024-05-10T08:41:39.085251+0000","last_peered":"2024-05-10T08:41:39.085251+0000","last_clean":"2024-05-10T08:41:39.085251+0000","last_became_active":"2024-05-10T08:41:39.076713+0000","last_became_peered":"2024-05-10T08:41:39.076713+0000","last_unstale":"2024-05-10T08:41:39.085251+0000","last_undegraded":"2024-05-10T08:41:39.085251+0000","last_fullsized":"2024-05-10T08:41:39.085251+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:15.720764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084343+0000","last_change":"2024-05-10T08:41:39.082044+0000","last_active":"2024-05-10T08:41:39.084343+0000","last_peered":"2024-05-10T08:41:39.084343+0000","last_clean":"2024-05-10T08:41:39.084343+0000","last_became_active":"2024-05-10T08:41:39.081234+0000","last_became_peered":"2024-05-10T08:41:39.081234+0000","last_unstale":"2024-05-10T08:41:39.084343+0000","last_undegraded":"2024-05-10T08:41:39.084343+0000","last_fullsized":"2024-05-10T08:41:39.084343+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:17.035446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.076123+0000","last_change":"2024-05-10T08:41:39.073403+0000","last_active":"2024-05-10T08:41:39.076123+0000","last_peered":"2024-05-10T08:41:39.076123+0000","last_clean":"2024-05-10T08:41:39.076123+0000","last_became_active":"2024-05-10T08:41:39.073119+0000","last_became_peered":"2024-05-10T08:41:39.073119+0000","last_unstale":"2024-05-10T08:41:39.076123+0000","last_undegraded":"2024-05-10T08:41:39.076123+0000","last_fullsized":"2024-05-10T08:41:39.076123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:48.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070055+0000","last_change":"2024-05-10T08:41:39.080116+0000","last_active":"2024-05-10T08:41:40.070055+0000","last_peered":"2024-05-10T08:41:40.070055+0000","last_clean":"2024-05-10T08:41:40.070055+0000","last_became_active":"2024-05-10T08:41:39.078069+0000","last_became_peered":"2024-05-10T08:41:39.078069+0000","last_unstale":"2024-05-10T08:41:40.070055+0000","last_undegraded":"2024-05-10T08:41:40.070055+0000","last_fullsized":"2024-05-10T08:41:40.070055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:55.451128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070916+0000","last_change":"2024-05-10T08:41:39.080200+0000","last_active":"2024-05-10T08:41:40.070916+0000","last_peered":"2024-05-10T08:41:40.070916+0000","last_clean":"2024-05-10T08:41:40.070916+0000","last_became_active":"2024-05-10T08:41:39.079220+0000","last_became_peered":"2024-05-10T08:41:39.079220+0000","last_unstale":"2024-05-10T08:41:40.070916+0000","last_undegraded":"2024-05-10T08:41:40.070916+0000","last_fullsized":"2024-05-10T08:41:40.070916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:33.274834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082713+0000","last_change":"2024-05-10T08:41:39.073974+0000","last_active":"2024-05-10T08:41:39.082713+0000","last_peered":"2024-05-10T08:41:39.082713+0000","last_clean":"2024-05-10T08:41:39.082713+0000","last_became_active":"2024-05-10T08:41:39.073312+0000","last_became_peered":"2024-05-10T08:41:39.073312+0000","last_unstale":"2024-05-10T08:41:39.082713+0000","last_undegraded":"2024-05-10T08:41:39.082713+0000","last_fullsized":"2024-05-10T08:41:39.082713+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:18.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069219+0000","last_change":"2024-05-10T08:41:39.082222+0000","last_active":"2024-05-10T08:41:40.069219+0000","last_peered":"2024-05-10T08:41:40.069219+0000","last_clean":"2024-05-10T08:41:40.069219+0000","last_became_active":"2024-05-10T08:41:39.081952+0000","last_became_peered":"2024-05-10T08:41:39.081952+0000","last_unstale":"2024-05-10T08:41:40.069219+0000","last_undegraded":"2024-05-10T08:41:40.069219+0000","last_fullsized":"2024-05-10T08:41:40.069219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:02.956995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088462+0000","last_change":"2024-05-10T08:41:39.082553+0000","last_active":"2024-05-10T08:41:39.088462+0000","last_peered":"2024-05-10T08:41:39.088462+0000","last_clean":"2024-05-10T08:41:39.088462+0000","last_became_active":"2024-05-10T08:41:39.082126+0000","last_became_peered":"2024-05-10T08:41:39.082126+0000","last_unstale":"2024-05-10T08:41:39.088462+0000","last_undegraded":"2024-05-10T08:41:39.088462+0000","last_fullsized":"2024-05-10T08:41:39.088462+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:04.980074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070769+0000","last_change":"2024-05-10T08:41:39.085154+0000","last_active":"2024-05-10T08:41:40.070769+0000","last_peered":"2024-05-10T08:41:40.070769+0000","last_clean":"2024-05-10T08:41:40.070769+0000","last_became_active":"2024-05-10T08:41:39.084859+0000","last_became_peered":"2024-05-10T08:41:39.084859+0000","last_unstale":"2024-05-10T08:41:40.070769+0000","last_undegraded":"2024-05-10T08:41:40.070769+0000","last_fullsized":"2024-05-10T08:41:40.070769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:57.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.075782+0000","last_change":"2024-05-10T08:41:39.073570+0000","last_active":"2024-05-10T08:41:39.075782+0000","last_peered":"2024-05-10T08:41:39.075782+0000","last_clean":"2024-05-10T08:41:39.075782+0000","last_became_active":"2024-05-10T08:41:39.072822+0000","last_became_peered":"2024-05-10T08:41:39.072822+0000","last_unstale":"2024-05-10T08:41:39.075782+0000","last_undegraded":"2024-05-10T08:41:39.075782+0000","last_fullsized":"2024-05-10T08:41:39.075782+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:12.649813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070243+0000","last_change":"2024-05-10T08:41:39.078226+0000","last_active":"2024-05-10T08:41:40.070243+0000","last_peered":"2024-05-10T08:41:40.070243+0000","last_clean":"2024-05-10T08:41:40.070243+0000","last_became_active":"2024-05-10T08:41:39.076643+0000","last_became_peered":"2024-05-10T08:41:39.076643+0000","last_unstale":"2024-05-10T08:41:40.070243+0000","last_undegraded":"2024-05-10T08:41:40.070243+0000","last_fullsized":"2024-05-10T08:41:40.070243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:40:49.584980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088209+0000","last_change":"2024-05-10T08:41:39.083951+0000","last_active":"2024-05-10T08:41:39.088209+0000","last_peered":"2024-05-10T08:41:39.088209+0000","last_clean":"2024-05-10T08:41:39.088209+0000","last_became_active":"2024-05-10T08:41:39.083674+0000","last_became_peered":"2024-05-10T08:41:39.083674+0000","last_unstale":"2024-05-10T08:41:39.088209+0000","last_undegraded":"2024-05-10T08:41:39.088209+0000","last_fullsized":"2024-05-10T08:41:39.088209+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:20.859498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082613+0000","last_change":"2024-05-10T08:41:39.076429+0000","last_active":"2024-05-10T08:41:39.082613+0000","last_peered":"2024-05-10T08:41:39.082613+0000","last_clean":"2024-05-10T08:41:39.082613+0000","last_became_active":"2024-05-10T08:41:39.076146+0000","last_became_peered":"2024-05-10T08:41:39.076146+0000","last_unstale":"2024-05-10T08:41:39.082613+0000","last_undegraded":"2024-05-10T08:41:39.082613+0000","last_fullsized":"2024-05-10T08:41:39.082613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:48.380787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.083638+0000","last_change":"2024-05-10T08:41:38.063512+0000","last_active":"2024-05-10T08:41:39.083638+0000","last_peered":"2024-05-10T08:41:39.083638+0000","last_clean":"2024-05-10T08:41:39.083638+0000","last_became_active":"2024-05-10T08:41:38.063246+0000","last_became_peered":"2024-05-10T08:41:38.063246+0000","last_unstale":"2024-05-10T08:41:39.083638+0000","last_undegraded":"2024-05-10T08:41:39.083638+0000","last_fullsized":"2024-05-10T08:41:39.083638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:15:12.086903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.075964+0000","last_change":"2024-05-10T08:41:39.072448+0000","last_active":"2024-05-10T08:41:39.075964+0000","last_peered":"2024-05-10T08:41:39.075964+0000","last_clean":"2024-05-10T08:41:39.075964+0000","last_became_active":"2024-05-10T08:41:39.072200+0000","last_became_peered":"2024-05-10T08:41:39.072200+0000","last_unstale":"2024-05-10T08:41:39.075964+0000","last_undegraded":"2024-05-10T08:41:39.075964+0000","last_fullsized":"2024-05-10T08:41:39.075964+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:10.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069307+0000","last_change":"2024-05-10T08:41:38.073332+0000","last_active":"2024-05-10T08:41:40.069307+0000","last_peered":"2024-05-10T08:41:40.069307+0000","last_clean":"2024-05-10T08:41:40.069307+0000","last_became_active":"2024-05-10T08:41:38.073047+0000","last_became_peered":"2024-05-10T08:41:38.073047+0000","last_unstale":"2024-05-10T08:41:40.069307+0000","last_undegraded":"2024-05-10T08:41:40.069307+0000","last_fullsized":"2024-05-10T08:41:40.069307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:47:05.771815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088395+0000","last_change":"2024-05-10T08:41:39.083740+0000","last_active":"2024-05-10T08:41:39.088395+0000","last_peered":"2024-05-10T08:41:39.088395+0000","last_clean":"2024-05-10T08:41:39.088395+0000","last_became_active":"2024-05-10T08:41:39.083445+0000","last_became_peered":"2024-05-10T08:41:39.083445+0000","last_unstale":"2024-05-10T08:41:39.088395+0000","last_undegraded":"2024-05-10T08:41:39.088395+0000","last_fullsized":"2024-05-10T08:41:39.088395+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:49.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069499+0000","last_change":"2024-05-10T08:41:38.064170+0000","last_active":"2024-05-10T08:41:40.069499+0000","last_peered":"2024-05-10T08:41:40.069499+0000","last_clean":"2024-05-10T08:41:40.069499+0000","last_became_active":"2024-05-10T08:41:38.063456+0000","last_became_peered":"2024-05-10T08:41:38.063456+0000","last_unstale":"2024-05-10T08:41:40.069499+0000","last_undegraded":"2024-05-10T08:41:40.069499+0000","last_fullsized":"2024-05-10T08:41:40.069499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:09.904487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077868+0000","last_change":"2024-05-10T08:41:39.069422+0000","last_active":"2024-05-10T08:41:39.077868+0000","last_peered":"2024-05-10T08:41:39.077868+0000","last_clean":"2024-05-10T08:41:39.077868+0000","last_became_active":"2024-05-10T08:41:39.069105+0000","last_became_peered":"2024-05-10T08:41:39.069105+0000","last_unstale":"2024-05-10T08:41:39.077868+0000","last_undegraded":"2024-05-10T08:41:39.077868+0000","last_fullsized":"2024-05-10T08:41:39.077868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:40:49.584980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088366+0000","last_change":"2024-05-10T08:41:38.072942+0000","last_active":"2024-05-10T08:41:39.088366+0000","last_peered":"2024-05-10T08:41:39.088366+0000","last_clean":"2024-05-10T08:41:39.088366+0000","last_became_active":"2024-05-10T08:41:38.072627+0000","last_became_peered":"2024-05-10T08:41:38.072627+0000","last_unstale":"2024-05-10T08:41:39.088366+0000","last_undegraded":"2024-05-10T08:41:39.088366+0000","last_fullsized":"2024-05-10T08:41:39.088366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:59.464531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070279+0000","last_change":"2024-05-10T08:41:39.075756+0000","last_active":"2024-05-10T08:41:40.070279+0000","last_peered":"2024-05-10T08:41:40.070279+0000","last_clean":"2024-05-10T08:41:40.070279+0000","last_became_active":"2024-05-10T08:41:39.075114+0000","last_became_peered":"2024-05-10T08:41:39.075114+0000","last_unstale":"2024-05-10T08:41:40.070279+0000","last_undegraded":"2024-05-10T08:41:40.070279+0000","last_fullsized":"2024-05-10T08:41:40.070279+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:47:14.263275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070548+0000","last_change":"2024-05-10T08:41:38.074835+0000","last_active":"2024-05-10T08:41:40.070548+0000","last_peered":"2024-05-10T08:41:40.070548+0000","last_clean":"2024-05-10T08:41:40.070548+0000","last_became_active":"2024-05-10T08:41:38.073139+0000","last_became_peered":"2024-05-10T08:41:38.073139+0000","last_unstale":"2024-05-10T08:41:40.070548+0000","last_undegraded":"2024-05-10T08:41:40.070548+0000","last_fullsized":"2024-05-10T08:41:40.070548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:47:13.260653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084284+0000","last_change":"2024-05-10T08:41:39.080374+0000","last_active":"2024-05-10T08:41:39.084284+0000","last_peered":"2024-05-10T08:41:39.084284+0000","last_clean":"2024-05-10T08:41:39.084284+0000","last_became_active":"2024-05-10T08:41:39.080127+0000","last_became_peered":"2024-05-10T08:41:39.080127+0000","last_unstale":"2024-05-10T08:41:39.084284+0000","last_undegraded":"2024-05-10T08:41:39.084284+0000","last_fullsized":"2024-05-10T08:41:39.084284+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.006313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070208+0000","last_change":"2024-05-10T08:41:38.063775+0000","last_active":"2024-05-10T08:41:40.070208+0000","last_peered":"2024-05-10T08:41:40.070208+0000","last_clean":"2024-05-10T08:41:40.070208+0000","last_became_active":"2024-05-10T08:41:38.063423+0000","last_became_peered":"2024-05-10T08:41:38.063423+0000","last_unstale":"2024-05-10T08:41:40.070208+0000","last_undegraded":"2024-05-10T08:41:40.070208+0000","last_fullsized":"2024-05-10T08:41:40.070208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:57.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077577+0000","last_change":"2024-05-10T08:41:39.070207+0000","last_active":"2024-05-10T08:41:39.077577+0000","last_peered":"2024-05-10T08:41:39.077577+0000","last_clean":"2024-05-10T08:41:39.077577+0000","last_became_active":"2024-05-10T08:41:39.069926+0000","last_became_peered":"2024-05-10T08:41:39.069926+0000","last_unstale":"2024-05-10T08:41:39.077577+0000","last_undegraded":"2024-05-10T08:41:39.077577+0000","last_fullsized":"2024-05-10T08:41:39.077577+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:11.864756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.064353+0000","last_change":"2024-05-10T08:41:38.065525+0000","last_active":"2024-05-10T08:41:39.064353+0000","last_peered":"2024-05-10T08:41:39.064353+0000","last_clean":"2024-05-10T08:41:39.064353+0000","last_became_active":"2024-05-10T08:41:38.065196+0000","last_became_peered":"2024-05-10T08:41:38.065196+0000","last_unstale":"2024-05-10T08:41:39.064353+0000","last_undegraded":"2024-05-10T08:41:39.064353+0000","last_fullsized":"2024-05-10T08:41:39.064353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.247237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084637+0000","last_change":"2024-05-10T08:41:39.081920+0000","last_active":"2024-05-10T08:41:39.084637+0000","last_peered":"2024-05-10T08:41:39.084637+0000","last_clean":"2024-05-10T08:41:39.084637+0000","last_became_active":"2024-05-10T08:41:39.081634+0000","last_became_peered":"2024-05-10T08:41:39.081634+0000","last_unstale":"2024-05-10T08:41:39.084637+0000","last_undegraded":"2024-05-10T08:41:39.084637+0000","last_fullsized":"2024-05-10T08:41:39.084637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:54.644223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070067+0000","last_change":"2024-05-10T08:41:38.075968+0000","last_active":"2024-05-10T08:41:40.070067+0000","last_peered":"2024-05-10T08:41:40.070067+0000","last_clean":"2024-05-10T08:41:40.070067+0000","last_became_active":"2024-05-10T08:41:38.075472+0000","last_became_peered":"2024-05-10T08:41:38.075472+0000","last_unstale":"2024-05-10T08:41:40.070067+0000","last_undegraded":"2024-05-10T08:41:40.070067+0000","last_fullsized":"2024-05-10T08:41:40.070067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:48.852753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070046+0000","last_change":"2024-05-10T08:41:39.075291+0000","last_active":"2024-05-10T08:41:40.070046+0000","last_peered":"2024-05-10T08:41:40.070046+0000","last_clean":"2024-05-10T08:41:40.070046+0000","last_became_active":"2024-05-10T08:41:39.074977+0000","last_became_peered":"2024-05-10T08:41:39.074977+0000","last_unstale":"2024-05-10T08:41:40.070046+0000","last_undegraded":"2024-05-10T08:41:40.070046+0000","last_fullsized":"2024-05-10T08:41:40.070046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:43.482367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.067448+0000","last_change":"2024-05-10T08:41:38.061816+0000","last_active":"2024-05-10T08:41:39.067448+0000","last_peered":"2024-05-10T08:41:39.067448+0000","last_clean":"2024-05-10T08:41:39.067448+0000","last_became_active":"2024-05-10T08:41:38.061321+0000","last_became_peered":"2024-05-10T08:41:38.061321+0000","last_unstale":"2024-05-10T08:41:39.067448+0000","last_undegraded":"2024-05-10T08:41:39.067448+0000","last_fullsized":"2024-05-10T08:41:39.067448+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:42.479745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.075983+0000","last_change":"2024-05-10T08:41:39.073462+0000","last_active":"2024-05-10T08:41:39.075983+0000","last_peered":"2024-05-10T08:41:39.075983+0000","last_clean":"2024-05-10T08:41:39.075983+0000","last_became_active":"2024-05-10T08:41:39.073216+0000","last_became_peered":"2024-05-10T08:41:39.073216+0000","last_unstale":"2024-05-10T08:41:39.075983+0000","last_undegraded":"2024-05-10T08:41:39.075983+0000","last_fullsized":"2024-05-10T08:41:39.075983+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.006313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070319+0000","last_change":"2024-05-10T08:41:38.069643+0000","last_active":"2024-05-10T08:41:40.070319+0000","last_peered":"2024-05-10T08:41:40.070319+0000","last_clean":"2024-05-10T08:41:40.070319+0000","last_became_active":"2024-05-10T08:41:38.069374+0000","last_became_peered":"2024-05-10T08:41:38.069374+0000","last_unstale":"2024-05-10T08:41:40.070319+0000","last_undegraded":"2024-05-10T08:41:40.070319+0000","last_fullsized":"2024-05-10T08:41:40.070319+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:14.718142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070416+0000","last_change":"2024-05-10T08:41:39.085186+0000","last_active":"2024-05-10T08:41:40.070416+0000","last_peered":"2024-05-10T08:41:40.070416+0000","last_clean":"2024-05-10T08:41:40.070416+0000","last_became_active":"2024-05-10T08:41:39.084905+0000","last_became_peered":"2024-05-10T08:41:39.084905+0000","last_unstale":"2024-05-10T08:41:40.070416+0000","last_undegraded":"2024-05-10T08:41:40.070416+0000","last_fullsized":"2024-05-10T08:41:40.070416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:11.864756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.080025+0000","last_change":"2024-05-10T08:41:38.061555+0000","last_active":"2024-05-10T08:41:39.080025+0000","last_peered":"2024-05-10T08:41:39.080025+0000","last_clean":"2024-05-10T08:41:39.080025+0000","last_became_active":"2024-05-10T08:41:38.060965+0000","last_became_peered":"2024-05-10T08:41:38.060965+0000","last_unstale":"2024-05-10T08:41:39.080025+0000","last_undegraded":"2024-05-10T08:41:39.080025+0000","last_fullsized":"2024-05-10T08:41:39.080025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:48.852753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070299+0000","last_change":"2024-05-10T08:41:39.070988+0000","last_active":"2024-05-10T08:41:40.070299+0000","last_peered":"2024-05-10T08:41:40.070299+0000","last_clean":"2024-05-10T08:41:40.070299+0000","last_became_active":"2024-05-10T08:41:39.070659+0000","last_became_peered":"2024-05-10T08:41:39.070659+0000","last_unstale":"2024-05-10T08:41:40.070299+0000","last_undegraded":"2024-05-10T08:41:40.070299+0000","last_fullsized":"2024-05-10T08:41:40.070299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:12.649813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.096359+0000","last_change":"2024-05-10T08:41:38.076969+0000","last_active":"2024-05-10T08:41:39.096359+0000","last_peered":"2024-05-10T08:41:39.096359+0000","last_clean":"2024-05-10T08:41:39.096359+0000","last_became_active":"2024-05-10T08:41:38.076663+0000","last_became_peered":"2024-05-10T08:41:38.076663+0000","last_unstale":"2024-05-10T08:41:39.096359+0000","last_undegraded":"2024-05-10T08:41:39.096359+0000","last_fullsized":"2024-05-10T08:41:39.096359+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:50.377519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.081817+0000","last_change":"2024-05-10T08:41:39.078909+0000","last_active":"2024-05-10T08:41:39.081817+0000","last_peered":"2024-05-10T08:41:39.081817+0000","last_clean":"2024-05-10T08:41:39.081817+0000","last_became_active":"2024-05-10T08:41:39.078619+0000","last_became_peered":"2024-05-10T08:41:39.078619+0000","last_unstale":"2024-05-10T08:41:39.081817+0000","last_undegraded":"2024-05-10T08:41:39.081817+0000","last_fullsized":"2024-05-10T08:41:39.081817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:16.926723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070648+0000","last_change":"2024-05-10T08:41:38.075055+0000","last_active":"2024-05-10T08:41:40.070648+0000","last_peered":"2024-05-10T08:41:40.070648+0000","last_clean":"2024-05-10T08:41:40.070648+0000","last_became_active":"2024-05-10T08:41:38.073766+0000","last_became_peered":"2024-05-10T08:41:38.073766+0000","last_unstale":"2024-05-10T08:41:40.070648+0000","last_undegraded":"2024-05-10T08:41:40.070648+0000","last_fullsized":"2024-05-10T08:41:40.070648+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:42.479745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070734+0000","last_change":"2024-05-10T08:41:39.076973+0000","last_active":"2024-05-10T08:41:40.070734+0000","last_peered":"2024-05-10T08:41:40.070734+0000","last_clean":"2024-05-10T08:41:40.070734+0000","last_became_active":"2024-05-10T08:41:39.074196+0000","last_became_peered":"2024-05-10T08:41:39.074196+0000","last_unstale":"2024-05-10T08:41:40.070734+0000","last_undegraded":"2024-05-10T08:41:40.070734+0000","last_fullsized":"2024-05-10T08:41:40.070734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:45.247838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.066636+0000","last_change":"2024-05-10T08:41:38.071707+0000","last_active":"2024-05-10T08:41:39.066636+0000","last_peered":"2024-05-10T08:41:39.066636+0000","last_clean":"2024-05-10T08:41:39.066636+0000","last_became_active":"2024-05-10T08:41:38.071447+0000","last_became_peered":"2024-05-10T08:41:38.071447+0000","last_unstale":"2024-05-10T08:41:39.066636+0000","last_undegraded":"2024-05-10T08:41:39.066636+0000","last_fullsized":"2024-05-10T08:41:39.066636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:47:05.771815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082738+0000","last_change":"2024-05-10T08:41:39.074211+0000","last_active":"2024-05-10T08:41:39.082738+0000","last_peered":"2024-05-10T08:41:39.082738+0000","last_clean":"2024-05-10T08:41:39.082738+0000","last_became_active":"2024-05-10T08:41:39.073677+0000","last_became_peered":"2024-05-10T08:41:39.073677+0000","last_unstale":"2024-05-10T08:41:39.082738+0000","last_undegraded":"2024-05-10T08:41:39.082738+0000","last_fullsized":"2024-05-10T08:41:39.082738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:35.118376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.062996+0000","last_change":"2024-05-10T08:41:38.063166+0000","last_active":"2024-05-10T08:41:39.062996+0000","last_peered":"2024-05-10T08:41:39.062996+0000","last_clean":"2024-05-10T08:41:39.062996+0000","last_became_active":"2024-05-10T08:41:38.062897+0000","last_became_peered":"2024-05-10T08:41:38.062897+0000","last_unstale":"2024-05-10T08:41:39.062996+0000","last_undegraded":"2024-05-10T08:41:39.062996+0000","last_fullsized":"2024-05-10T08:41:39.062996+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:56.225924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070766+0000","last_change":"2024-05-10T08:41:39.080653+0000","last_active":"2024-05-10T08:41:40.070766+0000","last_peered":"2024-05-10T08:41:40.070766+0000","last_clean":"2024-05-10T08:41:40.070766+0000","last_became_active":"2024-05-10T08:41:39.079824+0000","last_became_peered":"2024-05-10T08:41:39.079824+0000","last_unstale":"2024-05-10T08:41:40.070766+0000","last_undegraded":"2024-05-10T08:41:40.070766+0000","last_fullsized":"2024-05-10T08:41:40.070766+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:03.908737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.087916+0000","last_change":"2024-05-10T08:41:38.075051+0000","last_active":"2024-05-10T08:41:39.087916+0000","last_peered":"2024-05-10T08:41:39.087916+0000","last_clean":"2024-05-10T08:41:39.087916+0000","last_became_active":"2024-05-10T08:41:38.074745+0000","last_became_peered":"2024-05-10T08:41:38.074745+0000","last_unstale":"2024-05-10T08:41:39.087916+0000","last_undegraded":"2024-05-10T08:41:39.087916+0000","last_fullsized":"2024-05-10T08:41:39.087916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:54.448505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.083223+0000","last_change":"2024-05-10T08:41:39.077735+0000","last_active":"2024-05-10T08:41:39.083223+0000","last_peered":"2024-05-10T08:41:39.083223+0000","last_clean":"2024-05-10T08:41:39.083223+0000","last_became_active":"2024-05-10T08:41:39.077365+0000","last_became_peered":"2024-05-10T08:41:39.077365+0000","last_unstale":"2024-05-10T08:41:39.083223+0000","last_undegraded":"2024-05-10T08:41:39.083223+0000","last_fullsized":"2024-05-10T08:41:39.083223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:45.247838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070946+0000","last_change":"2024-05-10T08:41:38.073055+0000","last_active":"2024-05-10T08:41:40.070946+0000","last_peered":"2024-05-10T08:41:40.070946+0000","last_clean":"2024-05-10T08:41:40.070946+0000","last_became_active":"2024-05-10T08:41:38.072719+0000","last_became_peered":"2024-05-10T08:41:38.072719+0000","last_unstale":"2024-05-10T08:41:40.070946+0000","last_undegraded":"2024-05-10T08:41:40.070946+0000","last_fullsized":"2024-05-10T08:41:40.070946+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:11.647191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069181+0000","last_change":"2024-05-10T08:41:39.082877+0000","last_active":"2024-05-10T08:41:40.069181+0000","last_peered":"2024-05-10T08:41:40.069181+0000","last_clean":"2024-05-10T08:41:40.069181+0000","last_became_active":"2024-05-10T08:41:39.082612+0000","last_became_peered":"2024-05-10T08:41:39.082612+0000","last_unstale":"2024-05-10T08:41:40.069181+0000","last_undegraded":"2024-05-10T08:41:40.069181+0000","last_fullsized":"2024-05-10T08:41:40.069181+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:54.644223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077551+0000","last_change":"2024-05-10T08:41:38.063320+0000","last_active":"2024-05-10T08:41:39.077551+0000","last_peered":"2024-05-10T08:41:39.077551+0000","last_clean":"2024-05-10T08:41:39.077551+0000","last_became_active":"2024-05-10T08:41:38.063006+0000","last_became_peered":"2024-05-10T08:41:38.063006+0000","last_unstale":"2024-05-10T08:41:39.077551+0000","last_undegraded":"2024-05-10T08:41:39.077551+0000","last_fullsized":"2024-05-10T08:41:39.077551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:01.451105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070003+0000","last_change":"2024-05-10T08:41:39.077855+0000","last_active":"2024-05-10T08:41:40.070003+0000","last_peered":"2024-05-10T08:41:40.070003+0000","last_clean":"2024-05-10T08:41:40.070003+0000","last_became_active":"2024-05-10T08:41:39.077547+0000","last_became_peered":"2024-05-10T08:41:39.077547+0000","last_unstale":"2024-05-10T08:41:40.070003+0000","last_undegraded":"2024-05-10T08:41:40.070003+0000","last_fullsized":"2024-05-10T08:41:40.070003+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:02.482751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082693+0000","last_change":"2024-05-10T08:41:38.079089+0000","last_active":"2024-05-10T08:41:39.082693+0000","last_peered":"2024-05-10T08:41:39.082693+0000","last_clean":"2024-05-10T08:41:39.082693+0000","last_became_active":"2024-05-10T08:41:38.078865+0000","last_became_peered":"2024-05-10T08:41:38.078865+0000","last_unstale":"2024-05-10T08:41:39.082693+0000","last_undegraded":"2024-05-10T08:41:39.082693+0000","last_fullsized":"2024-05-10T08:41:39.082693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:39.035516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069313+0000","last_change":"2024-05-10T08:41:39.070373+0000","last_active":"2024-05-10T08:41:40.069313+0000","last_peered":"2024-05-10T08:41:40.069313+0000","last_clean":"2024-05-10T08:41:40.069313+0000","last_became_active":"2024-05-10T08:41:39.070092+0000","last_became_peered":"2024-05-10T08:41:39.070092+0000","last_unstale":"2024-05-10T08:41:40.069313+0000","last_undegraded":"2024-05-10T08:41:40.069313+0000","last_fullsized":"2024-05-10T08:41:40.069313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:29.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.062985+0000","last_change":"2024-05-10T08:41:38.073085+0000","last_active":"2024-05-10T08:41:39.062985+0000","last_peered":"2024-05-10T08:41:39.062985+0000","last_clean":"2024-05-10T08:41:39.062985+0000","last_became_active":"2024-05-10T08:41:38.072751+0000","last_became_peered":"2024-05-10T08:41:38.072751+0000","last_unstale":"2024-05-10T08:41:39.062985+0000","last_undegraded":"2024-05-10T08:41:39.062985+0000","last_fullsized":"2024-05-10T08:41:39.062985+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:56.950369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.076478+0000","last_change":"2024-05-10T08:41:39.074172+0000","last_active":"2024-05-10T08:41:39.076478+0000","last_peered":"2024-05-10T08:41:39.076478+0000","last_clean":"2024-05-10T08:41:39.076478+0000","last_became_active":"2024-05-10T08:41:39.073918+0000","last_became_peered":"2024-05-10T08:41:39.073918+0000","last_unstale":"2024-05-10T08:41:39.076478+0000","last_undegraded":"2024-05-10T08:41:39.076478+0000","last_fullsized":"2024-05-10T08:41:39.076478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:54.644223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069288+0000","last_change":"2024-05-10T08:41:38.069651+0000","last_active":"2024-05-10T08:41:40.069288+0000","last_peered":"2024-05-10T08:41:40.069288+0000","last_clean":"2024-05-10T08:41:40.069288+0000","last_became_active":"2024-05-10T08:41:38.067863+0000","last_became_peered":"2024-05-10T08:41:38.067863+0000","last_unstale":"2024-05-10T08:41:40.069288+0000","last_undegraded":"2024-05-10T08:41:40.069288+0000","last_fullsized":"2024-05-10T08:41:40.069288+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:14.718142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088372+0000","last_change":"2024-05-10T08:41:39.083152+0000","last_active":"2024-05-10T08:41:39.088372+0000","last_peered":"2024-05-10T08:41:39.088372+0000","last_clean":"2024-05-10T08:41:39.088372+0000","last_became_active":"2024-05-10T08:41:39.082856+0000","last_became_peered":"2024-05-10T08:41:39.082856+0000","last_unstale":"2024-05-10T08:41:39.088372+0000","last_undegraded":"2024-05-10T08:41:39.088372+0000","last_fullsized":"2024-05-10T08:41:39.088372+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:57.228546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.061026+0000","last_change":"2024-05-10T08:41:38.075695+0000","last_active":"2024-05-10T08:41:39.061026+0000","last_peered":"2024-05-10T08:41:39.061026+0000","last_clean":"2024-05-10T08:41:39.061026+0000","last_became_active":"2024-05-10T08:41:38.075426+0000","last_became_peered":"2024-05-10T08:41:38.075426+0000","last_unstale":"2024-05-10T08:41:39.061026+0000","last_undegraded":"2024-05-10T08:41:39.061026+0000","last_fullsized":"2024-05-10T08:41:39.061026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:02.173487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070588+0000","last_change":"2024-05-10T08:41:39.085961+0000","last_active":"2024-05-10T08:41:40.070588+0000","last_peered":"2024-05-10T08:41:40.070588+0000","last_clean":"2024-05-10T08:41:40.070588+0000","last_became_active":"2024-05-10T08:41:39.085702+0000","last_became_peered":"2024-05-10T08:41:39.085702+0000","last_unstale":"2024-05-10T08:41:40.070588+0000","last_undegraded":"2024-05-10T08:41:40.070588+0000","last_fullsized":"2024-05-10T08:41:40.070588+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:44.726038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070256+0000","last_change":"2024-05-10T08:41:38.079619+0000","last_active":"2024-05-10T08:41:40.070256+0000","last_peered":"2024-05-10T08:41:40.070256+0000","last_clean":"2024-05-10T08:41:40.070256+0000","last_became_active":"2024-05-10T08:41:38.079314+0000","last_became_peered":"2024-05-10T08:41:38.079314+0000","last_unstale":"2024-05-10T08:41:40.070256+0000","last_undegraded":"2024-05-10T08:41:40.070256+0000","last_fullsized":"2024-05-10T08:41:40.070256+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:56.225924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069262+0000","last_change":"2024-05-10T08:41:39.068217+0000","last_active":"2024-05-10T08:41:40.069262+0000","last_peered":"2024-05-10T08:41:40.069262+0000","last_clean":"2024-05-10T08:41:40.069262+0000","last_became_active":"2024-05-10T08:41:39.067948+0000","last_became_peered":"2024-05-10T08:41:39.067948+0000","last_unstale":"2024-05-10T08:41:40.069262+0000","last_undegraded":"2024-05-10T08:41:40.069262+0000","last_fullsized":"2024-05-10T08:41:40.069262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:16.926723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.067258+0000","last_change":"2024-05-10T08:41:38.065390+0000","last_active":"2024-05-10T08:41:39.067258+0000","last_peered":"2024-05-10T08:41:39.067258+0000","last_clean":"2024-05-10T08:41:39.067258+0000","last_became_active":"2024-05-10T08:41:38.064953+0000","last_became_peered":"2024-05-10T08:41:38.064953+0000","last_unstale":"2024-05-10T08:41:39.067258+0000","last_undegraded":"2024-05-10T08:41:39.067258+0000","last_fullsized":"2024-05-10T08:41:39.067258+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:23.297006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088170+0000","last_change":"2024-05-10T08:41:39.083713+0000","last_active":"2024-05-10T08:41:39.088170+0000","last_peered":"2024-05-10T08:41:39.088170+0000","last_clean":"2024-05-10T08:41:39.088170+0000","last_became_active":"2024-05-10T08:41:39.083351+0000","last_became_peered":"2024-05-10T08:41:39.083351+0000","last_unstale":"2024-05-10T08:41:39.088170+0000","last_undegraded":"2024-05-10T08:41:39.088170+0000","last_fullsized":"2024-05-10T08:41:39.088170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:29.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084228+0000","last_change":"2024-05-10T08:41:38.069668+0000","last_active":"2024-05-10T08:41:39.084228+0000","last_peered":"2024-05-10T08:41:39.084228+0000","last_clean":"2024-05-10T08:41:39.084228+0000","last_became_active":"2024-05-10T08:41:38.069389+0000","last_became_peered":"2024-05-10T08:41:38.069389+0000","last_unstale":"2024-05-10T08:41:39.084228+0000","last_undegraded":"2024-05-10T08:41:39.084228+0000","last_fullsized":"2024-05-10T08:41:39.084228+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:57.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069456+0000","last_change":"2024-05-10T08:41:39.069759+0000","last_active":"2024-05-10T08:41:40.069456+0000","last_peered":"2024-05-10T08:41:40.069456+0000","last_clean":"2024-05-10T08:41:40.069456+0000","last_became_active":"2024-05-10T08:41:39.069466+0000","last_became_peered":"2024-05-10T08:41:39.069466+0000","last_unstale":"2024-05-10T08:41:40.069456+0000","last_undegraded":"2024-05-10T08:41:40.069456+0000","last_fullsized":"2024-05-10T08:41:40.069456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:58.041845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.064451+0000","last_change":"2024-05-10T08:41:38.063135+0000","last_active":"2024-05-10T08:41:39.064451+0000","last_peered":"2024-05-10T08:41:39.064451+0000","last_clean":"2024-05-10T08:41:39.064451+0000","last_became_active":"2024-05-10T08:41:38.062639+0000","last_became_peered":"2024-05-10T08:41:38.062639+0000","last_unstale":"2024-05-10T08:41:39.064451+0000","last_undegraded":"2024-05-10T08:41:39.064451+0000","last_fullsized":"2024-05-10T08:41:39.064451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:01.480129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082690+0000","last_change":"2024-05-10T08:41:39.075099+0000","last_active":"2024-05-10T08:41:39.082690+0000","last_peered":"2024-05-10T08:41:39.082690+0000","last_clean":"2024-05-10T08:41:39.082690+0000","last_became_active":"2024-05-10T08:41:39.074685+0000","last_became_peered":"2024-05-10T08:41:39.074685+0000","last_unstale":"2024-05-10T08:41:39.082690+0000","last_undegraded":"2024-05-10T08:41:39.082690+0000","last_fullsized":"2024-05-10T08:41:39.082690+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:44.726038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070696+0000","last_change":"2024-05-10T08:41:38.070182+0000","last_active":"2024-05-10T08:41:40.070696+0000","last_peered":"2024-05-10T08:41:40.070696+0000","last_clean":"2024-05-10T08:41:40.070696+0000","last_became_active":"2024-05-10T08:41:38.069697+0000","last_became_peered":"2024-05-10T08:41:38.069697+0000","last_unstale":"2024-05-10T08:41:40.070696+0000","last_undegraded":"2024-05-10T08:41:40.070696+0000","last_fullsized":"2024-05-10T08:41:40.070696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:18.960295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070824+0000","last_change":"2024-05-10T08:41:39.072792+0000","last_active":"2024-05-10T08:41:40.070824+0000","last_peered":"2024-05-10T08:41:40.070824+0000","last_clean":"2024-05-10T08:41:40.070824+0000","last_became_active":"2024-05-10T08:41:39.072514+0000","last_became_peered":"2024-05-10T08:41:39.072514+0000","last_unstale":"2024-05-10T08:41:40.070824+0000","last_undegraded":"2024-05-10T08:41:40.070824+0000","last_fullsized":"2024-05-10T08:41:40.070824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:41.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.061148+0000","last_change":"2024-05-10T08:41:38.076292+0000","last_active":"2024-05-10T08:41:39.061148+0000","last_peered":"2024-05-10T08:41:39.061148+0000","last_clean":"2024-05-10T08:41:39.061148+0000","last_became_active":"2024-05-10T08:41:38.075994+0000","last_became_peered":"2024-05-10T08:41:38.075994+0000","last_unstale":"2024-05-10T08:41:39.061148+0000","last_undegraded":"2024-05-10T08:41:39.061148+0000","last_fullsized":"2024-05-10T08:41:39.061148+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:13.538680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.079108+0000","last_change":"2024-05-10T08:41:39.077138+0000","last_active":"2024-05-10T08:41:39.079108+0000","last_peered":"2024-05-10T08:41:39.079108+0000","last_clean":"2024-05-10T08:41:39.079108+0000","last_became_active":"2024-05-10T08:41:39.076852+0000","last_became_peered":"2024-05-10T08:41:39.076852+0000","last_unstale":"2024-05-10T08:41:39.079108+0000","last_undegraded":"2024-05-10T08:41:39.079108+0000","last_fullsized":"2024-05-10T08:41:39.079108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:02.956995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.060878+0000","last_change":"2024-05-10T08:41:38.070458+0000","last_active":"2024-05-10T08:41:39.060878+0000","last_peered":"2024-05-10T08:41:39.060878+0000","last_clean":"2024-05-10T08:41:39.060878+0000","last_became_active":"2024-05-10T08:41:38.070164+0000","last_became_peered":"2024-05-10T08:41:38.070164+0000","last_unstale":"2024-05-10T08:41:39.060878+0000","last_undegraded":"2024-05-10T08:41:39.060878+0000","last_fullsized":"2024-05-10T08:41:39.060878+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:34.541342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070722+0000","last_change":"2024-05-10T08:41:39.076816+0000","last_active":"2024-05-10T08:41:40.070722+0000","last_peered":"2024-05-10T08:41:40.070722+0000","last_clean":"2024-05-10T08:41:40.070722+0000","last_became_active":"2024-05-10T08:41:39.076518+0000","last_became_peered":"2024-05-10T08:41:39.076518+0000","last_unstale":"2024-05-10T08:41:40.070722+0000","last_undegraded":"2024-05-10T08:41:40.070722+0000","last_fullsized":"2024-05-10T08:41:40.070722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:17.035446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069897+0000","last_change":"2024-05-10T08:41:38.072741+0000","last_active":"2024-05-10T08:41:40.069897+0000","last_peered":"2024-05-10T08:41:40.069897+0000","last_clean":"2024-05-10T08:41:40.069897+0000","last_became_active":"2024-05-10T08:41:38.072382+0000","last_became_peered":"2024-05-10T08:41:38.072382+0000","last_unstale":"2024-05-10T08:41:40.069897+0000","last_undegraded":"2024-05-10T08:41:40.069897+0000","last_fullsized":"2024-05-10T08:41:40.069897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:47:05.771815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077414+0000","last_change":"2024-05-10T08:41:39.069866+0000","last_active":"2024-05-10T08:41:39.077414+0000","last_peered":"2024-05-10T08:41:39.077414+0000","last_clean":"2024-05-10T08:41:39.077414+0000","last_became_active":"2024-05-10T08:41:39.069537+0000","last_became_peered":"2024-05-10T08:41:39.069537+0000","last_unstale":"2024-05-10T08:41:39.077414+0000","last_undegraded":"2024-05-10T08:41:39.077414+0000","last_fullsized":"2024-05-10T08:41:39.077414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:57.443438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.063504+0000","last_change":"2024-05-10T08:41:38.079465+0000","last_active":"2024-05-10T08:41:39.063504+0000","last_peered":"2024-05-10T08:41:39.063504+0000","last_clean":"2024-05-10T08:41:39.063504+0000","last_became_active":"2024-05-10T08:41:38.079163+0000","last_became_peered":"2024-05-10T08:41:38.079163+0000","last_unstale":"2024-05-10T08:41:39.063504+0000","last_undegraded":"2024-05-10T08:41:39.063504+0000","last_fullsized":"2024-05-10T08:41:39.063504+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:47.378165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088332+0000","last_change":"2024-05-10T08:41:39.082765+0000","last_active":"2024-05-10T08:41:39.088332+0000","last_peered":"2024-05-10T08:41:39.088332+0000","last_clean":"2024-05-10T08:41:39.088332+0000","last_became_active":"2024-05-10T08:41:39.082235+0000","last_became_peered":"2024-05-10T08:41:39.082235+0000","last_unstale":"2024-05-10T08:41:39.088332+0000","last_undegraded":"2024-05-10T08:41:39.088332+0000","last_fullsized":"2024-05-10T08:41:39.088332+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:19.962917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070770+0000","last_change":"2024-05-10T08:41:38.073819+0000","last_active":"2024-05-10T08:41:40.070770+0000","last_peered":"2024-05-10T08:41:40.070770+0000","last_clean":"2024-05-10T08:41:40.070770+0000","last_became_active":"2024-05-10T08:41:38.073442+0000","last_became_peered":"2024-05-10T08:41:38.073442+0000","last_unstale":"2024-05-10T08:41:40.070770+0000","last_undegraded":"2024-05-10T08:41:40.070770+0000","last_fullsized":"2024-05-10T08:41:40.070770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:01.480129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":160,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.065376+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:41:39.065376+0000","last_peered":"2024-05-10T08:41:39.065376+0000","last_clean":"2024-05-10T08:41:39.065376+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:41:39.065376+0000","last_undegraded":"2024-05-10T08:41:39.065376+0000","last_fullsized":"2024-05-10T08:41:39.065376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1171456,"data_stored":839081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":249241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":569344,"data_stored":248589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":255863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":250223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":250201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":248749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1171456,"data_stored":839013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:41:43.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:41:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.249+0000 7f33a391c640 1 Processor -- start 2024-05-10T08:41:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.249+0000 7f33a391c640 1 -- start start 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a391c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f339c1629a0 0x7f339c0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a391c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f339c0d0cb0 0x7f339c0d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a391c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f339c0d3330 con 0x7f339c0d2dc0 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a391c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f339c0d2170 con 0x7f339c1629a0 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a391c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f339c0d2450 con 0x7f339c0d0cb0 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a16b8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f339c1629a0 0x7f339c0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a0eb7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f339c0d2dc0 0x7f339c0c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44234/0 (socket says 172.21.15.37:44234) 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a0eb7640 1 -- 172.21.15.37:0/1109754036 learned_addr learned my addr 172.21.15.37:0/1109754036 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a1eb9640 1 --2- 172.21.15.37:0/1109754036 >> v2:172.21.15.82:3300/0 conn(0x7f339c0d0cb0 0x7f339c0d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a16b8640 1 -- 172.21.15.37:0/1109754036 >> v2:172.21.15.82:3300/0 conn(0x7f339c0d0cb0 msgr2=0x7f339c0d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a16b8640 1 --2- 172.21.15.37:0/1109754036 >> v2:172.21.15.82:3300/0 conn(0x7f339c0d0cb0 0x7f339c0d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a16b8640 1 -- 172.21.15.37:0/1109754036 >> v1:172.21.15.37:6789/0 conn(0x7f339c0d2dc0 legacy=0x7f339c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.250+0000 7f33a16b8640 1 -- 172.21.15.37:0/1109754036 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c0d2730 con 0x7f339c1629a0 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.251+0000 7f33a16b8640 1 --2- 172.21.15.37:0/1109754036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d35c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f339c08e380 tx=0x7f339802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128c1a430df283f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.251+0000 7f3393fff640 1 -- 172.21.15.37:0/1109754036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398037070 con 0x7f339c1629a0 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.251+0000 7f3393fff640 1 -- 172.21.15.37:0/1109754036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339802add0 con 0x7f339c1629a0 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.251+0000 7f3393fff640 1 -- 172.21.15.37:0/1109754036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398032660 con 0x7f339c1629a0 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 -- 172.21.15.37:0/1109754036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 msgr2=0x7f339c0d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 --2- 172.21.15.37:0/1109754036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d35c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f339c08e380 tx=0x7f339802a080 comp rx=0 tx=0).stop 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 -- 172.21.15.37:0/1109754036 shutdown_connections 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 --2- 172.21.15.37:0/1109754036 >> v2:172.21.15.82:3300/0 conn(0x7f339c0d0cb0 0x7f339c0d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 --2- 172.21.15.37:0/1109754036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d35c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 -- 172.21.15.37:0/1109754036 >> 172.21.15.37:0/1109754036 conn(0x7f339c0d4fe0 msgr2=0x7f339c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:43.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 -- 172.21.15.37:0/1109754036 shutdown_connections 2024-05-10T08:41:43.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.252+0000 7f33a391c640 1 -- 172.21.15.37:0/1109754036 wait complete. 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.253+0000 7f33a391c640 1 Processor -- start 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.253+0000 7f33a391c640 1 -- start start 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a391c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c0d0cb0 0x7f339c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a391c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f339c0d2dc0 0x7f339c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a391c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a391c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f339c0cf440 con 0x7f339c1629a0 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a391c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f339c0cf2c0 con 0x7f339c0d0cb0 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a391c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f339c0c95e0 con 0x7f339c0d2dc0 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44414/0 (socket says 172.21.15.37:44414) 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 -- 172.21.15.37:0/1373919777 learned_addr learned my addr 172.21.15.37:0/1373919777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a0eb7640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f339c0d2dc0 0x7f339c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a16b8640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c0d0cb0 0x7f339c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 -- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f339c0d2dc0 msgr2=0x7f339c0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f339c0d2dc0 0x7f339c0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 -- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c0d0cb0 msgr2=0x7f339c14f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c0d0cb0 0x7f339c14f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a1eb9640 1 -- 172.21.15.37:0/1373919777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c0ccfc0 con 0x7f339c1629a0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a16b8640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c0d0cb0 0x7f339c14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.254+0000 7f33a0eb7640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f339c0d2dc0 0x7f339c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.255+0000 7f33a1eb9640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d3cc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3394007e40 tx=0x7f339400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.255+0000 7f3391ffb640 1 -- 172.21.15.37:0/1373919777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394014620 con 0x7f339c1629a0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.255+0000 7f3391ffb640 1 -- 172.21.15.37:0/1373919777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3394019070 con 0x7f339c1629a0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.255+0000 7f3391ffb640 1 -- 172.21.15.37:0/1373919777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394014a20 con 0x7f339c1629a0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.255+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339c0cca00 con 0x7f339c1629a0 2024-05-10T08:41:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.255+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339c0b7ca0 con 0x7f339c1629a0 2024-05-10T08:41:43.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.256+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339c0693f0 con 0x7f339c1629a0 2024-05-10T08:41:43.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.256+0000 7f3391ffb640 1 -- 172.21.15.37:0/1373919777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3394014bc0 con 0x7f339c1629a0 2024-05-10T08:41:43.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.257+0000 7f3391ffb640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33800762d0 0x7f3380078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.257+0000 7f3391ffb640 1 -- 172.21.15.37:0/1373919777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f33940980b0 con 0x7f339c1629a0 2024-05-10T08:41:43.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.257+0000 7f33a16b8640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33800762d0 0x7f3380078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.258+0000 7f33a16b8640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33800762d0 0x7f3380078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3398034000 tx=0x7f339802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:43.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.261+0000 7f3391ffb640 1 -- 172.21.15.37:0/1373919777 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3394061880 con 0x7f339c1629a0 2024-05-10T08:41:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.449+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f339c0c9c20 con 0x7f33800762d0 2024-05-10T08:41:43.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.455+0000 7f3391ffb640 1 -- 172.21.15.37:0/1373919777 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251905 (secure 0 0 0) 0x7f339c0c9c20 con 0x7f33800762d0 2024-05-10T08:41:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:43.459 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:41:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33800762d0 msgr2=0x7f3380078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33800762d0 0x7f3380078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3398034000 tx=0x7f339802e000 comp rx=0 tx=0).stop 2024-05-10T08:41:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 msgr2=0x7f339c0d3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d3cc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3394007e40 tx=0x7f339400e4b0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 shutdown_connections 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33800762d0 0x7f3380078790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f339c1629a0 0x7f339c0d3cc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f339c0d2dc0 0x7f339c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 --2- 172.21.15.37:0/1373919777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c0d0cb0 0x7f339c14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 >> 172.21.15.37:0/1373919777 conn(0x7f339c0d4fe0 msgr2=0x7f339c06e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 shutdown_connections 2024-05-10T08:41:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.458+0000 7f33a391c640 1 -- 172.21.15.37:0/1373919777 wait complete. 2024-05-10T08:41:43.469 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-05-10T08:41:43.345181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221872,"kb_used_data":5684,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752848,"statfs":{"total":773094113280,"available":772866916352,"internally_reserved":0,"allocated":5820416,"data_stored":3180960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069381+0000","last_change":"2024-05-10T08:41:39.066597+0000","last_active":"2024-05-10T08:41:40.069381+0000","last_peered":"2024-05-10T08:41:40.069381+0000","last_clean":"2024-05-10T08:41:40.069381+0000","last_became_active":"2024-05-10T08:41:39.066342+0000","last_became_peered":"2024-05-10T08:41:39.066342+0000","last_unstale":"2024-05-10T08:41:40.069381+0000","last_undegraded":"2024-05-10T08:41:40.069381+0000","last_fullsized":"2024-05-10T08:41:40.069381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:20.859498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.083016+0000","last_change":"2024-05-10T08:41:39.077126+0000","last_active":"2024-05-10T08:41:39.083016+0000","last_peered":"2024-05-10T08:41:39.083016+0000","last_clean":"2024-05-10T08:41:39.083016+0000","last_became_active":"2024-05-10T08:41:39.076298+0000","last_became_peered":"2024-05-10T08:41:39.076298+0000","last_unstale":"2024-05-10T08:41:39.083016+0000","last_undegraded":"2024-05-10T08:41:39.083016+0000","last_fullsized":"2024-05-10T08:41:39.083016+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:22:00.467154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070372+0000","last_change":"2024-05-10T08:41:39.073652+0000","last_active":"2024-05-10T08:41:40.070372+0000","last_peered":"2024-05-10T08:41:40.070372+0000","last_clean":"2024-05-10T08:41:40.070372+0000","last_became_active":"2024-05-10T08:41:39.073384+0000","last_became_peered":"2024-05-10T08:41:39.073384+0000","last_unstale":"2024-05-10T08:41:40.070372+0000","last_undegraded":"2024-05-10T08:41:40.070372+0000","last_fullsized":"2024-05-10T08:41:40.070372+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:57.443438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077913+0000","last_change":"2024-05-10T08:41:39.072236+0000","last_active":"2024-05-10T08:41:39.077913+0000","last_peered":"2024-05-10T08:41:39.077913+0000","last_clean":"2024-05-10T08:41:39.077913+0000","last_became_active":"2024-05-10T08:41:39.071953+0000","last_became_peered":"2024-05-10T08:41:39.071953+0000","last_unstale":"2024-05-10T08:41:39.077913+0000","last_undegraded":"2024-05-10T08:41:39.077913+0000","last_fullsized":"2024-05-10T08:41:39.077913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:47:14.263275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070308+0000","last_change":"2024-05-10T08:41:39.066586+0000","last_active":"2024-05-10T08:41:40.070308+0000","last_peered":"2024-05-10T08:41:40.070308+0000","last_clean":"2024-05-10T08:41:40.070308+0000","last_became_active":"2024-05-10T08:41:39.066276+0000","last_became_peered":"2024-05-10T08:41:39.066276+0000","last_unstale":"2024-05-10T08:41:40.070308+0000","last_undegraded":"2024-05-10T08:41:40.070308+0000","last_fullsized":"2024-05-10T08:41:40.070308+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:48.380787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069431+0000","last_change":"2024-05-10T08:41:39.071191+0000","last_active":"2024-05-10T08:41:40.069431+0000","last_peered":"2024-05-10T08:41:40.069431+0000","last_clean":"2024-05-10T08:41:40.069431+0000","last_became_active":"2024-05-10T08:41:39.070906+0000","last_became_peered":"2024-05-10T08:41:39.070906+0000","last_unstale":"2024-05-10T08:41:40.069431+0000","last_undegraded":"2024-05-10T08:41:40.069431+0000","last_fullsized":"2024-05-10T08:41:40.069431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:49.047140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070166+0000","last_change":"2024-05-10T08:41:39.078449+0000","last_active":"2024-05-10T08:41:40.070166+0000","last_peered":"2024-05-10T08:41:40.070166+0000","last_clean":"2024-05-10T08:41:40.070166+0000","last_became_active":"2024-05-10T08:41:39.076962+0000","last_became_peered":"2024-05-10T08:41:39.076962+0000","last_unstale":"2024-05-10T08:41:40.070166+0000","last_undegraded":"2024-05-10T08:41:40.070166+0000","last_fullsized":"2024-05-10T08:41:40.070166+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:51.380141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088559+0000","last_change":"2024-05-10T08:41:39.082308+0000","last_active":"2024-05-10T08:41:39.088559+0000","last_peered":"2024-05-10T08:41:39.088559+0000","last_clean":"2024-05-10T08:41:39.088559+0000","last_became_active":"2024-05-10T08:41:39.081961+0000","last_became_peered":"2024-05-10T08:41:39.081961+0000","last_unstale":"2024-05-10T08:41:39.088559+0000","last_undegraded":"2024-05-10T08:41:39.088559+0000","last_fullsized":"2024-05-10T08:41:39.088559+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:03.908737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088499+0000","last_change":"2024-05-10T08:41:39.083006+0000","last_active":"2024-05-10T08:41:39.088499+0000","last_peered":"2024-05-10T08:41:39.088499+0000","last_clean":"2024-05-10T08:41:39.088499+0000","last_became_active":"2024-05-10T08:41:39.081602+0000","last_became_peered":"2024-05-10T08:41:39.081602+0000","last_unstale":"2024-05-10T08:41:39.088499+0000","last_undegraded":"2024-05-10T08:41:39.088499+0000","last_fullsized":"2024-05-10T08:41:39.088499+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:57.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069435+0000","last_change":"2024-05-10T08:41:39.070830+0000","last_active":"2024-05-10T08:41:40.069435+0000","last_peered":"2024-05-10T08:41:40.069435+0000","last_clean":"2024-05-10T08:41:40.069435+0000","last_became_active":"2024-05-10T08:41:39.070529+0000","last_became_peered":"2024-05-10T08:41:39.070529+0000","last_unstale":"2024-05-10T08:41:40.069435+0000","last_undegraded":"2024-05-10T08:41:40.069435+0000","last_fullsized":"2024-05-10T08:41:40.069435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:15.558195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077397+0000","last_change":"2024-05-10T08:41:39.075833+0000","last_active":"2024-05-10T08:41:39.077397+0000","last_peered":"2024-05-10T08:41:39.077397+0000","last_clean":"2024-05-10T08:41:39.077397+0000","last_became_active":"2024-05-10T08:41:39.075538+0000","last_became_peered":"2024-05-10T08:41:39.075538+0000","last_unstale":"2024-05-10T08:41:39.077397+0000","last_undegraded":"2024-05-10T08:41:39.077397+0000","last_fullsized":"2024-05-10T08:41:39.077397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:18:42.944268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.089296+0000","last_change":"2024-05-10T08:41:39.087549+0000","last_active":"2024-05-10T08:41:39.089296+0000","last_peered":"2024-05-10T08:41:39.089296+0000","last_clean":"2024-05-10T08:41:39.089296+0000","last_became_active":"2024-05-10T08:41:39.087123+0000","last_became_peered":"2024-05-10T08:41:39.087123+0000","last_unstale":"2024-05-10T08:41:39.089296+0000","last_undegraded":"2024-05-10T08:41:39.089296+0000","last_fullsized":"2024-05-10T08:41:39.089296+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:41.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069164+0000","last_change":"2024-05-10T08:41:39.073614+0000","last_active":"2024-05-10T08:41:40.069164+0000","last_peered":"2024-05-10T08:41:40.069164+0000","last_clean":"2024-05-10T08:41:40.069164+0000","last_became_active":"2024-05-10T08:41:39.073356+0000","last_became_peered":"2024-05-10T08:41:39.073356+0000","last_unstale":"2024-05-10T08:41:40.069164+0000","last_undegraded":"2024-05-10T08:41:40.069164+0000","last_fullsized":"2024-05-10T08:41:40.069164+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.006313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070510+0000","last_change":"2024-05-10T08:41:39.076189+0000","last_active":"2024-05-10T08:41:40.070510+0000","last_peered":"2024-05-10T08:41:40.070510+0000","last_clean":"2024-05-10T08:41:40.070510+0000","last_became_active":"2024-05-10T08:41:39.075810+0000","last_became_peered":"2024-05-10T08:41:39.075810+0000","last_unstale":"2024-05-10T08:41:40.070510+0000","last_undegraded":"2024-05-10T08:41:40.070510+0000","last_fullsized":"2024-05-10T08:41:40.070510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:18.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.085436+0000","last_change":"2024-05-10T08:41:39.083194+0000","last_active":"2024-05-10T08:41:39.085436+0000","last_peered":"2024-05-10T08:41:39.085436+0000","last_clean":"2024-05-10T08:41:39.085436+0000","last_became_active":"2024-05-10T08:41:39.082924+0000","last_became_peered":"2024-05-10T08:41:39.082924+0000","last_unstale":"2024-05-10T08:41:39.085436+0000","last_undegraded":"2024-05-10T08:41:39.085436+0000","last_fullsized":"2024-05-10T08:41:39.085436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:02.956995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069046+0000","last_change":"2024-05-10T08:41:39.063291+0000","last_active":"2024-05-10T08:41:40.069046+0000","last_peered":"2024-05-10T08:41:40.069046+0000","last_clean":"2024-05-10T08:41:40.069046+0000","last_became_active":"2024-05-10T08:41:39.063006+0000","last_became_peered":"2024-05-10T08:41:39.063006+0000","last_unstale":"2024-05-10T08:41:40.069046+0000","last_undegraded":"2024-05-10T08:41:40.069046+0000","last_fullsized":"2024-05-10T08:41:40.069046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:10.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070863+0000","last_change":"2024-05-10T08:41:39.080430+0000","last_active":"2024-05-10T08:41:40.070863+0000","last_peered":"2024-05-10T08:41:40.070863+0000","last_clean":"2024-05-10T08:41:40.070863+0000","last_became_active":"2024-05-10T08:41:39.079532+0000","last_became_peered":"2024-05-10T08:41:39.079532+0000","last_unstale":"2024-05-10T08:41:40.070863+0000","last_undegraded":"2024-05-10T08:41:40.070863+0000","last_fullsized":"2024-05-10T08:41:40.070863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:06:09.345277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084611+0000","last_change":"2024-05-10T08:41:39.077900+0000","last_active":"2024-05-10T08:41:39.084611+0000","last_peered":"2024-05-10T08:41:39.084611+0000","last_clean":"2024-05-10T08:41:39.084611+0000","last_became_active":"2024-05-10T08:41:39.076671+0000","last_became_peered":"2024-05-10T08:41:39.076671+0000","last_unstale":"2024-05-10T08:41:39.084611+0000","last_undegraded":"2024-05-10T08:41:39.084611+0000","last_fullsized":"2024-05-10T08:41:39.084611+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:10.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070538+0000","last_change":"2024-05-10T08:41:39.073002+0000","last_active":"2024-05-10T08:41:40.070538+0000","last_peered":"2024-05-10T08:41:40.070538+0000","last_clean":"2024-05-10T08:41:40.070538+0000","last_became_active":"2024-05-10T08:41:39.072183+0000","last_became_peered":"2024-05-10T08:41:39.072183+0000","last_unstale":"2024-05-10T08:41:40.070538+0000","last_undegraded":"2024-05-10T08:41:40.070538+0000","last_fullsized":"2024-05-10T08:41:40.070538+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:35.118376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088443+0000","last_change":"2024-05-10T08:41:39.082515+0000","last_active":"2024-05-10T08:41:39.088443+0000","last_peered":"2024-05-10T08:41:39.088443+0000","last_clean":"2024-05-10T08:41:39.088443+0000","last_became_active":"2024-05-10T08:41:39.082192+0000","last_became_peered":"2024-05-10T08:41:39.082192+0000","last_unstale":"2024-05-10T08:41:39.088443+0000","last_undegraded":"2024-05-10T08:41:39.088443+0000","last_fullsized":"2024-05-10T08:41:39.088443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:10.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.085251+0000","last_change":"2024-05-10T08:41:39.076984+0000","last_active":"2024-05-10T08:41:39.085251+0000","last_peered":"2024-05-10T08:41:39.085251+0000","last_clean":"2024-05-10T08:41:39.085251+0000","last_became_active":"2024-05-10T08:41:39.076713+0000","last_became_peered":"2024-05-10T08:41:39.076713+0000","last_unstale":"2024-05-10T08:41:39.085251+0000","last_undegraded":"2024-05-10T08:41:39.085251+0000","last_fullsized":"2024-05-10T08:41:39.085251+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:15.720764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084343+0000","last_change":"2024-05-10T08:41:39.082044+0000","last_active":"2024-05-10T08:41:39.084343+0000","last_peered":"2024-05-10T08:41:39.084343+0000","last_clean":"2024-05-10T08:41:39.084343+0000","last_became_active":"2024-05-10T08:41:39.081234+0000","last_became_peered":"2024-05-10T08:41:39.081234+0000","last_unstale":"2024-05-10T08:41:39.084343+0000","last_undegraded":"2024-05-10T08:41:39.084343+0000","last_fullsized":"2024-05-10T08:41:39.084343+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:17.035446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.076123+0000","last_change":"2024-05-10T08:41:39.073403+0000","last_active":"2024-05-10T08:41:39.076123+0000","last_peered":"2024-05-10T08:41:39.076123+0000","last_clean":"2024-05-10T08:41:39.076123+0000","last_became_active":"2024-05-10T08:41:39.073119+0000","last_became_peered":"2024-05-10T08:41:39.073119+0000","last_unstale":"2024-05-10T08:41:39.076123+0000","last_undegraded":"2024-05-10T08:41:39.076123+0000","last_fullsized":"2024-05-10T08:41:39.076123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:48.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070055+0000","last_change":"2024-05-10T08:41:39.080116+0000","last_active":"2024-05-10T08:41:40.070055+0000","last_peered":"2024-05-10T08:41:40.070055+0000","last_clean":"2024-05-10T08:41:40.070055+0000","last_became_active":"2024-05-10T08:41:39.078069+0000","last_became_peered":"2024-05-10T08:41:39.078069+0000","last_unstale":"2024-05-10T08:41:40.070055+0000","last_undegraded":"2024-05-10T08:41:40.070055+0000","last_fullsized":"2024-05-10T08:41:40.070055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:55.451128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070916+0000","last_change":"2024-05-10T08:41:39.080200+0000","last_active":"2024-05-10T08:41:40.070916+0000","last_peered":"2024-05-10T08:41:40.070916+0000","last_clean":"2024-05-10T08:41:40.070916+0000","last_became_active":"2024-05-10T08:41:39.079220+0000","last_became_peered":"2024-05-10T08:41:39.079220+0000","last_unstale":"2024-05-10T08:41:40.070916+0000","last_undegraded":"2024-05-10T08:41:40.070916+0000","last_fullsized":"2024-05-10T08:41:40.070916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:33.274834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082713+0000","last_change":"2024-05-10T08:41:39.073974+0000","last_active":"2024-05-10T08:41:39.082713+0000","last_peered":"2024-05-10T08:41:39.082713+0000","last_clean":"2024-05-10T08:41:39.082713+0000","last_became_active":"2024-05-10T08:41:39.073312+0000","last_became_peered":"2024-05-10T08:41:39.073312+0000","last_unstale":"2024-05-10T08:41:39.082713+0000","last_undegraded":"2024-05-10T08:41:39.082713+0000","last_fullsized":"2024-05-10T08:41:39.082713+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:18.313610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069219+0000","last_change":"2024-05-10T08:41:39.082222+0000","last_active":"2024-05-10T08:41:40.069219+0000","last_peered":"2024-05-10T08:41:40.069219+0000","last_clean":"2024-05-10T08:41:40.069219+0000","last_became_active":"2024-05-10T08:41:39.081952+0000","last_became_peered":"2024-05-10T08:41:39.081952+0000","last_unstale":"2024-05-10T08:41:40.069219+0000","last_undegraded":"2024-05-10T08:41:40.069219+0000","last_fullsized":"2024-05-10T08:41:40.069219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:02.956995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088462+0000","last_change":"2024-05-10T08:41:39.082553+0000","last_active":"2024-05-10T08:41:39.088462+0000","last_peered":"2024-05-10T08:41:39.088462+0000","last_clean":"2024-05-10T08:41:39.088462+0000","last_became_active":"2024-05-10T08:41:39.082126+0000","last_became_peered":"2024-05-10T08:41:39.082126+0000","last_unstale":"2024-05-10T08:41:39.088462+0000","last_undegraded":"2024-05-10T08:41:39.088462+0000","last_fullsized":"2024-05-10T08:41:39.088462+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:04.980074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070769+0000","last_change":"2024-05-10T08:41:39.085154+0000","last_active":"2024-05-10T08:41:40.070769+0000","last_peered":"2024-05-10T08:41:40.070769+0000","last_clean":"2024-05-10T08:41:40.070769+0000","last_became_active":"2024-05-10T08:41:39.084859+0000","last_became_peered":"2024-05-10T08:41:39.084859+0000","last_unstale":"2024-05-10T08:41:40.070769+0000","last_undegraded":"2024-05-10T08:41:40.070769+0000","last_fullsized":"2024-05-10T08:41:40.070769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:57.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.075782+0000","last_change":"2024-05-10T08:41:39.073570+0000","last_active":"2024-05-10T08:41:39.075782+0000","last_peered":"2024-05-10T08:41:39.075782+0000","last_clean":"2024-05-10T08:41:39.075782+0000","last_became_active":"2024-05-10T08:41:39.072822+0000","last_became_peered":"2024-05-10T08:41:39.072822+0000","last_unstale":"2024-05-10T08:41:39.075782+0000","last_undegraded":"2024-05-10T08:41:39.075782+0000","last_fullsized":"2024-05-10T08:41:39.075782+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:12.649813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070243+0000","last_change":"2024-05-10T08:41:39.078226+0000","last_active":"2024-05-10T08:41:40.070243+0000","last_peered":"2024-05-10T08:41:40.070243+0000","last_clean":"2024-05-10T08:41:40.070243+0000","last_became_active":"2024-05-10T08:41:39.076643+0000","last_became_peered":"2024-05-10T08:41:39.076643+0000","last_unstale":"2024-05-10T08:41:40.070243+0000","last_undegraded":"2024-05-10T08:41:40.070243+0000","last_fullsized":"2024-05-10T08:41:40.070243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:40:49.584980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088209+0000","last_change":"2024-05-10T08:41:39.083951+0000","last_active":"2024-05-10T08:41:39.088209+0000","last_peered":"2024-05-10T08:41:39.088209+0000","last_clean":"2024-05-10T08:41:39.088209+0000","last_became_active":"2024-05-10T08:41:39.083674+0000","last_became_peered":"2024-05-10T08:41:39.083674+0000","last_unstale":"2024-05-10T08:41:39.088209+0000","last_undegraded":"2024-05-10T08:41:39.088209+0000","last_fullsized":"2024-05-10T08:41:39.088209+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:20.859498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082613+0000","last_change":"2024-05-10T08:41:39.076429+0000","last_active":"2024-05-10T08:41:39.082613+0000","last_peered":"2024-05-10T08:41:39.082613+0000","last_clean":"2024-05-10T08:41:39.082613+0000","last_became_active":"2024-05-10T08:41:39.076146+0000","last_became_peered":"2024-05-10T08:41:39.076146+0000","last_unstale":"2024-05-10T08:41:39.082613+0000","last_undegraded":"2024-05-10T08:41:39.082613+0000","last_fullsized":"2024-05-10T08:41:39.082613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:48.380787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.083638+0000","last_change":"2024-05-10T08:41:38.063512+0000","last_active":"2024-05-10T08:41:39.083638+0000","last_peered":"2024-05-10T08:41:39.083638+0000","last_clean":"2024-05-10T08:41:39.083638+0000","last_became_active":"2024-05-10T08:41:38.063246+0000","last_became_peered":"2024-05-10T08:41:38.063246+0000","last_unstale":"2024-05-10T08:41:39.083638+0000","last_undegraded":"2024-05-10T08:41:39.083638+0000","last_fullsized":"2024-05-10T08:41:39.083638+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:15:12.086903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.075964+0000","last_change":"2024-05-10T08:41:39.072448+0000","last_active":"2024-05-10T08:41:39.075964+0000","last_peered":"2024-05-10T08:41:39.075964+0000","last_clean":"2024-05-10T08:41:39.075964+0000","last_became_active":"2024-05-10T08:41:39.072200+0000","last_became_peered":"2024-05-10T08:41:39.072200+0000","last_unstale":"2024-05-10T08:41:39.075964+0000","last_undegraded":"2024-05-10T08:41:39.075964+0000","last_fullsized":"2024-05-10T08:41:39.075964+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:10.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069307+0000","last_change":"2024-05-10T08:41:38.073332+0000","last_active":"2024-05-10T08:41:40.069307+0000","last_peered":"2024-05-10T08:41:40.069307+0000","last_clean":"2024-05-10T08:41:40.069307+0000","last_became_active":"2024-05-10T08:41:38.073047+0000","last_became_peered":"2024-05-10T08:41:38.073047+0000","last_unstale":"2024-05-10T08:41:40.069307+0000","last_undegraded":"2024-05-10T08:41:40.069307+0000","last_fullsized":"2024-05-10T08:41:40.069307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:47:05.771815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088395+0000","last_change":"2024-05-10T08:41:39.083740+0000","last_active":"2024-05-10T08:41:39.088395+0000","last_peered":"2024-05-10T08:41:39.088395+0000","last_clean":"2024-05-10T08:41:39.088395+0000","last_became_active":"2024-05-10T08:41:39.083445+0000","last_became_peered":"2024-05-10T08:41:39.083445+0000","last_unstale":"2024-05-10T08:41:39.088395+0000","last_undegraded":"2024-05-10T08:41:39.088395+0000","last_fullsized":"2024-05-10T08:41:39.088395+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:49.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069499+0000","last_change":"2024-05-10T08:41:38.064170+0000","last_active":"2024-05-10T08:41:40.069499+0000","last_peered":"2024-05-10T08:41:40.069499+0000","last_clean":"2024-05-10T08:41:40.069499+0000","last_became_active":"2024-05-10T08:41:38.063456+0000","last_became_peered":"2024-05-10T08:41:38.063456+0000","last_unstale":"2024-05-10T08:41:40.069499+0000","last_undegraded":"2024-05-10T08:41:40.069499+0000","last_fullsized":"2024-05-10T08:41:40.069499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:09.904487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077868+0000","last_change":"2024-05-10T08:41:39.069422+0000","last_active":"2024-05-10T08:41:39.077868+0000","last_peered":"2024-05-10T08:41:39.077868+0000","last_clean":"2024-05-10T08:41:39.077868+0000","last_became_active":"2024-05-10T08:41:39.069105+0000","last_became_peered":"2024-05-10T08:41:39.069105+0000","last_unstale":"2024-05-10T08:41:39.077868+0000","last_undegraded":"2024-05-10T08:41:39.077868+0000","last_fullsized":"2024-05-10T08:41:39.077868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:40:49.584980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088366+0000","last_change":"2024-05-10T08:41:38.072942+0000","last_active":"2024-05-10T08:41:39.088366+0000","last_peered":"2024-05-10T08:41:39.088366+0000","last_clean":"2024-05-10T08:41:39.088366+0000","last_became_active":"2024-05-10T08:41:38.072627+0000","last_became_peered":"2024-05-10T08:41:38.072627+0000","last_unstale":"2024-05-10T08:41:39.088366+0000","last_undegraded":"2024-05-10T08:41:39.088366+0000","last_fullsized":"2024-05-10T08:41:39.088366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:59.464531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070279+0000","last_change":"2024-05-10T08:41:39.075756+0000","last_active":"2024-05-10T08:41:40.070279+0000","last_peered":"2024-05-10T08:41:40.070279+0000","last_clean":"2024-05-10T08:41:40.070279+0000","last_became_active":"2024-05-10T08:41:39.075114+0000","last_became_peered":"2024-05-10T08:41:39.075114+0000","last_unstale":"2024-05-10T08:41:40.070279+0000","last_undegraded":"2024-05-10T08:41:40.070279+0000","last_fullsized":"2024-05-10T08:41:40.070279+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:47:14.263275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070548+0000","last_change":"2024-05-10T08:41:38.074835+0000","last_active":"2024-05-10T08:41:40.070548+0000","last_peered":"2024-05-10T08:41:40.070548+0000","last_clean":"2024-05-10T08:41:40.070548+0000","last_became_active":"2024-05-10T08:41:38.073139+0000","last_became_peered":"2024-05-10T08:41:38.073139+0000","last_unstale":"2024-05-10T08:41:40.070548+0000","last_undegraded":"2024-05-10T08:41:40.070548+0000","last_fullsized":"2024-05-10T08:41:40.070548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:47:13.260653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084284+0000","last_change":"2024-05-10T08:41:39.080374+0000","last_active":"2024-05-10T08:41:39.084284+0000","last_peered":"2024-05-10T08:41:39.084284+0000","last_clean":"2024-05-10T08:41:39.084284+0000","last_became_active":"2024-05-10T08:41:39.080127+0000","last_became_peered":"2024-05-10T08:41:39.080127+0000","last_unstale":"2024-05-10T08:41:39.084284+0000","last_undegraded":"2024-05-10T08:41:39.084284+0000","last_fullsized":"2024-05-10T08:41:39.084284+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.006313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070208+0000","last_change":"2024-05-10T08:41:38.063775+0000","last_active":"2024-05-10T08:41:40.070208+0000","last_peered":"2024-05-10T08:41:40.070208+0000","last_clean":"2024-05-10T08:41:40.070208+0000","last_became_active":"2024-05-10T08:41:38.063423+0000","last_became_peered":"2024-05-10T08:41:38.063423+0000","last_unstale":"2024-05-10T08:41:40.070208+0000","last_undegraded":"2024-05-10T08:41:40.070208+0000","last_fullsized":"2024-05-10T08:41:40.070208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:57.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077577+0000","last_change":"2024-05-10T08:41:39.070207+0000","last_active":"2024-05-10T08:41:39.077577+0000","last_peered":"2024-05-10T08:41:39.077577+0000","last_clean":"2024-05-10T08:41:39.077577+0000","last_became_active":"2024-05-10T08:41:39.069926+0000","last_became_peered":"2024-05-10T08:41:39.069926+0000","last_unstale":"2024-05-10T08:41:39.077577+0000","last_undegraded":"2024-05-10T08:41:39.077577+0000","last_fullsized":"2024-05-10T08:41:39.077577+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:11.864756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.064353+0000","last_change":"2024-05-10T08:41:38.065525+0000","last_active":"2024-05-10T08:41:39.064353+0000","last_peered":"2024-05-10T08:41:39.064353+0000","last_clean":"2024-05-10T08:41:39.064353+0000","last_became_active":"2024-05-10T08:41:38.065196+0000","last_became_peered":"2024-05-10T08:41:38.065196+0000","last_unstale":"2024-05-10T08:41:39.064353+0000","last_undegraded":"2024-05-10T08:41:39.064353+0000","last_fullsized":"2024-05-10T08:41:39.064353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.247237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084637+0000","last_change":"2024-05-10T08:41:39.081920+0000","last_active":"2024-05-10T08:41:39.084637+0000","last_peered":"2024-05-10T08:41:39.084637+0000","last_clean":"2024-05-10T08:41:39.084637+0000","last_became_active":"2024-05-10T08:41:39.081634+0000","last_became_peered":"2024-05-10T08:41:39.081634+0000","last_unstale":"2024-05-10T08:41:39.084637+0000","last_undegraded":"2024-05-10T08:41:39.084637+0000","last_fullsized":"2024-05-10T08:41:39.084637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:54.644223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070067+0000","last_change":"2024-05-10T08:41:38.075968+0000","last_active":"2024-05-10T08:41:40.070067+0000","last_peered":"2024-05-10T08:41:40.070067+0000","last_clean":"2024-05-10T08:41:40.070067+0000","last_became_active":"2024-05-10T08:41:38.075472+0000","last_became_peered":"2024-05-10T08:41:38.075472+0000","last_unstale":"2024-05-10T08:41:40.070067+0000","last_undegraded":"2024-05-10T08:41:40.070067+0000","last_fullsized":"2024-05-10T08:41:40.070067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:48.852753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070046+0000","last_change":"2024-05-10T08:41:39.075291+0000","last_active":"2024-05-10T08:41:40.070046+0000","last_peered":"2024-05-10T08:41:40.070046+0000","last_clean":"2024-05-10T08:41:40.070046+0000","last_became_active":"2024-05-10T08:41:39.074977+0000","last_became_peered":"2024-05-10T08:41:39.074977+0000","last_unstale":"2024-05-10T08:41:40.070046+0000","last_undegraded":"2024-05-10T08:41:40.070046+0000","last_fullsized":"2024-05-10T08:41:40.070046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:43.482367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.067448+0000","last_change":"2024-05-10T08:41:38.061816+0000","last_active":"2024-05-10T08:41:39.067448+0000","last_peered":"2024-05-10T08:41:39.067448+0000","last_clean":"2024-05-10T08:41:39.067448+0000","last_became_active":"2024-05-10T08:41:38.061321+0000","last_became_peered":"2024-05-10T08:41:38.061321+0000","last_unstale":"2024-05-10T08:41:39.067448+0000","last_undegraded":"2024-05-10T08:41:39.067448+0000","last_fullsized":"2024-05-10T08:41:39.067448+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:42.479745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.075983+0000","last_change":"2024-05-10T08:41:39.073462+0000","last_active":"2024-05-10T08:41:39.075983+0000","last_peered":"2024-05-10T08:41:39.075983+0000","last_clean":"2024-05-10T08:41:39.075983+0000","last_became_active":"2024-05-10T08:41:39.073216+0000","last_became_peered":"2024-05-10T08:41:39.073216+0000","last_unstale":"2024-05-10T08:41:39.075983+0000","last_undegraded":"2024-05-10T08:41:39.075983+0000","last_fullsized":"2024-05-10T08:41:39.075983+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:42:25.006313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070319+0000","last_change":"2024-05-10T08:41:38.069643+0000","last_active":"2024-05-10T08:41:40.070319+0000","last_peered":"2024-05-10T08:41:40.070319+0000","last_clean":"2024-05-10T08:41:40.070319+0000","last_became_active":"2024-05-10T08:41:38.069374+0000","last_became_peered":"2024-05-10T08:41:38.069374+0000","last_unstale":"2024-05-10T08:41:40.070319+0000","last_undegraded":"2024-05-10T08:41:40.070319+0000","last_fullsized":"2024-05-10T08:41:40.070319+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:14.718142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070416+0000","last_change":"2024-05-10T08:41:39.085186+0000","last_active":"2024-05-10T08:41:40.070416+0000","last_peered":"2024-05-10T08:41:40.070416+0000","last_clean":"2024-05-10T08:41:40.070416+0000","last_became_active":"2024-05-10T08:41:39.084905+0000","last_became_peered":"2024-05-10T08:41:39.084905+0000","last_unstale":"2024-05-10T08:41:40.070416+0000","last_undegraded":"2024-05-10T08:41:40.070416+0000","last_fullsized":"2024-05-10T08:41:40.070416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:11.864756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.080025+0000","last_change":"2024-05-10T08:41:38.061555+0000","last_active":"2024-05-10T08:41:39.080025+0000","last_peered":"2024-05-10T08:41:39.080025+0000","last_clean":"2024-05-10T08:41:39.080025+0000","last_became_active":"2024-05-10T08:41:38.060965+0000","last_became_peered":"2024-05-10T08:41:38.060965+0000","last_unstale":"2024-05-10T08:41:39.080025+0000","last_undegraded":"2024-05-10T08:41:39.080025+0000","last_fullsized":"2024-05-10T08:41:39.080025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:24:48.852753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070299+0000","last_change":"2024-05-10T08:41:39.070988+0000","last_active":"2024-05-10T08:41:40.070299+0000","last_peered":"2024-05-10T08:41:40.070299+0000","last_clean":"2024-05-10T08:41:40.070299+0000","last_became_active":"2024-05-10T08:41:39.070659+0000","last_became_peered":"2024-05-10T08:41:39.070659+0000","last_unstale":"2024-05-10T08:41:40.070299+0000","last_undegraded":"2024-05-10T08:41:40.070299+0000","last_fullsized":"2024-05-10T08:41:40.070299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:12.649813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.096359+0000","last_change":"2024-05-10T08:41:38.076969+0000","last_active":"2024-05-10T08:41:39.096359+0000","last_peered":"2024-05-10T08:41:39.096359+0000","last_clean":"2024-05-10T08:41:39.096359+0000","last_became_active":"2024-05-10T08:41:38.076663+0000","last_became_peered":"2024-05-10T08:41:38.076663+0000","last_unstale":"2024-05-10T08:41:39.096359+0000","last_undegraded":"2024-05-10T08:41:39.096359+0000","last_fullsized":"2024-05-10T08:41:39.096359+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:50.377519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.081817+0000","last_change":"2024-05-10T08:41:39.078909+0000","last_active":"2024-05-10T08:41:39.081817+0000","last_peered":"2024-05-10T08:41:39.081817+0000","last_clean":"2024-05-10T08:41:39.081817+0000","last_became_active":"2024-05-10T08:41:39.078619+0000","last_became_peered":"2024-05-10T08:41:39.078619+0000","last_unstale":"2024-05-10T08:41:39.081817+0000","last_undegraded":"2024-05-10T08:41:39.081817+0000","last_fullsized":"2024-05-10T08:41:39.081817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:16.926723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070648+0000","last_change":"2024-05-10T08:41:38.075055+0000","last_active":"2024-05-10T08:41:40.070648+0000","last_peered":"2024-05-10T08:41:40.070648+0000","last_clean":"2024-05-10T08:41:40.070648+0000","last_became_active":"2024-05-10T08:41:38.073766+0000","last_became_peered":"2024-05-10T08:41:38.073766+0000","last_unstale":"2024-05-10T08:41:40.070648+0000","last_undegraded":"2024-05-10T08:41:40.070648+0000","last_fullsized":"2024-05-10T08:41:40.070648+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:42.479745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070734+0000","last_change":"2024-05-10T08:41:39.076973+0000","last_active":"2024-05-10T08:41:40.070734+0000","last_peered":"2024-05-10T08:41:40.070734+0000","last_clean":"2024-05-10T08:41:40.070734+0000","last_became_active":"2024-05-10T08:41:39.074196+0000","last_became_peered":"2024-05-10T08:41:39.074196+0000","last_unstale":"2024-05-10T08:41:40.070734+0000","last_undegraded":"2024-05-10T08:41:40.070734+0000","last_fullsized":"2024-05-10T08:41:40.070734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:45.247838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.066636+0000","last_change":"2024-05-10T08:41:38.071707+0000","last_active":"2024-05-10T08:41:39.066636+0000","last_peered":"2024-05-10T08:41:39.066636+0000","last_clean":"2024-05-10T08:41:39.066636+0000","last_became_active":"2024-05-10T08:41:38.071447+0000","last_became_peered":"2024-05-10T08:41:38.071447+0000","last_unstale":"2024-05-10T08:41:39.066636+0000","last_undegraded":"2024-05-10T08:41:39.066636+0000","last_fullsized":"2024-05-10T08:41:39.066636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:47:05.771815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082738+0000","last_change":"2024-05-10T08:41:39.074211+0000","last_active":"2024-05-10T08:41:39.082738+0000","last_peered":"2024-05-10T08:41:39.082738+0000","last_clean":"2024-05-10T08:41:39.082738+0000","last_became_active":"2024-05-10T08:41:39.073677+0000","last_became_peered":"2024-05-10T08:41:39.073677+0000","last_unstale":"2024-05-10T08:41:39.082738+0000","last_undegraded":"2024-05-10T08:41:39.082738+0000","last_fullsized":"2024-05-10T08:41:39.082738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:35.118376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.062996+0000","last_change":"2024-05-10T08:41:38.063166+0000","last_active":"2024-05-10T08:41:39.062996+0000","last_peered":"2024-05-10T08:41:39.062996+0000","last_clean":"2024-05-10T08:41:39.062996+0000","last_became_active":"2024-05-10T08:41:38.062897+0000","last_became_peered":"2024-05-10T08:41:38.062897+0000","last_unstale":"2024-05-10T08:41:39.062996+0000","last_undegraded":"2024-05-10T08:41:39.062996+0000","last_fullsized":"2024-05-10T08:41:39.062996+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:56.225924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070766+0000","last_change":"2024-05-10T08:41:39.080653+0000","last_active":"2024-05-10T08:41:40.070766+0000","last_peered":"2024-05-10T08:41:40.070766+0000","last_clean":"2024-05-10T08:41:40.070766+0000","last_became_active":"2024-05-10T08:41:39.079824+0000","last_became_peered":"2024-05-10T08:41:39.079824+0000","last_unstale":"2024-05-10T08:41:40.070766+0000","last_undegraded":"2024-05-10T08:41:40.070766+0000","last_fullsized":"2024-05-10T08:41:40.070766+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:03.908737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.087916+0000","last_change":"2024-05-10T08:41:38.075051+0000","last_active":"2024-05-10T08:41:39.087916+0000","last_peered":"2024-05-10T08:41:39.087916+0000","last_clean":"2024-05-10T08:41:39.087916+0000","last_became_active":"2024-05-10T08:41:38.074745+0000","last_became_peered":"2024-05-10T08:41:38.074745+0000","last_unstale":"2024-05-10T08:41:39.087916+0000","last_undegraded":"2024-05-10T08:41:39.087916+0000","last_fullsized":"2024-05-10T08:41:39.087916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:54.448505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.083223+0000","last_change":"2024-05-10T08:41:39.077735+0000","last_active":"2024-05-10T08:41:39.083223+0000","last_peered":"2024-05-10T08:41:39.083223+0000","last_clean":"2024-05-10T08:41:39.083223+0000","last_became_active":"2024-05-10T08:41:39.077365+0000","last_became_peered":"2024-05-10T08:41:39.077365+0000","last_unstale":"2024-05-10T08:41:39.083223+0000","last_undegraded":"2024-05-10T08:41:39.083223+0000","last_fullsized":"2024-05-10T08:41:39.083223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:45.247838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070946+0000","last_change":"2024-05-10T08:41:38.073055+0000","last_active":"2024-05-10T08:41:40.070946+0000","last_peered":"2024-05-10T08:41:40.070946+0000","last_clean":"2024-05-10T08:41:40.070946+0000","last_became_active":"2024-05-10T08:41:38.072719+0000","last_became_peered":"2024-05-10T08:41:38.072719+0000","last_unstale":"2024-05-10T08:41:40.070946+0000","last_undegraded":"2024-05-10T08:41:40.070946+0000","last_fullsized":"2024-05-10T08:41:40.070946+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:11.647191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069181+0000","last_change":"2024-05-10T08:41:39.082877+0000","last_active":"2024-05-10T08:41:40.069181+0000","last_peered":"2024-05-10T08:41:40.069181+0000","last_clean":"2024-05-10T08:41:40.069181+0000","last_became_active":"2024-05-10T08:41:39.082612+0000","last_became_peered":"2024-05-10T08:41:39.082612+0000","last_unstale":"2024-05-10T08:41:40.069181+0000","last_undegraded":"2024-05-10T08:41:40.069181+0000","last_fullsized":"2024-05-10T08:41:40.069181+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:54.644223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077551+0000","last_change":"2024-05-10T08:41:38.063320+0000","last_active":"2024-05-10T08:41:39.077551+0000","last_peered":"2024-05-10T08:41:39.077551+0000","last_clean":"2024-05-10T08:41:39.077551+0000","last_became_active":"2024-05-10T08:41:38.063006+0000","last_became_peered":"2024-05-10T08:41:38.063006+0000","last_unstale":"2024-05-10T08:41:39.077551+0000","last_undegraded":"2024-05-10T08:41:39.077551+0000","last_fullsized":"2024-05-10T08:41:39.077551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:04:01.451105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070003+0000","last_change":"2024-05-10T08:41:39.077855+0000","last_active":"2024-05-10T08:41:40.070003+0000","last_peered":"2024-05-10T08:41:40.070003+0000","last_clean":"2024-05-10T08:41:40.070003+0000","last_became_active":"2024-05-10T08:41:39.077547+0000","last_became_peered":"2024-05-10T08:41:39.077547+0000","last_unstale":"2024-05-10T08:41:40.070003+0000","last_undegraded":"2024-05-10T08:41:40.070003+0000","last_fullsized":"2024-05-10T08:41:40.070003+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:02.482751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082693+0000","last_change":"2024-05-10T08:41:38.079089+0000","last_active":"2024-05-10T08:41:39.082693+0000","last_peered":"2024-05-10T08:41:39.082693+0000","last_clean":"2024-05-10T08:41:39.082693+0000","last_became_active":"2024-05-10T08:41:38.078865+0000","last_became_peered":"2024-05-10T08:41:38.078865+0000","last_unstale":"2024-05-10T08:41:39.082693+0000","last_undegraded":"2024-05-10T08:41:39.082693+0000","last_fullsized":"2024-05-10T08:41:39.082693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:39.035516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069313+0000","last_change":"2024-05-10T08:41:39.070373+0000","last_active":"2024-05-10T08:41:40.069313+0000","last_peered":"2024-05-10T08:41:40.069313+0000","last_clean":"2024-05-10T08:41:40.069313+0000","last_became_active":"2024-05-10T08:41:39.070092+0000","last_became_peered":"2024-05-10T08:41:39.070092+0000","last_unstale":"2024-05-10T08:41:40.069313+0000","last_undegraded":"2024-05-10T08:41:40.069313+0000","last_fullsized":"2024-05-10T08:41:40.069313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:29.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.062985+0000","last_change":"2024-05-10T08:41:38.073085+0000","last_active":"2024-05-10T08:41:39.062985+0000","last_peered":"2024-05-10T08:41:39.062985+0000","last_clean":"2024-05-10T08:41:39.062985+0000","last_became_active":"2024-05-10T08:41:38.072751+0000","last_became_peered":"2024-05-10T08:41:38.072751+0000","last_unstale":"2024-05-10T08:41:39.062985+0000","last_undegraded":"2024-05-10T08:41:39.062985+0000","last_fullsized":"2024-05-10T08:41:39.062985+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:56.950369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.076478+0000","last_change":"2024-05-10T08:41:39.074172+0000","last_active":"2024-05-10T08:41:39.076478+0000","last_peered":"2024-05-10T08:41:39.076478+0000","last_clean":"2024-05-10T08:41:39.076478+0000","last_became_active":"2024-05-10T08:41:39.073918+0000","last_became_peered":"2024-05-10T08:41:39.073918+0000","last_unstale":"2024-05-10T08:41:39.076478+0000","last_undegraded":"2024-05-10T08:41:39.076478+0000","last_fullsized":"2024-05-10T08:41:39.076478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:40:54.644223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069288+0000","last_change":"2024-05-10T08:41:38.069651+0000","last_active":"2024-05-10T08:41:40.069288+0000","last_peered":"2024-05-10T08:41:40.069288+0000","last_clean":"2024-05-10T08:41:40.069288+0000","last_became_active":"2024-05-10T08:41:38.067863+0000","last_became_peered":"2024-05-10T08:41:38.067863+0000","last_unstale":"2024-05-10T08:41:40.069288+0000","last_undegraded":"2024-05-10T08:41:40.069288+0000","last_fullsized":"2024-05-10T08:41:40.069288+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:14.718142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088372+0000","last_change":"2024-05-10T08:41:39.083152+0000","last_active":"2024-05-10T08:41:39.088372+0000","last_peered":"2024-05-10T08:41:39.088372+0000","last_clean":"2024-05-10T08:41:39.088372+0000","last_became_active":"2024-05-10T08:41:39.082856+0000","last_became_peered":"2024-05-10T08:41:39.082856+0000","last_unstale":"2024-05-10T08:41:39.088372+0000","last_undegraded":"2024-05-10T08:41:39.088372+0000","last_fullsized":"2024-05-10T08:41:39.088372+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:57.228546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.061026+0000","last_change":"2024-05-10T08:41:38.075695+0000","last_active":"2024-05-10T08:41:39.061026+0000","last_peered":"2024-05-10T08:41:39.061026+0000","last_clean":"2024-05-10T08:41:39.061026+0000","last_became_active":"2024-05-10T08:41:38.075426+0000","last_became_peered":"2024-05-10T08:41:38.075426+0000","last_unstale":"2024-05-10T08:41:39.061026+0000","last_undegraded":"2024-05-10T08:41:39.061026+0000","last_fullsized":"2024-05-10T08:41:39.061026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:02.173487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070588+0000","last_change":"2024-05-10T08:41:39.085961+0000","last_active":"2024-05-10T08:41:40.070588+0000","last_peered":"2024-05-10T08:41:40.070588+0000","last_clean":"2024-05-10T08:41:40.070588+0000","last_became_active":"2024-05-10T08:41:39.085702+0000","last_became_peered":"2024-05-10T08:41:39.085702+0000","last_unstale":"2024-05-10T08:41:40.070588+0000","last_undegraded":"2024-05-10T08:41:40.070588+0000","last_fullsized":"2024-05-10T08:41:40.070588+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:44.726038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070256+0000","last_change":"2024-05-10T08:41:38.079619+0000","last_active":"2024-05-10T08:41:40.070256+0000","last_peered":"2024-05-10T08:41:40.070256+0000","last_clean":"2024-05-10T08:41:40.070256+0000","last_became_active":"2024-05-10T08:41:38.079314+0000","last_became_peered":"2024-05-10T08:41:38.079314+0000","last_unstale":"2024-05-10T08:41:40.070256+0000","last_undegraded":"2024-05-10T08:41:40.070256+0000","last_fullsized":"2024-05-10T08:41:40.070256+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:56.225924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069262+0000","last_change":"2024-05-10T08:41:39.068217+0000","last_active":"2024-05-10T08:41:40.069262+0000","last_peered":"2024-05-10T08:41:40.069262+0000","last_clean":"2024-05-10T08:41:40.069262+0000","last_became_active":"2024-05-10T08:41:39.067948+0000","last_became_peered":"2024-05-10T08:41:39.067948+0000","last_unstale":"2024-05-10T08:41:40.069262+0000","last_undegraded":"2024-05-10T08:41:40.069262+0000","last_fullsized":"2024-05-10T08:41:40.069262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:16.926723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.067258+0000","last_change":"2024-05-10T08:41:38.065390+0000","last_active":"2024-05-10T08:41:39.067258+0000","last_peered":"2024-05-10T08:41:39.067258+0000","last_clean":"2024-05-10T08:41:39.067258+0000","last_became_active":"2024-05-10T08:41:38.064953+0000","last_became_peered":"2024-05-10T08:41:38.064953+0000","last_unstale":"2024-05-10T08:41:39.067258+0000","last_undegraded":"2024-05-10T08:41:39.067258+0000","last_fullsized":"2024-05-10T08:41:39.067258+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:23.297006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088170+0000","last_change":"2024-05-10T08:41:39.083713+0000","last_active":"2024-05-10T08:41:39.088170+0000","last_peered":"2024-05-10T08:41:39.088170+0000","last_clean":"2024-05-10T08:41:39.088170+0000","last_became_active":"2024-05-10T08:41:39.083351+0000","last_became_peered":"2024-05-10T08:41:39.083351+0000","last_unstale":"2024-05-10T08:41:39.088170+0000","last_undegraded":"2024-05-10T08:41:39.088170+0000","last_fullsized":"2024-05-10T08:41:39.088170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:46:29.488666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.084228+0000","last_change":"2024-05-10T08:41:38.069668+0000","last_active":"2024-05-10T08:41:39.084228+0000","last_peered":"2024-05-10T08:41:39.084228+0000","last_clean":"2024-05-10T08:41:39.084228+0000","last_became_active":"2024-05-10T08:41:38.069389+0000","last_became_peered":"2024-05-10T08:41:38.069389+0000","last_unstale":"2024-05-10T08:41:39.084228+0000","last_undegraded":"2024-05-10T08:41:39.084228+0000","last_fullsized":"2024-05-10T08:41:39.084228+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:57.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069456+0000","last_change":"2024-05-10T08:41:39.069759+0000","last_active":"2024-05-10T08:41:40.069456+0000","last_peered":"2024-05-10T08:41:40.069456+0000","last_clean":"2024-05-10T08:41:40.069456+0000","last_became_active":"2024-05-10T08:41:39.069466+0000","last_became_peered":"2024-05-10T08:41:39.069466+0000","last_unstale":"2024-05-10T08:41:40.069456+0000","last_undegraded":"2024-05-10T08:41:40.069456+0000","last_fullsized":"2024-05-10T08:41:40.069456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:58.041845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.064451+0000","last_change":"2024-05-10T08:41:38.063135+0000","last_active":"2024-05-10T08:41:39.064451+0000","last_peered":"2024-05-10T08:41:39.064451+0000","last_clean":"2024-05-10T08:41:39.064451+0000","last_became_active":"2024-05-10T08:41:38.062639+0000","last_became_peered":"2024-05-10T08:41:38.062639+0000","last_unstale":"2024-05-10T08:41:39.064451+0000","last_undegraded":"2024-05-10T08:41:39.064451+0000","last_fullsized":"2024-05-10T08:41:39.064451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:01.480129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.082690+0000","last_change":"2024-05-10T08:41:39.075099+0000","last_active":"2024-05-10T08:41:39.082690+0000","last_peered":"2024-05-10T08:41:39.082690+0000","last_clean":"2024-05-10T08:41:39.082690+0000","last_became_active":"2024-05-10T08:41:39.074685+0000","last_became_peered":"2024-05-10T08:41:39.074685+0000","last_unstale":"2024-05-10T08:41:39.082690+0000","last_undegraded":"2024-05-10T08:41:39.082690+0000","last_fullsized":"2024-05-10T08:41:39.082690+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:44.726038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070696+0000","last_change":"2024-05-10T08:41:38.070182+0000","last_active":"2024-05-10T08:41:40.070696+0000","last_peered":"2024-05-10T08:41:40.070696+0000","last_clean":"2024-05-10T08:41:40.070696+0000","last_became_active":"2024-05-10T08:41:38.069697+0000","last_became_peered":"2024-05-10T08:41:38.069697+0000","last_unstale":"2024-05-10T08:41:40.070696+0000","last_undegraded":"2024-05-10T08:41:40.070696+0000","last_fullsized":"2024-05-10T08:41:40.070696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:18.960295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070824+0000","last_change":"2024-05-10T08:41:39.072792+0000","last_active":"2024-05-10T08:41:40.070824+0000","last_peered":"2024-05-10T08:41:40.070824+0000","last_clean":"2024-05-10T08:41:40.070824+0000","last_became_active":"2024-05-10T08:41:39.072514+0000","last_became_peered":"2024-05-10T08:41:39.072514+0000","last_unstale":"2024-05-10T08:41:40.070824+0000","last_undegraded":"2024-05-10T08:41:40.070824+0000","last_fullsized":"2024-05-10T08:41:40.070824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:50:41.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.061148+0000","last_change":"2024-05-10T08:41:38.076292+0000","last_active":"2024-05-10T08:41:39.061148+0000","last_peered":"2024-05-10T08:41:39.061148+0000","last_clean":"2024-05-10T08:41:39.061148+0000","last_became_active":"2024-05-10T08:41:38.075994+0000","last_became_peered":"2024-05-10T08:41:38.075994+0000","last_unstale":"2024-05-10T08:41:39.061148+0000","last_undegraded":"2024-05-10T08:41:39.061148+0000","last_fullsized":"2024-05-10T08:41:39.061148+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:13.538680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.079108+0000","last_change":"2024-05-10T08:41:39.077138+0000","last_active":"2024-05-10T08:41:39.079108+0000","last_peered":"2024-05-10T08:41:39.079108+0000","last_clean":"2024-05-10T08:41:39.079108+0000","last_became_active":"2024-05-10T08:41:39.076852+0000","last_became_peered":"2024-05-10T08:41:39.076852+0000","last_unstale":"2024-05-10T08:41:39.079108+0000","last_undegraded":"2024-05-10T08:41:39.079108+0000","last_fullsized":"2024-05-10T08:41:39.079108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:02.956995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.060878+0000","last_change":"2024-05-10T08:41:38.070458+0000","last_active":"2024-05-10T08:41:39.060878+0000","last_peered":"2024-05-10T08:41:39.060878+0000","last_clean":"2024-05-10T08:41:39.060878+0000","last_became_active":"2024-05-10T08:41:38.070164+0000","last_became_peered":"2024-05-10T08:41:38.070164+0000","last_unstale":"2024-05-10T08:41:39.060878+0000","last_undegraded":"2024-05-10T08:41:39.060878+0000","last_fullsized":"2024-05-10T08:41:39.060878+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:34.541342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070722+0000","last_change":"2024-05-10T08:41:39.076816+0000","last_active":"2024-05-10T08:41:40.070722+0000","last_peered":"2024-05-10T08:41:40.070722+0000","last_clean":"2024-05-10T08:41:40.070722+0000","last_became_active":"2024-05-10T08:41:39.076518+0000","last_became_peered":"2024-05-10T08:41:39.076518+0000","last_unstale":"2024-05-10T08:41:40.070722+0000","last_undegraded":"2024-05-10T08:41:40.070722+0000","last_fullsized":"2024-05-10T08:41:40.070722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:17.035446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.069897+0000","last_change":"2024-05-10T08:41:38.072741+0000","last_active":"2024-05-10T08:41:40.069897+0000","last_peered":"2024-05-10T08:41:40.069897+0000","last_clean":"2024-05-10T08:41:40.069897+0000","last_became_active":"2024-05-10T08:41:38.072382+0000","last_became_peered":"2024-05-10T08:41:38.072382+0000","last_unstale":"2024-05-10T08:41:40.069897+0000","last_undegraded":"2024-05-10T08:41:40.069897+0000","last_fullsized":"2024-05-10T08:41:40.069897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:47:05.771815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.077414+0000","last_change":"2024-05-10T08:41:39.069866+0000","last_active":"2024-05-10T08:41:39.077414+0000","last_peered":"2024-05-10T08:41:39.077414+0000","last_clean":"2024-05-10T08:41:39.077414+0000","last_became_active":"2024-05-10T08:41:39.069537+0000","last_became_peered":"2024-05-10T08:41:39.069537+0000","last_unstale":"2024-05-10T08:41:39.077414+0000","last_undegraded":"2024-05-10T08:41:39.077414+0000","last_fullsized":"2024-05-10T08:41:39.077414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:57.443438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.063504+0000","last_change":"2024-05-10T08:41:38.079465+0000","last_active":"2024-05-10T08:41:39.063504+0000","last_peered":"2024-05-10T08:41:39.063504+0000","last_clean":"2024-05-10T08:41:39.063504+0000","last_became_active":"2024-05-10T08:41:38.079163+0000","last_became_peered":"2024-05-10T08:41:38.079163+0000","last_unstale":"2024-05-10T08:41:39.063504+0000","last_undegraded":"2024-05-10T08:41:39.063504+0000","last_fullsized":"2024-05-10T08:41:39.063504+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:47.378165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.088332+0000","last_change":"2024-05-10T08:41:39.082765+0000","last_active":"2024-05-10T08:41:39.088332+0000","last_peered":"2024-05-10T08:41:39.088332+0000","last_clean":"2024-05-10T08:41:39.088332+0000","last_became_active":"2024-05-10T08:41:39.082235+0000","last_became_peered":"2024-05-10T08:41:39.082235+0000","last_unstale":"2024-05-10T08:41:39.088332+0000","last_undegraded":"2024-05-10T08:41:39.088332+0000","last_fullsized":"2024-05-10T08:41:39.088332+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:38.045827+0000","last_clean_scrub_stamp":"2024-05-10T08:41:38.045827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:19.962917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-10T08:41:40.070770+0000","last_change":"2024-05-10T08:41:38.073819+0000","last_active":"2024-05-10T08:41:40.070770+0000","last_peered":"2024-05-10T08:41:40.070770+0000","last_clean":"2024-05-10T08:41:40.070770+0000","last_became_active":"2024-05-10T08:41:38.073442+0000","last_became_peered":"2024-05-10T08:41:38.073442+0000","last_unstale":"2024-05-10T08:41:40.070770+0000","last_undegraded":"2024-05-10T08:41:40.070770+0000","last_fullsized":"2024-05-10T08:41:40.070770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:41:37.043205+0000","last_clean_scrub_stamp":"2024-05-10T08:41:37.043205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:01.480129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":160,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-10T08:41:39.065376+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:41:39.065376+0000","last_peered":"2024-05-10T08:41:39.065376+0000","last_clean":"2024-05-10T08:41:39.065376+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:41:39.065376+0000","last_undegraded":"2024-05-10T08:41:39.065376+0000","last_fullsized":"2024-05-10T08:41:39.065376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1171456,"data_stored":839081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":249241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":569344,"data_stored":248589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":255863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":250223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":250201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":248749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1171456,"data_stored":839013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:41:43.472 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:41:43.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T08:41:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.620+0000 7f9db7351640 1 Processor -- start 2024-05-10T08:41:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.621+0000 7f9db7351640 1 -- start start 2024-05-10T08:41:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.621+0000 7f9db7351640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 0x7f9db00d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.621+0000 7f9db7351640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9db00d3320 con 0x7f9db0163460 2024-05-10T08:41:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.621+0000 7f9db7351640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9db00d3600 con 0x7f9db00d2bb0 2024-05-10T08:41:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.621+0000 7f9db7351640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9db00d38e0 con 0x7f9db00b6590 2024-05-10T08:41:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9db58ee640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9db0163460 0x7f9db015ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44242/0 (socket says 172.21.15.37:44242) 2024-05-10T08:41:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9db58ee640 1 -- 172.21.15.37:0/2658423562 learned_addr learned my addr 172.21.15.37:0/2658423562 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9db50ed640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 0x7f9db00d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221298551 0 0) 0x7f9db00d3320 con 0x7f9db0163460 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9c003520 con 0x7f9db0163460 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3370817019 0 0) 0x7f9d9c003520 con 0x7f9db0163460 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 msgr2=0x7f9db00d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 0x7f9db00d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 >> v1:172.21.15.82:6789/0 conn(0x7f9db00d2bb0 legacy=0x7f9db0162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db00d3bc0 con 0x7f9db0163460 2024-05-10T08:41:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f9da80019f0 con 0x7f9db0163460 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 >> v1:172.21.15.37:6789/0 conn(0x7f9db0163460 legacy=0x7f9db015ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9c0039e0 0x7f9d9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9c004800 0x7f9d9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 0x7f9d9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9db00d38e0 con 0x7f9d9c004800 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c00ba70 con 0x7f9d9c0039e0 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9c00bc20 con 0x7f9db00b6590 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9db48ec640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9c004800 0x7f9d9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9db50ed640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9c0039e0 0x7f9d9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.622+0000 7f9db58ee640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 0x7f9d9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.623+0000 7f9db48ec640 1 -- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 msgr2=0x7f9d9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.623+0000 7f9db48ec640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9db00b6590 0x7f9d9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.623+0000 7f9db48ec640 1 -- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9c0039e0 msgr2=0x7f9d9c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:43.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.623+0000 7f9db48ec640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9c0039e0 0x7f9d9c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.623+0000 7f9db48ec640 1 -- 172.21.15.37:0/2658423562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c003520 con 0x7f9d9c004800 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.623+0000 7f9db48ec640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9c004800 0x7f9d9c004c80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9da0001830 tx=0x7f9d9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a03051610807ff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0037070 con 0x7f9d9c004800 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da002aba0 con 0x7f9d9c004800 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9da7fff640 1 -- 172.21.15.37:0/2658423562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0001430 con 0x7f9d9c004800 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9db7351640 1 -- 172.21.15.37:0/2658423562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9c004800 msgr2=0x7f9d9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9db7351640 1 --2- 172.21.15.37:0/2658423562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9c004800 0x7f9d9c004c80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9da0001830 tx=0x7f9d9c005830 comp rx=0 tx=0).stop 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9db58ee640 1 -- 172.21.15.37:0/2658423562 reap_dead start 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9db7351640 1 -- 172.21.15.37:0/2658423562 shutdown_connections 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9db7351640 1 -- 172.21.15.37:0/2658423562 >> 172.21.15.37:0/2658423562 conn(0x7f9db00d4fe0 msgr2=0x7f9db00d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:43.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9db7351640 1 -- 172.21.15.37:0/2658423562 shutdown_connections 2024-05-10T08:41:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.624+0000 7f9db7351640 1 -- 172.21.15.37:0/2658423562 wait complete. 2024-05-10T08:41:43.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.625+0000 7f9db7351640 1 Processor -- start 2024-05-10T08:41:43.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db7351640 1 -- start start 2024-05-10T08:41:43.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db7351640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9c004800 0x7f9db0150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db7351640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db00a1020 0x7f9db00a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db7351640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00cc260 0x7f9db00cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db7351640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9db00b9080 con 0x7f9db00a1020 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db7351640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9db00d3010 con 0x7f9db00cc260 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db7351640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9db00b9200 con 0x7f9d9c004800 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db48ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db00a1020 0x7f9db00a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db48ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db00a1020 0x7f9db00a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44426/0 (socket says 172.21.15.37:44426) 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db48ec640 1 -- 172.21.15.37:0/1159264654 learned_addr learned my addr 172.21.15.37:0/1159264654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db58ee640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00cc260 0x7f9db00cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.626+0000 7f9db50ed640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9c004800 0x7f9db0150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db48ec640 1 -- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9c004800 msgr2=0x7f9db0150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db48ec640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9c004800 0x7f9db0150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db48ec640 1 -- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00cc260 msgr2=0x7f9db00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db48ec640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00cc260 0x7f9db00cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db48ec640 1 -- 172.21.15.37:0/1159264654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db00a1d70 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db48ec640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db00a1020 0x7f9db00a14a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9da0001950 tx=0x7f9da0001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9da5ffb640 1 -- 172.21.15.37:0/1159264654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da003f020 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9da5ffb640 1 -- 172.21.15.37:0/1159264654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da0005270 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9da5ffb640 1 -- 172.21.15.37:0/1159264654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0037040 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db00a2050 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.627+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db00a2610 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.628+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db00693f0 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.629+0000 7f9da5ffb640 1 -- 172.21.15.37:0/1159264654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9da0042020 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.629+0000 7f9da5ffb640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d94076300 0x7f9d940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.630+0000 7f9da5ffb640 1 -- 172.21.15.37:0/1159264654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f9da00b75b0 con 0x7f9db00a1020 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.630+0000 7f9db50ed640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d94076300 0x7f9d940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.630+0000 7f9db50ed640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d94076300 0x7f9d940787c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009bc0 tx=0x7f9dac009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:43.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.634+0000 7f9da5ffb640 1 -- 172.21.15.37:0/1159264654 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9da0049030 con 0x7f9db00a1020 2024-05-10T08:41:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.896+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9db00baaf0 con 0x7f9db00a1020 2024-05-10T08:41:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.898+0000 7f9da5ffb640 1 -- 172.21.15.37:0/1159264654 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f9da00807c0 con 0x7f9db00a1020 2024-05-10T08:41:43.898 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:41:43.898 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:41:43.898 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-10T08:41:43.898 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-10T08:41:43.898 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T08:41:43.898 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-10T08:41:43.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.900+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d94076300 msgr2=0x7f9d940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.900+0000 7f9db7351640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d94076300 0x7f9d940787c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009bc0 tx=0x7f9dac009190 comp rx=0 tx=0).stop 2024-05-10T08:41:43.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.900+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db00a1020 msgr2=0x7f9db00a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:43.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.900+0000 7f9db7351640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db00a1020 0x7f9db00a14a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9da0001950 tx=0x7f9da0001230 comp rx=0 tx=0).stop 2024-05-10T08:41:43.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 shutdown_connections 2024-05-10T08:41:43.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d94076300 0x7f9d940787c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00cc260 0x7f9db00cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db00a1020 0x7f9db00a14a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 --2- 172.21.15.37:0/1159264654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d9c004800 0x7f9db0150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:43.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 >> 172.21.15.37:0/1159264654 conn(0x7f9db00d4fe0 msgr2=0x7f9db006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:43.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 shutdown_connections 2024-05-10T08:41:43.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:43.901+0000 7f9db7351640 1 -- 172.21.15.37:0/1159264654 wait complete. 2024-05-10T08:41:43.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.015+0000 7f0dd2e72640 1 Processor -- start 2024-05-10T08:41:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.015+0000 7f0dd2e72640 1 -- start start 2024-05-10T08:41:44.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd2e72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0dcc15f380 0x7f0dcc0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd2e72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dcc0d3cd0 0x7f0dcc0b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd2e72640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dcc0d1760 con 0x7f0dcc0d0cf0 2024-05-10T08:41:44.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd2e72640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0dcc0d30f0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd2e72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0dcc0d2370 con 0x7f0dcc15f380 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd140f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dcc0d3cd0 0x7f0dcc0b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd140f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dcc0d3cd0 0x7f0dcc0b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44428/0 (socket says 172.21.15.37:44428) 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd140f640 1 -- 172.21.15.37:0/3240719268 learned_addr learned my addr 172.21.15.37:0/3240719268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd0c0e640 1 --2- 172.21.15.37:0/3240719268 >> v2:172.21.15.82:3300/0 conn(0x7f0dcc15f380 0x7f0dcc0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd140f640 1 -- 172.21.15.37:0/3240719268 >> v2:172.21.15.82:3300/0 conn(0x7f0dcc15f380 msgr2=0x7f0dcc0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd140f640 1 --2- 172.21.15.37:0/3240719268 >> v2:172.21.15.82:3300/0 conn(0x7f0dcc15f380 0x7f0dcc0d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd140f640 1 -- 172.21.15.37:0/3240719268 >> v1:172.21.15.82:6789/0 conn(0x7f0dcc0d0cf0 legacy=0x7f0dcc0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.016+0000 7f0dd140f640 1 -- 172.21.15.37:0/3240719268 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc0d1a40 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.017+0000 7f0dd140f640 1 --2- 172.21.15.37:0/3240719268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc0b7e30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0b7ba0 tx=0x7f0dc402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea08af1a1858537 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.017+0000 7f0dcb7fe640 1 -- 172.21.15.37:0/3240719268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4036070 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.017+0000 7f0dcb7fe640 1 -- 172.21.15.37:0/3240719268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc4031600 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.017+0000 7f0dcb7fe640 1 -- 172.21.15.37:0/3240719268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40319d0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.017+0000 7f0dd2e72640 1 -- 172.21.15.37:0/3240719268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 msgr2=0x7f0dcc0b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.017+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/3240719268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc0b7e30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0b7ba0 tx=0x7f0dc402a730 comp rx=0 tx=0).stop 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.018+0000 7f0dd2e72640 1 -- 172.21.15.37:0/3240719268 shutdown_connections 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.018+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/3240719268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc0b7e30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.018+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/3240719268 >> v2:172.21.15.82:3300/0 conn(0x7f0dcc15f380 0x7f0dcc0d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.018+0000 7f0dd2e72640 1 -- 172.21.15.37:0/3240719268 >> 172.21.15.37:0/3240719268 conn(0x7f0dcc0d4fe0 msgr2=0x7f0dcc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.018+0000 7f0dd2e72640 1 -- 172.21.15.37:0/3240719268 shutdown_connections 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.018+0000 7f0dd2e72640 1 -- 172.21.15.37:0/3240719268 wait complete. 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.019+0000 7f0dd2e72640 1 Processor -- start 2024-05-10T08:41:44.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.019+0000 7f0dd2e72640 1 -- start start 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd2e72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dcc0d0cf0 0x7f0dcc1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd2e72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc1f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd2e72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dcc15f380 0x7f0dcc1f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd2e72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc15f760 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd2e72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc0d2000 con 0x7f0dcc15f380 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd2e72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0dcc0d2800 con 0x7f0dcc0d0cf0 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc1f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc1f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44440/0 (socket says 172.21.15.37:44440) 2024-05-10T08:41:44.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 -- 172.21.15.37:0/2377608642 learned_addr learned my addr 172.21.15.37:0/2377608642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd0c0e640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dcc0d0cf0 0x7f0dcc1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dd140f640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dcc15f380 0x7f0dcc1f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 -- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dcc0d0cf0 msgr2=0x7f0dcc1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dcc0d0cf0 0x7f0dcc1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 -- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dcc15f380 msgr2=0x7f0dcc1f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dcc15f380 0x7f0dcc1f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 -- 172.21.15.37:0/2377608642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc158c60 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dcbfff640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc1f5b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c3c0 tx=0x7f0db800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.020+0000 7f0dc97fa640 1 -- 172.21.15.37:0/2377608642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db80052d0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.021+0000 7f0dc97fa640 1 -- 172.21.15.37:0/2377608642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db8005490 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.021+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc158ee0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.021+0000 7f0dc97fa640 1 -- 172.21.15.37:0/2377608642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8007260 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.021+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc1594a0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.022+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc0693f0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.022+0000 7f0dc97fa640 1 -- 172.21.15.37:0/2377608642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0db8007400 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.023+0000 7f0dc97fa640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0db0076300 0x7f0db00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.023+0000 7f0dc97fa640 1 -- 172.21.15.37:0/2377608642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f0db8096b70 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.023+0000 7f0dd0c0e640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0db0076300 0x7f0db00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.023+0000 7f0dd0c0e640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0db0076300 0x7f0db00787c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0006fd0 tx=0x7f0dc0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.027+0000 7f0dc97fa640 1 -- 172.21.15.37:0/2377608642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0dcc158c60 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.259+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dcc08cfd0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.260+0000 7f0dc97fa640 1 -- 172.21.15.37:0/2377608642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7f0db805fcf0 con 0x7f0dcc0d3cd0 2024-05-10T08:41:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:44.260 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:41:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:41:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0db0076300 msgr2=0x7f0db00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0db0076300 0x7f0db00787c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0006fd0 tx=0x7f0dc0008040 comp rx=0 tx=0).stop 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 msgr2=0x7f0dcc1f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc1f5b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c3c0 tx=0x7f0db800c880 comp rx=0 tx=0).stop 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 shutdown_connections 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0db0076300 0x7f0db00787c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dcc15f380 0x7f0dcc1f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dcc0d3cd0 0x7f0dcc1f5b30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 --2- 172.21.15.37:0/2377608642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0dcc0d0cf0 0x7f0dcc1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 >> 172.21.15.37:0/2377608642 conn(0x7f0dcc0d4fe0 msgr2=0x7f0dcc0c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 shutdown_connections 2024-05-10T08:41:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.262+0000 7f0dd2e72640 1 -- 172.21.15.37:0/2377608642 wait complete. 2024-05-10T08:41:44.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:41:38.434380+0000', 'modified': '2024-05-10T08:41:41.446393+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5086}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5086': {'gid': 5086, 'name': 'b', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/662459250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 662459250}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 662459250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5086, 'qdb_cluster': [5086]} 2024-05-10T08:41:44.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:41:44.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T08:41:44.701 INFO:tasks.ceph.mds.b.smithi082.stderr:2024-05-10T08:41:44.702+0000 7f924c937640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:41:44.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.786+0000 7f1a26304640 1 Processor -- start 2024-05-10T08:41:44.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.786+0000 7f1a26304640 1 -- start start 2024-05-10T08:41:44.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a26304640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a2006e0f0 0x7f1a200cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a26304640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a200d0360 0x7f1a200b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a26304640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2015d2a0 con 0x7f1a2006f060 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a26304640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1a200d07c0 con 0x7f1a2006e0f0 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a26304640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2006f440 con 0x7f1a200d0360 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a17fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a2006e0f0 0x7f1a200cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a17fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a2006e0f0 0x7f1a200cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44450/0 (socket says 172.21.15.37:44450) 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a17fff640 1 -- 172.21.15.37:0/1761503918 learned_addr learned my addr 172.21.15.37:0/1761503918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a248a1640 1 --2- 172.21.15.37:0/1761503918 >> v2:172.21.15.82:3300/0 conn(0x7f1a200d0360 0x7f1a200b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a17fff640 1 -- 172.21.15.37:0/1761503918 >> v2:172.21.15.82:3300/0 conn(0x7f1a200d0360 msgr2=0x7f1a200b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1761503918 >> v2:172.21.15.82:3300/0 conn(0x7f1a200d0360 0x7f1a200b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a17fff640 1 -- 172.21.15.37:0/1761503918 >> v1:172.21.15.82:6789/0 conn(0x7f1a2006f060 legacy=0x7f1a2006fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a17fff640 1 -- 172.21.15.37:0/1761503918 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a201609b0 con 0x7f1a2006e0f0 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.787+0000 7f1a248a1640 1 --2- 172.21.15.37:0/1761503918 >> v2:172.21.15.82:3300/0 conn(0x7f1a200d0360 0x7f1a200b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.788+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1761503918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006e0f0 0x7f1a200cfe20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1a2009f050 tx=0x7f1a0802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b373947504638e15 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.788+0000 7f1a1f7fe640 1 -- 172.21.15.37:0/1761503918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08037070 con 0x7f1a2006e0f0 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.788+0000 7f1a1f7fe640 1 -- 172.21.15.37:0/1761503918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a08032440 con 0x7f1a2006e0f0 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.788+0000 7f1a1f7fe640 1 -- 172.21.15.37:0/1761503918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08032810 con 0x7f1a2006e0f0 2024-05-10T08:41:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 -- 172.21.15.37:0/1761503918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006e0f0 msgr2=0x7f1a200cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 --2- 172.21.15.37:0/1761503918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006e0f0 0x7f1a200cfe20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1a2009f050 tx=0x7f1a0802a230 comp rx=0 tx=0).stop 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 -- 172.21.15.37:0/1761503918 shutdown_connections 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 --2- 172.21.15.37:0/1761503918 >> v2:172.21.15.82:3300/0 conn(0x7f1a200d0360 0x7f1a200b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 --2- 172.21.15.37:0/1761503918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006e0f0 0x7f1a200cfe20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 -- 172.21.15.37:0/1761503918 >> 172.21.15.37:0/1761503918 conn(0x7f1a2006c3a0 msgr2=0x7f1a2006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 -- 172.21.15.37:0/1761503918 shutdown_connections 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.789+0000 7f1a26304640 1 -- 172.21.15.37:0/1761503918 wait complete. 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.790+0000 7f1a26304640 1 Processor -- start 2024-05-10T08:41:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.790+0000 7f1a26304640 1 -- start start 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a26304640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a2006e0f0 0x7f1a2009e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a26304640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006f060 0x7f1a20151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a26304640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a200d0360 0x7f1a200b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a26304640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20161250 con 0x7f1a2006f060 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a26304640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20160f70 con 0x7f1a200d0360 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a26304640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a20161530 con 0x7f1a2006e0f0 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006f060 0x7f1a20151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006f060 0x7f1a20151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44454/0 (socket says 172.21.15.37:44454) 2024-05-10T08:41:44.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 -- 172.21.15.37:0/4192210574 learned_addr learned my addr 172.21.15.37:0/4192210574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a248a1640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a200d0360 0x7f1a200b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a2006e0f0 0x7f1a2009e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 -- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a2006e0f0 msgr2=0x7f1a2009e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a2006e0f0 0x7f1a2009e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 -- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a200d0360 msgr2=0x7f1a200b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a200d0360 0x7f1a200b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 -- 172.21.15.37:0/4192210574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a200b3130 con 0x7f1a2006f060 2024-05-10T08:41:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a2006e0f0 0x7f1a2009e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.791+0000 7f1a17fff640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006f060 0x7f1a20151920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1a0802a270 tx=0x7f1a080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.792+0000 7f1a1d7fa640 1 -- 172.21.15.37:0/4192210574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08037040 con 0x7f1a2006f060 2024-05-10T08:41:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.792+0000 7f1a1d7fa640 1 -- 172.21.15.37:0/4192210574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a08042070 con 0x7f1a2006f060 2024-05-10T08:41:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.792+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a200b3410 con 0x7f1a2006f060 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.792+0000 7f1a1d7fa640 1 -- 172.21.15.37:0/4192210574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08030bb0 con 0x7f1a2006f060 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.792+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2009be50 con 0x7f1a2006f060 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.793+0000 7f1a1d7fa640 1 -- 172.21.15.37:0/4192210574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a08047460 con 0x7f1a2006f060 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.794+0000 7f1a1d7fa640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a000762d0 0x7f1a00078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.794+0000 7f1a1d7fa640 1 -- 172.21.15.37:0/4192210574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f1a080b8450 con 0x7f1a2006f060 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.794+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a000762d0 0x7f1a00078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.794+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a000762d0 0x7f1a00078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a10003eb0 tx=0x7f1a10009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 Processor -- start 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 -- start start 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa2d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2b330 0x5577daa2dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577da9fdbb0 0x5577daa013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5577da9678d0 con 0x5577daa2af50 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5577da920c10 con 0x5577da9fdbb0 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5577da963890 con 0x5577daa2b330 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa2d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa2d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44462/0 (socket says 172.21.15.37:44462) 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.795+0000 7f1a1ffff640 1 -- 172.21.15.37:0/2768704265 learned_addr learned my addr 172.21.15.37:0/2768704265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a17fff640 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2b330 0x5577daa2dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a248a1640 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577da9fdbb0 0x5577daa013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a1ffff640 1 -- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2b330 msgr2=0x5577daa2dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2b330 0x5577daa2dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a1ffff640 1 -- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577da9fdbb0 msgr2=0x5577daa013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577da9fdbb0 0x5577daa013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a1ffff640 1 -- 172.21.15.37:0/2768704265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577da9285d0 con 0x5577daa2af50 2024-05-10T08:41:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a248a1640 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577da9fdbb0 0x5577daa013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa2d760 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1a10003c90 tx=0x7f1a10010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdea686a798664 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a15ffb640 1 -- 172.21.15.37:0/2768704265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10024070 con 0x5577daa2af50 2024-05-10T08:41:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a15ffb640 1 -- 172.21.15.37:0/2768704265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a10014db0 con 0x5577daa2af50 2024-05-10T08:41:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.796+0000 7f1a15ffb640 1 -- 172.21.15.37:0/2768704265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1001f640 con 0x5577daa2af50 2024-05-10T08:41:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 -- 172.21.15.37:0/2768704265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 msgr2=0x5577daa2d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa2d760 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1a10003c90 tx=0x7f1a10010000 comp rx=0 tx=0).stop 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 -- 172.21.15.37:0/2768704265 shutdown_connections 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577da9fdbb0 0x5577daa013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2b330 0x5577daa2dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2768704265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa2d760 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 -- 172.21.15.37:0/2768704265 >> 172.21.15.37:0/2768704265 conn(0x5577da9ffe20 msgr2=0x5577daa48760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 -- 172.21.15.37:0/2768704265 shutdown_connections 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 -- 172.21.15.37:0/2768704265 wait complete. 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.797+0000 7f1a2901c740 1 -- start start 2024-05-10T08:41:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 1 Processor -- start 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daa2e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa2ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daa2f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5577daa02fd0 con 0x5577daa2b330 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5577da924760 con 0x5577daa210d0 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5577daa032b0 con 0x5577daa2af50 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a2901c740 10 client.0 _ll_register_callbacks cb 0x5577da95dcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa2ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa2ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44474/0 (socket says 172.21.15.37:44474) 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a17fff640 1 -- 172.21.15.37:0/1320489578 learned_addr learned my addr 172.21.15.37:0/1320489578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.798+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daa2e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a248a1640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daa2f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a17fff640 1 -- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 msgr2=0x5577daa2e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daa2e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a17fff640 1 -- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 msgr2=0x5577daa2f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daa2f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a17fff640 1 -- 172.21.15.37:0/1320489578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577da6792d0 con 0x5577daa2b330 2024-05-10T08:41:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a248a1640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daa2f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa2ed90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1a0807e780 tx=0x7f1a08080d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e43aa179f9b3cb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f19feffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f19feffd640 1 -- 172.21.15.37:0/1320489578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08081970 con 0x5577daa2b330 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f19feffd640 1 -- 172.21.15.37:0/1320489578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f1a08089e50 con 0x5577daa2b330 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a10014db0 con 0x5577daa2b330 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f19feffd640 1 -- 172.21.15.37:0/1320489578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1a08081510 con 0x5577daa2b330 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 10 client.5382 fetch_fsmap learned FSMap version 26 2024-05-10T08:41:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5577da7436b0 con 0x5577daa2b330 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f19feffd640 1 -- 172.21.15.37:0/1320489578 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a10014db0 con 0x5577daa2b330 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f19feffd640 1 -- 172.21.15.37:0/1320489578 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f1a0803a030 con 0x5577daa2b330 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 10 client.5382 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 10 client.5382 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 20 client.5382 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daa304d0 0x5577daa308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.799+0000 7f1a2901c740 4 client.5382 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:41:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.800+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577da8eb760 con 0x5577daa304d0 2024-05-10T08:41:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.800+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daa304d0 0x5577daa308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.800+0000 7f19feffd640 10 client.5382 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.800+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daa304d0 0x5577daa308b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5735fba7d59e951 server_cookie=5652fc0deaf96531 in_seq=0 out_seq=0 2024-05-10T08:41:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f19feffd640 1 -- 172.21.15.37:0/1320489578 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5577da8eb760 con 0x5577daa304d0 2024-05-10T08:41:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f19feffd640 10 client.5382 handle_command_reply: tid=0 2024-05-10T08:41:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 client.5382 shutdown 2024-05-10T08:41:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 msgr2=0x5577daa2ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa2ed90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1a0807e780 tx=0x7f1a08080d40 comp rx=0 tx=0).stop 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 shutdown_connections 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daa2f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daa304d0 0x5577daa308b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa2ed90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1320489578 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daa2e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f19feffd640 0 client.5382 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 >> 172.21.15.37:0/1320489578 conn(0x5577da9fdbb0 msgr2=0x5577daa013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 shutdown_connections 2024-05-10T08:41:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.801+0000 7f1a2901c740 1 -- 172.21.15.37:0/1320489578 wait complete. 2024-05-10T08:41:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.802+0000 7f1a2901c740 20 client.5382 trim_cache size 0 max 16384 2024-05-10T08:41:44.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.820+0000 7f1a2901c740 1 Processor -- start 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.820+0000 7f1a2901c740 1 -- start start 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa210d0 0x5577daa4a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa4ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa2b330 0x5577daa1f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a2901c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20201c00 con 0x5577daa2af50 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20200c70 con 0x5577daa2b330 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2009cec0 con 0x5577daa210d0 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa4ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa4ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44482/0 (socket says 172.21.15.37:44482) 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 -- 172.21.15.37:0/1038996063 learned_addr learned my addr 172.21.15.37:0/1038996063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa210d0 0x5577daa4a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a248a1640 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa2b330 0x5577daa1f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 -- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa210d0 msgr2=0x5577daa4a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa210d0 0x5577daa4a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 -- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa2b330 msgr2=0x5577daa1f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa2b330 0x5577daa1f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 -- 172.21.15.37:0/1038996063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577daa2fa40 con 0x5577daa2af50 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a17fff640 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa4ac70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1a080814a0 tx=0x7f1a08083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fc05e409deaa30 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a157fa640 1 -- 172.21.15.37:0/1038996063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0809e020 con 0x5577daa2af50 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a157fa640 1 -- 172.21.15.37:0/1038996063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0808a2e0 con 0x5577daa2af50 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.821+0000 7f1a157fa640 1 -- 172.21.15.37:0/1038996063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08085910 con 0x5577daa2af50 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 -- 172.21.15.37:0/1038996063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 msgr2=0x5577daa4ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa4ac70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1a080814a0 tx=0x7f1a08083000 comp rx=0 tx=0).stop 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 -- 172.21.15.37:0/1038996063 shutdown_connections 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa2b330 0x5577daa1f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2af50 0x5577daa4ac70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 --2- 172.21.15.37:0/1038996063 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa210d0 0x5577daa4a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 -- 172.21.15.37:0/1038996063 >> 172.21.15.37:0/1038996063 conn(0x5577da9fdbb0 msgr2=0x5577daa013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 -- 172.21.15.37:0/1038996063 shutdown_connections 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 -- 172.21.15.37:0/1038996063 wait complete. 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.822+0000 7f1a2901c740 1 -- start start 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.823+0000 7f1a2901c740 1 Processor -- start 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.823+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daac3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.823+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daac9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa4a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5577daa2e3c0 con 0x5577daa2b330 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2009d510 con 0x5577daa210d0 2024-05-10T08:41:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5577daa4da40 con 0x5577daa2af50 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 10 client.0 _ll_register_callbacks cb 0x7f1a080094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa4a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa4a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44488/0 (socket says 172.21.15.37:44488) 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 -- 172.21.15.37:0/2929192459 learned_addr learned my addr 172.21.15.37:0/2929192459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daac3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a17fff640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daac9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 -- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 msgr2=0x5577daac9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daac9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 -- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 msgr2=0x5577daac3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daac3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 -- 172.21.15.37:0/2929192459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577daa176f0 con 0x5577daa2b330 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a17fff640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daac9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a248a1640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa4a730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800eae0 tx=0x7f1a18007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dbf37e8b31ea57 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f19feffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f19feffd640 1 -- 172.21.15.37:0/2929192459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1801e060 con 0x5577daa2b330 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f19feffd640 1 -- 172.21.15.37:0/2929192459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f1a1800c420 con 0x5577daa2b330 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a0808a2e0 con 0x5577daa2b330 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f19feffd640 1 -- 172.21.15.37:0/2929192459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1a18024050 con 0x5577daa2b330 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 10 client.5388 fetch_fsmap learned FSMap version 26 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.824+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5577daa28f50 con 0x5577daa2b330 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f19feffd640 1 -- 172.21.15.37:0/2929192459 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0808a2e0 con 0x5577daa2b330 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f19feffd640 1 -- 172.21.15.37:0/2929192459 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f1a18027020 con 0x5577daa2b330 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a2901c740 10 client.5388 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a2901c740 10 client.5388 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a2901c740 20 client.5388 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daac7480 0x5577daa2e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a2901c740 4 client.5388 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "status"}) -- 0x5577daa2fc10 con 0x5577daac7480 2024-05-10T08:41:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daac7480 0x5577daa2e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f1a1ffff640 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daac7480 0x5577daa2e6a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24377867daa66cdd server_cookie=5e5c85cf9f398584 in_seq=0 out_seq=0 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.825+0000 7f19feffd640 10 client.5388 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f19feffd640 1 -- 172.21.15.37:0/2929192459 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5577daa2fc10 con 0x5577daac7480 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f19feffd640 10 client.5388 handle_command_reply: tid=0 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 client.5388 shutdown 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 msgr2=0x5577daa4a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa4a730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800eae0 tx=0x7f1a18007f60 comp rx=0 tx=0).stop 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 shutdown_connections 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x5577daac7480 0x5577daa2e6a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577daa2b330 0x5577daa4a730 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5577daa2af50 0x5577daac9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f19feffd640 0 client.5388 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 --2- 172.21.15.37:0/2929192459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577daa210d0 0x5577daac3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 >> 172.21.15.37:0/2929192459 conn(0x5577da9fdbb0 msgr2=0x5577daa2a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 shutdown_connections 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 1 -- 172.21.15.37:0/2929192459 wait complete. 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a2901c740 20 client.5388 trim_cache size 0 max 16384 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5086, 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:41:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:41:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.7716088670000003, 2024-05-10T08:41:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 26, 2024-05-10T08:41:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 49, 2024-05-10T08:41:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 49, 2024-05-10T08:41:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 11.076782914000001 2024-05-10T08:41:44.840 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:41:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a000762d0 msgr2=0x7f1a00078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a000762d0 0x7f1a00078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a10003eb0 tx=0x7f1a10009040 comp rx=0 tx=0).stop 2024-05-10T08:41:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006f060 msgr2=0x7f1a20151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006f060 0x7f1a20151920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1a0802a270 tx=0x7f1a080046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 shutdown_connections 2024-05-10T08:41:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a000762d0 0x7f1a00078790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a200d0360 0x7f1a200b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a2006f060 0x7f1a20151920 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 --2- 172.21.15.37:0/4192210574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a2006e0f0 0x7f1a2009e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.826+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 >> 172.21.15.37:0/4192210574 conn(0x7f1a2006c3a0 msgr2=0x7f1a200b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.827+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 shutdown_connections 2024-05-10T08:41:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.827+0000 7f1a26304640 1 -- 172.21.15.37:0/4192210574 wait complete. 2024-05-10T08:41:44.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:41:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.948+0000 7fc4bd220640 1 Processor -- start 2024-05-10T08:41:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.948+0000 7fc4bd220640 1 -- start start 2024-05-10T08:41:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4bd220640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b815f420 0x7fc4b80d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4bd220640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4b80d3ca0 0x7fc4b80d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4bd220640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b81630b0 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4bd220640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b80d22f0 con 0x7fc4b80d3ca0 2024-05-10T08:41:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4bd220640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80d2550 con 0x7fc4b815f420 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4b659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4b80d3ca0 0x7fc4b80d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4b759e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc4b80d1eb0 0x7fc4b80d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44252/0 (socket says 172.21.15.37:44252) 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.949+0000 7fc4b759e640 1 -- 172.21.15.37:0/710023369 learned_addr learned my addr 172.21.15.37:0/710023369 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b6d9d640 1 --2- 172.21.15.37:0/710023369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b815f420 0x7fc4b80d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b659c640 1 -- 172.21.15.37:0/710023369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b815f420 msgr2=0x7fc4b80d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b659c640 1 --2- 172.21.15.37:0/710023369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b815f420 0x7fc4b80d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b659c640 1 -- 172.21.15.37:0/710023369 >> v1:172.21.15.37:6789/0 conn(0x7fc4b80d1eb0 legacy=0x7fc4b80d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b659c640 1 -- 172.21.15.37:0/710023369 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b80d2c80 con 0x7fc4b80d3ca0 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b5d9b640 1 -- 172.21.15.37:0/710023369 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1946093992 0 0) 0x7fc4a8001110 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b6d9d640 1 --2- 172.21.15.37:0/710023369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b815f420 0x7fc4b80d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.950+0000 7fc4b659c640 1 --2- 172.21.15.37:0/710023369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d3ca0 0x7fc4b80d1970 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097a0 tx=0x7fc4a002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8058efa99c5b52b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4b5d9b640 1 -- 172.21.15.37:0/710023369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0037070 con 0x7fc4b80d3ca0 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4b5d9b640 1 -- 172.21.15.37:0/710023369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a0032440 con 0x7fc4b80d3ca0 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4b5d9b640 1 -- 172.21.15.37:0/710023369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0032810 con 0x7fc4b80d3ca0 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 -- 172.21.15.37:0/710023369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d3ca0 msgr2=0x7fc4b80d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 --2- 172.21.15.37:0/710023369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d3ca0 0x7fc4b80d1970 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097a0 tx=0x7fc4a002a180 comp rx=0 tx=0).stop 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 -- 172.21.15.37:0/710023369 shutdown_connections 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 --2- 172.21.15.37:0/710023369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d3ca0 0x7fc4b80d1970 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 --2- 172.21.15.37:0/710023369 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b815f420 0x7fc4b80d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 -- 172.21.15.37:0/710023369 >> 172.21.15.37:0/710023369 conn(0x7fc4b808eac0 msgr2=0x7fc4b809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 -- 172.21.15.37:0/710023369 shutdown_connections 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.951+0000 7fc4bd220640 1 -- 172.21.15.37:0/710023369 wait complete. 2024-05-10T08:41:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 Processor -- start 2024-05-10T08:41:44.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 -- start start 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d1eb0 0x7fc4b80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b8154410 0x7fc4b80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80cab50 0x7fc4b80cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80d2830 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80d3240 con 0x7fc4b80cab50 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4bd220640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80d53d0 con 0x7fc4b8154410 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4b6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d1eb0 0x7fc4b80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4b6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d1eb0 0x7fc4b80c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44504/0 (socket says 172.21.15.37:44504) 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.953+0000 7fc4b6d9d640 1 -- 172.21.15.37:0/4124829598 learned_addr learned my addr 172.21.15.37:0/4124829598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b659c640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b8154410 0x7fc4b80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b759e640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80cab50 0x7fc4b80cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b6d9d640 1 -- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b8154410 msgr2=0x7fc4b80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b6d9d640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b8154410 0x7fc4b80b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b6d9d640 1 -- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80cab50 msgr2=0x7fc4b80cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b6d9d640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80cab50 0x7fc4b80cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b6d9d640 1 -- 172.21.15.37:0/4124829598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b815e6e0 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4b6d9d640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d1eb0 0x7fc4b80c9f10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000ce30 tx=0x7fc4b000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4af7fe640 1 -- 172.21.15.37:0/4124829598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000f890 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4af7fe640 1 -- 172.21.15.37:0/4124829598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b000fa30 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b80c8e70 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4af7fe640 1 -- 172.21.15.37:0/4124829598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000fe00 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.954+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b80c9430 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.955+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b80693f0 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.956+0000 7fc4af7fe640 1 -- 172.21.15.37:0/4124829598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc4b0018400 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.956+0000 7fc4af7fe640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc498076300 0x7fc4980787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.956+0000 7fc4af7fe640 1 -- 172.21.15.37:0/4124829598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fc4b00983f0 con 0x7fc4b80d1eb0 2024-05-10T08:41:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.956+0000 7fc4b659c640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc498076300 0x7fc4980787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.957+0000 7fc4b659c640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc498076300 0x7fc4980787c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0034000 tx=0x7fc4a002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:44.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:44.961+0000 7fc4af7fe640 1 -- 172.21.15.37:0/4124829598 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc4b0014030 con 0x7fc4b80d1eb0 2024-05-10T08:41:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.195+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4b80d0dd0 con 0x7fc4b80d1eb0 2024-05-10T08:41:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.195+0000 7fc4af7fe640 1 -- 172.21.15.37:0/4124829598 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7fc4b000ae20 con 0x7fc4b80d1eb0 2024-05-10T08:41:45.195 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:41:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.197+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc498076300 msgr2=0x7fc4980787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.197+0000 7fc4bd220640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc498076300 0x7fc4980787c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0034000 tx=0x7fc4a002e000 comp rx=0 tx=0).stop 2024-05-10T08:41:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.197+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d1eb0 msgr2=0x7fc4b80c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.197+0000 7fc4bd220640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d1eb0 0x7fc4b80c9f10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000ce30 tx=0x7fc4b000a650 comp rx=0 tx=0).stop 2024-05-10T08:41:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.197+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 shutdown_connections 2024-05-10T08:41:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.197+0000 7fc4bd220640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc498076300 0x7fc4980787c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.198+0000 7fc4bd220640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80cab50 0x7fc4b80cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.198+0000 7fc4bd220640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc4b8154410 0x7fc4b80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.198+0000 7fc4bd220640 1 --2- 172.21.15.37:0/4124829598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4b80d1eb0 0x7fc4b80c9f10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.198+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 >> 172.21.15.37:0/4124829598 conn(0x7fc4b808eac0 msgr2=0x7fc4b806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.198+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 shutdown_connections 2024-05-10T08:41:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45.198+0000 7fc4bd220640 1 -- 172.21.15.37:0/4124829598 wait complete. 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:41:45.208 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:41:45.209 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:41:45.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.209 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:41:45.226 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:41:45.226 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:41:45.226 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:41:45.226 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:45.226 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:41:45.226 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:45.226 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42657sec preferred_lft 42657sec 2024-05-10T08:41:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:41:45.228 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:45.229 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:41:45.229 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:41:45.229 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:41:45.229 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:41:45.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.229 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:41:45.290 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:41:45.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.292 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:41:45.349 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:41:45.349 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:41:45.349 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:41:45.349 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:41:45.349 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:41:45.350 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:41:45.350 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:41:45.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:41:45.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:41:45.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:41:45.350 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:41:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:41:45.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:45.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.480 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:41:45.496 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:41:45.496 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:41:45.496 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:41:45.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:41:45.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:41:45.562 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:45.618 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:41:45.618 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:41:45.618 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:45.674 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:41:45.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:45.759 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:45.759 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:41:45.759 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:41:45.768 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:45.768 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:41:45.768 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:41:45.768 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:41:45.768 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:41:45.779 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:41:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:41:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:41:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:41:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:41:45.781 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:41:45.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:41:45.808 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:41:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:41:45.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:45.913 INFO:teuthology.orchestra.run.smithi037.stdout:client4961 2024-05-10T08:41:45.913 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:41:45.914 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:41:45.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.930 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-05-10T08:41:45.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:45.992 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-05-10T08:41:46.050 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:41:46.050 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:41:46.050 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:41:46.050 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:41:46.050 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-05-10T08:41:46.050 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:41:46.158 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2024-05-10T08:41:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:41:46.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:41:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.311+0000 7fadbd064640 1 Processor -- start 2024-05-10T08:41:46.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.311+0000 7fadbd064640 1 -- start start 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadbd064640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadb80b2490 0x7fadb8070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadbd064640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadb8070d20 0x7fadb80711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadbd064640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb806e110 con 0x7fadb81629b0 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadbd064640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fadb806dec0 con 0x7fadb8070d20 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadbd064640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fadb806e3f0 con 0x7fadb80b2490 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadb8070d20 0x7fadb80711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb6d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fadb81629b0 0x7fadb806eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44258/0 (socket says 172.21.15.37:44258) 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb6d9d640 1 -- 172.21.15.37:0/2063006813 learned_addr learned my addr 172.21.15.37:0/2063006813 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:46.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb759e640 1 -- 172.21.15.37:0/2063006813 >> v2:172.21.15.82:3300/0 conn(0x7fadb80b2490 msgr2=0x7fadb8070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:46.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb759e640 1 --2- 172.21.15.37:0/2063006813 >> v2:172.21.15.82:3300/0 conn(0x7fadb80b2490 0x7fadb8070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb759e640 1 -- 172.21.15.37:0/2063006813 >> v1:172.21.15.37:6789/0 conn(0x7fadb81629b0 legacy=0x7fadb806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb5d9b640 1 -- 172.21.15.37:0/2063006813 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674030262 0 0) 0x7fadb806e110 con 0x7fadb81629b0 2024-05-10T08:41:46.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.312+0000 7fadb759e640 1 -- 172.21.15.37:0/2063006813 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb806e6d0 con 0x7fadb8070d20 2024-05-10T08:41:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.313+0000 7fadb759e640 1 --2- 172.21.15.37:0/2063006813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80711d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fadb80b8fb0 tx=0x7fadb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ade1ee80e10150 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.313+0000 7fadb5d9b640 1 -- 172.21.15.37:0/2063006813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0037070 con 0x7fadb8070d20 2024-05-10T08:41:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.313+0000 7fadb5d9b640 1 -- 172.21.15.37:0/2063006813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb0032440 con 0x7fadb8070d20 2024-05-10T08:41:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.313+0000 7fadb5d9b640 1 -- 172.21.15.37:0/2063006813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0032810 con 0x7fadb8070d20 2024-05-10T08:41:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 -- 172.21.15.37:0/2063006813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 msgr2=0x7fadb80711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 --2- 172.21.15.37:0/2063006813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80711d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fadb80b8fb0 tx=0x7fadb002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 -- 172.21.15.37:0/2063006813 shutdown_connections 2024-05-10T08:41:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 --2- 172.21.15.37:0/2063006813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80711d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 --2- 172.21.15.37:0/2063006813 >> v2:172.21.15.82:3300/0 conn(0x7fadb80b2490 0x7fadb8070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 -- 172.21.15.37:0/2063006813 >> 172.21.15.37:0/2063006813 conn(0x7fadb80b49d0 msgr2=0x7fadb80b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 -- 172.21.15.37:0/2063006813 shutdown_connections 2024-05-10T08:41:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.314+0000 7fadbd064640 1 -- 172.21.15.37:0/2063006813 wait complete. 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.315+0000 7fadbd064640 1 Processor -- start 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.315+0000 7fadbd064640 1 -- start start 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadbd064640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadbd064640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fadb80b2490 0x7fadb80b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadbd064640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb81629b0 0x7fadb80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadbd064640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadb80709f0 con 0x7fadb8070d20 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadbd064640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8070870 con 0x7fadb81629b0 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadbd064640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fadb80afcb0 con 0x7fadb80b2490 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80b7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44520/0 (socket says 172.21.15.37:44520) 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 -- 172.21.15.37:0/985607203 learned_addr learned my addr 172.21.15.37:0/985607203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb759e640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb81629b0 0x7fadb80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb659c640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fadb80b2490 0x7fadb80b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 -- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fadb80b2490 msgr2=0x7fadb80b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fadb80b2490 0x7fadb80b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 -- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb81629b0 msgr2=0x7fadb80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb81629b0 0x7fadb80b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.316+0000 7fadb6d9d640 1 -- 172.21.15.37:0/985607203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb80c8930 con 0x7fadb8070d20 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.317+0000 7fadb6d9d640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80b7770 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fada800c7c0 tx=0x7fada800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.317+0000 7fad9f7fe640 1 -- 172.21.15.37:0/985607203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8018070 con 0x7fadb8070d20 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.317+0000 7fad9f7fe640 1 -- 172.21.15.37:0/985607203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada800a640 con 0x7fadb8070d20 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.317+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb80b66d0 con 0x7fadb8070d20 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.317+0000 7fad9f7fe640 1 -- 172.21.15.37:0/985607203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada800aa30 con 0x7fadb8070d20 2024-05-10T08:41:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.317+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb80b6c90 con 0x7fadb8070d20 2024-05-10T08:41:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.318+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb80693f0 con 0x7fadb8070d20 2024-05-10T08:41:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.319+0000 7fad9f7fe640 1 -- 172.21.15.37:0/985607203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fada801b070 con 0x7fadb8070d20 2024-05-10T08:41:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.319+0000 7fad9f7fe640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fada40762d0 0x7fada4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.319+0000 7fad9f7fe640 1 -- 172.21.15.37:0/985607203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fada8096d00 con 0x7fadb8070d20 2024-05-10T08:41:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.320+0000 7fadb659c640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fada40762d0 0x7fada4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.320+0000 7fadb659c640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fada40762d0 0x7fada4078790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fadb80c9930 tx=0x7fadac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.324+0000 7fad9f7fe640 1 -- 172.21.15.37:0/985607203 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fadb80c8930 con 0x7fadb8070d20 2024-05-10T08:41:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.552+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadb815f5e0 con 0x7fadb8070d20 2024-05-10T08:41:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.553+0000 7fad9f7fe640 1 -- 172.21.15.37:0/985607203 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7fada8060560 con 0x7fadb8070d20 2024-05-10T08:41:46.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:46.553 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:41:46.553 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fada40762d0 msgr2=0x7fada4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fada40762d0 0x7fada4078790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fadb80c9930 tx=0x7fadac008040 comp rx=0 tx=0).stop 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 msgr2=0x7fadb80b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80b7770 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fada800c7c0 tx=0x7fada800cc80 comp rx=0 tx=0).stop 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 shutdown_connections 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fada40762d0 0x7fada4078790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadb81629b0 0x7fadb80b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fadb80b2490 0x7fadb80b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 --2- 172.21.15.37:0/985607203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8070d20 0x7fadb80b7770 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 >> 172.21.15.37:0/985607203 conn(0x7fadb80b49d0 msgr2=0x7fadb80d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 shutdown_connections 2024-05-10T08:41:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.555+0000 7fadbd064640 1 -- 172.21.15.37:0/985607203 wait complete. 2024-05-10T08:41:46.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-05-10T08:41:46.706 INFO:teuthology.orchestra.run.smithi082.stdout:{"message":"","return_code":0} 2024-05-10T08:41:46.707 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:41:46.707 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T08:41:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 Processor -- start 2024-05-10T08:41:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 -- start start 2024-05-10T08:41:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 0x5594a8b4f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b4fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8abd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594a8a7a800 con 0x5594a8b506d0 2024-05-10T08:41:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5594a8a20f50 con 0x5594a8a78130 2024-05-10T08:41:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.753+0000 7fd56abdbf40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5594a8a7aae0 con 0x5594a8ac0990 2024-05-10T08:41:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8abd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8abd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44552/0 (socket says 172.21.15.37:44552) 2024-05-10T08:41:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 -- 172.21.15.37:0/1070479035 learned_addr learned my addr 172.21.15.37:0/1070479035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd5686d5640 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 0x5594a8b4f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd567ed4640 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b4fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 -- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 msgr2=0x5594a8b4fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b4fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 -- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 msgr2=0x5594a8b4f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 0x5594a8b4f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 -- 172.21.15.37:0/1070479035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a8b4ccc0 con 0x5594a8b506d0 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd567ed4640 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b4fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd568ed6640 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8abd140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd560045ed0 tx=0x7fd560051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d553e1ab96c34f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd566ed2640 1 -- 172.21.15.37:0/1070479035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560062070 con 0x5594a8b506d0 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd566ed2640 1 -- 172.21.15.37:0/1070479035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd560054970 con 0x5594a8b506d0 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.754+0000 7fd566ed2640 1 -- 172.21.15.37:0/1070479035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560054d20 con 0x5594a8b506d0 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1070479035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 msgr2=0x5594a8abd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8abd140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd560045ed0 tx=0x7fd560051000 comp rx=0 tx=0).stop 2024-05-10T08:41:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1070479035 shutdown_connections 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8abd140 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b4fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1070479035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 0x5594a8b4f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1070479035 >> 172.21.15.37:0/1070479035 conn(0x5594a8a78b30 msgr2=0x5594a8aa5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1070479035 shutdown_connections 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1070479035 wait complete. 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.755+0000 7fd56abdbf40 1 Processor -- start 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd56abdbf40 1 -- start start 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd56abdbf40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 0x5594a8a79050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd56abdbf40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b45160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd56abdbf40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8b413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd56abdbf40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594a8b4cf60 con 0x5594a8b506d0 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd56abdbf40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5594a8abee40 con 0x5594a8a78130 2024-05-10T08:41:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd56abdbf40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5594a8abeb10 con 0x5594a8ac0990 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd568ed6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8b413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd568ed6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8b413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44568/0 (socket says 172.21.15.37:44568) 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd568ed6640 1 -- 172.21.15.37:0/1925825337 learned_addr learned my addr 172.21.15.37:0/1925825337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd567ed4640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b45160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.756+0000 7fd5686d5640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 0x5594a8a79050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd568ed6640 1 -- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 msgr2=0x5594a8b45160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd568ed6640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5594a8ac0990 0x5594a8b45160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd568ed6640 1 -- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 msgr2=0x5594a8a79050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd568ed6640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594a8a78130 0x5594a8a79050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd568ed6640 1 -- 172.21.15.37:0/1925825337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a8b46870 con 0x5594a8b506d0 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd568ed6640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8b413c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd560005570 tx=0x7fd560002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd565ed0640 1 -- 172.21.15.37:0/1925825337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560076070 con 0x5594a8b506d0 2024-05-10T08:41:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd565ed0640 1 -- 172.21.15.37:0/1925825337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56006d070 con 0x5594a8b506d0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd565ed0640 1 -- 172.21.15.37:0/1925825337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560062040 con 0x5594a8b506d0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594a8b46b50 con 0x5594a8b506d0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.757+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a8b40020 con 0x5594a8b506d0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.759+0000 7fd565ed0640 1 -- 172.21.15.37:0/1925825337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd56006f070 con 0x5594a8b506d0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.759+0000 7fd565ed0640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd548074cb0 0x7fd548077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.759+0000 7fd565ed0640 1 -- 172.21.15.37:0/1925825337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7fd5600db7c0 con 0x5594a8b506d0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.759+0000 7fd5686d5640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd548074cb0 0x7fd548077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.759+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5594a8b456a0 0x5594a8b3ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.759+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) -- 0x5594a8b40820 con 0x5594a8b456a0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd567ed4640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5594a8b456a0 0x5594a8b3ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd5686d5640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd548074cb0 0x7fd548077170 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5580059b0 tx=0x7fd558007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd567ed4640 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5594a8b456a0 0x5594a8b3ee90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd567ed4640 1 -- 172.21.15.37:0/1925825337 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fd55000e040 con 0x5594a8b456a0 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5594a8b456a0 msgr2=0x5594a8b3ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5594a8b456a0 0x5594a8b3ee90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd548074cb0 msgr2=0x7fd548077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd548074cb0 0x7fd548077170 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5580059b0 tx=0x7fd558007040 comp rx=0 tx=0).stop 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 msgr2=0x5594a8b413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 --2- 172.21.15.37:0/1925825337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8b506d0 0x5594a8b413c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd560005570 tx=0x7fd560002fb0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd568ed6640 1 -- 172.21.15.37:0/1925825337 reap_dead start 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 shutdown_connections 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 >> 172.21.15.37:0/1925825337 conn(0x5594a8a78b30 msgr2=0x5594a8ac2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 shutdown_connections 2024-05-10T08:41:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.760+0000 7fd56abdbf40 1 -- 172.21.15.37:0/1925825337 wait complete. 2024-05-10T08:41:46.768 INFO:teuthology.orchestra.run.smithi037.stdout:Yalphaparent_a 2024-05-10T08:41:46.769 DEBUG:teuthology.orchestra.run.smithi037:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-10T08:41:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:41:46.854 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2024-05-10T08:41:46.854 INFO:teuthology.orchestra.run.smithi037.stdout: "ancestors": [ 2024-05-10T08:41:46.854 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:46.854 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1099511627776, 2024-05-10T08:41:46.854 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "alpha", 2024-05-10T08:41:46.854 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1, 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "parent_a", 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 8, 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: "old_pools": [] 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:41:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:46.866 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-05-10T08:41:46.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 Processor -- start 2024-05-10T08:41:46.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 -- start start 2024-05-10T08:41:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba5c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bb9c99a0 0x5571bba4c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bba596e0 0x5571bb9c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5571bb983810 con 0x5571bb981140 2024-05-10T08:41:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5571bb929f50 con 0x5571bb9c99a0 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd5051df40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5571bb983af0 con 0x5571bba596e0 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.912+0000 7efd4d5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba5c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba5c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44594/0 (socket says 172.21.15.37:44594) 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2323776608 learned_addr learned my addr 172.21.15.37:0/2323776608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4cdd1640 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bb9c99a0 0x5571bba4c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4ddd3640 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bba596e0 0x5571bb9c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bba596e0 msgr2=0x5571bb9c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bba596e0 0x5571bb9c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bb9c99a0 msgr2=0x5571bba4c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bb9c99a0 0x5571bba4c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2323776608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571bba567a0 con 0x5571bb981140 2024-05-10T08:41:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd4d5d2640 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba5c090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efd40000c00 tx=0x7efd40051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5b02e7bace5c6f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd3f7fe640 1 -- 172.21.15.37:0/2323776608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd400565e0 con 0x5571bb981140 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd3f7fe640 1 -- 172.21.15.37:0/2323776608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40056780 con 0x5571bb981140 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.913+0000 7efd3f7fe640 1 -- 172.21.15.37:0/2323776608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40056b70 con 0x5571bb981140 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 -- 172.21.15.37:0/2323776608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 msgr2=0x5571bba5c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba5c090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efd40000c00 tx=0x7efd40051000 comp rx=0 tx=0).stop 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 -- 172.21.15.37:0/2323776608 shutdown_connections 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bba596e0 0x5571bb9c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bb9c99a0 0x5571bba4c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 --2- 172.21.15.37:0/2323776608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba5c090 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 -- 172.21.15.37:0/2323776608 >> 172.21.15.37:0/2323776608 conn(0x5571bb981b40 msgr2=0x5571bba56ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 -- 172.21.15.37:0/2323776608 shutdown_connections 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 -- 172.21.15.37:0/2323776608 wait complete. 2024-05-10T08:41:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 Processor -- start 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.914+0000 7efd5051df40 1 -- start start 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd5051df40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba42a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd5051df40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bb9c99a0 0x5571bb9c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd5051df40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bba596e0 0x5571bb9c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd5051df40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5571bba564c0 con 0x5571bb981140 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd5051df40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5571bba5c8f0 con 0x5571bba596e0 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd5051df40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5571bba586d0 con 0x5571bb9c99a0 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba42a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44602/0 (socket says 172.21.15.37:44602) 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2712361184 learned_addr learned my addr 172.21.15.37:0/2712361184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4cdd1640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bb9c99a0 0x5571bb9c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4ddd3640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bba596e0 0x5571bb9c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bb9c99a0 msgr2=0x5571bb9c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5571bb9c99a0 0x5571bb9c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bba596e0 msgr2=0x5571bb9c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bba596e0 0x5571bb9c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4d5d2640 1 -- 172.21.15.37:0/2712361184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571bba43400 con 0x5571bb981140 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.915+0000 7efd4ddd3640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5571bba596e0 0x5571bb9c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.916+0000 7efd4d5d2640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba42a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efd40025c90 tx=0x7efd40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.916+0000 7efd3e7fc640 1 -- 172.21.15.37:0/2712361184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40075070 con 0x5571bb981140 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.916+0000 7efd3e7fc640 1 -- 172.21.15.37:0/2712361184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40056250 con 0x5571bb981140 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.916+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571bba478a0 con 0x5571bb981140 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.916+0000 7efd3e7fc640 1 -- 172.21.15.37:0/2712361184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40056b70 con 0x5571bb981140 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.916+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571bba42f50 con 0x5571bb981140 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.917+0000 7efd3e7fc640 1 -- 172.21.15.37:0/2712361184 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd40078070 con 0x5571bb981140 2024-05-10T08:41:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.918+0000 7efd3e7fc640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd30074cb0 0x7efd30077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.918+0000 7efd3e7fc640 1 -- 172.21.15.37:0/2712361184 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7efd400db670 con 0x5571bb981140 2024-05-10T08:41:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.918+0000 7efd5051df40 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5571bba436e0 0x5571bbafcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.918+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) -- 0x5571bba5bad0 con 0x5571bba436e0 2024-05-10T08:41:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.918+0000 7efd4cdd1640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd30074cb0 0x7efd30077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.918+0000 7efd4ddd3640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5571bba436e0 0x5571bbafcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.919+0000 7efd4cdd1640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd30074cb0 0x7efd30077170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5571bb982100 tx=0x7efd44002c40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.919+0000 7efd4ddd3640 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5571bba436e0 0x5571bbafcda0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd4ddd3640 1 -- 172.21.15.37:0/2712361184 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v49'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7efd48002980 con 0x5571bba436e0 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5571bba436e0 msgr2=0x5571bbafcda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5571bba436e0 0x5571bbafcda0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd30074cb0 msgr2=0x7efd30077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd30074cb0 0x7efd30077170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5571bb982100 tx=0x7efd44002c40 comp rx=0 tx=0).stop 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 msgr2=0x5571bba42a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 --2- 172.21.15.37:0/2712361184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571bb981140 0x5571bba42a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efd40025c90 tx=0x7efd40002fb0 comp rx=0 tx=0).stop 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd4ddd3640 1 -- 172.21.15.37:0/2712361184 reap_dead start 2024-05-10T08:41:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 shutdown_connections 2024-05-10T08:41:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 >> 172.21.15.37:0/2712361184 conn(0x5571bb981b40 msgr2=0x5571bb9c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 shutdown_connections 2024-05-10T08:41:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:46.920+0000 7efd5051df40 1 -- 172.21.15.37:0/2712361184 wait complete. 2024-05-10T08:41:46.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo daemon-helper kill ceph --cluster ceph -w 2024-05-10T08:41:46.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:46.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-05-10T08:41:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.036+0000 7f88cdfda640 1 Processor -- start 2024-05-10T08:41:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.036+0000 7f88cdfda640 1 -- start start 2024-05-10T08:41:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88cdfda640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80d3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88cdfda640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88c80d2100 0x7f88c806cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88cdfda640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c80d2f40 con 0x7f88c80d07d0 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88cdfda640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f88c815f810 con 0x7f88c80d2100 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88cdfda640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88c80d2cf0 con 0x7f88c815f430 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88c80d2100 0x7f88c806cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88c80d2100 0x7f88c806cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44612/0 (socket says 172.21.15.37:44612) 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88beffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f88c80d07d0 0x7f88c80d19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44268/0 (socket says 172.21.15.37:44268) 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.037+0000 7f88c7fff640 1 -- 172.21.15.37:0/2342679468 learned_addr learned my addr 172.21.15.37:0/2342679468 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.038+0000 7f88c77fe640 1 --2- 172.21.15.37:0/2342679468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80d3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.038+0000 7f88c7fff640 1 -- 172.21.15.37:0/2342679468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 msgr2=0x7f88c80d3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.038+0000 7f88c7fff640 1 --2- 172.21.15.37:0/2342679468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80d3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.038+0000 7f88c7fff640 1 -- 172.21.15.37:0/2342679468 >> v1:172.21.15.37:6789/0 conn(0x7f88c80d07d0 legacy=0x7f88c80d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.038+0000 7f88c7fff640 1 -- 172.21.15.37:0/2342679468 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c80d3220 con 0x7f88c80d2100 2024-05-10T08:41:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.038+0000 7f88c7fff640 1 --2- 172.21.15.37:0/2342679468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d2100 0x7f88c806cf60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009e50 tx=0x7f88c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77caf7a57d670976 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88c6ffd640 1 -- 172.21.15.37:0/2342679468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0036070 con 0x7f88c80d2100 2024-05-10T08:41:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88c6ffd640 1 -- 172.21.15.37:0/2342679468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c0031600 con 0x7f88c80d2100 2024-05-10T08:41:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88c6ffd640 1 -- 172.21.15.37:0/2342679468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c00319d0 con 0x7f88c80d2100 2024-05-10T08:41:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 -- 172.21.15.37:0/2342679468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d2100 msgr2=0x7f88c806cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 --2- 172.21.15.37:0/2342679468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d2100 0x7f88c806cf60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009e50 tx=0x7f88c002a680 comp rx=0 tx=0).stop 2024-05-10T08:41:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 -- 172.21.15.37:0/2342679468 shutdown_connections 2024-05-10T08:41:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 --2- 172.21.15.37:0/2342679468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d2100 0x7f88c806cf60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 --2- 172.21.15.37:0/2342679468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80d3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 -- 172.21.15.37:0/2342679468 >> 172.21.15.37:0/2342679468 conn(0x7f88c809e3f0 msgr2=0x7f88c80d5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 -- 172.21.15.37:0/2342679468 shutdown_connections 2024-05-10T08:41:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.039+0000 7f88cdfda640 1 -- 172.21.15.37:0/2342679468 wait complete. 2024-05-10T08:41:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.040+0000 7f88cdfda640 1 Processor -- start 2024-05-10T08:41:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88cdfda640 1 -- start start 2024-05-10T08:41:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88cdfda640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d07d0 0x7f88c80b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88cdfda640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c80d2100 0x7f88c80c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88cdfda640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88cdfda640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80d59f0 con 0x7f88c80d07d0 2024-05-10T08:41:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88cdfda640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80d37e0 con 0x7f88c80d2100 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88cdfda640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88c80d5b70 con 0x7f88c815f430 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.041+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d07d0 0x7f88c80b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d07d0 0x7f88c80b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44618/0 (socket says 172.21.15.37:44618) 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 -- 172.21.15.37:0/3520487044 learned_addr learned my addr 172.21.15.37:0/3520487044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88beffd640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c80d2100 0x7f88c80c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 -- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 msgr2=0x7f88c80c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 -- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c80d2100 msgr2=0x7f88c80c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c80d2100 0x7f88c80c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 -- 172.21.15.37:0/3520487044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c81eb2e0 con 0x7f88c80d07d0 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d07d0 0x7f88c80b6b30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f88b800d620 tx=0x7f88b800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c4ff9640 1 -- 172.21.15.37:0/3520487044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b800b620 con 0x7f88c80d07d0 2024-05-10T08:41:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c4ff9640 1 -- 172.21.15.37:0/3520487044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8019070 con 0x7f88c80d07d0 2024-05-10T08:41:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c8160170 con 0x7f88c80d07d0 2024-05-10T08:41:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88c4ff9640 1 -- 172.21.15.37:0/3520487044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b800ba00 con 0x7f88c80d07d0 2024-05-10T08:41:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.042+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c80b7070 con 0x7f88c80d07d0 2024-05-10T08:41:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.044+0000 7f88c4ff9640 1 -- 172.21.15.37:0/3520487044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f88b800bba0 con 0x7f88c80d07d0 2024-05-10T08:41:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.045+0000 7f88c4ff9640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88a80762d0 0x7f88a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.045+0000 7f88c4ff9640 1 -- 172.21.15.37:0/3520487044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f88b80979f0 con 0x7f88c80d07d0 2024-05-10T08:41:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.045+0000 7f88beffd640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88a80762d0 0x7f88a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.045+0000 7f88d0dc9740 1 Processor -- start 2024-05-10T08:41:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.045+0000 7f88d0dc9740 1 -- start start 2024-05-10T08:41:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.045+0000 7f88beffd640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88a80762d0 0x7f88a8078790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b7560 tx=0x7f88b0007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b2846ad220 0x55b28465fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28468f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468fc00 0x55b284664a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b2845c8cf0 con 0x55b28468fc00 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b284581e10 con 0x55b284690340 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b2845c4cb0 con 0x55b2846ad220 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468fc00 0x55b284664a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468fc00 0x55b284664a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44632/0 (socket says 172.21.15.37:44632) 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88c7fff640 1 -- 172.21.15.37:0/1441274544 learned_addr learned my addr 172.21.15.37:0/1441274544 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.046+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b2846ad220 0x55b28465fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88beffd640 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28468f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88c7fff640 1 -- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b2846ad220 msgr2=0x55b28465fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b2846ad220 0x55b28465fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88c7fff640 1 -- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 msgr2=0x55b28468f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28468f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88c7fff640 1 -- 172.21.15.37:0/1441274544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2843a27e0 con 0x55b28468fc00 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88beffd640 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28468f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468fc00 0x55b284664a10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009f70 tx=0x7f88c002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336e9ee9794c240d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88bd7fa640 1 -- 172.21.15.37:0/1441274544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0036040 con 0x55b28468fc00 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88bd7fa640 1 -- 172.21.15.37:0/1441274544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c0037040 con 0x55b28468fc00 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.047+0000 7f88bd7fa640 1 -- 172.21.15.37:0/1441274544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0031940 con 0x55b28468fc00 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1441274544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468fc00 msgr2=0x55b284664a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468fc00 0x55b284664a10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009f70 tx=0x7f88c002e000 comp rx=0 tx=0).stop 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1441274544 shutdown_connections 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468fc00 0x55b284664a10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28468f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1441274544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b2846ad220 0x55b28465fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1441274544 >> 172.21.15.37:0/1441274544 conn(0x55b284661e20 msgr2=0x55b2846aa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1441274544 shutdown_connections 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1441274544 wait complete. 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.048+0000 7f88d0dc9740 1 -- start start 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 1 Processor -- start 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b28467d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2846ad220 0x55b284664860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468b2e0 0x55b28467caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b284663fd0 con 0x55b28468b2e0 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b284585940 con 0x55b2846ad220 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b2846633c0 con 0x55b284690340 2024-05-10T08:41:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88d0dc9740 10 client.0 _ll_register_callbacks cb 0x55b284588440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468b2e0 0x55b28467caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468b2e0 0x55b28467caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44642/0 (socket says 172.21.15.37:44642) 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.049+0000 7f88c7fff640 1 -- 172.21.15.37:0/1376654380 learned_addr learned my addr 172.21.15.37:0/1376654380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88beffd640 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2846ad220 0x55b284664860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b28467d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88c7fff640 1 -- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 msgr2=0x55b28467d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b28467d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88c7fff640 1 -- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2846ad220 msgr2=0x55b284664860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2846ad220 0x55b284664860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88c7fff640 1 -- 172.21.15.37:0/1376654380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b284402f70 con 0x55b28468b2e0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468b2e0 0x55b28467caa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f88c0008000 tx=0x7f88c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81cc0f08f0f7d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88a67fc640 1 -- 172.21.15.37:0/1376654380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c004a020 con 0x55b28468b2e0 2024-05-10T08:41:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88a67fc640 1 -- 172.21.15.37:0/1376654380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f88c0032d10 con 0x55b28468b2e0 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c0037040 con 0x55b28468b2e0 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88a67fc640 1 -- 172.21.15.37:0/1376654380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f88c0054050 con 0x55b28468b2e0 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88d0dc9740 10 client.5439 fetch_fsmap learned FSMap version 26 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.050+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b28429a170 con 0x55b28468b2e0 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88a67fc640 1 -- 172.21.15.37:0/1376654380 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c0037040 con 0x55b28468b2e0 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88a67fc640 1 -- 172.21.15.37:0/1376654380 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f88c0057020 con 0x55b28468b2e0 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88d0dc9740 10 client.5439 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88d0dc9740 10 client.5439 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88d0dc9740 20 client.5439 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b2846bdb90 0x55b2846bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88d0dc9740 4 client.5439 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2845d6900 con 0x55b2846bdb90 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b2846bdb90 0x55b2846bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88a67fc640 10 client.5439 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.051+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b2846bdb90 0x55b2846bdfa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a7dd037e9f5669 server_cookie=5da2a4efcb6be405 in_seq=0 out_seq=0 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88a67fc640 1 -- 172.21.15.37:0/1376654380 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b2845d6900 con 0x55b2846bdb90 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88a67fc640 10 client.5439 handle_command_reply: tid=0 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 client.5439 shutdown 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468b2e0 msgr2=0x55b28467caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468b2e0 0x55b28467caa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f88c0008000 tx=0x7f88c0004ab0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 shutdown_connections 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b2846bdb90 0x55b2846bdfa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28468b2e0 0x55b28467caa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2846ad220 0x55b284664860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/1376654380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b28467d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88a67fc640 0 client.5439 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 >> 172.21.15.37:0/1376654380 conn(0x55b28468fc00 msgr2=0x55b28465f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 shutdown_connections 2024-05-10T08:41:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.052+0000 7f88d0dc9740 1 -- 172.21.15.37:0/1376654380 wait complete. 2024-05-10T08:41:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.053+0000 7f88d0dc9740 20 client.5439 trim_cache size 0 max 16384 2024-05-10T08:41:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.057+0000 7f18eb0dc640 1 Processor -- start 2024-05-10T08:41:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.057+0000 7f18eb0dc640 1 -- start start 2024-05-10T08:41:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18eb0dc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f18e415f790 0x7f18e40cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18eb0dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18e40b1be0 0x7f18e40cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18eb0dc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e40d1240 con 0x7f18e40d3a30 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18eb0dc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f18e4160820 con 0x7f18e40b1be0 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18eb0dc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f18e4160b00 con 0x7f18e415f790 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18e9679640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18e40b1be0 0x7f18e40cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18e3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f18e40d3a30 0x7f18e406d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44278/0 (socket says 172.21.15.37:44278) 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18e3fff640 1 -- 172.21.15.37:0/1553266473 learned_addr learned my addr 172.21.15.37:0/1553266473 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.058+0000 7f18e8e78640 1 --2- 172.21.15.37:0/1553266473 >> v2:172.21.15.82:3300/0 conn(0x7f18e415f790 0x7f18e40cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.059+0000 7f18e9679640 1 -- 172.21.15.37:0/1553266473 >> v2:172.21.15.82:3300/0 conn(0x7f18e415f790 msgr2=0x7f18e40cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.059+0000 7f18e9679640 1 --2- 172.21.15.37:0/1553266473 >> v2:172.21.15.82:3300/0 conn(0x7f18e415f790 0x7f18e40cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.059+0000 7f18e9679640 1 -- 172.21.15.37:0/1553266473 >> v1:172.21.15.37:6789/0 conn(0x7f18e40d3a30 legacy=0x7f18e406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.059+0000 7f18e9679640 1 -- 172.21.15.37:0/1553266473 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e40d14e0 con 0x7f18e40b1be0 2024-05-10T08:41:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.059+0000 7f18e37fe640 1 -- 172.21.15.37:0/1553266473 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381530070 0 0) 0x7f18e40d1240 con 0x7f18e40d3a30 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.059+0000 7f18e9679640 1 --2- 172.21.15.37:0/1553266473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 0x7f18e40cfcd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f18e406aa00 tx=0x7f18dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132f094b1d5a6602 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18e37fe640 1 -- 172.21.15.37:0/1553266473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc037070 con 0x7f18e40b1be0 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18e37fe640 1 -- 172.21.15.37:0/1553266473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18dc032440 con 0x7f18e40b1be0 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18e37fe640 1 -- 172.21.15.37:0/1553266473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc032810 con 0x7f18e40b1be0 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 -- 172.21.15.37:0/1553266473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 msgr2=0x7f18e40cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 --2- 172.21.15.37:0/1553266473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 0x7f18e40cfcd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f18e406aa00 tx=0x7f18dc02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 -- 172.21.15.37:0/1553266473 shutdown_connections 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 --2- 172.21.15.37:0/1553266473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 0x7f18e40cfcd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 --2- 172.21.15.37:0/1553266473 >> v2:172.21.15.82:3300/0 conn(0x7f18e415f790 0x7f18e40cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 -- 172.21.15.37:0/1553266473 >> 172.21.15.37:0/1553266473 conn(0x7f18e40d2f10 msgr2=0x7f18e40d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 -- 172.21.15.37:0/1553266473 shutdown_connections 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.060+0000 7f18eb0dc640 1 -- 172.21.15.37:0/1553266473 wait complete. 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.061+0000 7f18eb0dc640 1 Processor -- start 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.062+0000 7f18eb0dc640 1 -- start start 2024-05-10T08:41:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.062+0000 7f18eb0dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 0x7f18e414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.062+0000 7f18eb0dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e40d3a30 0x7f18e41e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.062+0000 7f18eb0dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18e415f790 0x7f18e41e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.062+0000 7f18eb0dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18e40b22b0 con 0x7f18e40b1be0 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.062+0000 7f18eb0dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18e40b2130 con 0x7f18e40d3a30 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18eb0dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f18e40cd560 con 0x7f18e415f790 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 0x7f18e414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 0x7f18e414f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44662/0 (socket says 172.21.15.37:44662) 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 -- 172.21.15.37:0/2641092766 learned_addr learned my addr 172.21.15.37:0/2641092766 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e9679640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18e415f790 0x7f18e41e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e3fff640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e40d3a30 0x7f18e41e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 -- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18e415f790 msgr2=0x7f18e41e7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18e415f790 0x7f18e41e7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 -- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e40d3a30 msgr2=0x7f18e41e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e40d3a30 0x7f18e41e75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 -- 172.21.15.37:0/2641092766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e40cafb0 con 0x7f18e40b1be0 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e8e78640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e40b1be0 0x7f18e414f490 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f18d400e9b0 tx=0x7f18d400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4017070 con 0x7f18e40b1be0 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d400c9a0 con 0x7f18e40b1be0 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18eb0dc640 1 -- 172.21.15.37:0/2641092766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e40cb290 con 0x7f18e40b1be0 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d400cd90 con 0x7f18e40b1be0 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.063+0000 7f18eb0dc640 1 -- 172.21.15.37:0/2641092766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e40cb850 con 0x7f18e40b1be0 2024-05-10T08:41:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.064+0000 7f18eb0dc640 1 -- 172.21.15.37:0/2641092766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f18e40cecf0 con 0x7f18e40b1be0 2024-05-10T08:41:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.065+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18d401a070 con 0x7f18e40b1be0 2024-05-10T08:41:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.065+0000 7f18e17fa640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18d00762d0 0x7f18d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.065+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f18d4097720 con 0x7f18e40b1be0 2024-05-10T08:41:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.066+0000 7f18e3fff640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18d00762d0 0x7f18d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.066+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+508 (secure 0 0 0) 0x7f18e40cecf0 con 0x7f18e40b1be0 2024-05-10T08:41:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.066+0000 7f18caffd640 1 -- 172.21.15.37:0/2641092766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f18bc0034b0 con 0x7f18e40b1be0 2024-05-10T08:41:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.066+0000 7f18e3fff640 1 --2- 172.21.15.37:0/2641092766 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18d00762d0 0x7f18d0078790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f18e40b8e50 tx=0x7f18d8001630 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.074+0000 7f88d0dc9740 1 Processor -- start 2024-05-10T08:41:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.074+0000 7f88d0dc9740 1 -- start start 2024-05-10T08:41:47.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b28468b2e0 0x55b28468a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b284722380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8201e80 con 0x55b2846ad220 2024-05-10T08:41:47.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8200eb0 con 0x55b28468b2e0 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88c80cb760 con 0x55b284690340 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847228c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44664/0 (socket says 172.21.15.37:44664) 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c7fff640 1 -- 172.21.15.37:0/3378157346 learned_addr learned my addr 172.21.15.37:0/3378157346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b28468b2e0 0x55b28468a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88beffd640 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b284722380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c77fe640 1 -- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 msgr2=0x55b284722380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b284722380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c77fe640 1 -- 172.21.15.37:0/3378157346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 msgr2=0x55b2847228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c77fe640 1 -- 172.21.15.37:0/3378157346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2846ab140 con 0x55b28468b2e0 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88beffd640 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b284722380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.075+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:41:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.076+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b28468b2e0 0x55b28468a810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f88b8095df0 tx=0x7f88b8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97c2f5c4a2523c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.076+0000 7f88bcff9640 1 -- 172.21.15.37:0/3378157346 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8060710 con 0x55b28468b2e0 2024-05-10T08:41:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.076+0000 7f88bcff9640 1 -- 172.21.15.37:0/3378157346 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8079030 con 0x55b28468b2e0 2024-05-10T08:41:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.076+0000 7f88bcff9640 1 -- 172.21.15.37:0/3378157346 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8060c00 con 0x55b28468b2e0 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b28468b2e0 msgr2=0x55b28468a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b28468b2e0 0x55b28468a810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f88b8095df0 tx=0x7f88b8014000 comp rx=0 tx=0).stop 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3378157346 shutdown_connections 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b284690340 0x55b284722380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3378157346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b28468b2e0 0x55b28468a810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3378157346 >> 172.21.15.37:0/3378157346 conn(0x55b28468fc00 msgr2=0x55b2846635d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3378157346 shutdown_connections 2024-05-10T08:41:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3378157346 wait complete. 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 -- start start 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.077+0000 7f88d0dc9740 1 Processor -- start 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b28468b2e0 0x55b28470d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28472c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88d0dc9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847285f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8200860 con 0x55b2846ad220 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b2846aaa60 con 0x55b284690340 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88d0dc9740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b284729200 con 0x55b28468b2e0 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88d0dc9740 10 client.0 _ll_register_callbacks cb 0x7f88c0009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847285f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44666/0 (socket says 172.21.15.37:44666) 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88c7fff640 1 -- 172.21.15.37:0/3876220371 learned_addr learned my addr 172.21.15.37:0/3876220371 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b28468b2e0 0x55b28470d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.078+0000 7f88beffd640 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28472c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88c7fff640 1 -- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b28468b2e0 msgr2=0x55b28470d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b28468b2e0 0x55b28470d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88c7fff640 1 -- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 msgr2=0x55b28472c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28472c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88c7fff640 1 -- 172.21.15.37:0/3876220371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b28470e0a0 con 0x55b2846ad220 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847285f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009e50 tx=0x7f88c0009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db4289d06dddda server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88a67fc640 1 -- 172.21.15.37:0/3876220371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c004a040 con 0x55b2846ad220 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88a67fc640 1 -- 172.21.15.37:0/3876220371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f88c0003990 con 0x55b2846ad220 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88b8079030 con 0x55b2846ad220 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88a67fc640 1 -- 172.21.15.37:0/3876220371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f88c0065050 con 0x55b2846ad220 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88d0dc9740 10 client.5454 fetch_fsmap learned FSMap version 26 2024-05-10T08:41:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b284728f40 con 0x55b2846ad220 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88a67fc640 1 -- 172.21.15.37:0/3876220371 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8079030 con 0x55b2846ad220 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88a67fc640 1 -- 172.21.15.37:0/3876220371 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f88c0068020 con 0x55b2846ad220 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88d0dc9740 10 client.5454 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.079+0000 7f88d0dc9740 10 client.5454 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.080+0000 7f88d0dc9740 20 client.5454 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.080+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b284728b30 0x55b2846c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.080+0000 7f88d0dc9740 4 client.5454 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.080+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55b2845d0770 con 0x55b284728b30 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.080+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b284728b30 0x55b2846c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.080+0000 7f88a67fc640 10 client.5454 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.080+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b284728b30 0x55b2846c3fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dc1925787d86a26 server_cookie=556ec1ce5f320f6c in_seq=0 out_seq=0 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88a67fc640 1 -- 172.21.15.37:0/3876220371 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b2845d0770 con 0x55b284728b30 2024-05-10T08:41:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88a67fc640 10 client.5454 handle_command_reply: tid=0 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 client.5454 shutdown 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 msgr2=0x55b2847285f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847285f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009e50 tx=0x7f88c0009000 comp rx=0 tx=0).stop 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 shutdown_connections 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55b284728b30 0x55b2846c3fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2846ad220 0x55b2847285f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b284690340 0x55b28472c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 --2- 172.21.15.37:0/3876220371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b28468b2e0 0x55b28470d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 >> 172.21.15.37:0/3876220371 conn(0x55b28468fc00 msgr2=0x55b28468a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88a67fc640 0 client.5454 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.081+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 shutdown_connections 2024-05-10T08:41:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88d0dc9740 1 -- 172.21.15.37:0/3876220371 wait complete. 2024-05-10T08:41:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88d0dc9740 20 client.5454 trim_cache size 0 max 16384 2024-05-10T08:41:47.087 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:41:47.087 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:41:47.087 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "612321c8-5ea0-4bc0-a205-c33606410068", 2024-05-10T08:41:47.087 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:41:47.087 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:41:47.088 INFO:tasks.ceph.mds.b.smithi082.stderr:2024-05-10T08:41:47.081+0000 7f924892f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={4961=0-4194304@1} caps={4961=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=4961 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x556cf9d9ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:41:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88a80762d0 msgr2=0x7f88a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88a80762d0 0x7f88a8078790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b7560 tx=0x7f88b0007e80 comp rx=0 tx=0).stop 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d07d0 msgr2=0x7f88c80b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d07d0 0x7f88c80b6b30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f88b800d620 tx=0x7f88b800dae0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 shutdown_connections 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f88a80762d0 0x7f88a8078790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88c815f430 0x7f88c80c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88c80d2100 0x7f88c80c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 --2- 172.21.15.37:0/3520487044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80d07d0 0x7f88c80b6b30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 >> 172.21.15.37:0/3520487044 conn(0x7f88c809e3f0 msgr2=0x7f88c80d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 shutdown_connections 2024-05-10T08:41:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.082+0000 7f88cdfda640 1 -- 172.21.15.37:0/3520487044 wait complete. 2024-05-10T08:41:47.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:41:47.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-05-10T08:41:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.198+0000 7f96d41af640 1 Processor -- start 2024-05-10T08:41:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.199+0000 7f96d41af640 1 -- start start 2024-05-10T08:41:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.199+0000 7f96d41af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc0b21f0 0x7f96cc06e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.199+0000 7f96d41af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96cc0d0500 con 0x7f96cc0cfea0 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.199+0000 7f96d41af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96cc06da60 con 0x7f96cc162f50 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.199+0000 7f96d41af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f96cc06d810 con 0x7f96cc0b21f0 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d274c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96cc0cfea0 0x7f96cc0cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44284/0 (socket says 172.21.15.37:44284) 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d274c640 1 -- 172.21.15.37:0/3329210038 learned_addr learned my addr 172.21.15.37:0/3329210038 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/3329210038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc0b21f0 0x7f96cc06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d0f49640 1 -- 172.21.15.37:0/3329210038 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034432347 0 0) 0x7f96cc0d0500 con 0x7f96cc0cfea0 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d0f49640 1 -- 172.21.15.37:0/3329210038 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b4003520 con 0x7f96cc0cfea0 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d0f49640 1 -- 172.21.15.37:0/3329210038 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701299476 0 0) 0x7f96cc06da60 con 0x7f96cc162f50 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d0f49640 1 -- 172.21.15.37:0/3329210038 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96cc0d0500 con 0x7f96cc162f50 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d1f4b640 1 -- 172.21.15.37:0/3329210038 >> v1:172.21.15.82:6789/0 conn(0x7f96cc162f50 legacy=0x7f96cc0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d1f4b640 1 -- 172.21.15.37:0/3329210038 >> v1:172.21.15.37:6789/0 conn(0x7f96cc0cfea0 legacy=0x7f96cc0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.200+0000 7f96d1f4b640 1 -- 172.21.15.37:0/3329210038 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96cc06dd40 con 0x7f96cc0b21f0 2024-05-10T08:41:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.201+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/3329210038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc0b21f0 0x7f96cc06e540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f96cc06d990 tx=0x7f96c402a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3e4950e785c4768 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.201+0000 7f96d0f49640 1 -- 172.21.15.37:0/3329210038 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4037070 con 0x7f96cc0b21f0 2024-05-10T08:41:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.201+0000 7f96d0f49640 1 -- 172.21.15.37:0/3329210038 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c402ae20 con 0x7f96cc0b21f0 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.201+0000 7f96d0f49640 1 -- 172.21.15.37:0/3329210038 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4032660 con 0x7f96cc0b21f0 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.202+0000 7f96d41af640 1 -- 172.21.15.37:0/3329210038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc0b21f0 msgr2=0x7f96cc06e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.202+0000 7f96d41af640 1 --2- 172.21.15.37:0/3329210038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc0b21f0 0x7f96cc06e540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f96cc06d990 tx=0x7f96c402a0d0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.202+0000 7f96d41af640 1 -- 172.21.15.37:0/3329210038 shutdown_connections 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.202+0000 7f96d41af640 1 --2- 172.21.15.37:0/3329210038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc0b21f0 0x7f96cc06e540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.202+0000 7f96d41af640 1 -- 172.21.15.37:0/3329210038 >> 172.21.15.37:0/3329210038 conn(0x7f96cc09ba40 msgr2=0x7f96cc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.202+0000 7f96d41af640 1 -- 172.21.15.37:0/3329210038 shutdown_connections 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.202+0000 7f96d41af640 1 -- 172.21.15.37:0/3329210038 wait complete. 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.203+0000 7f96d41af640 1 Processor -- start 2024-05-10T08:41:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.203+0000 7f96d41af640 1 -- start start 2024-05-10T08:41:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96cc0b21f0 0x7f96cc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc0cfea0 0x7f96cc14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc162f50 0x7f96cc0b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96cc0b25d0 con 0x7f96cc0b21f0 2024-05-10T08:41:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96cc06e0b0 con 0x7f96cc0cfea0 2024-05-10T08:41:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f96cc0cdb90 con 0x7f96cc162f50 2024-05-10T08:41:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96cc0b21f0 0x7f96cc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96cc0b21f0 0x7f96cc150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44674/0 (socket says 172.21.15.37:44674) 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 -- 172.21.15.37:0/704897891 learned_addr learned my addr 172.21.15.37:0/704897891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d274c640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc162f50 0x7f96cc0b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 -- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc162f50 msgr2=0x7f96cc0b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d174a640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc0cfea0 0x7f96cc14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc162f50 0x7f96cc0b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 -- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc0cfea0 msgr2=0x7f96cc14dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc0cfea0 0x7f96cc14dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 -- 172.21.15.37:0/704897891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96cc0b73f0 con 0x7f96cc0b21f0 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d174a640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc0cfea0 0x7f96cc14dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96cc0b21f0 0x7f96cc150fa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f96c40098c0 tx=0x7f96c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96ca7fc640 1 -- 172.21.15.37:0/704897891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4041020 con 0x7f96cc0b21f0 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96ca7fc640 1 -- 172.21.15.37:0/704897891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c403c870 con 0x7f96cc0b21f0 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96cc0b76d0 con 0x7f96cc0b21f0 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96ca7fc640 1 -- 172.21.15.37:0/704897891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4037040 con 0x7f96cc0b21f0 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.204+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96cc0b7c90 con 0x7f96cc0b21f0 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.206+0000 7f96ca7fc640 1 -- 172.21.15.37:0/704897891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f96c4044020 con 0x7f96cc0b21f0 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.206+0000 7f96ca7fc640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96b80762d0 0x7f96b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.207+0000 7f96ca7fc640 1 -- 172.21.15.37:0/704897891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f96c40b7fa0 con 0x7f96cc0b21f0 2024-05-10T08:41:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.207+0000 7f96d174a640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96b80762d0 0x7f96b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.207+0000 7f96d174a640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96b80762d0 0x7f96b8078790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0d0d00 tx=0x7f96c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 Processor -- start 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 -- start start 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x5607225faaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x56072262a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262ab40 0x5607225ff950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607225c7690 con 0x56072262ab40 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560722564f30 con 0x560722648160 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56072251db20 con 0x56072262b280 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.208+0000 7f96d274c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262ab40 0x5607225ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d174a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x56072262a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262ab40 0x5607225ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44682/0 (socket says 172.21.15.37:44682) 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d1f4b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x5607225faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 -- 172.21.15.37:0/568977703 learned_addr learned my addr 172.21.15.37:0/568977703 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 -- 172.21.15.37:0/568977703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 msgr2=0x56072262a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 --2- 172.21.15.37:0/568977703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x56072262a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 -- 172.21.15.37:0/568977703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 msgr2=0x5607225faaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 --2- 172.21.15.37:0/568977703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x5607225faaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 -- 172.21.15.37:0/568977703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560722515e60 con 0x56072262ab40 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96d274c640 1 --2- 172.21.15.37:0/568977703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262ab40 0x5607225ff950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0021a0 tx=0x7f96bc00d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d501cc0a7df1c584 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96b37fe640 1 -- 172.21.15.37:0/568977703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc018070 con 0x56072262ab40 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96b37fe640 1 -- 172.21.15.37:0/568977703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96bc013670 con 0x56072262ab40 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.209+0000 7f96b37fe640 1 -- 172.21.15.37:0/568977703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc013a20 con 0x56072262ab40 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 -- 172.21.15.37:0/568977703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262ab40 msgr2=0x5607225ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/568977703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262ab40 0x5607225ff950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0021a0 tx=0x7f96bc00d5e0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 -- 172.21.15.37:0/568977703 shutdown_connections 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/568977703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262ab40 0x5607225ff950 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/568977703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x56072262a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/568977703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x5607225faaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 -- 172.21.15.37:0/568977703 >> 172.21.15.37:0/568977703 conn(0x5607225fcd60 msgr2=0x560722645600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 -- 172.21.15.37:0/568977703 shutdown_connections 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 -- 172.21.15.37:0/568977703 wait complete. 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.210+0000 7f96d6fa7740 1 -- start start 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 1 Processor -- start 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x560722625f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722642550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 0x5607226469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607225215e0 con 0x56072262b280 2024-05-10T08:41:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560722560ef0 con 0x560722648160 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5607225fef10 con 0x5607226557f0 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.211+0000 7f96d6fa7740 10 client.0 _ll_register_callbacks cb 0x56072251c320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x560722625f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x560722625f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44692/0 (socket says 172.21.15.37:44692) 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 -- 172.21.15.37:0/2331940210 learned_addr learned my addr 172.21.15.37:0/2331940210 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d174a640 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722642550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d274c640 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 0x5607226469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 -- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 msgr2=0x5607226469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 0x5607226469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 -- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 msgr2=0x560722642550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722642550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 -- 172.21.15.37:0/2331940210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607223407d0 con 0x56072262b280 2024-05-10T08:41:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x560722625f80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f96c407e2e0 tx=0x7f96c403cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53c4c369e71a887 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96b0ff9640 1 -- 172.21.15.37:0/2331940210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c40b4060 con 0x56072262b280 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96b0ff9640 1 -- 172.21.15.37:0/2331940210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f96c40850d0 con 0x56072262b280 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96bc013670 con 0x56072262b280 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96b0ff9640 1 -- 172.21.15.37:0/2331940210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96c409f050 con 0x56072262b280 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d6fa7740 10 client.5466 fetch_fsmap learned FSMap version 26 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5607222763f0 con 0x56072262b280 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.212+0000 7f96b0ff9640 1 -- 172.21.15.37:0/2331940210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96bc013670 con 0x56072262b280 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96b0ff9640 1 -- 172.21.15.37:0/2331940210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f96c40a2020 con 0x56072262b280 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d6fa7740 10 client.5466 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d6fa7740 10 client.5466 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d6fa7740 20 client.5466 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x56072262cb80 0x56072262cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d6fa7740 4 client.5466 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560722572b40 con 0x56072262cb80 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d174a640 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x56072262cb80 0x56072262cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96b0ff9640 10 client.5466 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.213+0000 7f96d174a640 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x56072262cb80 0x56072262cfa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd90d471a89732b7 server_cookie=91b388cb7ce80e52 in_seq=0 out_seq=0 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96b0ff9640 1 -- 172.21.15.37:0/2331940210 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560722572b40 con 0x56072262cb80 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96b0ff9640 10 client.5466 handle_command_reply: tid=0 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 client.5466 shutdown 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 msgr2=0x560722625f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x560722625f80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f96c407e2e0 tx=0x7f96c403cfa0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 shutdown_connections 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 0x5607226469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722642550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x56072262cb80 0x56072262cfa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/2331940210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x560722625f80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96b0ff9640 0 client.5466 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 >> 172.21.15.37:0/2331940210 conn(0x56072262ab40 msgr2=0x5607225fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 shutdown_connections 2024-05-10T08:41:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 1 -- 172.21.15.37:0/2331940210 wait complete. 2024-05-10T08:41:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.214+0000 7f96d6fa7740 20 client.5466 trim_cache size 0 max 16384 2024-05-10T08:41:47.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.232+0000 7f96d6fa7740 1 Processor -- start 2024-05-10T08:41:47.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.232+0000 7f96d6fa7740 1 -- start start 2024-05-10T08:41:47.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x5607226459b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722646730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 0x5607226696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96cc201e00 con 0x56072262b280 2024-05-10T08:41:47.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96cc200e50 con 0x560722648160 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f96cc14ed10 con 0x5607226557f0 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x5607226459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x5607226459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44702/0 (socket says 172.21.15.37:44702) 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 -- 172.21.15.37:0/4066801542 learned_addr learned my addr 172.21.15.37:0/4066801542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 -- 172.21.15.37:0/4066801542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 msgr2=0x5607226696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/4066801542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 0x5607226696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 -- 172.21.15.37:0/4066801542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 msgr2=0x560722646730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/4066801542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722646730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.233+0000 7f96d1f4b640 1 -- 172.21.15.37:0/4066801542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607222360f0 con 0x56072262b280 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/4066801542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x5607226459b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f96c4081000 tx=0x7f96c4048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba01e302bbc4bfb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96b2ffd640 1 -- 172.21.15.37:0/4066801542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4080b80 con 0x56072262b280 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96b2ffd640 1 -- 172.21.15.37:0/4066801542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c4085420 con 0x56072262b280 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96b2ffd640 1 -- 172.21.15.37:0/4066801542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4089e40 con 0x56072262b280 2024-05-10T08:41:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 -- 172.21.15.37:0/4066801542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 msgr2=0x5607226459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/4066801542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x5607226459b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f96c4081000 tx=0x7f96c4048000 comp rx=0 tx=0).stop 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 -- 172.21.15.37:0/4066801542 shutdown_connections 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/4066801542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5607226557f0 0x5607226696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/4066801542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722646730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/4066801542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072262b280 0x5607226459b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 -- 172.21.15.37:0/4066801542 >> 172.21.15.37:0/4066801542 conn(0x56072262ab40 msgr2=0x5607225fb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 -- 172.21.15.37:0/4066801542 shutdown_connections 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.234+0000 7f96d6fa7740 1 -- 172.21.15.37:0/4066801542 wait complete. 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.235+0000 7f96d6fa7740 1 -- start start 2024-05-10T08:41:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.235+0000 7f96d6fa7740 1 Processor -- start 2024-05-10T08:41:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x560722627620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722658130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d6fa7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607226557f0 0x560722658670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56072262dc00 con 0x5607226557f0 2024-05-10T08:41:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607222360f0 con 0x560722648160 2024-05-10T08:41:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d6fa7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56072263c230 con 0x56072262b280 2024-05-10T08:41:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d6fa7740 10 client.0 _ll_register_callbacks cb 0x7f96c407cfa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607226557f0 0x560722658670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607226557f0 0x560722658670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44710/0 (socket says 172.21.15.37:44710) 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 -- 172.21.15.37:0/813690343 learned_addr learned my addr 172.21.15.37:0/813690343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d174a640 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722658130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x560722627620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 -- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 msgr2=0x560722627620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x560722627620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 -- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 msgr2=0x560722658130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722658130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.236+0000 7f96d274c640 1 -- 172.21.15.37:0/813690343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607226540c0 con 0x5607226557f0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d274c640 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607226557f0 0x560722658670 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96bc002230 tx=0x7f96bc0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbfa78de2257ec8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96b0ff9640 1 -- 172.21.15.37:0/813690343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc025070 con 0x5607226557f0 2024-05-10T08:41:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96b0ff9640 1 -- 172.21.15.37:0/813690343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f96bc0139b0 con 0x5607226557f0 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96c4085420 con 0x5607226557f0 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96b0ff9640 1 -- 172.21.15.37:0/813690343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96bc030050 con 0x5607226557f0 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 10 client.5472 fetch_fsmap learned FSMap version 26 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5607226694c0 con 0x5607226557f0 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96b0ff9640 1 -- 172.21.15.37:0/813690343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c4085420 con 0x5607226557f0 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96b0ff9640 1 -- 172.21.15.37:0/813690343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f96bc033020 con 0x5607226557f0 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 10 client.5472 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 10 client.5472 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 20 client.5472 populate_metadata read hostname 'smithi037' 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x560722645a20 0x5607225f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 4 client.5472 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56072256c9b0 con 0x560722645a20 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.237+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x560722645a20 0x5607225f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:41:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d1f4b640 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x560722645a20 0x5607225f99a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317300092443539f server_cookie=d243fea792fabb16 in_seq=0 out_seq=0 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96b0ff9640 10 client.5472 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96b0ff9640 1 -- 172.21.15.37:0/813690343 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x56072256c9b0 con 0x560722645a20 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96b0ff9640 10 client.5472 handle_command_reply: tid=0 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 client.5472 shutdown 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607226557f0 msgr2=0x560722658670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607226557f0 0x560722658670 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96bc002230 tx=0x7f96bc0014d0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 shutdown_connections 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x560722645a20 0x5607225f99a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607226557f0 0x560722658670 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560722648160 0x560722658130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 --2- 172.21.15.37:0/813690343 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56072262b280 0x560722627620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96b0ff9640 0 client.5472 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 >> 172.21.15.37:0/813690343 conn(0x56072262ab40 msgr2=0x56072262d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 shutdown_connections 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 1 -- 172.21.15.37:0/813690343 wait complete. 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.238+0000 7f96d6fa7740 20 client.5472 trim_cache size 0 max 16384 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout: "612321c8-5ea0-4bc0-a205-c33606410068": { 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "612321c8-5ea0-4bc0-a205-c33606410068", 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2024-05-10T08:41:47.244 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:47.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:41:47.245 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:41:47.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96b80762d0 msgr2=0x7f96b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96b80762d0 0x7f96b8078790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0d0d00 tx=0x7f96c0009040 comp rx=0 tx=0).stop 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96cc0b21f0 msgr2=0x7f96cc150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96cc0b21f0 0x7f96cc150fa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f96c40098c0 tx=0x7f96c40046c0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 shutdown_connections 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f96b80762d0 0x7f96b8078790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f96cc162f50 0x7f96cc0b6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc0cfea0 0x7f96cc14dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 --2- 172.21.15.37:0/704897891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96cc0b21f0 0x7f96cc150fa0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 >> 172.21.15.37:0/704897891 conn(0x7f96cc09ba40 msgr2=0x7f96cc0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 shutdown_connections 2024-05-10T08:41:47.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:47.239+0000 7f96d41af640 1 -- 172.21.15.37:0/704897891 wait complete. 2024-05-10T08:41:47.249 INFO:tasks.cephfs.filesystem:scrub status for tag:612321c8-5ea0-4bc0-a205-c33606410068 - {'path': '/', 'tag': '612321c8-5ea0-4bc0-a205-c33606410068', 'options': 'recursive,repair'} 2024-05-10T08:41:48.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:48.100+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 7 ==== log(6 entries from seq 1 at 2024-05-10T08:41:47.081860+0000) ==== 1078+0+0 (secure 0 0 0) 0x7f18d4095bd0 con 0x7f18e40b1be0 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: cluster: 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: id: 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: health: HEALTH_OK 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: services: 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: mon: 3 daemons, quorum a,b,c (age 108s) 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: mgr: x(active, since 103s), standbys: y 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: mds: 1/1 daemons up, 3 standby 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: osd: 8 osds: 8 up (since 97s), 8 in (since 106s) 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: data: 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: volumes: 1/1 healthy 2024-05-10T08:41:48.100 INFO:teuthology.orchestra.run.smithi037.stdout: pools: 3 pools, 97 pgs 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: objects: 23 objects, 579 KiB 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: usage: 217 MiB used, 720 GiB / 720 GiB avail 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: pgs: 97 active+clean 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: io: 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: client: 1.9 KiB/s wr, 0 op/s rd, 6 op/s wr 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:41:47.081860+0000 mds.b [INF] scrub queued for path: / 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:41:47.081863+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:41:47.081868+0000 mds.b [INF] scrub summary: active paths [/] 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:41:47.082731+0000 mds.b [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:41:47.082741+0000 mds.b [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-05-10T08:41:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:41:47.083197+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-05-10T08:41:50.399 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:41:48.752744+0000 mds.b [INF] scrub summary: idle 2024-05-10T08:41:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:41:50.400+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 8 ==== log(1 entries from seq 7 at 2024-05-10T08:41:48.752744+0000) ==== 189+0+0 (secure 0 0 0) 0x7f18d405cb30 con 0x7f18e40b1be0 2024-05-10T08:41:53.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:41:53.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:42:03.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:03.429+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 9 ==== log(4 entries from seq 113 at 2024-05-10T08:42:03.337186+0000) ==== 1120+0+0 (secure 0 0 0) 0x7f18d4060b00 con 0x7f18e40b1be0 2024-05-10T08:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:04.432+0000 7f18e17fa640 1 -- 172.21.15.37:0/2641092766 <== mon.0 v2:172.21.15.37:3300/0 10 ==== log(2 entries from seq 403 at 2024-05-10T08:42:03.425096+0000) ==== 558+0+0 (secure 0 0 0) 0x7f18d4069130 con 0x7f18e40b1be0 2024-05-10T08:42:17.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:17.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-05-10T08:42:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.369+0000 7f2f4fb19640 1 Processor -- start 2024-05-10T08:42:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.370+0000 7f2f4fb19640 1 -- start start 2024-05-10T08:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4fb19640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f48163500 0x7f2f480af790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4fb19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4806ff00 0x7f2f4806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4fb19640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f480ae750 con 0x7f2f480d08b0 2024-05-10T08:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4fb19640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2f481638e0 con 0x7f2f48163500 2024-05-10T08:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4fb19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2f480ae9d0 con 0x7f2f4806ff00 2024-05-10T08:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4d0b4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4806ff00 0x7f2f4806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4d8b5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f48163500 0x7f2f480af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4e0b6640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2f480d08b0 0x7f2f480b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:50260/0 (socket says 172.21.15.37:50260) 2024-05-10T08:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/3241604637 learned_addr learned my addr 172.21.15.37:0/3241604637 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/3241604637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4806ff00 msgr2=0x7f2f4806e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/3241604637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4806ff00 0x7f2f4806e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.371+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/3241604637 >> v1:172.21.15.82:6789/0 conn(0x7f2f480d08b0 legacy=0x7f2f480b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.372+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/3241604637 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f480aecb0 con 0x7f2f48163500 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.372+0000 7f2f4c8b3640 1 -- 172.21.15.37:0/3241604637 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56168046 0 0) 0x7f2f40001490 con 0x7f2f480d08b0 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.372+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/3241604637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f48163500 0x7f2f480af790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2f440097a0 tx=0x7f2f4402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14d2fb117b76de92 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4c8b3640 1 -- 172.21.15.37:0/3241604637 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44037070 con 0x7f2f48163500 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4c8b3640 1 -- 172.21.15.37:0/3241604637 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f44032440 con 0x7f2f48163500 2024-05-10T08:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4c8b3640 1 -- 172.21.15.37:0/3241604637 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44032810 con 0x7f2f48163500 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 -- 172.21.15.37:0/3241604637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f48163500 msgr2=0x7f2f480af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/3241604637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f48163500 0x7f2f480af790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2f440097a0 tx=0x7f2f4402a180 comp rx=0 tx=0).stop 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 -- 172.21.15.37:0/3241604637 shutdown_connections 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/3241604637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f4806ff00 0x7f2f4806e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/3241604637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f48163500 0x7f2f480af790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 -- 172.21.15.37:0/3241604637 >> 172.21.15.37:0/3241604637 conn(0x7f2f4806c3a0 msgr2=0x7f2f4806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 -- 172.21.15.37:0/3241604637 shutdown_connections 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.373+0000 7f2f4fb19640 1 -- 172.21.15.37:0/3241604637 wait complete. 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.374+0000 7f2f4fb19640 1 Processor -- start 2024-05-10T08:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4fb19640 1 -- start start 2024-05-10T08:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4fb19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4806ff00 0x7f2f48152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4fb19640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f480d08b0 0x7f2f4809d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4fb19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f48163500 0x7f2f480c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4fb19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4806e630 con 0x7f2f4806ff00 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4fb19640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f480af270 con 0x7f2f480d08b0 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4fb19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4806e7b0 con 0x7f2f48163500 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.375+0000 7f2f4d8b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4806ff00 0x7f2f48152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4806ff00 0x7f2f48152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37896/0 (socket says 172.21.15.37:37896) 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/1793618924 learned_addr learned my addr 172.21.15.37:0/1793618924 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f480d08b0 0x7f2f4809d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f48163500 0x7f2f480c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f48163500 msgr2=0x7f2f480c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f48163500 0x7f2f480c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f480d08b0 msgr2=0x7f2f4809d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f480d08b0 0x7f2f4809d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/1793618924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4809e220 con 0x7f2f4806ff00 2024-05-10T08:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4806ff00 0x7f2f48152f40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f44035040 tx=0x7f2f440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f3e7fc640 1 -- 172.21.15.37:0/1793618924 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44037040 con 0x7f2f4806ff00 2024-05-10T08:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f3e7fc640 1 -- 172.21.15.37:0/1793618924 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f44030500 con 0x7f2f4806ff00 2024-05-10T08:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4809e500 con 0x7f2f4806ff00 2024-05-10T08:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f3e7fc640 1 -- 172.21.15.37:0/1793618924 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44030910 con 0x7f2f4806ff00 2024-05-10T08:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.376+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f48153480 con 0x7f2f4806ff00 2024-05-10T08:42:17.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.378+0000 7f2f3e7fc640 1 -- 172.21.15.37:0/1793618924 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f44044020 con 0x7f2f4806ff00 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.378+0000 7f2f3e7fc640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f2c0762d0 0x7f2f2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.379+0000 7f2f3e7fc640 1 -- 172.21.15.37:0/1793618924 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f2f440b78e0 con 0x7f2f4806ff00 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.379+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f2c0762d0 0x7f2f2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.379+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f2c0762d0 0x7f2f2c078790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2f481fd870 tx=0x7f2f38009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 Processor -- start 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 -- start start 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e703af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e733600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e733b40 0x55842e708950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55842e6d0690 con 0x55842e734280 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55842e66df30 con 0x55842e751160 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55842e626b20 con 0x55842e733b40 2024-05-10T08:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f4d0b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e733600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.380+0000 7f2f4d0b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e733600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37904/0 (socket says 172.21.15.37:37904) 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d0b4640 1 -- 172.21.15.37:0/2770211042 learned_addr learned my addr 172.21.15.37:0/2770211042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e733b40 0x55842e708950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e703af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d0b4640 1 -- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e733b40 msgr2=0x55842e708950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e733b40 0x55842e708950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d0b4640 1 -- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 msgr2=0x55842e703af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e703af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d0b4640 1 -- 172.21.15.37:0/2770211042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842e61ee60 con 0x55842e734280 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e733600 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f38011ea0 tx=0x7f2f38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900a0aad46603df2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/2770211042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3801b070 con 0x55842e734280 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/2770211042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38027070 con 0x55842e734280 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.381+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/2770211042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38003a40 con 0x55842e734280 2024-05-10T08:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 -- 172.21.15.37:0/2770211042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 msgr2=0x55842e733600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e733600 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f38011ea0 tx=0x7f2f38014000 comp rx=0 tx=0).stop 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 -- 172.21.15.37:0/2770211042 shutdown_connections 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e733b40 0x55842e708950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e733600 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2770211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e703af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 -- 172.21.15.37:0/2770211042 >> 172.21.15.37:0/2770211042 conn(0x55842e705d60 msgr2=0x55842e74e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 -- 172.21.15.37:0/2770211042 shutdown_connections 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 -- 172.21.15.37:0/2770211042 wait complete. 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.382+0000 7f2f5283a740 1 -- start start 2024-05-10T08:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.383+0000 7f2f5283a740 1 Processor -- start 2024-05-10T08:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e74d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e751160 0x55842e721860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e7359b0 0x55842e7083a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55842e62a5e0 con 0x55842e7359b0 2024-05-10T08:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55842e669ef0 con 0x55842e734280 2024-05-10T08:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55842e707f10 con 0x55842e751160 2024-05-10T08:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 10 client.0 _ll_register_callbacks cb 0x55842e625320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e7359b0 0x55842e7083a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e7359b0 0x55842e7083a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37914/0 (socket says 172.21.15.37:37914) 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/3493934811 learned_addr learned my addr 172.21.15.37:0/3493934811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e74d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e751160 0x55842e721860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e751160 msgr2=0x55842e721860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e751160 0x55842e721860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 msgr2=0x55842e74d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e74d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/3493934811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55842e4497d0 con 0x55842e7359b0 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e74d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e7359b0 0x55842e7083a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007350 tx=0x7f2f40007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302588c21fd582c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f28ff9640 1 -- 172.21.15.37:0/3493934811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f400127c0 con 0x55842e7359b0 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f28ff9640 1 -- 172.21.15.37:0/3493934811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f2f40012960 con 0x55842e7359b0 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.384+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f38027070 con 0x55842e7359b0 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f28ff9640 1 -- 172.21.15.37:0/3493934811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2f40022050 con 0x55842e7359b0 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 10 client.5481 fetch_fsmap learned FSMap version 26 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55842e37f3f0 con 0x55842e7359b0 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f28ff9640 1 -- 172.21.15.37:0/3493934811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38027070 con 0x55842e7359b0 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f28ff9640 1 -- 172.21.15.37:0/3493934811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f2f40025020 con 0x55842e7359b0 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 10 client.5481 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 10 client.5481 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 20 client.5481 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e735e30 0x55842e721da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 4 client.5481 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55842e67bb40 con 0x55842e735e30 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.385+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e735e30 0x55842e721da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.386+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e735e30 0x55842e721da0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8b549e4293ef39 server_cookie=86eefe5ccd413230 in_seq=0 out_seq=0 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.386+0000 7f2f28ff9640 10 client.5481 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.386+0000 7f2f28ff9640 1 -- 172.21.15.37:0/3493934811 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55842e67bb40 con 0x55842e735e30 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.386+0000 7f2f28ff9640 10 client.5481 handle_command_reply: tid=0 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.386+0000 7f2f5283a740 1 client.5481 shutdown 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.386+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e7359b0 msgr2=0x55842e7083a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.386+0000 7f2f5283a740 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e7359b0 0x55842e7083a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007350 tx=0x7f2f40007810 comp rx=0 tx=0).stop 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 shutdown_connections 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e735e30 0x55842e721da0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e7359b0 0x55842e7083a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e751160 0x55842e721860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 --2- 172.21.15.37:0/3493934811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e74d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f28ff9640 0 client.5481 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 >> 172.21.15.37:0/3493934811 conn(0x55842e733b40 msgr2=0x55842e703230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 shutdown_connections 2024-05-10T08:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 1 -- 172.21.15.37:0/3493934811 wait complete. 2024-05-10T08:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.387+0000 7f2f5283a740 20 client.5481 trim_cache size 0 max 16384 2024-05-10T08:42:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.405+0000 7f2f5283a740 1 Processor -- start 2024-05-10T08:42:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.405+0000 7f2f5283a740 1 -- start start 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e736210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e703e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e72ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f5283a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48206250 con 0x55842e734280 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f482052b0 con 0x55842e751160 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2f480b25c0 con 0x55842e7359b0 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e736210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e736210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37924/0 (socket says 172.21.15.37:37924) 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/2802166090 learned_addr learned my addr 172.21.15.37:0/2802166090 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e703e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e72ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 msgr2=0x55842e703e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e703e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 msgr2=0x55842e72ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e72ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 -- 172.21.15.37:0/2802166090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842e706ea0 con 0x55842e734280 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e736210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2f44000c00 tx=0x7f2f440b5b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ab76548f1ecb45 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f2affd640 1 -- 172.21.15.37:0/2802166090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f440b3070 con 0x55842e734280 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f2affd640 1 -- 172.21.15.37:0/2802166090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f44080a20 con 0x55842e734280 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.406+0000 7f2f2affd640 1 -- 172.21.15.37:0/2802166090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44099070 con 0x55842e734280 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 -- 172.21.15.37:0/2802166090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 msgr2=0x55842e736210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e736210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2f44000c00 tx=0x7f2f440b5b10 comp rx=0 tx=0).stop 2024-05-10T08:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 -- 172.21.15.37:0/2802166090 shutdown_connections 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e751160 0x55842e72ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e703e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 --2- 172.21.15.37:0/2802166090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e734280 0x55842e736210 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 -- 172.21.15.37:0/2802166090 >> 172.21.15.37:0/2802166090 conn(0x55842e733b40 msgr2=0x55842e72ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 -- 172.21.15.37:0/2802166090 shutdown_connections 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.407+0000 7f2f5283a740 1 -- 172.21.15.37:0/2802166090 wait complete. 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.408+0000 7f2f5283a740 1 -- start start 2024-05-10T08:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.408+0000 7f2f5283a740 1 Processor -- start 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e743f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e708160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e751160 0x55842e7cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48204c60 con 0x55842e751160 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55842e70a580 con 0x55842e734280 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55842e744820 con 0x55842e7359b0 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 10 client.0 _ll_register_callbacks cb 0x7f2f40004e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e751160 0x55842e7cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e751160 0x55842e7cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37926/0 (socket says 172.21.15.37:37926) 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/1647626415 learned_addr learned my addr 172.21.15.37:0/1647626415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e743f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4d0b4640 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e708160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 msgr2=0x55842e708160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e708160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 msgr2=0x55842e743f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e743f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 -- 172.21.15.37:0/1647626415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55842e33f0f0 con 0x55842e751160 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f4e0b6640 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e751160 0x55842e7cfe10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f40000f80 tx=0x7f2f400016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e5b04b479e0f10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f28ff9640 1 -- 172.21.15.37:0/1647626415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40015850 con 0x55842e751160 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f28ff9640 1 -- 172.21.15.37:0/1647626415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f2f400159f0 con 0x55842e751160 2024-05-10T08:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.409+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f44080a20 con 0x55842e751160 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f28ff9640 1 -- 172.21.15.37:0/1647626415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2f40015bf0 con 0x55842e751160 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 10 client.5487 fetch_fsmap learned FSMap version 26 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55842e744560 con 0x55842e751160 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f28ff9640 1 -- 172.21.15.37:0/1647626415 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f44080a20 con 0x55842e751160 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f28ff9640 1 -- 172.21.15.37:0/1647626415 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f2f40025040 con 0x55842e751160 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 10 client.5487 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 10 client.5487 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 20 client.5487 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e7b18a0 0x55842e7d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 4 client.5487 mds_command: new command op to 5086 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 --> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55842e6759b0 con 0x55842e7b18a0 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e7b18a0 0x55842e7d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f4d8b5640 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e7b18a0 0x55842e7d0350 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9a3481f771e6756 server_cookie=b012fe091d7ecb66 in_seq=0 out_seq=0 2024-05-10T08:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.410+0000 7f2f28ff9640 10 client.5487 ms_handle_connect on v2:172.21.15.82:6835/662459250 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f28ff9640 1 -- 172.21.15.37:0/1647626415 <== mds.0 v2:172.21.15.82:6835/662459250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55842e6759b0 con 0x55842e7b18a0 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f28ff9640 10 client.5487 handle_command_reply: tid=0 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 client.5487 shutdown 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e751160 msgr2=0x55842e7cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e751160 0x55842e7cfe10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f40000f80 tx=0x7f2f400016f0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 shutdown_connections 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:6835/662459250,v1:172.21.15.82:6837/662459250] conn(0x55842e7b18a0 0x55842e7d0350 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55842e751160 0x55842e7cfe10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55842e7359b0 0x55842e708160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 --2- 172.21.15.37:0/1647626415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55842e734280 0x55842e743f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f28ff9640 0 client.5487 ms_handle_reset on v2:172.21.15.82:6835/662459250 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 >> 172.21.15.37:0/1647626415 conn(0x55842e733b40 msgr2=0x55842e74dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 shutdown_connections 2024-05-10T08:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 1 -- 172.21.15.37:0/1647626415 wait complete. 2024-05-10T08:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f5283a740 20 client.5487 trim_cache size 0 max 16384 2024-05-10T08:42:17.417 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:42:17.417 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:42:17.417 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:42:17.417 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f2c0762d0 msgr2=0x7f2f2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f2c0762d0 0x7f2f2c078790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2f481fd870 tx=0x7f2f38009190 comp rx=0 tx=0).stop 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4806ff00 msgr2=0x7f2f48152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.411+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4806ff00 0x7f2f48152f40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f44035040 tx=0x7f2f440046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 shutdown_connections 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f2c0762d0 0x7f2f2c078790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f48163500 0x7f2f480c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f480d08b0 0x7f2f4809d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 --2- 172.21.15.37:0/1793618924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4806ff00 0x7f2f48152f40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 >> 172.21.15.37:0/1793618924 conn(0x7f2f4806c3a0 msgr2=0x7f2f4806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 shutdown_connections 2024-05-10T08:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.412+0000 7f2f4fb19640 1 -- 172.21.15.37:0/1793618924 wait complete. 2024-05-10T08:42:17.422 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:42:17.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.628+0000 7fe3e602a640 1 Processor -- start 2024-05-10T08:42:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.628+0000 7fe3e602a640 1 -- start start 2024-05-10T08:42:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3e602a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe3e01629b0 0x7fe3e006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3e602a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3e00b2490 0x7fe3e0070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3e602a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e006e110 con 0x7fe3e0070d20 2024-05-10T08:42:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3e602a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e006dec0 con 0x7fe3e00b2490 2024-05-10T08:42:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3e602a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e006e3f0 con 0x7fe3e01629b0 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3deffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3e00b2490 0x7fe3e0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3dffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe3e0070d20 0x7fe3e00afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50282/0 (socket says 172.21.15.37:50282) 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3dffff640 1 -- 172.21.15.37:0/2757297411 learned_addr learned my addr 172.21.15.37:0/2757297411 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3df7fe640 1 --2- 172.21.15.37:0/2757297411 >> v2:172.21.15.82:3300/0 conn(0x7fe3e01629b0 0x7fe3e006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3deffd640 1 -- 172.21.15.37:0/2757297411 >> v2:172.21.15.82:3300/0 conn(0x7fe3e01629b0 msgr2=0x7fe3e006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3deffd640 1 --2- 172.21.15.37:0/2757297411 >> v2:172.21.15.82:3300/0 conn(0x7fe3e01629b0 0x7fe3e006eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3deffd640 1 -- 172.21.15.37:0/2757297411 >> v1:172.21.15.37:6789/0 conn(0x7fe3e0070d20 legacy=0x7fe3e00afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3de7fc640 1 -- 172.21.15.37:0/2757297411 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245789234 0 0) 0x7fe3e006e110 con 0x7fe3e0070d20 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.629+0000 7fe3deffd640 1 -- 172.21.15.37:0/2757297411 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e006e6d0 con 0x7fe3e00b2490 2024-05-10T08:42:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.630+0000 7fe3deffd640 1 --2- 172.21.15.37:0/2757297411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e00b2490 0x7fe3e0070330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0068b40 tx=0x7fe3d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e8e3c829e1cdb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.630+0000 7fe3de7fc640 1 -- 172.21.15.37:0/2757297411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4037070 con 0x7fe3e00b2490 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.630+0000 7fe3de7fc640 1 -- 172.21.15.37:0/2757297411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d4032440 con 0x7fe3e00b2490 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.630+0000 7fe3de7fc640 1 -- 172.21.15.37:0/2757297411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4032810 con 0x7fe3e00b2490 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 -- 172.21.15.37:0/2757297411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e00b2490 msgr2=0x7fe3e0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 --2- 172.21.15.37:0/2757297411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e00b2490 0x7fe3e0070330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0068b40 tx=0x7fe3d402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 -- 172.21.15.37:0/2757297411 shutdown_connections 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 --2- 172.21.15.37:0/2757297411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e00b2490 0x7fe3e0070330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 --2- 172.21.15.37:0/2757297411 >> v2:172.21.15.82:3300/0 conn(0x7fe3e01629b0 0x7fe3e006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 -- 172.21.15.37:0/2757297411 >> 172.21.15.37:0/2757297411 conn(0x7fe3e00b49d0 msgr2=0x7fe3e00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 -- 172.21.15.37:0/2757297411 shutdown_connections 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.631+0000 7fe3e602a640 1 -- 172.21.15.37:0/2757297411 wait complete. 2024-05-10T08:42:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.632+0000 7fe3e602a640 1 Processor -- start 2024-05-10T08:42:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.632+0000 7fe3e602a640 1 -- start start 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3e602a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e0070d20 0x7fe3e0147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3e602a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3e00b2490 0x7fe3e00b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3e602a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e01629b0 0x7fe3e014a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3e602a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0070870 con 0x7fe3e0070d20 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3e602a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e006f410 con 0x7fe3e01629b0 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3e602a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e00709f0 con 0x7fe3e00b2490 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e0070d20 0x7fe3e0147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e0070d20 0x7fe3e0147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37946/0 (socket says 172.21.15.37:37946) 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3df7fe640 1 -- 172.21.15.37:0/198758248 learned_addr learned my addr 172.21.15.37:0/198758248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3deffd640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3e00b2490 0x7fe3e00b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3dffff640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e01629b0 0x7fe3e014a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.633+0000 7fe3df7fe640 1 -- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3e00b2490 msgr2=0x7fe3e00b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3df7fe640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3e00b2490 0x7fe3e00b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3df7fe640 1 -- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e01629b0 msgr2=0x7fe3e014a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3df7fe640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e01629b0 0x7fe3e014a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3df7fe640 1 -- 172.21.15.37:0/198758248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e00b5c60 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3deffd640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3e00b2490 0x7fe3e00b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3dffff640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e01629b0 0x7fe3e014a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3df7fe640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e0070d20 0x7fe3e0147bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d5f0 tx=0x7fe3d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3c7fff640 1 -- 172.21.15.37:0/198758248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00125f0 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3c7fff640 1 -- 172.21.15.37:0/198758248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d0019070 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e00b5f40 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3c7fff640 1 -- 172.21.15.37:0/198758248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00129d0 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.634+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e00b0b20 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.635+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e006e0b0 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.636+0000 7fe3c7fff640 1 -- 172.21.15.37:0/198758248 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe3d0012b70 con 0x7fe3e0070d20 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.636+0000 7fe3c7fff640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe3cc0762d0 0x7fe3cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.636+0000 7fe3c7fff640 1 -- 172.21.15.37:0/198758248 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fe3d0097c20 con 0x7fe3e0070d20 2024-05-10T08:42:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.636+0000 7fe3deffd640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe3cc0762d0 0x7fe3cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.637+0000 7fe3deffd640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe3cc0762d0 0x7fe3cc078790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4034000 tx=0x7fe3d402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:17.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.641+0000 7fe3c7fff640 1 -- 172.21.15.37:0/198758248 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe3e006e0b0 con 0x7fe3e0070d20 2024-05-10T08:42:17.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.870+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3e00693f0 con 0x7fe3e0070d20 2024-05-10T08:42:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.871+0000 7fe3c7fff640 1 -- 172.21.15.37:0/198758248 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7fe3d00613c0 con 0x7fe3e0070d20 2024-05-10T08:42:17.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:17.870 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:42:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:42:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe3cc0762d0 msgr2=0x7fe3cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe3cc0762d0 0x7fe3cc078790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4034000 tx=0x7fe3d402e000 comp rx=0 tx=0).stop 2024-05-10T08:42:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e0070d20 msgr2=0x7fe3e0147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e0070d20 0x7fe3e0147bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d5f0 tx=0x7fe3d000dab0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 shutdown_connections 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe3cc0762d0 0x7fe3cc078790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e01629b0 0x7fe3e014a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe3e00b2490 0x7fe3e00b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 --2- 172.21.15.37:0/198758248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3e0070d20 0x7fe3e0147bb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 >> 172.21.15.37:0/198758248 conn(0x7fe3e00b49d0 msgr2=0x7fe3e00d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 shutdown_connections 2024-05-10T08:42:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:17.873+0000 7fe3e602a640 1 -- 172.21.15.37:0/198758248 wait complete. 2024-05-10T08:42:17.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-05-10T08:42:18.024 INFO:teuthology.orchestra.run.smithi082.stdout:{"message":"","return_code":0} 2024-05-10T08:42:18.024 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:42:18.024 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T08:42:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.070+0000 7f412a467f40 1 Processor -- start 2024-05-10T08:42:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f412a467f40 1 -- start start 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f412a467f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2f10a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f412a467f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2e8b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f412a467f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 0x5565d2e8c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f412a467f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565d2e47800 con 0x5565d2e8d990 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f412a467f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565d2dedf50 con 0x5565d2e45130 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f412a467f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5565d2e47ae0 con 0x5565d2f1d6d0 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f4127762640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2e8b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f4127f63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2f10a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f4127f63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2f10a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:41230/0 (socket says 172.21.15.37:41230) 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f4127f63640 1 -- 172.21.15.37:0/854711709 learned_addr learned my addr 172.21.15.37:0/854711709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.071+0000 7f4128764640 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 0x5565d2e8c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4127762640 1 -- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 msgr2=0x5565d2e8c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4127762640 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 0x5565d2e8c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4127762640 1 -- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 msgr2=0x5565d2f10a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4127762640 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2f10a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4127762640 1 -- 172.21.15.37:0/854711709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d2f14160 con 0x5565d2e8d990 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4127f63640 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2f10a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4127762640 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2e8b920 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f411c001e30 tx=0x7f411c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f5d9a555730afd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4126760640 1 -- 172.21.15.37:0/854711709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c00e5c0 con 0x5565d2e8d990 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4126760640 1 -- 172.21.15.37:0/854711709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411c006070 con 0x5565d2e8d990 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.072+0000 7f4126760640 1 -- 172.21.15.37:0/854711709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c00e980 con 0x5565d2e8d990 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 -- 172.21.15.37:0/854711709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 msgr2=0x5565d2e8b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2e8b920 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f411c001e30 tx=0x7f411c00b6c0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 -- 172.21.15.37:0/854711709 shutdown_connections 2024-05-10T08:42:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 0x5565d2e8c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2e8b920 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 --2- 172.21.15.37:0/854711709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2f10a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 -- 172.21.15.37:0/854711709 >> 172.21.15.37:0/854711709 conn(0x5565d2e45b30 msgr2=0x5565d2e8a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 -- 172.21.15.37:0/854711709 shutdown_connections 2024-05-10T08:42:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 -- 172.21.15.37:0/854711709 wait complete. 2024-05-10T08:42:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.073+0000 7f412a467f40 1 Processor -- start 2024-05-10T08:42:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f412a467f40 1 -- start start 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f412a467f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2e74e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f412a467f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2f0ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f412a467f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 0x5565d2f0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f412a467f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565d2e72200 con 0x5565d2e8d990 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f412a467f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565d2e71fb0 con 0x5565d2e45130 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f412a467f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5565d2e724e0 con 0x5565d2f1d6d0 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f4127762640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2f0ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f4127762640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2f0ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40030/0 (socket says 172.21.15.37:40030) 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f4127762640 1 -- 172.21.15.37:0/3665237601 learned_addr learned my addr 172.21.15.37:0/3665237601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f4127f63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2e74e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.074+0000 7f4128764640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 0x5565d2f0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f4127762640 1 -- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 msgr2=0x5565d2f0b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f4127762640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565d2f1d6d0 0x5565d2f0b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f4127762640 1 -- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 msgr2=0x5565d2e74e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f4127762640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565d2e45130 0x5565d2e74e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f4127762640 1 -- 172.21.15.37:0/3665237601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d2e8ca30 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f4127762640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2f0ab90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f411c000fb0 tx=0x7f411c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f412575e640 1 -- 172.21.15.37:0/3665237601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c020020 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f412575e640 1 -- 172.21.15.37:0/3665237601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411c00f860 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565d2f14640 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f412575e640 1 -- 172.21.15.37:0/3665237601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c00fc50 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.075+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565d2f1fb80 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.077+0000 7f412575e640 1 -- 172.21.15.37:0/3665237601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f411c023020 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.077+0000 7f412575e640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4114074ce0 0x7f41140771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.077+0000 7f412575e640 1 -- 172.21.15.37:0/3665237601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f411c097e00 con 0x5565d2e8d990 2024-05-10T08:42:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.078+0000 7f4127f63640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4114074ce0 0x7f41140771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.078+0000 7f412a467f40 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5565d2f0c110 0x5565d2fbf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.078+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5565d2e75350 con 0x5565d2f0c110 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.078+0000 7f4128764640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5565d2f0c110 0x5565d2fbf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.078+0000 7f4127f63640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4114074ce0 0x7f41140771a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4118005400 tx=0x7f4118061040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.078+0000 7f4128764640 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5565d2f0c110 0x5565d2fbf8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.078+0000 7f4128764640 1 -- 172.21.15.37:0/3665237601 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f412000da00 con 0x5565d2f0c110 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5565d2f0c110 msgr2=0x5565d2fbf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5565d2f0c110 0x5565d2fbf8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4114074ce0 msgr2=0x7f41140771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4114074ce0 0x7f41140771a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4118005400 tx=0x7f4118061040 comp rx=0 tx=0).stop 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 msgr2=0x5565d2f0ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 --2- 172.21.15.37:0/3665237601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565d2e8d990 0x5565d2f0ab90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f411c000fb0 tx=0x7f411c000bc0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f4128764640 1 -- 172.21.15.37:0/3665237601 reap_dead start 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 shutdown_connections 2024-05-10T08:42:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 >> 172.21.15.37:0/3665237601 conn(0x5565d2e45b30 msgr2=0x5565d2f12a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 shutdown_connections 2024-05-10T08:42:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.079+0000 7f412a467f40 1 -- 172.21.15.37:0/3665237601 wait complete. 2024-05-10T08:42:18.085 INFO:teuthology.orchestra.run.smithi037.stdout:Yalphaparent_a 2024-05-10T08:42:18.086 DEBUG:teuthology.orchestra.run.smithi037:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-10T08:42:18.134 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:42:18.134 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "ancestors": [ 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1099511627776, 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "alpha", 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1, 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "parent_a", 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 7 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 8, 2024-05-10T08:42:18.135 INFO:teuthology.orchestra.run.smithi037.stdout: "old_pools": [] 2024-05-10T08:42:18.136 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:42:18.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:18.137 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:42:18.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:42:18.221 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:42:18.275 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:42:18.275 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:42:18.276 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:42:18.276 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:18.296 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:42:18.296 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:18.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:42:18.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.499+0000 7f46cd093640 1 Processor -- start 2024-05-10T08:42:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.499+0000 7f46cd093640 1 -- start start 2024-05-10T08:42:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46cd093640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c80d3cd0 0x7f46c80cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46cd093640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c80c9ee0 0x7f46c80d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46cd093640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c80d3330 con 0x7f46c81629a0 2024-05-10T08:42:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46cd093640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f46c80d2170 con 0x7f46c80c9ee0 2024-05-10T08:42:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46cd093640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80d2450 con 0x7f46c80d3cd0 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46bffff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c80d3cd0 0x7f46c80cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c80c9ee0 0x7f46c80d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c6d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f46c81629a0 0x7f46c80d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:38414/0 (socket says 172.21.15.37:38414) 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c6d9d640 1 -- 172.21.15.37:0/1383696981 learned_addr learned my addr 172.21.15.37:0/1383696981 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c80c9ee0 0x7f46c80d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:41254/0 (socket says 172.21.15.37:41254) 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c659c640 1 -- 172.21.15.37:0/1383696981 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1424374944 0 0) 0x7f46c80d3330 con 0x7f46c81629a0 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c759e640 1 -- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c80d3cd0 msgr2=0x7f46c80cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c759e640 1 --2- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c80d3cd0 0x7f46c80cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c759e640 1 -- 172.21.15.37:0/1383696981 >> v1:172.21.15.82:6789/0 conn(0x7f46c81629a0 legacy=0x7f46c80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46c759e640 1 -- 172.21.15.37:0/1383696981 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c80d2730 con 0x7f46c80c9ee0 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.500+0000 7f46bffff640 1 --2- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c80d3cd0 0x7f46c80cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.501+0000 7f46c759e640 1 --2- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80c9ee0 0x7f46c80d01e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009d90 tx=0x7f46c002a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80939cd2b3ed5bc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.501+0000 7f46c659c640 1 -- 172.21.15.37:0/1383696981 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0007740 con 0x7f46c80c9ee0 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.501+0000 7f46c659c640 1 -- 172.21.15.37:0/1383696981 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c00078e0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.501+0000 7f46c659c640 1 -- 172.21.15.37:0/1383696981 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0007cb0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 -- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80c9ee0 msgr2=0x7f46c80d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 --2- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80c9ee0 0x7f46c80d01e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009d90 tx=0x7f46c002a530 comp rx=0 tx=0).stop 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 -- 172.21.15.37:0/1383696981 shutdown_connections 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 --2- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80c9ee0 0x7f46c80d01e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 --2- 172.21.15.37:0/1383696981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c80d3cd0 0x7f46c80cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 -- 172.21.15.37:0/1383696981 >> 172.21.15.37:0/1383696981 conn(0x7f46c80d4fe0 msgr2=0x7f46c80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 -- 172.21.15.37:0/1383696981 shutdown_connections 2024-05-10T08:42:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.502+0000 7f46cd093640 1 -- 172.21.15.37:0/1383696981 wait complete. 2024-05-10T08:42:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.503+0000 7f46cd093640 1 Processor -- start 2024-05-10T08:42:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.503+0000 7f46cd093640 1 -- start start 2024-05-10T08:42:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46cd093640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c80c9ee0 0x7f46c80ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46cd093640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80d3cd0 0x7f46c81f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46cd093640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c81629a0 0x7f46c81f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46cd093640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80cf440 con 0x7f46c80c9ee0 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46cd093640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80cf2c0 con 0x7f46c80d3cd0 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46cd093640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80d2dc0 con 0x7f46c81629a0 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46c6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c80c9ee0 0x7f46c80ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46c6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c80c9ee0 0x7f46c80ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40038/0 (socket says 172.21.15.37:40038) 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46c6d9d640 1 -- 172.21.15.37:0/1894045800 learned_addr learned my addr 172.21.15.37:0/1894045800 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46c759e640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c81629a0 0x7f46c81f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.504+0000 7f46bffff640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80d3cd0 0x7f46c81f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46c6d9d640 1 -- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c81629a0 msgr2=0x7f46c81f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46c6d9d640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c81629a0 0x7f46c81f8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46c6d9d640 1 -- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80d3cd0 msgr2=0x7f46c81f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46c6d9d640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80d3cd0 0x7f46c81f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46c6d9d640 1 -- 172.21.15.37:0/1894045800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c80ceb60 con 0x7f46c80c9ee0 2024-05-10T08:42:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46c6d9d640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c80c9ee0 0x7f46c80ce620 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c3f0 tx=0x7f46b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46bf7fe640 1 -- 172.21.15.37:0/1894045800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b80074e0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46bf7fe640 1 -- 172.21.15.37:0/1894045800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b80047e0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c81f8d30 con 0x7f46c80c9ee0 2024-05-10T08:42:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46bf7fe640 1 -- 172.21.15.37:0/1894045800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8004c10 con 0x7f46c80c9ee0 2024-05-10T08:42:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.505+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c81f4fe0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.506+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c80693f0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.507+0000 7f46bf7fe640 1 -- 172.21.15.37:0/1894045800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46b8011070 con 0x7f46c80c9ee0 2024-05-10T08:42:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.507+0000 7f46bf7fe640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46a80762d0 0x7f46a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.507+0000 7f46bf7fe640 1 -- 172.21.15.37:0/1894045800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f46b80972d0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.507+0000 7f46bffff640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46a80762d0 0x7f46a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.508+0000 7f46bffff640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46a80762d0 0x7f46a8078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009560 tx=0x7f46b0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.511+0000 7f46bf7fe640 1 -- 172.21.15.37:0/1894045800 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f46b80603a0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.719+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f46c806d750 con 0x7f46c80c9ee0 2024-05-10T08:42:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.719+0000 7f46bf7fe640 1 -- 172.21.15.37:0/1894045800 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7f46b80646a0 con 0x7f46c80c9ee0 2024-05-10T08:42:18.719 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:42:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46a80762d0 msgr2=0x7f46a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46a80762d0 0x7f46a8078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009560 tx=0x7f46b0009190 comp rx=0 tx=0).stop 2024-05-10T08:42:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c80c9ee0 msgr2=0x7f46c80ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c80c9ee0 0x7f46c80ce620 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c3f0 tx=0x7f46b800c8b0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 shutdown_connections 2024-05-10T08:42:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46a80762d0 0x7f46a8078790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46c81629a0 0x7f46c81f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c80d3cd0 0x7f46c81f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 --2- 172.21.15.37:0/1894045800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c80c9ee0 0x7f46c80ce620 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 >> 172.21.15.37:0/1894045800 conn(0x7f46c80d4fe0 msgr2=0x7f46c80b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 shutdown_connections 2024-05-10T08:42:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:18.721+0000 7f46cd093640 1 -- 172.21.15.37:0/1894045800 wait complete. 2024-05-10T08:42:18.732 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:42:18.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:18.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:42:18.772 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:42:18.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:18.773 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:42:18.828 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:42:18.828 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:42:18.829 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:18.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:42:18.844 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:42:18.845 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:42:18.845 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:18.886 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:42:18.886 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:42:18.887 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:42:18.887 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:18.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:42:18.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.030+0000 7f3119874640 1 Processor -- start 2024-05-10T08:42:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.030+0000 7f3119874640 1 -- start start 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.030+0000 7f3119874640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f311415f420 0x7f31140d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.030+0000 7f3119874640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140d3ca0 0x7f31140d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3119874640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31141630b0 con 0x7f31140d1eb0 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3119874640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f31140d22f0 con 0x7f311415f420 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3119874640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f31140d2550 con 0x7f31140d3ca0 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f31137fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31140d1eb0 0x7f31140d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48306/0 (socket says 172.21.15.37:48306) 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f31137fe640 1 -- 172.21.15.37:0/1281613411 learned_addr learned my addr 172.21.15.37:0/1281613411 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3112ffd640 1 --2- 172.21.15.37:0/1281613411 >> v2:172.21.15.82:3300/0 conn(0x7f311415f420 0x7f31140d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f310bfff640 1 --2- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140d3ca0 0x7f31140d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f31127fc640 1 -- 172.21.15.37:0/1281613411 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831072552 0 0) 0x7f310c001490 con 0x7f31140d1eb0 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f31127fc640 1 -- 172.21.15.37:0/1281613411 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3100003520 con 0x7f31140d1eb0 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3112ffd640 1 -- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140d3ca0 msgr2=0x7f31140d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3112ffd640 1 --2- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140d3ca0 0x7f31140d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3112ffd640 1 -- 172.21.15.37:0/1281613411 >> v1:172.21.15.37:6789/0 conn(0x7f31140d1eb0 legacy=0x7f31140d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f3112ffd640 1 -- 172.21.15.37:0/1281613411 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31140d2c80 con 0x7f311415f420 2024-05-10T08:42:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.031+0000 7f310bfff640 1 --2- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140d3ca0 0x7f31140d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.032+0000 7f3112ffd640 1 --2- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311415f420 0x7f31140d3760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f31040097a0 tx=0x7f310402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897b4366d12147b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.032+0000 7f31127fc640 1 -- 172.21.15.37:0/1281613411 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104037070 con 0x7f311415f420 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.032+0000 7f31127fc640 1 -- 172.21.15.37:0/1281613411 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3104032440 con 0x7f311415f420 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.032+0000 7f31127fc640 1 -- 172.21.15.37:0/1281613411 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040327f0 con 0x7f311415f420 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 -- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311415f420 msgr2=0x7f31140d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 --2- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311415f420 0x7f31140d3760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f31040097a0 tx=0x7f310402a180 comp rx=0 tx=0).stop 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 -- 172.21.15.37:0/1281613411 shutdown_connections 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 --2- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140d3ca0 0x7f31140d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 --2- 172.21.15.37:0/1281613411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311415f420 0x7f31140d3760 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 -- 172.21.15.37:0/1281613411 >> 172.21.15.37:0/1281613411 conn(0x7f311408eac0 msgr2=0x7f311409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 -- 172.21.15.37:0/1281613411 shutdown_connections 2024-05-10T08:42:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.033+0000 7f3119874640 1 -- 172.21.15.37:0/1281613411 wait complete. 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.034+0000 7f3119874640 1 Processor -- start 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.034+0000 7f3119874640 1 -- start start 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3119874640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31140d1eb0 0x7f311415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3119874640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31140b7c30 0x7f31140ba440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3119874640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140b80b0 0x7f31140ba980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3119874640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31140d2830 con 0x7f31140d1eb0 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3119874640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f31140d3240 con 0x7f31140b7c30 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3119874640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f31140d53d0 con 0x7f31140b80b0 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31140d1eb0 0x7f311415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31140d1eb0 0x7f311415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40046/0 (socket says 172.21.15.37:40046) 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 -- 172.21.15.37:0/174342686 learned_addr learned my addr 172.21.15.37:0/174342686 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f310bfff640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31140b7c30 0x7f31140ba440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f31137fe640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140b80b0 0x7f31140ba980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 -- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140b80b0 msgr2=0x7f31140ba980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140b80b0 0x7f31140ba980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 -- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31140b7c30 msgr2=0x7f31140ba440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31140b7c30 0x7f31140ba440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 -- 172.21.15.37:0/174342686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3114160f40 con 0x7f31140d1eb0 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3112ffd640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31140d1eb0 0x7f311415a570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3104035040 tx=0x7f31040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3110ff9640 1 -- 172.21.15.37:0/174342686 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104037040 con 0x7f31140d1eb0 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3110ff9640 1 -- 172.21.15.37:0/174342686 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3104042070 con 0x7f31140d1eb0 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3114161220 con 0x7f31140d1eb0 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.035+0000 7f3110ff9640 1 -- 172.21.15.37:0/174342686 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310403b930 con 0x7f31140d1eb0 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.036+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31141617e0 con 0x7f31140d1eb0 2024-05-10T08:42:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.037+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31140693f0 con 0x7f31140d1eb0 2024-05-10T08:42:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.037+0000 7f3110ff9640 1 -- 172.21.15.37:0/174342686 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f310403bad0 con 0x7f31140d1eb0 2024-05-10T08:42:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.038+0000 7f3110ff9640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f30f40762d0 0x7f30f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.038+0000 7f3110ff9640 1 -- 172.21.15.37:0/174342686 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f31040b7ff0 con 0x7f31140d1eb0 2024-05-10T08:42:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.038+0000 7f310bfff640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f30f40762d0 0x7f30f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.038+0000 7f310bfff640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f30f40762d0 0x7f30f4078790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f31140b3ea0 tx=0x7f30fc009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.042+0000 7f3110ff9640 1 -- 172.21.15.37:0/174342686 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3104081790 con 0x7f31140d1eb0 2024-05-10T08:42:19.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.277+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31140c8280 con 0x7f31140d1eb0 2024-05-10T08:42:19.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.278+0000 7f3110ff9640 1 -- 172.21.15.37:0/174342686 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7f3104081090 con 0x7f31140d1eb0 2024-05-10T08:42:19.278 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:19.278 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:42:19.278 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f30f40762d0 msgr2=0x7f30f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f30f40762d0 0x7f30f4078790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f31140b3ea0 tx=0x7f30fc009190 comp rx=0 tx=0).stop 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31140d1eb0 msgr2=0x7f311415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31140d1eb0 0x7f311415a570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3104035040 tx=0x7f31040046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 shutdown_connections 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f30f40762d0 0x7f30f4078790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31140b80b0 0x7f31140ba980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31140b7c30 0x7f31140ba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 --2- 172.21.15.37:0/174342686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31140d1eb0 0x7f311415a570 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 >> 172.21.15.37:0/174342686 conn(0x7f311408eac0 msgr2=0x7f311406e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:19.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 shutdown_connections 2024-05-10T08:42:19.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.280+0000 7f3119874640 1 -- 172.21.15.37:0/174342686 wait complete. 2024-05-10T08:42:19.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:19.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.395+0000 7f65dab04640 1 Processor -- start 2024-05-10T08:42:19.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.395+0000 7f65dab04640 1 -- start start 2024-05-10T08:42:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65dab04640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65dab04640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65d406e8d0 0x7f65d4073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65dab04640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d40b4590 con 0x7f65d41524f0 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65dab04640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f65d40b51a0 con 0x7f65d406e8d0 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65dab04640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f65d4073450 con 0x7f65d415bc80 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d90a1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65d406e8d0 0x7f65d4073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d88a0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65d41524f0 0x7f65d40b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48322/0 (socket says 172.21.15.37:48322) 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d88a0640 1 -- 172.21.15.37:0/2412051862 learned_addr learned my addr 172.21.15.37:0/2412051862 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d3fff640 1 --2- 172.21.15.37:0/2412051862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d90a1640 1 -- 172.21.15.37:0/2412051862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 msgr2=0x7f65d406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d90a1640 1 --2- 172.21.15.37:0/2412051862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d406e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d90a1640 1 -- 172.21.15.37:0/2412051862 >> v1:172.21.15.37:6789/0 conn(0x7f65d41524f0 legacy=0x7f65d40b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d37fe640 1 -- 172.21.15.37:0/2412051862 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694951506 0 0) 0x7f65d40b4590 con 0x7f65d41524f0 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.396+0000 7f65d90a1640 1 -- 172.21.15.37:0/2412051862 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d40b4870 con 0x7f65d406e8d0 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.397+0000 7f65d90a1640 1 --2- 172.21.15.37:0/2412051862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d4073700 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009d90 tx=0x7f65cc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f47e85296d5aea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.397+0000 7f65d37fe640 1 -- 172.21.15.37:0/2412051862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc007740 con 0x7f65d406e8d0 2024-05-10T08:42:19.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.397+0000 7f65d37fe640 1 -- 172.21.15.37:0/2412051862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc0078e0 con 0x7f65d406e8d0 2024-05-10T08:42:19.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.397+0000 7f65d37fe640 1 -- 172.21.15.37:0/2412051862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc007cb0 con 0x7f65d406e8d0 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 -- 172.21.15.37:0/2412051862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 msgr2=0x7f65d4073700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 --2- 172.21.15.37:0/2412051862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d4073700 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009d90 tx=0x7f65cc02a660 comp rx=0 tx=0).stop 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 -- 172.21.15.37:0/2412051862 shutdown_connections 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 --2- 172.21.15.37:0/2412051862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d4073700 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 --2- 172.21.15.37:0/2412051862 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 -- 172.21.15.37:0/2412051862 >> 172.21.15.37:0/2412051862 conn(0x7f65d406c3a0 msgr2=0x7f65d406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 -- 172.21.15.37:0/2412051862 shutdown_connections 2024-05-10T08:42:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.398+0000 7f65dab04640 1 -- 172.21.15.37:0/2412051862 wait complete. 2024-05-10T08:42:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.399+0000 7f65dab04640 1 Processor -- start 2024-05-10T08:42:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.399+0000 7f65dab04640 1 -- start start 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65dab04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d409e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65dab04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d41524f0 0x7f65d415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65dab04640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65dab04640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40b4e30 con 0x7f65d406e8d0 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65dab04640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40b4330 con 0x7f65d41524f0 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65dab04640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f65d41528d0 con 0x7f65d415bc80 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d409e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d409e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40064/0 (socket says 172.21.15.37:40064) 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 -- 172.21.15.37:0/2251427380 learned_addr learned my addr 172.21.15.37:0/2251427380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d3fff640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d41524f0 0x7f65d415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d90a1640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 -- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 msgr2=0x7f65d415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 -- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d41524f0 msgr2=0x7f65d415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d41524f0 0x7f65d415a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.400+0000 7f65d88a0640 1 -- 172.21.15.37:0/2251427380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d415f030 con 0x7f65d406e8d0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.401+0000 7f65d88a0640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d409e390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f65c800c500 tx=0x7f65c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.401+0000 7f65d17fa640 1 -- 172.21.15.37:0/2251427380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8018070 con 0x7f65d406e8d0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.401+0000 7f65d17fa640 1 -- 172.21.15.37:0/2251427380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8007580 con 0x7f65d406e8d0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.401+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d415f310 con 0x7f65d406e8d0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.401+0000 7f65d17fa640 1 -- 172.21.15.37:0/2251427380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8004a20 con 0x7f65d406e8d0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.401+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d415f8d0 con 0x7f65d406e8d0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.402+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d40693f0 con 0x7f65d406e8d0 2024-05-10T08:42:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.402+0000 7f65d17fa640 1 -- 172.21.15.37:0/2251427380 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f65c8004bc0 con 0x7f65d406e8d0 2024-05-10T08:42:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.403+0000 7f65d17fa640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65b80762d0 0x7f65b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.403+0000 7f65d17fa640 1 -- 172.21.15.37:0/2251427380 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f65c8096a40 con 0x7f65d406e8d0 2024-05-10T08:42:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.403+0000 7f65d3fff640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65b80762d0 0x7f65b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.404+0000 7f65d3fff640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65b80762d0 0x7f65b8078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b19c0 tx=0x7f65c0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.407+0000 7f65d17fa640 1 -- 172.21.15.37:0/2251427380 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f65c805fb00 con 0x7f65d406e8d0 2024-05-10T08:42:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.639+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65d40d1260 con 0x7f65d406e8d0 2024-05-10T08:42:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.640+0000 7f65d17fa640 1 -- 172.21.15.37:0/2251427380 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7f65c8068140 con 0x7f65d406e8d0 2024-05-10T08:42:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:19.640 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:42:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65b80762d0 msgr2=0x7f65b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65b80762d0 0x7f65b8078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b19c0 tx=0x7f65c0008040 comp rx=0 tx=0).stop 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 msgr2=0x7f65d409e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d409e390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f65c800c500 tx=0x7f65c800c9c0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 shutdown_connections 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65b80762d0 0x7f65b8078790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65d415bc80 0x7f65d415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d41524f0 0x7f65d415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 --2- 172.21.15.37:0/2251427380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65d406e8d0 0x7f65d409e390 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 >> 172.21.15.37:0/2251427380 conn(0x7f65d406c3a0 msgr2=0x7f65d406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 shutdown_connections 2024-05-10T08:42:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.642+0000 7f65dab04640 1 -- 172.21.15.37:0/2251427380 wait complete. 2024-05-10T08:42:19.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:42:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.757+0000 7f1e8c7da640 1 Processor -- start 2024-05-10T08:42:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.757+0000 7f1e8c7da640 1 -- start start 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8c7da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e841629a0 0x7f1e840d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8c7da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e840d0cb0 0x7f1e840d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8c7da640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e840d3330 con 0x7f1e840d2dc0 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8c7da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1e840d2170 con 0x7f1e841629a0 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8c7da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1e840d2450 con 0x7f1e840d0cb0 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8a576640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e841629a0 0x7f1e840d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8a576640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e841629a0 0x7f1e840d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40078/0 (socket says 172.21.15.37:40078) 2024-05-10T08:42:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8a576640 1 -- 172.21.15.37:0/1119605339 learned_addr learned my addr 172.21.15.37:0/1119605339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8ad77640 1 --2- 172.21.15.37:0/1119605339 >> v2:172.21.15.82:3300/0 conn(0x7f1e840d0cb0 0x7f1e840d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8a576640 1 -- 172.21.15.37:0/1119605339 >> v2:172.21.15.82:3300/0 conn(0x7f1e840d0cb0 msgr2=0x7f1e840d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8a576640 1 --2- 172.21.15.37:0/1119605339 >> v2:172.21.15.82:3300/0 conn(0x7f1e840d0cb0 0x7f1e840d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8a576640 1 -- 172.21.15.37:0/1119605339 >> v1:172.21.15.82:6789/0 conn(0x7f1e840d2dc0 legacy=0x7f1e840c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.758+0000 7f1e8a576640 1 -- 172.21.15.37:0/1119605339 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e840d2730 con 0x7f1e841629a0 2024-05-10T08:42:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.759+0000 7f1e8a576640 1 --2- 172.21.15.37:0/1119605339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e841629a0 0x7f1e840d35c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e8408e380 tx=0x7f1e8002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90c3322bbb582b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.759+0000 7f1e89574640 1 -- 172.21.15.37:0/1119605339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80036070 con 0x7f1e841629a0 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.759+0000 7f1e89574640 1 -- 172.21.15.37:0/1119605339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e80031600 con 0x7f1e841629a0 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.759+0000 7f1e89574640 1 -- 172.21.15.37:0/1119605339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e800319d0 con 0x7f1e841629a0 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 -- 172.21.15.37:0/1119605339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e841629a0 msgr2=0x7f1e840d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/1119605339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e841629a0 0x7f1e840d35c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e8408e380 tx=0x7f1e8002a610 comp rx=0 tx=0).stop 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 -- 172.21.15.37:0/1119605339 shutdown_connections 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/1119605339 >> v2:172.21.15.82:3300/0 conn(0x7f1e840d0cb0 0x7f1e840d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/1119605339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e841629a0 0x7f1e840d35c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 -- 172.21.15.37:0/1119605339 >> 172.21.15.37:0/1119605339 conn(0x7f1e840d4fe0 msgr2=0x7f1e840d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 -- 172.21.15.37:0/1119605339 shutdown_connections 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.760+0000 7f1e8c7da640 1 -- 172.21.15.37:0/1119605339 wait complete. 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.761+0000 7f1e8c7da640 1 Processor -- start 2024-05-10T08:42:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.761+0000 7f1e8c7da640 1 -- start start 2024-05-10T08:42:19.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8c7da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e840d0cb0 0x7f1e840cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8c7da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840d2dc0 0x7f1e840cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8c7da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e841629a0 0x7f1e840ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8c7da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e840cf440 con 0x7f1e840d2dc0 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8c7da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1e840cf2c0 con 0x7f1e840d0cb0 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8c7da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1e840c95e0 con 0x7f1e841629a0 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840d2dc0 0x7f1e840cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840d2dc0 0x7f1e840cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40088/0 (socket says 172.21.15.37:40088) 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 -- 172.21.15.37:0/2374959086 learned_addr learned my addr 172.21.15.37:0/2374959086 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8a576640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e840d0cb0 0x7f1e840cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e8ad77640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e841629a0 0x7f1e840ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 -- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e841629a0 msgr2=0x7f1e840ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e841629a0 0x7f1e840ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 -- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e840d0cb0 msgr2=0x7f1e840cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e840d0cb0 0x7f1e840cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 -- 172.21.15.37:0/2374959086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e841f5ee0 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.762+0000 7f1e89d75640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840d2dc0 0x7f1e840cd990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c400 tx=0x7f1e7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.763+0000 7f1e7affd640 1 -- 172.21.15.37:0/2374959086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e740052d0 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.763+0000 7f1e7affd640 1 -- 172.21.15.37:0/2374959086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e74005490 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.763+0000 7f1e7affd640 1 -- 172.21.15.37:0/2374959086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74007260 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.763+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e840cc6b0 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.763+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e840cc950 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.764+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e840693f0 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.764+0000 7f1e7affd640 1 -- 172.21.15.37:0/2374959086 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e74007400 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.765+0000 7f1e7affd640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e680762d0 0x7f1e68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.765+0000 7f1e7affd640 1 -- 172.21.15.37:0/2374959086 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f1e74096bb0 con 0x7f1e840d2dc0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.765+0000 7f1e8a576640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e680762d0 0x7f1e68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:19.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.765+0000 7f1e8a576640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e680762d0 0x7f1e68078790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e80033000 tx=0x7f1e80009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.769+0000 7f1e7affd640 1 -- 172.21.15.37:0/2374959086 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1e7405fd90 con 0x7f1e840d2dc0 2024-05-10T08:42:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.961+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e840baa10 con 0x7f1e840d2dc0 2024-05-10T08:42:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.962+0000 7f1e7affd640 1 -- 172.21.15.37:0/2374959086 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16922 (secure 0 0 0) 0x7f1e740683d0 con 0x7f1e840d2dc0 2024-05-10T08:42:19.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:19.962 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":51,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:42:04.425134+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:36.103494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:37.392261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.25","mappings":[{"from":0,"to":6}]},{"pgid":"8.2d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e680762d0 msgr2=0x7f1e68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e680762d0 0x7f1e68078790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e80033000 tx=0x7f1e80009000 comp rx=0 tx=0).stop 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840d2dc0 msgr2=0x7f1e840cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840d2dc0 0x7f1e840cd990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c400 tx=0x7f1e7400c8c0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 shutdown_connections 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e680762d0 0x7f1e68078790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e841629a0 0x7f1e840ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840d2dc0 0x7f1e840cd990 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 --2- 172.21.15.37:0/2374959086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e840d0cb0 0x7f1e840cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 >> 172.21.15.37:0/2374959086 conn(0x7f1e840d4fe0 msgr2=0x7f1e84161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 shutdown_connections 2024-05-10T08:42:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:19.964+0000 7f1e8c7da640 1 -- 172.21.15.37:0/2374959086 wait complete. 2024-05-10T08:42:19.975 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:42:19.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:20.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.079+0000 7f11a6415640 1 Processor -- start 2024-05-10T08:42:20.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.079+0000 7f11a6415640 1 -- start start 2024-05-10T08:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f11a6415640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a01629a0 0x7f11a00d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f11a6415640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f11a00d2dc0 0x7f11a00d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f11a6415640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a00d3330 con 0x7f11a00c8ed0 2024-05-10T08:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f11a6415640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f11a00d2170 con 0x7f11a00d2dc0 2024-05-10T08:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f11a6415640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f11a00d2450 con 0x7f11a01629a0 2024-05-10T08:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f11a49b2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f11a00c8ed0 0x7f11a00c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48326/0 (socket says 172.21.15.37:48326) 2024-05-10T08:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f11a49b2640 1 -- 172.21.15.37:0/2747120030 learned_addr learned my addr 172.21.15.37:0/2747120030 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f1197fff640 1 --2- 172.21.15.37:0/2747120030 >> v2:172.21.15.82:3300/0 conn(0x7f11a00d2dc0 0x7f11a00d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f119ffff640 1 --2- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a01629a0 0x7f11a00d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.080+0000 7f119f7fe640 1 -- 172.21.15.37:0/2747120030 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352341082 0 0) 0x7f11a00d3330 con 0x7f11a00c8ed0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.081+0000 7f119f7fe640 1 -- 172.21.15.37:0/2747120030 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f118c003520 con 0x7f11a00c8ed0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.081+0000 7f119f7fe640 1 -- 172.21.15.37:0/2747120030 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1870006102 0 0) 0x7f118c003520 con 0x7f11a00c8ed0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.081+0000 7f1197fff640 1 -- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a01629a0 msgr2=0x7f11a00d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.081+0000 7f1197fff640 1 --2- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a01629a0 0x7f11a00d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.081+0000 7f1197fff640 1 -- 172.21.15.37:0/2747120030 >> v1:172.21.15.37:6789/0 conn(0x7f11a00c8ed0 legacy=0x7f11a00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.081+0000 7f1197fff640 1 -- 172.21.15.37:0/2747120030 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a00d2730 con 0x7f11a00d2dc0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f1197fff640 1 --2- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 0x7f11a00d3b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11880097a0 tx=0x7f118802a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6717b297ed3f19ee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f119f7fe640 1 -- 172.21.15.37:0/2747120030 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188037070 con 0x7f11a00d2dc0 2024-05-10T08:42:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f119f7fe640 1 -- 172.21.15.37:0/2747120030 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118802aa90 con 0x7f11a00d2dc0 2024-05-10T08:42:20.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f119f7fe640 1 -- 172.21.15.37:0/2747120030 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980019f0 con 0x7f11a00d2dc0 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 -- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 msgr2=0x7f11a00d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 --2- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 0x7f11a00d3b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11880097a0 tx=0x7f118802a000 comp rx=0 tx=0).stop 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 -- 172.21.15.37:0/2747120030 shutdown_connections 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 --2- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 0x7f11a00d3b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 --2- 172.21.15.37:0/2747120030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a01629a0 0x7f11a00d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 -- 172.21.15.37:0/2747120030 >> 172.21.15.37:0/2747120030 conn(0x7f11a00d4fe0 msgr2=0x7f11a00d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 -- 172.21.15.37:0/2747120030 shutdown_connections 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.082+0000 7f11a6415640 1 -- 172.21.15.37:0/2747120030 wait complete. 2024-05-10T08:42:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 Processor -- start 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 -- start start 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a00c8ed0 0x7f11a00cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 0x7f11a009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11a01629a0 0x7f11a00a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11a00cf440 con 0x7f11a01629a0 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f11a00cf2c0 con 0x7f11a00d2dc0 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.084+0000 7f11a6415640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f11a00d0cb0 con 0x7f11a00c8ed0 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11a01629a0 0x7f11a00a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f119ffff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a00c8ed0 0x7f11a00cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11a01629a0 0x7f11a00a28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40102/0 (socket says 172.21.15.37:40102) 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f119ffff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a00c8ed0 0x7f11a00cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:57860/0 (socket says 172.21.15.37:57860) 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 -- 172.21.15.37:0/1858365135 learned_addr learned my addr 172.21.15.37:0/1858365135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f1197fff640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 0x7f11a009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 -- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a00c8ed0 msgr2=0x7f11a00cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a00c8ed0 0x7f11a00cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 -- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 msgr2=0x7f11a009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 0x7f11a009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 -- 172.21.15.37:0/1858365135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a009f470 con 0x7f11a01629a0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a49b2640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11a01629a0 0x7f11a00a28a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1198001b60 tx=0x7f119800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f119d7fa640 1 -- 172.21.15.37:0/1858365135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1198017070 con 0x7f11a01629a0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f119d7fa640 1 -- 172.21.15.37:0/1858365135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1198012400 con 0x7f11a01629a0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a009f750 con 0x7f11a01629a0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f119d7fa640 1 -- 172.21.15.37:0/1858365135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980127b0 con 0x7f11a01629a0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.085+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a009fd10 con 0x7f11a01629a0 2024-05-10T08:42:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.086+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a00693f0 con 0x7f11a01629a0 2024-05-10T08:42:20.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.087+0000 7f119d7fa640 1 -- 172.21.15.37:0/1858365135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f119801a070 con 0x7f11a01629a0 2024-05-10T08:42:20.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.087+0000 7f119d7fa640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11800762d0 0x7f1180078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.088+0000 7f119d7fa640 1 -- 172.21.15.37:0/1858365135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f1198097640 con 0x7f11a01629a0 2024-05-10T08:42:20.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.088+0000 7f119ffff640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11800762d0 0x7f1180078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.088+0000 7f119ffff640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11800762d0 0x7f1180078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1190009aa0 tx=0x7f1190009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.092+0000 7f119d7fa640 1 -- 172.21.15.37:0/1858365135 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1198060790 con 0x7f11a01629a0 2024-05-10T08:42:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.320+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11a00cb0e0 con 0x7f11a01629a0 2024-05-10T08:42:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.321+0000 7f119d7fa640 1 -- 172.21.15.37:0/1858365135 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7f1198064a90 con 0x7f11a01629a0 2024-05-10T08:42:20.321 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:20.321 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:42:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11800762d0 msgr2=0x7f1180078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11800762d0 0x7f1180078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1190009aa0 tx=0x7f1190009190 comp rx=0 tx=0).stop 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11a01629a0 msgr2=0x7f11a00a28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11a01629a0 0x7f11a00a28a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1198001b60 tx=0x7f119800a430 comp rx=0 tx=0).stop 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 shutdown_connections 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f11800762d0 0x7f1180078790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11a01629a0 0x7f11a00a28a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a00d2dc0 0x7f11a009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 --2- 172.21.15.37:0/1858365135 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f11a00c8ed0 0x7f11a00cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 >> 172.21.15.37:0/1858365135 conn(0x7f11a00d4fe0 msgr2=0x7f11a006dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 shutdown_connections 2024-05-10T08:42:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.323+0000 7f11a6415640 1 -- 172.21.15.37:0/1858365135 wait complete. 2024-05-10T08:42:20.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:20.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.438+0000 7fa604d46640 1 Processor -- start 2024-05-10T08:42:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.438+0000 7fa604d46640 1 -- start start 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa604d46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600070d30 0x7fa6000d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa604d46640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa600071110 0x7fa60006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa604d46640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa600163d80 con 0x7fa600163920 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa604d46640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa6000d10d0 con 0x7fa600071110 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa604d46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa600070b80 con 0x7fa600070d30 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa5f7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa600163920 0x7fa6000703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:38432/0 (socket says 172.21.15.37:38432) 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa5f7fff640 1 -- 172.21.15.37:0/4265065613 learned_addr learned my addr 172.21.15.37:0/4265065613 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa5fed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa600071110 0x7fa60006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa5fe59c640 1 --2- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600070d30 0x7fa6000d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa5fdd9b640 1 -- 172.21.15.37:0/4265065613 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600787120 0 0) 0x7fa600163d80 con 0x7fa600163920 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.439+0000 7fa5fdd9b640 1 -- 172.21.15.37:0/4265065613 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ec003520 con 0x7fa600163920 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.440+0000 7fa5fed9d640 1 -- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600070d30 msgr2=0x7fa6000d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.440+0000 7fa5fed9d640 1 --2- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600070d30 0x7fa6000d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.440+0000 7fa5fed9d640 1 -- 172.21.15.37:0/4265065613 >> v1:172.21.15.82:6789/0 conn(0x7fa600163920 legacy=0x7fa6000703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.440+0000 7fa5fed9d640 1 -- 172.21.15.37:0/4265065613 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6000d1300 con 0x7fa600071110 2024-05-10T08:42:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.440+0000 7fa5fe59c640 1 --2- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600070d30 0x7fa6000d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.440+0000 7fa5fed9d640 1 --2- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600071110 0x7fa60006d4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009d90 tx=0x7fa5f802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbddfb31e5b80059 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.440+0000 7fa5fdd9b640 1 -- 172.21.15.37:0/4265065613 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8007740 con 0x7fa600071110 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa5fdd9b640 1 -- 172.21.15.37:0/4265065613 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f80078e0 con 0x7fa600071110 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa5fdd9b640 1 -- 172.21.15.37:0/4265065613 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8007c90 con 0x7fa600071110 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 -- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600071110 msgr2=0x7fa60006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 --2- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600071110 0x7fa60006d4b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009d90 tx=0x7fa5f802a660 comp rx=0 tx=0).stop 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 -- 172.21.15.37:0/4265065613 shutdown_connections 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 --2- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600071110 0x7fa60006d4b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 --2- 172.21.15.37:0/4265065613 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600070d30 0x7fa6000d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 -- 172.21.15.37:0/4265065613 >> 172.21.15.37:0/4265065613 conn(0x7fa6000d2e90 msgr2=0x7fa6000d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 -- 172.21.15.37:0/4265065613 shutdown_connections 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.441+0000 7fa604d46640 1 -- 172.21.15.37:0/4265065613 wait complete. 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.442+0000 7fa604d46640 1 Processor -- start 2024-05-10T08:42:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa604d46640 1 -- start start 2024-05-10T08:42:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa604d46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600070d30 0x7fa6000b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa604d46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600071110 0x7fa6000cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa604d46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600163920 0x7fa6000cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa604d46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6000d18c0 con 0x7fa600071110 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa604d46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa6000d1c30 con 0x7fa600070d30 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa604d46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa6000715a0 con 0x7fa600163920 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa5f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600071110 0x7fa6000cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa5f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600071110 0x7fa6000cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40106/0 (socket says 172.21.15.37:40106) 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2968173200 learned_addr learned my addr 172.21.15.37:0/2968173200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.443+0000 7fa5fe59c640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600070d30 0x7fa6000b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5fed9d640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600163920 0x7fa6000cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600163920 msgr2=0x7fa6000cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f7fff640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600163920 0x7fa6000cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600070d30 msgr2=0x7fa6000b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f7fff640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600070d30 0x7fa6000b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2968173200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6000b8ba0 con 0x7fa600071110 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f7fff640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600071110 0x7fa6000cc750 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8001eb0 tx=0x7fa5e800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f6ffd640 1 -- 172.21.15.37:0/2968173200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8017070 con 0x7fa600071110 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f6ffd640 1 -- 172.21.15.37:0/2968173200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e8005d00 con 0x7fa600071110 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6000ce5b0 con 0x7fa600071110 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa5f6ffd640 1 -- 172.21.15.37:0/2968173200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8007310 con 0x7fa600071110 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.444+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6000ceb70 con 0x7fa600071110 2024-05-10T08:42:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.445+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6000722a0 con 0x7fa600071110 2024-05-10T08:42:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.446+0000 7fa5f6ffd640 1 -- 172.21.15.37:0/2968173200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5e801a070 con 0x7fa600071110 2024-05-10T08:42:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.446+0000 7fa5f6ffd640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5e00762d0 0x7fa5e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.446+0000 7fa5f6ffd640 1 -- 172.21.15.37:0/2968173200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fa5e8096a10 con 0x7fa600071110 2024-05-10T08:42:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.447+0000 7fa5fe59c640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5e00762d0 0x7fa5e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.447+0000 7fa5fe59c640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5e00762d0 0x7fa5e0078790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009560 tx=0x7fa5f0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.451+0000 7fa5f6ffd640 1 -- 172.21.15.37:0/2968173200 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa6000722a0 con 0x7fa600071110 2024-05-10T08:42:20.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.683+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6000693f0 con 0x7fa600071110 2024-05-10T08:42:20.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.684+0000 7fa5f6ffd640 1 -- 172.21.15.37:0/2968173200 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5175 (secure 0 0 0) 0x7fa5e805fbf0 con 0x7fa600071110 2024-05-10T08:42:20.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:20.684 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:41:38.434380+0000","modified":"2024-05-10T08:41:41.446393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/662459250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":662459250},{"type":"v1","addr":"172.21.15.82:6837","nonce":662459250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5086,"qdb_cluster":[5086]},"id":3}]} 2024-05-10T08:42:20.684 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-05-10T08:42:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5e00762d0 msgr2=0x7fa5e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5e00762d0 0x7fa5e0078790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009560 tx=0x7fa5f0009190 comp rx=0 tx=0).stop 2024-05-10T08:42:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600071110 msgr2=0x7fa6000cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600071110 0x7fa6000cc750 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8001eb0 tx=0x7fa5e800c820 comp rx=0 tx=0).stop 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 shutdown_connections 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5e00762d0 0x7fa5e0078790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa600163920 0x7fa6000cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600071110 0x7fa6000cc750 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 --2- 172.21.15.37:0/2968173200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa600070d30 0x7fa6000b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 >> 172.21.15.37:0/2968173200 conn(0x7fa6000d2e90 msgr2=0x7fa600159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 shutdown_connections 2024-05-10T08:42:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.686+0000 7fa604d46640 1 -- 172.21.15.37:0/2968173200 wait complete. 2024-05-10T08:42:20.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:42:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.800+0000 7fa4d6378640 1 Processor -- start 2024-05-10T08:42:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.800+0000 7fa4d6378640 1 -- start start 2024-05-10T08:42:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.801+0000 7fa4d6378640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4d00d1970 0x7fa4d00d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.801+0000 7fa4d6378640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa4d00d4cc0 0x7fa4d00d50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.801+0000 7fa4d6378640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d01630b0 con 0x7fa4d015f420 2024-05-10T08:42:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.801+0000 7fa4d6378640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d00d3e70 con 0x7fa4d00d4cc0 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.801+0000 7fa4d6378640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d00d2550 con 0x7fa4d00d1970 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.801+0000 7fa4d4915640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa4d00d4cc0 0x7fa4d00d50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.802+0000 7fa4d4915640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa4d00d4cc0 0x7fa4d00d50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40112/0 (socket says 172.21.15.37:40112) 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.802+0000 7fa4d4915640 1 -- 172.21.15.37:0/1962425393 learned_addr learned my addr 172.21.15.37:0/1962425393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.802+0000 7fa4cf7fe640 1 --2- 172.21.15.37:0/1962425393 >> v2:172.21.15.82:3300/0 conn(0x7fa4d00d1970 0x7fa4d00d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.802+0000 7fa4d4915640 1 -- 172.21.15.37:0/1962425393 >> v2:172.21.15.82:3300/0 conn(0x7fa4d00d1970 msgr2=0x7fa4d00d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.802+0000 7fa4d4915640 1 --2- 172.21.15.37:0/1962425393 >> v2:172.21.15.82:3300/0 conn(0x7fa4d00d1970 0x7fa4d00d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.802+0000 7fa4d4915640 1 -- 172.21.15.37:0/1962425393 >> v1:172.21.15.82:6789/0 conn(0x7fa4d015f420 legacy=0x7fa4d00d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.802+0000 7fa4d4915640 1 -- 172.21.15.37:0/1962425393 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d00d2c80 con 0x7fa4d00d4cc0 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d4915640 1 --2- 172.21.15.37:0/1962425393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00d50e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa4d008f380 tx=0x7fa4c802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7297ce73ce88c752 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4ceffd640 1 -- 172.21.15.37:0/1962425393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8036070 con 0x7fa4d00d4cc0 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4ceffd640 1 -- 172.21.15.37:0/1962425393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c8031600 con 0x7fa4d00d4cc0 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4ceffd640 1 -- 172.21.15.37:0/1962425393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80319d0 con 0x7fa4d00d4cc0 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 -- 172.21.15.37:0/1962425393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d4cc0 msgr2=0x7fa4d00d50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 --2- 172.21.15.37:0/1962425393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00d50e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa4d008f380 tx=0x7fa4c802a6f0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 -- 172.21.15.37:0/1962425393 shutdown_connections 2024-05-10T08:42:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 --2- 172.21.15.37:0/1962425393 >> v2:172.21.15.82:3300/0 conn(0x7fa4d00d1970 0x7fa4d00d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 --2- 172.21.15.37:0/1962425393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00d50e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 -- 172.21.15.37:0/1962425393 >> 172.21.15.37:0/1962425393 conn(0x7fa4d008eac0 msgr2=0x7fa4d009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 -- 172.21.15.37:0/1962425393 shutdown_connections 2024-05-10T08:42:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.803+0000 7fa4d6378640 1 -- 172.21.15.37:0/1962425393 wait complete. 2024-05-10T08:42:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.805+0000 7fa4d6378640 1 Processor -- start 2024-05-10T08:42:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.805+0000 7fa4d6378640 1 -- start start 2024-05-10T08:42:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.805+0000 7fa4d6378640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d1970 0x7fa4d014e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d6378640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d6378640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d014eb30 0x7fa4d006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d6378640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d00d2830 con 0x7fa4d00d1970 2024-05-10T08:42:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d6378640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d00d3240 con 0x7fa4d00d4cc0 2024-05-10T08:42:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d6378640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d00d5620 con 0x7fa4d014eb30 2024-05-10T08:42:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d1970 0x7fa4d014e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d1970 0x7fa4d014e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40118/0 (socket says 172.21.15.37:40118) 2024-05-10T08:42:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 -- 172.21.15.37:0/2254473774 learned_addr learned my addr 172.21.15.37:0/2254473774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cf7fe640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d4915640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d014eb30 0x7fa4d006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 -- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d014eb30 msgr2=0x7fa4d006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d014eb30 0x7fa4d006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 -- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d00d4cc0 msgr2=0x7fa4d00b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00b90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 -- 172.21.15.37:0/2254473774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d00b9a30 con 0x7fa4d00d1970 2024-05-10T08:42:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cf7fe640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4cffff640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d1970 0x7fa4d014e440 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b3f0 tx=0x7fa4c000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4ccff9640 1 -- 172.21.15.37:0/2254473774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0015020 con 0x7fa4d00d1970 2024-05-10T08:42:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4ccff9640 1 -- 172.21.15.37:0/2254473774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c0011830 con 0x7fa4d00d1970 2024-05-10T08:42:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4ccff9640 1 -- 172.21.15.37:0/2254473774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0011c20 con 0x7fa4d00d1970 2024-05-10T08:42:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d00b9d10 con 0x7fa4d00d1970 2024-05-10T08:42:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.806+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d00ba2d0 con 0x7fa4d00d1970 2024-05-10T08:42:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.807+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d00693f0 con 0x7fa4d00d1970 2024-05-10T08:42:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.808+0000 7fa4ccff9640 1 -- 172.21.15.37:0/2254473774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa4c0018020 con 0x7fa4d00d1970 2024-05-10T08:42:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.808+0000 7fa4ccff9640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4bc0762d0 0x7fa4bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.809+0000 7fa4ccff9640 1 -- 172.21.15.37:0/2254473774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7fa4c00973f0 con 0x7fa4d00d1970 2024-05-10T08:42:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.809+0000 7fa4cf7fe640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4bc0762d0 0x7fa4bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.809+0000 7fa4cf7fe640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4bc0762d0 0x7fa4bc078790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00a2f90 tx=0x7fa4c4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:20.813+0000 7fa4ccff9640 1 -- 172.21.15.37:0/2254473774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa4c001f030 con 0x7fa4d00d1970 2024-05-10T08:42:21.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.004+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4d00b4c50 con 0x7fa4d00d1970 2024-05-10T08:42:21.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.005+0000 7fa4ccff9640 1 -- 172.21.15.37:0/2254473774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16922 (secure 0 0 0) 0x7fa4c0060540 con 0x7fa4d00d1970 2024-05-10T08:42:21.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:21.005 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":51,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:42:04.425134+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:41:36.103494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-10T08:41:37.392261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.25","mappings":[{"from":0,"to":6}]},{"pgid":"8.2d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4bc0762d0 msgr2=0x7fa4bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4bc0762d0 0x7fa4bc078790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00a2f90 tx=0x7fa4c4008040 comp rx=0 tx=0).stop 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d1970 msgr2=0x7fa4d014e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d1970 0x7fa4d014e440 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b3f0 tx=0x7fa4c000b8b0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 shutdown_connections 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4bc0762d0 0x7fa4bc078790 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4d014eb30 0x7fa4d006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d00d4cc0 0x7fa4d00b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 --2- 172.21.15.37:0/2254473774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00d1970 0x7fa4d014e440 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 >> 172.21.15.37:0/2254473774 conn(0x7fa4d008eac0 msgr2=0x7fa4d00b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 shutdown_connections 2024-05-10T08:42:21.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.007+0000 7fa4d6378640 1 -- 172.21.15.37:0/2254473774 wait complete. 2024-05-10T08:42:21.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:42:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.124+0000 7f855d628640 1 Processor -- start 2024-05-10T08:42:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.124+0000 7f855d628640 1 -- start start 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f855d628640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85581629b0 0x7f855806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f855d628640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8558070d20 0x7f85580711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f855d628640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855806e110 con 0x7f85580b2490 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f855d628640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8558070a40 con 0x7f8558070d20 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f855d628640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f855806dec0 con 0x7f85581629b0 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f85577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8558070d20 0x7f85580711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f85577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8558070d20 0x7f85580711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40120/0 (socket says 172.21.15.37:40120) 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f85577fe640 1 -- 172.21.15.37:0/3070649228 learned_addr learned my addr 172.21.15.37:0/3070649228 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f85577fe640 1 -- 172.21.15.37:0/3070649228 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85581629b0 msgr2=0x7f855806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f85577fe640 1 --2- 172.21.15.37:0/3070649228 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85581629b0 0x7f855806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f85577fe640 1 -- 172.21.15.37:0/3070649228 >> v1:172.21.15.82:6789/0 conn(0x7f85580b2490 legacy=0x7f8558070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.125+0000 7f85577fe640 1 -- 172.21.15.37:0/3070649228 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855806e3f0 con 0x7f8558070d20 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.126+0000 7f85577fe640 1 --2- 172.21.15.37:0/3070649228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8558070d20 0x7f85580711a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8550009e50 tx=0x7f855002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91fe5103572214b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.126+0000 7f8555ffb640 1 -- 172.21.15.37:0/3070649228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550036070 con 0x7f8558070d20 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.126+0000 7f8555ffb640 1 -- 172.21.15.37:0/3070649228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8550031600 con 0x7f8558070d20 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.126+0000 7f8555ffb640 1 -- 172.21.15.37:0/3070649228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500319d0 con 0x7f8558070d20 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 -- 172.21.15.37:0/3070649228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8558070d20 msgr2=0x7f85580711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 --2- 172.21.15.37:0/3070649228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8558070d20 0x7f85580711a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8550009e50 tx=0x7f855002a6c0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 -- 172.21.15.37:0/3070649228 shutdown_connections 2024-05-10T08:42:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 --2- 172.21.15.37:0/3070649228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8558070d20 0x7f85580711a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 --2- 172.21.15.37:0/3070649228 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85581629b0 0x7f855806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 -- 172.21.15.37:0/3070649228 >> 172.21.15.37:0/3070649228 conn(0x7f85580b49d0 msgr2=0x7f85580b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 -- 172.21.15.37:0/3070649228 shutdown_connections 2024-05-10T08:42:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.127+0000 7f855d628640 1 -- 172.21.15.37:0/3070649228 wait complete. 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.128+0000 7f855d628640 1 Processor -- start 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.128+0000 7f855d628640 1 -- start start 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f855d628640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8558070d20 0x7f85580cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f855d628640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85580b2490 0x7f85581f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f855d628640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85581629b0 0x7f85581f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f855d628640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f855806f410 con 0x7f85581629b0 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f855d628640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f855806e9b0 con 0x7f8558070d20 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f855d628640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f85580afcb0 con 0x7f85580b2490 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85581629b0 0x7f85581f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85581629b0 0x7f85581f59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40126/0 (socket says 172.21.15.37:40126) 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 -- 172.21.15.37:0/4207374674 learned_addr learned my addr 172.21.15.37:0/4207374674 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f8556ffd640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8558070d20 0x7f85580cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85567fc640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85580b2490 0x7f85581f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 -- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85580b2490 msgr2=0x7f85581f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85580b2490 0x7f85581f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 -- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8558070d20 msgr2=0x7f85580cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8558070d20 0x7f85580cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.129+0000 7f85577fe640 1 -- 172.21.15.37:0/4207374674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580c8e60 con 0x7f85581629b0 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.130+0000 7f85577fe640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85581629b0 0x7f85581f59b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8550034040 tx=0x7f8550004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.130+0000 7f853f7fe640 1 -- 172.21.15.37:0/4207374674 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550041020 con 0x7f85581629b0 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.130+0000 7f853f7fe640 1 -- 172.21.15.37:0/4207374674 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85500077a0 con 0x7f85581629b0 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.130+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85580c9140 con 0x7f85581629b0 2024-05-10T08:42:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.130+0000 7f853f7fe640 1 -- 172.21.15.37:0/4207374674 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550036040 con 0x7f85581629b0 2024-05-10T08:42:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.130+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85581f6120 con 0x7f85581629b0 2024-05-10T08:42:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.131+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85580684e0 con 0x7f85581629b0 2024-05-10T08:42:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.131+0000 7f853f7fe640 1 -- 172.21.15.37:0/4207374674 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8550044020 con 0x7f85581629b0 2024-05-10T08:42:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.132+0000 7f853f7fe640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f85440762d0 0x7f8544078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.132+0000 7f853f7fe640 1 -- 172.21.15.37:0/4207374674 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6159+0+0 (secure 0 0 0) 0x7f85500b85d0 con 0x7f85581629b0 2024-05-10T08:42:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.132+0000 7f8556ffd640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f85440762d0 0x7f8544078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.133+0000 7f8556ffd640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f85440762d0 0x7f8544078790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85580cd590 tx=0x7f8548008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.137+0000 7f853f7fe640 1 -- 172.21.15.37:0/4207374674 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f85580684e0 con 0x7f85581629b0 2024-05-10T08:42:21.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.367+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f85580693f0 con 0x7f85581629b0 2024-05-10T08:42:21.367 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:42:21.368+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:42:21.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.369+0000 7f853f7fe640 1 -- 172.21.15.37:0/4207374674 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f855004b030 con 0x7f85581629b0 2024-05-10T08:42:21.368 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f85440762d0 msgr2=0x7f8544078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f85440762d0 0x7f8544078790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85580cd590 tx=0x7f8548008040 comp rx=0 tx=0).stop 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85581629b0 msgr2=0x7f85581f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85581629b0 0x7f85581f59b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8550034040 tx=0x7f8550004a40 comp rx=0 tx=0).stop 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 shutdown_connections 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f85440762d0 0x7f8544078790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85581629b0 0x7f85581f59b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85580b2490 0x7f85581f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 --2- 172.21.15.37:0/4207374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8558070d20 0x7f85580cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 >> 172.21.15.37:0/4207374674 conn(0x7f85580b49d0 msgr2=0x7f85580d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 shutdown_connections 2024-05-10T08:42:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.371+0000 7f855d628640 1 -- 172.21.15.37:0/4207374674 wait complete. 2024-05-10T08:42:21.378 INFO:tasks.ceph.mds.b.smithi082.stderr: -5868> 2024-05-10T08:41:44.702+0000 7f924c937640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:42:21.379 INFO:tasks.ceph.mds.b.smithi082.stderr: -3096> 2024-05-10T08:41:47.081+0000 7f924892f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={4961=0-4194304@1} caps={4961=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=4961 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x556cf9d9ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:42:21.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:42:21.409 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:42:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.490+0000 7f8cf4017640 1 Processor -- start 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.490+0000 7f8cf4017640 1 -- start start 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf4017640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 0x7f8cec0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf4017640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cec0c9ee0 0x7f8cec0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf4017640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cec0d3330 con 0x7f8cec1629a0 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf4017640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8cec0d2170 con 0x7f8cec0c9ee0 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf4017640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8cec0d2450 con 0x7f8cec0d3cd0 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf1db3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8cec1629a0 0x7f8cec0d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48332/0 (socket says 172.21.15.37:48332) 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf1db3640 1 -- 172.21.15.37:0/701318051 learned_addr learned my addr 172.21.15.37:0/701318051 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644974975 0 0) 0x7f8cec0d3330 con 0x7f8cec1629a0 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf15b2640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 0x7f8cec0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cd4003520 con 0x7f8cec1629a0 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.491+0000 7f8cf25b4640 1 --2- 172.21.15.37:0/701318051 >> v2:172.21.15.82:3300/0 conn(0x7f8cec0c9ee0 0x7f8cec0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1489281242 0 0) 0x7f8cd4003520 con 0x7f8cec1629a0 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 msgr2=0x7f8cec0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 0x7f8cec0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 >> v2:172.21.15.82:3300/0 conn(0x7f8cec0c9ee0 msgr2=0x7f8cec0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 --2- 172.21.15.37:0/701318051 >> v2:172.21.15.82:3300/0 conn(0x7f8cec0c9ee0 0x7f8cec0d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec0d2730 con 0x7f8cec1629a0 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8cdc0019f0 con 0x7f8cec1629a0 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 >> v1:172.21.15.37:6789/0 conn(0x7f8cec1629a0 legacy=0x7f8cec0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd40039b0 0x7f8cd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd4004800 0x7f8cd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 0x7f8cd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec0d2170 con 0x7f8cd4004800 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec0d2450 con 0x7f8cd40039b0 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd400ba40 con 0x7f8cec0d3cd0 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf15b2640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd4004800 0x7f8cd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf1db3640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd40039b0 0x7f8cd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf25b4640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 0x7f8cd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf15b2640 1 -- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 msgr2=0x7f8cd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf15b2640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0d3cd0 0x7f8cd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf15b2640 1 -- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd40039b0 msgr2=0x7f8cd4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf15b2640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd40039b0 0x7f8cd4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.492+0000 7f8cf15b2640 1 -- 172.21.15.37:0/701318051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd4003520 con 0x7f8cd4004800 2024-05-10T08:42:21.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.493+0000 7f8cf15b2640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd4004800 0x7f8cd4004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009ac0 tx=0x7f8cd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b262b24e13a012 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:21.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.493+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0036070 con 0x7f8cd4004800 2024-05-10T08:42:21.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.493+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce0031400 con 0x7f8cd4004800 2024-05-10T08:42:21.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.493+0000 7f8cf0db1640 1 -- 172.21.15.37:0/701318051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0009690 con 0x7f8cd4004800 2024-05-10T08:42:21.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.494+0000 7f8cf4017640 1 -- 172.21.15.37:0/701318051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd4004800 msgr2=0x7f8cd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.494+0000 7f8cf4017640 1 --2- 172.21.15.37:0/701318051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd4004800 0x7f8cd4004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009ac0 tx=0x7f8cd4005830 comp rx=0 tx=0).stop 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.494+0000 7f8cf25b4640 1 -- 172.21.15.37:0/701318051 reap_dead start 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.494+0000 7f8cf4017640 1 -- 172.21.15.37:0/701318051 shutdown_connections 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.494+0000 7f8cf4017640 1 -- 172.21.15.37:0/701318051 >> 172.21.15.37:0/701318051 conn(0x7f8cec0d4fe0 msgr2=0x7f8cec0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.494+0000 7f8cf4017640 1 -- 172.21.15.37:0/701318051 shutdown_connections 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.494+0000 7f8cf4017640 1 -- 172.21.15.37:0/701318051 wait complete. 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.495+0000 7f8cf4017640 1 Processor -- start 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.495+0000 7f8cf4017640 1 -- start start 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf4017640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4004800 0x7f8cec15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf4017640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0a2a70 0x7f8cec0ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf4017640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec0b8d40 0x7f8cec0b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf4017640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec0cf440 con 0x7f8cec0b8d40 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf4017640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec0cf2c0 con 0x7f8cd4004800 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf4017640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8cec0d2dc0 con 0x7f8cec0a2a70 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec0b8d40 0x7f8cec0b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec0b8d40 0x7f8cec0b91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40146/0 (socket says 172.21.15.37:40146) 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 -- 172.21.15.37:0/185971760 learned_addr learned my addr 172.21.15.37:0/185971760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf15b2640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0a2a70 0x7f8cec0ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf1db3640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4004800 0x7f8cec15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 -- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0a2a70 msgr2=0x7f8cec0ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0a2a70 0x7f8cec0ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 -- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4004800 msgr2=0x7f8cec15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4004800 0x7f8cec15ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:21.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 -- 172.21.15.37:0/185971760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec0b7ca0 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf1db3640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4004800 0x7f8cec15ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cf25b4640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec0b8d40 0x7f8cec0b91d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0b7b70 tx=0x7f8ce4011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cea7fc640 1 -- 172.21.15.37:0/185971760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4004240 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.496+0000 7f8cea7fc640 1 -- 172.21.15.37:0/185971760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce401b070 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.497+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cec0b7f80 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.497+0000 7f8cea7fc640 1 -- 172.21.15.37:0/185971760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400f770 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.497+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cec0b8540 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.498+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cec0693f0 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.498+0000 7f8cea7fc640 1 -- 172.21.15.37:0/185971760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ce4012040 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.498+0000 7f8cea7fc640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cd80762d0 0x7f8cd8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.499+0000 7f8cea7fc640 1 -- 172.21.15.37:0/185971760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6245+0+0 (secure 0 0 0) 0x7f8ce40975d0 con 0x7f8cec0b8d40 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.499+0000 7f8cf1db3640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cd80762d0 0x7f8cd8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.499+0000 7f8cf1db3640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cd80762d0 0x7f8cd8078790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0014a0 tx=0x7f8cdc006040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:21.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.503+0000 7f8cea7fc640 1 -- 172.21.15.37:0/185971760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8ce4060d10 con 0x7f8cec0b8d40 2024-05-10T08:42:21.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:21.732+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8cec160dd0 con 0x7f8cec0b8d40 2024-05-10T08:42:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.371+0000 7f8cea7fc640 1 -- 172.21.15.37:0/185971760 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f8ce4060610 con 0x7f8cec0b8d40 2024-05-10T08:42:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cd80762d0 msgr2=0x7f8cd8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cd80762d0 0x7f8cd8078790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0014a0 tx=0x7f8cdc006040 comp rx=0 tx=0).stop 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec0b8d40 msgr2=0x7f8cec0b91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec0b8d40 0x7f8cec0b91d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0b7b70 tx=0x7f8ce4011cf0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 shutdown_connections 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cd80762d0 0x7f8cd8078790 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec0b8d40 0x7f8cec0b91d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8cec0a2a70 0x7f8cec0ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 --2- 172.21.15.37:0/185971760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd4004800 0x7f8cec15ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 >> 172.21.15.37:0/185971760 conn(0x7f8cec0d4fe0 msgr2=0x7f8cec0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 shutdown_connections 2024-05-10T08:42:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.374+0000 7f8cf4017640 1 -- 172.21.15.37:0/185971760 wait complete. 2024-05-10T08:42:22.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:42:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.503+0000 7fde45e9c640 1 Processor -- start 2024-05-10T08:42:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.503+0000 7fde45e9c640 1 -- start start 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde45e9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde400cef40 0x7fde4016ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde45e9c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde400d2030 con 0x7fde400d3920 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde45e9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde4015f8d0 con 0x7fde400cf8f0 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde45e9c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fde40071320 con 0x7fde400cef40 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde400cef40 0x7fde4016ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde400cef40 0x7fde4016ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40160/0 (socket says 172.21.15.37:40160) 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fde400d3920 0x7fde40070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48342/0 (socket says 172.21.15.37:48342) 2024-05-10T08:42:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3ffff640 1 -- 172.21.15.37:0/544366089 learned_addr learned my addr 172.21.15.37:0/544366089 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:22.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3ffff640 1 -- 172.21.15.37:0/544366089 >> v1:172.21.15.82:6789/0 conn(0x7fde400cf8f0 legacy=0x7fde40070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:22.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3ffff640 1 -- 172.21.15.37:0/544366089 >> v1:172.21.15.37:6789/0 conn(0x7fde400d3920 legacy=0x7fde40070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:22.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3e7fc640 1 -- 172.21.15.37:0/544366089 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631020618 0 0) 0x7fde34001110 con 0x7fde400d3920 2024-05-10T08:42:22.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.504+0000 7fde3ffff640 1 -- 172.21.15.37:0/544366089 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400d22b0 con 0x7fde400cef40 2024-05-10T08:42:22.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.505+0000 7fde3ffff640 1 --2- 172.21.15.37:0/544366089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4016ab40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fde38009e50 tx=0x7fde3802a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d37f5115496943f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:22.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.505+0000 7fde3e7fc640 1 -- 172.21.15.37:0/544366089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38037070 con 0x7fde400cef40 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.505+0000 7fde3e7fc640 1 -- 172.21.15.37:0/544366089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde38032630 con 0x7fde400cef40 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.505+0000 7fde3e7fc640 1 -- 172.21.15.37:0/544366089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3802e050 con 0x7fde400cef40 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.506+0000 7fde45e9c640 1 -- 172.21.15.37:0/544366089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 msgr2=0x7fde4016ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.506+0000 7fde45e9c640 1 --2- 172.21.15.37:0/544366089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4016ab40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fde38009e50 tx=0x7fde3802a840 comp rx=0 tx=0).stop 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.506+0000 7fde45e9c640 1 -- 172.21.15.37:0/544366089 shutdown_connections 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.506+0000 7fde45e9c640 1 --2- 172.21.15.37:0/544366089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4016ab40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.506+0000 7fde45e9c640 1 -- 172.21.15.37:0/544366089 >> 172.21.15.37:0/544366089 conn(0x7fde400d2e00 msgr2=0x7fde400d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.506+0000 7fde45e9c640 1 -- 172.21.15.37:0/544366089 shutdown_connections 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.506+0000 7fde45e9c640 1 -- 172.21.15.37:0/544366089 wait complete. 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.507+0000 7fde45e9c640 1 Processor -- start 2024-05-10T08:42:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.507+0000 7fde45e9c640 1 -- start start 2024-05-10T08:42:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde45e9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4015abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde45e9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde400cf8f0 0x7fde400caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde45e9c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde400d3920 0x7fde4014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde45e9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde400cd730 con 0x7fde400cef40 2024-05-10T08:42:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde45e9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde400cd450 con 0x7fde400cf8f0 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde45e9c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fde400cda10 con 0x7fde400d3920 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4015abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4015abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40176/0 (socket says 172.21.15.37:40176) 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde3f7fe640 1 -- 172.21.15.37:0/628930364 learned_addr learned my addr 172.21.15.37:0/628930364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde3effd640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde400cf8f0 0x7fde400caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde3ffff640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde400d3920 0x7fde4014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde3f7fe640 1 -- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde400d3920 msgr2=0x7fde4014aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.508+0000 7fde3f7fe640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde400d3920 0x7fde4014aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde3f7fe640 1 -- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde400cf8f0 msgr2=0x7fde400caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde3f7fe640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde400cf8f0 0x7fde400caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde3f7fe640 1 -- 172.21.15.37:0/628930364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400cb770 con 0x7fde400cef40 2024-05-10T08:42:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde3effd640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde400cf8f0 0x7fde400caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde3f7fe640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4015abc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fde3000c400 tx=0x7fde3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde27fff640 1 -- 172.21.15.37:0/628930364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30017070 con 0x7fde400cef40 2024-05-10T08:42:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde27fff640 1 -- 172.21.15.37:0/628930364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde300052d0 con 0x7fde400cef40 2024-05-10T08:42:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde400cba50 con 0x7fde400cef40 2024-05-10T08:42:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde27fff640 1 -- 172.21.15.37:0/628930364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30003830 con 0x7fde400cef40 2024-05-10T08:42:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.509+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde400cc010 con 0x7fde400cef40 2024-05-10T08:42:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.510+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde400693f0 con 0x7fde400cef40 2024-05-10T08:42:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.510+0000 7fde27fff640 1 -- 172.21.15.37:0/628930364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde3001a070 con 0x7fde400cef40 2024-05-10T08:42:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.511+0000 7fde27fff640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde2c0762d0 0x7fde2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.511+0000 7fde27fff640 1 -- 172.21.15.37:0/628930364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6245+0+0 (secure 0 0 0) 0x7fde30096af0 con 0x7fde400cef40 2024-05-10T08:42:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.511+0000 7fde3effd640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde2c0762d0 0x7fde2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.512+0000 7fde3effd640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde2c0762d0 0x7fde2c078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fde4015b100 tx=0x7fde34007a10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.515+0000 7fde27fff640 1 -- 172.21.15.37:0/628930364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fde3005fbe0 con 0x7fde400cef40 2024-05-10T08:42:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:22.706+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde400d0440 con 0x7fde400cef40 2024-05-10T08:42:23.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:42:23.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:42:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.478+0000 7fde27fff640 1 -- 172.21.15.37:0/628930364 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7fde30068220 con 0x7fde400cef40 2024-05-10T08:42:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde2c0762d0 msgr2=0x7fde2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde2c0762d0 0x7fde2c078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fde4015b100 tx=0x7fde34007a10 comp rx=0 tx=0).stop 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 msgr2=0x7fde4015abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4015abc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fde3000c400 tx=0x7fde3000c8c0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 shutdown_connections 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde2c0762d0 0x7fde2c078790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde400d3920 0x7fde4014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde400cf8f0 0x7fde400caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 --2- 172.21.15.37:0/628930364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde400cef40 0x7fde4015abc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.480+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 >> 172.21.15.37:0/628930364 conn(0x7fde400d2e00 msgr2=0x7fde400d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.481+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 shutdown_connections 2024-05-10T08:42:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.481+0000 7fde45e9c640 1 -- 172.21.15.37:0/628930364 wait complete. 2024-05-10T08:42:23.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:42:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.608+0000 7f07e4445640 1 Processor -- start 2024-05-10T08:42:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.608+0000 7f07e4445640 1 -- start start 2024-05-10T08:42:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e4445640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07dc1629f0 0x7f07dc0d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e4445640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07dc0cfef0 0x7f07dc06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e4445640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07dc0cde80 con 0x7f07dc0d22a0 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e4445640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f07dc0ce120 con 0x7f07dc0cfef0 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e4445640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f07dc0ce400 con 0x7f07dc1629f0 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e29e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07dc0cfef0 0x7f07dc06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e19e0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07dc0d22a0 0x7f07dc0d1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48352/0 (socket says 172.21.15.37:48352) 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e19e0640 1 -- 172.21.15.37:0/3431375774 learned_addr learned my addr 172.21.15.37:0/3431375774 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e21e1640 1 --2- 172.21.15.37:0/3431375774 >> v2:172.21.15.82:3300/0 conn(0x7f07dc1629f0 0x7f07dc0d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e29e2640 1 -- 172.21.15.37:0/3431375774 >> v2:172.21.15.82:3300/0 conn(0x7f07dc1629f0 msgr2=0x7f07dc0d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e29e2640 1 --2- 172.21.15.37:0/3431375774 >> v2:172.21.15.82:3300/0 conn(0x7f07dc1629f0 0x7f07dc0d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e29e2640 1 -- 172.21.15.37:0/3431375774 >> v1:172.21.15.37:6789/0 conn(0x7f07dc0d22a0 legacy=0x7f07dc0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e29e2640 1 -- 172.21.15.37:0/3431375774 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc0ce6e0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.609+0000 7f07e11df640 1 -- 172.21.15.37:0/3431375774 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696744060 0 0) 0x7f07dc0cde80 con 0x7f07dc0d22a0 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.610+0000 7f07e29e2640 1 --2- 172.21.15.37:0/3431375774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc06d6c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f07dc068c10 tx=0x7f07d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb2575a6244670d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.610+0000 7f07e11df640 1 -- 172.21.15.37:0/3431375774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4007740 con 0x7f07dc0cfef0 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.610+0000 7f07e11df640 1 -- 172.21.15.37:0/3431375774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d40078e0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.610+0000 7f07e11df640 1 -- 172.21.15.37:0/3431375774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4007cb0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 -- 172.21.15.37:0/3431375774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 msgr2=0x7f07dc06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 --2- 172.21.15.37:0/3431375774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc06d6c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f07dc068c10 tx=0x7f07d402a680 comp rx=0 tx=0).stop 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 -- 172.21.15.37:0/3431375774 shutdown_connections 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 --2- 172.21.15.37:0/3431375774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc06d6c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 --2- 172.21.15.37:0/3431375774 >> v2:172.21.15.82:3300/0 conn(0x7f07dc1629f0 0x7f07dc0d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 -- 172.21.15.37:0/3431375774 >> 172.21.15.37:0/3431375774 conn(0x7f07dc0d2d80 msgr2=0x7f07dc0d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 -- 172.21.15.37:0/3431375774 shutdown_connections 2024-05-10T08:42:23.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.611+0000 7f07e4445640 1 -- 172.21.15.37:0/3431375774 wait complete. 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.612+0000 7f07e4445640 1 Processor -- start 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.612+0000 7f07e4445640 1 -- start start 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e4445640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc15fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e4445640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07dc0d22a0 0x7f07dc154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e4445640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07dc1629f0 0x7f07dc149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e4445640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc0d1ef0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e4445640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc0d1d70 con 0x7f07dc1629f0 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e4445640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07dc06dc00 con 0x7f07dc0d22a0 2024-05-10T08:42:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc15fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc15fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40186/0 (socket says 172.21.15.37:40186) 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 -- 172.21.15.37:0/1741566054 learned_addr learned my addr 172.21.15.37:0/1741566054 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e19e0640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07dc0d22a0 0x7f07dc154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e29e2640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07dc1629f0 0x7f07dc149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 -- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07dc0d22a0 msgr2=0x7f07dc154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07dc0d22a0 0x7f07dc154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 -- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07dc1629f0 msgr2=0x7f07dc149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07dc1629f0 0x7f07dc149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 -- 172.21.15.37:0/1741566054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc154bc0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07e21e1640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc15fbf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f07d800d620 tx=0x7f07d800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.613+0000 7f07ceffd640 1 -- 172.21.15.37:0/1741566054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d800b620 con 0x7f07dc0cfef0 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.614+0000 7f07ceffd640 1 -- 172.21.15.37:0/1741566054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d8019070 con 0x7f07dc0cfef0 2024-05-10T08:42:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.614+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc154ea0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.614+0000 7f07ceffd640 1 -- 172.21.15.37:0/1741566054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d800ba00 con 0x7f07dc0cfef0 2024-05-10T08:42:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.614+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc155740 con 0x7f07dc0cfef0 2024-05-10T08:42:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.614+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07dc0693f0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.615+0000 7f07ceffd640 1 -- 172.21.15.37:0/1741566054 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07d800bba0 con 0x7f07dc0cfef0 2024-05-10T08:42:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.615+0000 7f07ceffd640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07c0076300 0x7f07c00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.616+0000 7f07ceffd640 1 -- 172.21.15.37:0/1741566054 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5807+0+0 (secure 0 0 0) 0x7f07d8097a70 con 0x7f07dc0cfef0 2024-05-10T08:42:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.616+0000 7f07e19e0640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07c0076300 0x7f07c00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.616+0000 7f07e19e0640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07c0076300 0x7f07c00787c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f07dc153300 tx=0x7f07d0007b50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.620+0000 7f07ceffd640 1 -- 172.21.15.37:0/1741566054 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f07d8061370 con 0x7f07dc0cfef0 2024-05-10T08:42:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:23.810+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f07dc1619c0 con 0x7f07dc0cfef0 2024-05-10T08:42:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.487+0000 7f07ceffd640 1 -- 172.21.15.37:0/1741566054 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7f07d8067070 con 0x7f07dc0cfef0 2024-05-10T08:42:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:42:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.490+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07c0076300 msgr2=0x7f07c00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.490+0000 7f07e4445640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07c0076300 0x7f07c00787c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f07dc153300 tx=0x7f07d0007b50 comp rx=0 tx=0).stop 2024-05-10T08:42:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.490+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 msgr2=0x7f07dc15fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.490+0000 7f07e4445640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc15fbf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f07d800d620 tx=0x7f07d800dae0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 shutdown_connections 2024-05-10T08:42:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07c0076300 0x7f07c00787c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07dc1629f0 0x7f07dc149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07dc0d22a0 0x7f07dc154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 --2- 172.21.15.37:0/1741566054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07dc0cfef0 0x7f07dc15fbf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 >> 172.21.15.37:0/1741566054 conn(0x7f07dc0d2d80 msgr2=0x7f07dc06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 shutdown_connections 2024-05-10T08:42:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.491+0000 7f07e4445640 1 -- 172.21.15.37:0/1741566054 wait complete. 2024-05-10T08:42:24.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T08:42:24.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.621+0000 7f68199da640 1 Processor -- start 2024-05-10T08:42:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.621+0000 7f68199da640 1 -- start start 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68199da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68140d3cd0 0x7f68140cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68199da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140c9ee0 0x7f68140d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68199da640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68140d3330 con 0x7f68141629a0 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68199da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f68140d2170 con 0x7f68140d3cd0 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68199da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f68140d2450 con 0x7f68140c9ee0 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68127fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68140d3cd0 0x7f68140cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68137fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140c9ee0 0x7f68140d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68127fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68140d3cd0 0x7f68140cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:41428/0 (socket says 172.21.15.37:41428) 2024-05-10T08:42:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.622+0000 7f68127fc640 1 -- 172.21.15.37:0/4200970408 learned_addr learned my addr 172.21.15.37:0/4200970408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.623+0000 7f68127fc640 1 -- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140c9ee0 msgr2=0x7f68140d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.623+0000 7f68127fc640 1 --2- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140c9ee0 0x7f68140d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.623+0000 7f68127fc640 1 -- 172.21.15.37:0/4200970408 >> v1:172.21.15.82:6789/0 conn(0x7f68141629a0 legacy=0x7f68140d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.623+0000 7f68127fc640 1 -- 172.21.15.37:0/4200970408 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68140d2730 con 0x7f68140d3cd0 2024-05-10T08:42:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.623+0000 7f68137fe640 1 --2- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140c9ee0 0x7f68140d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.623+0000 7f6811ffb640 1 -- 172.21.15.37:0/4200970408 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168449151 0 0) 0x7f68140d3330 con 0x7f68141629a0 2024-05-10T08:42:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.623+0000 7f68127fc640 1 --2- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68140d3cd0 0x7f68140cfca0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009870 tx=0x7f67fc02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3136f525d95604c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f6811ffb640 1 -- 172.21.15.37:0/4200970408 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc037070 con 0x7f68140d3cd0 2024-05-10T08:42:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f6811ffb640 1 -- 172.21.15.37:0/4200970408 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67fc032440 con 0x7f68140d3cd0 2024-05-10T08:42:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f6811ffb640 1 -- 172.21.15.37:0/4200970408 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc032810 con 0x7f68140d3cd0 2024-05-10T08:42:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 -- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68140d3cd0 msgr2=0x7f68140cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 --2- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68140d3cd0 0x7f68140cfca0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009870 tx=0x7f67fc02a130 comp rx=0 tx=0).stop 2024-05-10T08:42:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 -- 172.21.15.37:0/4200970408 shutdown_connections 2024-05-10T08:42:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 --2- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140c9ee0 0x7f68140d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 --2- 172.21.15.37:0/4200970408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68140d3cd0 0x7f68140cfca0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 -- 172.21.15.37:0/4200970408 >> 172.21.15.37:0/4200970408 conn(0x7f68140d4fe0 msgr2=0x7f68140d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 -- 172.21.15.37:0/4200970408 shutdown_connections 2024-05-10T08:42:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.624+0000 7f68199da640 1 -- 172.21.15.37:0/4200970408 wait complete. 2024-05-10T08:42:24.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.625+0000 7f68199da640 1 Processor -- start 2024-05-10T08:42:24.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.626+0000 7f68199da640 1 -- start start 2024-05-10T08:42:24.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.626+0000 7f68199da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68140c9ee0 0x7f68140baa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.626+0000 7f68199da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140d3cd0 0x7f681415d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.626+0000 7f68199da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68141629a0 0x7f68140ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.626+0000 7f68199da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68140cf440 con 0x7f68140c9ee0 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.626+0000 7f68199da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68140cf2c0 con 0x7f68141629a0 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.626+0000 7f68199da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f68140d2dc0 con 0x7f68140d3cd0 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68140c9ee0 0x7f68140baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68140c9ee0 0x7f68140baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40192/0 (socket says 172.21.15.37:40192) 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 -- 172.21.15.37:0/3010394608 learned_addr learned my addr 172.21.15.37:0/3010394608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f68127fc640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140d3cd0 0x7f681415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f68137fe640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68141629a0 0x7f68140ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 -- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140d3cd0 msgr2=0x7f681415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140d3cd0 0x7f681415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 -- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68141629a0 msgr2=0x7f68140ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68141629a0 0x7f68140ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 -- 172.21.15.37:0/3010394608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681415db40 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f68137fe640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68141629a0 0x7f68140ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f6812ffd640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68140c9ee0 0x7f68140baa60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f680400c410 tx=0x7f680400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f680bfff640 1 -- 172.21.15.37:0/3010394608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804017070 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68140b9c00 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f680bfff640 1 -- 172.21.15.37:0/3010394608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68040035f0 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f680bfff640 1 -- 172.21.15.37:0/3010394608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68040039e0 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.627+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68140b9640 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.628+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68140693f0 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.629+0000 7f680bfff640 1 -- 172.21.15.37:0/3010394608 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f680401a070 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.630+0000 7f680bfff640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67f4076300 0x7f67f40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.630+0000 7f680bfff640 1 -- 172.21.15.37:0/3010394608 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f68040969a0 con 0x7f68140c9ee0 2024-05-10T08:42:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.630+0000 7f68127fc640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67f4076300 0x7f67f40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.630+0000 7f68127fc640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67f4076300 0x7f67f40787c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f67fc034000 tx=0x7f67fc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.634+0000 7f680bfff640 1 -- 172.21.15.37:0/3010394608 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f681415db40 con 0x7f68140c9ee0 2024-05-10T08:42:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.825+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f6814162150 con 0x7f68140c9ee0 2024-05-10T08:42:24.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.828+0000 7f680bfff640 1 -- 172.21.15.37:0/3010394608 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f6804060360 con 0x7f68140c9ee0 2024-05-10T08:42:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67f4076300 msgr2=0x7f67f40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67f4076300 0x7f67f40787c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f67fc034000 tx=0x7f67fc02e000 comp rx=0 tx=0).stop 2024-05-10T08:42:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68140c9ee0 msgr2=0x7f68140baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68140c9ee0 0x7f68140baa60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f680400c410 tx=0x7f680400c8d0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 shutdown_connections 2024-05-10T08:42:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67f4076300 0x7f67f40787c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68141629a0 0x7f68140ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68140d3cd0 0x7f681415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 --2- 172.21.15.37:0/3010394608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68140c9ee0 0x7f68140baa60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 >> 172.21.15.37:0/3010394608 conn(0x7f68140d4fe0 msgr2=0x7f68140d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 shutdown_connections 2024-05-10T08:42:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.830+0000 7f68199da640 1 -- 172.21.15.37:0/3010394608 wait complete. 2024-05-10T08:42:24.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-05-10T08:42:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.946+0000 7f0403a72640 1 Processor -- start 2024-05-10T08:42:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.946+0000 7f0403a72640 1 -- start start 2024-05-10T08:42:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f0403a72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc06e0f0 0x7f03fc15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f0403a72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03fc072840 0x7f03fc0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f0403a72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f03fc06e4d0 0x7f03fc0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f0403a72640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f03fc0d14b0 con 0x7f03fc072840 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f0403a72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f03fc15c920 con 0x7f03fc06e4d0 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f0403a72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f03fc15cc00 con 0x7f03fc06e0f0 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f040100d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03fc072840 0x7f03fc0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f040100d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03fc072840 0x7f03fc0d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40202/0 (socket says 172.21.15.37:40202) 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.947+0000 7f040100d640 1 -- 172.21.15.37:0/3093348819 learned_addr learned my addr 172.21.15.37:0/3093348819 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040200f640 1 --2- 172.21.15.37:0/3093348819 >> v2:172.21.15.82:3300/0 conn(0x7f03fc06e4d0 0x7f03fc0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040180e640 1 --2- 172.21.15.37:0/3093348819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc06e0f0 0x7f03fc15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040100d640 1 -- 172.21.15.37:0/3093348819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc06e0f0 msgr2=0x7f03fc15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040100d640 1 --2- 172.21.15.37:0/3093348819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc06e0f0 0x7f03fc15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040100d640 1 -- 172.21.15.37:0/3093348819 >> v2:172.21.15.82:3300/0 conn(0x7f03fc06e4d0 msgr2=0x7f03fc0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040100d640 1 --2- 172.21.15.37:0/3093348819 >> v2:172.21.15.82:3300/0 conn(0x7f03fc06e4d0 0x7f03fc0b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040100d640 1 -- 172.21.15.37:0/3093348819 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc15cee0 con 0x7f03fc072840 2024-05-10T08:42:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.948+0000 7f040100d640 1 --2- 172.21.15.37:0/3093348819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc072840 0x7f03fc0d0f70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03fc070580 tx=0x7f03ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a411e49a954650a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f040080c640 1 -- 172.21.15.37:0/3093348819 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec037070 con 0x7f03fc072840 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f040080c640 1 -- 172.21.15.37:0/3093348819 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ec032440 con 0x7f03fc072840 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f040080c640 1 -- 172.21.15.37:0/3093348819 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec032810 con 0x7f03fc072840 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 -- 172.21.15.37:0/3093348819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc072840 msgr2=0x7f03fc0d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 --2- 172.21.15.37:0/3093348819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc072840 0x7f03fc0d0f70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03fc070580 tx=0x7f03ec02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 -- 172.21.15.37:0/3093348819 shutdown_connections 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 --2- 172.21.15.37:0/3093348819 >> v2:172.21.15.82:3300/0 conn(0x7f03fc06e4d0 0x7f03fc0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 --2- 172.21.15.37:0/3093348819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc072840 0x7f03fc0d0f70 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 --2- 172.21.15.37:0/3093348819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc06e0f0 0x7f03fc15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 -- 172.21.15.37:0/3093348819 >> 172.21.15.37:0/3093348819 conn(0x7f03fc06c3a0 msgr2=0x7f03fc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 -- 172.21.15.37:0/3093348819 shutdown_connections 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.949+0000 7f0403a72640 1 -- 172.21.15.37:0/3093348819 wait complete. 2024-05-10T08:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.950+0000 7f0403a72640 1 Processor -- start 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f0403a72640 1 -- start start 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f0403a72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03fc06e0f0 0x7f03fc1f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f0403a72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc06e4d0 0x7f03fc0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f0403a72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc072840 0x7f03fc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f0403a72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc0ae650 con 0x7f03fc06e4d0 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f0403a72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc06e980 con 0x7f03fc06e0f0 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f0403a72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f03fc0ae7d0 con 0x7f03fc072840 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f040100d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc06e4d0 0x7f03fc0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f040100d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc06e4d0 0x7f03fc0cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40212/0 (socket says 172.21.15.37:40212) 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.951+0000 7f040100d640 1 -- 172.21.15.37:0/1616804515 learned_addr learned my addr 172.21.15.37:0/1616804515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040180e640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03fc06e0f0 0x7f03fc1f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040200f640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc072840 0x7f03fc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040100d640 1 -- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc072840 msgr2=0x7f03fc0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040100d640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc072840 0x7f03fc0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040100d640 1 -- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03fc06e0f0 msgr2=0x7f03fc1f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040100d640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03fc06e0f0 0x7f03fc1f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040100d640 1 -- 172.21.15.37:0/1616804515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc0b1840 con 0x7f03fc06e4d0 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040200f640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc072840 0x7f03fc0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f040100d640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc06e4d0 0x7f03fc0cf940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f03ec02a220 tx=0x7f03ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f03f27fc640 1 -- 172.21.15.37:0/1616804515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec041070 con 0x7f03fc06e4d0 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f03f27fc640 1 -- 172.21.15.37:0/1616804515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ec03c870 con 0x7f03fc06e4d0 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03fc0b0cc0 con 0x7f03fc06e4d0 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f03f27fc640 1 -- 172.21.15.37:0/1616804515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec037040 con 0x7f03fc06e4d0 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.952+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03fc0b1280 con 0x7f03fc06e4d0 2024-05-10T08:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.953+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03fc0693f0 con 0x7f03fc06e4d0 2024-05-10T08:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.954+0000 7f03f27fc640 1 -- 172.21.15.37:0/1616804515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f03ec044070 con 0x7f03fc06e4d0 2024-05-10T08:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.954+0000 7f03f27fc640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f03e00762d0 0x7f03e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.954+0000 7f03f27fc640 1 -- 172.21.15.37:0/1616804515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f03ec0b7e10 con 0x7f03fc06e4d0 2024-05-10T08:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.955+0000 7f040180e640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f03e00762d0 0x7f03e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:24.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.955+0000 7f040180e640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f03e00762d0 0x7f03e0078790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f03f8006fd0 tx=0x7f03f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:24.959+0000 7f03f27fc640 1 -- 172.21.15.37:0/1616804515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f03ec081290 con 0x7f03fc06e4d0 2024-05-10T08:42:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.240+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f03fc0afe20 con 0x7f03fc06e4d0 2024-05-10T08:42:25.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.489+0000 7f03f27fc640 1 -- 172.21.15.37:0/1616804515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v125) ==== 149+0+0 (secure 0 0 0) 0x7f03ec085590 con 0x7f03fc06e4d0 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f03e00762d0 msgr2=0x7f03e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f03e00762d0 0x7f03e0078790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f03f8006fd0 tx=0x7f03f8008040 comp rx=0 tx=0).stop 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc06e4d0 msgr2=0x7f03fc0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc06e4d0 0x7f03fc0cf940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f03ec02a220 tx=0x7f03ec0046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 shutdown_connections 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f03e00762d0 0x7f03e0078790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f03fc072840 0x7f03fc0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc06e4d0 0x7f03fc0cf940 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 --2- 172.21.15.37:0/1616804515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03fc06e0f0 0x7f03fc1f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 >> 172.21.15.37:0/1616804515 conn(0x7f03fc06c3a0 msgr2=0x7f03fc0735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.491+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 shutdown_connections 2024-05-10T08:42:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.492+0000 7f0403a72640 1 -- 172.21.15.37:0/1616804515 wait complete. 2024-05-10T08:42:25.502 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-05-10T08:42:25.502 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-05-10T08:42:25.503 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T08:42:25.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:42:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.608+0000 7f133052b640 1 Processor -- start 2024-05-10T08:42:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.608+0000 7f133052b640 1 -- start start 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.609+0000 7f133052b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13281629b0 0x7f132806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.609+0000 7f133052b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132806e110 con 0x7f1328070d20 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.609+0000 7f133052b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132806e3f0 con 0x7f13280b2490 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.609+0000 7f133052b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1328070a40 con 0x7f13281629b0 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.609+0000 7f132e2c7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13281629b0 0x7f132806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.609+0000 7f132eac8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1328070d20 0x7f13280afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48364/0 (socket says 172.21.15.37:48364) 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.609+0000 7f132eac8640 1 -- 172.21.15.37:0/514490642 learned_addr learned my addr 172.21.15.37:0/514490642 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.610+0000 7f132e2c7640 1 -- 172.21.15.37:0/514490642 >> v1:172.21.15.82:6789/0 conn(0x7f13280b2490 legacy=0x7f1328070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.610+0000 7f132e2c7640 1 -- 172.21.15.37:0/514490642 >> v1:172.21.15.37:6789/0 conn(0x7f1328070d20 legacy=0x7f13280afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.610+0000 7f132e2c7640 1 -- 172.21.15.37:0/514490642 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132806e6d0 con 0x7f13281629b0 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.610+0000 7f132e2c7640 1 --2- 172.21.15.37:0/514490642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f132806eed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1318009d90 tx=0x7f131802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d24b76a567935e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.610+0000 7f132d2c5640 1 -- 172.21.15.37:0/514490642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318007740 con 0x7f13281629b0 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f132d2c5640 1 -- 172.21.15.37:0/514490642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13180078e0 con 0x7f13281629b0 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f132d2c5640 1 -- 172.21.15.37:0/514490642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318007cb0 con 0x7f13281629b0 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f133052b640 1 -- 172.21.15.37:0/514490642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 msgr2=0x7f132806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f133052b640 1 --2- 172.21.15.37:0/514490642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f132806eed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1318009d90 tx=0x7f131802a6f0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f133052b640 1 -- 172.21.15.37:0/514490642 shutdown_connections 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f133052b640 1 --2- 172.21.15.37:0/514490642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f132806eed0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f133052b640 1 -- 172.21.15.37:0/514490642 >> 172.21.15.37:0/514490642 conn(0x7f13280b49d0 msgr2=0x7f13280b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f133052b640 1 -- 172.21.15.37:0/514490642 shutdown_connections 2024-05-10T08:42:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.611+0000 7f133052b640 1 -- 172.21.15.37:0/514490642 wait complete. 2024-05-10T08:42:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.612+0000 7f133052b640 1 Processor -- start 2024-05-10T08:42:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f133052b640 1 -- start start 2024-05-10T08:42:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f133052b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1328070d20 0x7f1328150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f133052b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13280b2490 0x7f13280c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f133052b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f13280c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f133052b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f132806f410 con 0x7f13281629b0 2024-05-10T08:42:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f133052b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f132806dec0 con 0x7f1328070d20 2024-05-10T08:42:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f133052b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f13280b03c0 con 0x7f13280b2490 2024-05-10T08:42:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f132eac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f13280c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f132eac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f13280c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40230/0 (socket says 172.21.15.37:40230) 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.613+0000 7f132eac8640 1 -- 172.21.15.37:0/1200731497 learned_addr learned my addr 172.21.15.37:0/1200731497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132e2c7640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1328070d20 0x7f1328150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132dac6640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13280b2490 0x7f13280c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132eac8640 1 -- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13280b2490 msgr2=0x7f13280c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132eac8640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13280b2490 0x7f13280c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132eac8640 1 -- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1328070d20 msgr2=0x7f1328150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132eac8640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1328070d20 0x7f1328150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132eac8640 1 -- 172.21.15.37:0/1200731497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13280b6790 con 0x7f13281629b0 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f132eac8640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f13280c9350 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f132000c450 tx=0x7f132000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f1326ffd640 1 -- 172.21.15.37:0/1200731497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320017070 con 0x7f13281629b0 2024-05-10T08:42:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f1326ffd640 1 -- 172.21.15.37:0/1200731497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1320005ce0 con 0x7f13281629b0 2024-05-10T08:42:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13280b6a70 con 0x7f13281629b0 2024-05-10T08:42:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f1326ffd640 1 -- 172.21.15.37:0/1200731497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320007270 con 0x7f13281629b0 2024-05-10T08:42:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.614+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13280b7030 con 0x7f13281629b0 2024-05-10T08:42:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.615+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13280693f0 con 0x7f13281629b0 2024-05-10T08:42:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.616+0000 7f1326ffd640 1 -- 172.21.15.37:0/1200731497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f132001a070 con 0x7f13281629b0 2024-05-10T08:42:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.616+0000 7f1326ffd640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13140762d0 0x7f1314078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.616+0000 7f1326ffd640 1 -- 172.21.15.37:0/1200731497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f13200966c0 con 0x7f13281629b0 2024-05-10T08:42:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.617+0000 7f132e2c7640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13140762d0 0x7f1314078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.617+0000 7f132e2c7640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13140762d0 0x7f1314078790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1318034000 tx=0x7f131802f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.620+0000 7f1326ffd640 1 -- 172.21.15.37:0/1200731497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f132005fb30 con 0x7f13281629b0 2024-05-10T08:42:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.813+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13280afde0 con 0x7f13281629b0 2024-05-10T08:42:25.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.814+0000 7f1326ffd640 1 -- 172.21.15.37:0/1200731497 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13231 (secure 0 0 0) 0x7f1320063e30 con 0x7f13281629b0 2024-05-10T08:42:25.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:25.813 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":54,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:42:24.479678+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6837/662459250":"2024-05-11T08:42:21.368825+0000","172.21.15.82:6835/662459250":"2024-05-11T08:42:21.368825+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:42:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13140762d0 msgr2=0x7f1314078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13140762d0 0x7f1314078790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1318034000 tx=0x7f131802f000 comp rx=0 tx=0).stop 2024-05-10T08:42:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 msgr2=0x7f13280c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f13280c9350 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f132000c450 tx=0x7f132000c910 comp rx=0 tx=0).stop 2024-05-10T08:42:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 shutdown_connections 2024-05-10T08:42:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13140762d0 0x7f1314078790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13281629b0 0x7f13280c9350 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13280b2490 0x7f13280c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 --2- 172.21.15.37:0/1200731497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1328070d20 0x7f1328150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 >> 172.21.15.37:0/1200731497 conn(0x7f13280b49d0 msgr2=0x7f13280b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 shutdown_connections 2024-05-10T08:42:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.816+0000 7f133052b640 1 -- 172.21.15.37:0/1200731497 wait complete. 2024-05-10T08:42:25.826 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T08:40:11.341540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T08:42:25.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T08:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.933+0000 7fcf7519d640 1 Processor -- start 2024-05-10T08:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.933+0000 7fcf7519d640 1 -- start start 2024-05-10T08:42:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf7519d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 0x7fcf70073f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf7519d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf7006f570 0x7fcf700cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf7519d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf700ce600 con 0x7fcf7006f9d0 2024-05-10T08:42:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf7519d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcf700b09c0 con 0x7fcf7006f570 2024-05-10T08:42:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf7519d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcf70072f50 con 0x7fcf7006f190 2024-05-10T08:42:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6f59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcf7006f9d0 0x7fcf700adfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48370/0 (socket says 172.21.15.37:48370) 2024-05-10T08:42:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6f59e640 1 -- 172.21.15.37:0/611900149 learned_addr learned my addr 172.21.15.37:0/611900149 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/611900149 >> v2:172.21.15.82:3300/0 conn(0x7fcf7006f570 0x7fcf700cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6ed9d640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 0x7fcf70073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972841685 0 0) 0x7fcf700ce600 con 0x7fcf7006f9d0 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf58003520 con 0x7fcf7006f9d0 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1251846798 0 0) 0x7fcf58003520 con 0x7fcf7006f9d0 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 msgr2=0x7fcf70073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.934+0000 7fcf6dd9b640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 0x7fcf70073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 >> v2:172.21.15.82:3300/0 conn(0x7fcf7006f570 msgr2=0x7fcf700cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 --2- 172.21.15.37:0/611900149 >> v2:172.21.15.82:3300/0 conn(0x7fcf7006f570 0x7fcf700cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf70073180 con 0x7fcf7006f9d0 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fcf680019f0 con 0x7fcf7006f9d0 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/611900149 >> v2:172.21.15.82:3300/0 conn(0x7fcf7006f570 0x7fcf700cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 >> v1:172.21.15.37:6789/0 conn(0x7fcf7006f9d0 legacy=0x7fcf700adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 0x7fcf580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 0x7fcf580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5800b9c0 con 0x7fcf58003f30 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5800bb40 con 0x7fcf58004d40 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5800bd10 con 0x7fcf7006f190 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6ed9d640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 0x7fcf580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6f59e640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 0x7fcf580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6e59c640 1 -- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 msgr2=0x7fcf580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7006f190 0x7fcf580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6e59c640 1 -- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 msgr2=0x7fcf580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 0x7fcf580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.935+0000 7fcf6e59c640 1 -- 172.21.15.37:0/611900149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf58003520 con 0x7fcf58003f30 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf58004800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009cc0 tx=0x7fcf58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da157e6c09eb3f68 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64036070 con 0x7fcf58003f30 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf64031400 con 0x7fcf58003f30 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf6dd9b640 1 -- 172.21.15.37:0/611900149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64009860 con 0x7fcf58003f30 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf7519d640 1 -- 172.21.15.37:0/611900149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 msgr2=0x7fcf58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf7519d640 1 --2- 172.21.15.37:0/611900149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf58004800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009cc0 tx=0x7fcf58005830 comp rx=0 tx=0).stop 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf6f59e640 1 -- 172.21.15.37:0/611900149 reap_dead start 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf7519d640 1 -- 172.21.15.37:0/611900149 shutdown_connections 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf7519d640 1 -- 172.21.15.37:0/611900149 >> 172.21.15.37:0/611900149 conn(0x7fcf700b2cc0 msgr2=0x7fcf700b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf7519d640 1 -- 172.21.15.37:0/611900149 shutdown_connections 2024-05-10T08:42:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.936+0000 7fcf7519d640 1 -- 172.21.15.37:0/611900149 wait complete. 2024-05-10T08:42:25.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.938+0000 7fcf7519d640 1 Processor -- start 2024-05-10T08:42:25.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.938+0000 7fcf7519d640 1 -- start start 2024-05-10T08:42:25.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf7519d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf700d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf7519d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7014c790 0x7fcf7014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf7519d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7015d580 0x7fcf7015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf7519d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700cdf60 con 0x7fcf58003f30 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf7519d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70073700 con 0x7fcf7014c790 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf7519d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcf700ce0e0 con 0x7fcf7015d580 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf700d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf700d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40236/0 (socket says 172.21.15.37:40236) 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 -- 172.21.15.37:0/3494283058 learned_addr learned my addr 172.21.15.37:0/3494283058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6f59e640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7015d580 0x7fcf7015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7014c790 0x7fcf7014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 -- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7015d580 msgr2=0x7fcf7015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7015d580 0x7fcf7015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 -- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7014c790 msgr2=0x7fcf7014cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7014c790 0x7fcf7014cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 -- 172.21.15.37:0/3494283058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7015e240 con 0x7fcf58003f30 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf6ed9d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf700d1060 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcf600119a0 tx=0x7fcf60011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.939+0000 7fcf577fe640 1 -- 172.21.15.37:0/3494283058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000faf0 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.940+0000 7fcf577fe640 1 -- 172.21.15.37:0/3494283058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6000fc90 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.940+0000 7fcf577fe640 1 -- 172.21.15.37:0/3494283058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60014440 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.940+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf70157870 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.940+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf70157e30 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.941+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf700693f0 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.941+0000 7fcf577fe640 1 -- 172.21.15.37:0/3494283058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf60012040 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.942+0000 7fcf577fe640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf5c0762d0 0x7fcf5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.942+0000 7fcf577fe640 1 -- 172.21.15.37:0/3494283058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fcf600979c0 con 0x7fcf58003f30 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.942+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf5c0762d0 0x7fcf5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.942+0000 7fcf6e59c640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf5c0762d0 0x7fcf5c078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf64033000 tx=0x7fcf64008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:25.946+0000 7fcf577fe640 1 -- 172.21.15.37:0/3494283058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcf60099e20 con 0x7fcf58003f30 2024-05-10T08:42:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.136+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf70069d30 con 0x7fcf58003f30 2024-05-10T08:42:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.136+0000 7fcf577fe640 1 -- 172.21.15.37:0/3494283058 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7fcf60019030 con 0x7fcf58003f30 2024-05-10T08:42:26.136 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-10T08:42:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf5c0762d0 msgr2=0x7fcf5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf5c0762d0 0x7fcf5c078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf64033000 tx=0x7fcf64008030 comp rx=0 tx=0).stop 2024-05-10T08:42:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 msgr2=0x7fcf700d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf700d1060 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcf600119a0 tx=0x7fcf60011e60 comp rx=0 tx=0).stop 2024-05-10T08:42:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 shutdown_connections 2024-05-10T08:42:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcf5c0762d0 0x7fcf5c078790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcf7015d580 0x7fcf7015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7014c790 0x7fcf7014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 --2- 172.21.15.37:0/3494283058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf58003f30 0x7fcf700d1060 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.138+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 >> 172.21.15.37:0/3494283058 conn(0x7fcf700b2cc0 msgr2=0x7fcf700d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.139+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 shutdown_connections 2024-05-10T08:42:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.139+0000 7fcf7519d640 1 -- 172.21.15.37:0/3494283058 wait complete. 2024-05-10T08:42:26.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-05-10T08:42:26.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.254+0000 7fbaa0112640 1 Processor -- start 2024-05-10T08:42:26.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.254+0000 7fbaa0112640 1 -- start start 2024-05-10T08:42:26.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fbaa0112640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba981629b0 0x7fba9806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:26.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fbaa0112640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980b2490 0x7fba98070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:26.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fbaa0112640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba9806e110 con 0x7fba98070d20 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fbaa0112640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fba9806dec0 con 0x7fba981629b0 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fbaa0112640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fba9806e3f0 con 0x7fba980b2490 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fba9deae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba981629b0 0x7fba9806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fba9deae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba981629b0 0x7fba9806eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40252/0 (socket says 172.21.15.37:40252) 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fba9deae640 1 -- 172.21.15.37:0/2633590261 learned_addr learned my addr 172.21.15.37:0/2633590261 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.255+0000 7fba9d6ad640 1 --2- 172.21.15.37:0/2633590261 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980b2490 0x7fba98070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.256+0000 7fba9deae640 1 -- 172.21.15.37:0/2633590261 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980b2490 msgr2=0x7fba98070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.256+0000 7fba9deae640 1 --2- 172.21.15.37:0/2633590261 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980b2490 0x7fba98070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.256+0000 7fba9deae640 1 -- 172.21.15.37:0/2633590261 >> v1:172.21.15.82:6789/0 conn(0x7fba98070d20 legacy=0x7fba980afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.256+0000 7fba9deae640 1 -- 172.21.15.37:0/2633590261 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9806e6d0 con 0x7fba981629b0 2024-05-10T08:42:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.256+0000 7fba9deae640 1 --2- 172.21.15.37:0/2633590261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9806eed0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba88009e50 tx=0x7fba8802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb13e9dd4470bf9d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.256+0000 7fba9ceac640 1 -- 172.21.15.37:0/2633590261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88036070 con 0x7fba981629b0 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fba9ceac640 1 -- 172.21.15.37:0/2633590261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba88031600 con 0x7fba981629b0 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fba9ceac640 1 -- 172.21.15.37:0/2633590261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba880319d0 con 0x7fba981629b0 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 -- 172.21.15.37:0/2633590261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 msgr2=0x7fba9806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 --2- 172.21.15.37:0/2633590261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9806eed0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba88009e50 tx=0x7fba8802a710 comp rx=0 tx=0).stop 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 -- 172.21.15.37:0/2633590261 shutdown_connections 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 --2- 172.21.15.37:0/2633590261 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980b2490 0x7fba98070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 --2- 172.21.15.37:0/2633590261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9806eed0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 -- 172.21.15.37:0/2633590261 >> 172.21.15.37:0/2633590261 conn(0x7fba980b49d0 msgr2=0x7fba980b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 -- 172.21.15.37:0/2633590261 shutdown_connections 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.257+0000 7fbaa0112640 1 -- 172.21.15.37:0/2633590261 wait complete. 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.258+0000 7fbaa0112640 1 Processor -- start 2024-05-10T08:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.258+0000 7fbaa0112640 1 -- start start 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fbaa0112640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba98070d20 0x7fba981556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fbaa0112640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba980b2490 0x7fba980b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fbaa0112640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fbaa0112640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba98070870 con 0x7fba981629b0 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fbaa0112640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba9806f410 con 0x7fba980b2490 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fbaa0112640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fba980709f0 con 0x7fba98070d20 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fba9e6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fba9e6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9815dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40268/0 (socket says 172.21.15.37:40268) 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fba9e6af640 1 -- 172.21.15.37:0/818079832 learned_addr learned my addr 172.21.15.37:0/818079832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fba9deae640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba98070d20 0x7fba981556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.259+0000 7fba9d6ad640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba980b2490 0x7fba980b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba9e6af640 1 -- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba98070d20 msgr2=0x7fba981556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba9e6af640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba98070d20 0x7fba981556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba9e6af640 1 -- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba980b2490 msgr2=0x7fba980b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba9e6af640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba980b2490 0x7fba980b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba9e6af640 1 -- 172.21.15.37:0/818079832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980b8920 con 0x7fba981629b0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba9e6af640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9815dde0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba90001eb0 tx=0x7fba9000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba967fc640 1 -- 172.21.15.37:0/818079832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90017070 con 0x7fba981629b0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba967fc640 1 -- 172.21.15.37:0/818079832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba900052d0 con 0x7fba981629b0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba980b8080 con 0x7fba981629b0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fba967fc640 1 -- 172.21.15.37:0/818079832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90003810 con 0x7fba981629b0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.260+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba980b8640 con 0x7fba981629b0 2024-05-10T08:42:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.261+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba980693f0 con 0x7fba981629b0 2024-05-10T08:42:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.262+0000 7fba967fc640 1 -- 172.21.15.37:0/818079832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fba9001a070 con 0x7fba981629b0 2024-05-10T08:42:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.262+0000 7fba967fc640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba84076300 0x7fba840787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.262+0000 7fba967fc640 1 -- 172.21.15.37:0/818079832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fba900967c0 con 0x7fba981629b0 2024-05-10T08:42:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.263+0000 7fba9deae640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba84076300 0x7fba840787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.263+0000 7fba9deae640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba84076300 0x7fba840787c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fba88033000 tx=0x7fba88009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:26.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.267+0000 7fba967fc640 1 -- 172.21.15.37:0/818079832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fba9005fba0 con 0x7fba981629b0 2024-05-10T08:42:26.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:26.536+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7fba98076460 con 0x7fba981629b0 2024-05-10T08:42:27.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.497+0000 7fba967fc640 1 -- 172.21.15.37:0/818079832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v127) ==== 172+0+0 (secure 0 0 0) 0x7fba900681e0 con 0x7fba981629b0 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba84076300 msgr2=0x7fba840787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba84076300 0x7fba840787c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fba88033000 tx=0x7fba88009000 comp rx=0 tx=0).stop 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 msgr2=0x7fba9815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9815dde0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba90001eb0 tx=0x7fba9000c890 comp rx=0 tx=0).stop 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 shutdown_connections 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba84076300 0x7fba840787c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba981629b0 0x7fba9815dde0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba980b2490 0x7fba980b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 --2- 172.21.15.37:0/818079832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba98070d20 0x7fba981556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 >> 172.21.15.37:0/818079832 conn(0x7fba980b49d0 msgr2=0x7fba980b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 shutdown_connections 2024-05-10T08:42:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.500+0000 7fbaa0112640 1 -- 172.21.15.37:0/818079832 wait complete. 2024-05-10T08:42:27.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T08:42:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.628+0000 7f0d80683640 1 Processor -- start 2024-05-10T08:42:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.628+0000 7f0d80683640 1 -- start start 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.629+0000 7f0d80683640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d780b3f30 0x7f0d780d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.629+0000 7f0d80683640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d780b1c90 con 0x7f0d7815f380 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.629+0000 7f0d80683640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d780d0a50 con 0x7f0d780d3cd0 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.629+0000 7f0d80683640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0d780d0d30 con 0x7f0d780b3f30 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.629+0000 7f0d7e41f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0d7815f380 0x7f0d780d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48376/0 (socket says 172.21.15.37:48376) 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.629+0000 7f0d7e41f640 1 -- 172.21.15.37:0/3526631873 learned_addr learned my addr 172.21.15.37:0/3526631873 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.629+0000 7f0d7ec20640 1 --2- 172.21.15.37:0/3526631873 >> v2:172.21.15.82:3300/0 conn(0x7f0d780b3f30 0x7f0d780d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130820634 0 0) 0x7f0d780b1c90 con 0x7f0d7815f380 2024-05-10T08:42:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d60003520 con 0x7f0d7815f380 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1101393355 0 0) 0x7f0d60003520 con 0x7f0d7815f380 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 >> v2:172.21.15.82:3300/0 conn(0x7f0d780b3f30 msgr2=0x7f0d780d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 --2- 172.21.15.37:0/3526631873 >> v2:172.21.15.82:3300/0 conn(0x7f0d780b3f30 0x7f0d780d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 >> v1:172.21.15.82:6789/0 conn(0x7f0d780d3cd0 legacy=0x7f0d780d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d780b1f00 con 0x7f0d7815f380 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f0d70001670 con 0x7f0d7815f380 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 >> v1:172.21.15.37:6789/0 conn(0x7f0d7815f380 legacy=0x7f0d780d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d600051c0 0x7f0d6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d780d0d30 con 0x7f0d60004800 2024-05-10T08:42:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6000c060 con 0x7f0d600039b0 2024-05-10T08:42:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6000c260 con 0x7f0d600051c0 2024-05-10T08:42:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7e41f640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7ec20640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d600051c0 0x7f0d6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7dc1e640 1 -- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d600051c0 msgr2=0x7f0d6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d600051c0 0x7f0d6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7dc1e640 1 -- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d600039b0 msgr2=0x7f0d60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7dc1e640 1 -- 172.21.15.37:0/3526631873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d60003520 con 0x7f0d60004800 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.630+0000 7f0d7ec20640 1 -- 172.21.15.37:0/3526631873 reap_dead start 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.631+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c001750 tx=0x7f0d60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a625042df7d976e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.631+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c001370 con 0x7f0d60004800 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.631+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0052d0 con 0x7f0d60004800 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.631+0000 7f0d7d41d640 1 -- 172.21.15.37:0/3526631873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c02abc0 con 0x7f0d60004800 2024-05-10T08:42:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.632+0000 7f0d80683640 1 -- 172.21.15.37:0/3526631873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 msgr2=0x7f0d60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.632+0000 7f0d80683640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c001750 tx=0x7f0d60005830 comp rx=0 tx=0).stop 2024-05-10T08:42:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.632+0000 7f0d80683640 1 -- 172.21.15.37:0/3526631873 shutdown_connections 2024-05-10T08:42:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.632+0000 7f0d80683640 1 --2- 172.21.15.37:0/3526631873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.632+0000 7f0d80683640 1 -- 172.21.15.37:0/3526631873 >> 172.21.15.37:0/3526631873 conn(0x7f0d780d4fe0 msgr2=0x7f0d780d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.632+0000 7f0d80683640 1 -- 172.21.15.37:0/3526631873 shutdown_connections 2024-05-10T08:42:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.632+0000 7f0d80683640 1 -- 172.21.15.37:0/3526631873 wait complete. 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.633+0000 7f0d80683640 1 Processor -- start 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.633+0000 7f0d80683640 1 -- start start 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d80683640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d780c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d80683640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d780cb180 0x7f0d780c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d80683640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d780cb5e0 0x7f0d780c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d80683640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d780d06e0 con 0x7f0d60004800 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d80683640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d780d1010 con 0x7f0d780cb180 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d80683640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0d780d35c0 con 0x7f0d780cb5e0 2024-05-10T08:42:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d780c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d780c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40284/0 (socket says 172.21.15.37:40284) 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 -- 172.21.15.37:0/1227830968 learned_addr learned my addr 172.21.15.37:0/1227830968 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7ec20640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d780cb5e0 0x7f0d780c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d780cb180 0x7f0d780c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 -- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d780cb5e0 msgr2=0x7f0d780c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d780cb5e0 0x7f0d780c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 -- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d780cb180 msgr2=0x7f0d780c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d780cb180 0x7f0d780c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 -- 172.21.15.37:0/1227830968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7814b610 con 0x7f0d60004800 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7ec20640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d780cb5e0 0x7f0d780c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d780cb180 0x7f0d780c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.634+0000 7f0d7e41f640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d780c7cc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d700072f0 tx=0x7f0d700077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.635+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1227830968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7001a070 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.635+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1227830968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7000f960 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.635+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7814b8b0 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.635+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1227830968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000fd50 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.635+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7814be70 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.636+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d780693f0 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.636+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1227830968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d7001d070 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.637+0000 7f0d76ffd640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d640762d0 0x7f0d64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.637+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1227830968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f0d70096d10 con 0x7f0d60004800 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.637+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d640762d0 0x7f0d64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.638+0000 7f0d7dc1e640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d640762d0 0x7f0d64078790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c032000 tx=0x7f0d6c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:27.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.641+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1227830968 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0d700607e0 con 0x7f0d60004800 2024-05-10T08:42:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.835+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0d780b3a00 con 0x7f0d60004800 2024-05-10T08:42:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.841+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1227830968 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f0d700600e0 con 0x7f0d60004800 2024-05-10T08:42:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d640762d0 msgr2=0x7f0d64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d640762d0 0x7f0d64078790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c032000 tx=0x7f0d6c02e000 comp rx=0 tx=0).stop 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 msgr2=0x7f0d780c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d780c7cc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d700072f0 tx=0x7f0d700077b0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 shutdown_connections 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d640762d0 0x7f0d64078790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d780cb5e0 0x7f0d780c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d780cb180 0x7f0d780c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 --2- 172.21.15.37:0/1227830968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d60004800 0x7f0d780c7cc0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 >> 172.21.15.37:0/1227830968 conn(0x7f0d780d4fe0 msgr2=0x7f0d7815e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 shutdown_connections 2024-05-10T08:42:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:27.843+0000 7f0d80683640 1 -- 172.21.15.37:0/1227830968 wait complete. 2024-05-10T08:42:27.854 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:42:27.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:42:27.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:42:27.947 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:42:27.947 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:42:27.947 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:27.963 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:42:27.963 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:42:27.963 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:27.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:42:27.983 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:42:27.983 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:28.019 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:42:28.019 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:42:28.019 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:28.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:42:28.042 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T08:42:28.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:28.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.163+0000 7f5541e54640 1 Processor -- start 2024-05-10T08:42:28.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.163+0000 7f5541e54640 1 -- start start 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5541e54640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f553c06e0f0 0x7f553c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5541e54640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f553c0d0360 0x7f553c0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5541e54640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553c15d2a0 con 0x7f553c06f060 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5541e54640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f553c0d07c0 con 0x7f553c06e0f0 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5541e54640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f553c06f440 con 0x7f553c0d0360 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5533fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f553c06e0f0 0x7f553c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5533fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f553c06e0f0 0x7f553c0cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56238/0 (socket says 172.21.15.37:56238) 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5533fff640 1 -- 172.21.15.37:0/53539721 learned_addr learned my addr 172.21.15.37:0/53539721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f553bfff640 1 --2- 172.21.15.37:0/53539721 >> v2:172.21.15.82:3300/0 conn(0x7f553c0d0360 0x7f553c0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5533fff640 1 -- 172.21.15.37:0/53539721 >> v2:172.21.15.82:3300/0 conn(0x7f553c0d0360 msgr2=0x7f553c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:28.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5533fff640 1 --2- 172.21.15.37:0/53539721 >> v2:172.21.15.82:3300/0 conn(0x7f553c0d0360 0x7f553c0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5533fff640 1 -- 172.21.15.37:0/53539721 >> v1:172.21.15.82:6789/0 conn(0x7f553c06f060 legacy=0x7f553c06fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:28.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.164+0000 7f5533fff640 1 -- 172.21.15.37:0/53539721 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c1609b0 con 0x7f553c06e0f0 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.165+0000 7f5533fff640 1 --2- 172.21.15.37:0/53539721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c0cfe20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f553c09f050 tx=0x7f552402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b67ca9408abaf23 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.165+0000 7f553affd640 1 -- 172.21.15.37:0/53539721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524037070 con 0x7f553c06e0f0 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.165+0000 7f553affd640 1 -- 172.21.15.37:0/53539721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524032440 con 0x7f553c06e0f0 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.165+0000 7f553affd640 1 -- 172.21.15.37:0/53539721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524032810 con 0x7f553c06e0f0 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 -- 172.21.15.37:0/53539721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 msgr2=0x7f553c0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 --2- 172.21.15.37:0/53539721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c0cfe20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f553c09f050 tx=0x7f552402a230 comp rx=0 tx=0).stop 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 -- 172.21.15.37:0/53539721 shutdown_connections 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 --2- 172.21.15.37:0/53539721 >> v2:172.21.15.82:3300/0 conn(0x7f553c0d0360 0x7f553c0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 --2- 172.21.15.37:0/53539721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c0cfe20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 -- 172.21.15.37:0/53539721 >> 172.21.15.37:0/53539721 conn(0x7f553c06c3a0 msgr2=0x7f553c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:28.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 -- 172.21.15.37:0/53539721 shutdown_connections 2024-05-10T08:42:28.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.166+0000 7f5541e54640 1 -- 172.21.15.37:0/53539721 wait complete. 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.167+0000 7f5541e54640 1 Processor -- start 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.167+0000 7f5541e54640 1 -- start start 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f5541e54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c1f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f5541e54640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553c06f060 0x7f553c151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f5541e54640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553c0d0360 0x7f553c09e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f5541e54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f553c161250 con 0x7f553c06e0f0 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f5541e54640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f553c160f70 con 0x7f553c0d0360 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f5541e54640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f553c161530 con 0x7f553c06f060 2024-05-10T08:42:28.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c1f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c1f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56242/0 (socket says 172.21.15.37:56242) 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 -- 172.21.15.37:0/817830216 learned_addr learned my addr 172.21.15.37:0/817830216 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f5533fff640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553c06f060 0x7f553c151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553bfff640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553c0d0360 0x7f553c09e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 -- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553c06f060 msgr2=0x7f553c151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553c06f060 0x7f553c151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 -- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553c0d0360 msgr2=0x7f553c09e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553c0d0360 0x7f553c09e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.168+0000 7f553b7fe640 1 -- 172.21.15.37:0/817830216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c0720b0 con 0x7f553c06e0f0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.169+0000 7f553b7fe640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c1f4810 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c430 tx=0x7f552c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.169+0000 7f5538ff9640 1 -- 172.21.15.37:0/817830216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c011790 con 0x7f553c06e0f0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.169+0000 7f5538ff9640 1 -- 172.21.15.37:0/817830216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c017070 con 0x7f553c06e0f0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.169+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c1f4e30 con 0x7f553c06e0f0 2024-05-10T08:42:28.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.169+0000 7f5538ff9640 1 -- 172.21.15.37:0/817830216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c011bb0 con 0x7f553c06e0f0 2024-05-10T08:42:28.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.169+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c1f53f0 con 0x7f553c06e0f0 2024-05-10T08:42:28.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.170+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c0693f0 con 0x7f553c06e0f0 2024-05-10T08:42:28.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.170+0000 7f5538ff9640 1 -- 172.21.15.37:0/817830216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f552c01c460 con 0x7f553c06e0f0 2024-05-10T08:42:28.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.171+0000 7f5538ff9640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f551c0762d0 0x7f551c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.171+0000 7f5538ff9640 1 -- 172.21.15.37:0/817830216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f552c097340 con 0x7f553c06e0f0 2024-05-10T08:42:28.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.171+0000 7f5533fff640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f551c0762d0 0x7f551c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.172+0000 7f5533fff640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f551c0762d0 0x7f551c078790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5524034000 tx=0x7f552402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:28.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.175+0000 7f5538ff9640 1 -- 172.21.15.37:0/817830216 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f552c060e10 con 0x7f553c06e0f0 2024-05-10T08:42:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.404+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f553c09e8c0 con 0x7f553c06e0f0 2024-05-10T08:42:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.404+0000 7f5538ff9640 1 -- 172.21.15.37:0/817830216 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3863 (secure 0 0 0) 0x7f552c060710 con 0x7f553c06e0f0 2024-05-10T08:42:28.404 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:28.404 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3601274855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3601274855},{"type":"v1","addr":"172.21.15.37:6834","nonce":3601274855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/875553799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":875553799},{"type":"v1","addr":"172.21.15.37:6835","nonce":875553799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1278524218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1278524218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1278524218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/769730793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":769730793},{"type":"v1","addr":"172.21.15.82:6837","nonce":769730793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-05-10T08:42:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f551c0762d0 msgr2=0x7f551c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f551c0762d0 0x7f551c078790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5524034000 tx=0x7f552402e000 comp rx=0 tx=0).stop 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 msgr2=0x7f553c1f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c1f4810 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c430 tx=0x7f552c00c8f0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 shutdown_connections 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f551c0762d0 0x7f551c078790 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f553c0d0360 0x7f553c09e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f553c06f060 0x7f553c151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 --2- 172.21.15.37:0/817830216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f553c06e0f0 0x7f553c1f4810 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 >> 172.21.15.37:0/817830216 conn(0x7f553c06c3a0 msgr2=0x7f553c15e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.406+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 shutdown_connections 2024-05-10T08:42:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.407+0000 7f5541e54640 1 -- 172.21.15.37:0/817830216 wait complete. 2024-05-10T08:42:28.417 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:42:28.417 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T08:42:28.418 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:42:28.418 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:42:28.418 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:42:28.418 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T08:42:28.418 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:42:28.418 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:42:28.418 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:42:28.418 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T08:42:28.419 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:42:28.419 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:42:28.419 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:42:28.419 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T08:42:28.419 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:42:28.419 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:42:28.428 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:42:28.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:42:28.429 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:42:28.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:42:28.431 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:42:28.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:42:28.432 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:42:28.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:42:28.470 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:42:28.471 DEBUG:teuthology.parallel:result is None 2024-05-10T08:42:28.471 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:42:28.471 DEBUG:teuthology.parallel:result is None 2024-05-10T08:42:28.473 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:42:28.473 DEBUG:teuthology.parallel:result is None 2024-05-10T08:42:28.474 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:42:28.474 DEBUG:teuthology.parallel:result is None 2024-05-10T08:42:28.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T08:42:28.550 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:42:28.550 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:42:28.556 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:42:28.556 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:42:28.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.586+0000 7f0871859640 1 Processor -- start 2024-05-10T08:42:28.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.586+0000 7f0871859640 1 -- start start 2024-05-10T08:42:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f0871859640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f086c0d53d0 0x7f086c0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f0871859640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c1630b0 con 0x7f086c15f420 2024-05-10T08:42:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f0871859640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0d3e70 con 0x7f086c0d1970 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f0871859640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f086c0d2550 con 0x7f086c0d53d0 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f086b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f086c0d53d0 0x7f086c0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f086affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f086c15f420 0x7f086c0d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35454/0 (socket says 172.21.15.37:35454) 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f086affd640 1 -- 172.21.15.37:0/3312591492 learned_addr learned my addr 172.21.15.37:0/3312591492 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f086b7fe640 1 -- 172.21.15.37:0/3312591492 >> v1:172.21.15.82:6789/0 conn(0x7f086c0d1970 legacy=0x7f086c0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f086b7fe640 1 -- 172.21.15.37:0/3312591492 >> v1:172.21.15.37:6789/0 conn(0x7f086c15f420 legacy=0x7f086c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f086b7fe640 1 -- 172.21.15.37:0/3312591492 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c0d2c80 con 0x7f086c0d53d0 2024-05-10T08:42:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.587+0000 7f0869ffb640 1 -- 172.21.15.37:0/3312591492 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002794256 0 0) 0x7f085c001110 con 0x7f086c15f420 2024-05-10T08:42:28.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.588+0000 7f086b7fe640 1 --2- 172.21.15.37:0/3312591492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d53d0 0x7f086c0d1e20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0864009d90 tx=0x7f086402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c450753feb478ee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:28.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.588+0000 7f0869ffb640 1 -- 172.21.15.37:0/3312591492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864007740 con 0x7f086c0d53d0 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.588+0000 7f0869ffb640 1 -- 172.21.15.37:0/3312591492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08640078e0 con 0x7f086c0d53d0 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.588+0000 7f0869ffb640 1 -- 172.21.15.37:0/3312591492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864007cb0 con 0x7f086c0d53d0 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.589+0000 7f0871859640 1 -- 172.21.15.37:0/3312591492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d53d0 msgr2=0x7f086c0d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.589+0000 7f0871859640 1 --2- 172.21.15.37:0/3312591492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d53d0 0x7f086c0d1e20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0864009d90 tx=0x7f086402a6f0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.589+0000 7f0871859640 1 -- 172.21.15.37:0/3312591492 shutdown_connections 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.589+0000 7f0871859640 1 --2- 172.21.15.37:0/3312591492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d53d0 0x7f086c0d1e20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.589+0000 7f0871859640 1 -- 172.21.15.37:0/3312591492 >> 172.21.15.37:0/3312591492 conn(0x7f086c08eac0 msgr2=0x7f086c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.589+0000 7f0871859640 1 -- 172.21.15.37:0/3312591492 shutdown_connections 2024-05-10T08:42:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.589+0000 7f0871859640 1 -- 172.21.15.37:0/3312591492 wait complete. 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.590+0000 7f0871859640 1 Processor -- start 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.590+0000 7f0871859640 1 -- start start 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f0871859640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d1970 0x7f086c159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f0871859640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f086c0d53d0 0x7f086c0b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f0871859640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086c0b31d0 0x7f086c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f0871859640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f086c0d2830 con 0x7f086c0d1970 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f0871859640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f086c0d3240 con 0x7f086c0b31d0 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f0871859640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f086c0cfb20 con 0x7f086c0d53d0 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d1970 0x7f086c159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d1970 0x7f086c159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56324/0 (socket says 172.21.15.37:56324) 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 -- 172.21.15.37:0/599375572 learned_addr learned my addr 172.21.15.37:0/599375572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086b7fe640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086c0b31d0 0x7f086c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086a7fc640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f086c0d53d0 0x7f086c0b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 -- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f086c0d53d0 msgr2=0x7f086c0b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f086c0d53d0 0x7f086c0b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 -- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086c0b31d0 msgr2=0x7f086c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086c0b31d0 0x7f086c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 -- 172.21.15.37:0/599375572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c0caac0 con 0x7f086c0d1970 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086b7fe640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086c0b31d0 0x7f086c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f086affd640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d1970 0x7f086c159e80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c3f0 tx=0x7f085c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.591+0000 7f0853fff640 1 -- 172.21.15.37:0/599375572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c0074e0 con 0x7f086c0d1970 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.592+0000 7f0853fff640 1 -- 172.21.15.37:0/599375572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c0047e0 con 0x7f086c0d1970 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.592+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f086c0cada0 con 0x7f086c0d1970 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.592+0000 7f0853fff640 1 -- 172.21.15.37:0/599375572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c004c10 con 0x7f086c0d1970 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.592+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086c0cb360 con 0x7f086c0d1970 2024-05-10T08:42:28.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.593+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086c0cb7a0 con 0x7f086c0d1970 2024-05-10T08:42:28.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.593+0000 7f0853fff640 1 -- 172.21.15.37:0/599375572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f085c011070 con 0x7f086c0d1970 2024-05-10T08:42:28.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.594+0000 7f0853fff640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08580762d0 0x7f0858078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:28.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.594+0000 7f0853fff640 1 -- 172.21.15.37:0/599375572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f085c0970d0 con 0x7f086c0d1970 2024-05-10T08:42:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.594+0000 7f086a7fc640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08580762d0 0x7f0858078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.595+0000 7f086a7fc640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08580762d0 0x7f0858078790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f086c0d1370 tx=0x7f0860009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:28.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.598+0000 7f0853fff640 1 -- 172.21.15.37:0/599375572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f086c1630b0 con 0x7f086c0d1970 2024-05-10T08:42:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:28.800+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f086c0693f0 con 0x7f086c0d1970 2024-05-10T08:42:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.515+0000 7f0853fff640 1 -- 172.21.15.37:0/599375572 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7f085c060b90 con 0x7f086c0d1970 2024-05-10T08:42:29.515 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-10T08:42:29.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08580762d0 msgr2=0x7f0858078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08580762d0 0x7f0858078790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f086c0d1370 tx=0x7f0860009040 comp rx=0 tx=0).stop 2024-05-10T08:42:29.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d1970 msgr2=0x7f086c159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d1970 0x7f086c159e80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c3f0 tx=0x7f085c00c8b0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 shutdown_connections 2024-05-10T08:42:29.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08580762d0 0x7f0858078790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086c0b31d0 0x7f086c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f086c0d53d0 0x7f086c0b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 --2- 172.21.15.37:0/599375572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f086c0d1970 0x7f086c159e80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.518+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 >> 172.21.15.37:0/599375572 conn(0x7f086c08eac0 msgr2=0x7f086c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:29.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.519+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 shutdown_connections 2024-05-10T08:42:29.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.519+0000 7f0871859640 1 -- 172.21.15.37:0/599375572 wait complete. 2024-05-10T08:42:29.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T08:42:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.645+0000 7fe57aacc640 1 Processor -- start 2024-05-10T08:42:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.645+0000 7fe57aacc640 1 -- start start 2024-05-10T08:42:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.646+0000 7fe57aacc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe57415c510 0x7fe5740734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.646+0000 7fe57aacc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57406d3b0 0x7fe57406d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.646+0000 7fe57aacc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe574156a40 con 0x7fe57406fb80 2024-05-10T08:42:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.646+0000 7fe57aacc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe574073a30 con 0x7fe57415c510 2024-05-10T08:42:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.646+0000 7fe57aacc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe57415c9c0 con 0x7fe57406d3b0 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe579069640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57406d3b0 0x7fe57406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe573fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe57415c510 0x7fe5740734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe579069640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57406d3b0 0x7fe57406d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:37242/0 (socket says 172.21.15.37:37242) 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe579069640 1 -- 172.21.15.37:0/2632964324 learned_addr learned my addr 172.21.15.37:0/2632964324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe573fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe57415c510 0x7fe5740734f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:53096/0 (socket says 172.21.15.37:53096) 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe578868640 1 --1- 172.21.15.37:0/2632964324 >> v1:172.21.15.82:6789/0 conn(0x7fe57406fb80 0x7fe57406e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:60786/0 (socket says 172.21.15.37:60786) 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe579069640 1 -- 172.21.15.37:0/2632964324 >> v2:172.21.15.82:3300/0 conn(0x7fe57415c510 msgr2=0x7fe5740734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe579069640 1 --2- 172.21.15.37:0/2632964324 >> v2:172.21.15.82:3300/0 conn(0x7fe57415c510 0x7fe5740734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe579069640 1 -- 172.21.15.37:0/2632964324 >> v1:172.21.15.82:6789/0 conn(0x7fe57406fb80 legacy=0x7fe57406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe579069640 1 -- 172.21.15.37:0/2632964324 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57406ef10 con 0x7fe57406d3b0 2024-05-10T08:42:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.647+0000 7fe573fff640 1 --2- 172.21.15.37:0/2632964324 >> v2:172.21.15.82:3300/0 conn(0x7fe57415c510 0x7fe5740734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.648+0000 7fe579069640 1 --2- 172.21.15.37:0/2632964324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57406d3b0 0x7fe57406d840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe564009870 tx=0x7fe56402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec10ae57c60cf012 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.648+0000 7fe5737fe640 1 -- 172.21.15.37:0/2632964324 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe564037070 con 0x7fe57406d3b0 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.648+0000 7fe5737fe640 1 -- 172.21.15.37:0/2632964324 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe564032440 con 0x7fe57406d3b0 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.648+0000 7fe5737fe640 1 -- 172.21.15.37:0/2632964324 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe564032810 con 0x7fe57406d3b0 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 -- 172.21.15.37:0/2632964324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57406d3b0 msgr2=0x7fe57406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 --2- 172.21.15.37:0/2632964324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57406d3b0 0x7fe57406d840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe564009870 tx=0x7fe56402a270 comp rx=0 tx=0).stop 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 -- 172.21.15.37:0/2632964324 shutdown_connections 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 --2- 172.21.15.37:0/2632964324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57406d3b0 0x7fe57406d840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 --2- 172.21.15.37:0/2632964324 >> v2:172.21.15.82:3300/0 conn(0x7fe57415c510 0x7fe5740734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 -- 172.21.15.37:0/2632964324 >> 172.21.15.37:0/2632964324 conn(0x7fe574072960 msgr2=0x7fe574072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 -- 172.21.15.37:0/2632964324 shutdown_connections 2024-05-10T08:42:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.649+0000 7fe57aacc640 1 -- 172.21.15.37:0/2632964324 wait complete. 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.650+0000 7fe57aacc640 1 Processor -- start 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.650+0000 7fe57aacc640 1 -- start start 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe57aacc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57406d3b0 0x7fe5741f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe57aacc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe57406fb80 0x7fe5741e5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe57aacc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57415c510 0x7fe5741e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe57aacc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe57415cf20 con 0x7fe57406d3b0 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe57aacc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe57415cc40 con 0x7fe57406fb80 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe57aacc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe57415d200 con 0x7fe57415c510 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe578868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57406d3b0 0x7fe5741f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe578868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57406d3b0 0x7fe5741f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56340/0 (socket says 172.21.15.37:56340) 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe578868640 1 -- 172.21.15.37:0/1735155272 learned_addr learned my addr 172.21.15.37:0/1735155272 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe573fff640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe57406fb80 0x7fe5741e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.651+0000 7fe579069640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57415c510 0x7fe5741e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe578868640 1 -- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57415c510 msgr2=0x7fe5741e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe578868640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57415c510 0x7fe5741e70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe578868640 1 -- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe57406fb80 msgr2=0x7fe5741e5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe578868640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe57406fb80 0x7fe5741e5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe578868640 1 -- 172.21.15.37:0/1735155272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5741e5c50 con 0x7fe57406d3b0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe578868640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57406d3b0 0x7fe5741f5d00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00c790 tx=0x7fe56c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe5717fa640 1 -- 172.21.15.37:0/1735155272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c017070 con 0x7fe57406d3b0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe5717fa640 1 -- 172.21.15.37:0/1735155272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe56c00a640 con 0x7fe57406d3b0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5741e5f30 con 0x7fe57406d3b0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe5717fa640 1 -- 172.21.15.37:0/1735155272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c00a9f0 con 0x7fe57406d3b0 2024-05-10T08:42:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.652+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5741e64f0 con 0x7fe57406d3b0 2024-05-10T08:42:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.653+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5741f3090 con 0x7fe57406d3b0 2024-05-10T08:42:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.654+0000 7fe5717fa640 1 -- 172.21.15.37:0/1735155272 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe56c01a070 con 0x7fe57406d3b0 2024-05-10T08:42:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.654+0000 7fe5717fa640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5600762d0 0x7fe560078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.655+0000 7fe5717fa640 1 -- 172.21.15.37:0/1735155272 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7fe56c096a00 con 0x7fe57406d3b0 2024-05-10T08:42:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.655+0000 7fe573fff640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5600762d0 0x7fe560078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.655+0000 7fe573fff640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5600762d0 0x7fe560078790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe568009560 tx=0x7fe568009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.659+0000 7fe5717fa640 1 -- 172.21.15.37:0/1735155272 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe574156a40 con 0x7fe57406d3b0 2024-05-10T08:42:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.922+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe5741e6890 con 0x7fe57406d3b0 2024-05-10T08:42:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.923+0000 7fe5717fa640 1 -- 172.21.15.37:0/1735155272 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fe56c05fed0 con 0x7fe57406d3b0 2024-05-10T08:42:29.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:29.922 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:42:29.922 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-10T08:42:29.922 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg==", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ==", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA==", 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw==", 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw==", 2024-05-10T08:42:29.925 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw==", 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.926 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg==", 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ==", 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.927 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g==", 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-10T08:42:29.928 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA==", 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w==", 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg==", 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A==", 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.930 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg==", 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw==", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA==", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA83T1mpCEPLBAAZlDinj6hQh8Ccd9D/MMUDw==", 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA==", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A==", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:42:29.935 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.935 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:29.935 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:42:29.935 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.924+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5600762d0 msgr2=0x7fe560078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.924+0000 7fe57aacc640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5600762d0 0x7fe560078790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe568009560 tx=0x7fe568009190 comp rx=0 tx=0).stop 2024-05-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.924+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57406d3b0 msgr2=0x7fe5741f5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.924+0000 7fe57aacc640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57406d3b0 0x7fe5741f5d00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00c790 tx=0x7fe56c00cc50 comp rx=0 tx=0).stop 2024-05-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 shutdown_connections 2024-05-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5600762d0 0x7fe560078790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe57415c510 0x7fe5741e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe57406fb80 0x7fe5741e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 --2- 172.21.15.37:0/1735155272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57406d3b0 0x7fe5741f5d00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 >> 172.21.15.37:0/1735155272 conn(0x7fe574072960 msgr2=0x7fe5740b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 shutdown_connections 2024-05-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:29.925+0000 7fe57aacc640 1 -- 172.21.15.37:0/1735155272 wait complete. 2024-05-10T08:42:29.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:42:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.042+0000 7fd30fdf0640 1 Processor -- start 2024-05-10T08:42:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.042+0000 7fd30fdf0640 1 -- start start 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30fdf0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd30806d620 0x7fd308073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30fdf0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806da00 0x7fd3080af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30fdf0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3080af800 con 0x7fd3080b5ee0 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30fdf0640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd3080afaa0 con 0x7fd30806d620 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30fdf0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd3080b5a50 con 0x7fd30806da00 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30d38b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806da00 0x7fd3080af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30db8c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd30806d620 0x7fd308073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30d38b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806da00 0x7fd3080af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:37262/0 (socket says 172.21.15.37:37262) 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30d38b640 1 -- 172.21.15.37:0/349035971 learned_addr learned my addr 172.21.15.37:0/349035971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.043+0000 7fd30db8c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd30806d620 0x7fd308073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:53108/0 (socket says 172.21.15.37:53108) 2024-05-10T08:42:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.044+0000 7fd30d38b640 1 -- 172.21.15.37:0/349035971 >> v2:172.21.15.82:3300/0 conn(0x7fd30806d620 msgr2=0x7fd308073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.044+0000 7fd30d38b640 1 --2- 172.21.15.37:0/349035971 >> v2:172.21.15.82:3300/0 conn(0x7fd30806d620 0x7fd308073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.044+0000 7fd30d38b640 1 -- 172.21.15.37:0/349035971 >> v1:172.21.15.82:6789/0 conn(0x7fd3080b5ee0 legacy=0x7fd30806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.044+0000 7fd30d38b640 1 -- 172.21.15.37:0/349035971 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3080b5120 con 0x7fd30806da00 2024-05-10T08:42:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30d38b640 1 --2- 172.21.15.37:0/349035971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806da00 0x7fd3080af2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009870 tx=0x7fd2fc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=104761dbbbb5ee4c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30cb8a640 1 -- 172.21.15.37:0/349035971 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc037070 con 0x7fd30806da00 2024-05-10T08:42:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30cb8a640 1 -- 172.21.15.37:0/349035971 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc032440 con 0x7fd30806da00 2024-05-10T08:42:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30cb8a640 1 -- 172.21.15.37:0/349035971 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc032810 con 0x7fd30806da00 2024-05-10T08:42:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 -- 172.21.15.37:0/349035971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806da00 msgr2=0x7fd3080af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/349035971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806da00 0x7fd3080af2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009870 tx=0x7fd2fc02a130 comp rx=0 tx=0).stop 2024-05-10T08:42:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 -- 172.21.15.37:0/349035971 shutdown_connections 2024-05-10T08:42:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/349035971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806da00 0x7fd3080af2c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/349035971 >> v2:172.21.15.82:3300/0 conn(0x7fd30806d620 0x7fd308073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 -- 172.21.15.37:0/349035971 >> 172.21.15.37:0/349035971 conn(0x7fd3080728c0 msgr2=0x7fd308072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 -- 172.21.15.37:0/349035971 shutdown_connections 2024-05-10T08:42:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.045+0000 7fd30fdf0640 1 -- 172.21.15.37:0/349035971 wait complete. 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.046+0000 7fd30fdf0640 1 Processor -- start 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30fdf0640 1 -- start start 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30fdf0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806d620 0x7fd30814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30fdf0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30806da00 0x7fd30814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30fdf0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3080b5ee0 0x7fd3080c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30fdf0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd30806f030 con 0x7fd30806da00 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30fdf0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3080b56e0 con 0x7fd3080b5ee0 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30fdf0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd30806f1b0 con 0x7fd30806d620 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30d38b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30806da00 0x7fd30814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30d38b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30806da00 0x7fd30814af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56356/0 (socket says 172.21.15.37:56356) 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.047+0000 7fd30d38b640 1 -- 172.21.15.37:0/1699688954 learned_addr learned my addr 172.21.15.37:0/1699688954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30db8c640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806d620 0x7fd30814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30e38d640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3080b5ee0 0x7fd3080c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30d38b640 1 -- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806d620 msgr2=0x7fd30814c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30d38b640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806d620 0x7fd30814c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30d38b640 1 -- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3080b5ee0 msgr2=0x7fd3080c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30d38b640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3080b5ee0 0x7fd3080c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30d38b640 1 -- 172.21.15.37:0/1699688954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30814b850 con 0x7fd30806da00 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30d38b640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30806da00 0x7fd30814af50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009870 tx=0x7fd2fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd3067fc640 1 -- 172.21.15.37:0/1699688954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc041070 con 0x7fd30806da00 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd3067fc640 1 -- 172.21.15.37:0/1699688954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc03c870 con 0x7fd30806da00 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30814bb30 con 0x7fd30806da00 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd3067fc640 1 -- 172.21.15.37:0/1699688954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc037040 con 0x7fd30806da00 2024-05-10T08:42:30.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.048+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30814c0f0 con 0x7fd30806da00 2024-05-10T08:42:30.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.049+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30815ea40 con 0x7fd30806da00 2024-05-10T08:42:30.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.050+0000 7fd3067fc640 1 -- 172.21.15.37:0/1699688954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2fc044070 con 0x7fd30806da00 2024-05-10T08:42:30.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.050+0000 7fd3067fc640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2f4076300 0x7fd2f40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.050+0000 7fd3067fc640 1 -- 172.21.15.37:0/1699688954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7fd2fc0b7db0 con 0x7fd30806da00 2024-05-10T08:42:30.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.050+0000 7fd30db8c640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2f4076300 0x7fd2f40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.051+0000 7fd30db8c640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2f4076300 0x7fd2f40787c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd300009a30 tx=0x7fd300008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:30.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.054+0000 7fd3067fc640 1 -- 172.21.15.37:0/1699688954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd30815ea40 con 0x7fd30806da00 2024-05-10T08:42:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.247+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd3080b2430 con 0x7fd30806da00 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.247+0000 7fd3067fc640 1 -- 172.21.15.37:0/1699688954 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7fd2fc0818d0 con 0x7fd30806da00 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:30.247 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2f4076300 msgr2=0x7fd2f40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2f4076300 0x7fd2f40787c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd300009a30 tx=0x7fd300008040 comp rx=0 tx=0).stop 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30806da00 msgr2=0x7fd30814af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30806da00 0x7fd30814af50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009870 tx=0x7fd2fc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 shutdown_connections 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2f4076300 0x7fd2f40787c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3080b5ee0 0x7fd3080c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30806da00 0x7fd30814af50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 --2- 172.21.15.37:0/1699688954 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd30806d620 0x7fd30814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 >> 172.21.15.37:0/1699688954 conn(0x7fd3080728c0 msgr2=0x7fd3080b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 shutdown_connections 2024-05-10T08:42:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.249+0000 7fd30fdf0640 1 -- 172.21.15.37:0/1699688954 wait complete. 2024-05-10T08:42:30.260 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:42:30.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:42:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.369+0000 7f3590207640 1 Processor -- start 2024-05-10T08:42:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.370+0000 7f3590207640 1 -- start start 2024-05-10T08:42:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.370+0000 7f3590207640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3588159770 0x7f358806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.370+0000 7f3590207640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35880af6a0 0x7f358806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.370+0000 7f3590207640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880afbe0 con 0x7f358806c8e0 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.370+0000 7f3590207640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f35880b1660 con 0x7f3588159770 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.370+0000 7f3590207640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f35881600d0 con 0x7f35880af6a0 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358dfa3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3588159770 0x7f358806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358d7a2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f358806c8e0 0x7f35880aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35456/0 (socket says 172.21.15.37:35456) 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358d7a2640 1 -- 172.21.15.37:0/634755005 learned_addr learned my addr 172.21.15.37:0/634755005 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358e7a4640 1 --2- 172.21.15.37:0/634755005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35880af6a0 0x7f358806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358dfa3640 1 -- 172.21.15.37:0/634755005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35880af6a0 msgr2=0x7f358806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358cfa1640 1 -- 172.21.15.37:0/634755005 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202767616 0 0) 0x7f35880afbe0 con 0x7f358806c8e0 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358dfa3640 1 --2- 172.21.15.37:0/634755005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35880af6a0 0x7f358806ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358dfa3640 1 -- 172.21.15.37:0/634755005 >> v1:172.21.15.37:6789/0 conn(0x7f358806c8e0 legacy=0x7f35880aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358dfa3640 1 -- 172.21.15.37:0/634755005 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358815fa80 con 0x7f3588159770 2024-05-10T08:42:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.371+0000 7f358e7a4640 1 --2- 172.21.15.37:0/634755005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35880af6a0 0x7f358806ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f358dfa3640 1 --2- 172.21.15.37:0/634755005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f358806c3a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f35800097a0 tx=0x7f358002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dac73b3934258b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f358cfa1640 1 -- 172.21.15.37:0/634755005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580037070 con 0x7f3588159770 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f358cfa1640 1 -- 172.21.15.37:0/634755005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3580032440 con 0x7f3588159770 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f358cfa1640 1 -- 172.21.15.37:0/634755005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580032810 con 0x7f3588159770 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 -- 172.21.15.37:0/634755005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 msgr2=0x7f358806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 --2- 172.21.15.37:0/634755005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f358806c3a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f35800097a0 tx=0x7f358002a180 comp rx=0 tx=0).stop 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 -- 172.21.15.37:0/634755005 shutdown_connections 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 --2- 172.21.15.37:0/634755005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35880af6a0 0x7f358806ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 --2- 172.21.15.37:0/634755005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f358806c3a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 -- 172.21.15.37:0/634755005 >> 172.21.15.37:0/634755005 conn(0x7f35880b3aa0 msgr2=0x7f35880b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 -- 172.21.15.37:0/634755005 shutdown_connections 2024-05-10T08:42:30.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.372+0000 7f3590207640 1 -- 172.21.15.37:0/634755005 wait complete. 2024-05-10T08:42:30.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 Processor -- start 2024-05-10T08:42:30.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 -- start start 2024-05-10T08:42:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f358806c8e0 0x7f35881455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35880af6a0 0x7f35881f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f3588147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f358815f730 con 0x7f3588159770 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3588159b50 con 0x7f35880af6a0 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.374+0000 7f3590207640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3588160560 con 0x7f358806c8e0 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f3588147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f3588147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56376/0 (socket says 172.21.15.37:56376) 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 -- 172.21.15.37:0/3819724167 learned_addr learned my addr 172.21.15.37:0/3819724167 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358dfa3640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f358806c8e0 0x7f35881455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358d7a2640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35880af6a0 0x7f35881f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 -- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f358806c8e0 msgr2=0x7f35881455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f358806c8e0 0x7f35881455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 -- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35880af6a0 msgr2=0x7f35881f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35880af6a0 0x7f35881f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 -- 172.21.15.37:0/3819724167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358815d4e0 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f358e7a4640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f3588147610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f357800ce80 tx=0x7f357800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f35867fc640 1 -- 172.21.15.37:0/3819724167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357801a070 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f35867fc640 1 -- 172.21.15.37:0/3819724167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f357800d880 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3588148050 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f35867fc640 1 -- 172.21.15.37:0/3819724167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357800dc70 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.375+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358815d780 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.376+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358806a8f0 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.377+0000 7f35867fc640 1 -- 172.21.15.37:0/3819724167 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f357801d070 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.377+0000 7f35867fc640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35740762d0 0x7f3574078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.377+0000 7f35867fc640 1 -- 172.21.15.37:0/3819724167 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f3578097b00 con 0x7f3588159770 2024-05-10T08:42:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.378+0000 7f358dfa3640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35740762d0 0x7f3574078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.378+0000 7f358dfa3640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35740762d0 0x7f3574078790 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3580034000 tx=0x7f358002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:30.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.382+0000 7f35867fc640 1 -- 172.21.15.37:0/3819724167 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3578060fd0 con 0x7f3588159770 2024-05-10T08:42:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:30.577+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f35880b50e0 con 0x7f3588159770 2024-05-10T08:42:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.519+0000 7f35867fc640 1 -- 172.21.15.37:0/3819724167 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7f35780652d0 con 0x7f3588159770 2024-05-10T08:42:31.518 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.522+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35740762d0 msgr2=0x7f3574078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.522+0000 7f3590207640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35740762d0 0x7f3574078790 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3580034000 tx=0x7f358002e000 comp rx=0 tx=0).stop 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.522+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 msgr2=0x7f3588147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.522+0000 7f3590207640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f3588147610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f357800ce80 tx=0x7f357800a710 comp rx=0 tx=0).stop 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 shutdown_connections 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35740762d0 0x7f3574078790 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588159770 0x7f3588147610 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35880af6a0 0x7f35881f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 --2- 172.21.15.37:0/3819724167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f358806c8e0 0x7f35881455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 >> 172.21.15.37:0/3819724167 conn(0x7f35880b3aa0 msgr2=0x7f35880b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:31.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 shutdown_connections 2024-05-10T08:42:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.523+0000 7f3590207640 1 -- 172.21.15.37:0/3819724167 wait complete. 2024-05-10T08:42:31.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:42:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.657+0000 7fc37aefc640 1 Processor -- start 2024-05-10T08:42:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.657+0000 7fc37aefc640 1 -- start start 2024-05-10T08:42:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.657+0000 7fc37aefc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37415f4e0 0x7fc3740cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc37aefc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3740d3aa0 0x7fc3740d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc37aefc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc3740d3f00 0x7fc3740d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc37aefc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc3740d0320 con 0x7fc3740d3f00 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc37aefc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc3740d0600 con 0x7fc3740d3aa0 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc37aefc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3740d08e0 con 0x7fc37415f4e0 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc3740d3f00 0x7fc3740d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc3740d3f00 0x7fc3740d54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56382/0 (socket says 172.21.15.37:56382) 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 -- 172.21.15.37:0/1710770409 learned_addr learned my addr 172.21.15.37:0/1710770409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc378c98640 1 --2- 172.21.15.37:0/1710770409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37415f4e0 0x7fc3740cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc373fff640 1 --2- 172.21.15.37:0/1710770409 >> v2:172.21.15.82:3300/0 conn(0x7fc3740d3aa0 0x7fc3740d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 -- 172.21.15.37:0/1710770409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37415f4e0 msgr2=0x7fc3740cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 --2- 172.21.15.37:0/1710770409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37415f4e0 0x7fc3740cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 -- 172.21.15.37:0/1710770409 >> v2:172.21.15.82:3300/0 conn(0x7fc3740d3aa0 msgr2=0x7fc3740d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 --2- 172.21.15.37:0/1710770409 >> v2:172.21.15.82:3300/0 conn(0x7fc3740d3aa0 0x7fc3740d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.658+0000 7fc379499640 1 -- 172.21.15.37:0/1710770409 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3740d0bc0 con 0x7fc3740d3f00 2024-05-10T08:42:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.659+0000 7fc379499640 1 --2- 172.21.15.37:0/1710770409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3740d3f00 0x7fc3740d54e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc3740d2b90 tx=0x7fc36c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf94da17ece5bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.659+0000 7fc3737fe640 1 -- 172.21.15.37:0/1710770409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c036070 con 0x7fc3740d3f00 2024-05-10T08:42:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.659+0000 7fc3737fe640 1 -- 172.21.15.37:0/1710770409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c031600 con 0x7fc3740d3f00 2024-05-10T08:42:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.659+0000 7fc3737fe640 1 -- 172.21.15.37:0/1710770409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0319d0 con 0x7fc3740d3f00 2024-05-10T08:42:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.659+0000 7fc37aefc640 1 -- 172.21.15.37:0/1710770409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3740d3f00 msgr2=0x7fc3740d54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.659+0000 7fc37aefc640 1 --2- 172.21.15.37:0/1710770409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3740d3f00 0x7fc3740d54e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc3740d2b90 tx=0x7fc36c02a6a0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.660+0000 7fc37aefc640 1 -- 172.21.15.37:0/1710770409 shutdown_connections 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.660+0000 7fc37aefc640 1 --2- 172.21.15.37:0/1710770409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3740d3f00 0x7fc3740d54e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.660+0000 7fc37aefc640 1 --2- 172.21.15.37:0/1710770409 >> v2:172.21.15.82:3300/0 conn(0x7fc3740d3aa0 0x7fc3740d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.660+0000 7fc37aefc640 1 --2- 172.21.15.37:0/1710770409 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc37415f4e0 0x7fc3740cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.660+0000 7fc37aefc640 1 -- 172.21.15.37:0/1710770409 >> 172.21.15.37:0/1710770409 conn(0x7fc37408eac0 msgr2=0x7fc37409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.660+0000 7fc37aefc640 1 -- 172.21.15.37:0/1710770409 shutdown_connections 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.660+0000 7fc37aefc640 1 -- 172.21.15.37:0/1710770409 wait complete. 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.661+0000 7fc37aefc640 1 Processor -- start 2024-05-10T08:42:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.661+0000 7fc37aefc640 1 -- start start 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc37aefc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3740d3aa0 0x7fc37415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc37aefc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3740d3f00 0x7fc3741f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc37aefc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f4e0 0x7fc3740b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc37aefc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3740b50d0 con 0x7fc37415f4e0 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc37aefc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc37415f8c0 con 0x7fc3740d3f00 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc37aefc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3740b5250 con 0x7fc3740d3aa0 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f4e0 0x7fc3740b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f4e0 0x7fc3740b8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56388/0 (socket says 172.21.15.37:56388) 2024-05-10T08:42:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 -- 172.21.15.37:0/972409404 learned_addr learned my addr 172.21.15.37:0/972409404 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc373fff640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3740d3f00 0x7fc3741f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc378c98640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3740d3aa0 0x7fc37415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 -- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3740d3aa0 msgr2=0x7fc37415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3740d3aa0 0x7fc37415fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 -- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3740d3f00 msgr2=0x7fc3741f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3740d3f00 0x7fc3741f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 -- 172.21.15.37:0/972409404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3741f4cf0 con 0x7fc37415f4e0 2024-05-10T08:42:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc373fff640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3740d3f00 0x7fc3741f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.662+0000 7fc379499640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f4e0 0x7fc3740b8f00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc36c034040 tx=0x7fc36c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.663+0000 7fc3717fa640 1 -- 172.21.15.37:0/972409404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c041020 con 0x7fc37415f4e0 2024-05-10T08:42:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.663+0000 7fc3717fa640 1 -- 172.21.15.37:0/972409404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c0077a0 con 0x7fc37415f4e0 2024-05-10T08:42:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.663+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3741f4fd0 con 0x7fc37415f4e0 2024-05-10T08:42:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.663+0000 7fc3717fa640 1 -- 172.21.15.37:0/972409404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c036040 con 0x7fc37415f4e0 2024-05-10T08:42:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.663+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3741f5590 con 0x7fc37415f4e0 2024-05-10T08:42:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.664+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3740693f0 con 0x7fc37415f4e0 2024-05-10T08:42:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.664+0000 7fc3717fa640 1 -- 172.21.15.37:0/972409404 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc36c044020 con 0x7fc37415f4e0 2024-05-10T08:42:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.665+0000 7fc3717fa640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.665+0000 7fc3717fa640 1 -- 172.21.15.37:0/972409404 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5619+0+0 (secure 0 0 0) 0x7fc36c0b83f0 con 0x7fc37415f4e0 2024-05-10T08:42:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.665+0000 7fc378c98640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.666+0000 7fc378c98640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc368006fd0 tx=0x7fc368008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.670+0000 7fc3717fa640 1 -- 172.21.15.37:0/972409404 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc36c04b030 con 0x7fc37415f4e0 2024-05-10T08:42:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:31.860+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc3740d5060 con 0x7fc37415f4e0 2024-05-10T08:42:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.521+0000 7fc3717fa640 1 -- 172.21.15.37:0/972409404 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7fc36c081d00 con 0x7fc37415f4e0 2024-05-10T08:42:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 msgr2=0x7fc358078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc368006fd0 tx=0x7fc368008040 comp rx=0 tx=0).stop 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f4e0 msgr2=0x7fc3740b8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f4e0 0x7fc3740b8f00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc36c034040 tx=0x7fc36c004a40 comp rx=0 tx=0).stop 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 shutdown_connections 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f4e0 0x7fc3740b8f00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3740d3f00 0x7fc3741f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 --2- 172.21.15.37:0/972409404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3740d3aa0 0x7fc37415fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 >> 172.21.15.37:0/972409404 conn(0x7fc37408eac0 msgr2=0x7fc3740d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 shutdown_connections 2024-05-10T08:42:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.524+0000 7fc37aefc640 1 -- 172.21.15.37:0/972409404 wait complete. 2024-05-10T08:42:32.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:42:32.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.661+0000 7fa632a72640 1 Processor -- start 2024-05-10T08:42:32.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.661+0000 7fa632a72640 1 -- start start 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa632a72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa62c0cfcd0 0x7fa62c0d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa632a72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d54e0 0x7fa62c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa632a72640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62c0d0320 con 0x7fa62c15f4e0 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa632a72640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa62c0d41b0 con 0x7fa62c0cfcd0 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa632a72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c0d0600 con 0x7fa62c0d54e0 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa62bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa62c0cfcd0 0x7fa62c0d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa62bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa62c0cfcd0 0x7fa62c0d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56400/0 (socket says 172.21.15.37:56400) 2024-05-10T08:42:32.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa62bfff640 1 -- 172.21.15.37:0/3503893443 learned_addr learned my addr 172.21.15.37:0/3503893443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa63100f640 1 --2- 172.21.15.37:0/3503893443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d54e0 0x7fa62c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa62bfff640 1 -- 172.21.15.37:0/3503893443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d54e0 msgr2=0x7fa62c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa62bfff640 1 --2- 172.21.15.37:0/3503893443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d54e0 0x7fa62c0d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.662+0000 7fa62bfff640 1 -- 172.21.15.37:0/3503893443 >> v1:172.21.15.82:6789/0 conn(0x7fa62c15f4e0 legacy=0x7fa62c0d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.663+0000 7fa62bfff640 1 -- 172.21.15.37:0/3503893443 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c0d08e0 con 0x7fa62c0cfcd0 2024-05-10T08:42:32.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.663+0000 7fa62bfff640 1 --2- 172.21.15.37:0/3503893443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c0cfcd0 0x7fa62c0d4fa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009e50 tx=0x7fa61c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f00af8a50308a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:32.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.663+0000 7fa62b7fe640 1 -- 172.21.15.37:0/3503893443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c036070 con 0x7fa62c0cfcd0 2024-05-10T08:42:32.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.663+0000 7fa62b7fe640 1 -- 172.21.15.37:0/3503893443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c031600 con 0x7fa62c0cfcd0 2024-05-10T08:42:32.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.663+0000 7fa62b7fe640 1 -- 172.21.15.37:0/3503893443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0319d0 con 0x7fa62c0cfcd0 2024-05-10T08:42:32.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 -- 172.21.15.37:0/3503893443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c0cfcd0 msgr2=0x7fa62c0d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:32.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 --2- 172.21.15.37:0/3503893443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c0cfcd0 0x7fa62c0d4fa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009e50 tx=0x7fa61c02a710 comp rx=0 tx=0).stop 2024-05-10T08:42:32.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 -- 172.21.15.37:0/3503893443 shutdown_connections 2024-05-10T08:42:32.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 --2- 172.21.15.37:0/3503893443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d54e0 0x7fa62c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 --2- 172.21.15.37:0/3503893443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c0cfcd0 0x7fa62c0d4fa0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 -- 172.21.15.37:0/3503893443 >> 172.21.15.37:0/3503893443 conn(0x7fa62c08eac0 msgr2=0x7fa62c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:32.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 -- 172.21.15.37:0/3503893443 shutdown_connections 2024-05-10T08:42:32.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.664+0000 7fa632a72640 1 -- 172.21.15.37:0/3503893443 wait complete. 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.665+0000 7fa632a72640 1 Processor -- start 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.665+0000 7fa632a72640 1 -- start start 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa632a72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0cfcd0 0x7fa62c149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa632a72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c0d54e0 0x7fa62c0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa632a72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c15f4e0 0x7fa62c0b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa632a72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c15f8c0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa632a72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c0d0ea0 con 0x7fa62c0d54e0 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa632a72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c0d1900 con 0x7fa62c0cfcd0 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa63100f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c15f4e0 0x7fa62c0b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa63100f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c15f4e0 0x7fa62c0b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56406/0 (socket says 172.21.15.37:56406) 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa63100f640 1 -- 172.21.15.37:0/202316484 learned_addr learned my addr 172.21.15.37:0/202316484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa62bfff640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c0d54e0 0x7fa62c0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.666+0000 7fa63080e640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0cfcd0 0x7fa62c149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa63100f640 1 -- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0cfcd0 msgr2=0x7fa62c149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa63100f640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0cfcd0 0x7fa62c149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa63100f640 1 -- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c0d54e0 msgr2=0x7fa62c0b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa63100f640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c0d54e0 0x7fa62c0b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa63100f640 1 -- 172.21.15.37:0/202316484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c14bfd0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa63100f640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c15f4e0 0x7fa62c0b80e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa61400d800 tx=0x7fa61400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa6297fa640 1 -- 172.21.15.37:0/202316484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61400b6c0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa6297fa640 1 -- 172.21.15.37:0/202316484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614019070 con 0x7fa62c15f4e0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62c1f5bc0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa6297fa640 1 -- 172.21.15.37:0/202316484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61400bac0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.667+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62c0cd5b0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.668+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62c0693f0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.669+0000 7fa6297fa640 1 -- 172.21.15.37:0/202316484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa61400bc60 con 0x7fa62c15f4e0 2024-05-10T08:42:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.669+0000 7fa6297fa640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa60c0762d0 0x7fa60c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.670+0000 7fa6297fa640 1 -- 172.21.15.37:0/202316484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6001+0+0 (secure 0 0 0) 0x7fa614097a90 con 0x7fa62c15f4e0 2024-05-10T08:42:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.670+0000 7fa63080e640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa60c0762d0 0x7fa60c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.670+0000 7fa63080e640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa60c0762d0 0x7fa60c078790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa62c15c2e0 tx=0x7fa624009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.674+0000 7fa6297fa640 1 -- 172.21.15.37:0/202316484 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa614060bd0 con 0x7fa62c15f4e0 2024-05-10T08:42:32.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:32.906+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa62c06d240 con 0x7fa62c15f4e0 2024-05-10T08:42:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.544+0000 7fa6297fa640 1 -- 172.21.15.37:0/202316484 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v31) ==== 173+0+0 (secure 0 0 0) 0x7fa614064ed0 con 0x7fa62c15f4e0 2024-05-10T08:42:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 9 and data pool 10 2024-05-10T08:42:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.553+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa60c0762d0 msgr2=0x7fa60c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.554+0000 7fa632a72640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa60c0762d0 0x7fa60c078790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa62c15c2e0 tx=0x7fa624009040 comp rx=0 tx=0).stop 2024-05-10T08:42:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.554+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c15f4e0 msgr2=0x7fa62c0b80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.554+0000 7fa632a72640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c15f4e0 0x7fa62c0b80e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa61400d800 tx=0x7fa61400dcc0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.557+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 shutdown_connections 2024-05-10T08:42:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.557+0000 7fa632a72640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa60c0762d0 0x7fa60c078790 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.557+0000 7fa632a72640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62c15f4e0 0x7fa62c0b80e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.557+0000 7fa632a72640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c0d54e0 0x7fa62c0b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.557+0000 7fa632a72640 1 --2- 172.21.15.37:0/202316484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0cfcd0 0x7fa62c149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.557+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 >> 172.21.15.37:0/202316484 conn(0x7fa62c08eac0 msgr2=0x7fa62c15e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:33.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.560+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 shutdown_connections 2024-05-10T08:42:33.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.564+0000 7fa632a72640 1 -- 172.21.15.37:0/202316484 wait complete. 2024-05-10T08:42:33.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:42:33.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.690+0000 7f5146e5c640 1 Processor -- start 2024-05-10T08:42:33.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.690+0000 7f5146e5c640 1 -- start start 2024-05-10T08:42:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f5146e5c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f514015e180 0x7f51400ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f5146e5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5140160d10 con 0x7f51400d39b0 2024-05-10T08:42:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f5146e5c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5140160ff0 con 0x7f51400cf8a0 2024-05-10T08:42:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f5146e5c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f514015d5f0 con 0x7f514015e180 2024-05-10T08:42:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f5137fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f51400d39b0 0x7f51400cd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35460/0 (socket says 172.21.15.37:35460) 2024-05-10T08:42:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f5137fff640 1 -- 172.21.15.37:0/3719087385 learned_addr learned my addr 172.21.15.37:0/3719087385 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f51453f9640 1 --2- 172.21.15.37:0/3719087385 >> v2:172.21.15.82:3300/0 conn(0x7f514015e180 0x7f51400ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2037554092 0 0) 0x7f5140160d10 con 0x7f51400d39b0 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.691+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5128003520 con 0x7f51400d39b0 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2656615034 0 0) 0x7f5128003520 con 0x7f51400d39b0 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 >> v2:172.21.15.82:3300/0 conn(0x7f514015e180 msgr2=0x7f51400ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 --2- 172.21.15.37:0/3719087385 >> v2:172.21.15.82:3300/0 conn(0x7f514015e180 0x7f51400ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 >> v1:172.21.15.82:6789/0 conn(0x7f51400cf8a0 legacy=0x7f51400cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51401612d0 con 0x7f51400d39b0 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f5130001670 con 0x7f51400d39b0 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51453f9640 1 --2- 172.21.15.37:0/3719087385 >> v2:172.21.15.82:3300/0 conn(0x7f514015e180 0x7f51400ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 >> v1:172.21.15.37:6789/0 conn(0x7f51400d39b0 legacy=0x7f51400cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51280039b0 0x7f5128003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51280043b0 0x7f5128004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128005080 0x7f512800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f514015d5f0 con 0x7f5128005080 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f512800bfe0 con 0x7f51280043b0 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f512800c1e0 con 0x7f51280039b0 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51453f9640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128005080 0x7f512800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f5137fff640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51280043b0 0x7f5128004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f5144bf8640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51280039b0 0x7f5128003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51453f9640 1 -- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51280039b0 msgr2=0x7f5128003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51453f9640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51280039b0 0x7f5128003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51453f9640 1 -- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51280043b0 msgr2=0x7f5128004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51453f9640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51280043b0 0x7f5128004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.692+0000 7f51453f9640 1 -- 172.21.15.37:0/3719087385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5128003520 con 0x7f5128005080 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.693+0000 7f51453f9640 1 -- 172.21.15.37:0/3719087385 reap_dead start 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.693+0000 7f51453f9640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128005080 0x7f512800b9c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f513800e350 tx=0x7f5128005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8fc454dd070204 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.693+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138009de0 con 0x7f5128005080 2024-05-10T08:42:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.693+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513802e680 con 0x7f5128005080 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.693+0000 7f51377fe640 1 -- 172.21.15.37:0/3719087385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513802ea70 con 0x7f5128005080 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.694+0000 7f5146e5c640 1 -- 172.21.15.37:0/3719087385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128005080 msgr2=0x7f512800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.694+0000 7f5146e5c640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128005080 0x7f512800b9c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f513800e350 tx=0x7f5128005830 comp rx=0 tx=0).stop 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.694+0000 7f5146e5c640 1 -- 172.21.15.37:0/3719087385 shutdown_connections 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.694+0000 7f5146e5c640 1 --2- 172.21.15.37:0/3719087385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128005080 0x7f512800b9c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.694+0000 7f5146e5c640 1 -- 172.21.15.37:0/3719087385 >> 172.21.15.37:0/3719087385 conn(0x7f51400d2e90 msgr2=0x7f51400d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.694+0000 7f5146e5c640 1 -- 172.21.15.37:0/3719087385 shutdown_connections 2024-05-10T08:42:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.694+0000 7f5146e5c640 1 -- 172.21.15.37:0/3719087385 wait complete. 2024-05-10T08:42:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.695+0000 7f5146e5c640 1 Processor -- start 2024-05-10T08:42:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.695+0000 7f5146e5c640 1 -- start start 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5146e5c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5128005080 0x7f5140155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5146e5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400b0c70 0x7f51400b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5146e5c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51400cb4d0 0x7f51400cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5146e5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f51400d0700 con 0x7f51400b0c70 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5146e5c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f514015e5f0 con 0x7f5128005080 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5146e5c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f51400cfc80 con 0x7f51400cb4d0 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400b0c70 0x7f51400b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400b0c70 0x7f51400b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56430/0 (socket says 172.21.15.37:56430) 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 -- 172.21.15.37:0/1604481067 learned_addr learned my addr 172.21.15.37:0/1604481067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5144bf8640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5128005080 0x7f5140155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 -- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51400cb4d0 msgr2=0x7f51400cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51400cb4d0 0x7f51400cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 -- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5128005080 msgr2=0x7f5140155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5128005080 0x7f5140155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 -- 172.21.15.37:0/1604481067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51400cc0e0 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f5137fff640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400b0c70 0x7f51400b10f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f51300011e0 tx=0x7f5130007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.696+0000 7f51357fa640 1 -- 172.21.15.37:0/1604481067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513000f780 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.697+0000 7f51357fa640 1 -- 172.21.15.37:0/1604481067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5130018070 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.697+0000 7f51357fa640 1 -- 172.21.15.37:0/1604481067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513000fba0 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.697+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51400cc3c0 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.697+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51400cc980 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.698+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51400693f0 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.698+0000 7f51357fa640 1 -- 172.21.15.37:0/1604481067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f513000fd40 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.699+0000 7f51357fa640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f512c0762d0 0x7f512c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.699+0000 7f51357fa640 1 -- 172.21.15.37:0/1604481067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f51300976f0 con 0x7f51400b0c70 2024-05-10T08:42:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.699+0000 7f5144bf8640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f512c0762d0 0x7f512c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.700+0000 7f5144bf8640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f512c0762d0 0x7f512c078790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f513c0016a0 tx=0x7f513c007a90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:33.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.704+0000 7f51357fa640 1 -- 172.21.15.37:0/1604481067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5130060f50 con 0x7f51400b0c70 2024-05-10T08:42:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.899+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51400cf680 con 0x7f51400b0c70 2024-05-10T08:42:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.900+0000 7f51357fa640 1 -- 172.21.15.37:0/1604481067 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16837 (secure 0 0 0) 0x7f5130060850 con 0x7f51400b0c70 2024-05-10T08:42:33.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:33.900 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:42:32.908336+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:42:30.582142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T08:42:31.864914+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:42:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f512c0762d0 msgr2=0x7f512c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f512c0762d0 0x7f512c078790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f513c0016a0 tx=0x7f513c007a90 comp rx=0 tx=0).stop 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400b0c70 msgr2=0x7f51400b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400b0c70 0x7f51400b10f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f51300011e0 tx=0x7f5130007430 comp rx=0 tx=0).stop 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 shutdown_connections 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f512c0762d0 0x7f512c078790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51400cb4d0 0x7f51400cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400b0c70 0x7f51400b10f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 --2- 172.21.15.37:0/1604481067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5128005080 0x7f5140155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 >> 172.21.15.37:0/1604481067 conn(0x7f51400d2e90 msgr2=0x7f514015fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 shutdown_connections 2024-05-10T08:42:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:33.903+0000 7f5146e5c640 1 -- 172.21.15.37:0/1604481067 wait complete. 2024-05-10T08:42:33.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:42:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.018+0000 7fe9559f7640 1 Processor -- start 2024-05-10T08:42:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.018+0000 7fe9559f7640 1 -- start start 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe9559f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe95015c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe9559f7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe95006e4d0 0x7fe9500aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe9559f7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95015c920 con 0x7fe950072840 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe9559f7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe95015cc00 con 0x7fe95006e4d0 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe9559f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe95015cee0 con 0x7fe95006e0f0 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe94f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe95006e4d0 0x7fe9500aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe94effd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe95015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe94e7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe950072840 0x7fe9500d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:60828/0 (socket says 172.21.15.37:60828) 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.019+0000 7fe94e7fc640 1 -- 172.21.15.37:0/3041073893 learned_addr learned my addr 172.21.15.37:0/3041073893 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.020+0000 7fe94f7fe640 1 -- 172.21.15.37:0/3041073893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 msgr2=0x7fe95015c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.020+0000 7fe94f7fe640 1 --2- 172.21.15.37:0/3041073893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe95015c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.020+0000 7fe94f7fe640 1 -- 172.21.15.37:0/3041073893 >> v1:172.21.15.82:6789/0 conn(0x7fe950072840 legacy=0x7fe9500d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.020+0000 7fe94f7fe640 1 -- 172.21.15.37:0/3041073893 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95015d1c0 con 0x7fe95006e4d0 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.020+0000 7fe94f7fe640 1 --2- 172.21.15.37:0/3041073893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe9500aec30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe948009d90 tx=0x7fe94802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=becdba45edcc7b24 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe94dffb640 1 -- 172.21.15.37:0/3041073893 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948007740 con 0x7fe95006e4d0 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe94dffb640 1 -- 172.21.15.37:0/3041073893 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9480078e0 con 0x7fe95006e4d0 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe94dffb640 1 -- 172.21.15.37:0/3041073893 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948007cb0 con 0x7fe95006e4d0 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 -- 172.21.15.37:0/3041073893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 msgr2=0x7fe9500aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3041073893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe9500aec30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe948009d90 tx=0x7fe94802a660 comp rx=0 tx=0).stop 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 -- 172.21.15.37:0/3041073893 shutdown_connections 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3041073893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe9500aec30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3041073893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe95015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 -- 172.21.15.37:0/3041073893 >> 172.21.15.37:0/3041073893 conn(0x7fe95006c3a0 msgr2=0x7fe95006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 -- 172.21.15.37:0/3041073893 shutdown_connections 2024-05-10T08:42:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.021+0000 7fe9559f7640 1 -- 172.21.15.37:0/3041073893 wait complete. 2024-05-10T08:42:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.022+0000 7fe9559f7640 1 Processor -- start 2024-05-10T08:42:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.023+0000 7fe9559f7640 1 -- start start 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.023+0000 7fe9559f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe950144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.023+0000 7fe9559f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe95015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.023+0000 7fe9559f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe950072840 0x7fe95015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.023+0000 7fe9559f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500ae7d0 con 0x7fe950072840 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.023+0000 7fe9559f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500ae650 con 0x7fe95006e4d0 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.023+0000 7fe9559f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe9501530b0 con 0x7fe95006e0f0 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe950072840 0x7fe95015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe950072840 0x7fe95015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56446/0 (socket says 172.21.15.37:56446) 2024-05-10T08:42:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 -- 172.21.15.37:0/3590388944 learned_addr learned my addr 172.21.15.37:0/3590388944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94effd640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe950144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94e7fc640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe95015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 -- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 msgr2=0x7fe950144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe950144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 -- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 msgr2=0x7fe95015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe95015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 -- 172.21.15.37:0/3590388944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95015d9e0 con 0x7fe950072840 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94e7fc640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe95015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe94f7fe640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe950072840 0x7fe95015af40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe948009eb0 tx=0x7fe948004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe937fff640 1 -- 172.21.15.37:0/3590388944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948040070 con 0x7fe950072840 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe937fff640 1 -- 172.21.15.37:0/3590388944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe948031bc0 con 0x7fe950072840 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95015dcc0 con 0x7fe950072840 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe937fff640 1 -- 172.21.15.37:0/3590388944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948009450 con 0x7fe950072840 2024-05-10T08:42:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.024+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95015e280 con 0x7fe950072840 2024-05-10T08:42:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.025+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9500693f0 con 0x7fe950072840 2024-05-10T08:42:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.026+0000 7fe937fff640 1 -- 172.21.15.37:0/3590388944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe948039040 con 0x7fe950072840 2024-05-10T08:42:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.027+0000 7fe937fff640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe93c076300 0x7fe93c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.027+0000 7fe937fff640 1 -- 172.21.15.37:0/3590388944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7fe9480b9030 con 0x7fe950072840 2024-05-10T08:42:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.027+0000 7fe94effd640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe93c076300 0x7fe93c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.027+0000 7fe94effd640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe93c076300 0x7fe93c0787c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe940009b40 tx=0x7fe940009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.031+0000 7fe937fff640 1 -- 172.21.15.37:0/3590388944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe948082780 con 0x7fe950072840 2024-05-10T08:42:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.225+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe95006c820 con 0x7fe950072840 2024-05-10T08:42:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.226+0000 7fe937fff640 1 -- 172.21.15.37:0/3590388944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16837 (secure 0 0 0) 0x7fe948082080 con 0x7fe950072840 2024-05-10T08:42:34.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:34.225 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:42:32.908336+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:42:30.582142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T08:42:31.864914+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe93c076300 msgr2=0x7fe93c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe93c076300 0x7fe93c0787c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe940009b40 tx=0x7fe940009190 comp rx=0 tx=0).stop 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe950072840 msgr2=0x7fe95015af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe950072840 0x7fe95015af40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe948009eb0 tx=0x7fe948004a40 comp rx=0 tx=0).stop 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 shutdown_connections 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe93c076300 0x7fe93c0787c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe950072840 0x7fe95015af40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe95006e4d0 0x7fe95015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 --2- 172.21.15.37:0/3590388944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe95006e0f0 0x7fe950144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 >> 172.21.15.37:0/3590388944 conn(0x7fe95006c3a0 msgr2=0x7fe950072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 shutdown_connections 2024-05-10T08:42:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.228+0000 7fe9559f7640 1 -- 172.21.15.37:0/3590388944 wait complete. 2024-05-10T08:42:34.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:42:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.347+0000 7f8fe2699640 1 Processor -- start 2024-05-10T08:42:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.347+0000 7f8fe2699640 1 -- start start 2024-05-10T08:42:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fe2699640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b3f30 0x7f8fdc0d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fe2699640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fdc0b1c90 con 0x7f8fdc15f380 2024-05-10T08:42:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fe2699640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fdc0d0a50 con 0x7f8fdc0d3cd0 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fe2699640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc0d0d30 con 0x7f8fdc0b3f30 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fdbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8fdc15f380 0x7f8fdc0d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35474/0 (socket says 172.21.15.37:35474) 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fdbfff640 1 -- 172.21.15.37:0/1093211801 learned_addr learned my addr 172.21.15.37:0/1093211801 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fe0c36640 1 --2- 172.21.15.37:0/1093211801 >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b3f30 0x7f8fdc0d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713812795 0 0) 0x7f8fdc0b1c90 con 0x7f8fdc15f380 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fc4003520 con 0x7f8fdc15f380 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 119282887 0 0) 0x7f8fc4003520 con 0x7f8fdc15f380 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.348+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b3f30 msgr2=0x7f8fdc0d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 --2- 172.21.15.37:0/1093211801 >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b3f30 0x7f8fdc0d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 >> v1:172.21.15.82:6789/0 conn(0x7f8fdc0d3cd0 legacy=0x7f8fdc0d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc0b1f00 con 0x7f8fdc15f380 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8fcc001670 con 0x7f8fdc15f380 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fe0c36640 1 --2- 172.21.15.37:0/1093211801 >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b3f30 0x7f8fdc0d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 >> v1:172.21.15.37:6789/0 conn(0x7f8fdc15f380 legacy=0x7f8fdc0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc40039b0 0x7f8fc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fc40043b0 0x7f8fc4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0d0d30 con 0x7f8fc4005080 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc400bfe0 con 0x7f8fc40039b0 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc400c1e0 con 0x7f8fc40043b0 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fe0c36640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdbfff640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc40039b0 0x7f8fc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fdb7fe640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fc40043b0 0x7f8fc4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fe0c36640 1 -- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fc40043b0 msgr2=0x7f8fc4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fe0c36640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fc40043b0 0x7f8fc4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fe0c36640 1 -- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc40039b0 msgr2=0x7f8fc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fe0c36640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc40039b0 0x7f8fc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.349+0000 7f8fe0c36640 1 -- 172.21.15.37:0/1093211801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc4003520 con 0x7f8fc4005080 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe0c36640 1 -- 172.21.15.37:0/1093211801 reap_dead start 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe0c36640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fc400b9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400e350 tx=0x7f8fc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7316115d8f459be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4009de0 con 0x7f8fc4005080 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd4003bd0 con 0x7f8fc4005080 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fdaffd640 1 -- 172.21.15.37:0/1093211801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4004020 con 0x7f8fc4005080 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe2699640 1 -- 172.21.15.37:0/1093211801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 msgr2=0x7f8fc400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe2699640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fc400b9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400e350 tx=0x7f8fc4005830 comp rx=0 tx=0).stop 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe2699640 1 -- 172.21.15.37:0/1093211801 shutdown_connections 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe2699640 1 --2- 172.21.15.37:0/1093211801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fc400b9c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe2699640 1 -- 172.21.15.37:0/1093211801 >> 172.21.15.37:0/1093211801 conn(0x7f8fdc0d4fe0 msgr2=0x7f8fdc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.350+0000 7f8fe2699640 1 -- 172.21.15.37:0/1093211801 shutdown_connections 2024-05-10T08:42:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.351+0000 7f8fe2699640 1 -- 172.21.15.37:0/1093211801 wait complete. 2024-05-10T08:42:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.352+0000 7f8fe2699640 1 Processor -- start 2024-05-10T08:42:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.352+0000 7f8fe2699640 1 -- start start 2024-05-10T08:42:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fdc0b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fdc1f5490 0x7f8fdc0ba450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc160590 0x7f8fdc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0d06e0 con 0x7f8fc4005080 2024-05-10T08:42:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0d1010 con 0x7f8fdc160590 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc0d35c0 con 0x7f8fdc1f5490 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fdc0b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fdc0b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56458/0 (socket says 172.21.15.37:56458) 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 -- 172.21.15.37:0/3459181486 learned_addr learned my addr 172.21.15.37:0/3459181486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 -- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fdc1f5490 msgr2=0x7f8fdc0ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fdc1f5490 0x7f8fdc0ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 -- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc160590 msgr2=0x7f8fdc0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe0c36640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc160590 0x7f8fdc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc160590 0x7f8fdc0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 -- 172.21.15.37:0/3459181486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc0ba990 con 0x7f8fc4005080 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fdbfff640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fdc0b81f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0072c0 tx=0x7f8fcc007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fd8ff9640 1 -- 172.21.15.37:0/3459181486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00f960 con 0x7f8fc4005080 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fd8ff9640 1 -- 172.21.15.37:0/3459181486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc018070 con 0x7f8fc4005080 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc160e50 con 0x7f8fc4005080 2024-05-10T08:42:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fd8ff9640 1 -- 172.21.15.37:0/3459181486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00fd60 con 0x7f8fc4005080 2024-05-10T08:42:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.353+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc0b79f0 con 0x7f8fc4005080 2024-05-10T08:42:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.355+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc0693f0 con 0x7f8fc4005080 2024-05-10T08:42:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.355+0000 7f8fd8ff9640 1 -- 172.21.15.37:0/3459181486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8fcc01d460 con 0x7f8fc4005080 2024-05-10T08:42:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.356+0000 7f8fd8ff9640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8fc8076300 0x7f8fc80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.356+0000 7f8fd8ff9640 1 -- 172.21.15.37:0/3459181486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f8fcc0977e0 con 0x7f8fc4005080 2024-05-10T08:42:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.356+0000 7f8fdb7fe640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8fc8076300 0x7f8fc80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.356+0000 7f8fdb7fe640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8fc8076300 0x7f8fc80787c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0b8fa0 tx=0x7f8fd0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:34.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.360+0000 7f8fd8ff9640 1 -- 172.21.15.37:0/3459181486 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8fcc060fb0 con 0x7f8fc4005080 2024-05-10T08:42:34.516 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:42:34.517+0000 7f1d3d275640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:42:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:34.591+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8fdc06eb70 con 0x7f8fc4005080 2024-05-10T08:42:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.554+0000 7f8fd8ff9640 1 -- 172.21.15.37:0/3459181486 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7f8fcc0608b0 con 0x7f8fc4005080 2024-05-10T08:42:35.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8fc8076300 msgr2=0x7f8fc80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:35.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8fc8076300 0x7f8fc80787c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0b8fa0 tx=0x7f8fd0009040 comp rx=0 tx=0).stop 2024-05-10T08:42:35.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 msgr2=0x7f8fdc0b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fdc0b81f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0072c0 tx=0x7f8fcc007780 comp rx=0 tx=0).stop 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 shutdown_connections 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8fc8076300 0x7f8fc80787c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc160590 0x7f8fdc0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8fdc1f5490 0x7f8fdc0ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 --2- 172.21.15.37:0/3459181486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc4005080 0x7f8fdc0b81f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 >> 172.21.15.37:0/3459181486 conn(0x7f8fdc0d4fe0 msgr2=0x7f8fdc06de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 shutdown_connections 2024-05-10T08:42:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.557+0000 7f8fe2699640 1 -- 172.21.15.37:0/3459181486 wait complete. 2024-05-10T08:42:35.570 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T08:42:35.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:42:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.684+0000 7f58bb546640 1 Processor -- start 2024-05-10T08:42:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.684+0000 7f58bb546640 1 -- start start 2024-05-10T08:42:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.685+0000 7f58bb546640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58b406da00 0x7f58b4073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.685+0000 7f58bb546640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b40b65f0 con 0x7f58b406d620 2024-05-10T08:42:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.685+0000 7f58bb546640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b40b5120 con 0x7f58b41637b0 2024-05-10T08:42:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.685+0000 7f58bb546640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f58b40afaa0 con 0x7f58b406da00 2024-05-10T08:42:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.685+0000 7f58b8ae1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58b406da00 0x7f58b4073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.685+0000 7f58b92e2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58b406d620 0x7f58b40af2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35480/0 (socket says 172.21.15.37:35480) 2024-05-10T08:42:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.685+0000 7f58b92e2640 1 -- 172.21.15.37:0/933012380 learned_addr learned my addr 172.21.15.37:0/933012380 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.686+0000 7f58b3fff640 1 -- 172.21.15.37:0/933012380 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219854793 0 0) 0x7f58b40b65f0 con 0x7f58b406d620 2024-05-10T08:42:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.686+0000 7f58b3fff640 1 -- 172.21.15.37:0/933012380 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589c003520 con 0x7f58b406d620 2024-05-10T08:42:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.686+0000 7f58b8ae1640 1 -- 172.21.15.37:0/933012380 >> v1:172.21.15.82:6789/0 conn(0x7f58b41637b0 legacy=0x7f58b40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.686+0000 7f58b8ae1640 1 -- 172.21.15.37:0/933012380 >> v1:172.21.15.37:6789/0 conn(0x7f58b406d620 legacy=0x7f58b40af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.686+0000 7f58b8ae1640 1 -- 172.21.15.37:0/933012380 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b40b5400 con 0x7f58b406da00 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.686+0000 7f58b8ae1640 1 --2- 172.21.15.37:0/933012380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406da00 0x7f58b4073800 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f58a80097a0 tx=0x7f58a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e6e9bc685ec4f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58b3fff640 1 -- 172.21.15.37:0/933012380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8037070 con 0x7f58b406da00 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58b3fff640 1 -- 172.21.15.37:0/933012380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a8032440 con 0x7f58b406da00 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58b3fff640 1 -- 172.21.15.37:0/933012380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a802ae60 con 0x7f58b406da00 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58bb546640 1 -- 172.21.15.37:0/933012380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406da00 msgr2=0x7f58b4073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58bb546640 1 --2- 172.21.15.37:0/933012380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406da00 0x7f58b4073800 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f58a80097a0 tx=0x7f58a802a110 comp rx=0 tx=0).stop 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58bb546640 1 -- 172.21.15.37:0/933012380 shutdown_connections 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58bb546640 1 --2- 172.21.15.37:0/933012380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406da00 0x7f58b4073800 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58bb546640 1 -- 172.21.15.37:0/933012380 >> 172.21.15.37:0/933012380 conn(0x7f58b40728c0 msgr2=0x7f58b4072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58bb546640 1 -- 172.21.15.37:0/933012380 shutdown_connections 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.687+0000 7f58bb546640 1 -- 172.21.15.37:0/933012380 wait complete. 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.688+0000 7f58bb546640 1 Processor -- start 2024-05-10T08:42:35.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58bb546640 1 -- start start 2024-05-10T08:42:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58bb546640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406d620 0x7f58b40d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58bb546640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b406da00 0x7f58b4143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58bb546640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58b41637b0 0x7f58b4145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58bb546640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58b406e920 con 0x7f58b406d620 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58bb546640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58b40b5a50 con 0x7f58b406da00 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58bb546640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f58b406eaa0 con 0x7f58b41637b0 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58b92e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406d620 0x7f58b40d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58b92e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406d620 0x7f58b40d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56478/0 (socket says 172.21.15.37:56478) 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.689+0000 7f58b92e2640 1 -- 172.21.15.37:0/211352280 learned_addr learned my addr 172.21.15.37:0/211352280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b9ae3640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58b41637b0 0x7f58b4145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b92e2640 1 -- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58b41637b0 msgr2=0x7f58b4145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b8ae1640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b406da00 0x7f58b4143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b92e2640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58b41637b0 0x7f58b4145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b92e2640 1 -- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b406da00 msgr2=0x7f58b4143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b92e2640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b406da00 0x7f58b4143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b92e2640 1 -- 172.21.15.37:0/211352280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b4158cb0 con 0x7f58b406d620 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b9ae3640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58b41637b0 0x7f58b4145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b8ae1640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b406da00 0x7f58b4143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b92e2640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406d620 0x7f58b40d08d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c500 tx=0x7f58ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b1ffb640 1 -- 172.21.15.37:0/211352280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac017070 con 0x7f58b406d620 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b1ffb640 1 -- 172.21.15.37:0/211352280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac005ce0 con 0x7f58b406d620 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b4158f90 con 0x7f58b406d620 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58b1ffb640 1 -- 172.21.15.37:0/211352280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac007330 con 0x7f58b406d620 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.690+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b4159550 con 0x7f58b406d620 2024-05-10T08:42:35.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.691+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b40693f0 con 0x7f58b406d620 2024-05-10T08:42:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.692+0000 7f58b1ffb640 1 -- 172.21.15.37:0/211352280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58ac01a070 con 0x7f58b406d620 2024-05-10T08:42:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.692+0000 7f58b1ffb640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58a0076300 0x7f58a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.692+0000 7f58b1ffb640 1 -- 172.21.15.37:0/211352280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f58ac096b50 con 0x7f58b406d620 2024-05-10T08:42:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.693+0000 7f58b8ae1640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58a0076300 0x7f58a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.693+0000 7f58b8ae1640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58a0076300 0x7f58a00787c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58a8034000 tx=0x7f58a802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.697+0000 7f58b1ffb640 1 -- 172.21.15.37:0/211352280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f58ac060470 con 0x7f58b406d620 2024-05-10T08:42:35.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:35.926+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f58b4162f80 con 0x7f58b406d620 2024-05-10T08:42:36.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.557+0000 7f58b1ffb640 1 -- 172.21.15.37:0/211352280 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f58ac05fd70 con 0x7f58b406d620 2024-05-10T08:42:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.559+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58a0076300 msgr2=0x7f58a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.559+0000 7f58bb546640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58a0076300 0x7f58a00787c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58a8034000 tx=0x7f58a802e000 comp rx=0 tx=0).stop 2024-05-10T08:42:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406d620 msgr2=0x7f58b40d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406d620 0x7f58b40d08d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c500 tx=0x7f58ac00c9c0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 shutdown_connections 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58a0076300 0x7f58a00787c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58b41637b0 0x7f58b4145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b406da00 0x7f58b4143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 --2- 172.21.15.37:0/211352280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b406d620 0x7f58b40d08d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 >> 172.21.15.37:0/211352280 conn(0x7f58b40728c0 msgr2=0x7f58b40b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 shutdown_connections 2024-05-10T08:42:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.560+0000 7f58bb546640 1 -- 172.21.15.37:0/211352280 wait complete. 2024-05-10T08:42:36.572 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:42:36.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.682+0000 7efcc1346640 1 Processor -- start 2024-05-10T08:42:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.682+0000 7efcc1346640 1 -- start start 2024-05-10T08:42:36.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcc1346640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efcbc06df40 0x7efcbc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcc1346640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc0d0cb0 con 0x7efcbc15f450 2024-05-10T08:42:36.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcc1346640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc0d0f90 con 0x7efcbc15f830 2024-05-10T08:42:36.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcc1346640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efcbc06d690 con 0x7efcbc06df40 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcbaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efcbc15f450 0x7efcbc06d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35482/0 (socket says 172.21.15.37:35482) 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcbaffd640 1 -- 172.21.15.37:0/3639228649 learned_addr learned my addr 172.21.15.37:0/3639228649 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcba7fc640 1 --2- 172.21.15.37:0/3639228649 >> v2:172.21.15.82:3300/0 conn(0x7efcbc06df40 0x7efcbc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.683+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008053668 0 0) 0x7efcbc0d0cb0 con 0x7efcbc15f450 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca4003520 con 0x7efcbc15f450 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625943474 0 0) 0x7efcbc0d0f90 con 0x7efcbc15f830 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcbc0d0cb0 con 0x7efcbc15f830 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2891275752 0 0) 0x7efca4003520 con 0x7efcbc15f450 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 >> v2:172.21.15.82:3300/0 conn(0x7efcbc06df40 msgr2=0x7efcbc06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 --2- 172.21.15.37:0/3639228649 >> v2:172.21.15.82:3300/0 conn(0x7efcbc06df40 0x7efcbc06d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 >> v1:172.21.15.82:6789/0 conn(0x7efcbc15f830 legacy=0x7efcbc0d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc0d2fe0 con 0x7efcbc15f450 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7efcac001670 con 0x7efcbc15f450 2024-05-10T08:42:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 >> v1:172.21.15.37:6789/0 conn(0x7efcbc15f450 legacy=0x7efcbc06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca4003b90 0x7efca4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca4004800 0x7efca4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efca40051c0 0x7efca400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc06d690 con 0x7efca40051c0 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efca400c090 con 0x7efca4003b90 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efca400c290 con 0x7efca4004800 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcbb7fe640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efca40051c0 0x7efca400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcbaffd640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca4003b90 0x7efca4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcba7fc640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca4004800 0x7efca4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca4004800 msgr2=0x7efca4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcbb7fe640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca4004800 0x7efca4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca4003b90 msgr2=0x7efca4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcbb7fe640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca4003b90 0x7efca4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.684+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3639228649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca4003520 con 0x7efca40051c0 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.685+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3639228649 reap_dead start 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.685+0000 7efcbb7fe640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efca40051c0 0x7efca400b9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efcb4001fd0 tx=0x7efca4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9486001380fa23e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.685+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4001bf0 con 0x7efca40051c0 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.685+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4003b70 con 0x7efca40051c0 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.685+0000 7efcb9ffb640 1 -- 172.21.15.37:0/3639228649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb40050d0 con 0x7efca40051c0 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.686+0000 7efcc1346640 1 -- 172.21.15.37:0/3639228649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efca40051c0 msgr2=0x7efca400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.686+0000 7efcc1346640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efca40051c0 0x7efca400b9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efcb4001fd0 tx=0x7efca4005830 comp rx=0 tx=0).stop 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.686+0000 7efcc1346640 1 -- 172.21.15.37:0/3639228649 shutdown_connections 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.686+0000 7efcc1346640 1 --2- 172.21.15.37:0/3639228649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efca40051c0 0x7efca400b9c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.686+0000 7efcc1346640 1 -- 172.21.15.37:0/3639228649 >> 172.21.15.37:0/3639228649 conn(0x7efcbc0d5040 msgr2=0x7efcbc0d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.686+0000 7efcc1346640 1 -- 172.21.15.37:0/3639228649 shutdown_connections 2024-05-10T08:42:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.686+0000 7efcc1346640 1 -- 172.21.15.37:0/3639228649 wait complete. 2024-05-10T08:42:36.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.687+0000 7efcc1346640 1 Processor -- start 2024-05-10T08:42:36.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.687+0000 7efcc1346640 1 -- start start 2024-05-10T08:42:36.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcc1346640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca40051c0 0x7efcbc0ba850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcc1346640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcbc0cc110 0x7efcbc0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcc1346640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcbc0b7db0 0x7efcbc0b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcc1346640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0d0880 con 0x7efcbc0b7db0 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcc1346640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0d0700 con 0x7efcbc0cc110 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcc1346640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efcbc0d0a00 con 0x7efca40051c0 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcbc0b7db0 0x7efcbc0b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcbc0b7db0 0x7efcbc0b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56504/0 (socket says 172.21.15.37:56504) 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3869285837 learned_addr learned my addr 172.21.15.37:0/3869285837 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcba7fc640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcbc0cc110 0x7efcbc0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbaffd640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca40051c0 0x7efcbc0ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca40051c0 msgr2=0x7efcbc0ba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca40051c0 0x7efcbc0ba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcbc0cc110 msgr2=0x7efcbc0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcbc0cc110 0x7efcbc0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbb7fe640 1 -- 172.21.15.37:0/3869285837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc0b8770 con 0x7efcbc0b7db0 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcba7fc640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcbc0cc110 0x7efcbc0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.688+0000 7efcbaffd640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca40051c0 0x7efcbc0ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.689+0000 7efcbb7fe640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcbc0b7db0 0x7efcbc0b8230 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efcb40020c0 tx=0x7efcb4001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.689+0000 7efca37fe640 1 -- 172.21.15.37:0/3869285837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4041070 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.689+0000 7efca37fe640 1 -- 172.21.15.37:0/3869285837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4003970 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.689+0000 7efca37fe640 1 -- 172.21.15.37:0/3869285837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4005520 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.689+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcbc0b2e10 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.689+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcbc0b33d0 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.690+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcbc0693f0 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.691+0000 7efca37fe640 1 -- 172.21.15.37:0/3869285837 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcb4044070 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.691+0000 7efca37fe640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca8076300 0x7efca80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.691+0000 7efca37fe640 1 -- 172.21.15.37:0/3869285837 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7efcb40b70d0 con 0x7efcbc0b7db0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.692+0000 7efcbaffd640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca8076300 0x7efca80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:36.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.692+0000 7efcbaffd640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca8076300 0x7efca80787c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efcac000c00 tx=0x7efcac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:36.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.695+0000 7efca37fe640 1 -- 172.21.15.37:0/3869285837 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efcb404b020 con 0x7efcbc0b7db0 2024-05-10T08:42:36.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.922+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcbc0b1e20 con 0x7efcbc0b7db0 2024-05-10T08:42:36.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.923+0000 7efca37fe640 1 -- 172.21.15.37:0/3869285837 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5179 (secure 0 0 0) 0x7efcb4080880 con 0x7efcbc0b7db0 2024-05-10T08:42:36.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:42:35.928048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:42:36.923 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2024-05-10T08:42:36.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca8076300 msgr2=0x7efca80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca8076300 0x7efca80787c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efcac000c00 tx=0x7efcac009040 comp rx=0 tx=0).stop 2024-05-10T08:42:36.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcbc0b7db0 msgr2=0x7efcbc0b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:36.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcbc0b7db0 0x7efcbc0b8230 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efcb40020c0 tx=0x7efcb4001650 comp rx=0 tx=0).stop 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 shutdown_connections 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca8076300 0x7efca80787c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcbc0b7db0 0x7efcbc0b8230 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcbc0cc110 0x7efcbc0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 --2- 172.21.15.37:0/3869285837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efca40051c0 0x7efcbc0ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 >> 172.21.15.37:0/3869285837 conn(0x7efcbc0d5040 msgr2=0x7efcbc0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 shutdown_connections 2024-05-10T08:42:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:36.925+0000 7efcc1346640 1 -- 172.21.15.37:0/3869285837 wait complete. 2024-05-10T08:42:36.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:42:37.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.039+0000 7f556ada4640 1 Processor -- start 2024-05-10T08:42:37.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.039+0000 7f556ada4640 1 -- start start 2024-05-10T08:42:37.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f556ada4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55640d3cd0 0x7f55640cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f556ada4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55640d3330 con 0x7f55640c9ee0 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f556ada4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55640d2170 con 0x7f55641629a0 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f556ada4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f55640d2450 con 0x7f55640d3cd0 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f555bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55640d3cd0 0x7f55640cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f555bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55640d3cd0 0x7f55640cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56508/0 (socket says 172.21.15.37:56508) 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f555bfff640 1 -- 172.21.15.37:0/113050885 learned_addr learned my addr 172.21.15.37:0/113050885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f555bfff640 1 -- 172.21.15.37:0/113050885 >> v1:172.21.15.82:6789/0 conn(0x7f55641629a0 legacy=0x7f55640d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f555bfff640 1 -- 172.21.15.37:0/113050885 >> v1:172.21.15.37:6789/0 conn(0x7f55640c9ee0 legacy=0x7f55640d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.040+0000 7f555bfff640 1 -- 172.21.15.37:0/113050885 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640d2730 con 0x7f55640d3cd0 2024-05-10T08:42:37.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.041+0000 7f555bfff640 1 --2- 172.21.15.37:0/113050885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55640cfca0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41beb6219889a63 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.041+0000 7f555b7fe640 1 -- 172.21.15.37:0/113050885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554037070 con 0x7f55640d3cd0 2024-05-10T08:42:37.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.041+0000 7f555b7fe640 1 -- 172.21.15.37:0/113050885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554032440 con 0x7f55640d3cd0 2024-05-10T08:42:37.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.041+0000 7f555b7fe640 1 -- 172.21.15.37:0/113050885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554032810 con 0x7f55640d3cd0 2024-05-10T08:42:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.042+0000 7f556ada4640 1 -- 172.21.15.37:0/113050885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 msgr2=0x7f55640cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.042+0000 7f556ada4640 1 --2- 172.21.15.37:0/113050885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55640cfca0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402a180 comp rx=0 tx=0).stop 2024-05-10T08:42:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.042+0000 7f556ada4640 1 -- 172.21.15.37:0/113050885 shutdown_connections 2024-05-10T08:42:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.042+0000 7f556ada4640 1 --2- 172.21.15.37:0/113050885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55640cfca0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.042+0000 7f556ada4640 1 -- 172.21.15.37:0/113050885 >> 172.21.15.37:0/113050885 conn(0x7f55640d4fe0 msgr2=0x7f55640d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.042+0000 7f556ada4640 1 -- 172.21.15.37:0/113050885 shutdown_connections 2024-05-10T08:42:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.042+0000 7f556ada4640 1 -- 172.21.15.37:0/113050885 wait complete. 2024-05-10T08:42:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.043+0000 7f556ada4640 1 Processor -- start 2024-05-10T08:42:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.043+0000 7f556ada4640 1 -- start start 2024-05-10T08:42:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55640c9ee0 0x7f55641e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55641e8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55641629a0 0x7f556414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55640cf440 con 0x7f55640d3cd0 2024-05-10T08:42:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55640cf2c0 con 0x7f55640c9ee0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f55640d2dc0 con 0x7f55641629a0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55641e8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55641e8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56512/0 (socket says 172.21.15.37:56512) 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 -- 172.21.15.37:0/1731696761 learned_addr learned my addr 172.21.15.37:0/1731696761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 -- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55641629a0 msgr2=0x7f556414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55641629a0 0x7f556414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 -- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55640c9ee0 msgr2=0x7f55641e7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55640c9ee0 0x7f55641e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 -- 172.21.15.37:0/1731696761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640cc5f0 con 0x7f55640d3cd0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f555bfff640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55641e8260 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f55540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f55597fa640 1 -- 172.21.15.37:0/1731696761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554041020 con 0x7f55640d3cd0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f55597fa640 1 -- 172.21.15.37:0/1731696761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554030990 con 0x7f55640d3cd0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55640ba440 con 0x7f55640d3cd0 2024-05-10T08:42:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f55597fa640 1 -- 172.21.15.37:0/1731696761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554037040 con 0x7f55640d3cd0 2024-05-10T08:42:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.044+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556414b470 con 0x7f55640d3cd0 2024-05-10T08:42:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.045+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55640693f0 con 0x7f55640d3cd0 2024-05-10T08:42:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.046+0000 7f55597fa640 1 -- 172.21.15.37:0/1731696761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5554044020 con 0x7f55640d3cd0 2024-05-10T08:42:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.046+0000 7f55597fa640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55500762d0 0x7f5550078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.047+0000 7f55597fa640 1 -- 172.21.15.37:0/1731696761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f55540b7e60 con 0x7f55640d3cd0 2024-05-10T08:42:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.047+0000 7f5568b40640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55500762d0 0x7f5550078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.047+0000 7f5568b40640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55500762d0 0x7f5550078790 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5560006fd0 tx=0x7f5560006bc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.051+0000 7f55597fa640 1 -- 172.21.15.37:0/1731696761 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f555404b070 con 0x7f55640d3cd0 2024-05-10T08:42:37.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.242+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55640baea0 con 0x7f55640d3cd0 2024-05-10T08:42:37.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.243+0000 7f55597fa640 1 -- 172.21.15.37:0/1731696761 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16824 (secure 0 0 0) 0x7f55640cc5f0 con 0x7f55640d3cd0 2024-05-10T08:42:37.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:37.242 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:42:34.535241+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:42:30.582142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T08:42:31.864914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:42:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55500762d0 msgr2=0x7f5550078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55500762d0 0x7f5550078790 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5560006fd0 tx=0x7f5560006bc0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 msgr2=0x7f55641e8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55641e8260 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f55540046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 shutdown_connections 2024-05-10T08:42:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55500762d0 0x7f5550078790 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55641629a0 0x7f556414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640d3cd0 0x7f55641e8260 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 --2- 172.21.15.37:0/1731696761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55640c9ee0 0x7f55641e7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 >> 172.21.15.37:0/1731696761 conn(0x7f55640d4fe0 msgr2=0x7f55640ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 shutdown_connections 2024-05-10T08:42:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.245+0000 7f556ada4640 1 -- 172.21.15.37:0/1731696761 wait complete. 2024-05-10T08:42:37.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:42:37.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:42:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.360+0000 7f63ab1a5640 1 Processor -- start 2024-05-10T08:42:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.360+0000 7f63ab1a5640 1 -- start start 2024-05-10T08:42:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63ab1a5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a41629a0 0x7f63a40d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63ab1a5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63a40d0cb0 0x7f63a40d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63ab1a5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a40d3330 con 0x7f63a40d2dc0 2024-05-10T08:42:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63ab1a5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f63a40d2170 con 0x7f63a40d0cb0 2024-05-10T08:42:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63ab1a5640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f63a40d2450 con 0x7f63a41629a0 2024-05-10T08:42:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63a9742640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63a40d0cb0 0x7f63a40d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63a3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f63a40d2dc0 0x7f63a40c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35492/0 (socket says 172.21.15.37:35492) 2024-05-10T08:42:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63a3fff640 1 -- 172.21.15.37:0/3202499564 learned_addr learned my addr 172.21.15.37:0/3202499564 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.361+0000 7f63a8f41640 1 --2- 172.21.15.37:0/3202499564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a41629a0 0x7f63a40d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.362+0000 7f63a9742640 1 -- 172.21.15.37:0/3202499564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a41629a0 msgr2=0x7f63a40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.362+0000 7f63a9742640 1 --2- 172.21.15.37:0/3202499564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a41629a0 0x7f63a40d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.362+0000 7f63a9742640 1 -- 172.21.15.37:0/3202499564 >> v1:172.21.15.37:6789/0 conn(0x7f63a40d2dc0 legacy=0x7f63a40c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.362+0000 7f63a9742640 1 -- 172.21.15.37:0/3202499564 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a40d2730 con 0x7f63a40d0cb0 2024-05-10T08:42:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.362+0000 7f63a37fe640 1 -- 172.21.15.37:0/3202499564 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910628772 0 0) 0x7f63a40d3330 con 0x7f63a40d2dc0 2024-05-10T08:42:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.362+0000 7f63a9742640 1 --2- 172.21.15.37:0/3202499564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a40d0cb0 0x7f63a40d3b00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f639c0097a0 tx=0x7f639c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48656664d0b65768 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.362+0000 7f63a37fe640 1 -- 172.21.15.37:0/3202499564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c037070 con 0x7f63a40d0cb0 2024-05-10T08:42:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63a37fe640 1 -- 172.21.15.37:0/3202499564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c02adb0 con 0x7f63a40d0cb0 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63a37fe640 1 -- 172.21.15.37:0/3202499564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c032660 con 0x7f63a40d0cb0 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3202499564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a40d0cb0 msgr2=0x7f63a40d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3202499564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a40d0cb0 0x7f63a40d3b00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f639c0097a0 tx=0x7f639c02a060 comp rx=0 tx=0).stop 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3202499564 shutdown_connections 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3202499564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a40d0cb0 0x7f63a40d3b00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3202499564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a41629a0 0x7f63a40d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3202499564 >> 172.21.15.37:0/3202499564 conn(0x7f63a40d4fe0 msgr2=0x7f63a40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3202499564 shutdown_connections 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.363+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3202499564 wait complete. 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.364+0000 7f63ab1a5640 1 Processor -- start 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.364+0000 7f63ab1a5640 1 -- start start 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63ab1a5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a40d0cb0 0x7f63a41f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63ab1a5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63a40d2dc0 0x7f63a40b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63ab1a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a41629a0 0x7f63a40b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63ab1a5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f63a40cf440 con 0x7f63a41629a0 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63ab1a5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63a40cf2c0 con 0x7f63a40d2dc0 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63ab1a5640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f63a40c95e0 con 0x7f63a40d0cb0 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63a9742640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a41629a0 0x7f63a40b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63a9742640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a41629a0 0x7f63a40b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56528/0 (socket says 172.21.15.37:56528) 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63a9742640 1 -- 172.21.15.37:0/3380171248 learned_addr learned my addr 172.21.15.37:0/3380171248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63a3fff640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63a40d2dc0 0x7f63a40b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.365+0000 7f63a8f41640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a40d0cb0 0x7f63a41f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a3fff640 1 -- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a40d0cb0 msgr2=0x7f63a41f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a3fff640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a40d0cb0 0x7f63a41f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a3fff640 1 -- 172.21.15.37:0/3380171248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a41629a0 msgr2=0x7f63a40b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a3fff640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a41629a0 0x7f63a40b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a3fff640 1 -- 172.21.15.37:0/3380171248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a40ce220 con 0x7f63a40d2dc0 2024-05-10T08:42:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a3fff640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63a40d2dc0 0x7f63a40b6ae0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f639800c450 tx=0x7f639800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a17fa640 1 -- 172.21.15.37:0/3380171248 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398018070 con 0x7f63a40d2dc0 2024-05-10T08:42:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a17fa640 1 -- 172.21.15.37:0/3380171248 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63980074e0 con 0x7f63a40d2dc0 2024-05-10T08:42:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63a17fa640 1 -- 172.21.15.37:0/3380171248 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398004a20 con 0x7f63a40d2dc0 2024-05-10T08:42:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a40ce500 con 0x7f63a40d2dc0 2024-05-10T08:42:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.366+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a40ceac0 con 0x7f63a40d2dc0 2024-05-10T08:42:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.367+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a40693f0 con 0x7f63a40d2dc0 2024-05-10T08:42:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.368+0000 7f63a17fa640 1 -- 172.21.15.37:0/3380171248 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6398004bc0 con 0x7f63a40d2dc0 2024-05-10T08:42:37.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.369+0000 7f63a17fa640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63900762d0 0x7f6390078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.369+0000 7f63a17fa640 1 -- 172.21.15.37:0/3380171248 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f6398096d30 con 0x7f63a40d2dc0 2024-05-10T08:42:37.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.369+0000 7f63a8f41640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63900762d0 0x7f6390078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.369+0000 7f63a8f41640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63900762d0 0x7f6390078790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6394003aa0 tx=0x7f6394009830 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.373+0000 7f63a17fa640 1 -- 172.21.15.37:0/3380171248 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f639805fd80 con 0x7f63a40d2dc0 2024-05-10T08:42:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.560+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63a40c9c10 con 0x7f63900762d0 2024-05-10T08:42:37.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.567+0000 7f63a17fa640 1 -- 172.21.15.37:0/3380171248 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252003 (secure 0 0 0) 0x7f63a40c9c10 con 0x7f63900762d0 2024-05-10T08:42:37.569 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:42:37.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63900762d0 msgr2=0x7f6390078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63900762d0 0x7f6390078790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6394003aa0 tx=0x7f6394009830 comp rx=0 tx=0).stop 2024-05-10T08:42:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63a40d2dc0 msgr2=0x7f63a40b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63a40d2dc0 0x7f63a40b6ae0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f639800c450 tx=0x7f639800c910 comp rx=0 tx=0).stop 2024-05-10T08:42:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 shutdown_connections 2024-05-10T08:42:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f63900762d0 0x7f6390078790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63a41629a0 0x7f63a40b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63a40d2dc0 0x7f63a40b6ae0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 --2- 172.21.15.37:0/3380171248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f63a40d0cb0 0x7f63a41f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 >> 172.21.15.37:0/3380171248 conn(0x7f63a40d4fe0 msgr2=0x7f63a4160970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 shutdown_connections 2024-05-10T08:42:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.570+0000 7f63ab1a5640 1 -- 172.21.15.37:0/3380171248 wait complete. 2024-05-10T08:42:37.580 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-10T08:42:37.358451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223280,"kb_used_data":7068,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751440,"statfs":{"total":773094113280,"available":772865474560,"internally_reserved":0,"allocated":7237632,"data_stored":3864680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.837518"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543741+0000","last_change":"2024-05-10T08:42:33.552817+0000","last_active":"2024-05-10T08:42:34.543741+0000","last_peered":"2024-05-10T08:42:34.543741+0000","last_clean":"2024-05-10T08:42:34.543741+0000","last_became_active":"2024-05-10T08:42:33.552476+0000","last_became_peered":"2024-05-10T08:42:33.552476+0000","last_unstale":"2024-05-10T08:42:34.543741+0000","last_undegraded":"2024-05-10T08:42:34.543741+0000","last_fullsized":"2024-05-10T08:42:34.543741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:25.298303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543640+0000","last_change":"2024-05-10T08:42:33.557891+0000","last_active":"2024-05-10T08:42:34.543640+0000","last_peered":"2024-05-10T08:42:34.543640+0000","last_clean":"2024-05-10T08:42:34.543640+0000","last_became_active":"2024-05-10T08:42:33.557609+0000","last_became_peered":"2024-05-10T08:42:33.557609+0000","last_unstale":"2024-05-10T08:42:34.543640+0000","last_undegraded":"2024-05-10T08:42:34.543640+0000","last_fullsized":"2024-05-10T08:42:34.543640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:58.366302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541404+0000","last_change":"2024-05-10T08:42:33.569128+0000","last_active":"2024-05-10T08:42:34.541404+0000","last_peered":"2024-05-10T08:42:34.541404+0000","last_clean":"2024-05-10T08:42:34.541404+0000","last_became_active":"2024-05-10T08:42:33.568862+0000","last_became_peered":"2024-05-10T08:42:33.568862+0000","last_unstale":"2024-05-10T08:42:34.541404+0000","last_undegraded":"2024-05-10T08:42:34.541404+0000","last_fullsized":"2024-05-10T08:42:34.541404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:00.076642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539720+0000","last_change":"2024-05-10T08:42:33.557190+0000","last_active":"2024-05-10T08:42:34.539720+0000","last_peered":"2024-05-10T08:42:34.539720+0000","last_clean":"2024-05-10T08:42:34.539720+0000","last_became_active":"2024-05-10T08:42:33.556574+0000","last_became_peered":"2024-05-10T08:42:33.556574+0000","last_unstale":"2024-05-10T08:42:34.539720+0000","last_undegraded":"2024-05-10T08:42:34.539720+0000","last_fullsized":"2024-05-10T08:42:34.539720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:50.335634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542711+0000","last_change":"2024-05-10T08:42:33.560616+0000","last_active":"2024-05-10T08:42:34.542711+0000","last_peered":"2024-05-10T08:42:34.542711+0000","last_clean":"2024-05-10T08:42:34.542711+0000","last_became_active":"2024-05-10T08:42:33.559933+0000","last_became_peered":"2024-05-10T08:42:33.559933+0000","last_unstale":"2024-05-10T08:42:34.542711+0000","last_undegraded":"2024-05-10T08:42:34.542711+0000","last_fullsized":"2024-05-10T08:42:34.542711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:50.997274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542503+0000","last_change":"2024-05-10T08:42:33.562970+0000","last_active":"2024-05-10T08:42:34.542503+0000","last_peered":"2024-05-10T08:42:34.542503+0000","last_clean":"2024-05-10T08:42:34.542503+0000","last_became_active":"2024-05-10T08:42:33.562374+0000","last_became_peered":"2024-05-10T08:42:33.562374+0000","last_unstale":"2024-05-10T08:42:34.542503+0000","last_undegraded":"2024-05-10T08:42:34.542503+0000","last_fullsized":"2024-05-10T08:42:34.542503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:00:27.909987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541303+0000","last_change":"2024-05-10T08:42:33.559176+0000","last_active":"2024-05-10T08:42:34.541303+0000","last_peered":"2024-05-10T08:42:34.541303+0000","last_clean":"2024-05-10T08:42:34.541303+0000","last_became_active":"2024-05-10T08:42:33.558894+0000","last_became_peered":"2024-05-10T08:42:33.558894+0000","last_unstale":"2024-05-10T08:42:34.541303+0000","last_undegraded":"2024-05-10T08:42:34.541303+0000","last_fullsized":"2024-05-10T08:42:34.541303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:44.329696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542149+0000","last_change":"2024-05-10T08:42:33.558928+0000","last_active":"2024-05-10T08:42:34.542149+0000","last_peered":"2024-05-10T08:42:34.542149+0000","last_clean":"2024-05-10T08:42:34.542149+0000","last_became_active":"2024-05-10T08:42:33.558666+0000","last_became_peered":"2024-05-10T08:42:33.558666+0000","last_unstale":"2024-05-10T08:42:34.542149+0000","last_undegraded":"2024-05-10T08:42:34.542149+0000","last_fullsized":"2024-05-10T08:42:34.542149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:54.687741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541789+0000","last_change":"2024-05-10T08:42:33.573403+0000","last_active":"2024-05-10T08:42:34.541789+0000","last_peered":"2024-05-10T08:42:34.541789+0000","last_clean":"2024-05-10T08:42:34.541789+0000","last_became_active":"2024-05-10T08:42:33.572814+0000","last_became_peered":"2024-05-10T08:42:33.572814+0000","last_unstale":"2024-05-10T08:42:34.541789+0000","last_undegraded":"2024-05-10T08:42:34.541789+0000","last_fullsized":"2024-05-10T08:42:34.541789+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:17.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541925+0000","last_change":"2024-05-10T08:42:33.568665+0000","last_active":"2024-05-10T08:42:34.541925+0000","last_peered":"2024-05-10T08:42:34.541925+0000","last_clean":"2024-05-10T08:42:34.541925+0000","last_became_active":"2024-05-10T08:42:33.568379+0000","last_became_peered":"2024-05-10T08:42:33.568379+0000","last_unstale":"2024-05-10T08:42:34.541925+0000","last_undegraded":"2024-05-10T08:42:34.541925+0000","last_fullsized":"2024-05-10T08:42:34.541925+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:52.908172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539278+0000","last_change":"2024-05-10T08:42:33.551336+0000","last_active":"2024-05-10T08:42:34.539278+0000","last_peered":"2024-05-10T08:42:34.539278+0000","last_clean":"2024-05-10T08:42:34.539278+0000","last_became_active":"2024-05-10T08:42:33.550001+0000","last_became_peered":"2024-05-10T08:42:33.550001+0000","last_unstale":"2024-05-10T08:42:34.539278+0000","last_undegraded":"2024-05-10T08:42:34.539278+0000","last_fullsized":"2024-05-10T08:42:34.539278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:14.154558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542271+0000","last_change":"2024-05-10T08:42:33.559270+0000","last_active":"2024-05-10T08:42:34.542271+0000","last_peered":"2024-05-10T08:42:34.542271+0000","last_clean":"2024-05-10T08:42:34.542271+0000","last_became_active":"2024-05-10T08:42:33.558249+0000","last_became_peered":"2024-05-10T08:42:33.558249+0000","last_unstale":"2024-05-10T08:42:34.542271+0000","last_undegraded":"2024-05-10T08:42:34.542271+0000","last_fullsized":"2024-05-10T08:42:34.542271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:01.360451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542753+0000","last_change":"2024-05-10T08:42:33.567532+0000","last_active":"2024-05-10T08:42:34.542753+0000","last_peered":"2024-05-10T08:42:34.542753+0000","last_clean":"2024-05-10T08:42:34.542753+0000","last_became_active":"2024-05-10T08:42:33.567268+0000","last_became_peered":"2024-05-10T08:42:33.567268+0000","last_unstale":"2024-05-10T08:42:34.542753+0000","last_undegraded":"2024-05-10T08:42:34.542753+0000","last_fullsized":"2024-05-10T08:42:34.542753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:51.850101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541151+0000","last_change":"2024-05-10T08:42:33.568485+0000","last_active":"2024-05-10T08:42:34.541151+0000","last_peered":"2024-05-10T08:42:34.541151+0000","last_clean":"2024-05-10T08:42:34.541151+0000","last_became_active":"2024-05-10T08:42:33.568204+0000","last_became_peered":"2024-05-10T08:42:33.568204+0000","last_unstale":"2024-05-10T08:42:34.541151+0000","last_undegraded":"2024-05-10T08:42:34.541151+0000","last_fullsized":"2024-05-10T08:42:34.541151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:04.786975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540659+0000","last_change":"2024-05-10T08:42:33.567251+0000","last_active":"2024-05-10T08:42:34.540659+0000","last_peered":"2024-05-10T08:42:34.540659+0000","last_clean":"2024-05-10T08:42:34.540659+0000","last_became_active":"2024-05-10T08:42:33.566971+0000","last_became_peered":"2024-05-10T08:42:33.566971+0000","last_unstale":"2024-05-10T08:42:34.540659+0000","last_undegraded":"2024-05-10T08:42:34.540659+0000","last_fullsized":"2024-05-10T08:42:34.540659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:04.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541031+0000","last_change":"2024-05-10T08:42:33.554902+0000","last_active":"2024-05-10T08:42:34.541031+0000","last_peered":"2024-05-10T08:42:34.541031+0000","last_clean":"2024-05-10T08:42:34.541031+0000","last_became_active":"2024-05-10T08:42:33.554511+0000","last_became_peered":"2024-05-10T08:42:33.554511+0000","last_unstale":"2024-05-10T08:42:34.541031+0000","last_undegraded":"2024-05-10T08:42:34.541031+0000","last_fullsized":"2024-05-10T08:42:34.541031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:14.437238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543804+0000","last_change":"2024-05-10T08:42:33.552450+0000","last_active":"2024-05-10T08:42:34.543804+0000","last_peered":"2024-05-10T08:42:34.543804+0000","last_clean":"2024-05-10T08:42:34.543804+0000","last_became_active":"2024-05-10T08:42:33.552102+0000","last_became_peered":"2024-05-10T08:42:33.552102+0000","last_unstale":"2024-05-10T08:42:34.543804+0000","last_undegraded":"2024-05-10T08:42:34.543804+0000","last_fullsized":"2024-05-10T08:42:34.543804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:48.007530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539389+0000","last_change":"2024-05-10T08:42:33.560821+0000","last_active":"2024-05-10T08:42:34.539389+0000","last_peered":"2024-05-10T08:42:34.539389+0000","last_clean":"2024-05-10T08:42:34.539389+0000","last_became_active":"2024-05-10T08:42:33.559496+0000","last_became_peered":"2024-05-10T08:42:33.559496+0000","last_unstale":"2024-05-10T08:42:34.539389+0000","last_undegraded":"2024-05-10T08:42:34.539389+0000","last_fullsized":"2024-05-10T08:42:34.539389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:39.995960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542819+0000","last_change":"2024-05-10T08:42:33.562031+0000","last_active":"2024-05-10T08:42:34.542819+0000","last_peered":"2024-05-10T08:42:34.542819+0000","last_clean":"2024-05-10T08:42:34.542819+0000","last_became_active":"2024-05-10T08:42:33.561744+0000","last_became_peered":"2024-05-10T08:42:33.561744+0000","last_unstale":"2024-05-10T08:42:34.542819+0000","last_undegraded":"2024-05-10T08:42:34.542819+0000","last_fullsized":"2024-05-10T08:42:34.542819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:00.854327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542724+0000","last_change":"2024-05-10T08:42:33.558048+0000","last_active":"2024-05-10T08:42:34.542724+0000","last_peered":"2024-05-10T08:42:34.542724+0000","last_clean":"2024-05-10T08:42:34.542724+0000","last_became_active":"2024-05-10T08:42:33.557752+0000","last_became_peered":"2024-05-10T08:42:33.557752+0000","last_unstale":"2024-05-10T08:42:34.542724+0000","last_undegraded":"2024-05-10T08:42:34.542724+0000","last_fullsized":"2024-05-10T08:42:34.542724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:10.166269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542569+0000","last_change":"2024-05-10T08:42:33.566688+0000","last_active":"2024-05-10T08:42:34.542569+0000","last_peered":"2024-05-10T08:42:34.542569+0000","last_clean":"2024-05-10T08:42:34.542569+0000","last_became_active":"2024-05-10T08:42:33.566352+0000","last_became_peered":"2024-05-10T08:42:33.566352+0000","last_unstale":"2024-05-10T08:42:34.542569+0000","last_undegraded":"2024-05-10T08:42:34.542569+0000","last_fullsized":"2024-05-10T08:42:34.542569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:04.786975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542177+0000","last_change":"2024-05-10T08:42:33.561755+0000","last_active":"2024-05-10T08:42:34.542177+0000","last_peered":"2024-05-10T08:42:34.542177+0000","last_clean":"2024-05-10T08:42:34.542177+0000","last_became_active":"2024-05-10T08:42:33.560516+0000","last_became_peered":"2024-05-10T08:42:33.560516+0000","last_unstale":"2024-05-10T08:42:34.542177+0000","last_undegraded":"2024-05-10T08:42:34.542177+0000","last_fullsized":"2024-05-10T08:42:34.542177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:37.843959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542231+0000","last_change":"2024-05-10T08:42:33.557013+0000","last_active":"2024-05-10T08:42:34.542231+0000","last_peered":"2024-05-10T08:42:34.542231+0000","last_clean":"2024-05-10T08:42:34.542231+0000","last_became_active":"2024-05-10T08:42:33.556699+0000","last_became_peered":"2024-05-10T08:42:33.556699+0000","last_unstale":"2024-05-10T08:42:34.542231+0000","last_undegraded":"2024-05-10T08:42:34.542231+0000","last_fullsized":"2024-05-10T08:42:34.542231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:17.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540287+0000","last_change":"2024-05-10T08:42:33.565706+0000","last_active":"2024-05-10T08:42:34.540287+0000","last_peered":"2024-05-10T08:42:34.540287+0000","last_clean":"2024-05-10T08:42:34.540287+0000","last_became_active":"2024-05-10T08:42:33.565196+0000","last_became_peered":"2024-05-10T08:42:33.565196+0000","last_unstale":"2024-05-10T08:42:34.540287+0000","last_undegraded":"2024-05-10T08:42:34.540287+0000","last_fullsized":"2024-05-10T08:42:34.540287+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:20.550671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542924+0000","last_change":"2024-05-10T08:42:33.562491+0000","last_active":"2024-05-10T08:42:34.542924+0000","last_peered":"2024-05-10T08:42:34.542924+0000","last_clean":"2024-05-10T08:42:34.542924+0000","last_became_active":"2024-05-10T08:42:33.562191+0000","last_became_peered":"2024-05-10T08:42:33.562191+0000","last_unstale":"2024-05-10T08:42:34.542924+0000","last_undegraded":"2024-05-10T08:42:34.542924+0000","last_fullsized":"2024-05-10T08:42:34.542924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542778+0000","last_change":"2024-05-10T08:42:33.562273+0000","last_active":"2024-05-10T08:42:34.542778+0000","last_peered":"2024-05-10T08:42:34.542778+0000","last_clean":"2024-05-10T08:42:34.542778+0000","last_became_active":"2024-05-10T08:42:33.562010+0000","last_became_peered":"2024-05-10T08:42:33.562010+0000","last_unstale":"2024-05-10T08:42:34.542778+0000","last_undegraded":"2024-05-10T08:42:34.542778+0000","last_fullsized":"2024-05-10T08:42:34.542778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:00.076642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539168+0000","last_change":"2024-05-10T08:42:33.551125+0000","last_active":"2024-05-10T08:42:34.539168+0000","last_peered":"2024-05-10T08:42:34.539168+0000","last_clean":"2024-05-10T08:42:34.539168+0000","last_became_active":"2024-05-10T08:42:33.550361+0000","last_became_peered":"2024-05-10T08:42:33.550361+0000","last_unstale":"2024-05-10T08:42:34.539168+0000","last_undegraded":"2024-05-10T08:42:34.539168+0000","last_fullsized":"2024-05-10T08:42:34.539168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:50.170482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543954+0000","last_change":"2024-05-10T08:42:33.564413+0000","last_active":"2024-05-10T08:42:34.543954+0000","last_peered":"2024-05-10T08:42:34.543954+0000","last_clean":"2024-05-10T08:42:34.543954+0000","last_became_active":"2024-05-10T08:42:33.564111+0000","last_became_peered":"2024-05-10T08:42:33.564111+0000","last_unstale":"2024-05-10T08:42:34.543954+0000","last_undegraded":"2024-05-10T08:42:34.543954+0000","last_fullsized":"2024-05-10T08:42:34.543954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:38.634065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541351+0000","last_change":"2024-05-10T08:42:33.572566+0000","last_active":"2024-05-10T08:42:34.541351+0000","last_peered":"2024-05-10T08:42:34.541351+0000","last_clean":"2024-05-10T08:42:34.541351+0000","last_became_active":"2024-05-10T08:42:33.572241+0000","last_became_peered":"2024-05-10T08:42:33.572241+0000","last_unstale":"2024-05-10T08:42:34.541351+0000","last_undegraded":"2024-05-10T08:42:34.541351+0000","last_fullsized":"2024-05-10T08:42:34.541351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:51.850101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542318+0000","last_change":"2024-05-10T08:42:33.561478+0000","last_active":"2024-05-10T08:42:34.542318+0000","last_peered":"2024-05-10T08:42:34.542318+0000","last_clean":"2024-05-10T08:42:34.542318+0000","last_became_active":"2024-05-10T08:42:33.561177+0000","last_became_peered":"2024-05-10T08:42:33.561177+0000","last_unstale":"2024-05-10T08:42:34.542318+0000","last_undegraded":"2024-05-10T08:42:34.542318+0000","last_fullsized":"2024-05-10T08:42:34.542318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:20.550671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.538974+0000","last_change":"2024-05-10T08:42:33.550890+0000","last_active":"2024-05-10T08:42:34.538974+0000","last_peered":"2024-05-10T08:42:34.538974+0000","last_clean":"2024-05-10T08:42:34.538974+0000","last_became_active":"2024-05-10T08:42:33.550614+0000","last_became_peered":"2024-05-10T08:42:33.550614+0000","last_unstale":"2024-05-10T08:42:34.538974+0000","last_undegraded":"2024-05-10T08:42:34.538974+0000","last_fullsized":"2024-05-10T08:42:34.538974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:10.550677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542436+0000","last_change":"2024-05-10T08:42:33.562006+0000","last_active":"2024-05-10T08:42:34.542436+0000","last_peered":"2024-05-10T08:42:34.542436+0000","last_clean":"2024-05-10T08:42:34.542436+0000","last_became_active":"2024-05-10T08:42:33.561570+0000","last_became_peered":"2024-05-10T08:42:33.561570+0000","last_unstale":"2024-05-10T08:42:34.542436+0000","last_undegraded":"2024-05-10T08:42:34.542436+0000","last_fullsized":"2024-05-10T08:42:34.542436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:51.975687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542884+0000","last_change":"2024-05-10T08:42:33.568398+0000","last_active":"2024-05-10T08:42:34.542884+0000","last_peered":"2024-05-10T08:42:34.542884+0000","last_clean":"2024-05-10T08:42:34.542884+0000","last_became_active":"2024-05-10T08:42:33.568099+0000","last_became_peered":"2024-05-10T08:42:33.568099+0000","last_unstale":"2024-05-10T08:42:34.542884+0000","last_undegraded":"2024-05-10T08:42:34.542884+0000","last_fullsized":"2024-05-10T08:42:34.542884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:31:46.827128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543801+0000","last_change":"2024-05-10T08:42:32.544326+0000","last_active":"2024-05-10T08:42:34.543801+0000","last_peered":"2024-05-10T08:42:34.543801+0000","last_clean":"2024-05-10T08:42:34.543801+0000","last_became_active":"2024-05-10T08:42:32.544054+0000","last_became_peered":"2024-05-10T08:42:32.544054+0000","last_unstale":"2024-05-10T08:42:34.543801+0000","last_undegraded":"2024-05-10T08:42:34.543801+0000","last_fullsized":"2024-05-10T08:42:34.543801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:06.516972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539474+0000","last_change":"2024-05-10T08:42:33.554684+0000","last_active":"2024-05-10T08:42:34.539474+0000","last_peered":"2024-05-10T08:42:34.539474+0000","last_clean":"2024-05-10T08:42:34.539474+0000","last_became_active":"2024-05-10T08:42:33.554410+0000","last_became_peered":"2024-05-10T08:42:33.554410+0000","last_unstale":"2024-05-10T08:42:34.539474+0000","last_undegraded":"2024-05-10T08:42:34.539474+0000","last_fullsized":"2024-05-10T08:42:34.539474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:58.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542587+0000","last_change":"2024-05-10T08:42:32.545628+0000","last_active":"2024-05-10T08:42:34.542587+0000","last_peered":"2024-05-10T08:42:34.542587+0000","last_clean":"2024-05-10T08:42:34.542587+0000","last_became_active":"2024-05-10T08:42:32.545327+0000","last_became_peered":"2024-05-10T08:42:32.545327+0000","last_unstale":"2024-05-10T08:42:34.542587+0000","last_undegraded":"2024-05-10T08:42:34.542587+0000","last_fullsized":"2024-05-10T08:42:34.542587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:03.781984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542418+0000","last_change":"2024-05-10T08:42:33.567471+0000","last_active":"2024-05-10T08:42:34.542418+0000","last_peered":"2024-05-10T08:42:34.542418+0000","last_clean":"2024-05-10T08:42:34.542418+0000","last_became_active":"2024-05-10T08:42:33.567141+0000","last_became_peered":"2024-05-10T08:42:33.567141+0000","last_unstale":"2024-05-10T08:42:34.542418+0000","last_undegraded":"2024-05-10T08:42:34.542418+0000","last_fullsized":"2024-05-10T08:42:34.542418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:02.079428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543024+0000","last_change":"2024-05-10T08:42:32.545554+0000","last_active":"2024-05-10T08:42:34.543024+0000","last_peered":"2024-05-10T08:42:34.543024+0000","last_clean":"2024-05-10T08:42:34.543024+0000","last_became_active":"2024-05-10T08:42:32.545129+0000","last_became_peered":"2024-05-10T08:42:32.545129+0000","last_unstale":"2024-05-10T08:42:34.543024+0000","last_undegraded":"2024-05-10T08:42:34.543024+0000","last_fullsized":"2024-05-10T08:42:34.543024+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:44.831086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541543+0000","last_change":"2024-05-10T08:42:33.568200+0000","last_active":"2024-05-10T08:42:34.541543+0000","last_peered":"2024-05-10T08:42:34.541543+0000","last_clean":"2024-05-10T08:42:34.541543+0000","last_became_active":"2024-05-10T08:42:33.567901+0000","last_became_peered":"2024-05-10T08:42:33.567901+0000","last_unstale":"2024-05-10T08:42:34.541543+0000","last_undegraded":"2024-05-10T08:42:34.541543+0000","last_fullsized":"2024-05-10T08:42:34.541543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542882+0000","last_change":"2024-05-10T08:42:32.540666+0000","last_active":"2024-05-10T08:42:34.542882+0000","last_peered":"2024-05-10T08:42:34.542882+0000","last_clean":"2024-05-10T08:42:34.542882+0000","last_became_active":"2024-05-10T08:42:32.540319+0000","last_became_peered":"2024-05-10T08:42:32.540319+0000","last_unstale":"2024-05-10T08:42:34.542882+0000","last_undegraded":"2024-05-10T08:42:34.542882+0000","last_fullsized":"2024-05-10T08:42:34.542882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:50.845111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541171+0000","last_change":"2024-05-10T08:42:33.547893+0000","last_active":"2024-05-10T08:42:34.541171+0000","last_peered":"2024-05-10T08:42:34.541171+0000","last_clean":"2024-05-10T08:42:34.541171+0000","last_became_active":"2024-05-10T08:42:33.547603+0000","last_became_peered":"2024-05-10T08:42:33.547603+0000","last_unstale":"2024-05-10T08:42:34.541171+0000","last_undegraded":"2024-05-10T08:42:34.541171+0000","last_fullsized":"2024-05-10T08:42:34.541171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:51.702867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542574+0000","last_change":"2024-05-10T08:42:32.537360+0000","last_active":"2024-05-10T08:42:34.542574+0000","last_peered":"2024-05-10T08:42:34.542574+0000","last_clean":"2024-05-10T08:42:34.542574+0000","last_became_active":"2024-05-10T08:42:32.537040+0000","last_became_peered":"2024-05-10T08:42:32.537040+0000","last_unstale":"2024-05-10T08:42:34.542574+0000","last_undegraded":"2024-05-10T08:42:34.542574+0000","last_fullsized":"2024-05-10T08:42:34.542574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:44.720503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543436+0000","last_change":"2024-05-10T08:42:33.546292+0000","last_active":"2024-05-10T08:42:34.543436+0000","last_peered":"2024-05-10T08:42:34.543436+0000","last_clean":"2024-05-10T08:42:34.543436+0000","last_became_active":"2024-05-10T08:42:33.545714+0000","last_became_peered":"2024-05-10T08:42:33.545714+0000","last_unstale":"2024-05-10T08:42:34.543436+0000","last_undegraded":"2024-05-10T08:42:34.543436+0000","last_fullsized":"2024-05-10T08:42:34.543436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:31:46.827128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542102+0000","last_change":"2024-05-10T08:42:32.536884+0000","last_active":"2024-05-10T08:42:34.542102+0000","last_peered":"2024-05-10T08:42:34.542102+0000","last_clean":"2024-05-10T08:42:34.542102+0000","last_became_active":"2024-05-10T08:42:32.536552+0000","last_became_peered":"2024-05-10T08:42:32.536552+0000","last_unstale":"2024-05-10T08:42:34.542102+0000","last_undegraded":"2024-05-10T08:42:34.542102+0000","last_fullsized":"2024-05-10T08:42:34.542102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:51.903182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542279+0000","last_change":"2024-05-10T08:42:33.560315+0000","last_active":"2024-05-10T08:42:34.542279+0000","last_peered":"2024-05-10T08:42:34.542279+0000","last_clean":"2024-05-10T08:42:34.542279+0000","last_became_active":"2024-05-10T08:42:33.559817+0000","last_became_peered":"2024-05-10T08:42:33.559817+0000","last_unstale":"2024-05-10T08:42:34.542279+0000","last_undegraded":"2024-05-10T08:42:34.542279+0000","last_fullsized":"2024-05-10T08:42:34.542279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:07.521962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542325+0000","last_change":"2024-05-10T08:42:32.544317+0000","last_active":"2024-05-10T08:42:34.542325+0000","last_peered":"2024-05-10T08:42:34.542325+0000","last_clean":"2024-05-10T08:42:34.542325+0000","last_became_active":"2024-05-10T08:42:32.543949+0000","last_became_peered":"2024-05-10T08:42:32.543949+0000","last_unstale":"2024-05-10T08:42:34.542325+0000","last_undegraded":"2024-05-10T08:42:34.542325+0000","last_fullsized":"2024-05-10T08:42:34.542325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:50.970696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542475+0000","last_change":"2024-05-10T08:42:33.555915+0000","last_active":"2024-05-10T08:42:34.542475+0000","last_peered":"2024-05-10T08:42:34.542475+0000","last_clean":"2024-05-10T08:42:34.542475+0000","last_became_active":"2024-05-10T08:42:33.555550+0000","last_became_peered":"2024-05-10T08:42:33.555550+0000","last_unstale":"2024-05-10T08:42:34.542475+0000","last_undegraded":"2024-05-10T08:42:34.542475+0000","last_fullsized":"2024-05-10T08:42:34.542475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:30.873764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542330+0000","last_change":"2024-05-10T08:42:32.550349+0000","last_active":"2024-05-10T08:42:34.542330+0000","last_peered":"2024-05-10T08:42:34.542330+0000","last_clean":"2024-05-10T08:42:34.542330+0000","last_became_active":"2024-05-10T08:42:32.550070+0000","last_became_peered":"2024-05-10T08:42:32.550070+0000","last_unstale":"2024-05-10T08:42:34.542330+0000","last_undegraded":"2024-05-10T08:42:34.542330+0000","last_fullsized":"2024-05-10T08:42:34.542330+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:44:38.717168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543984+0000","last_change":"2024-05-10T08:42:33.549255+0000","last_active":"2024-05-10T08:42:34.543984+0000","last_peered":"2024-05-10T08:42:34.543984+0000","last_clean":"2024-05-10T08:42:34.543984+0000","last_became_active":"2024-05-10T08:42:33.548962+0000","last_became_peered":"2024-05-10T08:42:33.548962+0000","last_unstale":"2024-05-10T08:42:34.543984+0000","last_undegraded":"2024-05-10T08:42:34.543984+0000","last_fullsized":"2024-05-10T08:42:34.543984+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:22.370832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541840+0000","last_change":"2024-05-10T08:42:32.546667+0000","last_active":"2024-05-10T08:42:34.541840+0000","last_peered":"2024-05-10T08:42:34.541840+0000","last_clean":"2024-05-10T08:42:34.541840+0000","last_became_active":"2024-05-10T08:42:32.546343+0000","last_became_peered":"2024-05-10T08:42:32.546343+0000","last_unstale":"2024-05-10T08:42:34.541840+0000","last_undegraded":"2024-05-10T08:42:34.541840+0000","last_fullsized":"2024-05-10T08:42:34.541840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:31:45.822138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542717+0000","last_change":"2024-05-10T08:42:33.555824+0000","last_active":"2024-05-10T08:42:34.542717+0000","last_peered":"2024-05-10T08:42:34.542717+0000","last_clean":"2024-05-10T08:42:34.542717+0000","last_became_active":"2024-05-10T08:42:33.555462+0000","last_became_peered":"2024-05-10T08:42:33.555462+0000","last_unstale":"2024-05-10T08:42:34.542717+0000","last_undegraded":"2024-05-10T08:42:34.542717+0000","last_fullsized":"2024-05-10T08:42:34.542717+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:03.690092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539605+0000","last_change":"2024-05-10T08:42:32.548492+0000","last_active":"2024-05-10T08:42:34.539605+0000","last_peered":"2024-05-10T08:42:34.539605+0000","last_clean":"2024-05-10T08:42:34.539605+0000","last_became_active":"2024-05-10T08:42:32.548168+0000","last_became_peered":"2024-05-10T08:42:32.548168+0000","last_unstale":"2024-05-10T08:42:34.539605+0000","last_undegraded":"2024-05-10T08:42:34.539605+0000","last_fullsized":"2024-05-10T08:42:34.539605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:05.334087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542739+0000","last_change":"2024-05-10T08:42:33.559970+0000","last_active":"2024-05-10T08:42:34.542739+0000","last_peered":"2024-05-10T08:42:34.542739+0000","last_clean":"2024-05-10T08:42:34.542739+0000","last_became_active":"2024-05-10T08:42:33.559681+0000","last_became_peered":"2024-05-10T08:42:33.559681+0000","last_unstale":"2024-05-10T08:42:34.542739+0000","last_undegraded":"2024-05-10T08:42:34.542739+0000","last_fullsized":"2024-05-10T08:42:34.542739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:35.724065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541525+0000","last_change":"2024-05-10T08:42:32.546819+0000","last_active":"2024-05-10T08:42:34.541525+0000","last_peered":"2024-05-10T08:42:34.541525+0000","last_clean":"2024-05-10T08:42:34.541525+0000","last_became_active":"2024-05-10T08:42:32.546549+0000","last_became_peered":"2024-05-10T08:42:32.546549+0000","last_unstale":"2024-05-10T08:42:34.541525+0000","last_undegraded":"2024-05-10T08:42:34.541525+0000","last_fullsized":"2024-05-10T08:42:34.541525+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:49.992284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539378+0000","last_change":"2024-05-10T08:42:33.545050+0000","last_active":"2024-05-10T08:42:34.539378+0000","last_peered":"2024-05-10T08:42:34.539378+0000","last_clean":"2024-05-10T08:42:34.539378+0000","last_became_active":"2024-05-10T08:42:33.544573+0000","last_became_peered":"2024-05-10T08:42:33.544573+0000","last_unstale":"2024-05-10T08:42:34.539378+0000","last_undegraded":"2024-05-10T08:42:34.539378+0000","last_fullsized":"2024-05-10T08:42:34.539378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:07.521962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.544058+0000","last_change":"2024-05-10T08:42:32.551626+0000","last_active":"2024-05-10T08:42:34.544058+0000","last_peered":"2024-05-10T08:42:34.544058+0000","last_clean":"2024-05-10T08:42:34.544058+0000","last_became_active":"2024-05-10T08:42:32.551418+0000","last_became_peered":"2024-05-10T08:42:32.551418+0000","last_unstale":"2024-05-10T08:42:34.544058+0000","last_undegraded":"2024-05-10T08:42:34.544058+0000","last_fullsized":"2024-05-10T08:42:34.544058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:00.110054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539145+0000","last_change":"2024-05-10T08:42:33.556195+0000","last_active":"2024-05-10T08:42:34.539145+0000","last_peered":"2024-05-10T08:42:34.539145+0000","last_clean":"2024-05-10T08:42:34.539145+0000","last_became_active":"2024-05-10T08:42:33.555921+0000","last_became_peered":"2024-05-10T08:42:33.555921+0000","last_unstale":"2024-05-10T08:42:34.539145+0000","last_undegraded":"2024-05-10T08:42:34.539145+0000","last_fullsized":"2024-05-10T08:42:34.539145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:42.610815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541507+0000","last_change":"2024-05-10T08:42:32.549639+0000","last_active":"2024-05-10T08:42:34.541507+0000","last_peered":"2024-05-10T08:42:34.541507+0000","last_clean":"2024-05-10T08:42:34.541507+0000","last_became_active":"2024-05-10T08:42:32.549360+0000","last_became_peered":"2024-05-10T08:42:32.549360+0000","last_unstale":"2024-05-10T08:42:34.541507+0000","last_undegraded":"2024-05-10T08:42:34.541507+0000","last_fullsized":"2024-05-10T08:42:34.541507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:34.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542182+0000","last_change":"2024-05-10T08:42:33.555196+0000","last_active":"2024-05-10T08:42:34.542182+0000","last_peered":"2024-05-10T08:42:34.542182+0000","last_clean":"2024-05-10T08:42:34.542182+0000","last_became_active":"2024-05-10T08:42:33.554926+0000","last_became_peered":"2024-05-10T08:42:33.554926+0000","last_unstale":"2024-05-10T08:42:34.542182+0000","last_undegraded":"2024-05-10T08:42:34.542182+0000","last_fullsized":"2024-05-10T08:42:34.542182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:45.836076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542409+0000","last_change":"2024-05-10T08:42:32.544563+0000","last_active":"2024-05-10T08:42:34.542409+0000","last_peered":"2024-05-10T08:42:34.542409+0000","last_clean":"2024-05-10T08:42:34.542409+0000","last_became_active":"2024-05-10T08:42:32.544302+0000","last_became_peered":"2024-05-10T08:42:32.544302+0000","last_unstale":"2024-05-10T08:42:34.542409+0000","last_undegraded":"2024-05-10T08:42:34.542409+0000","last_fullsized":"2024-05-10T08:42:34.542409+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:34.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542483+0000","last_change":"2024-05-10T08:42:33.562747+0000","last_active":"2024-05-10T08:42:34.542483+0000","last_peered":"2024-05-10T08:42:34.542483+0000","last_clean":"2024-05-10T08:42:34.542483+0000","last_became_active":"2024-05-10T08:42:33.562235+0000","last_became_peered":"2024-05-10T08:42:33.562235+0000","last_unstale":"2024-05-10T08:42:34.542483+0000","last_undegraded":"2024-05-10T08:42:34.542483+0000","last_fullsized":"2024-05-10T08:42:34.542483+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:58.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540776+0000","last_change":"2024-05-10T08:42:32.545520+0000","last_active":"2024-05-10T08:42:34.540776+0000","last_peered":"2024-05-10T08:42:34.540776+0000","last_clean":"2024-05-10T08:42:34.540776+0000","last_became_active":"2024-05-10T08:42:32.545263+0000","last_became_peered":"2024-05-10T08:42:32.545263+0000","last_unstale":"2024-05-10T08:42:34.540776+0000","last_undegraded":"2024-05-10T08:42:34.540776+0000","last_fullsized":"2024-05-10T08:42:34.540776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:49.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543537+0000","last_change":"2024-05-10T08:42:33.556267+0000","last_active":"2024-05-10T08:42:34.543537+0000","last_peered":"2024-05-10T08:42:34.543537+0000","last_clean":"2024-05-10T08:42:34.543537+0000","last_became_active":"2024-05-10T08:42:33.555963+0000","last_became_peered":"2024-05-10T08:42:33.555963+0000","last_unstale":"2024-05-10T08:42:34.543537+0000","last_undegraded":"2024-05-10T08:42:34.543537+0000","last_fullsized":"2024-05-10T08:42:34.543537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:14.188620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539280+0000","last_change":"2024-05-10T08:42:32.548471+0000","last_active":"2024-05-10T08:42:34.539280+0000","last_peered":"2024-05-10T08:42:34.539280+0000","last_clean":"2024-05-10T08:42:34.539280+0000","last_became_active":"2024-05-10T08:42:32.548219+0000","last_became_peered":"2024-05-10T08:42:32.548219+0000","last_unstale":"2024-05-10T08:42:34.539280+0000","last_undegraded":"2024-05-10T08:42:34.539280+0000","last_fullsized":"2024-05-10T08:42:34.539280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:50.912769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541581+0000","last_change":"2024-05-10T08:42:33.573176+0000","last_active":"2024-05-10T08:42:34.541581+0000","last_peered":"2024-05-10T08:42:34.541581+0000","last_clean":"2024-05-10T08:42:34.541581+0000","last_became_active":"2024-05-10T08:42:33.572801+0000","last_became_peered":"2024-05-10T08:42:33.572801+0000","last_unstale":"2024-05-10T08:42:34.541581+0000","last_undegraded":"2024-05-10T08:42:34.541581+0000","last_fullsized":"2024-05-10T08:42:34.541581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:33.484512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543015+0000","last_change":"2024-05-10T08:42:32.544221+0000","last_active":"2024-05-10T08:42:34.543015+0000","last_peered":"2024-05-10T08:42:34.543015+0000","last_clean":"2024-05-10T08:42:34.543015+0000","last_became_active":"2024-05-10T08:42:32.543937+0000","last_became_peered":"2024-05-10T08:42:32.543937+0000","last_unstale":"2024-05-10T08:42:34.543015+0000","last_undegraded":"2024-05-10T08:42:34.543015+0000","last_fullsized":"2024-05-10T08:42:34.543015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:57.206706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542980+0000","last_change":"2024-05-10T08:42:33.556837+0000","last_active":"2024-05-10T08:42:34.542980+0000","last_peered":"2024-05-10T08:42:34.542980+0000","last_clean":"2024-05-10T08:42:34.542980+0000","last_became_active":"2024-05-10T08:42:33.556321+0000","last_became_peered":"2024-05-10T08:42:33.556321+0000","last_unstale":"2024-05-10T08:42:34.542980+0000","last_undegraded":"2024-05-10T08:42:34.542980+0000","last_fullsized":"2024-05-10T08:42:34.542980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:05.900691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541869+0000","last_change":"2024-05-10T08:42:32.549486+0000","last_active":"2024-05-10T08:42:34.541869+0000","last_peered":"2024-05-10T08:42:34.541869+0000","last_clean":"2024-05-10T08:42:34.541869+0000","last_became_active":"2024-05-10T08:42:32.548966+0000","last_became_peered":"2024-05-10T08:42:32.548966+0000","last_unstale":"2024-05-10T08:42:34.541869+0000","last_undegraded":"2024-05-10T08:42:34.541869+0000","last_fullsized":"2024-05-10T08:42:34.541869+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:47.490421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539310+0000","last_change":"2024-05-10T08:42:33.554598+0000","last_active":"2024-05-10T08:42:34.539310+0000","last_peered":"2024-05-10T08:42:34.539310+0000","last_clean":"2024-05-10T08:42:34.539310+0000","last_became_active":"2024-05-10T08:42:33.554297+0000","last_became_peered":"2024-05-10T08:42:33.554297+0000","last_unstale":"2024-05-10T08:42:34.539310+0000","last_undegraded":"2024-05-10T08:42:34.539310+0000","last_fullsized":"2024-05-10T08:42:34.539310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:06.768858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541708+0000","last_change":"2024-05-10T08:42:32.547083+0000","last_active":"2024-05-10T08:42:34.541708+0000","last_peered":"2024-05-10T08:42:34.541708+0000","last_clean":"2024-05-10T08:42:34.541708+0000","last_became_active":"2024-05-10T08:42:32.546838+0000","last_became_peered":"2024-05-10T08:42:32.546838+0000","last_unstale":"2024-05-10T08:42:34.541708+0000","last_undegraded":"2024-05-10T08:42:34.541708+0000","last_fullsized":"2024-05-10T08:42:34.541708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:09.326682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542817+0000","last_change":"2024-05-10T08:42:33.557719+0000","last_active":"2024-05-10T08:42:34.542817+0000","last_peered":"2024-05-10T08:42:34.542817+0000","last_clean":"2024-05-10T08:42:34.542817+0000","last_became_active":"2024-05-10T08:42:33.557453+0000","last_became_peered":"2024-05-10T08:42:33.557453+0000","last_unstale":"2024-05-10T08:42:34.542817+0000","last_undegraded":"2024-05-10T08:42:34.542817+0000","last_fullsized":"2024-05-10T08:42:34.542817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:48.495411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542768+0000","last_change":"2024-05-10T08:42:32.548942+0000","last_active":"2024-05-10T08:42:34.542768+0000","last_peered":"2024-05-10T08:42:34.542768+0000","last_clean":"2024-05-10T08:42:34.542768+0000","last_became_active":"2024-05-10T08:42:32.548647+0000","last_became_peered":"2024-05-10T08:42:32.548647+0000","last_unstale":"2024-05-10T08:42:34.542768+0000","last_undegraded":"2024-05-10T08:42:34.542768+0000","last_fullsized":"2024-05-10T08:42:34.542768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:00:26.904996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542583+0000","last_change":"2024-05-10T08:42:33.561737+0000","last_active":"2024-05-10T08:42:34.542583+0000","last_peered":"2024-05-10T08:42:34.542583+0000","last_clean":"2024-05-10T08:42:34.542583+0000","last_became_active":"2024-05-10T08:42:33.561442+0000","last_became_peered":"2024-05-10T08:42:33.561442+0000","last_unstale":"2024-05-10T08:42:34.542583+0000","last_undegraded":"2024-05-10T08:42:34.542583+0000","last_fullsized":"2024-05-10T08:42:34.542583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:09.555221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542065+0000","last_change":"2024-05-10T08:42:32.547683+0000","last_active":"2024-05-10T08:42:34.542065+0000","last_peered":"2024-05-10T08:42:34.542065+0000","last_clean":"2024-05-10T08:42:34.542065+0000","last_became_active":"2024-05-10T08:42:32.547312+0000","last_became_peered":"2024-05-10T08:42:32.547312+0000","last_unstale":"2024-05-10T08:42:34.542065+0000","last_undegraded":"2024-05-10T08:42:34.542065+0000","last_fullsized":"2024-05-10T08:42:34.542065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:00.355461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542321+0000","last_change":"2024-05-10T08:42:33.551415+0000","last_active":"2024-05-10T08:42:34.542321+0000","last_peered":"2024-05-10T08:42:34.542321+0000","last_clean":"2024-05-10T08:42:34.542321+0000","last_became_active":"2024-05-10T08:42:33.551125+0000","last_became_peered":"2024-05-10T08:42:33.551125+0000","last_unstale":"2024-05-10T08:42:34.542321+0000","last_undegraded":"2024-05-10T08:42:34.542321+0000","last_fullsized":"2024-05-10T08:42:34.542321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:04.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542423+0000","last_change":"2024-05-10T08:42:32.541733+0000","last_active":"2024-05-10T08:42:34.542423+0000","last_peered":"2024-05-10T08:42:34.542423+0000","last_clean":"2024-05-10T08:42:34.542423+0000","last_became_active":"2024-05-10T08:42:32.541448+0000","last_became_peered":"2024-05-10T08:42:32.541448+0000","last_unstale":"2024-05-10T08:42:34.542423+0000","last_undegraded":"2024-05-10T08:42:34.542423+0000","last_fullsized":"2024-05-10T08:42:34.542423+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:09.326682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542599+0000","last_change":"2024-05-10T08:42:33.560413+0000","last_active":"2024-05-10T08:42:34.542599+0000","last_peered":"2024-05-10T08:42:34.542599+0000","last_clean":"2024-05-10T08:42:34.542599+0000","last_became_active":"2024-05-10T08:42:33.560151+0000","last_became_peered":"2024-05-10T08:42:33.560151+0000","last_unstale":"2024-05-10T08:42:34.542599+0000","last_undegraded":"2024-05-10T08:42:34.542599+0000","last_fullsized":"2024-05-10T08:42:34.542599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:50.335634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542126+0000","last_change":"2024-05-10T08:42:32.543311+0000","last_active":"2024-05-10T08:42:34.542126+0000","last_peered":"2024-05-10T08:42:34.542126+0000","last_clean":"2024-05-10T08:42:34.542126+0000","last_became_active":"2024-05-10T08:42:32.543015+0000","last_became_peered":"2024-05-10T08:42:32.543015+0000","last_unstale":"2024-05-10T08:42:34.542126+0000","last_undegraded":"2024-05-10T08:42:34.542126+0000","last_fullsized":"2024-05-10T08:42:34.542126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:03.842645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542928+0000","last_change":"2024-05-10T08:42:33.567700+0000","last_active":"2024-05-10T08:42:34.542928+0000","last_peered":"2024-05-10T08:42:34.542928+0000","last_clean":"2024-05-10T08:42:34.542928+0000","last_became_active":"2024-05-10T08:42:33.566008+0000","last_became_peered":"2024-05-10T08:42:33.566008+0000","last_unstale":"2024-05-10T08:42:34.542928+0000","last_undegraded":"2024-05-10T08:42:34.542928+0000","last_fullsized":"2024-05-10T08:42:34.542928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:17.667236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543109+0000","last_change":"2024-05-10T08:42:32.548450+0000","last_active":"2024-05-10T08:42:34.543109+0000","last_peered":"2024-05-10T08:42:34.543109+0000","last_clean":"2024-05-10T08:42:34.543109+0000","last_became_active":"2024-05-10T08:42:32.548199+0000","last_became_peered":"2024-05-10T08:42:32.548199+0000","last_unstale":"2024-05-10T08:42:34.543109+0000","last_undegraded":"2024-05-10T08:42:34.543109+0000","last_fullsized":"2024-05-10T08:42:34.543109+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:49.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541439+0000","last_change":"2024-05-10T08:42:33.559030+0000","last_active":"2024-05-10T08:42:34.541439+0000","last_peered":"2024-05-10T08:42:34.541439+0000","last_clean":"2024-05-10T08:42:34.541439+0000","last_became_active":"2024-05-10T08:42:33.558704+0000","last_became_peered":"2024-05-10T08:42:33.558704+0000","last_unstale":"2024-05-10T08:42:34.541439+0000","last_undegraded":"2024-05-10T08:42:34.541439+0000","last_fullsized":"2024-05-10T08:42:34.541439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:56.957072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.555542+0000","last_change":"2024-05-10T08:42:32.537939+0000","last_active":"2024-05-10T08:42:34.555542+0000","last_peered":"2024-05-10T08:42:34.555542+0000","last_clean":"2024-05-10T08:42:34.555542+0000","last_became_active":"2024-05-10T08:42:32.537670+0000","last_became_peered":"2024-05-10T08:42:32.537670+0000","last_unstale":"2024-05-10T08:42:34.555542+0000","last_undegraded":"2024-05-10T08:42:34.555542+0000","last_fullsized":"2024-05-10T08:42:34.555542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:49.992284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543148+0000","last_change":"2024-05-10T08:42:33.561666+0000","last_active":"2024-05-10T08:42:34.543148+0000","last_peered":"2024-05-10T08:42:34.543148+0000","last_clean":"2024-05-10T08:42:34.543148+0000","last_became_active":"2024-05-10T08:42:33.561385+0000","last_became_peered":"2024-05-10T08:42:33.561385+0000","last_unstale":"2024-05-10T08:42:34.543148+0000","last_undegraded":"2024-05-10T08:42:34.543148+0000","last_fullsized":"2024-05-10T08:42:34.543148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:33.484512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543049+0000","last_change":"2024-05-10T08:42:32.545103+0000","last_active":"2024-05-10T08:42:34.543049+0000","last_peered":"2024-05-10T08:42:34.543049+0000","last_clean":"2024-05-10T08:42:34.543049+0000","last_became_active":"2024-05-10T08:42:32.544782+0000","last_became_peered":"2024-05-10T08:42:32.544782+0000","last_unstale":"2024-05-10T08:42:34.543049+0000","last_undegraded":"2024-05-10T08:42:34.543049+0000","last_fullsized":"2024-05-10T08:42:34.543049+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:19.545681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542727+0000","last_change":"2024-05-10T08:42:33.553074+0000","last_active":"2024-05-10T08:42:34.542727+0000","last_peered":"2024-05-10T08:42:34.542727+0000","last_clean":"2024-05-10T08:42:34.542727+0000","last_became_active":"2024-05-10T08:42:33.552807+0000","last_became_peered":"2024-05-10T08:42:33.552807+0000","last_unstale":"2024-05-10T08:42:34.542727+0000","last_undegraded":"2024-05-10T08:42:34.542727+0000","last_fullsized":"2024-05-10T08:42:34.542727+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:10.331673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.544088+0000","last_change":"2024-05-10T08:42:32.551578+0000","last_active":"2024-05-10T08:42:34.544088+0000","last_peered":"2024-05-10T08:42:34.544088+0000","last_clean":"2024-05-10T08:42:34.544088+0000","last_became_active":"2024-05-10T08:42:32.551292+0000","last_became_peered":"2024-05-10T08:42:32.551292+0000","last_unstale":"2024-05-10T08:42:34.544088+0000","last_undegraded":"2024-05-10T08:42:34.544088+0000","last_fullsized":"2024-05-10T08:42:34.544088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:05.763868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542325+0000","last_change":"2024-05-10T08:42:33.567510+0000","last_active":"2024-05-10T08:42:34.542325+0000","last_peered":"2024-05-10T08:42:34.542325+0000","last_clean":"2024-05-10T08:42:34.542325+0000","last_became_active":"2024-05-10T08:42:33.567234+0000","last_became_peered":"2024-05-10T08:42:33.567234+0000","last_unstale":"2024-05-10T08:42:34.542325+0000","last_undegraded":"2024-05-10T08:42:34.542325+0000","last_fullsized":"2024-05-10T08:42:34.542325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:39.995960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541613+0000","last_change":"2024-05-10T08:42:32.546414+0000","last_active":"2024-05-10T08:42:34.541613+0000","last_peered":"2024-05-10T08:42:34.541613+0000","last_clean":"2024-05-10T08:42:34.541613+0000","last_became_active":"2024-05-10T08:42:32.546052+0000","last_became_peered":"2024-05-10T08:42:32.546052+0000","last_unstale":"2024-05-10T08:42:34.541613+0000","last_undegraded":"2024-05-10T08:42:34.541613+0000","last_fullsized":"2024-05-10T08:42:34.541613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:59.849336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539234+0000","last_change":"2024-05-10T08:42:33.556796+0000","last_active":"2024-05-10T08:42:34.539234+0000","last_peered":"2024-05-10T08:42:34.539234+0000","last_clean":"2024-05-10T08:42:34.539234+0000","last_became_active":"2024-05-10T08:42:33.556023+0000","last_became_peered":"2024-05-10T08:42:33.556023+0000","last_unstale":"2024-05-10T08:42:34.539234+0000","last_undegraded":"2024-05-10T08:42:34.539234+0000","last_fullsized":"2024-05-10T08:42:34.539234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:01.115044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542290+0000","last_change":"2024-05-10T08:42:32.537455+0000","last_active":"2024-05-10T08:42:34.542290+0000","last_peered":"2024-05-10T08:42:34.542290+0000","last_clean":"2024-05-10T08:42:34.542290+0000","last_became_active":"2024-05-10T08:42:32.537093+0000","last_became_peered":"2024-05-10T08:42:32.537093+0000","last_unstale":"2024-05-10T08:42:34.542290+0000","last_undegraded":"2024-05-10T08:42:34.542290+0000","last_fullsized":"2024-05-10T08:42:34.542290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:01.074438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543517+0000","last_change":"2024-05-10T08:42:33.544192+0000","last_active":"2024-05-10T08:42:34.543517+0000","last_peered":"2024-05-10T08:42:34.543517+0000","last_clean":"2024-05-10T08:42:34.543517+0000","last_became_active":"2024-05-10T08:42:33.543879+0000","last_became_peered":"2024-05-10T08:42:33.543879+0000","last_unstale":"2024-05-10T08:42:34.543517+0000","last_undegraded":"2024-05-10T08:42:34.543517+0000","last_fullsized":"2024-05-10T08:42:34.543517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:05.900691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542416+0000","last_change":"2024-05-10T08:42:32.539556+0000","last_active":"2024-05-10T08:42:34.542416+0000","last_peered":"2024-05-10T08:42:34.542416+0000","last_clean":"2024-05-10T08:42:34.542416+0000","last_became_active":"2024-05-10T08:42:32.538805+0000","last_became_peered":"2024-05-10T08:42:32.538805+0000","last_unstale":"2024-05-10T08:42:34.542416+0000","last_undegraded":"2024-05-10T08:42:34.542416+0000","last_fullsized":"2024-05-10T08:42:34.542416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:08.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540910+0000","last_change":"2024-05-10T08:42:33.553295+0000","last_active":"2024-05-10T08:42:34.540910+0000","last_peered":"2024-05-10T08:42:34.540910+0000","last_clean":"2024-05-10T08:42:34.540910+0000","last_became_active":"2024-05-10T08:42:33.552984+0000","last_became_peered":"2024-05-10T08:42:33.552984+0000","last_unstale":"2024-05-10T08:42:34.540910+0000","last_undegraded":"2024-05-10T08:42:34.540910+0000","last_fullsized":"2024-05-10T08:42:34.540910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:59.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543437+0000","last_change":"2024-05-10T08:42:32.544270+0000","last_active":"2024-05-10T08:42:34.543437+0000","last_peered":"2024-05-10T08:42:34.543437+0000","last_clean":"2024-05-10T08:42:34.543437+0000","last_became_active":"2024-05-10T08:42:32.543966+0000","last_became_peered":"2024-05-10T08:42:32.543966+0000","last_unstale":"2024-05-10T08:42:34.543437+0000","last_undegraded":"2024-05-10T08:42:34.543437+0000","last_fullsized":"2024-05-10T08:42:34.543437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:41.605825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543014+0000","last_change":"2024-05-10T08:42:33.567542+0000","last_active":"2024-05-10T08:42:34.543014+0000","last_peered":"2024-05-10T08:42:34.543014+0000","last_clean":"2024-05-10T08:42:34.543014+0000","last_became_active":"2024-05-10T08:42:33.567266+0000","last_became_peered":"2024-05-10T08:42:33.567266+0000","last_unstale":"2024-05-10T08:42:34.543014+0000","last_undegraded":"2024-05-10T08:42:34.543014+0000","last_fullsized":"2024-05-10T08:42:34.543014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:14.188620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542050+0000","last_change":"2024-05-10T08:42:32.537449+0000","last_active":"2024-05-10T08:42:34.542050+0000","last_peered":"2024-05-10T08:42:34.542050+0000","last_clean":"2024-05-10T08:42:34.542050+0000","last_became_active":"2024-05-10T08:42:32.537069+0000","last_became_peered":"2024-05-10T08:42:32.537069+0000","last_unstale":"2024-05-10T08:42:34.542050+0000","last_undegraded":"2024-05-10T08:42:34.542050+0000","last_fullsized":"2024-05-10T08:42:34.542050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:16.662245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":186,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540295+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:42:34.540295+0000","last_peered":"2024-05-10T08:42:34.540295+0000","last_clean":"2024-05-10T08:42:34.540295+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:42:34.540295+0000","last_undegraded":"2024-05-10T08:42:34.540295+0000","last_fullsized":"2024-05-10T08:42:34.540295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1359872,"data_stored":926871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":335761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":335749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":761856,"data_stored":337339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":335727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":329035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":338103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1343488,"data_stored":926095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:42:37.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:42:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.725+0000 7f772af7f640 1 Processor -- start 2024-05-10T08:42:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.725+0000 7f772af7f640 1 -- start start 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.726+0000 7f772af7f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f772406f060 0x7f772406e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.726+0000 7f772af7f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77240d0530 0x7f77240b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.726+0000 7f772af7f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772415d2a0 con 0x7f772406fe30 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.726+0000 7f772af7f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f772406f440 con 0x7f772406f060 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.726+0000 7f772af7f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f77241609b0 con 0x7f77240d0530 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.726+0000 7f7728d1b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f772406f060 0x7f772406e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f7723fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f772406fe30 0x7f77240cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52674/0 (socket says 172.21.15.37:52674) 2024-05-10T08:42:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f7723fff640 1 -- 172.21.15.37:0/2399982050 learned_addr learned my addr 172.21.15.37:0/2399982050 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f7728d1b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f772406f060 0x7f772406e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60752/0 (socket says 172.21.15.37:60752) 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f7728d1b640 1 -- 172.21.15.37:0/2399982050 >> v2:172.21.15.82:3300/0 conn(0x7f77240d0530 msgr2=0x7f77240b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f772951c640 1 --2- 172.21.15.37:0/2399982050 >> v2:172.21.15.82:3300/0 conn(0x7f77240d0530 0x7f77240b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f77237fe640 1 -- 172.21.15.37:0/2399982050 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837625965 0 0) 0x7f772415d2a0 con 0x7f772406fe30 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f7728d1b640 1 --2- 172.21.15.37:0/2399982050 >> v2:172.21.15.82:3300/0 conn(0x7f77240d0530 0x7f77240b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f7728d1b640 1 -- 172.21.15.37:0/2399982050 >> v1:172.21.15.37:6789/0 conn(0x7f772406fe30 legacy=0x7f77240cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f7728d1b640 1 -- 172.21.15.37:0/2399982050 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7724160c90 con 0x7f772406f060 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.727+0000 7f772951c640 1 --2- 172.21.15.37:0/2399982050 >> v2:172.21.15.82:3300/0 conn(0x7f77240d0530 0x7f77240b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f7728d1b640 1 --2- 172.21.15.37:0/2399982050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772406e0f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f772409f050 tx=0x7f771402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd25544be6f0a4e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f77237fe640 1 -- 172.21.15.37:0/2399982050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714037070 con 0x7f772406f060 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f77237fe640 1 -- 172.21.15.37:0/2399982050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7714032440 con 0x7f772406f060 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f77237fe640 1 -- 172.21.15.37:0/2399982050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714032810 con 0x7f772406f060 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 -- 172.21.15.37:0/2399982050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 msgr2=0x7f772406e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 --2- 172.21.15.37:0/2399982050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772406e0f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f772409f050 tx=0x7f771402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 -- 172.21.15.37:0/2399982050 shutdown_connections 2024-05-10T08:42:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 --2- 172.21.15.37:0/2399982050 >> v2:172.21.15.82:3300/0 conn(0x7f77240d0530 0x7f77240b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 --2- 172.21.15.37:0/2399982050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772406e0f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 -- 172.21.15.37:0/2399982050 >> 172.21.15.37:0/2399982050 conn(0x7f772406c3a0 msgr2=0x7f772406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 -- 172.21.15.37:0/2399982050 shutdown_connections 2024-05-10T08:42:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.728+0000 7f772af7f640 1 -- 172.21.15.37:0/2399982050 wait complete. 2024-05-10T08:42:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.729+0000 7f772af7f640 1 Processor -- start 2024-05-10T08:42:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.730+0000 7f772af7f640 1 -- start start 2024-05-10T08:42:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.730+0000 7f772af7f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.730+0000 7f772af7f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f772406fe30 0x7f77241f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.730+0000 7f772af7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77240d0530 0x7f772409ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.730+0000 7f772af7f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7724161530 con 0x7f772406f060 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.730+0000 7f772af7f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7724161250 con 0x7f77240d0530 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.730+0000 7f772af7f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f77240702c0 con 0x7f772406fe30 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772414a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60762/0 (socket says 172.21.15.37:60762) 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 -- 172.21.15.37:0/1805792802 learned_addr learned my addr 172.21.15.37:0/1805792802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7723fff640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f772406fe30 0x7f77241f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f772951c640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77240d0530 0x7f772409ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 -- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f772406fe30 msgr2=0x7f77241f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f772406fe30 0x7f77241f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 -- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77240d0530 msgr2=0x7f772409ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77240d0530 0x7f772409ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 -- 172.21.15.37:0/1805792802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772414abe0 con 0x7f772406f060 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f7728d1b640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772414a6a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7714009890 tx=0x7f77140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f77217fa640 1 -- 172.21.15.37:0/1805792802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714037040 con 0x7f772406f060 2024-05-10T08:42:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f77217fa640 1 -- 172.21.15.37:0/1805792802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7714042070 con 0x7f772406f060 2024-05-10T08:42:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772409d450 con 0x7f772406f060 2024-05-10T08:42:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f77217fa640 1 -- 172.21.15.37:0/1805792802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714030a50 con 0x7f772406f060 2024-05-10T08:42:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.731+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77241552b0 con 0x7f772406f060 2024-05-10T08:42:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.732+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77240693f0 con 0x7f772406f060 2024-05-10T08:42:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.733+0000 7f77217fa640 1 -- 172.21.15.37:0/1805792802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7714030bf0 con 0x7f772406f060 2024-05-10T08:42:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.733+0000 7f77217fa640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77100762d0 0x7f7710078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.734+0000 7f77217fa640 1 -- 172.21.15.37:0/1805792802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f77140b8260 con 0x7f772406f060 2024-05-10T08:42:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.734+0000 7f7723fff640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77100762d0 0x7f7710078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.734+0000 7f7723fff640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77100762d0 0x7f7710078790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7724156990 tx=0x7f7718007b50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.738+0000 7f77217fa640 1 -- 172.21.15.37:0/1805792802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f772414abe0 con 0x7f772406f060 2024-05-10T08:42:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.924+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77240765b0 con 0x7f77100762d0 2024-05-10T08:42:37.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.931+0000 7f77217fa640 1 -- 172.21.15.37:0/1805792802 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252003 (secure 0 0 0) 0x7f77240765b0 con 0x7f77100762d0 2024-05-10T08:42:37.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77100762d0 msgr2=0x7f7710078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77100762d0 0x7f7710078790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7724156990 tx=0x7f7718007b50 comp rx=0 tx=0).stop 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 msgr2=0x7f772414a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772414a6a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7714009890 tx=0x7f77140046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 shutdown_connections 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77100762d0 0x7f7710078790 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77240d0530 0x7f772409ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f772406fe30 0x7f77241f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 --2- 172.21.15.37:0/1805792802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772406f060 0x7f772414a6a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 >> 172.21.15.37:0/1805792802 conn(0x7f772406c3a0 msgr2=0x7f772415b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 shutdown_connections 2024-05-10T08:42:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:37.934+0000 7f772af7f640 1 -- 172.21.15.37:0/1805792802 wait complete. 2024-05-10T08:42:37.945 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-10T08:42:37.358451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223280,"kb_used_data":7068,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751440,"statfs":{"total":773094113280,"available":772865474560,"internally_reserved":0,"allocated":7237632,"data_stored":3864680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.837518"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543741+0000","last_change":"2024-05-10T08:42:33.552817+0000","last_active":"2024-05-10T08:42:34.543741+0000","last_peered":"2024-05-10T08:42:34.543741+0000","last_clean":"2024-05-10T08:42:34.543741+0000","last_became_active":"2024-05-10T08:42:33.552476+0000","last_became_peered":"2024-05-10T08:42:33.552476+0000","last_unstale":"2024-05-10T08:42:34.543741+0000","last_undegraded":"2024-05-10T08:42:34.543741+0000","last_fullsized":"2024-05-10T08:42:34.543741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:25.298303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543640+0000","last_change":"2024-05-10T08:42:33.557891+0000","last_active":"2024-05-10T08:42:34.543640+0000","last_peered":"2024-05-10T08:42:34.543640+0000","last_clean":"2024-05-10T08:42:34.543640+0000","last_became_active":"2024-05-10T08:42:33.557609+0000","last_became_peered":"2024-05-10T08:42:33.557609+0000","last_unstale":"2024-05-10T08:42:34.543640+0000","last_undegraded":"2024-05-10T08:42:34.543640+0000","last_fullsized":"2024-05-10T08:42:34.543640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:58.366302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541404+0000","last_change":"2024-05-10T08:42:33.569128+0000","last_active":"2024-05-10T08:42:34.541404+0000","last_peered":"2024-05-10T08:42:34.541404+0000","last_clean":"2024-05-10T08:42:34.541404+0000","last_became_active":"2024-05-10T08:42:33.568862+0000","last_became_peered":"2024-05-10T08:42:33.568862+0000","last_unstale":"2024-05-10T08:42:34.541404+0000","last_undegraded":"2024-05-10T08:42:34.541404+0000","last_fullsized":"2024-05-10T08:42:34.541404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:00.076642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539720+0000","last_change":"2024-05-10T08:42:33.557190+0000","last_active":"2024-05-10T08:42:34.539720+0000","last_peered":"2024-05-10T08:42:34.539720+0000","last_clean":"2024-05-10T08:42:34.539720+0000","last_became_active":"2024-05-10T08:42:33.556574+0000","last_became_peered":"2024-05-10T08:42:33.556574+0000","last_unstale":"2024-05-10T08:42:34.539720+0000","last_undegraded":"2024-05-10T08:42:34.539720+0000","last_fullsized":"2024-05-10T08:42:34.539720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:50.335634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542711+0000","last_change":"2024-05-10T08:42:33.560616+0000","last_active":"2024-05-10T08:42:34.542711+0000","last_peered":"2024-05-10T08:42:34.542711+0000","last_clean":"2024-05-10T08:42:34.542711+0000","last_became_active":"2024-05-10T08:42:33.559933+0000","last_became_peered":"2024-05-10T08:42:33.559933+0000","last_unstale":"2024-05-10T08:42:34.542711+0000","last_undegraded":"2024-05-10T08:42:34.542711+0000","last_fullsized":"2024-05-10T08:42:34.542711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:50.997274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542503+0000","last_change":"2024-05-10T08:42:33.562970+0000","last_active":"2024-05-10T08:42:34.542503+0000","last_peered":"2024-05-10T08:42:34.542503+0000","last_clean":"2024-05-10T08:42:34.542503+0000","last_became_active":"2024-05-10T08:42:33.562374+0000","last_became_peered":"2024-05-10T08:42:33.562374+0000","last_unstale":"2024-05-10T08:42:34.542503+0000","last_undegraded":"2024-05-10T08:42:34.542503+0000","last_fullsized":"2024-05-10T08:42:34.542503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:00:27.909987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541303+0000","last_change":"2024-05-10T08:42:33.559176+0000","last_active":"2024-05-10T08:42:34.541303+0000","last_peered":"2024-05-10T08:42:34.541303+0000","last_clean":"2024-05-10T08:42:34.541303+0000","last_became_active":"2024-05-10T08:42:33.558894+0000","last_became_peered":"2024-05-10T08:42:33.558894+0000","last_unstale":"2024-05-10T08:42:34.541303+0000","last_undegraded":"2024-05-10T08:42:34.541303+0000","last_fullsized":"2024-05-10T08:42:34.541303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:44.329696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542149+0000","last_change":"2024-05-10T08:42:33.558928+0000","last_active":"2024-05-10T08:42:34.542149+0000","last_peered":"2024-05-10T08:42:34.542149+0000","last_clean":"2024-05-10T08:42:34.542149+0000","last_became_active":"2024-05-10T08:42:33.558666+0000","last_became_peered":"2024-05-10T08:42:33.558666+0000","last_unstale":"2024-05-10T08:42:34.542149+0000","last_undegraded":"2024-05-10T08:42:34.542149+0000","last_fullsized":"2024-05-10T08:42:34.542149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:54.687741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541789+0000","last_change":"2024-05-10T08:42:33.573403+0000","last_active":"2024-05-10T08:42:34.541789+0000","last_peered":"2024-05-10T08:42:34.541789+0000","last_clean":"2024-05-10T08:42:34.541789+0000","last_became_active":"2024-05-10T08:42:33.572814+0000","last_became_peered":"2024-05-10T08:42:33.572814+0000","last_unstale":"2024-05-10T08:42:34.541789+0000","last_undegraded":"2024-05-10T08:42:34.541789+0000","last_fullsized":"2024-05-10T08:42:34.541789+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:45:17.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541925+0000","last_change":"2024-05-10T08:42:33.568665+0000","last_active":"2024-05-10T08:42:34.541925+0000","last_peered":"2024-05-10T08:42:34.541925+0000","last_clean":"2024-05-10T08:42:34.541925+0000","last_became_active":"2024-05-10T08:42:33.568379+0000","last_became_peered":"2024-05-10T08:42:33.568379+0000","last_unstale":"2024-05-10T08:42:34.541925+0000","last_undegraded":"2024-05-10T08:42:34.541925+0000","last_fullsized":"2024-05-10T08:42:34.541925+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:52.908172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539278+0000","last_change":"2024-05-10T08:42:33.551336+0000","last_active":"2024-05-10T08:42:34.539278+0000","last_peered":"2024-05-10T08:42:34.539278+0000","last_clean":"2024-05-10T08:42:34.539278+0000","last_became_active":"2024-05-10T08:42:33.550001+0000","last_became_peered":"2024-05-10T08:42:33.550001+0000","last_unstale":"2024-05-10T08:42:34.539278+0000","last_undegraded":"2024-05-10T08:42:34.539278+0000","last_fullsized":"2024-05-10T08:42:34.539278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:14.154558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542271+0000","last_change":"2024-05-10T08:42:33.559270+0000","last_active":"2024-05-10T08:42:34.542271+0000","last_peered":"2024-05-10T08:42:34.542271+0000","last_clean":"2024-05-10T08:42:34.542271+0000","last_became_active":"2024-05-10T08:42:33.558249+0000","last_became_peered":"2024-05-10T08:42:33.558249+0000","last_unstale":"2024-05-10T08:42:34.542271+0000","last_undegraded":"2024-05-10T08:42:34.542271+0000","last_fullsized":"2024-05-10T08:42:34.542271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:01.360451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542753+0000","last_change":"2024-05-10T08:42:33.567532+0000","last_active":"2024-05-10T08:42:34.542753+0000","last_peered":"2024-05-10T08:42:34.542753+0000","last_clean":"2024-05-10T08:42:34.542753+0000","last_became_active":"2024-05-10T08:42:33.567268+0000","last_became_peered":"2024-05-10T08:42:33.567268+0000","last_unstale":"2024-05-10T08:42:34.542753+0000","last_undegraded":"2024-05-10T08:42:34.542753+0000","last_fullsized":"2024-05-10T08:42:34.542753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:51.850101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541151+0000","last_change":"2024-05-10T08:42:33.568485+0000","last_active":"2024-05-10T08:42:34.541151+0000","last_peered":"2024-05-10T08:42:34.541151+0000","last_clean":"2024-05-10T08:42:34.541151+0000","last_became_active":"2024-05-10T08:42:33.568204+0000","last_became_peered":"2024-05-10T08:42:33.568204+0000","last_unstale":"2024-05-10T08:42:34.541151+0000","last_undegraded":"2024-05-10T08:42:34.541151+0000","last_fullsized":"2024-05-10T08:42:34.541151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:04.786975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540659+0000","last_change":"2024-05-10T08:42:33.567251+0000","last_active":"2024-05-10T08:42:34.540659+0000","last_peered":"2024-05-10T08:42:34.540659+0000","last_clean":"2024-05-10T08:42:34.540659+0000","last_became_active":"2024-05-10T08:42:33.566971+0000","last_became_peered":"2024-05-10T08:42:33.566971+0000","last_unstale":"2024-05-10T08:42:34.540659+0000","last_undegraded":"2024-05-10T08:42:34.540659+0000","last_fullsized":"2024-05-10T08:42:34.540659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:04.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541031+0000","last_change":"2024-05-10T08:42:33.554902+0000","last_active":"2024-05-10T08:42:34.541031+0000","last_peered":"2024-05-10T08:42:34.541031+0000","last_clean":"2024-05-10T08:42:34.541031+0000","last_became_active":"2024-05-10T08:42:33.554511+0000","last_became_peered":"2024-05-10T08:42:33.554511+0000","last_unstale":"2024-05-10T08:42:34.541031+0000","last_undegraded":"2024-05-10T08:42:34.541031+0000","last_fullsized":"2024-05-10T08:42:34.541031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:14.437238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543804+0000","last_change":"2024-05-10T08:42:33.552450+0000","last_active":"2024-05-10T08:42:34.543804+0000","last_peered":"2024-05-10T08:42:34.543804+0000","last_clean":"2024-05-10T08:42:34.543804+0000","last_became_active":"2024-05-10T08:42:33.552102+0000","last_became_peered":"2024-05-10T08:42:33.552102+0000","last_unstale":"2024-05-10T08:42:34.543804+0000","last_undegraded":"2024-05-10T08:42:34.543804+0000","last_fullsized":"2024-05-10T08:42:34.543804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:48.007530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539389+0000","last_change":"2024-05-10T08:42:33.560821+0000","last_active":"2024-05-10T08:42:34.539389+0000","last_peered":"2024-05-10T08:42:34.539389+0000","last_clean":"2024-05-10T08:42:34.539389+0000","last_became_active":"2024-05-10T08:42:33.559496+0000","last_became_peered":"2024-05-10T08:42:33.559496+0000","last_unstale":"2024-05-10T08:42:34.539389+0000","last_undegraded":"2024-05-10T08:42:34.539389+0000","last_fullsized":"2024-05-10T08:42:34.539389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:39.995960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542819+0000","last_change":"2024-05-10T08:42:33.562031+0000","last_active":"2024-05-10T08:42:34.542819+0000","last_peered":"2024-05-10T08:42:34.542819+0000","last_clean":"2024-05-10T08:42:34.542819+0000","last_became_active":"2024-05-10T08:42:33.561744+0000","last_became_peered":"2024-05-10T08:42:33.561744+0000","last_unstale":"2024-05-10T08:42:34.542819+0000","last_undegraded":"2024-05-10T08:42:34.542819+0000","last_fullsized":"2024-05-10T08:42:34.542819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:00.854327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542724+0000","last_change":"2024-05-10T08:42:33.558048+0000","last_active":"2024-05-10T08:42:34.542724+0000","last_peered":"2024-05-10T08:42:34.542724+0000","last_clean":"2024-05-10T08:42:34.542724+0000","last_became_active":"2024-05-10T08:42:33.557752+0000","last_became_peered":"2024-05-10T08:42:33.557752+0000","last_unstale":"2024-05-10T08:42:34.542724+0000","last_undegraded":"2024-05-10T08:42:34.542724+0000","last_fullsized":"2024-05-10T08:42:34.542724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:14:10.166269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542569+0000","last_change":"2024-05-10T08:42:33.566688+0000","last_active":"2024-05-10T08:42:34.542569+0000","last_peered":"2024-05-10T08:42:34.542569+0000","last_clean":"2024-05-10T08:42:34.542569+0000","last_became_active":"2024-05-10T08:42:33.566352+0000","last_became_peered":"2024-05-10T08:42:33.566352+0000","last_unstale":"2024-05-10T08:42:34.542569+0000","last_undegraded":"2024-05-10T08:42:34.542569+0000","last_fullsized":"2024-05-10T08:42:34.542569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:04.786975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542177+0000","last_change":"2024-05-10T08:42:33.561755+0000","last_active":"2024-05-10T08:42:34.542177+0000","last_peered":"2024-05-10T08:42:34.542177+0000","last_clean":"2024-05-10T08:42:34.542177+0000","last_became_active":"2024-05-10T08:42:33.560516+0000","last_became_peered":"2024-05-10T08:42:33.560516+0000","last_unstale":"2024-05-10T08:42:34.542177+0000","last_undegraded":"2024-05-10T08:42:34.542177+0000","last_fullsized":"2024-05-10T08:42:34.542177+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:37.843959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542231+0000","last_change":"2024-05-10T08:42:33.557013+0000","last_active":"2024-05-10T08:42:34.542231+0000","last_peered":"2024-05-10T08:42:34.542231+0000","last_clean":"2024-05-10T08:42:34.542231+0000","last_became_active":"2024-05-10T08:42:33.556699+0000","last_became_peered":"2024-05-10T08:42:33.556699+0000","last_unstale":"2024-05-10T08:42:34.542231+0000","last_undegraded":"2024-05-10T08:42:34.542231+0000","last_fullsized":"2024-05-10T08:42:34.542231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:17.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540287+0000","last_change":"2024-05-10T08:42:33.565706+0000","last_active":"2024-05-10T08:42:34.540287+0000","last_peered":"2024-05-10T08:42:34.540287+0000","last_clean":"2024-05-10T08:42:34.540287+0000","last_became_active":"2024-05-10T08:42:33.565196+0000","last_became_peered":"2024-05-10T08:42:33.565196+0000","last_unstale":"2024-05-10T08:42:34.540287+0000","last_undegraded":"2024-05-10T08:42:34.540287+0000","last_fullsized":"2024-05-10T08:42:34.540287+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:20.550671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542924+0000","last_change":"2024-05-10T08:42:33.562491+0000","last_active":"2024-05-10T08:42:34.542924+0000","last_peered":"2024-05-10T08:42:34.542924+0000","last_clean":"2024-05-10T08:42:34.542924+0000","last_became_active":"2024-05-10T08:42:33.562191+0000","last_became_peered":"2024-05-10T08:42:33.562191+0000","last_unstale":"2024-05-10T08:42:34.542924+0000","last_undegraded":"2024-05-10T08:42:34.542924+0000","last_fullsized":"2024-05-10T08:42:34.542924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542778+0000","last_change":"2024-05-10T08:42:33.562273+0000","last_active":"2024-05-10T08:42:34.542778+0000","last_peered":"2024-05-10T08:42:34.542778+0000","last_clean":"2024-05-10T08:42:34.542778+0000","last_became_active":"2024-05-10T08:42:33.562010+0000","last_became_peered":"2024-05-10T08:42:33.562010+0000","last_unstale":"2024-05-10T08:42:34.542778+0000","last_undegraded":"2024-05-10T08:42:34.542778+0000","last_fullsized":"2024-05-10T08:42:34.542778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:00.076642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539168+0000","last_change":"2024-05-10T08:42:33.551125+0000","last_active":"2024-05-10T08:42:34.539168+0000","last_peered":"2024-05-10T08:42:34.539168+0000","last_clean":"2024-05-10T08:42:34.539168+0000","last_became_active":"2024-05-10T08:42:33.550361+0000","last_became_peered":"2024-05-10T08:42:33.550361+0000","last_unstale":"2024-05-10T08:42:34.539168+0000","last_undegraded":"2024-05-10T08:42:34.539168+0000","last_fullsized":"2024-05-10T08:42:34.539168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:50.170482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543954+0000","last_change":"2024-05-10T08:42:33.564413+0000","last_active":"2024-05-10T08:42:34.543954+0000","last_peered":"2024-05-10T08:42:34.543954+0000","last_clean":"2024-05-10T08:42:34.543954+0000","last_became_active":"2024-05-10T08:42:33.564111+0000","last_became_peered":"2024-05-10T08:42:33.564111+0000","last_unstale":"2024-05-10T08:42:34.543954+0000","last_undegraded":"2024-05-10T08:42:34.543954+0000","last_fullsized":"2024-05-10T08:42:34.543954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:38.634065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541351+0000","last_change":"2024-05-10T08:42:33.572566+0000","last_active":"2024-05-10T08:42:34.541351+0000","last_peered":"2024-05-10T08:42:34.541351+0000","last_clean":"2024-05-10T08:42:34.541351+0000","last_became_active":"2024-05-10T08:42:33.572241+0000","last_became_peered":"2024-05-10T08:42:33.572241+0000","last_unstale":"2024-05-10T08:42:34.541351+0000","last_undegraded":"2024-05-10T08:42:34.541351+0000","last_fullsized":"2024-05-10T08:42:34.541351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:51.850101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542318+0000","last_change":"2024-05-10T08:42:33.561478+0000","last_active":"2024-05-10T08:42:34.542318+0000","last_peered":"2024-05-10T08:42:34.542318+0000","last_clean":"2024-05-10T08:42:34.542318+0000","last_became_active":"2024-05-10T08:42:33.561177+0000","last_became_peered":"2024-05-10T08:42:33.561177+0000","last_unstale":"2024-05-10T08:42:34.542318+0000","last_undegraded":"2024-05-10T08:42:34.542318+0000","last_fullsized":"2024-05-10T08:42:34.542318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:20.550671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.538974+0000","last_change":"2024-05-10T08:42:33.550890+0000","last_active":"2024-05-10T08:42:34.538974+0000","last_peered":"2024-05-10T08:42:34.538974+0000","last_clean":"2024-05-10T08:42:34.538974+0000","last_became_active":"2024-05-10T08:42:33.550614+0000","last_became_peered":"2024-05-10T08:42:33.550614+0000","last_unstale":"2024-05-10T08:42:34.538974+0000","last_undegraded":"2024-05-10T08:42:34.538974+0000","last_fullsized":"2024-05-10T08:42:34.538974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:10.550677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542436+0000","last_change":"2024-05-10T08:42:33.562006+0000","last_active":"2024-05-10T08:42:34.542436+0000","last_peered":"2024-05-10T08:42:34.542436+0000","last_clean":"2024-05-10T08:42:34.542436+0000","last_became_active":"2024-05-10T08:42:33.561570+0000","last_became_peered":"2024-05-10T08:42:33.561570+0000","last_unstale":"2024-05-10T08:42:34.542436+0000","last_undegraded":"2024-05-10T08:42:34.542436+0000","last_fullsized":"2024-05-10T08:42:34.542436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:51.975687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542884+0000","last_change":"2024-05-10T08:42:33.568398+0000","last_active":"2024-05-10T08:42:34.542884+0000","last_peered":"2024-05-10T08:42:34.542884+0000","last_clean":"2024-05-10T08:42:34.542884+0000","last_became_active":"2024-05-10T08:42:33.568099+0000","last_became_peered":"2024-05-10T08:42:33.568099+0000","last_unstale":"2024-05-10T08:42:34.542884+0000","last_undegraded":"2024-05-10T08:42:34.542884+0000","last_fullsized":"2024-05-10T08:42:34.542884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:31:46.827128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543801+0000","last_change":"2024-05-10T08:42:32.544326+0000","last_active":"2024-05-10T08:42:34.543801+0000","last_peered":"2024-05-10T08:42:34.543801+0000","last_clean":"2024-05-10T08:42:34.543801+0000","last_became_active":"2024-05-10T08:42:32.544054+0000","last_became_peered":"2024-05-10T08:42:32.544054+0000","last_unstale":"2024-05-10T08:42:34.543801+0000","last_undegraded":"2024-05-10T08:42:34.543801+0000","last_fullsized":"2024-05-10T08:42:34.543801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:06.516972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539474+0000","last_change":"2024-05-10T08:42:33.554684+0000","last_active":"2024-05-10T08:42:34.539474+0000","last_peered":"2024-05-10T08:42:34.539474+0000","last_clean":"2024-05-10T08:42:34.539474+0000","last_became_active":"2024-05-10T08:42:33.554410+0000","last_became_peered":"2024-05-10T08:42:33.554410+0000","last_unstale":"2024-05-10T08:42:34.539474+0000","last_undegraded":"2024-05-10T08:42:34.539474+0000","last_fullsized":"2024-05-10T08:42:34.539474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:58.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542587+0000","last_change":"2024-05-10T08:42:32.545628+0000","last_active":"2024-05-10T08:42:34.542587+0000","last_peered":"2024-05-10T08:42:34.542587+0000","last_clean":"2024-05-10T08:42:34.542587+0000","last_became_active":"2024-05-10T08:42:32.545327+0000","last_became_peered":"2024-05-10T08:42:32.545327+0000","last_unstale":"2024-05-10T08:42:34.542587+0000","last_undegraded":"2024-05-10T08:42:34.542587+0000","last_fullsized":"2024-05-10T08:42:34.542587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:03.781984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542418+0000","last_change":"2024-05-10T08:42:33.567471+0000","last_active":"2024-05-10T08:42:34.542418+0000","last_peered":"2024-05-10T08:42:34.542418+0000","last_clean":"2024-05-10T08:42:34.542418+0000","last_became_active":"2024-05-10T08:42:33.567141+0000","last_became_peered":"2024-05-10T08:42:33.567141+0000","last_unstale":"2024-05-10T08:42:34.542418+0000","last_undegraded":"2024-05-10T08:42:34.542418+0000","last_fullsized":"2024-05-10T08:42:34.542418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:02.079428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543024+0000","last_change":"2024-05-10T08:42:32.545554+0000","last_active":"2024-05-10T08:42:34.543024+0000","last_peered":"2024-05-10T08:42:34.543024+0000","last_clean":"2024-05-10T08:42:34.543024+0000","last_became_active":"2024-05-10T08:42:32.545129+0000","last_became_peered":"2024-05-10T08:42:32.545129+0000","last_unstale":"2024-05-10T08:42:34.543024+0000","last_undegraded":"2024-05-10T08:42:34.543024+0000","last_fullsized":"2024-05-10T08:42:34.543024+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:44.831086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541543+0000","last_change":"2024-05-10T08:42:33.568200+0000","last_active":"2024-05-10T08:42:34.541543+0000","last_peered":"2024-05-10T08:42:34.541543+0000","last_clean":"2024-05-10T08:42:34.541543+0000","last_became_active":"2024-05-10T08:42:33.567901+0000","last_became_peered":"2024-05-10T08:42:33.567901+0000","last_unstale":"2024-05-10T08:42:34.541543+0000","last_undegraded":"2024-05-10T08:42:34.541543+0000","last_fullsized":"2024-05-10T08:42:34.541543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:42.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542882+0000","last_change":"2024-05-10T08:42:32.540666+0000","last_active":"2024-05-10T08:42:34.542882+0000","last_peered":"2024-05-10T08:42:34.542882+0000","last_clean":"2024-05-10T08:42:34.542882+0000","last_became_active":"2024-05-10T08:42:32.540319+0000","last_became_peered":"2024-05-10T08:42:32.540319+0000","last_unstale":"2024-05-10T08:42:34.542882+0000","last_undegraded":"2024-05-10T08:42:34.542882+0000","last_fullsized":"2024-05-10T08:42:34.542882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:46:50.845111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541171+0000","last_change":"2024-05-10T08:42:33.547893+0000","last_active":"2024-05-10T08:42:34.541171+0000","last_peered":"2024-05-10T08:42:34.541171+0000","last_clean":"2024-05-10T08:42:34.541171+0000","last_became_active":"2024-05-10T08:42:33.547603+0000","last_became_peered":"2024-05-10T08:42:33.547603+0000","last_unstale":"2024-05-10T08:42:34.541171+0000","last_undegraded":"2024-05-10T08:42:34.541171+0000","last_fullsized":"2024-05-10T08:42:34.541171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:51.702867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542574+0000","last_change":"2024-05-10T08:42:32.537360+0000","last_active":"2024-05-10T08:42:34.542574+0000","last_peered":"2024-05-10T08:42:34.542574+0000","last_clean":"2024-05-10T08:42:34.542574+0000","last_became_active":"2024-05-10T08:42:32.537040+0000","last_became_peered":"2024-05-10T08:42:32.537040+0000","last_unstale":"2024-05-10T08:42:34.542574+0000","last_undegraded":"2024-05-10T08:42:34.542574+0000","last_fullsized":"2024-05-10T08:42:34.542574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:12:44.720503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543436+0000","last_change":"2024-05-10T08:42:33.546292+0000","last_active":"2024-05-10T08:42:34.543436+0000","last_peered":"2024-05-10T08:42:34.543436+0000","last_clean":"2024-05-10T08:42:34.543436+0000","last_became_active":"2024-05-10T08:42:33.545714+0000","last_became_peered":"2024-05-10T08:42:33.545714+0000","last_unstale":"2024-05-10T08:42:34.543436+0000","last_undegraded":"2024-05-10T08:42:34.543436+0000","last_fullsized":"2024-05-10T08:42:34.543436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:31:46.827128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542102+0000","last_change":"2024-05-10T08:42:32.536884+0000","last_active":"2024-05-10T08:42:34.542102+0000","last_peered":"2024-05-10T08:42:34.542102+0000","last_clean":"2024-05-10T08:42:34.542102+0000","last_became_active":"2024-05-10T08:42:32.536552+0000","last_became_peered":"2024-05-10T08:42:32.536552+0000","last_unstale":"2024-05-10T08:42:34.542102+0000","last_undegraded":"2024-05-10T08:42:34.542102+0000","last_fullsized":"2024-05-10T08:42:34.542102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:51.903182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542279+0000","last_change":"2024-05-10T08:42:33.560315+0000","last_active":"2024-05-10T08:42:34.542279+0000","last_peered":"2024-05-10T08:42:34.542279+0000","last_clean":"2024-05-10T08:42:34.542279+0000","last_became_active":"2024-05-10T08:42:33.559817+0000","last_became_peered":"2024-05-10T08:42:33.559817+0000","last_unstale":"2024-05-10T08:42:34.542279+0000","last_undegraded":"2024-05-10T08:42:34.542279+0000","last_fullsized":"2024-05-10T08:42:34.542279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:07.521962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542325+0000","last_change":"2024-05-10T08:42:32.544317+0000","last_active":"2024-05-10T08:42:34.542325+0000","last_peered":"2024-05-10T08:42:34.542325+0000","last_clean":"2024-05-10T08:42:34.542325+0000","last_became_active":"2024-05-10T08:42:32.543949+0000","last_became_peered":"2024-05-10T08:42:32.543949+0000","last_unstale":"2024-05-10T08:42:34.542325+0000","last_undegraded":"2024-05-10T08:42:34.542325+0000","last_fullsized":"2024-05-10T08:42:34.542325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:50.970696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542475+0000","last_change":"2024-05-10T08:42:33.555915+0000","last_active":"2024-05-10T08:42:34.542475+0000","last_peered":"2024-05-10T08:42:34.542475+0000","last_clean":"2024-05-10T08:42:34.542475+0000","last_became_active":"2024-05-10T08:42:33.555550+0000","last_became_peered":"2024-05-10T08:42:33.555550+0000","last_unstale":"2024-05-10T08:42:34.542475+0000","last_undegraded":"2024-05-10T08:42:34.542475+0000","last_fullsized":"2024-05-10T08:42:34.542475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:30.873764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542330+0000","last_change":"2024-05-10T08:42:32.550349+0000","last_active":"2024-05-10T08:42:34.542330+0000","last_peered":"2024-05-10T08:42:34.542330+0000","last_clean":"2024-05-10T08:42:34.542330+0000","last_became_active":"2024-05-10T08:42:32.550070+0000","last_became_peered":"2024-05-10T08:42:32.550070+0000","last_unstale":"2024-05-10T08:42:34.542330+0000","last_undegraded":"2024-05-10T08:42:34.542330+0000","last_fullsized":"2024-05-10T08:42:34.542330+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:44:38.717168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543984+0000","last_change":"2024-05-10T08:42:33.549255+0000","last_active":"2024-05-10T08:42:34.543984+0000","last_peered":"2024-05-10T08:42:34.543984+0000","last_clean":"2024-05-10T08:42:34.543984+0000","last_became_active":"2024-05-10T08:42:33.548962+0000","last_became_peered":"2024-05-10T08:42:33.548962+0000","last_unstale":"2024-05-10T08:42:34.543984+0000","last_undegraded":"2024-05-10T08:42:34.543984+0000","last_fullsized":"2024-05-10T08:42:34.543984+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:22.370832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541840+0000","last_change":"2024-05-10T08:42:32.546667+0000","last_active":"2024-05-10T08:42:34.541840+0000","last_peered":"2024-05-10T08:42:34.541840+0000","last_clean":"2024-05-10T08:42:34.541840+0000","last_became_active":"2024-05-10T08:42:32.546343+0000","last_became_peered":"2024-05-10T08:42:32.546343+0000","last_unstale":"2024-05-10T08:42:34.541840+0000","last_undegraded":"2024-05-10T08:42:34.541840+0000","last_fullsized":"2024-05-10T08:42:34.541840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:31:45.822138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542717+0000","last_change":"2024-05-10T08:42:33.555824+0000","last_active":"2024-05-10T08:42:34.542717+0000","last_peered":"2024-05-10T08:42:34.542717+0000","last_clean":"2024-05-10T08:42:34.542717+0000","last_became_active":"2024-05-10T08:42:33.555462+0000","last_became_peered":"2024-05-10T08:42:33.555462+0000","last_unstale":"2024-05-10T08:42:34.542717+0000","last_undegraded":"2024-05-10T08:42:34.542717+0000","last_fullsized":"2024-05-10T08:42:34.542717+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:03.690092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539605+0000","last_change":"2024-05-10T08:42:32.548492+0000","last_active":"2024-05-10T08:42:34.539605+0000","last_peered":"2024-05-10T08:42:34.539605+0000","last_clean":"2024-05-10T08:42:34.539605+0000","last_became_active":"2024-05-10T08:42:32.548168+0000","last_became_peered":"2024-05-10T08:42:32.548168+0000","last_unstale":"2024-05-10T08:42:34.539605+0000","last_undegraded":"2024-05-10T08:42:34.539605+0000","last_fullsized":"2024-05-10T08:42:34.539605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:05.334087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542739+0000","last_change":"2024-05-10T08:42:33.559970+0000","last_active":"2024-05-10T08:42:34.542739+0000","last_peered":"2024-05-10T08:42:34.542739+0000","last_clean":"2024-05-10T08:42:34.542739+0000","last_became_active":"2024-05-10T08:42:33.559681+0000","last_became_peered":"2024-05-10T08:42:33.559681+0000","last_unstale":"2024-05-10T08:42:34.542739+0000","last_undegraded":"2024-05-10T08:42:34.542739+0000","last_fullsized":"2024-05-10T08:42:34.542739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:35.724065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541525+0000","last_change":"2024-05-10T08:42:32.546819+0000","last_active":"2024-05-10T08:42:34.541525+0000","last_peered":"2024-05-10T08:42:34.541525+0000","last_clean":"2024-05-10T08:42:34.541525+0000","last_became_active":"2024-05-10T08:42:32.546549+0000","last_became_peered":"2024-05-10T08:42:32.546549+0000","last_unstale":"2024-05-10T08:42:34.541525+0000","last_undegraded":"2024-05-10T08:42:34.541525+0000","last_fullsized":"2024-05-10T08:42:34.541525+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:49.992284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539378+0000","last_change":"2024-05-10T08:42:33.545050+0000","last_active":"2024-05-10T08:42:34.539378+0000","last_peered":"2024-05-10T08:42:34.539378+0000","last_clean":"2024-05-10T08:42:34.539378+0000","last_became_active":"2024-05-10T08:42:33.544573+0000","last_became_peered":"2024-05-10T08:42:33.544573+0000","last_unstale":"2024-05-10T08:42:34.539378+0000","last_undegraded":"2024-05-10T08:42:34.539378+0000","last_fullsized":"2024-05-10T08:42:34.539378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:27:07.521962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.544058+0000","last_change":"2024-05-10T08:42:32.551626+0000","last_active":"2024-05-10T08:42:34.544058+0000","last_peered":"2024-05-10T08:42:34.544058+0000","last_clean":"2024-05-10T08:42:34.544058+0000","last_became_active":"2024-05-10T08:42:32.551418+0000","last_became_peered":"2024-05-10T08:42:32.551418+0000","last_unstale":"2024-05-10T08:42:34.544058+0000","last_undegraded":"2024-05-10T08:42:34.544058+0000","last_fullsized":"2024-05-10T08:42:34.544058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:00.110054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539145+0000","last_change":"2024-05-10T08:42:33.556195+0000","last_active":"2024-05-10T08:42:34.539145+0000","last_peered":"2024-05-10T08:42:34.539145+0000","last_clean":"2024-05-10T08:42:34.539145+0000","last_became_active":"2024-05-10T08:42:33.555921+0000","last_became_peered":"2024-05-10T08:42:33.555921+0000","last_unstale":"2024-05-10T08:42:34.539145+0000","last_undegraded":"2024-05-10T08:42:34.539145+0000","last_fullsized":"2024-05-10T08:42:34.539145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:42.610815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541507+0000","last_change":"2024-05-10T08:42:32.549639+0000","last_active":"2024-05-10T08:42:34.541507+0000","last_peered":"2024-05-10T08:42:34.541507+0000","last_clean":"2024-05-10T08:42:34.541507+0000","last_became_active":"2024-05-10T08:42:32.549360+0000","last_became_peered":"2024-05-10T08:42:32.549360+0000","last_unstale":"2024-05-10T08:42:34.541507+0000","last_undegraded":"2024-05-10T08:42:34.541507+0000","last_fullsized":"2024-05-10T08:42:34.541507+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:34.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542182+0000","last_change":"2024-05-10T08:42:33.555196+0000","last_active":"2024-05-10T08:42:34.542182+0000","last_peered":"2024-05-10T08:42:34.542182+0000","last_clean":"2024-05-10T08:42:34.542182+0000","last_became_active":"2024-05-10T08:42:33.554926+0000","last_became_peered":"2024-05-10T08:42:33.554926+0000","last_unstale":"2024-05-10T08:42:34.542182+0000","last_undegraded":"2024-05-10T08:42:34.542182+0000","last_fullsized":"2024-05-10T08:42:34.542182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:45.836076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542409+0000","last_change":"2024-05-10T08:42:32.544563+0000","last_active":"2024-05-10T08:42:34.542409+0000","last_peered":"2024-05-10T08:42:34.542409+0000","last_clean":"2024-05-10T08:42:34.542409+0000","last_became_active":"2024-05-10T08:42:32.544302+0000","last_became_peered":"2024-05-10T08:42:32.544302+0000","last_unstale":"2024-05-10T08:42:34.542409+0000","last_undegraded":"2024-05-10T08:42:34.542409+0000","last_fullsized":"2024-05-10T08:42:34.542409+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:34.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542483+0000","last_change":"2024-05-10T08:42:33.562747+0000","last_active":"2024-05-10T08:42:34.542483+0000","last_peered":"2024-05-10T08:42:34.542483+0000","last_clean":"2024-05-10T08:42:34.542483+0000","last_became_active":"2024-05-10T08:42:33.562235+0000","last_became_peered":"2024-05-10T08:42:33.562235+0000","last_unstale":"2024-05-10T08:42:34.542483+0000","last_undegraded":"2024-05-10T08:42:34.542483+0000","last_fullsized":"2024-05-10T08:42:34.542483+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:58.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540776+0000","last_change":"2024-05-10T08:42:32.545520+0000","last_active":"2024-05-10T08:42:34.540776+0000","last_peered":"2024-05-10T08:42:34.540776+0000","last_clean":"2024-05-10T08:42:34.540776+0000","last_became_active":"2024-05-10T08:42:32.545263+0000","last_became_peered":"2024-05-10T08:42:32.545263+0000","last_unstale":"2024-05-10T08:42:34.540776+0000","last_undegraded":"2024-05-10T08:42:34.540776+0000","last_fullsized":"2024-05-10T08:42:34.540776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:49.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543537+0000","last_change":"2024-05-10T08:42:33.556267+0000","last_active":"2024-05-10T08:42:34.543537+0000","last_peered":"2024-05-10T08:42:34.543537+0000","last_clean":"2024-05-10T08:42:34.543537+0000","last_became_active":"2024-05-10T08:42:33.555963+0000","last_became_peered":"2024-05-10T08:42:33.555963+0000","last_unstale":"2024-05-10T08:42:34.543537+0000","last_undegraded":"2024-05-10T08:42:34.543537+0000","last_fullsized":"2024-05-10T08:42:34.543537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:14.188620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539280+0000","last_change":"2024-05-10T08:42:32.548471+0000","last_active":"2024-05-10T08:42:34.539280+0000","last_peered":"2024-05-10T08:42:34.539280+0000","last_clean":"2024-05-10T08:42:34.539280+0000","last_became_active":"2024-05-10T08:42:32.548219+0000","last_became_peered":"2024-05-10T08:42:32.548219+0000","last_unstale":"2024-05-10T08:42:34.539280+0000","last_undegraded":"2024-05-10T08:42:34.539280+0000","last_fullsized":"2024-05-10T08:42:34.539280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:50.912769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541581+0000","last_change":"2024-05-10T08:42:33.573176+0000","last_active":"2024-05-10T08:42:34.541581+0000","last_peered":"2024-05-10T08:42:34.541581+0000","last_clean":"2024-05-10T08:42:34.541581+0000","last_became_active":"2024-05-10T08:42:33.572801+0000","last_became_peered":"2024-05-10T08:42:33.572801+0000","last_unstale":"2024-05-10T08:42:34.541581+0000","last_undegraded":"2024-05-10T08:42:34.541581+0000","last_fullsized":"2024-05-10T08:42:34.541581+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:33.484512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543015+0000","last_change":"2024-05-10T08:42:32.544221+0000","last_active":"2024-05-10T08:42:34.543015+0000","last_peered":"2024-05-10T08:42:34.543015+0000","last_clean":"2024-05-10T08:42:34.543015+0000","last_became_active":"2024-05-10T08:42:32.543937+0000","last_became_peered":"2024-05-10T08:42:32.543937+0000","last_unstale":"2024-05-10T08:42:34.543015+0000","last_undegraded":"2024-05-10T08:42:34.543015+0000","last_fullsized":"2024-05-10T08:42:34.543015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:57.206706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542980+0000","last_change":"2024-05-10T08:42:33.556837+0000","last_active":"2024-05-10T08:42:34.542980+0000","last_peered":"2024-05-10T08:42:34.542980+0000","last_clean":"2024-05-10T08:42:34.542980+0000","last_became_active":"2024-05-10T08:42:33.556321+0000","last_became_peered":"2024-05-10T08:42:33.556321+0000","last_unstale":"2024-05-10T08:42:34.542980+0000","last_undegraded":"2024-05-10T08:42:34.542980+0000","last_fullsized":"2024-05-10T08:42:34.542980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:05.900691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541869+0000","last_change":"2024-05-10T08:42:32.549486+0000","last_active":"2024-05-10T08:42:34.541869+0000","last_peered":"2024-05-10T08:42:34.541869+0000","last_clean":"2024-05-10T08:42:34.541869+0000","last_became_active":"2024-05-10T08:42:32.548966+0000","last_became_peered":"2024-05-10T08:42:32.548966+0000","last_unstale":"2024-05-10T08:42:34.541869+0000","last_undegraded":"2024-05-10T08:42:34.541869+0000","last_fullsized":"2024-05-10T08:42:34.541869+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:47.490421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539310+0000","last_change":"2024-05-10T08:42:33.554598+0000","last_active":"2024-05-10T08:42:34.539310+0000","last_peered":"2024-05-10T08:42:34.539310+0000","last_clean":"2024-05-10T08:42:34.539310+0000","last_became_active":"2024-05-10T08:42:33.554297+0000","last_became_peered":"2024-05-10T08:42:33.554297+0000","last_unstale":"2024-05-10T08:42:34.539310+0000","last_undegraded":"2024-05-10T08:42:34.539310+0000","last_fullsized":"2024-05-10T08:42:34.539310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:06.768858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541708+0000","last_change":"2024-05-10T08:42:32.547083+0000","last_active":"2024-05-10T08:42:34.541708+0000","last_peered":"2024-05-10T08:42:34.541708+0000","last_clean":"2024-05-10T08:42:34.541708+0000","last_became_active":"2024-05-10T08:42:32.546838+0000","last_became_peered":"2024-05-10T08:42:32.546838+0000","last_unstale":"2024-05-10T08:42:34.541708+0000","last_undegraded":"2024-05-10T08:42:34.541708+0000","last_fullsized":"2024-05-10T08:42:34.541708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:09.326682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542817+0000","last_change":"2024-05-10T08:42:33.557719+0000","last_active":"2024-05-10T08:42:34.542817+0000","last_peered":"2024-05-10T08:42:34.542817+0000","last_clean":"2024-05-10T08:42:34.542817+0000","last_became_active":"2024-05-10T08:42:33.557453+0000","last_became_peered":"2024-05-10T08:42:33.557453+0000","last_unstale":"2024-05-10T08:42:34.542817+0000","last_undegraded":"2024-05-10T08:42:34.542817+0000","last_fullsized":"2024-05-10T08:42:34.542817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:19:48.495411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542768+0000","last_change":"2024-05-10T08:42:32.548942+0000","last_active":"2024-05-10T08:42:34.542768+0000","last_peered":"2024-05-10T08:42:34.542768+0000","last_clean":"2024-05-10T08:42:34.542768+0000","last_became_active":"2024-05-10T08:42:32.548647+0000","last_became_peered":"2024-05-10T08:42:32.548647+0000","last_unstale":"2024-05-10T08:42:34.542768+0000","last_undegraded":"2024-05-10T08:42:34.542768+0000","last_fullsized":"2024-05-10T08:42:34.542768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:00:26.904996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542583+0000","last_change":"2024-05-10T08:42:33.561737+0000","last_active":"2024-05-10T08:42:34.542583+0000","last_peered":"2024-05-10T08:42:34.542583+0000","last_clean":"2024-05-10T08:42:34.542583+0000","last_became_active":"2024-05-10T08:42:33.561442+0000","last_became_peered":"2024-05-10T08:42:33.561442+0000","last_unstale":"2024-05-10T08:42:34.542583+0000","last_undegraded":"2024-05-10T08:42:34.542583+0000","last_fullsized":"2024-05-10T08:42:34.542583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:09.555221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542065+0000","last_change":"2024-05-10T08:42:32.547683+0000","last_active":"2024-05-10T08:42:34.542065+0000","last_peered":"2024-05-10T08:42:34.542065+0000","last_clean":"2024-05-10T08:42:34.542065+0000","last_became_active":"2024-05-10T08:42:32.547312+0000","last_became_peered":"2024-05-10T08:42:32.547312+0000","last_unstale":"2024-05-10T08:42:34.542065+0000","last_undegraded":"2024-05-10T08:42:34.542065+0000","last_fullsized":"2024-05-10T08:42:34.542065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:59:00.355461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542321+0000","last_change":"2024-05-10T08:42:33.551415+0000","last_active":"2024-05-10T08:42:34.542321+0000","last_peered":"2024-05-10T08:42:34.542321+0000","last_clean":"2024-05-10T08:42:34.542321+0000","last_became_active":"2024-05-10T08:42:33.551125+0000","last_became_peered":"2024-05-10T08:42:33.551125+0000","last_unstale":"2024-05-10T08:42:34.542321+0000","last_undegraded":"2024-05-10T08:42:34.542321+0000","last_fullsized":"2024-05-10T08:42:34.542321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:04.847635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542423+0000","last_change":"2024-05-10T08:42:32.541733+0000","last_active":"2024-05-10T08:42:34.542423+0000","last_peered":"2024-05-10T08:42:34.542423+0000","last_clean":"2024-05-10T08:42:34.542423+0000","last_became_active":"2024-05-10T08:42:32.541448+0000","last_became_peered":"2024-05-10T08:42:32.541448+0000","last_unstale":"2024-05-10T08:42:34.542423+0000","last_undegraded":"2024-05-10T08:42:34.542423+0000","last_fullsized":"2024-05-10T08:42:34.542423+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:09.326682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542599+0000","last_change":"2024-05-10T08:42:33.560413+0000","last_active":"2024-05-10T08:42:34.542599+0000","last_peered":"2024-05-10T08:42:34.542599+0000","last_clean":"2024-05-10T08:42:34.542599+0000","last_became_active":"2024-05-10T08:42:33.560151+0000","last_became_peered":"2024-05-10T08:42:33.560151+0000","last_unstale":"2024-05-10T08:42:34.542599+0000","last_undegraded":"2024-05-10T08:42:34.542599+0000","last_fullsized":"2024-05-10T08:42:34.542599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:50.335634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542126+0000","last_change":"2024-05-10T08:42:32.543311+0000","last_active":"2024-05-10T08:42:34.542126+0000","last_peered":"2024-05-10T08:42:34.542126+0000","last_clean":"2024-05-10T08:42:34.542126+0000","last_became_active":"2024-05-10T08:42:32.543015+0000","last_became_peered":"2024-05-10T08:42:32.543015+0000","last_unstale":"2024-05-10T08:42:34.542126+0000","last_undegraded":"2024-05-10T08:42:34.542126+0000","last_fullsized":"2024-05-10T08:42:34.542126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:03.842645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542928+0000","last_change":"2024-05-10T08:42:33.567700+0000","last_active":"2024-05-10T08:42:34.542928+0000","last_peered":"2024-05-10T08:42:34.542928+0000","last_clean":"2024-05-10T08:42:34.542928+0000","last_became_active":"2024-05-10T08:42:33.566008+0000","last_became_peered":"2024-05-10T08:42:33.566008+0000","last_unstale":"2024-05-10T08:42:34.542928+0000","last_undegraded":"2024-05-10T08:42:34.542928+0000","last_fullsized":"2024-05-10T08:42:34.542928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:17.667236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543109+0000","last_change":"2024-05-10T08:42:32.548450+0000","last_active":"2024-05-10T08:42:34.543109+0000","last_peered":"2024-05-10T08:42:34.543109+0000","last_clean":"2024-05-10T08:42:34.543109+0000","last_became_active":"2024-05-10T08:42:32.548199+0000","last_became_peered":"2024-05-10T08:42:32.548199+0000","last_unstale":"2024-05-10T08:42:34.543109+0000","last_undegraded":"2024-05-10T08:42:34.543109+0000","last_fullsized":"2024-05-10T08:42:34.543109+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:54:49.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541439+0000","last_change":"2024-05-10T08:42:33.559030+0000","last_active":"2024-05-10T08:42:34.541439+0000","last_peered":"2024-05-10T08:42:34.541439+0000","last_clean":"2024-05-10T08:42:34.541439+0000","last_became_active":"2024-05-10T08:42:33.558704+0000","last_became_peered":"2024-05-10T08:42:33.558704+0000","last_unstale":"2024-05-10T08:42:34.541439+0000","last_undegraded":"2024-05-10T08:42:34.541439+0000","last_fullsized":"2024-05-10T08:42:34.541439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:56.957072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.555542+0000","last_change":"2024-05-10T08:42:32.537939+0000","last_active":"2024-05-10T08:42:34.555542+0000","last_peered":"2024-05-10T08:42:34.555542+0000","last_clean":"2024-05-10T08:42:34.555542+0000","last_became_active":"2024-05-10T08:42:32.537670+0000","last_became_peered":"2024-05-10T08:42:32.537670+0000","last_unstale":"2024-05-10T08:42:34.555542+0000","last_undegraded":"2024-05-10T08:42:34.555542+0000","last_fullsized":"2024-05-10T08:42:34.555542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:49.992284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543148+0000","last_change":"2024-05-10T08:42:33.561666+0000","last_active":"2024-05-10T08:42:34.543148+0000","last_peered":"2024-05-10T08:42:34.543148+0000","last_clean":"2024-05-10T08:42:34.543148+0000","last_became_active":"2024-05-10T08:42:33.561385+0000","last_became_peered":"2024-05-10T08:42:33.561385+0000","last_unstale":"2024-05-10T08:42:34.543148+0000","last_undegraded":"2024-05-10T08:42:34.543148+0000","last_fullsized":"2024-05-10T08:42:34.543148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:33.484512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543049+0000","last_change":"2024-05-10T08:42:32.545103+0000","last_active":"2024-05-10T08:42:34.543049+0000","last_peered":"2024-05-10T08:42:34.543049+0000","last_clean":"2024-05-10T08:42:34.543049+0000","last_became_active":"2024-05-10T08:42:32.544782+0000","last_became_peered":"2024-05-10T08:42:32.544782+0000","last_unstale":"2024-05-10T08:42:34.543049+0000","last_undegraded":"2024-05-10T08:42:34.543049+0000","last_fullsized":"2024-05-10T08:42:34.543049+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:19.545681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542727+0000","last_change":"2024-05-10T08:42:33.553074+0000","last_active":"2024-05-10T08:42:34.542727+0000","last_peered":"2024-05-10T08:42:34.542727+0000","last_clean":"2024-05-10T08:42:34.542727+0000","last_became_active":"2024-05-10T08:42:33.552807+0000","last_became_peered":"2024-05-10T08:42:33.552807+0000","last_unstale":"2024-05-10T08:42:34.542727+0000","last_undegraded":"2024-05-10T08:42:34.542727+0000","last_fullsized":"2024-05-10T08:42:34.542727+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:10.331673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.544088+0000","last_change":"2024-05-10T08:42:32.551578+0000","last_active":"2024-05-10T08:42:34.544088+0000","last_peered":"2024-05-10T08:42:34.544088+0000","last_clean":"2024-05-10T08:42:34.544088+0000","last_became_active":"2024-05-10T08:42:32.551292+0000","last_became_peered":"2024-05-10T08:42:32.551292+0000","last_unstale":"2024-05-10T08:42:34.544088+0000","last_undegraded":"2024-05-10T08:42:34.544088+0000","last_fullsized":"2024-05-10T08:42:34.544088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:05.763868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542325+0000","last_change":"2024-05-10T08:42:33.567510+0000","last_active":"2024-05-10T08:42:34.542325+0000","last_peered":"2024-05-10T08:42:34.542325+0000","last_clean":"2024-05-10T08:42:34.542325+0000","last_became_active":"2024-05-10T08:42:33.567234+0000","last_became_peered":"2024-05-10T08:42:33.567234+0000","last_unstale":"2024-05-10T08:42:34.542325+0000","last_undegraded":"2024-05-10T08:42:34.542325+0000","last_fullsized":"2024-05-10T08:42:34.542325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:39.995960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.541613+0000","last_change":"2024-05-10T08:42:32.546414+0000","last_active":"2024-05-10T08:42:34.541613+0000","last_peered":"2024-05-10T08:42:34.541613+0000","last_clean":"2024-05-10T08:42:34.541613+0000","last_became_active":"2024-05-10T08:42:32.546052+0000","last_became_peered":"2024-05-10T08:42:32.546052+0000","last_unstale":"2024-05-10T08:42:34.541613+0000","last_undegraded":"2024-05-10T08:42:34.541613+0000","last_fullsized":"2024-05-10T08:42:34.541613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:59.849336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.539234+0000","last_change":"2024-05-10T08:42:33.556796+0000","last_active":"2024-05-10T08:42:34.539234+0000","last_peered":"2024-05-10T08:42:34.539234+0000","last_clean":"2024-05-10T08:42:34.539234+0000","last_became_active":"2024-05-10T08:42:33.556023+0000","last_became_peered":"2024-05-10T08:42:33.556023+0000","last_unstale":"2024-05-10T08:42:34.539234+0000","last_undegraded":"2024-05-10T08:42:34.539234+0000","last_fullsized":"2024-05-10T08:42:34.539234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:01.115044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542290+0000","last_change":"2024-05-10T08:42:32.537455+0000","last_active":"2024-05-10T08:42:34.542290+0000","last_peered":"2024-05-10T08:42:34.542290+0000","last_clean":"2024-05-10T08:42:34.542290+0000","last_became_active":"2024-05-10T08:42:32.537093+0000","last_became_peered":"2024-05-10T08:42:32.537093+0000","last_unstale":"2024-05-10T08:42:34.542290+0000","last_undegraded":"2024-05-10T08:42:34.542290+0000","last_fullsized":"2024-05-10T08:42:34.542290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:01.074438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543517+0000","last_change":"2024-05-10T08:42:33.544192+0000","last_active":"2024-05-10T08:42:34.543517+0000","last_peered":"2024-05-10T08:42:34.543517+0000","last_clean":"2024-05-10T08:42:34.543517+0000","last_became_active":"2024-05-10T08:42:33.543879+0000","last_became_peered":"2024-05-10T08:42:33.543879+0000","last_unstale":"2024-05-10T08:42:34.543517+0000","last_undegraded":"2024-05-10T08:42:34.543517+0000","last_fullsized":"2024-05-10T08:42:34.543517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:05.900691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542416+0000","last_change":"2024-05-10T08:42:32.539556+0000","last_active":"2024-05-10T08:42:34.542416+0000","last_peered":"2024-05-10T08:42:34.542416+0000","last_clean":"2024-05-10T08:42:34.542416+0000","last_became_active":"2024-05-10T08:42:32.538805+0000","last_became_peered":"2024-05-10T08:42:32.538805+0000","last_unstale":"2024-05-10T08:42:34.542416+0000","last_undegraded":"2024-05-10T08:42:34.542416+0000","last_fullsized":"2024-05-10T08:42:34.542416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:19:08.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540910+0000","last_change":"2024-05-10T08:42:33.553295+0000","last_active":"2024-05-10T08:42:34.540910+0000","last_peered":"2024-05-10T08:42:34.540910+0000","last_clean":"2024-05-10T08:42:34.540910+0000","last_became_active":"2024-05-10T08:42:33.552984+0000","last_became_peered":"2024-05-10T08:42:33.552984+0000","last_unstale":"2024-05-10T08:42:34.540910+0000","last_undegraded":"2024-05-10T08:42:34.540910+0000","last_fullsized":"2024-05-10T08:42:34.540910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:59.454395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543437+0000","last_change":"2024-05-10T08:42:32.544270+0000","last_active":"2024-05-10T08:42:34.543437+0000","last_peered":"2024-05-10T08:42:34.543437+0000","last_clean":"2024-05-10T08:42:34.543437+0000","last_became_active":"2024-05-10T08:42:32.543966+0000","last_became_peered":"2024-05-10T08:42:32.543966+0000","last_unstale":"2024-05-10T08:42:34.543437+0000","last_undegraded":"2024-05-10T08:42:34.543437+0000","last_fullsized":"2024-05-10T08:42:34.543437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:41.605825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.543014+0000","last_change":"2024-05-10T08:42:33.567542+0000","last_active":"2024-05-10T08:42:34.543014+0000","last_peered":"2024-05-10T08:42:34.543014+0000","last_clean":"2024-05-10T08:42:34.543014+0000","last_became_active":"2024-05-10T08:42:33.567266+0000","last_became_peered":"2024-05-10T08:42:33.567266+0000","last_unstale":"2024-05-10T08:42:34.543014+0000","last_undegraded":"2024-05-10T08:42:34.543014+0000","last_fullsized":"2024-05-10T08:42:34.543014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:32.520148+0000","last_clean_scrub_stamp":"2024-05-10T08:42:32.520148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:14.188620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.542050+0000","last_change":"2024-05-10T08:42:32.537449+0000","last_active":"2024-05-10T08:42:34.542050+0000","last_peered":"2024-05-10T08:42:34.542050+0000","last_clean":"2024-05-10T08:42:34.542050+0000","last_became_active":"2024-05-10T08:42:32.537069+0000","last_became_peered":"2024-05-10T08:42:32.537069+0000","last_unstale":"2024-05-10T08:42:34.542050+0000","last_undegraded":"2024-05-10T08:42:34.542050+0000","last_fullsized":"2024-05-10T08:42:34.542050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:42:31.515157+0000","last_clean_scrub_stamp":"2024-05-10T08:42:31.515157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:51:16.662245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":186,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-10T08:42:34.540295+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:42:34.540295+0000","last_peered":"2024-05-10T08:42:34.540295+0000","last_clean":"2024-05-10T08:42:34.540295+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:42:34.540295+0000","last_undegraded":"2024-05-10T08:42:34.540295+0000","last_fullsized":"2024-05-10T08:42:34.540295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1359872,"data_stored":926871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":335761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":335749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":761856,"data_stored":337339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":335727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":329035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":338103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1343488,"data_stored":926095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:42:37.948 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:42:37.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T08:42:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.096+0000 7f684a208640 1 Processor -- start 2024-05-10T08:42:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.097+0000 7f684a208640 1 -- start start 2024-05-10T08:42:38.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.097+0000 7f684a208640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f68440d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.097+0000 7f684a208640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68440d0320 con 0x7f68440d54e0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.097+0000 7f684a208640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68440d0600 con 0x7f684415f4e0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.097+0000 7f684a208640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f68440d41b0 con 0x7f68440cfcd0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f6843fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f68440d54e0 0x7f68440d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52690/0 (socket says 172.21.15.37:52690) 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f6843fff640 1 -- 172.21.15.37:0/1389270095 learned_addr learned my addr 172.21.15.37:0/1389270095 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f6842ffd640 1 --2- 172.21.15.37:0/1389270095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f68440d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271522433 0 0) 0x7f68440d0320 con 0x7f68440d54e0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f682c003520 con 0x7f68440d54e0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999896022 0 0) 0x7f68440d0600 con 0x7f684415f4e0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68440d0320 con 0x7f684415f4e0 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f6842ffd640 1 -- 172.21.15.37:0/1389270095 >> v1:172.21.15.82:6789/0 conn(0x7f684415f4e0 legacy=0x7f68440d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f6842ffd640 1 -- 172.21.15.37:0/1389270095 >> v1:172.21.15.37:6789/0 conn(0x7f68440d54e0 legacy=0x7f68440d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 719374857 0 0) 0x7f682c003520 con 0x7f68440d54e0 2024-05-10T08:42:38.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.098+0000 7f6842ffd640 1 -- 172.21.15.37:0/1389270095 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68440d08e0 con 0x7f68440cfcd0 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.099+0000 7f6842ffd640 1 --2- 172.21.15.37:0/1389270095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f68440d4fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68380097d0 tx=0x7f683802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8219d59dd3c9a905 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.099+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838037070 con 0x7f68440cfcd0 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.099+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f683802ac30 con 0x7f68440cfcd0 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.099+0000 7f68427fc640 1 -- 172.21.15.37:0/1389270095 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c0019f0 con 0x7f68440cfcd0 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.100+0000 7f684a208640 1 -- 172.21.15.37:0/1389270095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 msgr2=0x7f68440d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.100+0000 7f684a208640 1 --2- 172.21.15.37:0/1389270095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f68440d4fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68380097d0 tx=0x7f683802a1a0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.100+0000 7f684a208640 1 -- 172.21.15.37:0/1389270095 shutdown_connections 2024-05-10T08:42:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.100+0000 7f684a208640 1 --2- 172.21.15.37:0/1389270095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f68440d4fa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.100+0000 7f684a208640 1 -- 172.21.15.37:0/1389270095 >> 172.21.15.37:0/1389270095 conn(0x7f684408eac0 msgr2=0x7f684409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.100+0000 7f684a208640 1 -- 172.21.15.37:0/1389270095 shutdown_connections 2024-05-10T08:42:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.100+0000 7f684a208640 1 -- 172.21.15.37:0/1389270095 wait complete. 2024-05-10T08:42:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.101+0000 7f684a208640 1 Processor -- start 2024-05-10T08:42:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.101+0000 7f684a208640 1 -- start start 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f684a208640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f684414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f684a208640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440d54e0 0x7f68441f8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f684a208640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684415f4e0 0x7f68440cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f684a208640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f684415f8c0 con 0x7f68440d54e0 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f684a208640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68440d0ea0 con 0x7f684415f4e0 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f684a208640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f68440d1ad0 con 0x7f68440cfcd0 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440d54e0 0x7f68441f8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440d54e0 0x7f68441f8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60772/0 (socket says 172.21.15.37:60772) 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 -- 172.21.15.37:0/461209676 learned_addr learned my addr 172.21.15.37:0/461209676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f68437fe640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f684414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6843fff640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684415f4e0 0x7f68440cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 -- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 msgr2=0x7f684414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f684414b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 -- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684415f4e0 msgr2=0x7f68440cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684415f4e0 0x7f68440cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 -- 172.21.15.37:0/461209676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684414b7a0 con 0x7f68440d54e0 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6843fff640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684415f4e0 0x7f68440cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.102+0000 7f6842ffd640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440d54e0 0x7f68441f8e90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f68380097d0 tx=0x7f68380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.103+0000 7f682bfff640 1 -- 172.21.15.37:0/461209676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838037050 con 0x7f68440d54e0 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.103+0000 7f682bfff640 1 -- 172.21.15.37:0/461209676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6838038040 con 0x7f68440d54e0 2024-05-10T08:42:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.103+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684414ba80 con 0x7f68440d54e0 2024-05-10T08:42:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.103+0000 7f682bfff640 1 -- 172.21.15.37:0/461209676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838006e10 con 0x7f68440d54e0 2024-05-10T08:42:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.103+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68441f5010 con 0x7f68440d54e0 2024-05-10T08:42:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.104+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68441f4e20 con 0x7f68440d54e0 2024-05-10T08:42:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.104+0000 7f682bfff640 1 -- 172.21.15.37:0/461209676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6838045020 con 0x7f68440d54e0 2024-05-10T08:42:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.105+0000 7f682bfff640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68300762d0 0x7f6830078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.105+0000 7f682bfff640 1 -- 172.21.15.37:0/461209676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f68380b7840 con 0x7f68440d54e0 2024-05-10T08:42:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.105+0000 7f68437fe640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68300762d0 0x7f6830078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.106+0000 7f68437fe640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68300762d0 0x7f6830078790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f68340011e0 tx=0x7f6834009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.110+0000 7f682bfff640 1 -- 172.21.15.37:0/461209676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f683804c020 con 0x7f68440d54e0 2024-05-10T08:42:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.374+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f684414bfa0 con 0x7f68440d54e0 2024-05-10T08:42:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.376+0000 7f682bfff640 1 -- 172.21.15.37:0/461209676 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f6838080ef0 con 0x7f68440d54e0 2024-05-10T08:42:38.376 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:42:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:42:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-10T08:42:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-10T08:42:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T08:42:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-10T08:42:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68300762d0 msgr2=0x7f6830078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68300762d0 0x7f6830078790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f68340011e0 tx=0x7f6834009040 comp rx=0 tx=0).stop 2024-05-10T08:42:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440d54e0 msgr2=0x7f68441f8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440d54e0 0x7f68441f8e90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f68380097d0 tx=0x7f68380046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 shutdown_connections 2024-05-10T08:42:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68300762d0 0x7f6830078790 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684415f4e0 0x7f68440cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440d54e0 0x7f68441f8e90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 --2- 172.21.15.37:0/461209676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68440cfcd0 0x7f684414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 >> 172.21.15.37:0/461209676 conn(0x7f684408eac0 msgr2=0x7f6844075840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 shutdown_connections 2024-05-10T08:42:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.378+0000 7f684a208640 1 -- 172.21.15.37:0/461209676 wait complete. 2024-05-10T08:42:38.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:38.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.493+0000 7f15ae746640 1 Processor -- start 2024-05-10T08:42:38.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.493+0000 7f15ae746640 1 -- start start 2024-05-10T08:42:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15ae746640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 0x7f15a8070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15ae746640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15a8070d20 0x7f15a80711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15ae746640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a806e110 con 0x7f15a81629b0 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15ae746640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f15a806dec0 con 0x7f15a8070d20 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15ae746640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15a806e3f0 con 0x7f15a80b2490 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15a7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15a81629b0 0x7f15a806eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52698/0 (socket says 172.21.15.37:52698) 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15a7fff640 1 -- 172.21.15.37:0/1298911459 learned_addr learned my addr 172.21.15.37:0/1298911459 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15acce3640 1 --2- 172.21.15.37:0/1298911459 >> v2:172.21.15.82:3300/0 conn(0x7f15a8070d20 0x7f15a80711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15a77fe640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 0x7f15a8070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574780591 0 0) 0x7f15a806e110 con 0x7f15a81629b0 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.494+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1590003520 con 0x7f15a81629b0 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498833850 0 0) 0x7f1590003520 con 0x7f15a81629b0 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 msgr2=0x7f15a8070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 0x7f15a8070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 >> v2:172.21.15.82:3300/0 conn(0x7f15a8070d20 msgr2=0x7f15a80711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 --2- 172.21.15.37:0/1298911459 >> v2:172.21.15.82:3300/0 conn(0x7f15a8070d20 0x7f15a80711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a806e6d0 con 0x7f15a81629b0 2024-05-10T08:42:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f1598001670 con 0x7f15a81629b0 2024-05-10T08:42:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 >> v1:172.21.15.37:6789/0 conn(0x7f15a81629b0 legacy=0x7f15a806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f1590003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1590004800 0x7f1590004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 0x7f15900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15a806dec0 con 0x7f15900039b0 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15a806e3f0 con 0x7f1590004800 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f159000b9c0 con 0x7f15a80b2490 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a7fff640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f1590003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a77fe640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1590004800 0x7f1590004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15acce3640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 0x7f15900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a7fff640 1 -- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 msgr2=0x7f15900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a7fff640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a80b2490 0x7f15900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a7fff640 1 -- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1590004800 msgr2=0x7f1590004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a7fff640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1590004800 0x7f1590004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.495+0000 7f15a7fff640 1 -- 172.21.15.37:0/1298911459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1590003520 con 0x7f15900039b0 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.496+0000 7f15a7fff640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f1590003dd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f159800c210 tx=0x7f1590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34220d6c7ee9a47 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.496+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598007d50 con 0x7f15900039b0 2024-05-10T08:42:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.496+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1598005af0 con 0x7f15900039b0 2024-05-10T08:42:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.496+0000 7f15a6ffd640 1 -- 172.21.15.37:0/1298911459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598007070 con 0x7f15900039b0 2024-05-10T08:42:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.497+0000 7f15ae746640 1 -- 172.21.15.37:0/1298911459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 msgr2=0x7f1590003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.497+0000 7f15ae746640 1 --2- 172.21.15.37:0/1298911459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f1590003dd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f159800c210 tx=0x7f1590005830 comp rx=0 tx=0).stop 2024-05-10T08:42:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.497+0000 7f15acce3640 1 -- 172.21.15.37:0/1298911459 reap_dead start 2024-05-10T08:42:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.497+0000 7f15ae746640 1 -- 172.21.15.37:0/1298911459 shutdown_connections 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.497+0000 7f15ae746640 1 -- 172.21.15.37:0/1298911459 >> 172.21.15.37:0/1298911459 conn(0x7f15a80b49d0 msgr2=0x7f15a80b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.497+0000 7f15ae746640 1 -- 172.21.15.37:0/1298911459 shutdown_connections 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.497+0000 7f15ae746640 1 -- 172.21.15.37:0/1298911459 wait complete. 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.498+0000 7f15ae746640 1 Processor -- start 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.498+0000 7f15ae746640 1 -- start start 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15ae746640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f15a814abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15ae746640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a80c94f0 0x7f15a80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15ae746640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a814b2d0 0x7f15a814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15ae746640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15a80704b0 con 0x7f15900039b0 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15ae746640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15a8070330 con 0x7f15a80c94f0 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15ae746640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15a8070630 con 0x7f15a814b2d0 2024-05-10T08:42:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f15a814abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f15a814abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60796/0 (socket says 172.21.15.37:60796) 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 -- 172.21.15.37:0/1985268038 learned_addr learned my addr 172.21.15.37:0/1985268038 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a77fe640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a80c94f0 0x7f15a80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15acce3640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a814b2d0 0x7f15a814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 -- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a814b2d0 msgr2=0x7f15a814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a814b2d0 0x7f15a814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 -- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a80c94f0 msgr2=0x7f15a80c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a80c94f0 0x7f15a80c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 -- 172.21.15.37:0/1985268038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a80c8a50 con 0x7f15900039b0 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a77fe640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a80c94f0 0x7f15a80c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.499+0000 7f15a7fff640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f15a814abc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1598034040 tx=0x7f1598001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.500+0000 7f15a4ff9640 1 -- 172.21.15.37:0/1985268038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598042070 con 0x7f15900039b0 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.500+0000 7f15a4ff9640 1 -- 172.21.15.37:0/1985268038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1598007480 con 0x7f15900039b0 2024-05-10T08:42:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.500+0000 7f15a4ff9640 1 -- 172.21.15.37:0/1985268038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598001c90 con 0x7f15900039b0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.500+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a815ef60 con 0x7f15900039b0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.500+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a80c8cf0 con 0x7f15900039b0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.501+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a80693f0 con 0x7f15900039b0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.501+0000 7f15a4ff9640 1 -- 172.21.15.37:0/1985268038 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1598045070 con 0x7f15900039b0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.502+0000 7f15a4ff9640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1594076300 0x7f15940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.502+0000 7f15a4ff9640 1 -- 172.21.15.37:0/1985268038 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f15980b8290 con 0x7f15900039b0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.502+0000 7f15a77fe640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1594076300 0x7f15940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.502+0000 7f15a77fe640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1594076300 0x7f15940787c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f15a80b5470 tx=0x7f159c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.506+0000 7f15a4ff9640 1 -- 172.21.15.37:0/1985268038 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1598005ac0 con 0x7f15900039b0 2024-05-10T08:42:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.734+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15a80c8820 con 0x7f15900039b0 2024-05-10T08:42:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.735+0000 7f15a4ff9640 1 -- 172.21.15.37:0/1985268038 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5179 (secure 0 0 0) 0x7f1598081410 con 0x7f15900039b0 2024-05-10T08:42:38.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:38.735 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:42:35.928048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:42:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2024-05-10T08:42:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1594076300 msgr2=0x7f15940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1594076300 0x7f15940787c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f15a80b5470 tx=0x7f159c008040 comp rx=0 tx=0).stop 2024-05-10T08:42:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 msgr2=0x7f15a814abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f15a814abc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1598034040 tx=0x7f1598001a40 comp rx=0 tx=0).stop 2024-05-10T08:42:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 shutdown_connections 2024-05-10T08:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1594076300 0x7f15940787c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15a814b2d0 0x7f15a814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a80c94f0 0x7f15a80c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 --2- 172.21.15.37:0/1985268038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15900039b0 0x7f15a814abc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 >> 172.21.15.37:0/1985268038 conn(0x7f15a80b49d0 msgr2=0x7f15a815f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 shutdown_connections 2024-05-10T08:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:38.737+0000 7f15ae746640 1 -- 172.21.15.37:0/1985268038 wait complete. 2024-05-10T08:42:39.150 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:42:32.908300+0000', 'modified': '2024-05-10T08:42:35.928048+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5637}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5637': {'gid': 5637, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/640581632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 640581632}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 640581632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5637, 'qdb_cluster': [5637]} 2024-05-10T08:42:39.150 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:42:39.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T08:42:39.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.259+0000 7f7226fdd640 1 Processor -- start 2024-05-10T08:42:39.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.259+0000 7f7226fdd640 1 -- start start 2024-05-10T08:42:39.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7226fdd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7220070d30 0x7f72200d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7226fdd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220071110 0x7f722006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7226fdd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72200d1300 con 0x7f7220163920 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7226fdd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f72200d10d0 con 0x7f7220070d30 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7226fdd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7220163db0 con 0x7f7220071110 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7224d79640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7220070d30 0x7f72200d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7224d79640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7220070d30 0x7f72200d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60812/0 (socket says 172.21.15.37:60812) 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7224d79640 1 -- 172.21.15.37:0/2140327865 learned_addr learned my addr 172.21.15.37:0/2140327865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f722557a640 1 --2- 172.21.15.37:0/2140327865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220071110 0x7f722006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7224d79640 1 -- 172.21.15.37:0/2140327865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220071110 msgr2=0x7f722006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7224d79640 1 --2- 172.21.15.37:0/2140327865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220071110 0x7f722006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7224d79640 1 -- 172.21.15.37:0/2140327865 >> v1:172.21.15.82:6789/0 conn(0x7f7220163920 legacy=0x7f72200703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.260+0000 7f7224d79640 1 -- 172.21.15.37:0/2140327865 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72200d15e0 con 0x7f7220070d30 2024-05-10T08:42:39.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.261+0000 7f7224d79640 1 --2- 172.21.15.37:0/2140327865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220070d30 0x7f72200d20c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f721c009e50 tx=0x7f721c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774d49bc091446f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.261+0000 7f72177fe640 1 -- 172.21.15.37:0/2140327865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c036070 con 0x7f7220070d30 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.261+0000 7f72177fe640 1 -- 172.21.15.37:0/2140327865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c031600 con 0x7f7220070d30 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.261+0000 7f72177fe640 1 -- 172.21.15.37:0/2140327865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0319d0 con 0x7f7220070d30 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 -- 172.21.15.37:0/2140327865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220070d30 msgr2=0x7f72200d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 --2- 172.21.15.37:0/2140327865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220070d30 0x7f72200d20c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f721c009e50 tx=0x7f721c02a710 comp rx=0 tx=0).stop 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 -- 172.21.15.37:0/2140327865 shutdown_connections 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 --2- 172.21.15.37:0/2140327865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220071110 0x7f722006d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 --2- 172.21.15.37:0/2140327865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220070d30 0x7f72200d20c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 -- 172.21.15.37:0/2140327865 >> 172.21.15.37:0/2140327865 conn(0x7f72200d2e90 msgr2=0x7f72200d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 -- 172.21.15.37:0/2140327865 shutdown_connections 2024-05-10T08:42:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.262+0000 7f7226fdd640 1 -- 172.21.15.37:0/2140327865 wait complete. 2024-05-10T08:42:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.263+0000 7f7226fdd640 1 Processor -- start 2024-05-10T08:42:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.263+0000 7f7226fdd640 1 -- start start 2024-05-10T08:42:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f7226fdd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220070d30 0x7f72200cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f7226fdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7220071110 0x7f72200cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f7226fdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220163920 0x7f72201f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f7226fdd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72200d1c30 con 0x7f7220163920 2024-05-10T08:42:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f7226fdd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7220070b80 con 0x7f7220071110 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f7226fdd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f72200715a0 con 0x7f7220070d30 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220163920 0x7f72201f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220163920 0x7f72201f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60816/0 (socket says 172.21.15.37:60816) 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 -- 172.21.15.37:0/135217622 learned_addr learned my addr 172.21.15.37:0/135217622 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f7224d79640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220070d30 0x7f72200cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 -- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220070d30 msgr2=0x7f72200cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220070d30 0x7f72200cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 -- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7220071110 msgr2=0x7f72200cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7220071110 0x7f72200cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 -- 172.21.15.37:0/135217622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72200b5100 con 0x7f7220163920 2024-05-10T08:42:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.264+0000 7f722557a640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220163920 0x7f72201f9100 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f721800d5d0 tx=0x7f721800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.265+0000 7f72157fa640 1 -- 172.21.15.37:0/135217622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180125f0 con 0x7f7220163920 2024-05-10T08:42:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.265+0000 7f72157fa640 1 -- 172.21.15.37:0/135217622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7218019070 con 0x7f7220163920 2024-05-10T08:42:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.265+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72200b6ee0 con 0x7f7220163920 2024-05-10T08:42:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.265+0000 7f72157fa640 1 -- 172.21.15.37:0/135217622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180129f0 con 0x7f7220163920 2024-05-10T08:42:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.265+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72200b74a0 con 0x7f7220163920 2024-05-10T08:42:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.266+0000 7f72157fa640 1 -- 172.21.15.37:0/135217622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7218012b90 con 0x7f7220163920 2024-05-10T08:42:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.267+0000 7f72157fa640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f720c0762d0 0x7f720c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.267+0000 7f72157fa640 1 -- 172.21.15.37:0/135217622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f7218097b10 con 0x7f7220163920 2024-05-10T08:42:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.267+0000 7f7224d79640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f720c0762d0 0x7f720c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.267+0000 7f7224d79640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f720c0762d0 0x7f720c078790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f721c033000 tx=0x7f721c009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 Processor -- start 2024-05-10T08:42:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 -- start start 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978831f50 0x557978834760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x557978834ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978804bb0 0x5579788083c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55797876e8d0 con 0x557978832330 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557978727c10 con 0x557978831f50 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55797876a890 con 0x557978804bb0 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.268+0000 7f7217fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x557978834ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7224d79640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978831f50 0x557978834760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x557978834ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60824/0 (socket says 172.21.15.37:60824) 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 -- 172.21.15.37:0/1137701281 learned_addr learned my addr 172.21.15.37:0/1137701281 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f722557a640 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978804bb0 0x5579788083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 -- 172.21.15.37:0/1137701281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978804bb0 msgr2=0x5579788083c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978804bb0 0x5579788083c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 -- 172.21.15.37:0/1137701281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978831f50 msgr2=0x557978834760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978831f50 0x557978834760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 -- 172.21.15.37:0/1137701281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55797872f5d0 con 0x557978832330 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f7217fff640 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x557978834ca0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7210001520 tx=0x7f72100019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c0aaf2292cf4ac server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f72067fc640 1 -- 172.21.15.37:0/1137701281 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210017070 con 0x557978832330 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f72067fc640 1 -- 172.21.15.37:0/1137701281 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72100052d0 con 0x557978832330 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.269+0000 7f72067fc640 1 -- 172.21.15.37:0/1137701281 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210003830 con 0x557978832330 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 -- 172.21.15.37:0/1137701281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 msgr2=0x557978834ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x557978834ca0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7210001520 tx=0x7f72100019e0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 -- 172.21.15.37:0/1137701281 shutdown_connections 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978804bb0 0x5579788083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x557978834ca0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1137701281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978831f50 0x557978834760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 -- 172.21.15.37:0/1137701281 >> 172.21.15.37:0/1137701281 conn(0x557978806e20 msgr2=0x55797884f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 -- 172.21.15.37:0/1137701281 shutdown_connections 2024-05-10T08:42:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 -- 172.21.15.37:0/1137701281 wait complete. 2024-05-10T08:42:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.270+0000 7f7229dd5740 1 -- start start 2024-05-10T08:42:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 1 Processor -- start 2024-05-10T08:42:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978831f50 0x55797884c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978832330 0x5579788477a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x557978847ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557978809fd0 con 0x557978831f50 2024-05-10T08:42:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55797872b760 con 0x557978828c40 2024-05-10T08:42:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55797880a2b0 con 0x557978832330 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.271+0000 7f7229dd5740 10 client.0 _ll_register_callbacks cb 0x557978764cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978831f50 0x55797884c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978831f50 0x55797884c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60838/0 (socket says 172.21.15.37:60838) 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 -- 172.21.15.37:0/324234975 learned_addr learned my addr 172.21.15.37:0/324234975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f722557a640 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x557978847ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7217fff640 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978832330 0x5579788477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 -- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978832330 msgr2=0x5579788477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978832330 0x5579788477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 -- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 msgr2=0x557978847ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x557978847ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 -- 172.21.15.37:0/324234975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579784802d0 con 0x557978831f50 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7224d79640 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978831f50 0x55797884c790 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f721c009f70 tx=0x7f721c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a25ca93e5c511a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f71ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f71ff7fe640 1 -- 172.21.15.37:0/324234975 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c036040 con 0x557978831f50 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72100052d0 con 0x557978831f50 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f71ff7fe640 1 -- 172.21.15.37:0/324234975 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f721c049440 con 0x557978831f50 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f71ff7fe640 1 -- 172.21.15.37:0/324234975 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f721c056050 con 0x557978831f50 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7229dd5740 10 client.5769 fetch_fsmap learned FSMap version 34 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.272+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55797854a6b0 con 0x557978831f50 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f71ff7fe640 1 -- 172.21.15.37:0/324234975 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72100052d0 con 0x557978831f50 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f71ff7fe640 1 -- 172.21.15.37:0/324234975 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f721c059020 con 0x557978831f50 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7229dd5740 10 client.5769 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7229dd5740 10 client.5769 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7229dd5740 20 client.5769 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7229dd5740 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x557978836290 0x55797886e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7229dd5740 4 client.5769 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579786f2760 con 0x557978836290 2024-05-10T08:42:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7217fff640 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x557978836290 0x55797886e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f71ff7fe640 10 client.5769 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.273+0000 7f7217fff640 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x557978836290 0x55797886e2b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caad64e0d0c16ac7 server_cookie=76e95af8c9037932 in_seq=0 out_seq=0 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f71ff7fe640 1 -- 172.21.15.37:0/324234975 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5579786f2760 con 0x557978836290 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f71ff7fe640 10 client.5769 handle_command_reply: tid=0 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 client.5769 shutdown 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978831f50 msgr2=0x55797884c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978831f50 0x55797884c790 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f721c009f70 tx=0x7f721c004ab0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 shutdown_connections 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x557978847ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978832330 0x5579788477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x557978836290 0x55797886e2b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 --2- 172.21.15.37:0/324234975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978831f50 0x55797884c790 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f71ff7fe640 0 client.5769 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 >> 172.21.15.37:0/324234975 conn(0x557978804bb0 msgr2=0x557978834ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 shutdown_connections 2024-05-10T08:42:39.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 1 -- 172.21.15.37:0/324234975 wait complete. 2024-05-10T08:42:39.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.274+0000 7f7229dd5740 20 client.5769 trim_cache size 0 max 16384 2024-05-10T08:42:39.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.293+0000 7f7229dd5740 1 Processor -- start 2024-05-10T08:42:39.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.293+0000 7f7229dd5740 1 -- start start 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978828c40 0x557978809700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 0x557978834a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978832330 0x5579787fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7229dd5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7220200fe0 con 0x557978828c40 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72201f6350 con 0x557978832330 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f72201f69a0 con 0x557978831f50 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978828c40 0x557978809700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978828c40 0x557978809700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60848/0 (socket says 172.21.15.37:60848) 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 -- 172.21.15.37:0/1517305281 learned_addr learned my addr 172.21.15.37:0/1517305281 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 -- 172.21.15.37:0/1517305281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 msgr2=0x557978834a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 --2- 172.21.15.37:0/1517305281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 0x557978834a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 -- 172.21.15.37:0/1517305281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978832330 msgr2=0x5579787fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 --2- 172.21.15.37:0/1517305281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978832330 0x5579787fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 -- 172.21.15.37:0/1517305281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579788049c0 con 0x557978828c40 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7224d79640 1 --2- 172.21.15.37:0/1517305281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978828c40 0x557978809700 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f721c02ad00 tx=0x7f721c03f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92716698dc4a54fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7205ffb640 1 -- 172.21.15.37:0/1517305281 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c05e070 con 0x557978828c40 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7205ffb640 1 -- 172.21.15.37:0/1517305281 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c04e070 con 0x557978828c40 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.294+0000 7f7205ffb640 1 -- 172.21.15.37:0/1517305281 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c049640 con 0x557978828c40 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 -- 172.21.15.37:0/1517305281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978828c40 msgr2=0x557978809700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1517305281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978828c40 0x557978809700 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f721c02ad00 tx=0x7f721c03f070 comp rx=0 tx=0).stop 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 -- 172.21.15.37:0/1517305281 shutdown_connections 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1517305281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978832330 0x5579787fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1517305281 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 0x557978834a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 --2- 172.21.15.37:0/1517305281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978828c40 0x557978809700 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 -- 172.21.15.37:0/1517305281 >> 172.21.15.37:0/1517305281 conn(0x557978804bb0 msgr2=0x55797880a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 -- 172.21.15.37:0/1517305281 shutdown_connections 2024-05-10T08:42:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.295+0000 7f7229dd5740 1 -- 172.21.15.37:0/1517305281 wait complete. 2024-05-10T08:42:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.296+0000 7f7229dd5740 1 -- start start 2024-05-10T08:42:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.296+0000 7f7229dd5740 1 Processor -- start 2024-05-10T08:42:39.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.296+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x5579788cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.296+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 0x55797884b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x55797884bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557978836110 con 0x557978832330 2024-05-10T08:42:39.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557978835c70 con 0x557978828c40 2024-05-10T08:42:39.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5579788366f0 con 0x557978831f50 2024-05-10T08:42:39.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 10 client.0 _ll_register_callbacks cb 0x7f721c009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x55797884bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x55797884bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60860/0 (socket says 172.21.15.37:60860) 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 -- 172.21.15.37:0/921255825 learned_addr learned my addr 172.21.15.37:0/921255825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7224d79640 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x5579788cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7217fff640 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 0x55797884b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 -- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 msgr2=0x55797884b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 0x55797884b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 -- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 msgr2=0x5579788cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x5579788cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 -- 172.21.15.37:0/921255825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557978848f70 con 0x557978832330 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f722557a640 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x55797884bbc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f721805cc70 tx=0x7f7218060700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad186b95881f5875 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f71ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f71ff7fe640 1 -- 172.21.15.37:0/921255825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7218080060 con 0x557978832330 2024-05-10T08:42:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f71ff7fe640 1 -- 172.21.15.37:0/921255825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f72180822b0 con 0x557978832330 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f721c04e070 con 0x557978832330 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f71ff7fe640 1 -- 172.21.15.37:0/921255825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7218060bf0 con 0x557978832330 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 10 client.5775 fetch_fsmap learned FSMap version 34 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.297+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x557978846090 con 0x557978832330 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f71ff7fe640 1 -- 172.21.15.37:0/921255825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c04e070 con 0x557978832330 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f71ff7fe640 1 -- 172.21.15.37:0/921255825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f7218013070 con 0x557978832330 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7229dd5740 10 client.5775 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7229dd5740 10 client.5775 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7229dd5740 20 client.5775 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7229dd5740 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x5579788d1d00 0x5579788d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7229dd5740 4 client.5775 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "status"}) -- 0x55797877c4e0 con 0x5579788d1d00 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7224d79640 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x5579788d1d00 0x5579788d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f71ff7fe640 10 client.5775 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7224d79640 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x5579788d1d00 0x5579788d20e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb5154e5442ca26 server_cookie=88913f9bcd8b4d13 in_seq=0 out_seq=0 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f71ff7fe640 1 -- 172.21.15.37:0/921255825 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55797877c4e0 con 0x5579788d1d00 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f71ff7fe640 10 client.5775 handle_command_reply: tid=0 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.298+0000 7f7229dd5740 1 client.5775 shutdown 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 msgr2=0x55797884bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x55797884bbc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f721805cc70 tx=0x7f7218060700 comp rx=0 tx=0).stop 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 shutdown_connections 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x5579788d1d00 0x5579788d20e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557978832330 0x55797884bbc0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557978831f50 0x55797884b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f71ff7fe640 0 client.5775 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 --2- 172.21.15.37:0/921255825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557978828c40 0x5579788cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 >> 172.21.15.37:0/921255825 conn(0x557978804bb0 msgr2=0x557978834a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 shutdown_connections 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 1 -- 172.21.15.37:0/921255825 wait complete. 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7229dd5740 20 client.5775 trim_cache size 0 max 16384 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5637, 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.7540229380000003, 2024-05-10T08:42:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 34, 2024-05-10T08:42:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 62, 2024-05-10T08:42:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 62, 2024-05-10T08:42:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 10.746660875 2024-05-10T08:42:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f720c0762d0 msgr2=0x7f720c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f720c0762d0 0x7f720c078790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f721c033000 tx=0x7f721c009000 comp rx=0 tx=0).stop 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220163920 msgr2=0x7f72201f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220163920 0x7f72201f9100 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f721800d5d0 tx=0x7f721800da90 comp rx=0 tx=0).stop 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 shutdown_connections 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f720c0762d0 0x7f720c078790 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7220163920 0x7f72201f9100 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7220071110 0x7f72200cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 --2- 172.21.15.37:0/135217622 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7220070d30 0x7f72200cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.299+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 >> 172.21.15.37:0/135217622 conn(0x7f72200d2e90 msgr2=0x7f722006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.300+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 shutdown_connections 2024-05-10T08:42:39.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.300+0000 7f7226fdd640 1 -- 172.21.15.37:0/135217622 wait complete. 2024-05-10T08:42:39.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:42:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.414+0000 7f403a571640 1 Processor -- start 2024-05-10T08:42:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.414+0000 7f403a571640 1 -- start start 2024-05-10T08:42:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.415+0000 7f403a571640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406d620 0x7f4034073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.415+0000 7f403a571640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40341637b0 0x7f40340b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.415+0000 7f403a571640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40340b5120 con 0x7f403406da00 2024-05-10T08:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.415+0000 7f403a571640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f40340afaa0 con 0x7f40341637b0 2024-05-10T08:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.415+0000 7f403a571640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f40340b5a50 con 0x7f403406d620 2024-05-10T08:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4033fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406d620 0x7f4034073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4038b0e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40341637b0 0x7f40340b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f40337fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f403406da00 0x7f40340af2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:54182/0 (socket says 172.21.15.37:54182) 2024-05-10T08:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f40337fe640 1 -- 172.21.15.37:0/2456775855 learned_addr learned my addr 172.21.15.37:0/2456775855 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4032ffd640 1 -- 172.21.15.37:0/2456775855 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103233827 0 0) 0x7f40340b5120 con 0x7f403406da00 2024-05-10T08:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4032ffd640 1 -- 172.21.15.37:0/2456775855 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f401c003520 con 0x7f403406da00 2024-05-10T08:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4038b0e640 1 -- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406d620 msgr2=0x7f4034073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4038b0e640 1 --2- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406d620 0x7f4034073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4038b0e640 1 -- 172.21.15.37:0/2456775855 >> v1:172.21.15.82:6789/0 conn(0x7f403406da00 legacy=0x7f40340af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4038b0e640 1 -- 172.21.15.37:0/2456775855 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40340b5400 con 0x7f40341637b0 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.416+0000 7f4033fff640 1 --2- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406d620 0x7f4034073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.417+0000 7f4038b0e640 1 --2- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 0x7f40340b5ee0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f402c009d90 tx=0x7f402c02a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59e8e75e2bb99fa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.417+0000 7f4032ffd640 1 -- 172.21.15.37:0/2456775855 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c007740 con 0x7f40341637b0 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.417+0000 7f4032ffd640 1 -- 172.21.15.37:0/2456775855 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402c0078e0 con 0x7f40341637b0 2024-05-10T08:42:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.417+0000 7f4032ffd640 1 -- 172.21.15.37:0/2456775855 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c007c90 con 0x7f40341637b0 2024-05-10T08:42:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 -- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 msgr2=0x7f40340b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 --2- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 0x7f40340b5ee0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f402c009d90 tx=0x7f402c02a530 comp rx=0 tx=0).stop 2024-05-10T08:42:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 -- 172.21.15.37:0/2456775855 shutdown_connections 2024-05-10T08:42:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 --2- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 0x7f40340b5ee0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 --2- 172.21.15.37:0/2456775855 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406d620 0x7f4034073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 -- 172.21.15.37:0/2456775855 >> 172.21.15.37:0/2456775855 conn(0x7f40340728c0 msgr2=0x7f4034072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 -- 172.21.15.37:0/2456775855 shutdown_connections 2024-05-10T08:42:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.418+0000 7f403a571640 1 -- 172.21.15.37:0/2456775855 wait complete. 2024-05-10T08:42:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.419+0000 7f403a571640 1 Processor -- start 2024-05-10T08:42:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.419+0000 7f403a571640 1 -- start start 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f403a571640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f403406d620 0x7f40341585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f403a571640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406da00 0x7f40340cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f403a571640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 0x7f40341554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f403a571640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40340b65a0 con 0x7f403406d620 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f403a571640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40340b6420 con 0x7f40341637b0 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f403a571640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f403406e920 con 0x7f403406da00 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f403406d620 0x7f40341585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f403406d620 0x7f40341585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60868/0 (socket says 172.21.15.37:60868) 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 -- 172.21.15.37:0/2553392380 learned_addr learned my addr 172.21.15.37:0/2553392380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4038b0e640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 0x7f40341554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f40337fe640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406da00 0x7f40340cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 -- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406da00 msgr2=0x7f40340cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406da00 0x7f40340cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 -- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 msgr2=0x7f40341554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 0x7f40341554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 -- 172.21.15.37:0/2553392380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40340cf590 con 0x7f403406d620 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f40337fe640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406da00 0x7f40340cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4033fff640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f403406d620 0x7f40341585c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f402400ebe0 tx=0x7f402400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.420+0000 7f4030ff9640 1 -- 172.21.15.37:0/2553392380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024017070 con 0x7f403406d620 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.421+0000 7f4030ff9640 1 -- 172.21.15.37:0/2553392380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402400cc30 con 0x7f403406d620 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.421+0000 7f4030ff9640 1 -- 172.21.15.37:0/2553392380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024013470 con 0x7f403406d620 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.421+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4034158b00 con 0x7f403406d620 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.421+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40340cf800 con 0x7f403406d620 2024-05-10T08:42:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.422+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40340693f0 con 0x7f403406d620 2024-05-10T08:42:39.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.422+0000 7f4030ff9640 1 -- 172.21.15.37:0/2553392380 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f402401a070 con 0x7f403406d620 2024-05-10T08:42:39.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.423+0000 7f4030ff9640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:39.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.423+0000 7f4030ff9640 1 -- 172.21.15.37:0/2553392380 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f40240975a0 con 0x7f403406d620 2024-05-10T08:42:39.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.423+0000 7f40337fe640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:39.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.424+0000 7f40337fe640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4034157480 tx=0x7f4028009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.427+0000 7f4030ff9640 1 -- 172.21.15.37:0/2553392380 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f40240607b0 con 0x7f403406d620 2024-05-10T08:42:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.659+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4034163290 con 0x7f403406d620 2024-05-10T08:42:39.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.659+0000 7f4030ff9640 1 -- 172.21.15.37:0/2553392380 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7f4024064ab0 con 0x7f403406d620 2024-05-10T08:42:39.659 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 msgr2=0x7f4020078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4034157480 tx=0x7f4028009040 comp rx=0 tx=0).stop 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f403406d620 msgr2=0x7f40341585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f403406d620 0x7f40341585c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f402400ebe0 tx=0x7f402400c520 comp rx=0 tx=0).stop 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 shutdown_connections 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40341637b0 0x7f40341554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f403406da00 0x7f40340cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 --2- 172.21.15.37:0/2553392380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f403406d620 0x7f40341585c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:39.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 >> 172.21.15.37:0/2553392380 conn(0x7f40340728c0 msgr2=0x7f4034072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:39.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 shutdown_connections 2024-05-10T08:42:39.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39.661+0000 7f403a571640 1 -- 172.21.15.37:0/2553392380 wait complete. 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:42:39.672 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:42:39.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:39.673 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:42:39.690 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42602sec preferred_lft 42602sec 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:42:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:42:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:42:39.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:39.693 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:42:39.754 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:42:39.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:39.757 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:42:39.814 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:42:39.815 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:42:39.815 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:42:39.815 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:42:39.815 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:42:39.817 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:42:39.817 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:42:39.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:42:39.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:42:39.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:42:39.817 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:42:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:42:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:42:39.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:39.945 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:42:39.962 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:42:39.963 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:42:39.963 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:42:39.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:39.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:42:40.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:42:40.029 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:42:40.086 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:42:40.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:42:40.086 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:42:40.142 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:42:40.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:40.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:42:40.226 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:42:40.227 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:42:40.227 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:42:40.235 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:42:40.236 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:42:40.236 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:42:40.236 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:42:40.236 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:42:40.245 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:42:40.245 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:42:40.245 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:42:40.245 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:42:40.245 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:42:40.245 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:42:40.246 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:42:40.246 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:42:40.246 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:42:40.246 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:42:40.246 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:42:40.247 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:42:40.247 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:42:40.248 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:42:40.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:40.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:42:40.275 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:42:40.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:42:40.378 INFO:teuthology.orchestra.run.smithi037.stdout:client5781 2024-05-10T08:42:40.378 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:42:40.378 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:42:40.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:40.396 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-05-10T08:42:40.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:40.457 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-05-10T08:42:40.515 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:42:40.515 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:42:40.515 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:42:40.515 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:42:40.515 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-05-10T08:42:40.515 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:42:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2024-05-10T08:42:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:42:40.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:42:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.778+0000 7f806ee5c640 1 Processor -- start 2024-05-10T08:42:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.778+0000 7f806ee5c640 1 -- start start 2024-05-10T08:42:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f806ee5c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f806815f0c0 0x7f80680b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f806ee5c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 0x7f806806c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f806ee5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80680b14e0 con 0x7f80681638e0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f806ee5c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8068163450 con 0x7f806815f0c0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f806ee5c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f80681604b0 con 0x7f806806c3a0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f8067fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f80681638e0 0x7f80680b0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52706/0 (socket says 172.21.15.37:52706) 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f8067fff640 1 -- 172.21.15.37:0/3750089635 learned_addr learned my addr 172.21.15.37:0/3750089635 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f806d3f9640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 0x7f806806c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3750089635 >> v2:172.21.15.82:3300/0 conn(0x7f806815f0c0 0x7f80680b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335705431 0 0) 0x7f80680b14e0 con 0x7f80681638e0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.779+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8058003520 con 0x7f80681638e0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127928436 0 0) 0x7f8058003520 con 0x7f80681638e0 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 msgr2=0x7f806806c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 0x7f806806c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 >> v2:172.21.15.82:3300/0 conn(0x7f806815f0c0 msgr2=0x7f80680b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 --2- 172.21.15.37:0/3750089635 >> v2:172.21.15.82:3300/0 conn(0x7f806815f0c0 0x7f80680b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8068162e00 con 0x7f80681638e0 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8054001690 con 0x7f80681638e0 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 >> v1:172.21.15.37:6789/0 conn(0x7f80681638e0 legacy=0x7f80680b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80580039b0 0x7f8058003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8058004800 0x7f8058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 0x7f80580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8068163450 con 0x7f80580039b0 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80681604b0 con 0x7f8058004800 2024-05-10T08:42:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f805800b9c0 con 0x7f806806c3a0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80580039b0 0x7f8058003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f8067fff640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8058004800 0x7f8058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f806d3f9640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 0x7f80580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f806cbf8640 1 -- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 msgr2=0x7f80580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f806806c3a0 0x7f80580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f806cbf8640 1 -- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8058004800 msgr2=0x7f8058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8058004800 0x7f8058004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.780+0000 7f806cbf8640 1 -- 172.21.15.37:0/3750089635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8058003520 con 0x7f80580039b0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.781+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80580039b0 0x7f8058003dd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f805c009ac0 tx=0x7f8058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34f8903881d2aa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.781+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c036070 con 0x7f80580039b0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.781+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c031400 con 0x7f80580039b0 2024-05-10T08:42:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.781+0000 7f80677fe640 1 -- 172.21.15.37:0/3750089635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c009690 con 0x7f80580039b0 2024-05-10T08:42:40.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.782+0000 7f806ee5c640 1 -- 172.21.15.37:0/3750089635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80580039b0 msgr2=0x7f8058003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:40.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.782+0000 7f806ee5c640 1 --2- 172.21.15.37:0/3750089635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80580039b0 0x7f8058003dd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f805c009ac0 tx=0x7f8058005830 comp rx=0 tx=0).stop 2024-05-10T08:42:40.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.782+0000 7f806d3f9640 1 -- 172.21.15.37:0/3750089635 reap_dead start 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.782+0000 7f806ee5c640 1 -- 172.21.15.37:0/3750089635 shutdown_connections 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.782+0000 7f806ee5c640 1 -- 172.21.15.37:0/3750089635 >> 172.21.15.37:0/3750089635 conn(0x7f80680b3b10 msgr2=0x7f80680b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.782+0000 7f806ee5c640 1 -- 172.21.15.37:0/3750089635 shutdown_connections 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.782+0000 7f806ee5c640 1 -- 172.21.15.37:0/3750089635 wait complete. 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.783+0000 7f806ee5c640 1 Processor -- start 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.783+0000 7f806ee5c640 1 -- start start 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806ee5c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80580039b0 0x7f80681f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806ee5c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f806815cca0 0x7f80680b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806ee5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80680b0950 0x7f80681f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806ee5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f806806c830 con 0x7f80680b0950 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806ee5c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80680b17c0 con 0x7f806815cca0 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806ee5c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f806806c9b0 con 0x7f80580039b0 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80680b0950 0x7f80681f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80680b0950 0x7f80681f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60882/0 (socket says 172.21.15.37:60882) 2024-05-10T08:42:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 -- 172.21.15.37:0/3441924544 learned_addr learned my addr 172.21.15.37:0/3441924544 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f8067fff640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f806815cca0 0x7f80680b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80580039b0 0x7f80681f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 -- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80580039b0 msgr2=0x7f80681f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80580039b0 0x7f80681f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 -- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f806815cca0 msgr2=0x7f80680b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f806815cca0 0x7f80680b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 -- 172.21.15.37:0/3441924544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80681f9200 con 0x7f80680b0950 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.784+0000 7f806d3f9640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80680b0950 0x7f80681f82a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8068163cc0 tx=0x7f806000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.785+0000 7f80657fa640 1 -- 172.21.15.37:0/3441924544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806000fc80 con 0x7f80680b0950 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.785+0000 7f80657fa640 1 -- 172.21.15.37:0/3441924544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806001d070 con 0x7f80680b0950 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.785+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80681f8f20 con 0x7f80680b0950 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.785+0000 7f80657fa640 1 -- 172.21.15.37:0/3441924544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060015430 con 0x7f80680b0950 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.785+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80681f5110 con 0x7f80680b0950 2024-05-10T08:42:40.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.786+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806806a8f0 con 0x7f80680b0950 2024-05-10T08:42:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.786+0000 7f80657fa640 1 -- 172.21.15.37:0/3441924544 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f80600155d0 con 0x7f80680b0950 2024-05-10T08:42:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.787+0000 7f80657fa640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f804c076300 0x7f804c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.787+0000 7f80657fa640 1 -- 172.21.15.37:0/3441924544 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f8060097eb0 con 0x7f80680b0950 2024-05-10T08:42:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.787+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f804c076300 0x7f804c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.788+0000 7f806cbf8640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f804c076300 0x7f804c0787c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f805c033000 tx=0x7f805c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:40.791+0000 7f80657fa640 1 -- 172.21.15.37:0/3441924544 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8060010040 con 0x7f80680b0950 2024-05-10T08:42:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.022+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f806815d080 con 0x7f80680b0950 2024-05-10T08:42:41.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.022+0000 7f80657fa640 1 -- 172.21.15.37:0/3441924544 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5179 (secure 0 0 0) 0x7f8060061680 con 0x7f80680b0950 2024-05-10T08:42:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:41.022 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:42:35.928048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:42:41.022 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.024+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f804c076300 msgr2=0x7f804c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.024+0000 7f806ee5c640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f804c076300 0x7f804c0787c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f805c033000 tx=0x7f805c008030 comp rx=0 tx=0).stop 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.024+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80680b0950 msgr2=0x7f80681f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.024+0000 7f806ee5c640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80680b0950 0x7f80681f82a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8068163cc0 tx=0x7f806000f1b0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 shutdown_connections 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f804c076300 0x7f804c0787c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80680b0950 0x7f80681f82a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f806815cca0 0x7f80680b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 --2- 172.21.15.37:0/3441924544 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f80580039b0 0x7f80681f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 >> 172.21.15.37:0/3441924544 conn(0x7f80680b3b10 msgr2=0x7f8068070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 shutdown_connections 2024-05-10T08:42:41.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.025+0000 7f806ee5c640 1 -- 172.21.15.37:0/3441924544 wait complete. 2024-05-10T08:42:41.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-10T08:42:41.164 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2024-05-10T08:42:41.164 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:42:41.165 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T08:42:41.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 Processor -- start 2024-05-10T08:42:41.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 -- start start 2024-05-10T08:42:41.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c7a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c7ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c5f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e33bd4780 con 0x558e33bd4330 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558e33b4cf50 con 0x558e33ba7cf0 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5579b1ff40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x558e33bec720 con 0x558e33c79500 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.210+0000 7f5576392640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c7ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c7ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60906/0 (socket says 172.21.15.37:60906) 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 -- 172.21.15.37:0/4002608200 learned_addr learned my addr 172.21.15.37:0/4002608200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576b93640 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c7a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5577394640 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c5f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 -- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 msgr2=0x558e33c5f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c5f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 -- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 msgr2=0x558e33c7a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c7a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 -- 172.21.15.37:0/4002608200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e33c5d120 con 0x558e33bd4330 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5577394640 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c5f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576b93640 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c7a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5576392640 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c7ab70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f556c000c00 tx=0x7f556c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d08cc5ba547aea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5575390640 1 -- 172.21.15.37:0/4002608200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c055070 con 0x558e33bd4330 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5575390640 1 -- 172.21.15.37:0/4002608200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556c051870 con 0x558e33bd4330 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.211+0000 7f5575390640 1 -- 172.21.15.37:0/4002608200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c051c60 con 0x558e33bd4330 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 -- 172.21.15.37:0/4002608200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 msgr2=0x558e33c7ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c7ab70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f556c000c00 tx=0x7f556c051000 comp rx=0 tx=0).stop 2024-05-10T08:42:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 -- 172.21.15.37:0/4002608200 shutdown_connections 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c5f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c7ab70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/4002608200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c7a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 -- 172.21.15.37:0/4002608200 >> 172.21.15.37:0/4002608200 conn(0x558e33ba4b30 msgr2=0x558e33c798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 -- 172.21.15.37:0/4002608200 shutdown_connections 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 -- 172.21.15.37:0/4002608200 wait complete. 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 Processor -- start 2024-05-10T08:42:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.212+0000 7f5579b1ff40 1 -- start start 2024-05-10T08:42:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5579b1ff40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c5c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5579b1ff40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c58d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5579b1ff40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c7a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5579b1ff40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e33d0bea0 con 0x558e33bd4330 2024-05-10T08:42:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5579b1ff40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558e33ba4900 con 0x558e33ba7cf0 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5579b1ff40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x558e33d0c180 con 0x558e33c79500 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c58d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c58d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60922/0 (socket says 172.21.15.37:60922) 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 -- 172.21.15.37:0/3788351121 learned_addr learned my addr 172.21.15.37:0/3788351121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576b93640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c5c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5577394640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c7a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 -- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 msgr2=0x558e33c7a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558e33c79500 0x558e33c7a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 -- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 msgr2=0x558e33c5c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e33ba7cf0 0x558e33c5c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 -- 172.21.15.37:0/3788351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e33c5ca80 con 0x558e33bd4330 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.213+0000 7f5576392640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c58d00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f556c046050 tx=0x7f556c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.214+0000 7f555ffff640 1 -- 172.21.15.37:0/3788351121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c06d070 con 0x558e33bd4330 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.214+0000 7f555ffff640 1 -- 172.21.15.37:0/3788351121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556c051d80 con 0x558e33bd4330 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.214+0000 7f555ffff640 1 -- 172.21.15.37:0/3788351121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c055070 con 0x558e33bd4330 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.214+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e33c5baa0 con 0x558e33bd4330 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.214+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e33bd1690 con 0x558e33bd4330 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.215+0000 7f555ffff640 1 -- 172.21.15.37:0/3788351121 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f556c070070 con 0x558e33bd4330 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.216+0000 7f555ffff640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5564074cb0 0x7f5564077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.216+0000 7f555ffff640 1 -- 172.21.15.37:0/3788351121 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f556c0da640 con 0x558e33bd4330 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.216+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558e33c7a9e0 0x558e33c61b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.216+0000 7f5576b93640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5564074cb0 0x7f5564077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.216+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62) -- 0x558e33c62050 con 0x558e33c7a9e0 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.216+0000 7f5577394640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558e33c7a9e0 0x558e33c61b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.216+0000 7f5576b93640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5564074cb0 0x7f5564077170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5568006450 tx=0x7f5568008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5577394640 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558e33c7a9e0 0x558e33c61b10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5577394640 1 -- 172.21.15.37:0/3788351121 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) ==== 164+0+94 (crc 0 0 0) 0x7f5570007860 con 0x558e33c7a9e0 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558e33c7a9e0 msgr2=0x558e33c61b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558e33c7a9e0 0x558e33c61b10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5564074cb0 msgr2=0x7f5564077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5564074cb0 0x7f5564077170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5568006450 tx=0x7f5568008040 comp rx=0 tx=0).stop 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 msgr2=0x558e33c58d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 --2- 172.21.15.37:0/3788351121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e33bd4330 0x558e33c58d00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f556c046050 tx=0x7f556c002fb0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5577394640 1 -- 172.21.15.37:0/3788351121 reap_dead start 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 shutdown_connections 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 >> 172.21.15.37:0/3788351121 conn(0x558e33ba4b30 msgr2=0x558e33c59d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 shutdown_connections 2024-05-10T08:42:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.217+0000 7f5579b1ff40 1 -- 172.21.15.37:0/3788351121 wait complete. 2024-05-10T08:42:41.222 INFO:teuthology.orchestra.run.smithi037.stdout:Xfiledir_test 2024-05-10T08:42:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:41.223 DEBUG:teuthology.orchestra.run.smithi037:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-10T08:42:41.271 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "ancestors": [ 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1099511627776, 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "file", 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1, 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "dir_test", 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4 2024-05-10T08:42:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-10T08:42:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 10, 2024-05-10T08:42:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "old_pools": [] 2024-05-10T08:42:41.273 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:42:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:42:41.274 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-05-10T08:42:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.361+0000 7fcd5eb93f40 1 Processor -- start 2024-05-10T08:42:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.361+0000 7fcd5eb93f40 1 -- start start 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5eb93f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 0x55c778dd5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5eb93f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5eb93f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 0x55c778dd7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5eb93f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c778df4cd0 con 0x55c778dd6390 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5eb93f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c778dd7350 con 0x55c778d4d770 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5eb93f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c778df4150 con 0x55c778dd98b0 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60942/0 (socket says 172.21.15.37:60942) 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 -- 172.21.15.37:0/291972134 learned_addr learned my addr 172.21.15.37:0/291972134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5c68d640 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 0x55c778dd5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5ce8e640 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 0x55c778dd7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 -- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 msgr2=0x55c778dd7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 0x55c778dd7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 -- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 msgr2=0x55c778dd5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 0x55c778dd5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.362+0000 7fcd5be8c640 1 -- 172.21.15.37:0/291972134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c778c87350 con 0x55c778dd6390 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5be8c640 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df6960 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcd50025c20 tx=0x7fcd5004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7880b38b31160cad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5ae8a640 1 -- 172.21.15.37:0/291972134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50062070 con 0x55c778dd6390 2024-05-10T08:42:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5ae8a640 1 -- 172.21.15.37:0/291972134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd50054a10 con 0x55c778dd6390 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5ae8a640 1 -- 172.21.15.37:0/291972134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50059040 con 0x55c778dd6390 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/291972134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 msgr2=0x55c778df6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df6960 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcd50025c20 tx=0x7fcd5004e000 comp rx=0 tx=0).stop 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/291972134 shutdown_connections 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 0x55c778dd7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df6960 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/291972134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 0x55c778dd5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/291972134 >> 172.21.15.37:0/291972134 conn(0x55c778d1d7f0 msgr2=0x55c778d67950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/291972134 shutdown_connections 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.363+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/291972134 wait complete. 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.364+0000 7fcd5eb93f40 1 Processor -- start 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.364+0000 7fcd5eb93f40 1 -- start start 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 0x55c778dd4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 0x55c778df6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c778dd9080 con 0x55c778dd6390 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c778ded1d0 con 0x55c778d4d770 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c778ded440 con 0x55c778dd98b0 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60946/0 (socket says 172.21.15.37:60946) 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 -- 172.21.15.37:0/1347408760 learned_addr learned my addr 172.21.15.37:0/1347408760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5c68d640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 0x55c778dd4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5ce8e640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 0x55c778df6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 -- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 msgr2=0x55c778df6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c778dd98b0 0x55c778df6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 -- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 msgr2=0x55c778dd4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c778d4d770 0x55c778dd4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 -- 172.21.15.37:0/1347408760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c778d66440 con 0x55c778dd6390 2024-05-10T08:42:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5be8c640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df67b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcd50000c00 tx=0x7fcd50002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd59e88640 1 -- 172.21.15.37:0/1347408760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5006c020 con 0x55c778dd6390 2024-05-10T08:42:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd59e88640 1 -- 172.21.15.37:0/1347408760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd5005e480 con 0x55c778dd6390 2024-05-10T08:42:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c778e8aeb0 con 0x55c778dd6390 2024-05-10T08:42:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd59e88640 1 -- 172.21.15.37:0/1347408760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50059050 con 0x55c778dd6390 2024-05-10T08:42:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.365+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c778df5490 con 0x55c778dd6390 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.367+0000 7fcd59e88640 1 -- 172.21.15.37:0/1347408760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcd5006f020 con 0x55c778dd6390 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.367+0000 7fcd59e88640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd48074cb0 0x7fcd48077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.367+0000 7fcd59e88640 1 -- 172.21.15.37:0/1347408760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fcd500db2b0 con 0x55c778dd6390 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.368+0000 7fcd5c68d640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd48074cb0 0x7fcd48077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.368+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55c778dd6ed0 0x55c778e96a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.368+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62) -- 0x55c778e96f90 con 0x55c778dd6ed0 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.368+0000 7fcd5ce8e640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55c778dd6ed0 0x55c778e96a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.368+0000 7fcd5c68d640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd48074cb0 0x7fcd48077170 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55c778d4e110 tx=0x7fcd4c007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.368+0000 7fcd5ce8e640 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55c778dd6ed0 0x55c778e96a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5ce8e640 1 -- 172.21.15.37:0/1347408760 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v62'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcd54009880 con 0x55c778dd6ed0 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55c778dd6ed0 msgr2=0x55c778e96a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55c778dd6ed0 0x55c778e96a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd48074cb0 msgr2=0x7fcd48077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcd48074cb0 0x7fcd48077170 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55c778d4e110 tx=0x7fcd4c007040 comp rx=0 tx=0).stop 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 msgr2=0x55c778df67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 --2- 172.21.15.37:0/1347408760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c778dd6390 0x55c778df67b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcd50000c00 tx=0x7fcd50002fb0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5ce8e640 1 -- 172.21.15.37:0/1347408760 reap_dead start 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 shutdown_connections 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 >> 172.21.15.37:0/1347408760 conn(0x55c778d1d7f0 msgr2=0x55c778d67950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 shutdown_connections 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.370+0000 7fcd5eb93f40 1 -- 172.21.15.37:0/1347408760 wait complete. 2024-05-10T08:42:41.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:41.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-05-10T08:42:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.483+0000 7f2312f0a640 1 Processor -- start 2024-05-10T08:42:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.483+0000 7f2312f0a640 1 -- start start 2024-05-10T08:42:41.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f2312f0a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f230c0d3920 0x7f230c070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f2312f0a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f230c0cef40 0x7f230c169b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f2312f0a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f230c0d2030 con 0x7f230c0cf8f0 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f2312f0a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f230c15f8d0 con 0x7f230c0cef40 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f2312f0a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f230c0d22b0 con 0x7f230c0d3920 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f23114a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f230c0cef40 0x7f230c169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f23114a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f230c0cef40 0x7f230c169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60954/0 (socket says 172.21.15.37:60954) 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f23114a7640 1 -- 172.21.15.37:0/3364293327 learned_addr learned my addr 172.21.15.37:0/3364293327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f230bfff640 1 --2- 172.21.15.37:0/3364293327 >> v2:172.21.15.82:3300/0 conn(0x7f230c0d3920 0x7f230c070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f23114a7640 1 -- 172.21.15.37:0/3364293327 >> v2:172.21.15.82:3300/0 conn(0x7f230c0d3920 msgr2=0x7f230c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f23114a7640 1 --2- 172.21.15.37:0/3364293327 >> v2:172.21.15.82:3300/0 conn(0x7f230c0d3920 0x7f230c070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f23114a7640 1 -- 172.21.15.37:0/3364293327 >> v1:172.21.15.82:6789/0 conn(0x7f230c0cf8f0 legacy=0x7f230c070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.484+0000 7f23114a7640 1 -- 172.21.15.37:0/3364293327 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230c0d2590 con 0x7f230c0cef40 2024-05-10T08:42:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.485+0000 7f23114a7640 1 --2- 172.21.15.37:0/3364293327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0cef40 0x7f230c169b30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f230c073380 tx=0x7f230402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ed9e05e692c88 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.485+0000 7f230b7fe640 1 -- 172.21.15.37:0/3364293327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304036070 con 0x7f230c0cef40 2024-05-10T08:42:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.485+0000 7f230b7fe640 1 -- 172.21.15.37:0/3364293327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304031600 con 0x7f230c0cef40 2024-05-10T08:42:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.485+0000 7f230b7fe640 1 -- 172.21.15.37:0/3364293327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23040319f0 con 0x7f230c0cef40 2024-05-10T08:42:41.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 -- 172.21.15.37:0/3364293327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0cef40 msgr2=0x7f230c169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3364293327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0cef40 0x7f230c169b30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f230c073380 tx=0x7f230402a7c0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 -- 172.21.15.37:0/3364293327 shutdown_connections 2024-05-10T08:42:41.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3364293327 >> v2:172.21.15.82:3300/0 conn(0x7f230c0d3920 0x7f230c070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3364293327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0cef40 0x7f230c169b30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 -- 172.21.15.37:0/3364293327 >> 172.21.15.37:0/3364293327 conn(0x7f230c0d2e00 msgr2=0x7f230c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 -- 172.21.15.37:0/3364293327 shutdown_connections 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.486+0000 7f2312f0a640 1 -- 172.21.15.37:0/3364293327 wait complete. 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.487+0000 7f2312f0a640 1 Processor -- start 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.487+0000 7f2312f0a640 1 -- start start 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2312f0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230c0cef40 0x7f230c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2312f0a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f230c0cf8f0 0x7f230c157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2312f0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0d3920 0x7f230c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2312f0a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f230c0cda10 con 0x7f230c0d3920 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2312f0a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f230c0cd730 con 0x7f230c0cef40 2024-05-10T08:42:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2312f0a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f230c071610 con 0x7f230c0cf8f0 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0d3920 0x7f230c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0d3920 0x7f230c15a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60962/0 (socket says 172.21.15.37:60962) 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 -- 172.21.15.37:0/3710767504 learned_addr learned my addr 172.21.15.37:0/3710767504 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 -- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f230c0cf8f0 msgr2=0x7f230c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f230bfff640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f230c0cf8f0 0x7f230c157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2310ca6640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230c0cef40 0x7f230c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f230c0cf8f0 0x7f230c157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 -- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230c0cef40 msgr2=0x7f230c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230c0cef40 0x7f230c0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f23114a7640 1 -- 172.21.15.37:0/3710767504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230c0c87b0 con 0x7f230c0d3920 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f230bfff640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f230c0cf8f0 0x7f230c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.488+0000 7f2310ca6640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230c0cef40 0x7f230c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.489+0000 7f23114a7640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0d3920 0x7f230c15a940 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f230402adb0 tx=0x7f2304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.489+0000 7f23097fa640 1 -- 172.21.15.37:0/3710767504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304036050 con 0x7f230c0d3920 2024-05-10T08:42:41.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.489+0000 7f23097fa640 1 -- 172.21.15.37:0/3710767504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304037040 con 0x7f230c0d3920 2024-05-10T08:42:41.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.489+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230c0cd0e0 con 0x7f230c0d3920 2024-05-10T08:42:41.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.489+0000 7f23097fa640 1 -- 172.21.15.37:0/3710767504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304009510 con 0x7f230c0d3920 2024-05-10T08:42:41.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.489+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f230c158cd0 con 0x7f230c0d3920 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.491+0000 7f23097fa640 1 -- 172.21.15.37:0/3710767504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2304044020 con 0x7f230c0d3920 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.491+0000 7f23097fa640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22f80762d0 0x7f22f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.491+0000 7f23097fa640 1 -- 172.21.15.37:0/3710767504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f23040b7ab0 con 0x7f230c0d3920 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.491+0000 7f2310ca6640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22f80762d0 0x7f22f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.492+0000 7f2315c26740 1 Processor -- start 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.492+0000 7f2310ca6640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22f80762d0 0x7f22f8078790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0015e0 tx=0x7f22fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.492+0000 7f2315c26740 1 -- start start 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec8fa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f2315c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8ca4f0 0x55b3ec8cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f2315c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3ec833bc0 con 0x55b3ec8ca4f0 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b3ec7ecd30 con 0x55b3ec8f7890 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b3ec82fb80 con 0x55b3ec8f7c70 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8ca4f0 0x55b3ec8cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8ca4f0 0x55b3ec8cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60974/0 (socket says 172.21.15.37:60974) 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 -- 172.21.15.37:0/1155865273 learned_addr learned my addr 172.21.15.37:0/1155865273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f2310ca6640 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f230bfff640 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec8fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 -- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 msgr2=0x55b3ec8fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec8fa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 -- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 msgr2=0x55b3ec8fa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8fa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 -- 172.21.15.37:0/1155865273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ec7d1100 con 0x55b3ec8ca4f0 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f23114a7640 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8ca4f0 0x55b3ec8cdd00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f230407d170 tx=0x7f23040804d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36f431ced8454b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f22f27fc640 1 -- 172.21.15.37:0/1155865273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23040892a0 con 0x55b3ec8ca4f0 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f22f27fc640 1 -- 172.21.15.37:0/1155865273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304080690 con 0x55b3ec8ca4f0 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.493+0000 7f22f27fc640 1 -- 172.21.15.37:0/1155865273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304080000 con 0x55b3ec8ca4f0 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 -- 172.21.15.37:0/1155865273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8ca4f0 msgr2=0x55b3ec8cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8ca4f0 0x55b3ec8cdd00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f230407d170 tx=0x7f23040804d0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 -- 172.21.15.37:0/1155865273 shutdown_connections 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8ca4f0 0x55b3ec8cdd00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec8fa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 --2- 172.21.15.37:0/1155865273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 -- 172.21.15.37:0/1155865273 >> 172.21.15.37:0/1155865273 conn(0x55b3ec8cc760 msgr2=0x55b3ec9150a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 -- 172.21.15.37:0/1155865273 shutdown_connections 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 -- 172.21.15.37:0/1155865273 wait complete. 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.494+0000 7f2315c26740 1 -- start start 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.495+0000 7f2315c26740 1 Processor -- start 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.495+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.495+0000 7f2315c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7c70 0x55b3ec925830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.495+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8eeac0 0x55b3ec918830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.495+0000 7f2315c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3ec833bc0 con 0x55b3ec8f7c70 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.495+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b3ec7f0870 con 0x55b3ec8f7890 2024-05-10T08:42:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.495+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b3ec8cf910 con 0x55b3ec8eeac0 2024-05-10T08:42:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f2315c26740 10 client.0 _ll_register_callbacks cb 0x55b3ec840b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7c70 0x55b3ec925830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7c70 0x55b3ec925830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60986/0 (socket says 172.21.15.37:60986) 2024-05-10T08:42:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f2310ca6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 -- 172.21.15.37:0/566097569 learned_addr learned my addr 172.21.15.37:0/566097569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f23114a7640 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8eeac0 0x55b3ec918830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 -- 172.21.15.37:0/566097569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8eeac0 msgr2=0x55b3ec918830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8eeac0 0x55b3ec918830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 -- 172.21.15.37:0/566097569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 msgr2=0x55b3ec8ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 -- 172.21.15.37:0/566097569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ec6117b0 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f230bfff640 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7c70 0x55b3ec925830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2300009d20 tx=0x7f23000136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4857f8f1ee9a1c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f22eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f22eb7fe640 1 -- 172.21.15.37:0/566097569 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230001b070 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f22eb7fe640 1 -- 172.21.15.37:0/566097569 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f2300016660 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2304080690 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f22eb7fe640 1 -- 172.21.15.37:0/566097569 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2300026050 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f2315c26740 10 client.5820 fetch_fsmap learned FSMap version 34 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.496+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55b3ec671f40 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f22eb7fe640 1 -- 172.21.15.37:0/566097569 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304080690 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f22eb7fe640 1 -- 172.21.15.37:0/566097569 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f2300016860 con 0x55b3ec8f7c70 2024-05-10T08:42:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2315c26740 10 client.5820 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2315c26740 10 client.5820 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2315c26740 20 client.5820 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2315c26740 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec8f0630 0x55b3ec8f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2315c26740 4 client.5820 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3ec8417d0 con 0x55b3ec8f0630 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2310ca6640 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec8f0630 0x55b3ec8f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f2310ca6640 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec8f0630 0x55b3ec8f0a90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df01733f34684418 server_cookie=8990196180a69355 in_seq=0 out_seq=0 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.497+0000 7f22eb7fe640 10 client.5820 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f22eb7fe640 1 -- 172.21.15.37:0/566097569 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b3ec8417d0 con 0x55b3ec8f0630 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f22eb7fe640 10 client.5820 handle_command_reply: tid=0 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 client.5820 shutdown 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7c70 msgr2=0x55b3ec925830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7c70 0x55b3ec925830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2300009d20 tx=0x7f23000136b0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 shutdown_connections 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8eeac0 0x55b3ec918830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec8f0630 0x55b3ec8f0a90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7c70 0x55b3ec925830 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 --2- 172.21.15.37:0/566097569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f22eb7fe640 0 client.5820 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 >> 172.21.15.37:0/566097569 conn(0x55b3ec8ca4f0 msgr2=0x55b3ec8c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 shutdown_connections 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 1 -- 172.21.15.37:0/566097569 wait complete. 2024-05-10T08:42:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.498+0000 7f2315c26740 20 client.5820 trim_cache size 0 max 16384 2024-05-10T08:42:41.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.516+0000 7f2315c26740 1 Processor -- start 2024-05-10T08:42:41.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.516+0000 7f2315c26740 1 -- start start 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 0x55b3ec8cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f2315c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec8ec480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f2315c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f230c201e40 con 0x55b3ec8f7890 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f230c200e20 con 0x55b3ec8eeac0 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f230c1f8e30 con 0x55b3ec8f7c70 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ebf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60994/0 (socket says 172.21.15.37:60994) 2024-05-10T08:42:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 -- 172.21.15.37:0/992173604 learned_addr learned my addr 172.21.15.37:0/992173604 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 -- 172.21.15.37:0/992173604 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 msgr2=0x55b3ec8ec480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 --2- 172.21.15.37:0/992173604 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec8ec480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 -- 172.21.15.37:0/992173604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 msgr2=0x55b3ec8cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 --2- 172.21.15.37:0/992173604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 0x55b3ec8cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.517+0000 7f230bfff640 1 -- 172.21.15.37:0/992173604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ec5050a0 con 0x55b3ec8f7890 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f230bfff640 1 --2- 172.21.15.37:0/992173604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ebf40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2300013be0 tx=0x7f2300018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87eacf507231e70 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f22f1ffb640 1 -- 172.21.15.37:0/992173604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230001b030 con 0x55b3ec8f7890 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f22f1ffb640 1 -- 172.21.15.37:0/992173604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230002f070 con 0x55b3ec8f7890 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f22f1ffb640 1 -- 172.21.15.37:0/992173604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230000f040 con 0x55b3ec8f7890 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 -- 172.21.15.37:0/992173604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 msgr2=0x55b3ec8ebf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 --2- 172.21.15.37:0/992173604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ebf40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2300013be0 tx=0x7f2300018000 comp rx=0 tx=0).stop 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 -- 172.21.15.37:0/992173604 shutdown_connections 2024-05-10T08:42:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 --2- 172.21.15.37:0/992173604 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec8ec480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 --2- 172.21.15.37:0/992173604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec8ebf40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 --2- 172.21.15.37:0/992173604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 0x55b3ec8cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 -- 172.21.15.37:0/992173604 >> 172.21.15.37:0/992173604 conn(0x55b3ec8ca4f0 msgr2=0x55b3ec8c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.518+0000 7f2315c26740 1 -- 172.21.15.37:0/992173604 shutdown_connections 2024-05-10T08:42:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.519+0000 7f2315c26740 1 -- 172.21.15.37:0/992173604 wait complete. 2024-05-10T08:42:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.519+0000 7f2315c26740 1 -- start start 2024-05-10T08:42:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.519+0000 7f2315c26740 1 Processor -- start 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 0x55b3ec993ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2315c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec92eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2315c26740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec9239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2315c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3ec7d45b0 con 0x55b3ec8f7890 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f230c1f9480 con 0x55b3ec8eeac0 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2315c26740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b3ec8f1090 con 0x55b3ec8f7c70 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2315c26740 10 client.0 _ll_register_callbacks cb 0x7f2300009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec92eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec92eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32772/0 (socket says 172.21.15.37:32772) 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 -- 172.21.15.37:0/1934792839 learned_addr learned my addr 172.21.15.37:0/1934792839 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f2310ca6640 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 0x55b3ec993ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f23114a7640 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec9239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 -- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 msgr2=0x55b3ec9239f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec9239f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 -- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 msgr2=0x55b3ec993ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 0x55b3ec993ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.520+0000 7f230bfff640 1 -- 172.21.15.37:0/1934792839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ec9391d0 con 0x55b3ec8f7890 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f230bfff640 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec92eff0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2300016ce0 tx=0x7f23000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4417a04645d972ad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f22eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f22eb7fe640 1 -- 172.21.15.37:0/1934792839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300038060 con 0x55b3ec8f7890 2024-05-10T08:42:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f22eb7fe640 1 -- 172.21.15.37:0/1934792839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f2300004050 con 0x55b3ec8f7890 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f230002f070 con 0x55b3ec8f7890 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f22eb7fe640 1 -- 172.21.15.37:0/1934792839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f230003e050 con 0x55b3ec8f7890 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 10 client.5826 fetch_fsmap learned FSMap version 34 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55b3ec979560 con 0x55b3ec8f7890 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f22eb7fe640 1 -- 172.21.15.37:0/1934792839 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230002f070 con 0x55b3ec8f7890 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f22eb7fe640 1 -- 172.21.15.37:0/1934792839 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f2300041020 con 0x55b3ec8f7890 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 10 client.5826 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 10 client.5826 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 20 client.5826 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec923f30 0x55b3ec8ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 4 client.5826 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x55b3ec83b640 con 0x55b3ec923f30 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.521+0000 7f2310ca6640 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec923f30 0x55b3ec8ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.522+0000 7f22eb7fe640 10 client.5826 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.522+0000 7f2310ca6640 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec923f30 0x55b3ec8ebf40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b9a4f6db146e63 server_cookie=1b59db6fe3441c15 in_seq=0 out_seq=0 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.522+0000 7f22eb7fe640 1 -- 172.21.15.37:0/1934792839 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b3ec83b640 con 0x55b3ec923f30 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.522+0000 7f22eb7fe640 10 client.5826 handle_command_reply: tid=0 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.522+0000 7f2315c26740 1 client.5826 shutdown 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.522+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 msgr2=0x55b3ec92eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.522+0000 7f2315c26740 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec92eff0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2300016ce0 tx=0x7f23000046c0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 shutdown_connections 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b3ec8f7c70 0x55b3ec9239f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55b3ec923f30 0x55b3ec8ebf40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3ec8f7890 0x55b3ec92eff0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 --2- 172.21.15.37:0/1934792839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3ec8eeac0 0x55b3ec993ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 >> 172.21.15.37:0/1934792839 conn(0x55b3ec8ca4f0 msgr2=0x55b3ec915130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.529 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f1d3926d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5781=0-4194304@1} caps={5781=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5781 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5568900de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:42:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f22eb7fe640 0 client.5826 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 shutdown_connections 2024-05-10T08:42:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 1 -- 172.21.15.37:0/1934792839 wait complete. 2024-05-10T08:42:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2315c26740 20 client.5826 trim_cache size 0 max 16384 2024-05-10T08:42:41.530 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:42:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:42:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "9d4c8b33-7bd5-4581-9b22-89365b18b0f2", 2024-05-10T08:42:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:42:41.530 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22f80762d0 msgr2=0x7f22f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22f80762d0 0x7f22f8078790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0015e0 tx=0x7f22fc009040 comp rx=0 tx=0).stop 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0d3920 msgr2=0x7f230c15a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0d3920 0x7f230c15a940 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f230402adb0 tx=0x7f2304004a40 comp rx=0 tx=0).stop 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 shutdown_connections 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22f80762d0 0x7f22f8078790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0d3920 0x7f230c15a940 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f230c0cf8f0 0x7f230c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.523+0000 7f2312f0a640 1 --2- 172.21.15.37:0/3710767504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230c0cef40 0x7f230c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.524+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 >> 172.21.15.37:0/3710767504 conn(0x7f230c0d2e00 msgr2=0x7f230c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.524+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 shutdown_connections 2024-05-10T08:42:41.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.524+0000 7f2312f0a640 1 -- 172.21.15.37:0/3710767504 wait complete. 2024-05-10T08:42:41.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:42:41.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T08:42:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.642+0000 7f7eb7178640 1 Processor -- start 2024-05-10T08:42:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.643+0000 7f7eb7178640 1 -- start start 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.643+0000 7f7eb7178640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb015ccb0 0x7f7eb015d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.643+0000 7f7eb7178640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7eb00d2ce0 0x7f7eb00d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.643+0000 7f7eb7178640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb00718c0 con 0x7f7eb0070b90 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.643+0000 7f7eb7178640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7eb00afba0 con 0x7f7eb00d2ce0 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.643+0000 7f7eb7178640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb0071ba0 con 0x7f7eb015ccb0 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.643+0000 7f7eaffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7eb00d2ce0 0x7f7eb00d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eaffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7eb00d2ce0 0x7f7eb00d3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32786/0 (socket says 172.21.15.37:32786) 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eb5715640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7eb0070b90 0x7f7eb0071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52732/0 (socket says 172.21.15.37:52732) 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eaffff640 1 -- 172.21.15.37:0/4184971119 learned_addr learned my addr 172.21.15.37:0/4184971119 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/4184971119 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb015ccb0 0x7f7eb015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eaffff640 1 -- 172.21.15.37:0/4184971119 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb015ccb0 msgr2=0x7f7eb015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eaffff640 1 --2- 172.21.15.37:0/4184971119 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb015ccb0 0x7f7eb015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eaffff640 1 -- 172.21.15.37:0/4184971119 >> v1:172.21.15.37:6789/0 conn(0x7f7eb0070b90 legacy=0x7f7eb0071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eaffff640 1 -- 172.21.15.37:0/4184971119 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb0071e80 con 0x7f7eb00d2ce0 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.644+0000 7f7eaf7fe640 1 -- 172.21.15.37:0/4184971119 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139746799 0 0) 0x7f7eb00718c0 con 0x7f7eb0070b90 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eaffff640 1 --2- 172.21.15.37:0/4184971119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb00d3120 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009e80 tx=0x7f7ea002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff925189c02a1ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eaf7fe640 1 -- 172.21.15.37:0/4184971119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0036070 con 0x7f7eb00d2ce0 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eaf7fe640 1 -- 172.21.15.37:0/4184971119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea0031600 con 0x7f7eb00d2ce0 2024-05-10T08:42:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eaf7fe640 1 -- 172.21.15.37:0/4184971119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00319d0 con 0x7f7eb00d2ce0 2024-05-10T08:42:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 -- 172.21.15.37:0/4184971119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb00d2ce0 msgr2=0x7f7eb00d3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 --2- 172.21.15.37:0/4184971119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb00d3120 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009e80 tx=0x7f7ea002a6c0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 -- 172.21.15.37:0/4184971119 shutdown_connections 2024-05-10T08:42:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 --2- 172.21.15.37:0/4184971119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb00d3120 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 --2- 172.21.15.37:0/4184971119 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb015ccb0 0x7f7eb015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 -- 172.21.15.37:0/4184971119 >> 172.21.15.37:0/4184971119 conn(0x7f7eb009ba40 msgr2=0x7f7eb009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 -- 172.21.15.37:0/4184971119 shutdown_connections 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.645+0000 7f7eb7178640 1 -- 172.21.15.37:0/4184971119 wait complete. 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.646+0000 7f7eb7178640 1 Processor -- start 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.647+0000 7f7eb7178640 1 -- start start 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.647+0000 7f7eb7178640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb0070b90 0x7f7eb00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.647+0000 7f7eb7178640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb01f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.647+0000 7f7eb7178640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb015ccb0 0x7f7eb01572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.647+0000 7f7eb7178640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb00cf980 con 0x7f7eb015ccb0 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.647+0000 7f7eb7178640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb00d3660 con 0x7f7eb00d2ce0 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.647+0000 7f7eb7178640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb00cfb00 con 0x7f7eb0070b90 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb015ccb0 0x7f7eb01572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb015ccb0 0x7f7eb01572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32790/0 (socket says 172.21.15.37:32790) 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 -- 172.21.15.37:0/3563144786 learned_addr learned my addr 172.21.15.37:0/3563144786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb0070b90 0x7f7eb00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eaffff640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb01f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 -- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb0070b90 msgr2=0x7f7eb00c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb0070b90 0x7f7eb00c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 -- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb00d2ce0 msgr2=0x7f7eb01f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb01f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 -- 172.21.15.37:0/3563144786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb01f9630 con 0x7f7eb015ccb0 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb0070b90 0x7f7eb00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eaffff640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb01f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb5715640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb015ccb0 0x7f7eb01572a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800c410 tx=0x7f7e9800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7ead7fa640 1 -- 172.21.15.37:0/3563144786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980074e0 con 0x7f7eb015ccb0 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7ead7fa640 1 -- 172.21.15.37:0/3563144786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e980047e0 con 0x7f7eb015ccb0 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7ead7fa640 1 -- 172.21.15.37:0/3563144786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98004bd0 con 0x7f7eb015ccb0 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb00c9090 con 0x7f7eb015ccb0 2024-05-10T08:42:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.648+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb00c9650 con 0x7f7eb015ccb0 2024-05-10T08:42:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.650+0000 7f7ead7fa640 1 -- 172.21.15.37:0/3563144786 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e98011070 con 0x7f7eb015ccb0 2024-05-10T08:42:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.650+0000 7f7ead7fa640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7e900762d0 0x7f7e90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.650+0000 7f7ead7fa640 1 -- 172.21.15.37:0/3563144786 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f7e98097280 con 0x7f7eb015ccb0 2024-05-10T08:42:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.651+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7e900762d0 0x7f7e90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.651+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7e900762d0 0x7f7e90078790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8006fd0 tx=0x7f7ea8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.651+0000 7f7eb9f69740 1 Processor -- start 2024-05-10T08:42:41.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.651+0000 7f7eb9f69740 1 -- start start 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce1374af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a4b40 0x55fce1379950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fce1341690 con 0x55fce13c2160 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fce12def30 con 0x55fce13a4b40 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fce1297b20 con 0x55fce13a5280 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce1374af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce1374af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32798/0 (socket says 172.21.15.37:32798) 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 -- 172.21.15.37:0/4244103420 learned_addr learned my addr 172.21.15.37:0/4244103420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eaffff640 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb5715640 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a4b40 0x55fce1379950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 -- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 msgr2=0x55fce13a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 -- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a4b40 msgr2=0x55fce1379950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a4b40 0x55fce1379950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eb4f14640 1 -- 172.21.15.37:0/4244103420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fce128fe60 con 0x55fce13c2160 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.652+0000 7f7eaffff640 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce1374af0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004300 tx=0x7f7ea8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dd39ef8e99a018 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7ea67fc640 1 -- 172.21.15.37:0/4244103420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800f040 con 0x55fce13c2160 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7ea67fc640 1 -- 172.21.15.37:0/4244103420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea80043f0 con 0x55fce13c2160 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7ea67fc640 1 -- 172.21.15.37:0/4244103420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800eea0 con 0x55fce13c2160 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 -- 172.21.15.37:0/4244103420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 msgr2=0x55fce1374af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce1374af0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004300 tx=0x7f7ea8011000 comp rx=0 tx=0).stop 2024-05-10T08:42:41.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 -- 172.21.15.37:0/4244103420 shutdown_connections 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a4b40 0x55fce1379950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/4244103420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce1374af0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 -- 172.21.15.37:0/4244103420 >> 172.21.15.37:0/4244103420 conn(0x55fce1376d60 msgr2=0x55fce13bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 -- 172.21.15.37:0/4244103420 shutdown_connections 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.653+0000 7f7eb9f69740 1 -- 172.21.15.37:0/4244103420 wait complete. 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.654+0000 7f7eb9f69740 1 -- start start 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.654+0000 7f7eb9f69740 1 Processor -- start 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 0x55fce13d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13b7500 0x55fce13a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fce129b5e0 con 0x55fce13c2160 2024-05-10T08:42:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fce12daef0 con 0x55fce13a5280 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fce1378f10 con 0x55fce13b7500 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eb9f69740 10 client.0 _ll_register_callbacks cb 0x55fce1296320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32806/0 (socket says 172.21.15.37:32806) 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 -- 172.21.15.37:0/18161857 learned_addr learned my addr 172.21.15.37:0/18161857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 -- 172.21.15.37:0/18161857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13b7500 msgr2=0x55fce13a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13b7500 0x55fce13a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 -- 172.21.15.37:0/18161857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 msgr2=0x55fce13d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 0x55fce13d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.655+0000 7f7eaffff640 1 -- 172.21.15.37:0/18161857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fce10ba7d0 con 0x55fce13c2160 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eaffff640 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13b6fc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009fa0 tx=0x7f7ea0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726d0bbde0895c8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7e8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/18161857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0040030 con 0x55fce13c2160 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/18161857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f7ea0004470 con 0x55fce13c2160 2024-05-10T08:42:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ea80043f0 con 0x55fce13c2160 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/18161857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7ea004c050 con 0x55fce13c2160 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 10 client.5841 fetch_fsmap learned FSMap version 34 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55fce0ff03f0 con 0x55fce13c2160 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/18161857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea80043f0 con 0x55fce13c2160 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/18161857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f7ea0008040 con 0x55fce13c2160 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 10 client.5841 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 10 client.5841 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 20 client.5841 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce13a7c20 0x55fce13a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 4 client.5841 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fce12ecb40 con 0x55fce13a7c20 2024-05-10T08:42:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.656+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce13a7c20 0x55fce13a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce13a7c20 0x55fce13a80b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b56c67eaea96ff1 server_cookie=70b0bc54837769c3 in_seq=0 out_seq=0 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7e8f7fe640 10 client.5841 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/18161857 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fce12ecb40 con 0x55fce13a7c20 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7e8f7fe640 10 client.5841 handle_command_reply: tid=0 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 client.5841 shutdown 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 msgr2=0x55fce13b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13b6fc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009fa0 tx=0x7f7ea0004ab0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 shutdown_connections 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13b7500 0x55fce13a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce13a7c20 0x55fce13a80b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13b6fc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/18161857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 0x55fce13d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7e8f7fe640 0 client.5841 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.657+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 >> 172.21.15.37:0/18161857 conn(0x55fce13a4b40 msgr2=0x55fce13bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.658+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 shutdown_connections 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.658+0000 7f7eb9f69740 1 -- 172.21.15.37:0/18161857 wait complete. 2024-05-10T08:42:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.658+0000 7f7eb9f69740 20 client.5841 trim_cache size 0 max 16384 2024-05-10T08:42:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 Processor -- start 2024-05-10T08:42:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 -- start start 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13b7500 0x55fce137ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13d9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0201d00 con 0x55fce13c2160 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0200ce0 con 0x55fce13b7500 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.676+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb006e270 con 0x55fce13a5280 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13d9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13d9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32820/0 (socket says 172.21.15.37:32820) 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 -- 172.21.15.37:0/68973985 learned_addr learned my addr 172.21.15.37:0/68973985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 -- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 msgr2=0x55fce13b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 -- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13b7500 msgr2=0x55fce137ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eaffff640 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13b7500 0x55fce137ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13b7500 0x55fce137ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 -- 172.21.15.37:0/68973985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fce0fb00f0 con 0x55fce13c2160 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eaffff640 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13b7500 0x55fce137ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7eb5715640 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13d9aa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7e98060040 tx=0x7f7e9805fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d36fbb0f4b1a9f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7ea5ffb640 1 -- 172.21.15.37:0/68973985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98060a40 con 0x55fce13c2160 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7ea5ffb640 1 -- 172.21.15.37:0/68973985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e98060340 con 0x55fce13c2160 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.677+0000 7f7ea5ffb640 1 -- 172.21.15.37:0/68973985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980646f0 con 0x55fce13c2160 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 -- 172.21.15.37:0/68973985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 msgr2=0x55fce13d9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13d9aa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7e98060040 tx=0x7f7e9805fd50 comp rx=0 tx=0).stop 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 -- 172.21.15.37:0/68973985 shutdown_connections 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13c2160 0x55fce13d9aa0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13b7500 0x55fce137ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/68973985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13a5280 0x55fce13b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 -- 172.21.15.37:0/68973985 >> 172.21.15.37:0/68973985 conn(0x55fce13a4b40 msgr2=0x55fce13b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 -- 172.21.15.37:0/68973985 shutdown_connections 2024-05-10T08:42:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 -- 172.21.15.37:0/68973985 wait complete. 2024-05-10T08:42:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 -- start start 2024-05-10T08:42:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.678+0000 7f7eb9f69740 1 Processor -- start 2024-05-10T08:42:41.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 0x55fce13a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13b7500 0x55fce13a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb9f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13c2160 0x55fce13a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fce13bed10 con 0x55fce13b7500 2024-05-10T08:42:41.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb00cc8d0 con 0x55fce13a5280 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb9f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fce13b60a0 con 0x55fce13c2160 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb9f69740 10 client.0 _ll_register_callbacks cb 0x7f7ea0034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13b7500 0x55fce13a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13b7500 0x55fce13a5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32826/0 (socket says 172.21.15.37:32826) 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eaffff640 1 -- 172.21.15.37:0/721836266 learned_addr learned my addr 172.21.15.37:0/721836266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 0x55fce13a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.679+0000 7f7eb5715640 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13c2160 0x55fce13a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eaffff640 1 -- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13c2160 msgr2=0x55fce13a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eaffff640 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13c2160 0x55fce13a61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eaffff640 1 -- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 msgr2=0x55fce13a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eaffff640 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 0x55fce13a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eaffff640 1 -- 172.21.15.37:0/721836266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fce1374620 con 0x55fce13b7500 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eaffff640 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13b7500 0x55fce13a5ca0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009600 tx=0x7f7ea0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec4169fdc46314d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:42:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7e8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/721836266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0055060 con 0x55fce13b7500 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/721836266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f7ea0004310 con 0x55fce13b7500 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e98060340 con 0x55fce13b7500 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/721836266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7ea005b050 con 0x55fce13b7500 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 10 client.5847 fetch_fsmap learned FSMap version 34 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55fce1398b10 con 0x55fce13b7500 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/721836266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e98060340 con 0x55fce13b7500 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/721836266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7f7ea005e020 con 0x55fce13b7500 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 10 client.5847 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 10 client.5847 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 20 client.5847 populate_metadata read hostname 'smithi037' 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce1399030 0x55fce1378820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 4 client.5847 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:42:41.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fce13a6bd0 con 0x55fce1399030 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.680+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce1399030 0x55fce1378820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7e8f7fe640 10 client.5847 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb4f14640 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce1399030 0x55fce1378820 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465685a49b671dcc server_cookie=5bb15bd7c3457917 in_seq=0 out_seq=0 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7e8f7fe640 1 -- 172.21.15.37:0/721836266 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+253 (crc 0 0 0) 0x55fce13a6bd0 con 0x55fce1399030 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7e8f7fe640 10 client.5847 handle_command_reply: tid=0 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 client.5847 shutdown 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13b7500 msgr2=0x55fce13a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13b7500 0x55fce13a5ca0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009600 tx=0x7f7ea0009810 comp rx=0 tx=0).stop 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 shutdown_connections 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fce13c2160 0x55fce13a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55fce1399030 0x55fce1378820 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fce13b7500 0x55fce13a5ca0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 --2- 172.21.15.37:0/721836266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fce13a5280 0x55fce13a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 >> 172.21.15.37:0/721836266 conn(0x55fce13a4b40 msgr2=0x55fce13a0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7e8f7fe640 0 client.5847 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 shutdown_connections 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 1 -- 172.21.15.37:0/721836266 wait complete. 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.681+0000 7f7eb9f69740 20 client.5847 trim_cache size 0 max 16384 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "9d4c8b33-7bd5-4581-9b22-89365b18b0f2": { 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "9d4c8b33-7bd5-4581-9b22-89365b18b0f2", 2024-05-10T08:42:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive" 2024-05-10T08:42:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:42:41.688 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:42:41.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7e900762d0 msgr2=0x7f7e90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7e900762d0 0x7f7e90078790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8006fd0 tx=0x7f7ea8008040 comp rx=0 tx=0).stop 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb015ccb0 msgr2=0x7f7eb01572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb015ccb0 0x7f7eb01572a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800c410 tx=0x7f7e9800c8d0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 shutdown_connections 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7e900762d0 0x7f7e90078790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb015ccb0 0x7f7eb01572a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb00d2ce0 0x7f7eb01f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 --2- 172.21.15.37:0/3563144786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7eb0070b90 0x7f7eb00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 >> 172.21.15.37:0/3563144786 conn(0x7f7eb009ba40 msgr2=0x7f7eb009be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 shutdown_connections 2024-05-10T08:42:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:42:41.682+0000 7f7eb7178640 1 -- 172.21.15.37:0/3563144786 wait complete. 2024-05-10T08:42:41.692 INFO:tasks.cephfs.filesystem:scrub status for tag:9d4c8b33-7bd5-4581-9b22-89365b18b0f2 - {'path': '/', 'tag': '9d4c8b33-7bd5-4581-9b22-89365b18b0f2', 'options': 'recursive'} 2024-05-10T08:42:45.578 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:42:45.579+0000 7fdeb3164640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T08:42:53.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:42:53.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:43:11.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:43:11.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T08:43:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.813+0000 7f8486b7f640 1 Processor -- start 2024-05-10T08:43:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.813+0000 7f8486b7f640 1 -- start start 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f8486b7f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f84800aedf0 0x7f84800b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f8486b7f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848009ff30 con 0x7f848006c3a0 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f8486b7f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848015d750 con 0x7f848015d180 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f8486b7f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f848015e360 con 0x7f84800aedf0 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f848491b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f848006c3a0 0x7f848006c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51520/0 (socket says 172.21.15.37:51520) 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f848491b640 1 -- 172.21.15.37:0/425836001 learned_addr learned my addr 172.21.15.37:0/425836001 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f847ffff640 1 --2- 172.21.15.37:0/425836001 >> v2:172.21.15.82:3300/0 conn(0x7f84800aedf0 0x7f84800b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f847f7fe640 1 -- 172.21.15.37:0/425836001 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996910128 0 0) 0x7f848009ff30 con 0x7f848006c3a0 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.814+0000 7f847f7fe640 1 -- 172.21.15.37:0/425836001 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8470003520 con 0x7f848006c3a0 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.815+0000 7f847f7fe640 1 -- 172.21.15.37:0/425836001 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2275455151 0 0) 0x7f8470003520 con 0x7f848006c3a0 2024-05-10T08:43:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.815+0000 7f847ffff640 1 -- 172.21.15.37:0/425836001 >> v1:172.21.15.82:6789/0 conn(0x7f848015d180 legacy=0x7f84800b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.815+0000 7f847ffff640 1 -- 172.21.15.37:0/425836001 >> v1:172.21.15.37:6789/0 conn(0x7f848006c3a0 legacy=0x7f848006c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.815+0000 7f847ffff640 1 -- 172.21.15.37:0/425836001 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848015da30 con 0x7f84800aedf0 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.815+0000 7f847ffff640 1 --2- 172.21.15.37:0/425836001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84800aedf0 0x7f84800b13f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f846c0097a0 tx=0x7f846c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=942f003b62b6e73e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f847f7fe640 1 -- 172.21.15.37:0/425836001 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c037070 con 0x7f84800aedf0 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f847f7fe640 1 -- 172.21.15.37:0/425836001 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c02ac50 con 0x7f84800aedf0 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f847f7fe640 1 -- 172.21.15.37:0/425836001 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474001670 con 0x7f84800aedf0 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f8486b7f640 1 -- 172.21.15.37:0/425836001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84800aedf0 msgr2=0x7f84800b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f8486b7f640 1 --2- 172.21.15.37:0/425836001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84800aedf0 0x7f84800b13f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f846c0097a0 tx=0x7f846c02a1c0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f8486b7f640 1 -- 172.21.15.37:0/425836001 shutdown_connections 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f8486b7f640 1 --2- 172.21.15.37:0/425836001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84800aedf0 0x7f84800b13f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f8486b7f640 1 -- 172.21.15.37:0/425836001 >> 172.21.15.37:0/425836001 conn(0x7f84800b3b10 msgr2=0x7f84800b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f8486b7f640 1 -- 172.21.15.37:0/425836001 shutdown_connections 2024-05-10T08:43:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.816+0000 7f8486b7f640 1 -- 172.21.15.37:0/425836001 wait complete. 2024-05-10T08:43:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.817+0000 7f8486b7f640 1 Processor -- start 2024-05-10T08:43:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.818+0000 7f8486b7f640 1 -- start start 2024-05-10T08:43:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.818+0000 7f8486b7f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f848006c3a0 0x7f84801591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f8486b7f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84800aedf0 0x7f84801427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f8486b7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015d180 0x7f84801578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f8486b7f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f84800b6130 con 0x7f84800aedf0 2024-05-10T08:43:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f8486b7f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f848015dff0 con 0x7f848015d180 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f8486b7f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f84800b62b0 con 0x7f848006c3a0 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84800aedf0 0x7f84801427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84800aedf0 0x7f84801427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48198/0 (socket says 172.21.15.37:48198) 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 -- 172.21.15.37:0/4256836953 learned_addr learned my addr 172.21.15.37:0/4256836953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f848491b640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f848006c3a0 0x7f84801591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f848511c640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015d180 0x7f84801578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 -- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f848006c3a0 msgr2=0x7f84801591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f848006c3a0 0x7f84801591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 -- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015d180 msgr2=0x7f84801578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015d180 0x7f84801578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 -- 172.21.15.37:0/4256836953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8480142d20 con 0x7f84800aedf0 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f848511c640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015d180 0x7f84801578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847ffff640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84800aedf0 0x7f84801427e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f846c0098c0 tx=0x7f846c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847d7fa640 1 -- 172.21.15.37:0/4256836953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c037050 con 0x7f84800aedf0 2024-05-10T08:43:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847d7fa640 1 -- 172.21.15.37:0/4256836953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c043070 con 0x7f84800aedf0 2024-05-10T08:43:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f847d7fa640 1 -- 172.21.15.37:0/4256836953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c006e10 con 0x7f84800aedf0 2024-05-10T08:43:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.819+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8480158140 con 0x7f84800aedf0 2024-05-10T08:43:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.820+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8480158700 con 0x7f84800aedf0 2024-05-10T08:43:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.821+0000 7f847d7fa640 1 -- 172.21.15.37:0/4256836953 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f846c03c810 con 0x7f84800aedf0 2024-05-10T08:43:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.822+0000 7f847d7fa640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84640762d0 0x7f8464078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.822+0000 7f847d7fa640 1 -- 172.21.15.37:0/4256836953 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f846c0b81f0 con 0x7f84800aedf0 2024-05-10T08:43:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.822+0000 7f848491b640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84640762d0 0x7f8464078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f848491b640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84640762d0 0x7f8464078790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8474005880 tx=0x7f8474000bc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 Processor -- start 2024-05-10T08:43:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 -- start start 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b1aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b4a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4ab40 0x563b60b1f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b60ae7690 con 0x563b60b4b280 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563b60a84f30 con 0x563b60b4ab40 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.823+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563b60a3db20 con 0x563b60b68160 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b4a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b4a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48206/0 (socket says 172.21.15.37:48206) 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 -- 172.21.15.37:0/2908458242 learned_addr learned my addr 172.21.15.37:0/2908458242 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f848491b640 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b1aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f848511c640 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4ab40 0x563b60b1f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 -- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 msgr2=0x563b60b1aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b1aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 -- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4ab40 msgr2=0x563b60b1f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4ab40 0x563b60b1f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 -- 172.21.15.37:0/2908458242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b60a35e60 con 0x563b60b4b280 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f847ffff640 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b4a600 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f846c07d6f0 tx=0x7f846c080b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314bb43afd1cffeb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f846a7fc640 1 -- 172.21.15.37:0/2908458242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c081800 con 0x563b60b4b280 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f846a7fc640 1 -- 172.21.15.37:0/2908458242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c038040 con 0x563b60b4b280 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.824+0000 7f846a7fc640 1 -- 172.21.15.37:0/2908458242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c081100 con 0x563b60b4b280 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 -- 172.21.15.37:0/2908458242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 msgr2=0x563b60b4a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b4a600 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f846c07d6f0 tx=0x7f846c080b10 comp rx=0 tx=0).stop 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 -- 172.21.15.37:0/2908458242 shutdown_connections 2024-05-10T08:43:11.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4ab40 0x563b60b1f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b4a600 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 --2- 172.21.15.37:0/2908458242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b1aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 -- 172.21.15.37:0/2908458242 >> 172.21.15.37:0/2908458242 conn(0x563b60b1cd60 msgr2=0x563b60b65600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:11.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 -- 172.21.15.37:0/2908458242 shutdown_connections 2024-05-10T08:43:11.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 -- 172.21.15.37:0/2908458242 wait complete. 2024-05-10T08:43:11.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.825+0000 7f8489971740 1 -- start start 2024-05-10T08:43:11.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.826+0000 7f8489971740 1 Processor -- start 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.826+0000 7f8489971740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b3b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.826+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b5c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.826+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b66bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.826+0000 7f8489971740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b60a415e0 con 0x563b60b4b280 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563b60a80ef0 con 0x563b60b5ddb0 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563b60b1ef10 con 0x563b60b68160 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f8489971740 10 client.0 _ll_register_callbacks cb 0x563b60a3c320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b3b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48214/0 (socket says 172.21.15.37:48214) 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 -- 172.21.15.37:0/1843732208 learned_addr learned my addr 172.21.15.37:0/1843732208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f847ffff640 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b5c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848511c640 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b66bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 -- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 msgr2=0x563b60b5c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b5c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 -- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 msgr2=0x563b60b66bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b66bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 -- 172.21.15.37:0/1843732208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b608607d0 con 0x563b60b4b280 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f848491b640 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b3b140 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8474014a60 tx=0x7f84740011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daada1400fcac75 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f845f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f845f7fe640 1 -- 172.21.15.37:0/1843732208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847400f8e0 con 0x563b60b4b280 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f845f7fe640 1 -- 172.21.15.37:0/1843732208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f8474013b40 con 0x563b60b4b280 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f846c038040 con 0x563b60b4b280 2024-05-10T08:43:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f845f7fe640 1 -- 172.21.15.37:0/1843732208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f847402e050 con 0x563b60b4b280 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f8489971740 10 client.5859 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.827+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x563b607963f0 con 0x563b60b4b280 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f845f7fe640 1 -- 172.21.15.37:0/1843732208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c038040 con 0x563b60b4b280 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f845f7fe640 1 -- 172.21.15.37:0/1843732208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f8474031020 con 0x563b60b4b280 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f8489971740 10 client.5859 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f8489971740 10 client.5859 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f8489971740 20 client.5859 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f8489971740 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60b75460 0x563b60b758d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f8489971740 4 client.5859 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b60a92b40 con 0x563b60b75460 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f847ffff640 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60b75460 0x563b60b758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f847ffff640 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60b75460 0x563b60b758d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45570b0895cfd7ae server_cookie=864d50d5e2b8f384 in_seq=0 out_seq=0 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.828+0000 7f845f7fe640 10 client.5859 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f845f7fe640 1 -- 172.21.15.37:0/1843732208 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b60a92b40 con 0x563b60b75460 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f845f7fe640 10 client.5859 handle_command_reply: tid=0 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 client.5859 shutdown 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 msgr2=0x563b60b3b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b3b140 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8474014a60 tx=0x7f84740011a0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 shutdown_connections 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b66bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b5c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60b75460 0x563b60b758d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 --2- 172.21.15.37:0/1843732208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b3b140 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f845f7fe640 0 client.5859 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 >> 172.21.15.37:0/1843732208 conn(0x563b60b4ab40 msgr2=0x563b60b1a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 shutdown_connections 2024-05-10T08:43:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 1 -- 172.21.15.37:0/1843732208 wait complete. 2024-05-10T08:43:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.829+0000 7f8489971740 20 client.5859 trim_cache size 0 max 16384 2024-05-10T08:43:11.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.847+0000 7f8489971740 1 Processor -- start 2024-05-10T08:43:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.847+0000 7f8489971740 1 -- start start 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4b280 0x563b60b3af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b5ddb0 0x563b60b459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f8489971740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b68160 0x563b60b63650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f8489971740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8480202050 con 0x563b60b68160 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8480201030 con 0x563b60b4b280 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8480151510 con 0x563b60b5ddb0 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b68160 0x563b60b63650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b68160 0x563b60b63650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48216/0 (socket says 172.21.15.37:48216) 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 -- 172.21.15.37:0/1097679397 learned_addr learned my addr 172.21.15.37:0/1097679397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 -- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b5ddb0 msgr2=0x563b60b459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f847ffff640 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b5ddb0 0x563b60b459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848491b640 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4b280 0x563b60b3af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b5ddb0 0x563b60b459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 -- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4b280 msgr2=0x563b60b3af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4b280 0x563b60b3af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848511c640 1 -- 172.21.15.37:0/1097679397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b607560f0 con 0x563b60b68160 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f847ffff640 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b5ddb0 0x563b60b459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.848+0000 7f848491b640 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4b280 0x563b60b3af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f848511c640 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b68160 0x563b60b63650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8478005130 tx=0x7f84780055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54405e1b4af2074 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8469ffb640 1 -- 172.21.15.37:0/1097679397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478010040 con 0x563b60b68160 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8469ffb640 1 -- 172.21.15.37:0/1097679397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8478001d60 con 0x563b60b68160 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8469ffb640 1 -- 172.21.15.37:0/1097679397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478015410 con 0x563b60b68160 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 -- 172.21.15.37:0/1097679397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b68160 msgr2=0x563b60b63650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b68160 0x563b60b63650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8478005130 tx=0x7f84780055f0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 -- 172.21.15.37:0/1097679397 shutdown_connections 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b68160 0x563b60b63650 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b5ddb0 0x563b60b459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 --2- 172.21.15.37:0/1097679397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b4b280 0x563b60b3af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 -- 172.21.15.37:0/1097679397 >> 172.21.15.37:0/1097679397 conn(0x563b60b4ab40 msgr2=0x563b60b16120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 -- 172.21.15.37:0/1097679397 shutdown_connections 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.849+0000 7f8489971740 1 -- 172.21.15.37:0/1097679397 wait complete. 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.850+0000 7f8489971740 1 -- start start 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.850+0000 7f8489971740 1 Processor -- start 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f8489971740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b73d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b74260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f8489971740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b46f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f8489971740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b60b1b8e0 con 0x563b60b4b280 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f848006fcd0 con 0x563b60b5ddb0 2024-05-10T08:43:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f8489971740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563b60bc9a90 con 0x563b60b68160 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f8489971740 10 client.0 _ll_register_callbacks cb 0x7f8474017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f848491b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b73d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f848491b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b73d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48218/0 (socket says 172.21.15.37:48218) 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f848491b640 1 -- 172.21.15.37:0/1891893515 learned_addr learned my addr 172.21.15.37:0/1891893515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f847ffff640 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b74260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f848511c640 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b46f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f848491b640 1 -- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 msgr2=0x563b60b46f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.851+0000 7f848491b640 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b46f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f848491b640 1 -- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 msgr2=0x563b60b74260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f848491b640 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b74260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f848491b640 1 -- 172.21.15.37:0/1891893515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b60b65960 con 0x563b60b4b280 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f848491b640 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b73d20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8474013fd0 tx=0x7f8474014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a738d51e6b98524 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f845f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:11.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f845f7fe640 1 -- 172.21.15.37:0/1891893515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847400f8e0 con 0x563b60b4b280 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f845f7fe640 1 -- 172.21.15.37:0/1891893515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f8474021d90 con 0x563b60b4b280 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8478001d60 con 0x563b60b4b280 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f845f7fe640 1 -- 172.21.15.37:0/1891893515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8474042050 con 0x563b60b4b280 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 10 client.5865 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x563b60b47ff0 con 0x563b60b4b280 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f845f7fe640 1 -- 172.21.15.37:0/1891893515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8478001d60 con 0x563b60b4b280 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f845f7fe640 1 -- 172.21.15.37:0/1891893515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f8474045020 con 0x563b60b4b280 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 10 client.5865 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 10 client.5865 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 20 client.5865 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60bc9470 0x563b60b474b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 4 client.5865 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.852+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563b60a8c9b0 con 0x563b60bc9470 2024-05-10T08:43:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f847ffff640 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60bc9470 0x563b60b474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f845f7fe640 10 client.5865 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f847ffff640 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60bc9470 0x563b60b474b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323761785ae38d24 server_cookie=da750873092abad0 in_seq=0 out_seq=0 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f845f7fe640 1 -- 172.21.15.37:0/1891893515 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563b60a8c9b0 con 0x563b60bc9470 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f845f7fe640 10 client.5865 handle_command_reply: tid=0 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 client.5865 shutdown 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 msgr2=0x563b60b73d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b73d20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8474013fd0 tx=0x7f8474014000 comp rx=0 tx=0).stop 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 shutdown_connections 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563b60b68160 0x563b60b46f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b60b5ddb0 0x563b60b74260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563b60bc9470 0x563b60b474b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 --2- 172.21.15.37:0/1891893515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b60b4b280 0x563b60b73d20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 >> 172.21.15.37:0/1891893515 conn(0x563b60b4ab40 msgr2=0x563b60b68880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f845f7fe640 0 client.5865 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 shutdown_connections 2024-05-10T08:43:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 1 -- 172.21.15.37:0/1891893515 wait complete. 2024-05-10T08:43:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.853+0000 7f8489971740 20 client.5865 trim_cache size 0 max 16384 2024-05-10T08:43:11.860 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:43:11.860 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:43:11.860 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:43:11.860 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:43:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84640762d0 msgr2=0x7f8464078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84640762d0 0x7f8464078790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8474005880 tx=0x7f8474000bc0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84800aedf0 msgr2=0x7f84801427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84800aedf0 0x7f84801427e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f846c0098c0 tx=0x7f846c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 shutdown_connections 2024-05-10T08:43:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f84640762d0 0x7f8464078790 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015d180 0x7f84801578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84800aedf0 0x7f84801427e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 --2- 172.21.15.37:0/4256836953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f848006c3a0 0x7f84801591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 >> 172.21.15.37:0/4256836953 conn(0x7f84800b3b10 msgr2=0x7f84800b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 shutdown_connections 2024-05-10T08:43:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.854+0000 7f8486b7f640 1 -- 172.21.15.37:0/4256836953 wait complete. 2024-05-10T08:43:11.864 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:43:11.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.969+0000 7f140d514640 1 Processor -- start 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.969+0000 7f140d514640 1 -- start start 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f140d514640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14080d20c0 0x7f1408163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f140d514640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408071110 0x7f140806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f140d514640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14080d1300 con 0x7f1408070d30 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f140d514640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f14080d10d0 con 0x7f14080d20c0 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f140d514640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1408070b80 con 0x7f1408071110 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f1406ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1408070d30 0x7f14080703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51530/0 (socket says 172.21.15.37:51530) 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f1406ffd640 1 -- 172.21.15.37:0/3471148334 learned_addr learned my addr 172.21.15.37:0/3471148334 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f13fffff640 1 --2- 172.21.15.37:0/3471148334 >> v2:172.21.15.82:3300/0 conn(0x7f14080d20c0 0x7f1408163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f14077fe640 1 --2- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408071110 0x7f140806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.970+0000 7f14067fc640 1 -- 172.21.15.37:0/3471148334 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120622870 0 0) 0x7f14080d1300 con 0x7f1408070d30 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.971+0000 7f14067fc640 1 -- 172.21.15.37:0/3471148334 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f4003520 con 0x7f1408070d30 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.971+0000 7f13fffff640 1 -- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408071110 msgr2=0x7f140806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.971+0000 7f13fffff640 1 --2- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408071110 0x7f140806d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.971+0000 7f13fffff640 1 -- 172.21.15.37:0/3471148334 >> v1:172.21.15.37:6789/0 conn(0x7f1408070d30 legacy=0x7f14080703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.971+0000 7f14067fc640 1 -- 172.21.15.37:0/3471148334 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3536001262 0 0) 0x7f13f4003520 con 0x7f1408070d30 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.971+0000 7f13fffff640 1 -- 172.21.15.37:0/3471148334 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080d15e0 con 0x7f14080d20c0 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f13fffff640 1 --2- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 0x7f1408163920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13f00097a0 tx=0x7f13f002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dedb76b339319f79 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f14067fc640 1 -- 172.21.15.37:0/3471148334 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0037070 con 0x7f14080d20c0 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f14067fc640 1 -- 172.21.15.37:0/3471148334 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f002aba0 con 0x7f14080d20c0 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f14067fc640 1 -- 172.21.15.37:0/3471148334 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8001670 con 0x7f14080d20c0 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 -- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 msgr2=0x7f1408163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 --2- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 0x7f1408163920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13f00097a0 tx=0x7f13f002a110 comp rx=0 tx=0).stop 2024-05-10T08:43:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 -- 172.21.15.37:0/3471148334 shutdown_connections 2024-05-10T08:43:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 --2- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408071110 0x7f140806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 --2- 172.21.15.37:0/3471148334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 0x7f1408163920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 -- 172.21.15.37:0/3471148334 >> 172.21.15.37:0/3471148334 conn(0x7f14080d2e90 msgr2=0x7f14080d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 -- 172.21.15.37:0/3471148334 shutdown_connections 2024-05-10T08:43:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.972+0000 7f140d514640 1 -- 172.21.15.37:0/3471148334 wait complete. 2024-05-10T08:43:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 Processor -- start 2024-05-10T08:43:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 -- start start 2024-05-10T08:43:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408070d30 0x7f14080c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1408071110 0x7f14080cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 0x7f14081f9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1408071560 con 0x7f1408071110 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f14080d1c30 con 0x7f14080d20c0 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.974+0000 7f140d514640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f14080716e0 con 0x7f1408070d30 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1408071110 0x7f14080cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1408071110 0x7f14080cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48230/0 (socket says 172.21.15.37:48230) 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 -- 172.21.15.37:0/2596603352 learned_addr learned my addr 172.21.15.37:0/2596603352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f1406ffd640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408070d30 0x7f14080c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f14077fe640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 0x7f14081f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 -- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408070d30 msgr2=0x7f14080c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408070d30 0x7f14080c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 -- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 msgr2=0x7f14081f9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 0x7f14081f9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 -- 172.21.15.37:0/2596603352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080b68c0 con 0x7f1408071110 2024-05-10T08:43:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13fffff640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1408071110 0x7f14080cbb10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f13f0035040 tx=0x7f13f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13ff7fe640 1 -- 172.21.15.37:0/2596603352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0037050 con 0x7f1408071110 2024-05-10T08:43:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13ff7fe640 1 -- 172.21.15.37:0/2596603352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f0043070 con 0x7f1408071110 2024-05-10T08:43:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14080b6ba0 con 0x7f1408071110 2024-05-10T08:43:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f13ff7fe640 1 -- 172.21.15.37:0/2596603352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0006e10 con 0x7f1408071110 2024-05-10T08:43:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.975+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14080b7160 con 0x7f1408071110 2024-05-10T08:43:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.976+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140806dd50 con 0x7f1408071110 2024-05-10T08:43:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.977+0000 7f13ff7fe640 1 -- 172.21.15.37:0/2596603352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13f003ca10 con 0x7f1408071110 2024-05-10T08:43:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.978+0000 7f13ff7fe640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13e8076300 0x7f13e80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.978+0000 7f13ff7fe640 1 -- 172.21.15.37:0/2596603352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f13f00b81c0 con 0x7f1408071110 2024-05-10T08:43:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.978+0000 7f1406ffd640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13e8076300 0x7f13e80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.978+0000 7f1406ffd640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13e8076300 0x7f13e80787c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005880 tx=0x7f13f80057f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:11.982+0000 7f13ff7fe640 1 -- 172.21.15.37:0/2596603352 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f140806dd50 con 0x7f1408071110 2024-05-10T08:43:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.210+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14080b2160 con 0x7f1408071110 2024-05-10T08:43:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.211+0000 7f13ff7fe640 1 -- 172.21.15.37:0/2596603352 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5179 (secure 0 0 0) 0x7f14080b2160 con 0x7f1408071110 2024-05-10T08:43:12.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:12.211 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:42:45.578989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":6,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:43:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-05-10T08:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13e8076300 msgr2=0x7f13e80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13e8076300 0x7f13e80787c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005880 tx=0x7f13f80057f0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1408071110 msgr2=0x7f14080cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1408071110 0x7f14080cbb10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f13f0035040 tx=0x7f13f00046c0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 shutdown_connections 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13e8076300 0x7f13e80787c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14080d20c0 0x7f14081f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1408071110 0x7f14080cbb10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 --2- 172.21.15.37:0/2596603352 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1408070d30 0x7f14080c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 >> 172.21.15.37:0/2596603352 conn(0x7f14080d2e90 msgr2=0x7f140806d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 shutdown_connections 2024-05-10T08:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.213+0000 7f140d514640 1 -- 172.21.15.37:0/2596603352 wait complete. 2024-05-10T08:43:12.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-05-10T08:43:12.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.329+0000 7fd77942a640 1 Processor -- start 2024-05-10T08:43:12.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.329+0000 7fd77942a640 1 -- start start 2024-05-10T08:43:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd77942a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd77415ccb0 0x7fd77415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd77942a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd7740d2ce0 0x7fd7740d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd77942a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7740718c0 con 0x7fd774070b90 2024-05-10T08:43:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd77942a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd7740afba0 con 0x7fd77415ccb0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd77942a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd774071ba0 con 0x7fd7740d2ce0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd772ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd77415ccb0 0x7fd77415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd772ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd77415ccb0 0x7fd77415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48244/0 (socket says 172.21.15.37:48244) 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.330+0000 7fd772ffd640 1 -- 172.21.15.37:0/2994392547 learned_addr learned my addr 172.21.15.37:0/2994392547 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.331+0000 7fd7727fc640 1 --2- 172.21.15.37:0/2994392547 >> v2:172.21.15.82:3300/0 conn(0x7fd7740d2ce0 0x7fd7740d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.331+0000 7fd772ffd640 1 -- 172.21.15.37:0/2994392547 >> v2:172.21.15.82:3300/0 conn(0x7fd7740d2ce0 msgr2=0x7fd7740d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.331+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2994392547 >> v2:172.21.15.82:3300/0 conn(0x7fd7740d2ce0 0x7fd7740d3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.331+0000 7fd772ffd640 1 -- 172.21.15.37:0/2994392547 >> v1:172.21.15.82:6789/0 conn(0x7fd774070b90 legacy=0x7fd774071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.331+0000 7fd772ffd640 1 -- 172.21.15.37:0/2994392547 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd774071e80 con 0x7fd77415ccb0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.331+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2994392547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd77415d090 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7740b20c0 tx=0x7fd76402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88680c9f2c8b5a6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd771ffb640 1 -- 172.21.15.37:0/2994392547 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764036070 con 0x7fd77415ccb0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd771ffb640 1 -- 172.21.15.37:0/2994392547 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd764031600 con 0x7fd77415ccb0 2024-05-10T08:43:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd771ffb640 1 -- 172.21.15.37:0/2994392547 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7640319d0 con 0x7fd77415ccb0 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 -- 172.21.15.37:0/2994392547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 msgr2=0x7fd77415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 --2- 172.21.15.37:0/2994392547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd77415d090 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7740b20c0 tx=0x7fd76402a660 comp rx=0 tx=0).stop 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 -- 172.21.15.37:0/2994392547 shutdown_connections 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 --2- 172.21.15.37:0/2994392547 >> v2:172.21.15.82:3300/0 conn(0x7fd7740d2ce0 0x7fd7740d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 --2- 172.21.15.37:0/2994392547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd77415d090 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 -- 172.21.15.37:0/2994392547 >> 172.21.15.37:0/2994392547 conn(0x7fd77409ba40 msgr2=0x7fd77409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 -- 172.21.15.37:0/2994392547 shutdown_connections 2024-05-10T08:43:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.332+0000 7fd77942a640 1 -- 172.21.15.37:0/2994392547 wait complete. 2024-05-10T08:43:12.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.333+0000 7fd77942a640 1 Processor -- start 2024-05-10T08:43:12.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd77942a640 1 -- start start 2024-05-10T08:43:12.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd77942a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774070b90 0x7fd7740b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd77942a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740d2ce0 0x7fd7740b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd77942a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd7740b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd77942a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7740cf980 con 0x7fd77415ccb0 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd77942a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7740d3660 con 0x7fd7740d2ce0 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd77942a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd7740cfb00 con 0x7fd774070b90 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd7737fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd7740b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd7737fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd7740b8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48246/0 (socket says 172.21.15.37:48246) 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.334+0000 7fd7737fe640 1 -- 172.21.15.37:0/2645527826 learned_addr learned my addr 172.21.15.37:0/2645527826 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd7727fc640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740d2ce0 0x7fd7740b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774070b90 0x7fd7740b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd7737fe640 1 -- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774070b90 msgr2=0x7fd7740b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774070b90 0x7fd7740b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd7737fe640 1 -- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740d2ce0 msgr2=0x7fd7740b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740d2ce0 0x7fd7740b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd7737fe640 1 -- 172.21.15.37:0/2645527826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7740c7df0 con 0x7fd77415ccb0 2024-05-10T08:43:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd7740b8720 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00b410 tx=0x7fd76c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd76b7fe640 1 -- 172.21.15.37:0/2645527826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c015030 con 0x7fd77415ccb0 2024-05-10T08:43:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd76b7fe640 1 -- 172.21.15.37:0/2645527826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76c004020 con 0x7fd77415ccb0 2024-05-10T08:43:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd76b7fe640 1 -- 172.21.15.37:0/2645527826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c004410 con 0x7fd77415ccb0 2024-05-10T08:43:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7740c80d0 con 0x7fd77415ccb0 2024-05-10T08:43:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.335+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7740c8690 con 0x7fd77415ccb0 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.337+0000 7fd76b7fe640 1 -- 172.21.15.37:0/2645527826 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd76c018070 con 0x7fd77415ccb0 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.338+0000 7fd76b7fe640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd7540762d0 0x7fd754078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.338+0000 7fd76b7fe640 1 -- 172.21.15.37:0/2645527826 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd76c0972b0 con 0x7fd77415ccb0 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.338+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd7540762d0 0x7fd754078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.338+0000 7fd77c229740 1 Processor -- start 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd77c229740 1 -- start start 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd7540762d0 0x7fd754078790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd764033000 tx=0x7fd764009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd77c229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f3d82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f407b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4080b0 0x55765f3dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd77c229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55765f2c8920 con 0x55765f4256d0 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55765f33ddd0 con 0x55765f4080b0 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55765f2ee3e0 con 0x55765f4087f0 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd772ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f3d82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd772ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f3d82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48254/0 (socket says 172.21.15.37:48254) 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.339+0000 7fd772ffd640 1 -- 172.21.15.37:0/1657795166 learned_addr learned my addr 172.21.15.37:0/1657795166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd7727fc640 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f407b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd7737fe640 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4080b0 0x55765f3dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd772ffd640 1 -- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 msgr2=0x55765f407b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd772ffd640 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f407b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd772ffd640 1 -- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4080b0 msgr2=0x55765f3dcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd772ffd640 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4080b0 0x55765f3dcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd772ffd640 1 -- 172.21.15.37:0/1657795166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55765f11f7c0 con 0x55765f4256d0 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd772ffd640 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f3d82f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd764009f10 tx=0x7fd76402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb950bdd7e2ef03 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd768ff9640 1 -- 172.21.15.37:0/1657795166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764036040 con 0x55765f4256d0 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd768ff9640 1 -- 172.21.15.37:0/1657795166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76403c440 con 0x55765f4256d0 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.340+0000 7fd768ff9640 1 -- 172.21.15.37:0/1657795166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76403c810 con 0x55765f4256d0 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 -- 172.21.15.37:0/1657795166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 msgr2=0x55765f3d82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f3d82f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd764009f10 tx=0x7fd76402e000 comp rx=0 tx=0).stop 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 -- 172.21.15.37:0/1657795166 shutdown_connections 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4080b0 0x55765f3dcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f407b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 --2- 172.21.15.37:0/1657795166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f3d82f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 -- 172.21.15.37:0/1657795166 >> 172.21.15.37:0/1657795166 conn(0x55765f3da560 msgr2=0x55765f422b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 -- 172.21.15.37:0/1657795166 shutdown_connections 2024-05-10T08:43:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.341+0000 7fd77c229740 1 -- 172.21.15.37:0/1657795166 wait complete. 2024-05-10T08:43:12.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 -- start start 2024-05-10T08:43:12.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 Processor -- start 2024-05-10T08:43:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4087f0 0x55765f41ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4256d0 0x55765f40bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55765f346440 con 0x55765f403520 2024-05-10T08:43:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55765f341120 con 0x55765f4087f0 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55765f34f210 con 0x55765f4256d0 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.342+0000 7fd77c229740 10 client.0 _ll_register_callbacks cb 0x55765f2e6690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd772ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4087f0 0x55765f41ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4240a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48258/0 (socket says 172.21.15.37:48258) 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7727fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4256d0 0x55765f40bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 -- 172.21.15.37:0/2158578980 learned_addr learned my addr 172.21.15.37:0/2158578980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 -- 172.21.15.37:0/2158578980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4256d0 msgr2=0x55765f40bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4256d0 0x55765f40bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 -- 172.21.15.37:0/2158578980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4087f0 msgr2=0x55765f41ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4087f0 0x55765f41ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 -- 172.21.15.37:0/2158578980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55765f17ff50 con 0x55765f403520 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4087f0 0x55765f41ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:43:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4240a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd76c05c970 tx=0x7fd76c05ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8f0f545634010e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd751ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd751ffb640 1 -- 172.21.15.37:0/2158578980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c093060 con 0x55765f403520 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd751ffb640 1 -- 172.21.15.37:0/2158578980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd76c05f7e0 con 0x55765f403520 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd76403c440 con 0x55765f403520 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd751ffb640 1 -- 172.21.15.37:0/2158578980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd76c07e050 con 0x55765f403520 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd77c229740 10 client.5883 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55765f0130b0 con 0x55765f403520 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.343+0000 7fd751ffb640 1 -- 172.21.15.37:0/2158578980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76403c440 con 0x55765f403520 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd751ffb640 1 -- 172.21.15.37:0/2158578980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7fd76c022060 con 0x55765f403520 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd77c229740 10 client.5883 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd77c229740 10 client.5883 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd77c229740 20 client.5883 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd77c229740 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f408ce0 0x55765f4090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd77c229740 4 client.5883 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55765f34fa20 con 0x55765f408ce0 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f408ce0 0x55765f4090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd772ffd640 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f408ce0 0x55765f4090c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8125389160f1132 server_cookie=81be0e60c24dda05 in_seq=0 out_seq=0 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.344+0000 7fd751ffb640 10 client.5883 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd751ffb640 1 -- 172.21.15.37:0/2158578980 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55765f34fa20 con 0x55765f408ce0 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd751ffb640 10 client.5883 handle_command_reply: tid=0 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 client.5883 shutdown 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 msgr2=0x55765f4240a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4240a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd76c05c970 tx=0x7fd76c05ff10 comp rx=0 tx=0).stop 2024-05-10T08:43:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 shutdown_connections 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f408ce0 0x55765f4090c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4240a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4256d0 0x55765f40bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 --2- 172.21.15.37:0/2158578980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4087f0 0x55765f41ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 >> 172.21.15.37:0/2158578980 conn(0x55765f4080b0 msgr2=0x55765f3d7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd751ffb640 0 client.5883 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 shutdown_connections 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 1 -- 172.21.15.37:0/2158578980 wait complete. 2024-05-10T08:43:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.345+0000 7fd77c229740 20 client.5883 trim_cache size 0 max 16384 2024-05-10T08:43:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.358+0000 7fd77c229740 1 Processor -- start 2024-05-10T08:43:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd77c229740 1 -- start start 2024-05-10T08:43:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f403520 0x55765f404140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f404680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd77c229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f409cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd77c229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd77406d930 con 0x55765f4256d0 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd77414a6b0 con 0x55765f403520 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd77414d7a0 con 0x55765f4087f0 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd7737fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f409cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd7737fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f409cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48272/0 (socket says 172.21.15.37:48272) 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.359+0000 7fd7737fe640 1 -- 172.21.15.37:0/2860977270 learned_addr learned my addr 172.21.15.37:0/2860977270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd7737fe640 1 -- 172.21.15.37:0/2860977270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 msgr2=0x55765f404680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2860977270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f404680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd7737fe640 1 -- 172.21.15.37:0/2860977270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f403520 msgr2=0x55765f404140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2860977270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f403520 0x55765f404140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd7737fe640 1 -- 172.21.15.37:0/2860977270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55765f423aa0 con 0x55765f4256d0 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd7737fe640 1 --2- 172.21.15.37:0/2860977270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f409cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00bdd0 tx=0x7fd76c076000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d4de8b5b6a746b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd753fff640 1 -- 172.21.15.37:0/2860977270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c079070 con 0x55765f4256d0 2024-05-10T08:43:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd753fff640 1 -- 172.21.15.37:0/2860977270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76c060a80 con 0x55765f4256d0 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd753fff640 1 -- 172.21.15.37:0/2860977270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c05f800 con 0x55765f4256d0 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 -- 172.21.15.37:0/2860977270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 msgr2=0x55765f409cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 --2- 172.21.15.37:0/2860977270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f409cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00bdd0 tx=0x7fd76c076000 comp rx=0 tx=0).stop 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 -- 172.21.15.37:0/2860977270 shutdown_connections 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 --2- 172.21.15.37:0/2860977270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f4256d0 0x55765f409cf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 --2- 172.21.15.37:0/2860977270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f404680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 --2- 172.21.15.37:0/2860977270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f403520 0x55765f404140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 -- 172.21.15.37:0/2860977270 >> 172.21.15.37:0/2860977270 conn(0x55765f4080b0 msgr2=0x55765f424920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 -- 172.21.15.37:0/2860977270 shutdown_connections 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.360+0000 7fd77c229740 1 -- 172.21.15.37:0/2860977270 wait complete. 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.361+0000 7fd77c229740 1 -- start start 2024-05-10T08:43:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.361+0000 7fd77c229740 1 Processor -- start 2024-05-10T08:43:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd77c229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f420db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd77c229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4256d0 0x55765f425f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd77c229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55765f433220 con 0x55765f403520 2024-05-10T08:43:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55765f2f7a20 con 0x55765f4256d0 2024-05-10T08:43:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd77c229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55765f433060 con 0x55765f4087f0 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd77c229740 10 client.0 _ll_register_callbacks cb 0x7fd76c060240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4096f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48278/0 (socket says 172.21.15.37:48278) 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 -- 172.21.15.37:0/3868329764 learned_addr learned my addr 172.21.15.37:0/3868329764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd7727fc640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f420db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd7737fe640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4256d0 0x55765f425f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 -- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 msgr2=0x55765f420db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f420db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 -- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4256d0 msgr2=0x55765f425f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4256d0 0x55765f425f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 -- 172.21.15.37:0/3868329764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55765f405620 con 0x55765f403520 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd7727fc640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f420db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd7737fe640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4256d0 0x55765f425f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd772ffd640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4096f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd76402a6a0 tx=0x7fd764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb20eb735003ab8f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd751ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.362+0000 7fd751ffb640 1 -- 172.21.15.37:0/3868329764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76405b070 con 0x55765f403520 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd751ffb640 1 -- 172.21.15.37:0/3868329764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd764052420 con 0x55765f403520 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd76c060a80 con 0x55765f403520 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd751ffb640 1 -- 172.21.15.37:0/3868329764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd764064050 con 0x55765f403520 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 10 client.5889 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55765f3dadd0 con 0x55765f403520 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd751ffb640 1 -- 172.21.15.37:0/3868329764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76c060a80 con 0x55765f403520 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd751ffb640 1 -- 172.21.15.37:0/3868329764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7fd764067020 con 0x55765f403520 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 10 client.5889 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 10 client.5889 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 20 client.5889 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f4264d0 0x55765f3d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 4 client.5889 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55765f349890 con 0x55765f4264d0 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd7727fc640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f4264d0 0x55765f3d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd751ffb640 10 client.5889 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.363+0000 7fd7727fc640 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f4264d0 0x55765f3d71a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb31d7481d9521aa server_cookie=174a1a7aa6f8f219 in_seq=0 out_seq=0 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd751ffb640 1 -- 172.21.15.37:0/3868329764 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+141 (crc 0 0 0) 0x55765f349890 con 0x55765f4264d0 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd751ffb640 10 client.5889 handle_command_reply: tid=0 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 client.5889 shutdown 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 msgr2=0x55765f4096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4096f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd76402a6a0 tx=0x7fd764004a40 comp rx=0 tx=0).stop 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 shutdown_connections 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55765f4256d0 0x55765f425f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55765f4087f0 0x55765f420db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55765f4264d0 0x55765f3d71a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 --2- 172.21.15.37:0/3868329764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55765f403520 0x55765f4096f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd751ffb640 0 client.5889 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 >> 172.21.15.37:0/3868329764 conn(0x55765f4080b0 msgr2=0x55765f424760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 shutdown_connections 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 1 -- 172.21.15.37:0/3868329764 wait complete. 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77c229740 20 client.5889 trim_cache size 0 max 16384 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:43:12.371 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:12.372 INFO:teuthology.orchestra.run.smithi037.stdout: "damage_type": "backtrace", 2024-05-10T08:43:12.372 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3405129018, 2024-05-10T08:43:12.372 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2024-05-10T08:43:12.372 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/dir_test/file" 2024-05-10T08:43:12.372 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:12.372 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd7540762d0 msgr2=0x7fd754078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77942a640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd7540762d0 0x7fd754078790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd764033000 tx=0x7fd764009000 comp rx=0 tx=0).stop 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 msgr2=0x7fd7740b8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.364+0000 7fd77942a640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd7740b8720 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00b410 tx=0x7fd76c00b8d0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 shutdown_connections 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd7540762d0 0x7fd754078790 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77415ccb0 0x7fd7740b8720 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740d2ce0 0x7fd7740b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 --2- 172.21.15.37:0/2645527826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774070b90 0x7fd7740b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 >> 172.21.15.37:0/2645527826 conn(0x7fd77409ba40 msgr2=0x7fd7740b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 shutdown_connections 2024-05-10T08:43:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.365+0000 7fd77942a640 1 -- 172.21.15.37:0/2645527826 wait complete. 2024-05-10T08:43:12.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T08:43:12.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.479+0000 7f3d43124640 1 Processor -- start 2024-05-10T08:43:12.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.479+0000 7f3d43124640 1 -- start start 2024-05-10T08:43:12.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.479+0000 7f3d43124640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d3c0d53d0 0x7f3d3c0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.479+0000 7f3d43124640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3c1630b0 con 0x7f3d3c0d1970 2024-05-10T08:43:12.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.479+0000 7f3d43124640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3c0d3e70 con 0x7f3d3c15f420 2024-05-10T08:43:12.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.479+0000 7f3d43124640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3d3c0d2550 con 0x7f3d3c0d53d0 2024-05-10T08:43:12.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3d3c0d1970 0x7f3d3c0d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51542/0 (socket says 172.21.15.37:51542) 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3bfff640 1 -- 172.21.15.37:0/3027384348 learned_addr learned my addr 172.21.15.37:0/3027384348 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561269735 0 0) 0x7f3d28001110 con 0x7f3d3c0d1970 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d416c1640 1 --2- 172.21.15.37:0/3027384348 >> v2:172.21.15.82:3300/0 conn(0x7f3d3c0d53d0 0x7f3d3c0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d2c003520 con 0x7f3d3c0d1970 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3736434752 0 0) 0x7f3d2c003520 con 0x7f3d3c0d1970 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 >> v2:172.21.15.82:3300/0 conn(0x7f3d3c0d53d0 msgr2=0x7f3d3c0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 --2- 172.21.15.37:0/3027384348 >> v2:172.21.15.82:3300/0 conn(0x7f3d3c0d53d0 0x7f3d3c0d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 >> v1:172.21.15.82:6789/0 conn(0x7f3d3c15f420 legacy=0x7f3d3c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c0d2c80 con 0x7f3d3c0d1970 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f3d28001840 con 0x7f3d3c0d1970 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 >> v1:172.21.15.37:6789/0 conn(0x7f3d3c0d1970 legacy=0x7f3d3c0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d2c0051c0 0x7f3d2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0d2550 con 0x7f3d2c0039b0 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c00c060 con 0x7f3d2c0051c0 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c00c260 con 0x7f3d2c004800 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d40ec0640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.480+0000 7f3d3bfff640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d416c1640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d2c0051c0 0x7f3d2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d40ec0640 1 -- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d2c004800 msgr2=0x7f3d2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d40ec0640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d40ec0640 1 -- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d2c0051c0 msgr2=0x7f3d2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d40ec0640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d2c0051c0 0x7f3d2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d40ec0640 1 -- 172.21.15.37:0/3027384348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c003520 con 0x7f3d2c0039b0 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d416c1640 1 -- 172.21.15.37:0/3027384348 reap_dead start 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d3bfff640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d40ec0640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3d30001750 tx=0x7f3d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98ca4ad3aef803c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.481+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30001370 con 0x7f3d2c0039b0 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d300052d0 con 0x7f3d2c0039b0 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d3b7fe640 1 -- 172.21.15.37:0/3027384348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3002abc0 con 0x7f3d2c0039b0 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d43124640 1 -- 172.21.15.37:0/3027384348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 msgr2=0x7f3d2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d43124640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3d30001750 tx=0x7f3d2c005830 comp rx=0 tx=0).stop 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d43124640 1 -- 172.21.15.37:0/3027384348 shutdown_connections 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d43124640 1 --2- 172.21.15.37:0/3027384348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d43124640 1 -- 172.21.15.37:0/3027384348 >> 172.21.15.37:0/3027384348 conn(0x7f3d3c08eac0 msgr2=0x7f3d3c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d43124640 1 -- 172.21.15.37:0/3027384348 shutdown_connections 2024-05-10T08:43:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.482+0000 7f3d43124640 1 -- 172.21.15.37:0/3027384348 wait complete. 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.483+0000 7f3d43124640 1 Processor -- start 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.483+0000 7f3d43124640 1 -- start start 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d43124640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d3c1f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d43124640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c14bd10 0x7f3d3c0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d43124640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d3c0b4430 0x7f3d3c1f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d43124640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0d2830 con 0x7f3d2c0039b0 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d43124640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0d3240 con 0x7f3d3c14bd10 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d43124640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3c0d1e20 con 0x7f3d3c0b4430 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d40ec0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d3c1f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d40ec0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d3c1f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48288/0 (socket says 172.21.15.37:48288) 2024-05-10T08:43:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d40ec0640 1 -- 172.21.15.37:0/732568416 learned_addr learned my addr 172.21.15.37:0/732568416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d416c1640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d3c0b4430 0x7f3d3c1f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.484+0000 7f3d3bfff640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c14bd10 0x7f3d3c0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d40ec0640 1 -- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d3c0b4430 msgr2=0x7f3d3c1f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d40ec0640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d3c0b4430 0x7f3d3c1f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d40ec0640 1 -- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c14bd10 msgr2=0x7f3d3c0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d40ec0640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c14bd10 0x7f3d3c0b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d40ec0640 1 -- 172.21.15.37:0/732568416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c1f9b30 con 0x7f3d2c0039b0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d40ec0640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d3c1f5060 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3d30000c00 tx=0x7f3d30001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d397fa640 1 -- 172.21.15.37:0/732568416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3003f030 con 0x7f3d2c0039b0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d397fa640 1 -- 172.21.15.37:0/732568416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d30005480 con 0x7f3d2c0039b0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d397fa640 1 -- 172.21.15.37:0/732568416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30037040 con 0x7f3d2c0039b0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c14b230 con 0x7f3d2c0039b0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.485+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c14b7f0 con 0x7f3d2c0039b0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.486+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3c0693f0 con 0x7f3d2c0039b0 2024-05-10T08:43:12.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.487+0000 7f3d397fa640 1 -- 172.21.15.37:0/732568416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d30042070 con 0x7f3d2c0039b0 2024-05-10T08:43:12.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.487+0000 7f3d397fa640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d20076300 0x7f3d200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.487+0000 7f3d397fa640 1 -- 172.21.15.37:0/732568416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f3d300b7060 con 0x7f3d2c0039b0 2024-05-10T08:43:12.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.487+0000 7f3d3bfff640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d20076300 0x7f3d200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.488+0000 7f3d3bfff640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d20076300 0x7f3d200787c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3d280013d0 tx=0x7f3d280011c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.491+0000 7f3d397fa640 1 -- 172.21.15.37:0/732568416 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3d30080150 con 0x7f3d2c0039b0 2024-05-10T08:43:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.724+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d3c0b4810 con 0x7f3d2c0039b0 2024-05-10T08:43:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.724+0000 7f3d397fa640 1 -- 172.21.15.37:0/732568416 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f3d30084450 con 0x7f3d2c0039b0 2024-05-10T08:43:12.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:12.724 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d20076300 msgr2=0x7f3d200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d20076300 0x7f3d200787c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3d280013d0 tx=0x7f3d280011c0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 msgr2=0x7f3d3c1f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d3c1f5060 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3d30000c00 tx=0x7f3d30001120 comp rx=0 tx=0).stop 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 shutdown_connections 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d20076300 0x7f3d200787c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d3c0b4430 0x7f3d3c1f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c14bd10 0x7f3d3c0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 --2- 172.21.15.37:0/732568416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d2c0039b0 0x7f3d3c1f5060 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 >> 172.21.15.37:0/732568416 conn(0x7f3d3c08eac0 msgr2=0x7f3d3c06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 shutdown_connections 2024-05-10T08:43:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.726+0000 7f3d43124640 1 -- 172.21.15.37:0/732568416 wait complete. 2024-05-10T08:43:12.736 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T08:43:12.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:43:12.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-05-10T08:43:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.845+0000 7fb20b37f640 1 Processor -- start 2024-05-10T08:43:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.845+0000 7fb20b37f640 1 -- start start 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20b37f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb204159770 0x7fb20406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20b37f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb20406c8e0 0x7fb2040aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20b37f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2040af940 con 0x7fb2040af4d0 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20b37f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb2040b1660 con 0x7fb20406c8e0 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20b37f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb2041600d0 con 0x7fb204159770 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20891a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb20406c8e0 0x7fb2040aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20891a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb20406c8e0 0x7fb2040aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48292/0 (socket says 172.21.15.37:48292) 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20891a640 1 -- 172.21.15.37:0/1212165853 learned_addr learned my addr 172.21.15.37:0/1212165853 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20991c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb2040af4d0 0x7fb20406ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51554/0 (socket says 172.21.15.37:51554) 2024-05-10T08:43:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20911b640 1 --2- 172.21.15.37:0/1212165853 >> v2:172.21.15.82:3300/0 conn(0x7fb204159770 0x7fb20406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20891a640 1 -- 172.21.15.37:0/1212165853 >> v2:172.21.15.82:3300/0 conn(0x7fb204159770 msgr2=0x7fb20406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20891a640 1 --2- 172.21.15.37:0/1212165853 >> v2:172.21.15.82:3300/0 conn(0x7fb204159770 0x7fb20406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20891a640 1 -- 172.21.15.37:0/1212165853 >> v1:172.21.15.37:6789/0 conn(0x7fb2040af4d0 legacy=0x7fb20406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20891a640 1 -- 172.21.15.37:0/1212165853 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2040afbe0 con 0x7fb20406c8e0 2024-05-10T08:43:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb1fbfff640 1 -- 172.21.15.37:0/1212165853 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403705567 0 0) 0x7fb2040af940 con 0x7fb2040af4d0 2024-05-10T08:43:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.846+0000 7fb20911b640 1 --2- 172.21.15.37:0/1212165853 >> v2:172.21.15.82:3300/0 conn(0x7fb204159770 0x7fb20406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.847+0000 7fb20891a640 1 --2- 172.21.15.37:0/1212165853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb2040aef90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb2040b18b0 tx=0x7fb1f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed41880b1d9dc09 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.847+0000 7fb1fbfff640 1 -- 172.21.15.37:0/1212165853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4037070 con 0x7fb20406c8e0 2024-05-10T08:43:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.847+0000 7fb1fbfff640 1 -- 172.21.15.37:0/1212165853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f4032440 con 0x7fb20406c8e0 2024-05-10T08:43:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.847+0000 7fb1fbfff640 1 -- 172.21.15.37:0/1212165853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4032810 con 0x7fb20406c8e0 2024-05-10T08:43:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 -- 172.21.15.37:0/1212165853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 msgr2=0x7fb2040aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 --2- 172.21.15.37:0/1212165853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb2040aef90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb2040b18b0 tx=0x7fb1f402a270 comp rx=0 tx=0).stop 2024-05-10T08:43:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 -- 172.21.15.37:0/1212165853 shutdown_connections 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 --2- 172.21.15.37:0/1212165853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb2040aef90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 --2- 172.21.15.37:0/1212165853 >> v2:172.21.15.82:3300/0 conn(0x7fb204159770 0x7fb20406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 -- 172.21.15.37:0/1212165853 >> 172.21.15.37:0/1212165853 conn(0x7fb2040b3aa0 msgr2=0x7fb2040b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 -- 172.21.15.37:0/1212165853 shutdown_connections 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.848+0000 7fb20b37f640 1 -- 172.21.15.37:0/1212165853 wait complete. 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.849+0000 7fb20b37f640 1 Processor -- start 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.849+0000 7fb20b37f640 1 -- start start 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20b37f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb204152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20b37f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2040af4d0 0x7fb204153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20b37f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb204159770 0x7fb204154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20b37f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb204159b50 con 0x7fb20406c8e0 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20b37f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb20415fd60 con 0x7fb2040af4d0 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20b37f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb20415f730 con 0x7fb204159770 2024-05-10T08:43:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb204152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb204152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48308/0 (socket says 172.21.15.37:48308) 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 -- 172.21.15.37:0/235008557 learned_addr learned my addr 172.21.15.37:0/235008557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 -- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb204159770 msgr2=0x7fb204154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb204159770 0x7fb204154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 -- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2040af4d0 msgr2=0x7fb204153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2040af4d0 0x7fb204153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 -- 172.21.15.37:0/235008557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2041e7a60 con 0x7fb20406c8e0 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.850+0000 7fb20911b640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb204152ae0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb200007ef0 tx=0x7fb20000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.851+0000 7fb1f9ffb640 1 -- 172.21.15.37:0/235008557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20001a070 con 0x7fb20406c8e0 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.851+0000 7fb1f9ffb640 1 -- 172.21.15.37:0/235008557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb200003b90 con 0x7fb20406c8e0 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.851+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2041e7d40 con 0x7fb20406c8e0 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.851+0000 7fb1f9ffb640 1 -- 172.21.15.37:0/235008557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20000de20 con 0x7fb20406c8e0 2024-05-10T08:43:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.851+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2041e8300 con 0x7fb20406c8e0 2024-05-10T08:43:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.853+0000 7fb1f9ffb640 1 -- 172.21.15.37:0/235008557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb20001d070 con 0x7fb20406c8e0 2024-05-10T08:43:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.853+0000 7fb1f9ffb640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e80762d0 0x7fb1e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.853+0000 7fb1f9ffb640 1 -- 172.21.15.37:0/235008557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fb2000978d0 con 0x7fb20406c8e0 2024-05-10T08:43:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.854+0000 7fb20891a640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e80762d0 0x7fb1e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.854+0000 7fb20e171740 1 Processor -- start 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.854+0000 7fb20e171740 1 -- start start 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.854+0000 7fb20891a640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e80762d0 0x7fb1e8078790 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4034000 tx=0x7fb1f402c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b9fe80 0x563713b52810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20e171740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713b82320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b82860 0x563713b57670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20e171740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563713abcbc0 con 0x563713b82fa0 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563713a75d00 con 0x563713b82860 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563713ab8b80 con 0x563713b9fe80 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713b82320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713b82320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48310/0 (socket says 172.21.15.37:48310) 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 -- 172.21.15.37:0/1902911207 learned_addr learned my addr 172.21.15.37:0/1902911207 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20991c640 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b82860 0x563713b57670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20911b640 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b9fe80 0x563713b52810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 -- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b9fe80 msgr2=0x563713b52810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b9fe80 0x563713b52810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 -- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b82860 msgr2=0x563713b57670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b82860 0x563713b57670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 -- 172.21.15.37:0/1902911207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56371389a940 con 0x563713b82fa0 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20991c640 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b82860 0x563713b57670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb20891a640 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713b82320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009930 tx=0x7fb1f402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5f9c3cb698797e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb1eeffd640 1 -- 172.21.15.37:0/1902911207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f404d070 con 0x563713b82fa0 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb1eeffd640 1 -- 172.21.15.37:0/1902911207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f4004230 con 0x563713b82fa0 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.855+0000 7fb1eeffd640 1 -- 172.21.15.37:0/1902911207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4037040 con 0x563713b82fa0 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 -- 172.21.15.37:0/1902911207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 msgr2=0x563713b82320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713b82320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009930 tx=0x7fb1f402e000 comp rx=0 tx=0).stop 2024-05-10T08:43:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 -- 172.21.15.37:0/1902911207 shutdown_connections 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b82860 0x563713b57670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713b82320 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 --2- 172.21.15.37:0/1902911207 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b9fe80 0x563713b52810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 -- 172.21.15.37:0/1902911207 >> 172.21.15.37:0/1902911207 conn(0x563713b54a80 msgr2=0x563713b9d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 -- 172.21.15.37:0/1902911207 shutdown_connections 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 -- 172.21.15.37:0/1902911207 wait complete. 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.856+0000 7fb20e171740 1 -- start start 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.857+0000 7fb20e171740 1 Processor -- start 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.857+0000 7fb20e171740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713bb13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.857+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b9fe80 0x563713b9ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.857+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b85df0 0x563713b94230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.857+0000 7fb20e171740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563713b56c30 con 0x563713b82fa0 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.857+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563713a79830 con 0x563713b9fe80 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.857+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563713b56020 con 0x563713b85df0 2024-05-10T08:43:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20e171740 10 client.0 _ll_register_callbacks cb 0x563713ab6750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713bb13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713bb13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48324/0 (socket says 172.21.15.37:48324) 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 -- 172.21.15.37:0/2876972542 learned_addr learned my addr 172.21.15.37:0/2876972542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20991c640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b85df0 0x563713b94230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20891a640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b9fe80 0x563713b9ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 -- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b85df0 msgr2=0x563713b94230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b85df0 0x563713b94230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 -- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b9fe80 msgr2=0x563713b9ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b9fe80 0x563713b9ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 -- 172.21.15.37:0/2876972542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637138fb0d0 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20991c640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b85df0 0x563713b94230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20911b640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713bb13c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb20005d040 tx=0x7fb200060fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cabf5136820908 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb1e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2876972542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20005feb0 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2876972542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fb20005c3c0 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1f4004230 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2876972542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb200067280 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20e171740 10 client.5910 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.858+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x56371378e230 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2876972542 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f4004230 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2876972542 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7fb20005c5c0 con 0x563713b82fa0 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20e171740 10 client.5910 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20e171740 10 client.5910 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20e171740 20 client.5910 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20e171740 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b9c420 0x563713b79bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20e171740 4 client.5910 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563713aca7d0 con 0x563713b9c420 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20891a640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b9c420 0x563713b79bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb20891a640 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b9c420 0x563713b79bd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c1626533405962a server_cookie=577cebee36d89ec8 in_seq=0 out_seq=0 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.859+0000 7fb1e3fff640 10 client.5910 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2876972542 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563713aca7d0 con 0x563713b9c420 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb1e3fff640 10 client.5910 handle_command_reply: tid=0 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 client.5910 shutdown 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 msgr2=0x563713bb13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713bb13c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb20005d040 tx=0x7fb200060fa0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 shutdown_connections 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b85df0 0x563713b94230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b9fe80 0x563713b9ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b9c420 0x563713b79bd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 --2- 172.21.15.37:0/2876972542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b82fa0 0x563713bb13c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 >> 172.21.15.37:0/2876972542 conn(0x563713b82860 msgr2=0x563713b53270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb1e3fff640 0 client.5910 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 shutdown_connections 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 1 -- 172.21.15.37:0/2876972542 wait complete. 2024-05-10T08:43:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.860+0000 7fb20e171740 20 client.5910 trim_cache size 0 max 16384 2024-05-10T08:43:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.878+0000 7fb20e171740 1 Processor -- start 2024-05-10T08:43:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.878+0000 7fb20e171740 1 -- start start 2024-05-10T08:43:12.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 0x563713b58250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713bbfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20e171740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713bc0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20e171740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb204201e30 con 0x563713b9fe80 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb204200e10 con 0x563713b85df0 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb2041573a0 con 0x563713b82fa0 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713bc0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713bc0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48336/0 (socket says 172.21.15.37:48336) 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 -- 172.21.15.37:0/2694955643 learned_addr learned my addr 172.21.15.37:0/2694955643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 -- 172.21.15.37:0/2694955643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 msgr2=0x563713b58250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 0x563713b58250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 -- 172.21.15.37:0/2694955643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 msgr2=0x563713bbfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20891a640 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713bbfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713bbfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.879+0000 7fb20991c640 1 -- 172.21.15.37:0/2694955643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563713b7e5b0 con 0x563713b9fe80 2024-05-10T08:43:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20991c640 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713bc0310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0073a0 tx=0x7fb1fc005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451a80cc89932e18 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb1ee7fc640 1 -- 172.21.15.37:0/2694955643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc005db0 con 0x563713b9fe80 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb1ee7fc640 1 -- 172.21.15.37:0/2694955643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc019070 con 0x563713b9fe80 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb1ee7fc640 1 -- 172.21.15.37:0/2694955643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc001830 con 0x563713b9fe80 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 -- 172.21.15.37:0/2694955643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 msgr2=0x563713bc0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713bc0310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0073a0 tx=0x7fb1fc005bc0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 -- 172.21.15.37:0/2694955643 shutdown_connections 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713bc0310 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713bbfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 --2- 172.21.15.37:0/2694955643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 0x563713b58250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 -- 172.21.15.37:0/2694955643 >> 172.21.15.37:0/2694955643 conn(0x563713b82860 msgr2=0x563713bafa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 -- 172.21.15.37:0/2694955643 shutdown_connections 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.880+0000 7fb20e171740 1 -- 172.21.15.37:0/2694955643 wait complete. 2024-05-10T08:43:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.881+0000 7fb20e171740 1 -- start start 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.881+0000 7fb20e171740 1 Processor -- start 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 0x563713c1b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713b7f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20e171740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713b956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20e171740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563713bb0250 con 0x563713b9fe80 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb204200760 con 0x563713b85df0 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20e171740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563713c1bfa0 con 0x563713b82fa0 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20e171740 10 client.0 _ll_register_callbacks cb 0x7fb200007e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713b956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713b956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48352/0 (socket says 172.21.15.37:48352) 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 -- 172.21.15.37:0/2903104618 learned_addr learned my addr 172.21.15.37:0/2903104618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20911b640 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 0x563713c1b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20891a640 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713b7f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 -- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 msgr2=0x563713c1b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 0x563713c1b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 -- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 msgr2=0x563713b7f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713b7f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 -- 172.21.15.37:0/2903104618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563713bc1770 con 0x563713b9fe80 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb20991c640 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713b956f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc000f60 tx=0x7fb1fc0010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85cf9d4debc0777 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.882+0000 7fb1e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2903104618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc026610 con 0x563713b9fe80 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2903104618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fb1fc0267b0 con 0x563713b9fe80 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1fc019070 con 0x563713b9fe80 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2903104618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb1fc0269b0 con 0x563713b9fe80 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 10 client.5916 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x563713b58760 con 0x563713b9fe80 2024-05-10T08:43:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2903104618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc019070 con 0x563713b9fe80 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2903104618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7fb1fc026b50 con 0x563713b9fe80 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 10 client.5916 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 10 client.5916 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 20 client.5916 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b7f8c0 0x563713b95c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 4 client.5916 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) -- 0x563713ac4640 con 0x563713b7f8c0 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20911b640 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b7f8c0 0x563713b95c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb1e3fff640 10 client.5916 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.883+0000 7fb20911b640 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b7f8c0 0x563713b95c30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92cb3c976ec36c69 server_cookie=f3bd943177a5f6f6 in_seq=0 out_seq=0 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb1e3fff640 1 -- 172.21.15.37:0/2903104618 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563713ac4640 con 0x563713b7f8c0 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb1e3fff640 10 client.5916 handle_command_reply: tid=0 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 client.5916 shutdown 2024-05-10T08:43:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 msgr2=0x563713b956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713b956f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc000f60 tx=0x7fb1fc0010f0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 shutdown_connections 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x563713b7f8c0 0x563713b95c30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563713b9fe80 0x563713b956f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563713b85df0 0x563713b7f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 --2- 172.21.15.37:0/2903104618 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563713b82fa0 0x563713c1b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 >> 172.21.15.37:0/2903104618 conn(0x563713b82860 msgr2=0x563713ba0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb1e3fff640 0 client.5916 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.884+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 shutdown_connections 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20e171740 1 -- 172.21.15.37:0/2903104618 wait complete. 2024-05-10T08:43:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20e171740 20 client.5916 trim_cache size 0 max 16384 2024-05-10T08:43:12.891 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:43:12.885+0000 7f1d3926d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5781=0-4194304@1} caps={5781=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5781 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5568900de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:43:12.891 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:43:12.891 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:43:12.891 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "86fa7ce4-5df3-4f25-8759-ba85f4594b13", 2024-05-10T08:43:12.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:43:12.891 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:43:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e80762d0 msgr2=0x7fb1e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e80762d0 0x7fb1e8078790 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4034000 tx=0x7fb1f402c000 comp rx=0 tx=0).stop 2024-05-10T08:43:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 msgr2=0x7fb204152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb204152ae0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb200007ef0 tx=0x7fb20000d4a0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 shutdown_connections 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e80762d0 0x7fb1e8078790 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb204159770 0x7fb204154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2040af4d0 0x7fb204153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 --2- 172.21.15.37:0/235008557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20406c8e0 0x7fb204152ae0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 >> 172.21.15.37:0/235008557 conn(0x7fb2040b3aa0 msgr2=0x7fb2040b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 shutdown_connections 2024-05-10T08:43:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:12.885+0000 7fb20b37f640 1 -- 172.21.15.37:0/235008557 wait complete. 2024-05-10T08:43:12.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:43:12.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T08:43:13.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.001+0000 7f772f645640 1 Processor -- start 2024-05-10T08:43:13.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.001+0000 7f772f645640 1 -- start start 2024-05-10T08:43:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772f645640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77280d0590 0x7f77280ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772f645640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77280ce610 0x7f77280709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772f645640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77280d15c0 con 0x7f77281606d0 2024-05-10T08:43:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772f645640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f77280d18a0 con 0x7f77280ce610 2024-05-10T08:43:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772f645640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f77280d1b80 con 0x7f77280d0590 2024-05-10T08:43:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772dbe2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77280ce610 0x7f77280709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772dbe2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77280ce610 0x7f77280709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48368/0 (socket says 172.21.15.37:48368) 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.002+0000 7f772dbe2640 1 -- 172.21.15.37:0/3889815118 learned_addr learned my addr 172.21.15.37:0/3889815118 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f772cbe0640 1 --2- 172.21.15.37:0/3889815118 >> v2:172.21.15.82:3300/0 conn(0x7f77280d0590 0x7f77280ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f772dbe2640 1 -- 172.21.15.37:0/3889815118 >> v2:172.21.15.82:3300/0 conn(0x7f77280d0590 msgr2=0x7f77280ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f772dbe2640 1 --2- 172.21.15.37:0/3889815118 >> v2:172.21.15.82:3300/0 conn(0x7f77280d0590 0x7f77280ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f772dbe2640 1 -- 172.21.15.37:0/3889815118 >> v1:172.21.15.82:6789/0 conn(0x7f77281606d0 legacy=0x7f77280cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f772dbe2640 1 -- 172.21.15.37:0/3889815118 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77280704d0 con 0x7f77280ce610 2024-05-10T08:43:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f772cbe0640 1 --2- 172.21.15.37:0/3889815118 >> v2:172.21.15.82:3300/0 conn(0x7f77280d0590 0x7f77280ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f772dbe2640 1 --2- 172.21.15.37:0/3889815118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280709f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f77280700a0 tx=0x7f772002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2725f2d6bc3ca0f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.003+0000 7f771ffff640 1 -- 172.21.15.37:0/3889815118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720036070 con 0x7f77280ce610 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f771ffff640 1 -- 172.21.15.37:0/3889815118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720031600 con 0x7f77280ce610 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f771ffff640 1 -- 172.21.15.37:0/3889815118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200319d0 con 0x7f77280ce610 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 -- 172.21.15.37:0/3889815118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 msgr2=0x7f77280709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 --2- 172.21.15.37:0/3889815118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280709f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f77280700a0 tx=0x7f772002a5d0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 -- 172.21.15.37:0/3889815118 shutdown_connections 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 --2- 172.21.15.37:0/3889815118 >> v2:172.21.15.82:3300/0 conn(0x7f77280d0590 0x7f77280ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 --2- 172.21.15.37:0/3889815118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280709f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 -- 172.21.15.37:0/3889815118 >> 172.21.15.37:0/3889815118 conn(0x7f77280b49d0 msgr2=0x7f77280b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 -- 172.21.15.37:0/3889815118 shutdown_connections 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.004+0000 7f772f645640 1 -- 172.21.15.37:0/3889815118 wait complete. 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.005+0000 7f772f645640 1 Processor -- start 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.005+0000 7f772f645640 1 -- start start 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772f645640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772f645640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77280d0590 0x7f77281f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772f645640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77281606d0 0x7f772806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772f645640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77280710b0 con 0x7f77280ce610 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772f645640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7728070f30 con 0x7f77281606d0 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772f645640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7728071230 con 0x7f77280d0590 2024-05-10T08:43:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772d3e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772d3e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48380/0 (socket says 172.21.15.37:48380) 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772d3e1640 1 -- 172.21.15.37:0/4270117173 learned_addr learned my addr 172.21.15.37:0/4270117173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772cbe0640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77280d0590 0x7f77281f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.006+0000 7f772dbe2640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77281606d0 0x7f772806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772d3e1640 1 -- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77280d0590 msgr2=0x7f77281f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772d3e1640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77280d0590 0x7f77281f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772d3e1640 1 -- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77281606d0 msgr2=0x7f772806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772d3e1640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77281606d0 0x7f772806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772d3e1640 1 -- 172.21.15.37:0/4270117173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77281f6910 con 0x7f77280ce610 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772d3e1640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280c91a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f772400b420 tx=0x7f772400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f771dffb640 1 -- 172.21.15.37:0/4270117173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724011830 con 0x7f77280ce610 2024-05-10T08:43:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f771dffb640 1 -- 172.21.15.37:0/4270117173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7724016070 con 0x7f77280ce610 2024-05-10T08:43:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77280c8100 con 0x7f77280ce610 2024-05-10T08:43:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f771dffb640 1 -- 172.21.15.37:0/4270117173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724011c10 con 0x7f77280ce610 2024-05-10T08:43:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.007+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77280c86c0 con 0x7f77280ce610 2024-05-10T08:43:13.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.009+0000 7f771dffb640 1 -- 172.21.15.37:0/4270117173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f772401b460 con 0x7f77280ce610 2024-05-10T08:43:13.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.010+0000 7f771dffb640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f770c0762d0 0x7f770c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.010+0000 7f771dffb640 1 -- 172.21.15.37:0/4270117173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f7724097470 con 0x7f77280ce610 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.010+0000 7f772cbe0640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f770c0762d0 0x7f770c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.010+0000 7f7731ffd740 1 Processor -- start 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.010+0000 7f7731ffd740 1 -- start start 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f772cbe0640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f770c0762d0 0x7f770c078790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f77280ca460 tx=0x7f7718008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336982af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b2b40 0x55f336987950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f7731ffd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f33694f690 con 0x55f3369b3280 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f3368ecf30 con 0x55f3369b2b40 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f3368a5b20 con 0x55f3369d0160 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f772cbe0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f772cbe0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48394/0 (socket says 172.21.15.37:48394) 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f772cbe0640 1 -- 172.21.15.37:0/534287973 learned_addr learned my addr 172.21.15.37:0/534287973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f772d3e1640 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336982af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.011+0000 7f772dbe2640 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b2b40 0x55f336987950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f772cbe0640 1 -- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 msgr2=0x55f336982af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f772cbe0640 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336982af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f772cbe0640 1 -- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b2b40 msgr2=0x55f336987950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f772cbe0640 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b2b40 0x55f336987950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f772cbe0640 1 -- 172.21.15.37:0/534287973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33689de60 con 0x55f3369b3280 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f772cbe0640 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b2600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f771800f9c0 tx=0x7f7718012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2590562f37d3a06a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f7712ffd640 1 -- 172.21.15.37:0/534287973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771801b050 con 0x55f3369b3280 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f7712ffd640 1 -- 172.21.15.37:0/534287973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718025070 con 0x55f3369b3280 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f7712ffd640 1 -- 172.21.15.37:0/534287973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718014de0 con 0x55f3369b3280 2024-05-10T08:43:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f7731ffd740 1 -- 172.21.15.37:0/534287973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 msgr2=0x55f3369b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f7731ffd740 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b2600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f771800f9c0 tx=0x7f7718012000 comp rx=0 tx=0).stop 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.012+0000 7f7731ffd740 1 -- 172.21.15.37:0/534287973 shutdown_connections 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b2b40 0x55f336987950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b2600 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 --2- 172.21.15.37:0/534287973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336982af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 -- 172.21.15.37:0/534287973 >> 172.21.15.37:0/534287973 conn(0x55f336984d60 msgr2=0x55f3369cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 -- 172.21.15.37:0/534287973 shutdown_connections 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 -- 172.21.15.37:0/534287973 wait complete. 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 -- start start 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.013+0000 7f7731ffd740 1 Processor -- start 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336987670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f336987bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f7731ffd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f3368a95e0 con 0x55f3369b3280 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f3368e8ef0 con 0x55f3369b51b0 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f336986f10 con 0x55f3369d0160 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f7731ffd740 10 client.0 _ll_register_callbacks cb 0x55f3368a4320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772d3e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772d3e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48406/0 (socket says 172.21.15.37:48406) 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772d3e1640 1 -- 172.21.15.37:0/3638608171 learned_addr learned my addr 172.21.15.37:0/3638608171 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772dbe2640 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f336987bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772cbe0640 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336987670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772d3e1640 1 -- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 msgr2=0x55f336987670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772d3e1640 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336987670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.014+0000 7f772d3e1640 1 -- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 msgr2=0x55f336987bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f772d3e1640 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f336987bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f772d3e1640 1 -- 172.21.15.37:0/3638608171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3366c87d0 con 0x55f3369b3280 2024-05-10T08:43:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f772d3e1640 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b4c70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f772400bde0 tx=0x7f772405c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93f083ead762c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7707fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7707fff640 1 -- 172.21.15.37:0/3638608171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772405f7f0 con 0x55f3369b3280 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7707fff640 1 -- 172.21.15.37:0/3638608171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f7724095b00 con 0x55f3369b3280 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7718025070 con 0x55f3369b3280 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7707fff640 1 -- 172.21.15.37:0/3638608171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7724069160 con 0x55f3369b3280 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 10 client.5928 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55f3365fe3f0 con 0x55f3369b3280 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7707fff640 1 -- 172.21.15.37:0/3638608171 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718025070 con 0x55f3369b3280 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7707fff640 1 -- 172.21.15.37:0/3638608171 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f7724079af0 con 0x55f3369b3280 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 10 client.5928 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 10 client.5928 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 20 client.5928 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369b3880 0x55f3369b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 4 client.5928 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:43:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3368fab40 con 0x55f3369b3880 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.015+0000 7f772cbe0640 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369b3880 0x55f3369b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f772cbe0640 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369b3880 0x55f3369b3c60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f81cb5066904eec server_cookie=86c487f30662fb06 in_seq=0 out_seq=0 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7707fff640 10 client.5928 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7707fff640 1 -- 172.21.15.37:0/3638608171 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f3368fab40 con 0x55f3369b3880 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7707fff640 10 client.5928 handle_command_reply: tid=0 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7731ffd740 1 client.5928 shutdown 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 msgr2=0x55f3369b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7731ffd740 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b4c70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f772400bde0 tx=0x7f772405c8d0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 shutdown_connections 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7731ffd740 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f336987bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7731ffd740 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f336987670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.016+0000 7f7731ffd740 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369b3880 0x55f3369b3c60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.017+0000 7f7731ffd740 1 --2- 172.21.15.37:0/3638608171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f3369b4c70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.017+0000 7f7707fff640 0 client.5928 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:13.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.017+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 >> 172.21.15.37:0/3638608171 conn(0x55f3369b2b40 msgr2=0x55f336986510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:13.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.017+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 shutdown_connections 2024-05-10T08:43:13.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.017+0000 7f7731ffd740 1 -- 172.21.15.37:0/3638608171 wait complete. 2024-05-10T08:43:13.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.017+0000 7f7731ffd740 20 client.5928 trim_cache size 0 max 16384 2024-05-10T08:43:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.035+0000 7f7731ffd740 1 Processor -- start 2024-05-10T08:43:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.035+0000 7f7731ffd740 1 -- start start 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369b3280 0x55f3369b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b51b0 0x55f336988c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369d0160 0x55f3369cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f7731ffd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7728202050 con 0x55f3369b51b0 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77281f9cb0 con 0x55f3369d0160 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f77281f8f90 con 0x55f3369b3280 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b51b0 0x55f336988c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b51b0 0x55f336988c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48416/0 (socket says 172.21.15.37:48416) 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 -- 172.21.15.37:0/644782836 learned_addr learned my addr 172.21.15.37:0/644782836 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772dbe2640 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369d0160 0x55f3369cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772d3e1640 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369b3280 0x55f3369b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 -- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369b3280 msgr2=0x55f3369b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369b3280 0x55f3369b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 -- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369d0160 msgr2=0x55f3369cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369d0160 0x55f3369cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 -- 172.21.15.37:0/644782836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3365be0f0 con 0x55f3369b51b0 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772dbe2640 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369d0160 0x55f3369cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f772cbe0640 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b51b0 0x55f336988c30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7718008010 tx=0x7f7718014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe2bfe17fbfb44b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f77127fc640 1 -- 172.21.15.37:0/644782836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771803d070 con 0x55f3369b51b0 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f77127fc640 1 -- 172.21.15.37:0/644782836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718025050 con 0x55f3369b51b0 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.036+0000 7f77127fc640 1 -- 172.21.15.37:0/644782836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771801b040 con 0x55f3369b51b0 2024-05-10T08:43:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 -- 172.21.15.37:0/644782836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b51b0 msgr2=0x55f336988c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b51b0 0x55f336988c30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7718008010 tx=0x7f7718014000 comp rx=0 tx=0).stop 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 -- 172.21.15.37:0/644782836 shutdown_connections 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369d0160 0x55f3369cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b51b0 0x55f336988c30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 --2- 172.21.15.37:0/644782836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369b3280 0x55f3369b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 -- 172.21.15.37:0/644782836 >> 172.21.15.37:0/644782836 conn(0x55f3369b2b40 msgr2=0x55f3369b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 -- 172.21.15.37:0/644782836 shutdown_connections 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 -- 172.21.15.37:0/644782836 wait complete. 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.037+0000 7f7731ffd740 1 -- start start 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 1 Processor -- start 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f336a345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f3369ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f3369c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f3369b4650 con 0x55f3369b3280 2024-05-10T08:43:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77281f95e0 con 0x55f3369b51b0 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f3369ae1b0 con 0x55f3369d0160 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.038+0000 7f7731ffd740 10 client.0 _ll_register_callbacks cb 0x7f772405fbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f336a345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f336a345c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48422/0 (socket says 172.21.15.37:48422) 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 -- 172.21.15.37:0/2116461214 learned_addr learned my addr 172.21.15.37:0/2116461214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772cbe0640 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f3369ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772dbe2640 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f3369c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 -- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 msgr2=0x55f3369c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f3369c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 -- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 msgr2=0x55f3369ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f3369ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 -- 172.21.15.37:0/2116461214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3369aec10 con 0x55f3369b3280 2024-05-10T08:43:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f772d3e1640 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f336a345c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7724069320 tx=0x7f77240955b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b0e0f4ca417c5e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f7707fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f7707fff640 1 -- 172.21.15.37:0/2116461214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772405f7f0 con 0x55f3369b3280 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f7707fff640 1 -- 172.21.15.37:0/2116461214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f7724095b00 con 0x55f3369b3280 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7718025050 con 0x55f3369b3280 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f7707fff640 1 -- 172.21.15.37:0/2116461214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7724095340 con 0x55f3369b3280 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f7731ffd740 10 client.5934 fetch_fsmap learned FSMap version 35 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.039+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55f3369af790 con 0x55f3369b3280 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7707fff640 1 -- 172.21.15.37:0/2116461214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718025050 con 0x55f3369b3280 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7707fff640 1 -- 172.21.15.37:0/2116461214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 3494+0+0 (secure 0 0 0) 0x7f7724095020 con 0x55f3369b3280 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 10 client.5934 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 10 client.5934 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 20 client.5934 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369c3930 0x55f3369ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 4 client.5934 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:43:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f3368f49b0 con 0x55f3369c3930 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f772cbe0640 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369c3930 0x55f3369ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f772cbe0640 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369c3930 0x55f3369ce510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc01f06a5699d2eb server_cookie=efb26e2597f75fe in_seq=0 out_seq=0 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7707fff640 10 client.5934 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7707fff640 1 -- 172.21.15.37:0/2116461214 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x55f3368f49b0 con 0x55f3369c3930 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7707fff640 10 client.5934 handle_command_reply: tid=0 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 client.5934 shutdown 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 msgr2=0x55f336a345c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f336a345c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7724069320 tx=0x7f77240955b0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 shutdown_connections 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f3369d0160 0x55f3369c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3369b51b0 0x55f3369ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55f3369c3930 0x55f3369ce510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 --2- 172.21.15.37:0/2116461214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3369b3280 0x55f336a345c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7707fff640 0 client.5934 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.040+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 >> 172.21.15.37:0/2116461214 conn(0x55f3369b2b40 msgr2=0x55f3369dd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 shutdown_connections 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f7731ffd740 1 -- 172.21.15.37:0/2116461214 wait complete. 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f7731ffd740 20 client.5934 trim_cache size 0 max 16384 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stdout: "86fa7ce4-5df3-4f25-8759-ba85f4594b13": { 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-10T08:43:13.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "86fa7ce4-5df3-4f25-8759-ba85f4594b13", 2024-05-10T08:43:13.048 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair,force" 2024-05-10T08:43:13.048 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:13.048 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:13.048 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f770c0762d0 msgr2=0x7f770c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f770c0762d0 0x7f770c078790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f77280ca460 tx=0x7f7718008040 comp rx=0 tx=0).stop 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 msgr2=0x7f77280c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280c91a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f772400b420 tx=0x7f772400b8e0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 shutdown_connections 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f770c0762d0 0x7f770c078790 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77281606d0 0x7f772806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77280d0590 0x7f77281f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 --2- 172.21.15.37:0/4270117173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77280ce610 0x7f77280c91a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 >> 172.21.15.37:0/4270117173 conn(0x7f77280b49d0 msgr2=0x7f7728071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 shutdown_connections 2024-05-10T08:43:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:13.041+0000 7f772f645640 1 -- 172.21.15.37:0/4270117173 wait complete. 2024-05-10T08:43:13.052 INFO:tasks.cephfs.filesystem:scrub status for tag:86fa7ce4-5df3-4f25-8759-ba85f4594b13 - {'path': '/', 'tag': '86fa7ce4-5df3-4f25-8759-ba85f4594b13', 'options': 'recursive,repair,force'} 2024-05-10T08:43:23.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:43:23.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:43:43.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:43:43.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-05-10T08:43:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.172+0000 7f383d493640 1 Processor -- start 2024-05-10T08:43:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.172+0000 7f383d493640 1 -- start start 2024-05-10T08:43:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.173+0000 7f383d493640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383815c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.173+0000 7f383d493640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f383806e4d0 0x7f38380aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.173+0000 7f383d493640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f383815c920 con 0x7f383806e0f0 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.173+0000 7f383d493640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f383815cc00 con 0x7f383806e4d0 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.173+0000 7f383d493640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f383815cee0 con 0x7f3838072840 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.173+0000 7f3836ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f383806e0f0 0x7f38380d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44780/0 (socket says 172.21.15.37:44780) 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.173+0000 7f3836ffd640 1 -- 172.21.15.37:0/4194202901 learned_addr learned my addr 172.21.15.37:0/4194202901 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f38367fc640 1 --2- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f38377fe640 1 --2- 172.21.15.37:0/4194202901 >> v2:172.21.15.82:3300/0 conn(0x7f383806e4d0 0x7f38380aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f3835ffb640 1 -- 172.21.15.37:0/4194202901 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081834577 0 0) 0x7f383815c920 con 0x7f383806e0f0 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f3835ffb640 1 -- 172.21.15.37:0/4194202901 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3820003520 con 0x7f383806e0f0 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f3835ffb640 1 -- 172.21.15.37:0/4194202901 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1272629992 0 0) 0x7f3820003520 con 0x7f383806e0f0 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f38377fe640 1 -- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 msgr2=0x7f383815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f38377fe640 1 --2- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383815c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f38377fe640 1 -- 172.21.15.37:0/4194202901 >> v1:172.21.15.37:6789/0 conn(0x7f383806e0f0 legacy=0x7f38380d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.174+0000 7f38377fe640 1 -- 172.21.15.37:0/4194202901 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383815d1c0 con 0x7f383806e4d0 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.175+0000 7f38377fe640 1 --2- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 0x7f38380aec30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f38300097a0 tx=0x7f383002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e5408a4e4b8a81c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.175+0000 7f3835ffb640 1 -- 172.21.15.37:0/4194202901 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830037070 con 0x7f383806e4d0 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.175+0000 7f3835ffb640 1 -- 172.21.15.37:0/4194202901 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383002aba0 con 0x7f383806e4d0 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.175+0000 7f3835ffb640 1 -- 172.21.15.37:0/4194202901 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828001670 con 0x7f383806e4d0 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.175+0000 7f383d493640 1 -- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 msgr2=0x7f38380aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.175+0000 7f383d493640 1 --2- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 0x7f38380aec30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f38300097a0 tx=0x7f383002a110 comp rx=0 tx=0).stop 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.176+0000 7f383d493640 1 -- 172.21.15.37:0/4194202901 shutdown_connections 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.176+0000 7f383d493640 1 --2- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 0x7f38380aec30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.176+0000 7f383d493640 1 --2- 172.21.15.37:0/4194202901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.176+0000 7f383d493640 1 -- 172.21.15.37:0/4194202901 >> 172.21.15.37:0/4194202901 conn(0x7f383806c3a0 msgr2=0x7f383806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.176+0000 7f383d493640 1 -- 172.21.15.37:0/4194202901 shutdown_connections 2024-05-10T08:43:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.176+0000 7f383d493640 1 -- 172.21.15.37:0/4194202901 wait complete. 2024-05-10T08:43:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.177+0000 7f383d493640 1 Processor -- start 2024-05-10T08:43:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.177+0000 7f383d493640 1 -- start start 2024-05-10T08:43:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f383d493640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f383806e0f0 0x7f38381f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f383d493640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 0x7f38380d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f383d493640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f383d493640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38380ae7d0 con 0x7f383806e0f0 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f383d493640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38380ae650 con 0x7f383806e4d0 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f383d493640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f38381530b0 con 0x7f3838072840 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f383806e0f0 0x7f38381f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f383806e0f0 0x7f38381f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33576/0 (socket says 172.21.15.37:33576) 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 -- 172.21.15.37:0/965804963 learned_addr learned my addr 172.21.15.37:0/965804963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f38367fc640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 0x7f38380d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f38377fe640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 -- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 msgr2=0x7f383814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383814e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 -- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 msgr2=0x7f38380d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 0x7f38380d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 -- 172.21.15.37:0/965804963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38380d0560 con 0x7f383806e0f0 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.178+0000 7f3836ffd640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f383806e0f0 0x7f38381f18a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f382800c730 tx=0x7f382800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.179+0000 7f381f7fe640 1 -- 172.21.15.37:0/965804963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828017070 con 0x7f383806e0f0 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.179+0000 7f381f7fe640 1 -- 172.21.15.37:0/965804963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3828005ad0 con 0x7f383806e0f0 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.179+0000 7f381f7fe640 1 -- 172.21.15.37:0/965804963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828007070 con 0x7f383806e0f0 2024-05-10T08:43:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.179+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38381f1f60 con 0x7f383806e0f0 2024-05-10T08:43:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.179+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38381f2520 con 0x7f383806e0f0 2024-05-10T08:43:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.181+0000 7f381f7fe640 1 -- 172.21.15.37:0/965804963 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f382801a070 con 0x7f383806e0f0 2024-05-10T08:43:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.182+0000 7f381f7fe640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38240762d0 0x7f3824078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.182+0000 7f381f7fe640 1 -- 172.21.15.37:0/965804963 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f3828096bc0 con 0x7f383806e0f0 2024-05-10T08:43:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.182+0000 7f38367fc640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38240762d0 0x7f3824078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.182+0000 7f38401af740 1 Processor -- start 2024-05-10T08:43:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.182+0000 7f38401af740 1 -- start start 2024-05-10T08:43:43.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.182+0000 7f38367fc640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38240762d0 0x7f3824078790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f383815b4e0 tx=0x7f382c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc27f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38401af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc2824600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2824b40 0x55afc27f9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38401af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afc27c1690 con 0x55afc2825280 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55afc275ef30 con 0x55afc2824b40 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55afc2717b20 con 0x55afc2842160 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc2824600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc2824600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33580/0 (socket says 172.21.15.37:33580) 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38367fc640 1 -- 172.21.15.37:0/3294563191 learned_addr learned my addr 172.21.15.37:0/3294563191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f3836ffd640 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc27f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38367fc640 1 -- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 msgr2=0x55afc27f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.183+0000 7f38377fe640 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2824b40 0x55afc27f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f38367fc640 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc27f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f38367fc640 1 -- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2824b40 msgr2=0x55afc27f9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f38367fc640 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2824b40 0x55afc27f9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f38367fc640 1 -- 172.21.15.37:0/3294563191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afc270fe60 con 0x55afc2825280 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f3836ffd640 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc27f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f38377fe640 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2824b40 0x55afc27f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f38367fc640 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc2824600 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f382c016740 tx=0x7f382c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22dcf40f24eefbf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f381cff9640 1 -- 172.21.15.37:0/3294563191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c026070 con 0x55afc2825280 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f381cff9640 1 -- 172.21.15.37:0/3294563191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c014ae0 con 0x55afc2825280 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.184+0000 7f381cff9640 1 -- 172.21.15.37:0/3294563191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c021400 con 0x55afc2825280 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 -- 172.21.15.37:0/3294563191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 msgr2=0x55afc2824600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc2824600 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f382c016740 tx=0x7f382c012000 comp rx=0 tx=0).stop 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 -- 172.21.15.37:0/3294563191 shutdown_connections 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2824b40 0x55afc27f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc2824600 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 --2- 172.21.15.37:0/3294563191 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc27f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 -- 172.21.15.37:0/3294563191 >> 172.21.15.37:0/3294563191 conn(0x55afc27f6d60 msgr2=0x55afc283f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 -- 172.21.15.37:0/3294563191 shutdown_connections 2024-05-10T08:43:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 -- 172.21.15.37:0/3294563191 wait complete. 2024-05-10T08:43:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 -- start start 2024-05-10T08:43:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.185+0000 7f38401af740 1 Processor -- start 2024-05-10T08:43:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38401af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2842160 0x55afc2852fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2827860 0x55afc2840cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38401af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afc271b5e0 con 0x55afc2825280 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55afc275aef0 con 0x55afc2842160 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55afc27f8f10 con 0x55afc2827860 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38401af740 10 client.0 _ll_register_callbacks cb 0x55afc2716320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33592/0 (socket says 172.21.15.37:33592) 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f3836ffd640 1 -- 172.21.15.37:0/2872831991 learned_addr learned my addr 172.21.15.37:0/2872831991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38377fe640 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2827860 0x55afc2840cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f3836ffd640 1 -- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2827860 msgr2=0x55afc2840cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.186+0000 7f38367fc640 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2842160 0x55afc2852fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2827860 0x55afc2840cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3836ffd640 1 -- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2842160 msgr2=0x55afc2852fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2842160 0x55afc2852fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3836ffd640 1 -- 172.21.15.37:0/2872831991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afc253a7d0 con 0x55afc2825280 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f9b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3828005880 tx=0x7f38280602d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bfa8612690e9ac server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3815ffb640 1 -- 172.21.15.37:0/2872831991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382805fcb0 con 0x55afc2825280 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3815ffb640 1 -- 172.21.15.37:0/2872831991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f38280661c0 con 0x55afc2825280 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f382c014ae0 con 0x55afc2825280 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3815ffb640 1 -- 172.21.15.37:0/2872831991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3828063fb0 con 0x55afc2825280 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 10 client.5946 fetch_fsmap learned FSMap version 36 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55afc24703f0 con 0x55afc2825280 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3815ffb640 1 -- 172.21.15.37:0/2872831991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c014ae0 con 0x55afc2825280 2024-05-10T08:43:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f3815ffb640 1 -- 172.21.15.37:0/2872831991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7f3828096070 con 0x55afc2825280 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 10 client.5946 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 10 client.5946 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 20 client.5946 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28202a0 0x55afc28261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 4 client.5946 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.187+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afc276cb40 con 0x55afc28202a0 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.188+0000 7f38367fc640 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28202a0 0x55afc28261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.188+0000 7f38367fc640 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28202a0 0x55afc28261f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210c170abd49adbb server_cookie=e9c4428680c9d04d in_seq=0 out_seq=0 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.188+0000 7f3815ffb640 10 client.5946 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.188+0000 7f3815ffb640 1 -- 172.21.15.37:0/2872831991 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55afc276cb40 con 0x55afc28202a0 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.188+0000 7f3815ffb640 10 client.5946 handle_command_reply: tid=0 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.188+0000 7f38401af740 1 client.5946 shutdown 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 msgr2=0x55afc284f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f9b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3828005880 tx=0x7f38280602d0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 shutdown_connections 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2827860 0x55afc2840cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2842160 0x55afc2852fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28202a0 0x55afc28261f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 --2- 172.21.15.37:0/2872831991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f9b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f3815ffb640 0 client.5946 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 >> 172.21.15.37:0/2872831991 conn(0x55afc2824b40 msgr2=0x55afc27f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 shutdown_connections 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 1 -- 172.21.15.37:0/2872831991 wait complete. 2024-05-10T08:43:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.189+0000 7f38401af740 20 client.5946 trim_cache size 0 max 16384 2024-05-10T08:43:43.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.207+0000 7f38401af740 1 Processor -- start 2024-05-10T08:43:43.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.207+0000 7f38401af740 1 -- start start 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38401af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc27fa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc283d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38401af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38381fdac0 con 0x55afc2825280 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38381fcad0 con 0x55afc2827860 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f38381f4a90 con 0x55afc2842160 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc27fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc27fa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33596/0 (socket says 172.21.15.37:33596) 2024-05-10T08:43:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 -- 172.21.15.37:0/2501697 learned_addr learned my addr 172.21.15.37:0/2501697 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38377fe640 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc283d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38367fc640 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 -- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 msgr2=0x55afc283d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc283d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 -- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 msgr2=0x55afc283ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f3836ffd640 1 -- 172.21.15.37:0/2501697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afc24300f0 con 0x55afc2825280 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38377fe640 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc283d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.208+0000 7f38367fc640 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc27fa500 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f382800a430 tx=0x7f3828096000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2ffd04c05a25f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f3817fff640 1 -- 172.21.15.37:0/2501697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382805bb70 con 0x55afc2825280 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f3817fff640 1 -- 172.21.15.37:0/2501697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3828079070 con 0x55afc2825280 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f3817fff640 1 -- 172.21.15.37:0/2501697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828068310 con 0x55afc2825280 2024-05-10T08:43:43.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 -- 172.21.15.37:0/2501697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 msgr2=0x55afc27fa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc27fa500 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f382800a430 tx=0x7f3828096000 comp rx=0 tx=0).stop 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 -- 172.21.15.37:0/2501697 shutdown_connections 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc283d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 --2- 172.21.15.37:0/2501697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc27fa500 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 -- 172.21.15.37:0/2501697 >> 172.21.15.37:0/2501697 conn(0x55afc2824b40 msgr2=0x55afc2840730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 -- 172.21.15.37:0/2501697 shutdown_connections 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.209+0000 7f38401af740 1 -- 172.21.15.37:0/2501697 wait complete. 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.210+0000 7f38401af740 1 -- start start 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.210+0000 7f38401af740 1 Processor -- start 2024-05-10T08:43:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc28bb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38381fc440 con 0x55afc2825280 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55afc27f5030 con 0x55afc2827860 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55afc27f4830 con 0x55afc2842160 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 10 client.0 _ll_register_callbacks cb 0x7f3828005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33610/0 (socket says 172.21.15.37:33610) 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 -- 172.21.15.37:0/2153773394 learned_addr learned my addr 172.21.15.37:0/2153773394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38367fc640 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38377fe640 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc28bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 -- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 msgr2=0x55afc28bb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc28bb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 -- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 msgr2=0x55afc283c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 -- 172.21.15.37:0/2153773394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afc28626f0 con 0x55afc2825280 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3836ffd640 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f340 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3828094f20 tx=0x7f3828014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44db8c15c026cbf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3815ffb640 1 -- 172.21.15.37:0/2153773394 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828068310 con 0x55afc2825280 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f3815ffb640 1 -- 172.21.15.37:0/2153773394 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f3828080070 con 0x55afc2825280 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.211+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3828079070 con 0x55afc2825280 2024-05-10T08:43:43.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f3815ffb640 1 -- 172.21.15.37:0/2153773394 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f38280689d0 con 0x55afc2825280 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 10 client.5952 fetch_fsmap learned FSMap version 36 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55afc28c20f0 con 0x55afc2825280 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f3815ffb640 1 -- 172.21.15.37:0/2153773394 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3828079070 con 0x55afc2825280 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f3815ffb640 1 -- 172.21.15.37:0/2153773394 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7f3828071070 con 0x55afc2825280 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 10 client.5952 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 10 client.5952 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 20 client.5952 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:43.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28c25b0 0x55afc28bb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 4 client.5952 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55afc283e5d0 con 0x55afc28c25b0 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38367fc640 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28c25b0 0x55afc28bb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f3815ffb640 10 client.5952 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f38367fc640 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28c25b0 0x55afc28bb950 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=478706984568ffe7 server_cookie=6c91cd95fe5aa56 in_seq=0 out_seq=0 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f3815ffb640 1 -- 172.21.15.37:0/2153773394 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55afc283e5d0 con 0x55afc28c25b0 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.212+0000 7f3815ffb640 10 client.5952 handle_command_reply: tid=0 2024-05-10T08:43:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 client.5952 shutdown 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 msgr2=0x55afc284f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f340 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3828094f20 tx=0x7f3828014040 comp rx=0 tx=0).stop 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 shutdown_connections 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55afc2842160 0x55afc28bb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afc2827860 0x55afc283c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x55afc28c25b0 0x55afc28bb950 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 --2- 172.21.15.37:0/2153773394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afc2825280 0x55afc284f340 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f3815ffb640 0 client.5952 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 >> 172.21.15.37:0/2153773394 conn(0x55afc2824b40 msgr2=0x55afc283f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 shutdown_connections 2024-05-10T08:43:43.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 1 -- 172.21.15.37:0/2153773394 wait complete. 2024-05-10T08:43:43.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f38401af740 20 client.5952 trim_cache size 0 max 16384 2024-05-10T08:43:43.222 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:43:43.223 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:43:43.223 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:43:43.223 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:43:43.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38240762d0 msgr2=0x7f3824078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38240762d0 0x7f3824078790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f383815b4e0 tx=0x7f382c00b040 comp rx=0 tx=0).stop 2024-05-10T08:43:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f383806e0f0 msgr2=0x7f38381f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f383806e0f0 0x7f38381f18a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f382800c730 tx=0x7f382800cbf0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 shutdown_connections 2024-05-10T08:43:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38240762d0 0x7f3824078790 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3838072840 0x7f383814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383806e4d0 0x7f38380d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 --2- 172.21.15.37:0/965804963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f383806e0f0 0x7f38381f18a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.213+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 >> 172.21.15.37:0/965804963 conn(0x7f383806c3a0 msgr2=0x7f383806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.214+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 shutdown_connections 2024-05-10T08:43:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.214+0000 7f383d493640 1 -- 172.21.15.37:0/965804963 wait complete. 2024-05-10T08:43:43.228 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:43:43.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:43:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.333+0000 7fc33a21d640 1 Processor -- start 2024-05-10T08:43:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.333+0000 7fc33a21d640 1 -- start start 2024-05-10T08:43:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.334+0000 7fc33a21d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3341629a0 0x7fc3340d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.334+0000 7fc33a21d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc3340d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.334+0000 7fc33a21d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3340d3330 con 0x7fc3340d2dc0 2024-05-10T08:43:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.334+0000 7fc33a21d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc3340d2170 con 0x7fc3341629a0 2024-05-10T08:43:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.334+0000 7fc33a21d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3340d2450 con 0x7fc3340d0cb0 2024-05-10T08:43:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.334+0000 7fc332ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc3340d2dc0 0x7fc3340c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44796/0 (socket says 172.21.15.37:44796) 2024-05-10T08:43:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.334+0000 7fc332ffd640 1 -- 172.21.15.37:0/1272946574 learned_addr learned my addr 172.21.15.37:0/1272946574 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3337fe640 1 --2- 172.21.15.37:0/1272946574 >> v2:172.21.15.82:3300/0 conn(0x7fc3341629a0 0x7fc3340d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc333fff640 1 --2- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc3340d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3327fc640 1 -- 172.21.15.37:0/1272946574 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137396596 0 0) 0x7fc3340d3330 con 0x7fc3340d2dc0 2024-05-10T08:43:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3327fc640 1 -- 172.21.15.37:0/1272946574 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003520 con 0x7fc3340d2dc0 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3337fe640 1 -- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 msgr2=0x7fc3340d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3337fe640 1 --2- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc3340d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3327fc640 1 -- 172.21.15.37:0/1272946574 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 558700172 0 0) 0x7fc31c003520 con 0x7fc3340d2dc0 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3337fe640 1 -- 172.21.15.37:0/1272946574 >> v1:172.21.15.37:6789/0 conn(0x7fc3340d2dc0 legacy=0x7fc3340c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.335+0000 7fc3337fe640 1 -- 172.21.15.37:0/1272946574 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3340d2730 con 0x7fc3341629a0 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc3337fe640 1 --2- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3341629a0 0x7fc3340d35c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc3240097a0 tx=0x7fc32402a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88974d0ae82b3dd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc3327fc640 1 -- 172.21.15.37:0/1272946574 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324037070 con 0x7fc3341629a0 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc3327fc640 1 -- 172.21.15.37:0/1272946574 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32402aa90 con 0x7fc3341629a0 2024-05-10T08:43:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc3327fc640 1 -- 172.21.15.37:0/1272946574 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328001670 con 0x7fc3341629a0 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc33a21d640 1 -- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3341629a0 msgr2=0x7fc3340d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc33a21d640 1 --2- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3341629a0 0x7fc3340d35c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc3240097a0 tx=0x7fc32402a000 comp rx=0 tx=0).stop 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc33a21d640 1 -- 172.21.15.37:0/1272946574 shutdown_connections 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc33a21d640 1 --2- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc3340d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc33a21d640 1 --2- 172.21.15.37:0/1272946574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3341629a0 0x7fc3340d35c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc33a21d640 1 -- 172.21.15.37:0/1272946574 >> 172.21.15.37:0/1272946574 conn(0x7fc3340d4fe0 msgr2=0x7fc3340d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.336+0000 7fc33a21d640 1 -- 172.21.15.37:0/1272946574 shutdown_connections 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.337+0000 7fc33a21d640 1 -- 172.21.15.37:0/1272946574 wait complete. 2024-05-10T08:43:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.338+0000 7fc33a21d640 1 Processor -- start 2024-05-10T08:43:43.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.338+0000 7fc33a21d640 1 -- start start 2024-05-10T08:43:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc334156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3340d2dc0 0x7fc3340b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3341629a0 0x7fc3340a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3340cf440 con 0x7fc3341629a0 2024-05-10T08:43:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3340cf2c0 con 0x7fc3340d2dc0 2024-05-10T08:43:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3340c95e0 con 0x7fc3340d0cb0 2024-05-10T08:43:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3341629a0 0x7fc3340a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3341629a0 0x7fc3340a20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33622/0 (socket says 172.21.15.37:33622) 2024-05-10T08:43:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 -- 172.21.15.37:0/776239147 learned_addr learned my addr 172.21.15.37:0/776239147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc3337fe640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc334156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc332ffd640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3340d2dc0 0x7fc3340b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 -- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 msgr2=0x7fc334156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc334156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 -- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3340d2dc0 msgr2=0x7fc3340b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3340d2dc0 0x7fc3340b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 -- 172.21.15.37:0/776239147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3340b86c0 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc333fff640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3341629a0 0x7fc3340a20f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009dd0 tx=0x7fc32c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc31bfff640 1 -- 172.21.15.37:0/776239147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c018020 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc31bfff640 1 -- 172.21.15.37:0/776239147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c014480 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc31bfff640 1 -- 172.21.15.37:0/776239147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c014870 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3340b89a0 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.339+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33409f110 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.341+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33409f310 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.341+0000 7fc31bfff640 1 -- 172.21.15.37:0/776239147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc32c005d10 con 0x7fc3341629a0 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.341+0000 7fc31bfff640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3200762d0 0x7fc320078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.342+0000 7fc31bfff640 1 -- 172.21.15.37:0/776239147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fc32c098190 con 0x7fc3341629a0 2024-05-10T08:43:43.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.342+0000 7fc3337fe640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3200762d0 0x7fc320078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.342+0000 7fc3337fe640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3200762d0 0x7fc320078790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc324034000 tx=0x7fc32402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.346+0000 7fc31bfff640 1 -- 172.21.15.37:0/776239147 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc33409f310 con 0x7fc3341629a0 2024-05-10T08:43:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.576+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3340693f0 con 0x7fc3341629a0 2024-05-10T08:43:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.577+0000 7fc31bfff640 1 -- 172.21.15.37:0/776239147 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5180 (secure 0 0 0) 0x7fc32c022070 con 0x7fc3341629a0 2024-05-10T08:43:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:43.577 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:43:13.580167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:43:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-05-10T08:43:43.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3200762d0 msgr2=0x7fc320078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3200762d0 0x7fc320078790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc324034000 tx=0x7fc32402e000 comp rx=0 tx=0).stop 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3341629a0 msgr2=0x7fc3340a20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3341629a0 0x7fc3340a20f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009dd0 tx=0x7fc32c00c490 comp rx=0 tx=0).stop 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 shutdown_connections 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3200762d0 0x7fc320078790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3341629a0 0x7fc3340a20f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3340d2dc0 0x7fc3340b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 --2- 172.21.15.37:0/776239147 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3340d0cb0 0x7fc334156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 >> 172.21.15.37:0/776239147 conn(0x7fc3340d4fe0 msgr2=0x7fc3340d53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 shutdown_connections 2024-05-10T08:43:43.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.579+0000 7fc33a21d640 1 -- 172.21.15.37:0/776239147 wait complete. 2024-05-10T08:43:43.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-05-10T08:43:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.696+0000 7f8d18ff0640 1 Processor -- start 2024-05-10T08:43:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.696+0000 7f8d18ff0640 1 -- start start 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.696+0000 7f8d18ff0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 0x7f8d140d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d18ff0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d140d1760 con 0x7f8d140d3cd0 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d18ff0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d140d1a40 con 0x7f8d140d0cf0 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d18ff0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d140d30f0 con 0x7f8d1415f380 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d12d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d140d3cd0 0x7f8d140b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44798/0 (socket says 172.21.15.37:44798) 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d12d9d640 1 -- 172.21.15.37:0/1194929730 learned_addr learned my addr 172.21.15.37:0/1194929730 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890265830 0 0) 0x7f8d140d1760 con 0x7f8d140d3cd0 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d1259c640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 0x7f8d140d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d00003520 con 0x7f8d140d3cd0 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2115081281 0 0) 0x7f8d00003520 con 0x7f8d140d3cd0 2024-05-10T08:43:43.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 msgr2=0x7f8d140d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 0x7f8d140d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 >> v1:172.21.15.82:6789/0 conn(0x7f8d140d0cf0 legacy=0x7f8d140d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d140d1d20 con 0x7f8d140d3cd0 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8d0c0019f0 con 0x7f8d140d3cd0 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 >> v1:172.21.15.37:6789/0 conn(0x7f8d140d3cd0 legacy=0x7f8d140b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000039e0 0x7f8d00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 0x7f8d00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d00004d40 0x7f8d000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d140d30f0 con 0x7f8d00004d40 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0000ba70 con 0x7f8d000039e0 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0000bc70 con 0x7f8d1415f380 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.697+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d00004d40 0x7f8d000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d1259c640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000039e0 0x7f8d00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 0x7f8d00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d12d9d640 1 -- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 msgr2=0x7f8d00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d1415f380 0x7f8d00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d12d9d640 1 -- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000039e0 msgr2=0x7f8d00003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d000039e0 0x7f8d00003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d12d9d640 1 -- 172.21.15.37:0/1194929730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d00003520 con 0x7f8d00004d40 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.698+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d00004d40 0x7f8d000051c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8d1408f260 tx=0x7f8d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c019452e7759de server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00a480 con 0x7f8d00004d40 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c02f070 con 0x7f8d00004d40 2024-05-10T08:43:43.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d11d9b640 1 -- 172.21.15.37:0/1194929730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c02bc90 con 0x7f8d00004d40 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d18ff0640 1 -- 172.21.15.37:0/1194929730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d00004d40 msgr2=0x7f8d000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d18ff0640 1 --2- 172.21.15.37:0/1194929730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d00004d40 0x7f8d000051c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8d1408f260 tx=0x7f8d00005830 comp rx=0 tx=0).stop 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d12d9d640 1 -- 172.21.15.37:0/1194929730 reap_dead start 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d18ff0640 1 -- 172.21.15.37:0/1194929730 shutdown_connections 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d18ff0640 1 -- 172.21.15.37:0/1194929730 >> 172.21.15.37:0/1194929730 conn(0x7f8d140d4fe0 msgr2=0x7f8d140d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d18ff0640 1 -- 172.21.15.37:0/1194929730 shutdown_connections 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.699+0000 7f8d18ff0640 1 -- 172.21.15.37:0/1194929730 wait complete. 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 Processor -- start 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 -- start start 2024-05-10T08:43:43.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00004d40 0x7f8d1415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d14154590 0x7f8d1415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c980 0x7f8d1415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d140d2370 con 0x7f8d1415c980 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1415f760 con 0x7f8d14154590 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.701+0000 7f8d18ff0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d140d2800 con 0x7f8d00004d40 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c980 0x7f8d1415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c980 0x7f8d1415ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33646/0 (socket says 172.21.15.37:33646) 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 -- 172.21.15.37:0/222140280 learned_addr learned my addr 172.21.15.37:0/222140280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d1259c640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00004d40 0x7f8d1415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d14154590 0x7f8d1415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 -- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00004d40 msgr2=0x7f8d1415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00004d40 0x7f8d1415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 -- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d14154590 msgr2=0x7f8d1415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d14154590 0x7f8d1415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 -- 172.21.15.37:0/222140280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d141569a0 con 0x7f8d1415c980 2024-05-10T08:43:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c980 0x7f8d1415ce00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c02b4c0 tx=0x7f8d140cfa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d0b7fe640 1 -- 172.21.15.37:0/222140280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00a480 con 0x7f8d1415c980 2024-05-10T08:43:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d0b7fe640 1 -- 172.21.15.37:0/222140280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c02cb50 con 0x7f8d1415c980 2024-05-10T08:43:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d14155be0 con 0x7f8d1415c980 2024-05-10T08:43:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d0b7fe640 1 -- 172.21.15.37:0/222140280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c034470 con 0x7f8d1415c980 2024-05-10T08:43:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.702+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d141561a0 con 0x7f8d1415c980 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.705+0000 7f8d0b7fe640 1 -- 172.21.15.37:0/222140280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d0c03e070 con 0x7f8d1415c980 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.705+0000 7f8d0b7fe640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cf4076300 0x7f8cf40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.705+0000 7f8d0b7fe640 1 -- 172.21.15.37:0/222140280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f8d0c0b79b0 con 0x7f8d1415c980 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.705+0000 7f8d1259c640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cf4076300 0x7f8cf40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.706+0000 7f8d1bde6740 1 Processor -- start 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.706+0000 7f8d1259c640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cf4076300 0x7f8cf40787c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009bc0 tx=0x7f8d04009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.706+0000 7f8d1bde6740 1 -- start start 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b8a6d0 0x556a87b3d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b6cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b6d0b0 0x556a87b41ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556a87a2d920 con 0x556a87b6d0b0 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556a87aa2dd0 con 0x556a87b6d7f0 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556a87a533e0 con 0x556a87b8a6d0 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b6d0b0 0x556a87b41ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b6d0b0 0x556a87b41ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33652/0 (socket says 172.21.15.37:33652) 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 -- 172.21.15.37:0/398453912 learned_addr learned my addr 172.21.15.37:0/398453912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b6cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1259c640 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b8a6d0 0x556a87b3d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 -- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b8a6d0 msgr2=0x556a87b3d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b8a6d0 0x556a87b3d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 -- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 msgr2=0x556a87b6cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b6cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 -- 172.21.15.37:0/398453912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a878847c0 con 0x556a87b6d0b0 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d1259c640 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b8a6d0 0x556a87b3d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b6d0b0 0x556a87b41ec0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0b5cc0 tx=0x7f8d0c001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0e6be233607461 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.707+0000 7f8cf3fff640 1 -- 172.21.15.37:0/398453912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0801f0 con 0x556a87b6d0b0 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8cf3fff640 1 -- 172.21.15.37:0/398453912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c02f070 con 0x556a87b6d0b0 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8cf3fff640 1 -- 172.21.15.37:0/398453912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c087270 con 0x556a87b6d0b0 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 -- 172.21.15.37:0/398453912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b6d0b0 msgr2=0x556a87b41ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b6d0b0 0x556a87b41ec0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0b5cc0 tx=0x7f8d0c001280 comp rx=0 tx=0).stop 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 -- 172.21.15.37:0/398453912 shutdown_connections 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b6d0b0 0x556a87b41ec0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b6cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/398453912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b8a6d0 0x556a87b3d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 -- 172.21.15.37:0/398453912 >> 172.21.15.37:0/398453912 conn(0x556a87b3f560 msgr2=0x556a87b87b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 -- 172.21.15.37:0/398453912 shutdown_connections 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.708+0000 7f8d1bde6740 1 -- 172.21.15.37:0/398453912 wait complete. 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.709+0000 7f8d1bde6740 1 -- start start 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.709+0000 7f8d1bde6740 1 Processor -- start 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b9b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b6c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556a87aab440 con 0x556a87b8a6d0 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556a87aa6120 con 0x556a87b6d7f0 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556a87ab4210 con 0x556a87b6ba30 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1bde6740 10 client.0 _ll_register_callbacks cb 0x556a87a4b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b6c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b6c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33658/0 (socket says 172.21.15.37:33658) 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 -- 172.21.15.37:0/97540374 learned_addr learned my addr 172.21.15.37:0/97540374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d1259c640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b9b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 -- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 msgr2=0x556a87b87b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 -- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 msgr2=0x556a87b9b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b9b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 -- 172.21.15.37:0/97540374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a878e4f50 con 0x556a87b8a6d0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b6c940 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc015640 tx=0x7f8cfc015a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b98d1972d9eb6d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.710+0000 7f8cf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8cf17fa640 1 -- 172.21.15.37:0/97540374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0052e0 con 0x556a87b8a6d0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8cf17fa640 1 -- 172.21.15.37:0/97540374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f8cfc0035f0 con 0x556a87b8a6d0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d0c02f070 con 0x556a87b8a6d0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8cf17fa640 1 -- 172.21.15.37:0/97540374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8cfc026050 con 0x556a87b8a6d0 2024-05-10T08:43:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 10 client.5970 fetch_fsmap learned FSMap version 36 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x556a877780b0 con 0x556a87b8a6d0 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8cf17fa640 1 -- 172.21.15.37:0/97540374 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c02f070 con 0x556a87b8a6d0 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8cf17fa640 1 -- 172.21.15.37:0/97540374 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7f8cfc029020 con 0x556a87b8a6d0 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 10 client.5970 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 10 client.5970 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 20 client.5970 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b8b0d0 0x556a87b8b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 4 client.5970 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a87ab4a20 con 0x556a87b8b0d0 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.711+0000 7f8d1259c640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b8b0d0 0x556a87b8b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8cf17fa640 10 client.5970 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1259c640 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b8b0d0 0x556a87b8b4b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb0867715d9d95a server_cookie=d476a8ab229facda in_seq=0 out_seq=0 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8cf17fa640 1 -- 172.21.15.37:0/97540374 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556a87ab4a20 con 0x556a87b8b0d0 2024-05-10T08:43:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8cf17fa640 10 client.5970 handle_command_reply: tid=0 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 client.5970 shutdown 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 msgr2=0x556a87b6c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b6c940 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc015640 tx=0x7f8cfc015a40 comp rx=0 tx=0).stop 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 shutdown_connections 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b8b0d0 0x556a87b8b4b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b6c940 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/97540374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b9b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8cf17fa640 0 client.5970 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 >> 172.21.15.37:0/97540374 conn(0x556a87b6d0b0 msgr2=0x556a87b3ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 shutdown_connections 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.712+0000 7f8d1bde6740 1 -- 172.21.15.37:0/97540374 wait complete. 2024-05-10T08:43:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.713+0000 7f8d1bde6740 20 client.5970 trim_cache size 0 max 16384 2024-05-10T08:43:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.726+0000 7f8d1bde6740 1 Processor -- start 2024-05-10T08:43:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.726+0000 7f8d1bde6740 1 -- start start 2024-05-10T08:43:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b96f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b42eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d14201800 con 0x556a87b8a6d0 2024-05-10T08:43:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d14200bd0 con 0x556a87b6d7f0 2024-05-10T08:43:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d14201160 con 0x556a87b6ba30 2024-05-10T08:43:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b42eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b42eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33668/0 (socket says 172.21.15.37:33668) 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 -- 172.21.15.37:0/4129280653 learned_addr learned my addr 172.21.15.37:0/4129280653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d1259c640 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b96f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 -- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 msgr2=0x556a87b87200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 -- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 msgr2=0x556a87b96f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b96f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.727+0000 7f8d12d9d640 1 -- 172.21.15.37:0/4129280653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a87b6b860 con 0x556a87b8a6d0 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b42eb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c004fd0 tx=0x7f8d0c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6231dad3e6cf41 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8cf37fe640 1 -- 172.21.15.37:0/4129280653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0801f0 con 0x556a87b8a6d0 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8cf37fe640 1 -- 172.21.15.37:0/4129280653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c089190 con 0x556a87b8a6d0 2024-05-10T08:43:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8cf37fe640 1 -- 172.21.15.37:0/4129280653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c087270 con 0x556a87b8a6d0 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 -- 172.21.15.37:0/4129280653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 msgr2=0x556a87b42eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b42eb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c004fd0 tx=0x7f8d0c02f000 comp rx=0 tx=0).stop 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 -- 172.21.15.37:0/4129280653 shutdown_connections 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b42eb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6d7f0 0x556a87b96f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/4129280653 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6ba30 0x556a87b87200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 -- 172.21.15.37:0/4129280653 >> 172.21.15.37:0/4129280653 conn(0x556a87b6d0b0 msgr2=0x556a87b43b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 -- 172.21.15.37:0/4129280653 shutdown_connections 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.728+0000 7f8d1bde6740 1 -- 172.21.15.37:0/4129280653 wait complete. 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.729+0000 7f8d1bde6740 1 -- start start 2024-05-10T08:43:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.729+0000 7f8d1bde6740 1 Processor -- start 2024-05-10T08:43:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6ba30 0x556a87b896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6d7f0 0x556a87c04e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1bde6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b3c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556a87b6f1e0 con 0x556a87b8a6d0 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556a87a5ca20 con 0x556a87b6ba30 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1bde6740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556a87b6e410 con 0x556a87b6d7f0 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1bde6740 10 client.0 _ll_register_callbacks cb 0x7f8cfc001590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b3c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b3c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33678/0 (socket says 172.21.15.37:33678) 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 -- 172.21.15.37:0/2049869668 learned_addr learned my addr 172.21.15.37:0/2049869668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d1259c640 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6ba30 0x556a87b896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d09d9b640 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6d7f0 0x556a87c04e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 -- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6d7f0 msgr2=0x556a87c04e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6d7f0 0x556a87c04e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 -- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6ba30 msgr2=0x556a87b896f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6ba30 0x556a87b896f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.730+0000 7f8d12d9d640 1 -- 172.21.15.37:0/2049869668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a87b69ea0 con 0x556a87b8a6d0 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d12d9d640 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b3c3b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c004fd0 tx=0x7f8d0c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b314b8b3de8444ea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8cf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8cf17fa640 1 -- 172.21.15.37:0/2049869668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0801f0 con 0x556a87b8a6d0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8cf17fa640 1 -- 172.21.15.37:0/2049869668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f8d0c087270 con 0x556a87b8a6d0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556a87aae890 con 0x556a87b8a6d0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8cf17fa640 1 -- 172.21.15.37:0/2049869668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8d0c080590 con 0x556a87b8a6d0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 10 client.5976 fetch_fsmap learned FSMap version 36 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x556a87b69ea0 con 0x556a87b8a6d0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8cf17fa640 1 -- 172.21.15.37:0/2049869668 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556a87aae890 con 0x556a87b8a6d0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8cf17fa640 1 -- 172.21.15.37:0/2049869668 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7f8d0c049070 con 0x556a87b8a6d0 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 10 client.5976 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 10 client.5976 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 20 client.5976 populate_metadata read hostname 'smithi037' 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b692d0 0x556a87b696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 4 client.5976 mds_command: new command op to 5637 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 --> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x556a8791f920 con 0x556a87b692d0 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.731+0000 7f8d1259c640 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b692d0 0x556a87b696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8cf17fa640 10 client.5976 ms_handle_connect on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1259c640 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b692d0 0x556a87b696b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a48dccd4a0d0a8e8 server_cookie=8451c41c16ff991 in_seq=0 out_seq=0 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8cf17fa640 1 -- 172.21.15.37:0/2049869668 <== mds.0 v2:172.21.15.37:6833/640581632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a8791f920 con 0x556a87b692d0 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8cf17fa640 10 client.5976 handle_command_reply: tid=0 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 client.5976 shutdown 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 msgr2=0x556a87b3c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b3c3b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c004fd0 tx=0x7f8d0c000f40 comp rx=0 tx=0).stop 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 shutdown_connections 2024-05-10T08:43:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:6833/640581632,v1:172.21.15.37:6835/640581632] conn(0x556a87b692d0 0x556a87b696b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556a87b8a6d0 0x556a87b3c3b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556a87b6d7f0 0x556a87c04e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 --2- 172.21.15.37:0/2049869668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a87b6ba30 0x556a87b896f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8cf17fa640 0 client.5976 ms_handle_reset on v2:172.21.15.37:6833/640581632 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 >> 172.21.15.37:0/2049869668 conn(0x556a87b6d0b0 msgr2=0x556a87b8b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 shutdown_connections 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 1 -- 172.21.15.37:0/2049869668 wait complete. 2024-05-10T08:43:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.732+0000 7f8d1bde6740 20 client.5976 trim_cache size 0 max 16384 2024-05-10T08:43:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:43.741 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cf4076300 msgr2=0x7f8cf40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cf4076300 0x7f8cf40787c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009bc0 tx=0x7f8d04009190 comp rx=0 tx=0).stop 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c980 msgr2=0x7f8d1415ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c980 0x7f8d1415ce00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c02b4c0 tx=0x7f8d140cfa50 comp rx=0 tx=0).stop 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 shutdown_connections 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8cf4076300 0x7f8cf40787c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c980 0x7f8d1415ce00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d14154590 0x7f8d1415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 --2- 172.21.15.37:0/222140280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d00004d40 0x7f8d1415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 >> 172.21.15.37:0/222140280 conn(0x7f8d140d4fe0 msgr2=0x7f8d140cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 shutdown_connections 2024-05-10T08:43:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.733+0000 7f8d18ff0640 1 -- 172.21.15.37:0/222140280 wait complete. 2024-05-10T08:43:43.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T08:43:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.848+0000 7f1246b32640 1 Processor -- start 2024-05-10T08:43:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.848+0000 7f1246b32640 1 -- start start 2024-05-10T08:43:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.848+0000 7f1246b32640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.848+0000 7f1246b32640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f12400d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f1246b32640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12400d3330 con 0x7f12400c8ed0 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f1246b32640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f12400d2170 con 0x7f12401629a0 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f1246b32640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f12400d2450 con 0x7f12400d2dc0 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f12448ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f12448ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33680/0 (socket says 172.21.15.37:33680) 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f12448ce640 1 -- 172.21.15.37:0/1487014945 learned_addr learned my addr 172.21.15.37:0/1487014945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f12448ce640 1 -- 172.21.15.37:0/1487014945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 msgr2=0x7f12400d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f123ffff640 1 --2- 172.21.15.37:0/1487014945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f12400d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f12448ce640 1 --2- 172.21.15.37:0/1487014945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f12400d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f12448ce640 1 -- 172.21.15.37:0/1487014945 >> v1:172.21.15.82:6789/0 conn(0x7f12400c8ed0 legacy=0x7f12400c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f12448ce640 1 -- 172.21.15.37:0/1487014945 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12400d2730 con 0x7f12401629a0 2024-05-10T08:43:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.849+0000 7f123ffff640 1 --2- 172.21.15.37:0/1487014945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f12400d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f12448ce640 1 --2- 172.21.15.37:0/1487014945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400d35c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f122802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180dfb561ba8c83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f123f7fe640 1 -- 172.21.15.37:0/1487014945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228037070 con 0x7f12401629a0 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f123f7fe640 1 -- 172.21.15.37:0/1487014945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f122802ae10 con 0x7f12401629a0 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f123f7fe640 1 -- 172.21.15.37:0/1487014945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228032660 con 0x7f12401629a0 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f1246b32640 1 -- 172.21.15.37:0/1487014945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 msgr2=0x7f12400d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f1246b32640 1 --2- 172.21.15.37:0/1487014945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400d35c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f122802a100 comp rx=0 tx=0).stop 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f1246b32640 1 -- 172.21.15.37:0/1487014945 shutdown_connections 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f1246b32640 1 --2- 172.21.15.37:0/1487014945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f12400d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f1246b32640 1 --2- 172.21.15.37:0/1487014945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.850+0000 7f1246b32640 1 -- 172.21.15.37:0/1487014945 >> 172.21.15.37:0/1487014945 conn(0x7f12400d4fe0 msgr2=0x7f12400d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.851+0000 7f1246b32640 1 -- 172.21.15.37:0/1487014945 shutdown_connections 2024-05-10T08:43:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.851+0000 7f1246b32640 1 -- 172.21.15.37:0/1487014945 wait complete. 2024-05-10T08:43:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.852+0000 7f1246b32640 1 Processor -- start 2024-05-10T08:43:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.852+0000 7f1246b32640 1 -- start start 2024-05-10T08:43:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400c8ed0 0x7f124015d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400d2dc0 0x7f12400b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12400cf440 con 0x7f12401629a0 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12400cf2c0 con 0x7f12400d2dc0 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f12400d0cb0 con 0x7f12400c8ed0 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400ba470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33686/0 (socket says 172.21.15.37:33686) 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 -- 172.21.15.37:0/136188864 learned_addr learned my addr 172.21.15.37:0/136188864 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12448ce640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400c8ed0 0x7f124015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f123ffff640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400d2dc0 0x7f12400b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 -- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400c8ed0 msgr2=0x7f124015d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400c8ed0 0x7f124015d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 -- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400d2dc0 msgr2=0x7f12400b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400d2dc0 0x7f12400b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 -- 172.21.15.37:0/136188864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12400b86c0 con 0x7f12401629a0 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12448ce640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400c8ed0 0x7f124015d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f12450cf640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400ba470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f123800c410 tx=0x7f123800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f123d7fa640 1 -- 172.21.15.37:0/136188864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238011790 con 0x7f12401629a0 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f123d7fa640 1 -- 172.21.15.37:0/136188864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1238017070 con 0x7f12401629a0 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12400b89a0 con 0x7f12401629a0 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f123d7fa640 1 -- 172.21.15.37:0/136188864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238011bb0 con 0x7f12401629a0 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.853+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12400b8f60 con 0x7f12401629a0 2024-05-10T08:43:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.854+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12400693f0 con 0x7f12401629a0 2024-05-10T08:43:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.855+0000 7f123d7fa640 1 -- 172.21.15.37:0/136188864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f123801c460 con 0x7f12401629a0 2024-05-10T08:43:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.856+0000 7f123d7fa640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12200762d0 0x7f1220078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.856+0000 7f123d7fa640 1 -- 172.21.15.37:0/136188864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f1238097350 con 0x7f12401629a0 2024-05-10T08:43:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.856+0000 7f12448ce640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12200762d0 0x7f1220078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.857+0000 7f12448ce640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12200762d0 0x7f1220078790 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1228034000 tx=0x7f122802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:43.860+0000 7f123d7fa640 1 -- 172.21.15.37:0/136188864 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1238021020 con 0x7f12401629a0 2024-05-10T08:43:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.094+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f12400b7550 con 0x7f12401629a0 2024-05-10T08:43:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.094+0000 7f123d7fa640 1 -- 172.21.15.37:0/136188864 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1238060b20 con 0x7f12401629a0 2024-05-10T08:43:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:44.094 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T08:43:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12200762d0 msgr2=0x7f1220078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12200762d0 0x7f1220078790 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1228034000 tx=0x7f122802e000 comp rx=0 tx=0).stop 2024-05-10T08:43:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 msgr2=0x7f12400ba470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400ba470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f123800c410 tx=0x7f123800c8d0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 shutdown_connections 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12200762d0 0x7f1220078790 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12401629a0 0x7f12400ba470 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400d2dc0 0x7f12400b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 --2- 172.21.15.37:0/136188864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400c8ed0 0x7f124015d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 >> 172.21.15.37:0/136188864 conn(0x7f12400d4fe0 msgr2=0x7f12400d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 shutdown_connections 2024-05-10T08:43:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.097+0000 7f1246b32640 1 -- 172.21.15.37:0/136188864 wait complete. 2024-05-10T08:43:44.107 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T08:43:44.107 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:43:44.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:43:44.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:43:44.195 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:43:44.196 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:43:44.196 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:43:44.196 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:44.212 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:43:44.212 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:44.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:43:44.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.415+0000 7fd2ec338640 1 Processor -- start 2024-05-10T08:43:44.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.415+0000 7fd2ec338640 1 -- start start 2024-05-10T08:43:44.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2ec338640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e41629a0 0x7fd2e40d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2ec338640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2e40d2dc0 0x7fd2e40d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2ec338640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2e40c8ed0 0x7fd2e40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2ec338640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e40d3330 con 0x7fd2e40d2dc0 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2ec338640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e40d2170 con 0x7fd2e40c8ed0 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2ec338640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e40d2450 con 0x7fd2e41629a0 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2e40d2dc0 0x7fd2e40d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2e40d2dc0 0x7fd2e40d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33698/0 (socket says 172.21.15.37:33698) 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 -- 172.21.15.37:0/1189715732 learned_addr learned my addr 172.21.15.37:0/1189715732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 -- 172.21.15.37:0/1189715732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e41629a0 msgr2=0x7fd2e40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 --2- 172.21.15.37:0/1189715732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e41629a0 0x7fd2e40d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 -- 172.21.15.37:0/1189715732 >> v2:172.21.15.82:3300/0 conn(0x7fd2e40c8ed0 msgr2=0x7fd2e40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 --2- 172.21.15.37:0/1189715732 >> v2:172.21.15.82:3300/0 conn(0x7fd2e40c8ed0 0x7fd2e40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.416+0000 7fd2e98d3640 1 -- 172.21.15.37:0/1189715732 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e40d2730 con 0x7fd2e40d2dc0 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.417+0000 7fd2e98d3640 1 --2- 172.21.15.37:0/1189715732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d2dc0 0x7fd2e40d3b00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd2e408e4c0 tx=0x7fd2d402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971720c482766cd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.417+0000 7fd2e90d2640 1 -- 172.21.15.37:0/1189715732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4037070 con 0x7fd2e40d2dc0 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.417+0000 7fd2e90d2640 1 -- 172.21.15.37:0/1189715732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d402ae00 con 0x7fd2e40d2dc0 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.417+0000 7fd2e90d2640 1 -- 172.21.15.37:0/1189715732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4032660 con 0x7fd2e40d2dc0 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 -- 172.21.15.37:0/1189715732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d2dc0 msgr2=0x7fd2e40d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1189715732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d2dc0 0x7fd2e40d3b00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd2e408e4c0 tx=0x7fd2d402a0b0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 -- 172.21.15.37:0/1189715732 shutdown_connections 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1189715732 >> v2:172.21.15.82:3300/0 conn(0x7fd2e40c8ed0 0x7fd2e40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1189715732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e40d2dc0 0x7fd2e40d3b00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1189715732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e41629a0 0x7fd2e40d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 -- 172.21.15.37:0/1189715732 >> 172.21.15.37:0/1189715732 conn(0x7fd2e40d4fe0 msgr2=0x7fd2e40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 -- 172.21.15.37:0/1189715732 shutdown_connections 2024-05-10T08:43:44.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.418+0000 7fd2ec338640 1 -- 172.21.15.37:0/1189715732 wait complete. 2024-05-10T08:43:44.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.419+0000 7fd2ec338640 1 Processor -- start 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.419+0000 7fd2ec338640 1 -- start start 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ec338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40c8ed0 0x7fd2e41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ec338640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d2dc0 0x7fd2e415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ec338640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e41629a0 0x7fd2e40c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ec338640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e40cf440 con 0x7fd2e41629a0 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ec338640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e40cf2c0 con 0x7fd2e40c8ed0 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ec338640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e40c98a0 con 0x7fd2e40d2dc0 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e41629a0 0x7fd2e40c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e41629a0 0x7fd2e40c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33700/0 (socket says 172.21.15.37:33700) 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 -- 172.21.15.37:0/1970235948 learned_addr learned my addr 172.21.15.37:0/1970235948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2e98d3640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d2dc0 0x7fd2e415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea0d4640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40c8ed0 0x7fd2e41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 -- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d2dc0 msgr2=0x7fd2e415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d2dc0 0x7fd2e415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 -- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40c8ed0 msgr2=0x7fd2e41580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40c8ed0 0x7fd2e41580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2ea8d5640 1 -- 172.21.15.37:0/1970235948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e415e6f0 con 0x7fd2e41629a0 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.420+0000 7fd2e98d3640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d2dc0 0x7fd2e415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.421+0000 7fd2ea8d5640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e41629a0 0x7fd2e40c9cd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00b970 tx=0x7fd2dc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.421+0000 7fd2daffd640 1 -- 172.21.15.37:0/1970235948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc019070 con 0x7fd2e41629a0 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.421+0000 7fd2daffd640 1 -- 172.21.15.37:0/1970235948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc00cb60 con 0x7fd2e41629a0 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.421+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e415e9d0 con 0x7fd2e41629a0 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.421+0000 7fd2daffd640 1 -- 172.21.15.37:0/1970235948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc014440 con 0x7fd2e41629a0 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.421+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e40cc150 con 0x7fd2e41629a0 2024-05-10T08:43:44.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.422+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e40693f0 con 0x7fd2e41629a0 2024-05-10T08:43:44.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.422+0000 7fd2daffd640 1 -- 172.21.15.37:0/1970235948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2dc01c070 con 0x7fd2e41629a0 2024-05-10T08:43:44.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.423+0000 7fd2daffd640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c8076300 0x7fd2c80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.423+0000 7fd2daffd640 1 -- 172.21.15.37:0/1970235948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd2dc097570 con 0x7fd2e41629a0 2024-05-10T08:43:44.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.423+0000 7fd2ea0d4640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c8076300 0x7fd2c80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.424+0000 7fd2ea0d4640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c8076300 0x7fd2c80787c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40d44b0 tx=0x7fd2e0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:44.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.427+0000 7fd2daffd640 1 -- 172.21.15.37:0/1970235948 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd2dc060cb0 con 0x7fd2e41629a0 2024-05-10T08:43:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.632+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd2e40c8590 con 0x7fd2e41629a0 2024-05-10T08:43:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.632+0000 7fd2daffd640 1 -- 172.21.15.37:0/1970235948 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7fd2dc0605b0 con 0x7fd2e41629a0 2024-05-10T08:43:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:43:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c8076300 msgr2=0x7fd2c80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c8076300 0x7fd2c80787c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40d44b0 tx=0x7fd2e0008040 comp rx=0 tx=0).stop 2024-05-10T08:43:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e41629a0 msgr2=0x7fd2e40c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e41629a0 0x7fd2e40c9cd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00b970 tx=0x7fd2dc00be30 comp rx=0 tx=0).stop 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 shutdown_connections 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd2c8076300 0x7fd2c80787c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2e41629a0 0x7fd2e40c9cd0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2e40d2dc0 0x7fd2e415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 --2- 172.21.15.37:0/1970235948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e40c8ed0 0x7fd2e41580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 >> 172.21.15.37:0/1970235948 conn(0x7fd2e40d4fe0 msgr2=0x7fd2e40b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 shutdown_connections 2024-05-10T08:43:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.634+0000 7fd2ec338640 1 -- 172.21.15.37:0/1970235948 wait complete. 2024-05-10T08:43:44.644 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:43:44.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:43:44.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:43:44.684 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:43:44.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:43:44.685 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:43:44.741 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:43:44.742 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:43:44.742 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:44.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:43:44.759 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:43:44.759 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:43:44.759 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:44.798 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:43:44.799 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:43:44.799 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:43:44.799 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:44.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:43:44.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:43:44.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.943+0000 7f3c664e8640 1 Processor -- start 2024-05-10T08:43:44.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.943+0000 7f3c664e8640 1 -- start start 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.943+0000 7f3c664e8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.943+0000 7f3c664e8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c60163920 0x7f3c600703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.943+0000 7f3c664e8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c60163d80 con 0x7f3c60071110 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.943+0000 7f3c664e8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3c600d10d0 con 0x7f3c60163920 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.943+0000 7f3c664e8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3c60070b80 con 0x7f3c60070d30 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c60163920 0x7f3c600703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c60163920 0x7f3c600703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33706/0 (socket says 172.21.15.37:33706) 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5f7fe640 1 -- 172.21.15.37:0/2964811142 learned_addr learned my addr 172.21.15.37:0/2964811142 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5ffff640 1 --2- 172.21.15.37:0/2964811142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5f7fe640 1 -- 172.21.15.37:0/2964811142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 msgr2=0x7f3c600d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5f7fe640 1 --2- 172.21.15.37:0/2964811142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5f7fe640 1 -- 172.21.15.37:0/2964811142 >> v1:172.21.15.82:6789/0 conn(0x7f3c60071110 legacy=0x7f3c6006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.944+0000 7f3c5f7fe640 1 -- 172.21.15.37:0/2964811142 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c600708e0 con 0x7f3c60163920 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c5f7fe640 1 --2- 172.21.15.37:0/2964811142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600703a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009870 tx=0x7f3c5402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaea8d780e6d8ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c5effd640 1 -- 172.21.15.37:0/2964811142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54037070 con 0x7f3c60163920 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c5effd640 1 -- 172.21.15.37:0/2964811142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c54032440 con 0x7f3c60163920 2024-05-10T08:43:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c5effd640 1 -- 172.21.15.37:0/2964811142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54032810 con 0x7f3c60163920 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 -- 172.21.15.37:0/2964811142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 msgr2=0x7f3c600703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2964811142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600703a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009870 tx=0x7f3c5402a210 comp rx=0 tx=0).stop 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 -- 172.21.15.37:0/2964811142 shutdown_connections 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2964811142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600703a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2964811142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 -- 172.21.15.37:0/2964811142 >> 172.21.15.37:0/2964811142 conn(0x7f3c600d2e90 msgr2=0x7f3c600d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 -- 172.21.15.37:0/2964811142 shutdown_connections 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.945+0000 7f3c664e8640 1 -- 172.21.15.37:0/2964811142 wait complete. 2024-05-10T08:43:44.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.947+0000 7f3c664e8640 1 Processor -- start 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.947+0000 7f3c664e8640 1 -- start start 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c60071110 0x7f3c60159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c600d15e0 con 0x7f3c60163920 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c600d1c30 con 0x7f3c60071110 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3c600d18c0 con 0x7f3c60070d30 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33708/0 (socket says 172.21.15.37:33708) 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c5ffff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 -- 172.21.15.37:0/2380806149 learned_addr learned my addr 172.21.15.37:0/2380806149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c5f7fe640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c60071110 0x7f3c60159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 -- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 msgr2=0x7f3c600cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 -- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c60071110 msgr2=0x7f3c60159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c60071110 0x7f3c60159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 -- 172.21.15.37:0/2380806149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c601f5a80 con 0x7f3c60163920 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c64a85640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600b61b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c7b0 tx=0x7f3c5800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c5cff9640 1 -- 172.21.15.37:0/2380806149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58004b60 con 0x7f3c60163920 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c5cff9640 1 -- 172.21.15.37:0/2380806149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c58004d00 con 0x7f3c60163920 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c5cff9640 1 -- 172.21.15.37:0/2380806149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800aa90 con 0x7f3c60163920 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c600b5190 con 0x7f3c60163920 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.948+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c600b83c0 con 0x7f3c60163920 2024-05-10T08:43:44.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.950+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6006fc30 con 0x7f3c60163920 2024-05-10T08:43:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.950+0000 7f3c5cff9640 1 -- 172.21.15.37:0/2380806149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3c5800ac30 con 0x7f3c60163920 2024-05-10T08:43:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.951+0000 7f3c5cff9640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3c4c0762d0 0x7f3c4c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.951+0000 7f3c5cff9640 1 -- 172.21.15.37:0/2380806149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f3c580978b0 con 0x7f3c60163920 2024-05-10T08:43:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.951+0000 7f3c5ffff640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3c4c0762d0 0x7f3c4c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:44.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.952+0000 7f3c5ffff640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3c4c0762d0 0x7f3c4c078790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000aa20 tx=0x7f3c50008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:44.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:44.956+0000 7f3c5cff9640 1 -- 172.21.15.37:0/2380806149 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3c6006fc30 con 0x7f3c60163920 2024-05-10T08:43:45.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.184+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c600693f0 con 0x7f3c60163920 2024-05-10T08:43:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.184+0000 7f3c5cff9640 1 -- 172.21.15.37:0/2380806149 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5180 (secure 0 0 0) 0x7f3c58020070 con 0x7f3c60163920 2024-05-10T08:43:45.184 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:45.184 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:43:13.580167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:43:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-05-10T08:43:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.186+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3c4c0762d0 msgr2=0x7f3c4c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.186+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3c4c0762d0 0x7f3c4c078790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000aa20 tx=0x7f3c50008040 comp rx=0 tx=0).stop 2024-05-10T08:43:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.186+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 msgr2=0x7f3c600b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.186+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600b61b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c7b0 tx=0x7f3c5800cc70 comp rx=0 tx=0).stop 2024-05-10T08:43:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 shutdown_connections 2024-05-10T08:43:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3c4c0762d0 0x7f3c4c078790 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c60163920 0x7f3c600b61b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c60071110 0x7f3c60159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 --2- 172.21.15.37:0/2380806149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c60070d30 0x7f3c600cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 >> 172.21.15.37:0/2380806149 conn(0x7f3c600d2e90 msgr2=0x7f3c60160e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 shutdown_connections 2024-05-10T08:43:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.187+0000 7f3c664e8640 1 -- 172.21.15.37:0/2380806149 wait complete. 2024-05-10T08:43:45.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:43:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.302+0000 7f89f68d3640 1 Processor -- start 2024-05-10T08:43:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.302+0000 7f89f68d3640 1 -- start start 2024-05-10T08:43:45.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89f68d3640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 0x7f89f006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89f68d3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f00b4590 con 0x7f89f01524f0 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89f68d3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f00b4870 con 0x7f89f006e8d0 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89f68d3640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f89f00b51a0 con 0x7f89f015bc80 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89effff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f89f01524f0 0x7f89f00b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44810/0 (socket says 172.21.15.37:44810) 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89effff640 1 -- 172.21.15.37:0/297499303 learned_addr learned my addr 172.21.15.37:0/297499303 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89ef7fe640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 0x7f89f006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253461655 0 0) 0x7f89f00b4590 con 0x7f89f01524f0 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d8003520 con 0x7f89f01524f0 2024-05-10T08:43:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757671216 0 0) 0x7f89f00b4870 con 0x7f89f006e8d0 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89f00b4590 con 0x7f89f006e8d0 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750448169 0 0) 0x7f89d8003520 con 0x7f89f01524f0 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 msgr2=0x7f89f006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 0x7f89f006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 >> v1:172.21.15.82:6789/0 conn(0x7f89f006e8d0 legacy=0x7f89f0073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.303+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f00b4b50 con 0x7f89f01524f0 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89ef7fe640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 0x7f89f006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:43:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f89e0001670 con 0x7f89f01524f0 2024-05-10T08:43:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 >> v1:172.21.15.37:6789/0 conn(0x7f89f01524f0 legacy=0x7f89f00b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d8003b70 0x7f89d8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 0x7f89d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d8004d40 0x7f89d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89f00b51a0 con 0x7f89d8004d40 2024-05-10T08:43:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89d8005a90 con 0x7f89d8003b70 2024-05-10T08:43:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f89d8005c40 con 0x7f89f015bc80 2024-05-10T08:43:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89f4e70640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d8004d40 0x7f89d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89effff640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d8003b70 0x7f89d8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89ef7fe640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 0x7f89d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89f4e70640 1 -- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 msgr2=0x7f89d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89f4e70640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f015bc80 0x7f89d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89f4e70640 1 -- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d8003b70 msgr2=0x7f89d8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89f4e70640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d8003b70 0x7f89d8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.304+0000 7f89f4e70640 1 -- 172.21.15.37:0/297499303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d8003520 con 0x7f89d8004d40 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89f4e70640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d8004d40 0x7f89d80051c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f89e8001fd0 tx=0x7f89d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf87cb255a37bafe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8001bf0 con 0x7f89d8004d40 2024-05-10T08:43:45.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e8003b70 con 0x7f89d8004d40 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89eeffd640 1 -- 172.21.15.37:0/297499303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e80050d0 con 0x7f89d8004d40 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89f68d3640 1 -- 172.21.15.37:0/297499303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d8004d40 msgr2=0x7f89d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89f68d3640 1 --2- 172.21.15.37:0/297499303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d8004d40 0x7f89d80051c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f89e8001fd0 tx=0x7f89d8005830 comp rx=0 tx=0).stop 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89f4e70640 1 -- 172.21.15.37:0/297499303 reap_dead start 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89f68d3640 1 -- 172.21.15.37:0/297499303 shutdown_connections 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89f68d3640 1 -- 172.21.15.37:0/297499303 >> 172.21.15.37:0/297499303 conn(0x7f89f006c3a0 msgr2=0x7f89f006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.305+0000 7f89f68d3640 1 -- 172.21.15.37:0/297499303 shutdown_connections 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.306+0000 7f89f68d3640 1 -- 172.21.15.37:0/297499303 wait complete. 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.307+0000 7f89f68d3640 1 Processor -- start 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.307+0000 7f89f68d3640 1 -- start start 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f68d3640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0141560 0x7f89f0072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f68d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0141940 0x7f89f0072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f68d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f009d8c0 0x7f89f009bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f68d3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89f00b4330 con 0x7f89f009d8c0 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f68d3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0073450 con 0x7f89f0141940 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f68d3640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f89f01528d0 con 0x7f89f0141560 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f009d8c0 0x7f89f009bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f009d8c0 0x7f89f009bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33722/0 (socket says 172.21.15.37:33722) 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 -- 172.21.15.37:0/4022760059 learned_addr learned my addr 172.21.15.37:0/4022760059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89effff640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0141560 0x7f89f0072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89ef7fe640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0141940 0x7f89f0072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 -- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0141560 msgr2=0x7f89f0072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0141560 0x7f89f0072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 -- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0141940 msgr2=0x7f89f0072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0141940 0x7f89f0072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 -- 172.21.15.37:0/4022760059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f009c820 con 0x7f89f009d8c0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f4e70640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f009d8c0 0x7f89f009bab0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f89e8005040 tx=0x7f89e8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89ecff9640 1 -- 172.21.15.37:0/4022760059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8001bf0 con 0x7f89f009d8c0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89ecff9640 1 -- 172.21.15.37:0/4022760059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e8003970 con 0x7f89f009d8c0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.308+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f009cb00 con 0x7f89f009d8c0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.309+0000 7f89ecff9640 1 -- 172.21.15.37:0/4022760059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8005610 con 0x7f89f009d8c0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.309+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f009d0c0 con 0x7f89f009d8c0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.310+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f00693f0 con 0x7f89f009d8c0 2024-05-10T08:43:45.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.310+0000 7f89ecff9640 1 -- 172.21.15.37:0/4022760059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f89e8045020 con 0x7f89f009d8c0 2024-05-10T08:43:45.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.311+0000 7f89ecff9640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89dc0762d0 0x7f89dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.311+0000 7f89ecff9640 1 -- 172.21.15.37:0/4022760059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f89e80b7840 con 0x7f89f009d8c0 2024-05-10T08:43:45.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.311+0000 7f89effff640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89dc0762d0 0x7f89dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.312+0000 7f89effff640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89dc0762d0 0x7f89dc078790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f89e0001050 tx=0x7f89e0000f80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.315+0000 7f89ecff9640 1 -- 172.21.15.37:0/4022760059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f89e8003b40 con 0x7f89f009d8c0 2024-05-10T08:43:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.545+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89f015b4e0 con 0x7f89f009d8c0 2024-05-10T08:43:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.545+0000 7f89ecff9640 1 -- 172.21.15.37:0/4022760059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5180 (secure 0 0 0) 0x7f89e80808a0 con 0x7f89f009d8c0 2024-05-10T08:43:45.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:45.546 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:43:13.580167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:43:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-05-10T08:43:45.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89dc0762d0 msgr2=0x7f89dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89dc0762d0 0x7f89dc078790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f89e0001050 tx=0x7f89e0000f80 comp rx=0 tx=0).stop 2024-05-10T08:43:45.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f009d8c0 msgr2=0x7f89f009bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f009d8c0 0x7f89f009bab0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f89e8005040 tx=0x7f89e8001650 comp rx=0 tx=0).stop 2024-05-10T08:43:45.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 shutdown_connections 2024-05-10T08:43:45.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89dc0762d0 0x7f89dc078790 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f009d8c0 0x7f89f009bab0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f0141940 0x7f89f0072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 --2- 172.21.15.37:0/4022760059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89f0141560 0x7f89f0072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.547+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 >> 172.21.15.37:0/4022760059 conn(0x7f89f006c3a0 msgr2=0x7f89f00b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:45.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.548+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 shutdown_connections 2024-05-10T08:43:45.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.548+0000 7f89f68d3640 1 -- 172.21.15.37:0/4022760059 wait complete. 2024-05-10T08:43:45.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:43:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.663+0000 7fb32c946640 1 Processor -- start 2024-05-10T08:43:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.663+0000 7fb32c946640 1 -- start start 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb32c946640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3281629a0 0x7fb3280d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb32c946640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3280d2dc0 0x7fb3280d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb32c946640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3280d3330 con 0x7fb3280c8ed0 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb32c946640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb3280d2170 con 0x7fb3280d2dc0 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb32c946640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb3280d2450 con 0x7fb3281629a0 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb31ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3280d2dc0 0x7fb3280d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb32659c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3281629a0 0x7fb3280d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb31ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3280d2dc0 0x7fb3280d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:36448/0 (socket says 172.21.15.37:36448) 2024-05-10T08:43:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.664+0000 7fb31ffff640 1 -- 172.21.15.37:0/331583065 learned_addr learned my addr 172.21.15.37:0/331583065 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.665+0000 7fb32659c640 1 -- 172.21.15.37:0/331583065 >> v2:172.21.15.82:3300/0 conn(0x7fb3280d2dc0 msgr2=0x7fb3280d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.665+0000 7fb32659c640 1 --2- 172.21.15.37:0/331583065 >> v2:172.21.15.82:3300/0 conn(0x7fb3280d2dc0 0x7fb3280d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.665+0000 7fb32659c640 1 -- 172.21.15.37:0/331583065 >> v1:172.21.15.82:6789/0 conn(0x7fb3280c8ed0 legacy=0x7fb3280c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.665+0000 7fb32659c640 1 -- 172.21.15.37:0/331583065 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3280d2730 con 0x7fb3281629a0 2024-05-10T08:43:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.665+0000 7fb31ffff640 1 --2- 172.21.15.37:0/331583065 >> v2:172.21.15.82:3300/0 conn(0x7fb3280d2dc0 0x7fb3280d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:43:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.665+0000 7fb32659c640 1 --2- 172.21.15.37:0/331583065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3281629a0 0x7fb3280d35c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097a0 tx=0x7fb31802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85146ed3ecc8159 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb325d9b640 1 -- 172.21.15.37:0/331583065 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318037070 con 0x7fb3281629a0 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb325d9b640 1 -- 172.21.15.37:0/331583065 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31802adb0 con 0x7fb3281629a0 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb325d9b640 1 -- 172.21.15.37:0/331583065 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318032660 con 0x7fb3281629a0 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 -- 172.21.15.37:0/331583065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3281629a0 msgr2=0x7fb3280d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 --2- 172.21.15.37:0/331583065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3281629a0 0x7fb3280d35c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097a0 tx=0x7fb31802a060 comp rx=0 tx=0).stop 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 -- 172.21.15.37:0/331583065 shutdown_connections 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 --2- 172.21.15.37:0/331583065 >> v2:172.21.15.82:3300/0 conn(0x7fb3280d2dc0 0x7fb3280d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 --2- 172.21.15.37:0/331583065 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3281629a0 0x7fb3280d35c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 -- 172.21.15.37:0/331583065 >> 172.21.15.37:0/331583065 conn(0x7fb3280d4fe0 msgr2=0x7fb3280d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 -- 172.21.15.37:0/331583065 shutdown_connections 2024-05-10T08:43:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.666+0000 7fb32c946640 1 -- 172.21.15.37:0/331583065 wait complete. 2024-05-10T08:43:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.667+0000 7fb32c946640 1 Processor -- start 2024-05-10T08:43:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb32c946640 1 -- start start 2024-05-10T08:43:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb32c946640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3280c8ed0 0x7fb3280cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb32c946640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3280d2dc0 0x7fb328158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb32c946640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3281629a0 0x7fb3280b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb32c946640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280cf440 con 0x7fb3280d2dc0 2024-05-10T08:43:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb32c946640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280cf2c0 con 0x7fb3281629a0 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb32c946640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb3280d0cb0 con 0x7fb3280c8ed0 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb31ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3280d2dc0 0x7fb328158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb31ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3280d2dc0 0x7fb328158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33736/0 (socket says 172.21.15.37:33736) 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.668+0000 7fb31ffff640 1 -- 172.21.15.37:0/2426892133 learned_addr learned my addr 172.21.15.37:0/2426892133 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb32659c640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3280c8ed0 0x7fb3280cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb326d9d640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3281629a0 0x7fb3280b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31ffff640 1 -- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3280c8ed0 msgr2=0x7fb3280cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31ffff640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3280c8ed0 0x7fb3280cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31ffff640 1 -- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3281629a0 msgr2=0x7fb3280b8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31ffff640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3281629a0 0x7fb3280b8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31ffff640 1 -- 172.21.15.37:0/2426892133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3280cce60 con 0x7fb3280d2dc0 2024-05-10T08:43:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb32659c640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3280c8ed0 0x7fb3280cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31ffff640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3280d2dc0 0x7fb328158620 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb31000e9d0 tx=0x7fb31000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31effd640 1 -- 172.21.15.37:0/2426892133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310017070 con 0x7fb3280d2dc0 2024-05-10T08:43:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31effd640 1 -- 172.21.15.37:0/2426892133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31000ca60 con 0x7fb3280d2dc0 2024-05-10T08:43:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3280cd140 con 0x7fb3280d2dc0 2024-05-10T08:43:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb31effd640 1 -- 172.21.15.37:0/2426892133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31000ce10 con 0x7fb3280d2dc0 2024-05-10T08:43:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.669+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3280cd700 con 0x7fb3280d2dc0 2024-05-10T08:43:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.670+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3280693f0 con 0x7fb3280d2dc0 2024-05-10T08:43:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.671+0000 7fb31effd640 1 -- 172.21.15.37:0/2426892133 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb31001a070 con 0x7fb3280d2dc0 2024-05-10T08:43:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.671+0000 7fb31effd640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb3080762d0 0x7fb308078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.671+0000 7fb31effd640 1 -- 172.21.15.37:0/2426892133 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fb310097a50 con 0x7fb3280d2dc0 2024-05-10T08:43:45.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.672+0000 7fb32659c640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb3080762d0 0x7fb308078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.672+0000 7fb32659c640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb3080762d0 0x7fb308078790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb318034000 tx=0x7fb31802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.676+0000 7fb31effd640 1 -- 172.21.15.37:0/2426892133 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb310061220 con 0x7fb3280d2dc0 2024-05-10T08:43:45.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.869+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb328160f90 con 0x7fb3280d2dc0 2024-05-10T08:43:45.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.870+0000 7fb31effd640 1 -- 172.21.15.37:0/2426892133 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17064 (secure 0 0 0) 0x7fb310060b20 con 0x7fb3280d2dc0 2024-05-10T08:43:45.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:45.870 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:43:04.663325+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:42:30.582142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T08:42:31.864914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.13","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.32","mappings":[{"from":7,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:43:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb3080762d0 msgr2=0x7fb308078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb3080762d0 0x7fb308078790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb318034000 tx=0x7fb31802e000 comp rx=0 tx=0).stop 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3280d2dc0 msgr2=0x7fb328158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3280d2dc0 0x7fb328158620 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb31000e9d0 tx=0x7fb31000ee90 comp rx=0 tx=0).stop 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 shutdown_connections 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb3080762d0 0x7fb308078790 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3281629a0 0x7fb3280b8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3280d2dc0 0x7fb328158620 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 --2- 172.21.15.37:0/2426892133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3280c8ed0 0x7fb3280cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 >> 172.21.15.37:0/2426892133 conn(0x7fb3280d4fe0 msgr2=0x7fb3280c9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 shutdown_connections 2024-05-10T08:43:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.872+0000 7fb32c946640 1 -- 172.21.15.37:0/2426892133 wait complete. 2024-05-10T08:43:45.883 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:43:45.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:43:45.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.988+0000 7fd77fa59640 1 Processor -- start 2024-05-10T08:43:45.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.988+0000 7fd77fa59640 1 -- start start 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd77fa59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 0x7fd7780d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd77fa59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7780d1760 con 0x7fd7780d0cf0 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd77fa59640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7780d1a40 con 0x7fd7780d3cd0 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd77fa59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd7780d30f0 con 0x7fd77815f380 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd77cff4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd7780d0cf0 0x7fd7780d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44818/0 (socket says 172.21.15.37:44818) 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd77cff4640 1 -- 172.21.15.37:0/4019743449 learned_addr learned my addr 172.21.15.37:0/4019743449 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370771968 0 0) 0x7fd7780d1760 con 0x7fd7780d0cf0 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 0x7fd7780d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd764003520 con 0x7fd7780d0cf0 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1261402073 0 0) 0x7fd764003520 con 0x7fd7780d0cf0 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 msgr2=0x7fd7780d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd76ffff640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 0x7fd7780d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.989+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 >> v1:172.21.15.82:6789/0 conn(0x7fd7780d3cd0 legacy=0x7fd7780b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7780d1d20 con 0x7fd7780d0cf0 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fd768001670 con 0x7fd7780d0cf0 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 >> v1:172.21.15.37:6789/0 conn(0x7fd7780d0cf0 legacy=0x7fd7780d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7640039e0 0x7fd764003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd764004800 0x7fd764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 0x7fd7640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7780d30f0 con 0x7fd7640039e0 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd76400ba70 con 0x7fd764004800 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd76400bc70 con 0x7fd77815f380 2024-05-10T08:43:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7640039e0 0x7fd764003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77cff4640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd764004800 0x7fd764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77dff6640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 0x7fd7640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77d7f5640 1 -- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 msgr2=0x7fd7640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77815f380 0x7fd7640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77d7f5640 1 -- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd764004800 msgr2=0x7fd764004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd764004800 0x7fd764004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77d7f5640 1 -- 172.21.15.37:0/4019743449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd764003520 con 0x7fd7640039e0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.990+0000 7fd77cff4640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd764004800 0x7fd764004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.991+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7640039e0 0x7fd764003e00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd774009a90 tx=0x7fd764005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caa7031a0af7a84 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.991+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774036070 con 0x7fd7640039e0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.991+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd774031400 con 0x7fd7640039e0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.991+0000 7fd76ffff640 1 -- 172.21.15.37:0/4019743449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774009690 con 0x7fd7640039e0 2024-05-10T08:43:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.991+0000 7fd77fa59640 1 -- 172.21.15.37:0/4019743449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7640039e0 msgr2=0x7fd764003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.991+0000 7fd77fa59640 1 --2- 172.21.15.37:0/4019743449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7640039e0 0x7fd764003e00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd774009a90 tx=0x7fd764005830 comp rx=0 tx=0).stop 2024-05-10T08:43:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.991+0000 7fd77dff6640 1 -- 172.21.15.37:0/4019743449 reap_dead start 2024-05-10T08:43:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.992+0000 7fd77fa59640 1 -- 172.21.15.37:0/4019743449 shutdown_connections 2024-05-10T08:43:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.992+0000 7fd77fa59640 1 -- 172.21.15.37:0/4019743449 >> 172.21.15.37:0/4019743449 conn(0x7fd7780d4fe0 msgr2=0x7fd7780d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.992+0000 7fd77fa59640 1 -- 172.21.15.37:0/4019743449 shutdown_connections 2024-05-10T08:43:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.992+0000 7fd77fa59640 1 -- 172.21.15.37:0/4019743449 wait complete. 2024-05-10T08:43:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.993+0000 7fd77fa59640 1 Processor -- start 2024-05-10T08:43:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.993+0000 7fd77fa59640 1 -- start start 2024-05-10T08:43:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.993+0000 7fd77fa59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7640039e0 0x7fd7781514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77fa59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77809ed00 0x7fd7780c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77fa59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77809f180 0x7fd7780ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77fa59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7780d2370 con 0x7fd77809ed00 2024-05-10T08:43:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77fa59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd77815f760 con 0x7fd7640039e0 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77fa59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd7780d2800 con 0x7fd77809f180 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77809ed00 0x7fd7780c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77809ed00 0x7fd7780c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33742/0 (socket says 172.21.15.37:33742) 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 -- 172.21.15.37:0/3460370487 learned_addr learned my addr 172.21.15.37:0/3460370487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77dff6640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77809f180 0x7fd7780ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7640039e0 0x7fd7781514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 -- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77809f180 msgr2=0x7fd7780ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77809f180 0x7fd7780ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 -- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7640039e0 msgr2=0x7fd7781514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7640039e0 0x7fd7781514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 -- 172.21.15.37:0/3460370487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7780cc250 con 0x7fd77809ed00 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7640039e0 0x7fd7781514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77cff4640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77809ed00 0x7fd7780c9b60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd76800e8f0 tx=0x7fd76800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd76dffb640 1 -- 172.21.15.37:0/3460370487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76800c870 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd76dffb640 1 -- 172.21.15.37:0/3460370487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd768018070 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7780cc530 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.994+0000 7fd76dffb640 1 -- 172.21.15.37:0/3460370487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76800cc10 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.995+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7780ccaf0 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.996+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7780693f0 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.996+0000 7fd76dffb640 1 -- 172.21.15.37:0/3460370487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd76801d460 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.997+0000 7fd76dffb640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd75c0762d0 0x7fd75c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.997+0000 7fd76dffb640 1 -- 172.21.15.37:0/3460370487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fd768097650 con 0x7fd77809ed00 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.997+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd75c0762d0 0x7fd75c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:45.997+0000 7fd77d7f5640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd75c0762d0 0x7fd75c078790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd774033000 tx=0x7fd774008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.001+0000 7fd76dffb640 1 -- 172.21.15.37:0/3460370487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd768060d90 con 0x7fd77809ed00 2024-05-10T08:43:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.230+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd77808cfd0 con 0x7fd77809ed00 2024-05-10T08:43:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.230+0000 7fd76dffb640 1 -- 172.21.15.37:0/3460370487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5180 (secure 0 0 0) 0x7fd768060690 con 0x7fd77809ed00 2024-05-10T08:43:46.229 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:46.230 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:43:13.580167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:43:46.230 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-05-10T08:43:46.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd75c0762d0 msgr2=0x7fd75c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd75c0762d0 0x7fd75c078790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd774033000 tx=0x7fd774008030 comp rx=0 tx=0).stop 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77809ed00 msgr2=0x7fd7780c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77809ed00 0x7fd7780c9b60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd76800e8f0 tx=0x7fd76800edb0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 shutdown_connections 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd75c0762d0 0x7fd75c078790 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd77809f180 0x7fd7780ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd77809ed00 0x7fd7780c9b60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 --2- 172.21.15.37:0/3460370487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7640039e0 0x7fd7781514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 >> 172.21.15.37:0/3460370487 conn(0x7fd7780d4fe0 msgr2=0x7fd7780ba4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 shutdown_connections 2024-05-10T08:43:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.232+0000 7fd77fa59640 1 -- 172.21.15.37:0/3460370487 wait complete. 2024-05-10T08:43:46.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:43:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.347+0000 7f2b902bd640 1 Processor -- start 2024-05-10T08:43:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.347+0000 7f2b902bd640 1 -- start start 2024-05-10T08:43:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b902bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b88156530 0x7f2b880aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b902bd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880b6280 0x7f2b8806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b902bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b880af4d0 0x7f2b8806c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b902bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2b880b5df0 con 0x7f2b88156530 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b902bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2b880afd10 con 0x7f2b880af4d0 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b902bd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2b880b57c0 con 0x7f2b880b6280 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b88156530 0x7f2b880aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b88156530 0x7f2b880aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33744/0 (socket says 172.21.15.37:33744) 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 -- 172.21.15.37:0/3119866482 learned_addr learned my addr 172.21.15.37:0/3119866482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e85a640 1 --2- 172.21.15.37:0/3119866482 >> v2:172.21.15.82:3300/0 conn(0x7f2b880af4d0 0x7f2b8806c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8d858640 1 --2- 172.21.15.37:0/3119866482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880b6280 0x7f2b8806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 -- 172.21.15.37:0/3119866482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880b6280 msgr2=0x7f2b8806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 --2- 172.21.15.37:0/3119866482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880b6280 0x7f2b8806c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 -- 172.21.15.37:0/3119866482 >> v2:172.21.15.82:3300/0 conn(0x7f2b880af4d0 msgr2=0x7f2b8806c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 --2- 172.21.15.37:0/3119866482 >> v2:172.21.15.82:3300/0 conn(0x7f2b880af4d0 0x7f2b8806c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e059640 1 -- 172.21.15.37:0/3119866482 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b880afa30 con 0x7f2b88156530 2024-05-10T08:43:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.348+0000 7f2b8e85a640 1 --2- 172.21.15.37:0/3119866482 >> v2:172.21.15.82:3300/0 conn(0x7f2b880af4d0 0x7f2b8806c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.349+0000 7f2b8e059640 1 --2- 172.21.15.37:0/3119866482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b88156530 0x7f2b880aef90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2b880b3930 tx=0x7f2b8402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117f8e1754956ce5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.349+0000 7f2b8d057640 1 -- 172.21.15.37:0/3119866482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84036070 con 0x7f2b88156530 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.349+0000 7f2b8d057640 1 -- 172.21.15.37:0/3119866482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b84031600 con 0x7f2b88156530 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.349+0000 7f2b8d057640 1 -- 172.21.15.37:0/3119866482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b840319d0 con 0x7f2b88156530 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 -- 172.21.15.37:0/3119866482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b88156530 msgr2=0x7f2b880aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 --2- 172.21.15.37:0/3119866482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b88156530 0x7f2b880aef90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2b880b3930 tx=0x7f2b8402a6a0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 -- 172.21.15.37:0/3119866482 shutdown_connections 2024-05-10T08:43:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 --2- 172.21.15.37:0/3119866482 >> v2:172.21.15.82:3300/0 conn(0x7f2b880af4d0 0x7f2b8806c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 --2- 172.21.15.37:0/3119866482 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880b6280 0x7f2b8806c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 --2- 172.21.15.37:0/3119866482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b88156530 0x7f2b880aef90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 -- 172.21.15.37:0/3119866482 >> 172.21.15.37:0/3119866482 conn(0x7f2b880b39a0 msgr2=0x7f2b880b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 -- 172.21.15.37:0/3119866482 shutdown_connections 2024-05-10T08:43:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.350+0000 7f2b902bd640 1 -- 172.21.15.37:0/3119866482 wait complete. 2024-05-10T08:43:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.351+0000 7f2b902bd640 1 Processor -- start 2024-05-10T08:43:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.351+0000 7f2b902bd640 1 -- start start 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880af4d0 0x7f2b8813ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b880b6280 0x7f2b88161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b88156530 0x7f2b8815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880731e0 con 0x7f2b880b6280 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880b14d0 con 0x7f2b88156530 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2b88073360 con 0x7f2b880af4d0 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b880b6280 0x7f2b88161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b880b6280 0x7f2b88161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33758/0 (socket says 172.21.15.37:33758) 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 -- 172.21.15.37:0/102773373 learned_addr learned my addr 172.21.15.37:0/102773373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 -- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880af4d0 msgr2=0x7f2b8813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880af4d0 0x7f2b8813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 -- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b88156530 msgr2=0x7f2b8815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b88156530 0x7f2b8815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 -- 172.21.15.37:0/102773373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8813b640 con 0x7f2b880b6280 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b8d858640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b880b6280 0x7f2b88161770 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800d800 tx=0x7f2b7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b7effd640 1 -- 172.21.15.37:0/102773373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800b6c0 con 0x7f2b880b6280 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b7effd640 1 -- 172.21.15.37:0/102773373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78019070 con 0x7f2b880b6280 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8813b920 con 0x7f2b880b6280 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b7effd640 1 -- 172.21.15.37:0/102773373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800ba80 con 0x7f2b880b6280 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.352+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8813bee0 con 0x7f2b880b6280 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.353+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b88069b00 con 0x7f2b880b6280 2024-05-10T08:43:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.354+0000 7f2b7effd640 1 -- 172.21.15.37:0/102773373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b7800bc20 con 0x7f2b880b6280 2024-05-10T08:43:46.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.354+0000 7f2b7effd640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b6c0762d0 0x7f2b6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.355+0000 7f2b7effd640 1 -- 172.21.15.37:0/102773373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f2b78097cd0 con 0x7f2b880b6280 2024-05-10T08:43:46.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.355+0000 7f2b8e059640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b6c0762d0 0x7f2b6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.355+0000 7f2b8e059640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b6c0762d0 0x7f2b6c078790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2b84033000 tx=0x7f2b8402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.359+0000 7f2b7effd640 1 -- 172.21.15.37:0/102773373 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2b78061400 con 0x7f2b880b6280 2024-05-10T08:43:46.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.588+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b880b4f10 con 0x7f2b880b6280 2024-05-10T08:43:46.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.588+0000 7f2b7effd640 1 -- 172.21.15.37:0/102773373 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5180 (secure 0 0 0) 0x7f2b78060d00 con 0x7f2b880b6280 2024-05-10T08:43:46.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:46.588 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:42:32.908300+0000","modified":"2024-05-10T08:43:13.580167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5637":{"gid":5637,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.37:6835/640581632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":640581632},{"type":"v1","addr":"172.21.15.37:6835","nonce":640581632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5637,"qdb_cluster":[5637]},"id":4}]} 2024-05-10T08:43:46.588 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-05-10T08:43:46.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b6c0762d0 msgr2=0x7f2b6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b6c0762d0 0x7f2b6c078790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2b84033000 tx=0x7f2b8402e000 comp rx=0 tx=0).stop 2024-05-10T08:43:46.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b880b6280 msgr2=0x7f2b88161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b880b6280 0x7f2b88161770 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800d800 tx=0x7f2b7800dcc0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 shutdown_connections 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b6c0762d0 0x7f2b6c078790 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b88156530 0x7f2b8815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b880b6280 0x7f2b88161770 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 --2- 172.21.15.37:0/102773373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2b880af4d0 0x7f2b8813ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 >> 172.21.15.37:0/102773373 conn(0x7f2b880b39a0 msgr2=0x7f2b880b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 shutdown_connections 2024-05-10T08:43:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.591+0000 7f2b902bd640 1 -- 172.21.15.37:0/102773373 wait complete. 2024-05-10T08:43:46.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:43:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.706+0000 7fdfa1d9e640 1 Processor -- start 2024-05-10T08:43:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.706+0000 7fdfa1d9e640 1 -- start start 2024-05-10T08:43:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.707+0000 7fdfa1d9e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf9c0cdf50 0x7fdf9c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.707+0000 7fdfa1d9e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9c06fe10 con 0x7fdf9c15db00 2024-05-10T08:43:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.707+0000 7fdfa1d9e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9c15e2b0 con 0x7fdf9c146530 2024-05-10T08:43:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.707+0000 7fdfa1d9e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdf9c0cfac0 con 0x7fdf9c0cdf50 2024-05-10T08:43:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.707+0000 7fdf9bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdf9c15db00 0x7fdf9c0cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44820/0 (socket says 172.21.15.37:44820) 2024-05-10T08:43:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.707+0000 7fdf9bfff640 1 -- 172.21.15.37:0/3331276812 learned_addr learned my addr 172.21.15.37:0/3331276812 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa159d640 1 --2- 172.21.15.37:0/3331276812 >> v2:172.21.15.82:3300/0 conn(0x7fdf9c0cdf50 0x7fdf9c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195855609 0 0) 0x7fdf9c06fe10 con 0x7fdf9c15db00 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf84003520 con 0x7fdf9c15db00 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1782549550 0 0) 0x7fdf84003520 con 0x7fdf9c15db00 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 >> v2:172.21.15.82:3300/0 conn(0x7fdf9c0cdf50 msgr2=0x7fdf9c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 --2- 172.21.15.37:0/3331276812 >> v2:172.21.15.82:3300/0 conn(0x7fdf9c0cdf50 0x7fdf9c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 >> v1:172.21.15.82:6789/0 conn(0x7fdf9c146530 legacy=0x7fdf9c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9c15dfd0 con 0x7fdf9c15db00 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fdf90001690 con 0x7fdf9c15db00 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 >> v1:172.21.15.37:6789/0 conn(0x7fdf9c15db00 legacy=0x7fdf9c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf840039b0 0x7fdf84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84004800 0x7fdf84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840051c0 0x7fdf8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c0cfac0 con 0x7fdf840039b0 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8400c060 con 0x7fdf84004800 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8400c260 con 0x7fdf840051c0 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf840039b0 0x7fdf84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9bfff640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84004800 0x7fdf84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa159d640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840051c0 0x7fdf8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa0d9c640 1 -- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840051c0 msgr2=0x7fdf8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840051c0 0x7fdf8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa0d9c640 1 -- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84004800 msgr2=0x7fdf84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84004800 0x7fdf84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa0d9c640 1 -- 172.21.15.37:0/3331276812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf84003520 con 0x7fdf840039b0 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdf9bfff640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84004800 0x7fdf84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.708+0000 7fdfa159d640 1 -- 172.21.15.37:0/3331276812 reap_dead start 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.709+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf840039b0 0x7fdf84003dd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c001750 tx=0x7fdf84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e4ef3970984cad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.709+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c001370 con 0x7fdf840039b0 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.709+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0052d0 con 0x7fdf840039b0 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.709+0000 7fdf9b7fe640 1 -- 172.21.15.37:0/3331276812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c02abc0 con 0x7fdf840039b0 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.710+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/3331276812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf840039b0 msgr2=0x7fdf84003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.710+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf840039b0 0x7fdf84003dd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c001750 tx=0x7fdf84005830 comp rx=0 tx=0).stop 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.710+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/3331276812 shutdown_connections 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.710+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/3331276812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf840039b0 0x7fdf84003dd0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.710+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/3331276812 >> 172.21.15.37:0/3331276812 conn(0x7fdf9c06c580 msgr2=0x7fdf9c06c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.710+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/3331276812 shutdown_connections 2024-05-10T08:43:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.710+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/3331276812 wait complete. 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.711+0000 7fdfa1d9e640 1 Processor -- start 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.711+0000 7fdfa1d9e640 1 -- start start 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa1d9e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840039b0 0x7fdf9c09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa1d9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9c09be30 0x7fdf9c13e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa1d9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9c0b4a70 0x7fdf9c09dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa1d9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c0cf060 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa1d9e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c0ced80 con 0x7fdf9c09be30 2024-05-10T08:43:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa1d9e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9c146910 con 0x7fdf840039b0 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa159d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9c0b4a70 0x7fdf9c09dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa159d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9c0b4a70 0x7fdf9c09dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33772/0 (socket says 172.21.15.37:33772) 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa159d640 1 -- 172.21.15.37:0/1160595927 learned_addr learned my addr 172.21.15.37:0/1160595927 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdf9bfff640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9c09be30 0x7fdf9c13e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.712+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840039b0 0x7fdf9c09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa159d640 1 -- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840039b0 msgr2=0x7fdf9c09cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa159d640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840039b0 0x7fdf9c09cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa159d640 1 -- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9c09be30 msgr2=0x7fdf9c13e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa159d640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9c09be30 0x7fdf9c13e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa159d640 1 -- 172.21.15.37:0/1160595927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9c1e6a90 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdf9bfff640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9c09be30 0x7fdf9c13e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840039b0 0x7fdf9c09cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa159d640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9c0b4a70 0x7fdf9c09dde0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c15dee0 tx=0x7fdf940115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdf997fa640 1 -- 172.21.15.37:0/1160595927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94011db0 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdf997fa640 1 -- 172.21.15.37:0/1160595927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf9401b070 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdf997fa640 1 -- 172.21.15.37:0/1160595927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94003990 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9c0b39d0 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.713+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9c0b3f90 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.714+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9c050740 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.715+0000 7fdf997fa640 1 -- 172.21.15.37:0/1160595927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf94005d10 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.715+0000 7fdf997fa640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf88076300 0x7fdf880787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.715+0000 7fdf997fa640 1 -- 172.21.15.37:0/1160595927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7fdf94097c30 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.716+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf88076300 0x7fdf880787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.716+0000 7fdfa0d9c640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf88076300 0x7fdf880787c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c032000 tx=0x7fdf8c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.720+0000 7fdf997fa640 1 -- 172.21.15.37:0/1160595927 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdf94025020 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.916+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf9c160750 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.917+0000 7fdf997fa640 1 -- 172.21.15.37:0/1160595927 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17064 (secure 0 0 0) 0x7fdf94061400 con 0x7fdf9c0b4a70 2024-05-10T08:43:46.916 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:46.916 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:43:04.663325+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:42:30.582142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-10T08:42:31.864914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.13","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.32","mappings":[{"from":7,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf88076300 msgr2=0x7fdf880787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf88076300 0x7fdf880787c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c032000 tx=0x7fdf8c02e000 comp rx=0 tx=0).stop 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9c0b4a70 msgr2=0x7fdf9c09dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9c0b4a70 0x7fdf9c09dde0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c15dee0 tx=0x7fdf940115a0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 shutdown_connections 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf88076300 0x7fdf880787c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9c0b4a70 0x7fdf9c09dde0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9c09be30 0x7fdf9c13e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 --2- 172.21.15.37:0/1160595927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf840039b0 0x7fdf9c09cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 >> 172.21.15.37:0/1160595927 conn(0x7fdf9c06c580 msgr2=0x7fdf9c15d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 shutdown_connections 2024-05-10T08:43:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:46.919+0000 7fdfa1d9e640 1 -- 172.21.15.37:0/1160595927 wait complete. 2024-05-10T08:43:46.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:43:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.035+0000 7f5f28ca0640 1 Processor -- start 2024-05-10T08:43:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.035+0000 7f5f28ca0640 1 -- start start 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.036+0000 7f5f28ca0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d1970 0x7f5f240d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.036+0000 7f5f28ca0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f240d4cc0 0x7f5f240d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.036+0000 7f5f28ca0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f241630b0 con 0x7f5f2415f420 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.036+0000 7f5f28ca0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5f240d2330 con 0x7f5f240d4cc0 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.036+0000 7f5f28ca0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5f240d3e70 con 0x7f5f240d1970 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f22d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f240d4cc0 0x7f5f240d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f22d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f240d4cc0 0x7f5f240d5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33788/0 (socket says 172.21.15.37:33788) 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2228614246 learned_addr learned my addr 172.21.15.37:0/2228614246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f21d9b640 1 --2- 172.21.15.37:0/2228614246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d1970 0x7f5f240d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2228614246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d1970 msgr2=0x7f5f240d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f22d9d640 1 --2- 172.21.15.37:0/2228614246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d1970 0x7f5f240d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2228614246 >> v1:172.21.15.82:6789/0 conn(0x7f5f2415f420 legacy=0x7f5f240d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.037+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2228614246 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f240d5670 con 0x7f5f240d4cc0 2024-05-10T08:43:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f22d9d640 1 --2- 172.21.15.37:0/2228614246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240d4cc0 0x7f5f240d5130 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009e50 tx=0x7f5f1c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a184cf9fa6b9147 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f2159a640 1 -- 172.21.15.37:0/2228614246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c036070 con 0x7f5f240d4cc0 2024-05-10T08:43:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f2159a640 1 -- 172.21.15.37:0/2228614246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c031600 con 0x7f5f240d4cc0 2024-05-10T08:43:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f2159a640 1 -- 172.21.15.37:0/2228614246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0319d0 con 0x7f5f240d4cc0 2024-05-10T08:43:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2228614246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240d4cc0 msgr2=0x7f5f240d5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2228614246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240d4cc0 0x7f5f240d5130 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009e50 tx=0x7f5f1c02a710 comp rx=0 tx=0).stop 2024-05-10T08:43:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2228614246 shutdown_connections 2024-05-10T08:43:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2228614246 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d1970 0x7f5f240d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2228614246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240d4cc0 0x7f5f240d5130 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.038+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2228614246 >> 172.21.15.37:0/2228614246 conn(0x7f5f2408eac0 msgr2=0x7f5f2409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.039+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2228614246 shutdown_connections 2024-05-10T08:43:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.039+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2228614246 wait complete. 2024-05-10T08:43:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.040+0000 7f5f28ca0640 1 Processor -- start 2024-05-10T08:43:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.040+0000 7f5f28ca0640 1 -- start start 2024-05-10T08:43:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f28ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f240d1970 0x7f5f24157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f28ca0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d4cc0 0x7f5f240cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f28ca0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240ccfb0 0x7f5f24160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f28ca0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f240d2f60 con 0x7f5f240ccfb0 2024-05-10T08:43:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f28ca0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f240d2c80 con 0x7f5f240d1970 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f28ca0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5f240d3240 con 0x7f5f240d4cc0 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240ccfb0 0x7f5f24160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240ccfb0 0x7f5f24160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33790/0 (socket says 172.21.15.37:33790) 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2427633792 learned_addr learned my addr 172.21.15.37:0/2427633792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f21d9b640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d4cc0 0x7f5f240cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f2259c640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f240d1970 0x7f5f24157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d4cc0 msgr2=0x7f5f240cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d4cc0 0x7f5f240cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f240d1970 msgr2=0x7f5f24157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f240d1970 0x7f5f24157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 -- 172.21.15.37:0/2427633792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f240cd540 con 0x7f5f240ccfb0 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f2259c640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f240d1970 0x7f5f24157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.041+0000 7f5f22d9d640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240ccfb0 0x7f5f24160340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c034040 tx=0x7f5f1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.042+0000 7f5f12ffd640 1 -- 172.21.15.37:0/2427633792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c036050 con 0x7f5f240ccfb0 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.042+0000 7f5f12ffd640 1 -- 172.21.15.37:0/2427633792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c042070 con 0x7f5f240ccfb0 2024-05-10T08:43:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.042+0000 7f5f12ffd640 1 -- 172.21.15.37:0/2427633792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c009510 con 0x7f5f240ccfb0 2024-05-10T08:43:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.042+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f240cd820 con 0x7f5f240ccfb0 2024-05-10T08:43:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.042+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f240cdde0 con 0x7f5f240ccfb0 2024-05-10T08:43:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.043+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f240693f0 con 0x7f5f240ccfb0 2024-05-10T08:43:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.043+0000 7f5f12ffd640 1 -- 172.21.15.37:0/2427633792 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5f1c007bb0 con 0x7f5f240ccfb0 2024-05-10T08:43:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.044+0000 7f5f12ffd640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5f040762d0 0x7f5f04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.044+0000 7f5f12ffd640 1 -- 172.21.15.37:0/2427633792 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6246+0+0 (secure 0 0 0) 0x7f5f1c0b8460 con 0x7f5f240ccfb0 2024-05-10T08:43:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.044+0000 7f5f2259c640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5f040762d0 0x7f5f04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.045+0000 7f5f2259c640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5f040762d0 0x7f5f04078790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5f14007fd0 tx=0x7f5f14009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:47.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.048+0000 7f5f12ffd640 1 -- 172.21.15.37:0/2427633792 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5f1c081c30 con 0x7f5f240ccfb0 2024-05-10T08:43:47.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.276+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5f2415fc30 con 0x7f5f240ccfb0 2024-05-10T08:43:47.276 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:43:47.277+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:43:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.278+0000 7f5f12ffd640 1 -- 172.21.15.37:0/2427633792 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f5f1c081530 con 0x7f5f240ccfb0 2024-05-10T08:43:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:43:47.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.280+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5f040762d0 msgr2=0x7f5f04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.280+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5f040762d0 0x7f5f04078790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5f14007fd0 tx=0x7f5f14009040 comp rx=0 tx=0).stop 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.280+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240ccfb0 msgr2=0x7f5f24160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.280+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240ccfb0 0x7f5f24160340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c034040 tx=0x7f5f1c004a40 comp rx=0 tx=0).stop 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 shutdown_connections 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5f040762d0 0x7f5f04078790 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f240ccfb0 0x7f5f24160340 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5f240d4cc0 0x7f5f240cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 --2- 172.21.15.37:0/2427633792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f240d1970 0x7f5f24157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 >> 172.21.15.37:0/2427633792 conn(0x7f5f2408eac0 msgr2=0x7f5f240cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 shutdown_connections 2024-05-10T08:43:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.281+0000 7f5f28ca0640 1 -- 172.21.15.37:0/2427633792 wait complete. 2024-05-10T08:43:47.284 INFO:tasks.ceph.mds.a.smithi037.stderr: -7692> 2024-05-10T08:42:34.517+0000 7f1d3d275640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:43:47.286 INFO:tasks.ceph.mds.a.smithi037.stderr: -4756> 2024-05-10T08:42:41.523+0000 7f1d3926d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5781=0-4194304@1} caps={5781=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5781 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5568900de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:43:47.288 INFO:tasks.ceph.mds.a.smithi037.stderr: -2942> 2024-05-10T08:43:12.885+0000 7f1d3926d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5781=0-4194304@1} caps={5781=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5781 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5568900de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:43:47.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:43:47.317 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:43:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.399+0000 7f1a6d314640 1 Processor -- start 2024-05-10T08:43:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.399+0000 7f1a6d314640 1 -- start start 2024-05-10T08:43:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a6d314640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d0ec0 0x7f1a680d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a6d314640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a680d3b00 0x7f1a680b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a6d314640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a680d1760 con 0x7f1a6815f380 2024-05-10T08:43:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a6d314640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1a680d30f0 con 0x7f1a680d3b00 2024-05-10T08:43:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a6d314640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a680d2370 con 0x7f1a680d0ec0 2024-05-10T08:43:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a667fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d0ec0 0x7f1a680d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a677fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a680d3b00 0x7f1a680b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a66ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1a6815f380 0x7f1a680d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:51124/0 (socket says 172.21.15.37:51124) 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.400+0000 7f1a66ffd640 1 -- 172.21.15.37:0/3100293551 learned_addr learned my addr 172.21.15.37:0/3100293551 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.401+0000 7f1a65ffb640 1 -- 172.21.15.37:0/3100293551 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748034711 0 0) 0x7f1a680d1760 con 0x7f1a6815f380 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.401+0000 7f1a65ffb640 1 -- 172.21.15.37:0/3100293551 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a54003520 con 0x7f1a6815f380 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.401+0000 7f1a677fe640 1 -- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d0ec0 msgr2=0x7f1a680d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.401+0000 7f1a677fe640 1 --2- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d0ec0 0x7f1a680d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.401+0000 7f1a677fe640 1 -- 172.21.15.37:0/3100293551 >> v1:172.21.15.82:6789/0 conn(0x7f1a6815f380 legacy=0x7f1a680d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.401+0000 7f1a677fe640 1 -- 172.21.15.37:0/3100293551 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a680d1a40 con 0x7f1a680d3b00 2024-05-10T08:43:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.401+0000 7f1a667fc640 1 --2- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d0ec0 0x7f1a680d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:43:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.402+0000 7f1a677fe640 1 --2- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a680d3b00 0x7f1a680b7e30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d90 tx=0x7f1a5802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1be2034ab73f6c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.402+0000 7f1a65ffb640 1 -- 172.21.15.37:0/3100293551 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58007740 con 0x7f1a680d3b00 2024-05-10T08:43:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.402+0000 7f1a65ffb640 1 -- 172.21.15.37:0/3100293551 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a580078e0 con 0x7f1a680d3b00 2024-05-10T08:43:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.402+0000 7f1a65ffb640 1 -- 172.21.15.37:0/3100293551 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58007c90 con 0x7f1a680d3b00 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 -- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a680d3b00 msgr2=0x7f1a680b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 --2- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a680d3b00 0x7f1a680b7e30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d90 tx=0x7f1a5802a660 comp rx=0 tx=0).stop 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 -- 172.21.15.37:0/3100293551 shutdown_connections 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 --2- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a680d3b00 0x7f1a680b7e30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 --2- 172.21.15.37:0/3100293551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d0ec0 0x7f1a680d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 -- 172.21.15.37:0/3100293551 >> 172.21.15.37:0/3100293551 conn(0x7f1a680d4fe0 msgr2=0x7f1a680d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 -- 172.21.15.37:0/3100293551 shutdown_connections 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.403+0000 7f1a6d314640 1 -- 172.21.15.37:0/3100293551 wait complete. 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.404+0000 7f1a6d314640 1 Processor -- start 2024-05-10T08:43:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.404+0000 7f1a6d314640 1 -- start start 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a6d314640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a680d0ec0 0x7f1a681f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a6d314640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d3b00 0x7f1a680cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a6d314640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a6815f380 0x7f1a680a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a6d314640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6815f760 con 0x7f1a680d0ec0 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a6d314640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a680d2000 con 0x7f1a6815f380 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a6d314640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a680d2800 con 0x7f1a680d3b00 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a680d0ec0 0x7f1a681f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a680d0ec0 0x7f1a681f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33836/0 (socket says 172.21.15.37:33836) 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 -- 172.21.15.37:0/2557395628 learned_addr learned my addr 172.21.15.37:0/2557395628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a677fe640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a6815f380 0x7f1a680a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a667fc640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d3b00 0x7f1a680cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 -- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d3b00 msgr2=0x7f1a680cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d3b00 0x7f1a680cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 -- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a6815f380 msgr2=0x7f1a680a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a6815f380 0x7f1a680a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 -- 172.21.15.37:0/2557395628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6809f900 con 0x7f1a680d0ec0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a677fe640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a6815f380 0x7f1a680a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a66ffd640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a680d0ec0 0x7f1a681f5380 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c3c0 tx=0x7f1a6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.405+0000 7f1a5f7fe640 1 -- 172.21.15.37:0/2557395628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60017070 con 0x7f1a680d0ec0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.406+0000 7f1a5f7fe640 1 -- 172.21.15.37:0/2557395628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a60005ce0 con 0x7f1a680d0ec0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.406+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6809fbe0 con 0x7f1a680d0ec0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.406+0000 7f1a5f7fe640 1 -- 172.21.15.37:0/2557395628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a600072f0 con 0x7f1a680d0ec0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.406+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a680a01a0 con 0x7f1a680d0ec0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.406+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a680693f0 con 0x7f1a680d0ec0 2024-05-10T08:43:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.407+0000 7f1a5f7fe640 1 -- 172.21.15.37:0/2557395628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a6001a070 con 0x7f1a680d0ec0 2024-05-10T08:43:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.408+0000 7f1a5f7fe640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a480762d0 0x7f1a48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.408+0000 7f1a5f7fe640 1 -- 172.21.15.37:0/2557395628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6332+0+0 (secure 0 0 0) 0x7f1a60096be0 con 0x7f1a680d0ec0 2024-05-10T08:43:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.408+0000 7f1a667fc640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a480762d0 0x7f1a48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.409+0000 7f1a667fc640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a480762d0 0x7f1a48078790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009560 tx=0x7f1a50009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.412+0000 7f1a5f7fe640 1 -- 172.21.15.37:0/2557395628 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1a6005fbe0 con 0x7f1a680d0ec0 2024-05-10T08:43:47.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:47.643+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1a680cbb30 con 0x7f1a680d0ec0 2024-05-10T08:43:48.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.286+0000 7f1a5f7fe640 1 -- 172.21.15.37:0/2557395628 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f1a60063ee0 con 0x7f1a680d0ec0 2024-05-10T08:43:48.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a480762d0 msgr2=0x7f1a48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:48.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a480762d0 0x7f1a48078790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009560 tx=0x7f1a50009190 comp rx=0 tx=0).stop 2024-05-10T08:43:48.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a680d0ec0 msgr2=0x7f1a681f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a680d0ec0 0x7f1a681f5380 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c3c0 tx=0x7f1a6000c880 comp rx=0 tx=0).stop 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 shutdown_connections 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1a480762d0 0x7f1a48078790 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a6815f380 0x7f1a680a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a680d3b00 0x7f1a680cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 --2- 172.21.15.37:0/2557395628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a680d0ec0 0x7f1a681f5380 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 >> 172.21.15.37:0/2557395628 conn(0x7f1a680d4fe0 msgr2=0x7f1a680cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 shutdown_connections 2024-05-10T08:43:48.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.289+0000 7f1a6d314640 1 -- 172.21.15.37:0/2557395628 wait complete. 2024-05-10T08:43:48.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:43:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.459+0000 7fd785b89640 1 Processor -- start 2024-05-10T08:43:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.459+0000 7fd785b89640 1 -- start start 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd785b89640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd780070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd785b89640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7800cef40 0x7fd780169b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd785b89640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7800d2030 con 0x7fd7800d3920 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd785b89640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd78015f8d0 con 0x7fd7800cef40 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd785b89640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd7800d22b0 con 0x7fd7800cf8f0 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7800cef40 0x7fd780169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd7800d3920 0x7fd780070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42780/0 (socket says 172.21.15.37:42780) 2024-05-10T08:43:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77effd640 1 -- 172.21.15.37:0/2035432648 learned_addr learned my addr 172.21.15.37:0/2035432648 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/2035432648 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd780070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77ffff640 1 -- 172.21.15.37:0/2035432648 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 msgr2=0x7fd780070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77ffff640 1 --2- 172.21.15.37:0/2035432648 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd780070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77ffff640 1 -- 172.21.15.37:0/2035432648 >> v1:172.21.15.37:6789/0 conn(0x7fd7800d3920 legacy=0x7fd780070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77ffff640 1 -- 172.21.15.37:0/2035432648 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7800d2590 con 0x7fd7800cef40 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.460+0000 7fd77e7fc640 1 -- 172.21.15.37:0/2035432648 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790383741 0 0) 0x7fd774001110 con 0x7fd7800d3920 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.461+0000 7fd77ffff640 1 --2- 172.21.15.37:0/2035432648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd780169b30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd778009d90 tx=0x7fd77802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87f82d114d09472 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.461+0000 7fd77e7fc640 1 -- 172.21.15.37:0/2035432648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778007740 con 0x7fd7800cef40 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.461+0000 7fd77e7fc640 1 -- 172.21.15.37:0/2035432648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7780078e0 con 0x7fd7800cef40 2024-05-10T08:43:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.461+0000 7fd77e7fc640 1 -- 172.21.15.37:0/2035432648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778007cb0 con 0x7fd7800cef40 2024-05-10T08:43:48.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.461+0000 7fd785b89640 1 -- 172.21.15.37:0/2035432648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 msgr2=0x7fd780169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:48.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.462+0000 7fd785b89640 1 --2- 172.21.15.37:0/2035432648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd780169b30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd778009d90 tx=0x7fd77802a6f0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.462+0000 7fd785b89640 1 -- 172.21.15.37:0/2035432648 shutdown_connections 2024-05-10T08:43:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.462+0000 7fd785b89640 1 --2- 172.21.15.37:0/2035432648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd780169b30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.462+0000 7fd785b89640 1 --2- 172.21.15.37:0/2035432648 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd780070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.462+0000 7fd785b89640 1 -- 172.21.15.37:0/2035432648 >> 172.21.15.37:0/2035432648 conn(0x7fd7800d2e00 msgr2=0x7fd7800d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.462+0000 7fd785b89640 1 -- 172.21.15.37:0/2035432648 shutdown_connections 2024-05-10T08:43:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.462+0000 7fd785b89640 1 -- 172.21.15.37:0/2035432648 wait complete. 2024-05-10T08:43:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.463+0000 7fd785b89640 1 Processor -- start 2024-05-10T08:43:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.463+0000 7fd785b89640 1 -- start start 2024-05-10T08:43:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd785b89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd78009cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd785b89640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd7800ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd785b89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7800d3920 0x7fd78009e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd785b89640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7800cda10 con 0x7fd7800cef40 2024-05-10T08:43:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd785b89640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7800cd730 con 0x7fd7800d3920 2024-05-10T08:43:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd785b89640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd780071610 con 0x7fd7800cf8f0 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd78009cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd78009cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49320/0 (socket says 172.21.15.37:49320) 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 -- 172.21.15.37:0/3288900606 learned_addr learned my addr 172.21.15.37:0/3288900606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77effd640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd7800ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77ffff640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7800d3920 0x7fd78009e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 -- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 msgr2=0x7fd7800ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd7800ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 -- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7800d3920 msgr2=0x7fd78009e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7800d3920 0x7fd78009e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 -- 172.21.15.37:0/3288900606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78014dfc0 con 0x7fd7800cef40 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77effd640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd7800ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77ffff640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7800d3920 0x7fd78009e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.464+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd78009cc90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c7f0 tx=0x7fd77000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.465+0000 7fd767fff640 1 -- 172.21.15.37:0/3288900606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770015070 con 0x7fd7800cef40 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.465+0000 7fd767fff640 1 -- 172.21.15.37:0/3288900606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd770004220 con 0x7fd7800cef40 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.465+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78014e2a0 con 0x7fd7800cef40 2024-05-10T08:43:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.465+0000 7fd767fff640 1 -- 172.21.15.37:0/3288900606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770003610 con 0x7fd7800cef40 2024-05-10T08:43:48.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.465+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78014e860 con 0x7fd7800cef40 2024-05-10T08:43:48.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.466+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7800693f0 con 0x7fd7800cef40 2024-05-10T08:43:48.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.466+0000 7fd767fff640 1 -- 172.21.15.37:0/3288900606 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd7700039c0 con 0x7fd7800cef40 2024-05-10T08:43:48.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.467+0000 7fd767fff640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd76c0762d0 0x7fd76c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:48.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.467+0000 7fd767fff640 1 -- 172.21.15.37:0/3288900606 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6332+0+0 (secure 0 0 0) 0x7fd770097ae0 con 0x7fd7800cef40 2024-05-10T08:43:48.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.467+0000 7fd77effd640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd76c0762d0 0x7fd76c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:48.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.467+0000 7fd77effd640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd76c0762d0 0x7fd76c078790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd7800cfd40 tx=0x7fd774007ca0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:48.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.471+0000 7fd767fff640 1 -- 172.21.15.37:0/3288900606 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd770061260 con 0x7fd7800cef40 2024-05-10T08:43:48.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:48.663+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd780076460 con 0x7fd7800cef40 2024-05-10T08:43:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.287+0000 7fd767fff640 1 -- 172.21.15.37:0/3288900606 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) ==== 181+0+0 (secure 0 0 0) 0x7fd770069250 con 0x7fd7800cef40 2024-05-10T08:43:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd76c0762d0 msgr2=0x7fd76c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd76c0762d0 0x7fd76c078790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd7800cfd40 tx=0x7fd774007ca0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 msgr2=0x7fd78009cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd78009cc90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c7f0 tx=0x7fd77000ccb0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 shutdown_connections 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd76c0762d0 0x7fd76c078790 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7800d3920 0x7fd78009e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7800cf8f0 0x7fd7800ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 --2- 172.21.15.37:0/3288900606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7800cef40 0x7fd78009cc90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.291+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 >> 172.21.15.37:0/3288900606 conn(0x7fd7800d2e00 msgr2=0x7fd7800afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.292+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 shutdown_connections 2024-05-10T08:43:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.292+0000 7fd785b89640 1 -- 172.21.15.37:0/3288900606 wait complete. 2024-05-10T08:43:49.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:43:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.419+0000 7f22e936a640 1 Processor -- start 2024-05-10T08:43:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.419+0000 7f22e936a640 1 -- start start 2024-05-10T08:43:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.420+0000 7f22e936a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22e415f710 0x7f22e40d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.420+0000 7f22e936a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40d22f0 0x7f22e40cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.420+0000 7f22e936a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e40cd610 con 0x7f22e40cfce0 2024-05-10T08:43:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.420+0000 7f22e936a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f22e40d2840 con 0x7f22e415f710 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.420+0000 7f22e936a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f22e40cd880 con 0x7f22e40d22f0 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.420+0000 7f22e37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f22e40cfce0 0x7f22e406d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42790/0 (socket says 172.21.15.37:42790) 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.420+0000 7f22e37fe640 1 -- 172.21.15.37:0/3367158184 learned_addr learned my addr 172.21.15.37:0/3367158184 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e2ffd640 1 --2- 172.21.15.37:0/3367158184 >> v2:172.21.15.82:3300/0 conn(0x7f22e415f710 0x7f22e40d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e27fc640 1 --2- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40d22f0 0x7f22e40cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e1ffb640 1 -- 172.21.15.37:0/3367158184 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263662644 0 0) 0x7f22e40cd610 con 0x7f22e40cfce0 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e1ffb640 1 -- 172.21.15.37:0/3367158184 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d0003520 con 0x7f22e40cfce0 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e2ffd640 1 -- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40d22f0 msgr2=0x7f22e40cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e2ffd640 1 --2- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40d22f0 0x7f22e40cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e2ffd640 1 -- 172.21.15.37:0/3367158184 >> v1:172.21.15.37:6789/0 conn(0x7f22e40cfce0 legacy=0x7f22e406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:49.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.421+0000 7f22e2ffd640 1 -- 172.21.15.37:0/3367158184 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e40cdb60 con 0x7f22e415f710 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e2ffd640 1 --2- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e415f710 0x7f22e40d1320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009d90 tx=0x7f22dc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca94a88721392c4f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e1ffb640 1 -- 172.21.15.37:0/3367158184 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc007740 con 0x7f22e415f710 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e1ffb640 1 -- 172.21.15.37:0/3367158184 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22dc0078e0 con 0x7f22e415f710 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e1ffb640 1 -- 172.21.15.37:0/3367158184 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc007c90 con 0x7f22e415f710 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e936a640 1 -- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e415f710 msgr2=0x7f22e40d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e936a640 1 --2- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e415f710 0x7f22e40d1320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009d90 tx=0x7f22dc02a660 comp rx=0 tx=0).stop 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e936a640 1 -- 172.21.15.37:0/3367158184 shutdown_connections 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e936a640 1 --2- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40d22f0 0x7f22e40cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e936a640 1 --2- 172.21.15.37:0/3367158184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e415f710 0x7f22e40d1320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.422+0000 7f22e936a640 1 -- 172.21.15.37:0/3367158184 >> 172.21.15.37:0/3367158184 conn(0x7f22e40d2f20 msgr2=0x7f22e40d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.423+0000 7f22e936a640 1 -- 172.21.15.37:0/3367158184 shutdown_connections 2024-05-10T08:43:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.423+0000 7f22e936a640 1 -- 172.21.15.37:0/3367158184 wait complete. 2024-05-10T08:43:49.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.424+0000 7f22e936a640 1 Processor -- start 2024-05-10T08:43:49.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.424+0000 7f22e936a640 1 -- start start 2024-05-10T08:43:49.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40cfce0 0x7f22e41f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:49.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e40d22f0 0x7f22e40cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:49.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e415f710 0x7f22e40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:49.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22e40cf210 con 0x7f22e415f710 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22e40cf090 con 0x7f22e40d22f0 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f22e40cf390 con 0x7f22e40cfce0 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e415f710 0x7f22e40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e415f710 0x7f22e40b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49334/0 (socket says 172.21.15.37:49334) 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 -- 172.21.15.37:0/2606456137 learned_addr learned my addr 172.21.15.37:0/2606456137 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e2ffd640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40cfce0 0x7f22e41f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e27fc640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e40d22f0 0x7f22e40cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 -- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40cfce0 msgr2=0x7f22e41f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40cfce0 0x7f22e41f8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 -- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e40d22f0 msgr2=0x7f22e40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e40d22f0 0x7f22e40cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 -- 172.21.15.37:0/2606456137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e41f5f50 con 0x7f22e415f710 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e2ffd640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40cfce0 0x7f22e41f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e27fc640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e40d22f0 0x7f22e40cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e37fe640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e415f710 0x7f22e40b3a00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f22d400c3c0 tx=0x7f22d4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22db7fe640 1 -- 172.21.15.37:0/2606456137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4017070 con 0x7f22e415f710 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22db7fe640 1 -- 172.21.15.37:0/2606456137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d4005ce0 con 0x7f22e415f710 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e40ca450 con 0x7f22e415f710 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22db7fe640 1 -- 172.21.15.37:0/2606456137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4007310 con 0x7f22e415f710 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.425+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e40caa10 con 0x7f22e415f710 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.426+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e4069b00 con 0x7f22e415f710 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.427+0000 7f22db7fe640 1 -- 172.21.15.37:0/2606456137 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f22d401a070 con 0x7f22e415f710 2024-05-10T08:43:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.427+0000 7f22db7fe640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22c40762d0 0x7f22c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.428+0000 7f22db7fe640 1 -- 172.21.15.37:0/2606456137 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5865+0+0 (secure 0 0 0) 0x7f22d4096970 con 0x7f22e415f710 2024-05-10T08:43:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.428+0000 7f22e2ffd640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22c40762d0 0x7f22c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.428+0000 7f22e2ffd640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22c40762d0 0x7f22c4078790 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22dc034000 tx=0x7f22dc02f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:49.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.432+0000 7f22db7fe640 1 -- 172.21.15.37:0/2606456137 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f22d40602c0 con 0x7f22e415f710 2024-05-10T08:43:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:49.621+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f22e40b37e0 con 0x7f22e415f710 2024-05-10T08:43:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.292+0000 7f22db7fe640 1 -- 172.21.15.37:0/2606456137 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) ==== 169+0+0 (secure 0 0 0) 0x7f22d405fbc0 con 0x7f22e415f710 2024-05-10T08:43:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:43:50.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.297+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22c40762d0 msgr2=0x7f22c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.297+0000 7f22e936a640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22c40762d0 0x7f22c4078790 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f22dc034000 tx=0x7f22dc02f000 comp rx=0 tx=0).stop 2024-05-10T08:43:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.298+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e415f710 msgr2=0x7f22e40b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.298+0000 7f22e936a640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e415f710 0x7f22e40b3a00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f22d400c3c0 tx=0x7f22d4001e70 comp rx=0 tx=0).stop 2024-05-10T08:43:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.299+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 shutdown_connections 2024-05-10T08:43:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.299+0000 7f22e936a640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22c40762d0 0x7f22c4078790 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.299+0000 7f22e936a640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e415f710 0x7f22e40b3a00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.299+0000 7f22e936a640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e40d22f0 0x7f22e40cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.299+0000 7f22e936a640 1 --2- 172.21.15.37:0/2606456137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22e40cfce0 0x7f22e41f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.299+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 >> 172.21.15.37:0/2606456137 conn(0x7f22e40d2f20 msgr2=0x7f22e4070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:50.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.300+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 shutdown_connections 2024-05-10T08:43:50.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.300+0000 7f22e936a640 1 -- 172.21.15.37:0/2606456137 wait complete. 2024-05-10T08:43:50.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T08:43:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.426+0000 7f3f28845640 1 Processor -- start 2024-05-10T08:43:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.426+0000 7f3f28845640 1 -- start start 2024-05-10T08:43:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f28845640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f241606d0 0x7f3f240cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f28845640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f240d15c0 con 0x7f3f240cdf00 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f28845640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f240d18a0 con 0x7f3f24071a00 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f28845640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3f240d1b80 con 0x7f3f241606d0 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f2259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f241606d0 0x7f3f240cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f1bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f240cdf00 0x7f3f240cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42800/0 (socket says 172.21.15.37:42800) 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f1bfff640 1 -- 172.21.15.37:0/4068834150 learned_addr learned my addr 172.21.15.37:0/4068834150 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f2259c640 1 -- 172.21.15.37:0/4068834150 >> v1:172.21.15.82:6789/0 conn(0x7f3f24071a00 legacy=0x7f3f240cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f2259c640 1 -- 172.21.15.37:0/4068834150 >> v1:172.21.15.37:6789/0 conn(0x7f3f240cdf00 legacy=0x7f3f240cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.427+0000 7f3f2259c640 1 -- 172.21.15.37:0/4068834150 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f240704d0 con 0x7f3f241606d0 2024-05-10T08:43:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.428+0000 7f3f2259c640 1 --2- 172.21.15.37:0/4068834150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f240cd9c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3f140097a0 tx=0x7f3f1402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b09c78cf1f28bcc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.428+0000 7f3f21d9b640 1 -- 172.21.15.37:0/4068834150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14037070 con 0x7f3f241606d0 2024-05-10T08:43:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.428+0000 7f3f21d9b640 1 -- 172.21.15.37:0/4068834150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1402ac90 con 0x7f3f241606d0 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.428+0000 7f3f21d9b640 1 -- 172.21.15.37:0/4068834150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14032660 con 0x7f3f241606d0 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.429+0000 7f3f28845640 1 -- 172.21.15.37:0/4068834150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 msgr2=0x7f3f240cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.429+0000 7f3f28845640 1 --2- 172.21.15.37:0/4068834150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f240cd9c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3f140097a0 tx=0x7f3f1402a000 comp rx=0 tx=0).stop 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.429+0000 7f3f28845640 1 -- 172.21.15.37:0/4068834150 shutdown_connections 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.429+0000 7f3f28845640 1 --2- 172.21.15.37:0/4068834150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f240cd9c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.429+0000 7f3f28845640 1 -- 172.21.15.37:0/4068834150 >> 172.21.15.37:0/4068834150 conn(0x7f3f240b49d0 msgr2=0x7f3f240b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.429+0000 7f3f28845640 1 -- 172.21.15.37:0/4068834150 shutdown_connections 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.429+0000 7f3f28845640 1 -- 172.21.15.37:0/4068834150 wait complete. 2024-05-10T08:43:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.430+0000 7f3f28845640 1 Processor -- start 2024-05-10T08:43:50.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.430+0000 7f3f28845640 1 -- start start 2024-05-10T08:43:50.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f28845640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f24071a00 0x7f3f2415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f28845640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f240cdf00 0x7f3f241e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f28845640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f241e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f28845640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f240d0520 con 0x7f3f241606d0 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f28845640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f240d03a0 con 0x7f3f24071a00 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f28845640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3f240d06a0 con 0x7f3f240cdf00 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f22d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f241e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f22d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f241e5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49352/0 (socket says 172.21.15.37:49352) 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f22d9d640 1 -- 172.21.15.37:0/3344159496 learned_addr learned my addr 172.21.15.37:0/3344159496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f2259c640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f24071a00 0x7f3f2415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.431+0000 7f3f1bfff640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f240cdf00 0x7f3f241e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f22d9d640 1 -- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f240cdf00 msgr2=0x7f3f241e57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f22d9d640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f240cdf00 0x7f3f241e57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f22d9d640 1 -- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f24071a00 msgr2=0x7f3f2415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f22d9d640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f24071a00 0x7f3f2415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f22d9d640 1 -- 172.21.15.37:0/3344159496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f240b8770 con 0x7f3f241606d0 2024-05-10T08:43:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f1bfff640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f240cdf00 0x7f3f241e57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f22d9d640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f241e5d00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00c6e0 tx=0x7f3f1c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f1affd640 1 -- 172.21.15.37:0/3344159496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c003b70 con 0x7f3f241606d0 2024-05-10T08:43:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f1affd640 1 -- 172.21.15.37:0/3344159496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c003d30 con 0x7f3f241606d0 2024-05-10T08:43:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2415d0b0 con 0x7f3f241606d0 2024-05-10T08:43:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f1affd640 1 -- 172.21.15.37:0/3344159496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c005310 con 0x7f3f241606d0 2024-05-10T08:43:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.432+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f240b6460 con 0x7f3f241606d0 2024-05-10T08:43:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.433+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f240693f0 con 0x7f3f241606d0 2024-05-10T08:43:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.433+0000 7f3f1affd640 1 -- 172.21.15.37:0/3344159496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f1c0054b0 con 0x7f3f241606d0 2024-05-10T08:43:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.434+0000 7f3f1affd640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f040762d0 0x7f3f04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.434+0000 7f3f1affd640 1 -- 172.21.15.37:0/3344159496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f3f1c0971b0 con 0x7f3f241606d0 2024-05-10T08:43:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.434+0000 7f3f2259c640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f040762d0 0x7f3f04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.435+0000 7f3f2259c640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f040762d0 0x7f3f04078790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f14034000 tx=0x7f3f1402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:50.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.438+0000 7f3f1affd640 1 -- 172.21.15.37:0/3344159496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3f240b8770 con 0x7f3f241606d0 2024-05-10T08:43:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.631+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3f240ce620 con 0x7f3f241606d0 2024-05-10T08:43:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.635+0000 7f3f1affd640 1 -- 172.21.15.37:0/3344159496 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f3f1c060d10 con 0x7f3f241606d0 2024-05-10T08:43:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f040762d0 msgr2=0x7f3f04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f040762d0 0x7f3f04078790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f14034000 tx=0x7f3f1402e000 comp rx=0 tx=0).stop 2024-05-10T08:43:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 msgr2=0x7f3f241e5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f241e5d00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00c6e0 tx=0x7f3f1c00cba0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 shutdown_connections 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f040762d0 0x7f3f04078790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f241606d0 0x7f3f241e5d00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f240cdf00 0x7f3f241e57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 --2- 172.21.15.37:0/3344159496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f24071a00 0x7f3f2415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 >> 172.21.15.37:0/3344159496 conn(0x7f3f240b49d0 msgr2=0x7f3f240b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 shutdown_connections 2024-05-10T08:43:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.637+0000 7f3f28845640 1 -- 172.21.15.37:0/3344159496 wait complete. 2024-05-10T08:43:50.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-05-10T08:43:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.752+0000 7f3d510c8640 1 Processor -- start 2024-05-10T08:43:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.752+0000 7f3d510c8640 1 -- start start 2024-05-10T08:43:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.752+0000 7f3d510c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 0x7f3d4c16a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.752+0000 7f3d510c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c0d1760 con 0x7f3d4c0d0ec0 2024-05-10T08:43:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.752+0000 7f3d510c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c0d1a40 con 0x7f3d4c15f380 2024-05-10T08:43:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.752+0000 7f3d510c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4c0d30f0 con 0x7f3d4c0d3cd0 2024-05-10T08:43:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d4a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3d4c0d0ec0 0x7f3d4c0d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42806/0 (socket says 172.21.15.37:42806) 2024-05-10T08:43:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d4a59c640 1 -- 172.21.15.37:0/1340318429 learned_addr learned my addr 172.21.15.37:0/1340318429 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d4b59e640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 0x7f3d4c16a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026344278 0 0) 0x7f3d4c0d1760 con 0x7f3d4c0d0ec0 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d34003520 con 0x7f3d4c0d0ec0 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 526165165 0 0) 0x7f3d34003520 con 0x7f3d4c0d0ec0 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 msgr2=0x7f3d4c16a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 0x7f3d4c16a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 >> v1:172.21.15.82:6789/0 conn(0x7f3d4c15f380 legacy=0x7f3d4c0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c0d1d20 con 0x7f3d4c0d0ec0 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f3d40001670 con 0x7f3d4c0d0ec0 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 >> v1:172.21.15.37:6789/0 conn(0x7f3d4c0d0ec0 legacy=0x7f3d4c0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340039e0 0x7f3d34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d34004390 0x7f3d34004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 0x7f3d340050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0d30f0 con 0x7f3d34004390 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3400b9f0 con 0x7f3d340039e0 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3400bbf0 con 0x7f3d4c0d3cd0 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d4a59c640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d34004390 0x7f3d34004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.753+0000 7f3d4ad9d640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340039e0 0x7f3d34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.754+0000 7f3d4b59e640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 0x7f3d340050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.754+0000 7f3d4a59c640 1 -- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 msgr2=0x7f3d340050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.754+0000 7f3d4a59c640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d4c0d3cd0 0x7f3d340050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.754+0000 7f3d4a59c640 1 -- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340039e0 msgr2=0x7f3d34003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.754+0000 7f3d4a59c640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340039e0 0x7f3d34003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.754+0000 7f3d4a59c640 1 -- 172.21.15.37:0/1340318429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d34003520 con 0x7f3d34004390 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.754+0000 7f3d4a59c640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d34004390 0x7f3d34004860 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c210 tx=0x7f3d34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bf1faa0e76ded6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:50.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40007ce0 con 0x7f3d34004390 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40005af0 con 0x7f3d34004390 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d49d9b640 1 -- 172.21.15.37:0/1340318429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40007070 con 0x7f3d34004390 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d510c8640 1 -- 172.21.15.37:0/1340318429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d34004390 msgr2=0x7f3d34004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d510c8640 1 --2- 172.21.15.37:0/1340318429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d34004390 0x7f3d34004860 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c210 tx=0x7f3d34005830 comp rx=0 tx=0).stop 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d4b59e640 1 -- 172.21.15.37:0/1340318429 reap_dead start 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d510c8640 1 -- 172.21.15.37:0/1340318429 shutdown_connections 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d510c8640 1 -- 172.21.15.37:0/1340318429 >> 172.21.15.37:0/1340318429 conn(0x7f3d4c0d4fe0 msgr2=0x7f3d4c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d510c8640 1 -- 172.21.15.37:0/1340318429 shutdown_connections 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.755+0000 7f3d510c8640 1 -- 172.21.15.37:0/1340318429 wait complete. 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 Processor -- start 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 -- start start 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d34004390 0x7f3d4c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d4c0ce280 0x7f3d4c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d4c15fbf0 0x7f3d4c160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0b8e40 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0d2370 con 0x7f3d4c0ce280 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d510c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4c15f760 con 0x7f3d34004390 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.757+0000 7f3d4b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d4c15fbf0 0x7f3d4c160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d4c15fbf0 0x7f3d4c160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49382/0 (socket says 172.21.15.37:49382) 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 -- 172.21.15.37:0/1359100412 learned_addr learned my addr 172.21.15.37:0/1359100412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4ad9d640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d34004390 0x7f3d4c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4a59c640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d4c0ce280 0x7f3d4c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 -- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d34004390 msgr2=0x7f3d4c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d34004390 0x7f3d4c15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 -- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d4c0ce280 msgr2=0x7f3d4c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d4c0ce280 0x7f3d4c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 -- 172.21.15.37:0/1359100412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c1605b0 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d4b59e640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d4c15fbf0 0x7f3d4c160070 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c163f80 tx=0x7f3d4400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d337fe640 1 -- 172.21.15.37:0/1359100412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44003990 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d337fe640 1 -- 172.21.15.37:0/1359100412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4401c070 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4c09eea0 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d337fe640 1 -- 172.21.15.37:0/1359100412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44003d50 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.758+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4c09f460 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.759+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4c0693f0 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.760+0000 7f3d337fe640 1 -- 172.21.15.37:0/1359100412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d44004030 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.761+0000 7f3d337fe640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d38076300 0x7f3d380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.761+0000 7f3d337fe640 1 -- 172.21.15.37:0/1359100412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f3d44097e40 con 0x7f3d4c15fbf0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.761+0000 7f3d4ad9d640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d38076300 0x7f3d380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.761+0000 7f3d4ad9d640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d38076300 0x7f3d380787c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c1f9560 tx=0x7f3d3c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:50.765+0000 7f3d337fe640 1 -- 172.21.15.37:0/1359100412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3d44010040 con 0x7f3d4c15fbf0 2024-05-10T08:43:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.028+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f3d4c08cfd0 con 0x7f3d4c15fbf0 2024-05-10T08:43:51.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.294+0000 7f3d337fe640 1 -- 172.21.15.37:0/1359100412 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v184) ==== 169+0+0 (secure 0 0 0) 0x7f3d44061910 con 0x7f3d4c15fbf0 2024-05-10T08:43:51.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d38076300 msgr2=0x7f3d380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d38076300 0x7f3d380787c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c1f9560 tx=0x7f3d3c009040 comp rx=0 tx=0).stop 2024-05-10T08:43:51.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d4c15fbf0 msgr2=0x7f3d4c160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d4c15fbf0 0x7f3d4c160070 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c163f80 tx=0x7f3d4400f580 comp rx=0 tx=0).stop 2024-05-10T08:43:51.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 shutdown_connections 2024-05-10T08:43:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3d38076300 0x7f3d380787c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d4c15fbf0 0x7f3d4c160070 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d4c0ce280 0x7f3d4c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 --2- 172.21.15.37:0/1359100412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3d34004390 0x7f3d4c15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 >> 172.21.15.37:0/1359100412 conn(0x7f3d4c0d4fe0 msgr2=0x7f3d4c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 shutdown_connections 2024-05-10T08:43:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.296+0000 7f3d510c8640 1 -- 172.21.15.37:0/1359100412 wait complete. 2024-05-10T08:43:51.307 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-05-10T08:43:51.307 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-05-10T08:43:51.307 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T08:43:51.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:43:51.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.415+0000 7f413f2d1640 1 Processor -- start 2024-05-10T08:43:51.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.415+0000 7f413f2d1640 1 -- start start 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413f2d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f413806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413f2d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41380731c0 0x7f4138073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413f2d1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380b55a0 con 0x7f41380ce130 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413f2d1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f41380aed80 con 0x7f41380731c0 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413f2d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f41380b5880 con 0x7f413815c2d0 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413d06d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f413806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413d06d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f413806fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:51548/0 (socket says 172.21.15.37:51548) 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413d06d640 1 -- 172.21.15.37:0/524049492 learned_addr learned my addr 172.21.15.37:0/524049492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:51.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.416+0000 7f413d86e640 1 --2- 172.21.15.37:0/524049492 >> v2:172.21.15.82:3300/0 conn(0x7f41380731c0 0x7f4138073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.417+0000 7f413d06d640 1 -- 172.21.15.37:0/524049492 >> v2:172.21.15.82:3300/0 conn(0x7f41380731c0 msgr2=0x7f4138073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:51.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.417+0000 7f413d06d640 1 --2- 172.21.15.37:0/524049492 >> v2:172.21.15.82:3300/0 conn(0x7f41380731c0 0x7f4138073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.417+0000 7f413d06d640 1 -- 172.21.15.37:0/524049492 >> v1:172.21.15.82:6789/0 conn(0x7f41380ce130 legacy=0x7f41380b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.417+0000 7f413d06d640 1 -- 172.21.15.37:0/524049492 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41380b5b60 con 0x7f413815c2d0 2024-05-10T08:43:51.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.417+0000 7f413d86e640 1 --2- 172.21.15.37:0/524049492 >> v2:172.21.15.82:3300/0 conn(0x7f41380731c0 0x7f4138073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:43:51.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.418+0000 7f413d06d640 1 --2- 172.21.15.37:0/524049492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f413806fda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4134009870 tx=0x7f413402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4588a9dd08a6663 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:51.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.418+0000 7f412ffff640 1 -- 172.21.15.37:0/524049492 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4134037070 con 0x7f413815c2d0 2024-05-10T08:43:51.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f412ffff640 1 -- 172.21.15.37:0/524049492 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4134032440 con 0x7f413815c2d0 2024-05-10T08:43:51.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f412ffff640 1 -- 172.21.15.37:0/524049492 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4134032810 con 0x7f413815c2d0 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f413f2d1640 1 -- 172.21.15.37:0/524049492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 msgr2=0x7f413806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f413f2d1640 1 --2- 172.21.15.37:0/524049492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f413806fda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4134009870 tx=0x7f413402a1c0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f413f2d1640 1 -- 172.21.15.37:0/524049492 shutdown_connections 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f413f2d1640 1 --2- 172.21.15.37:0/524049492 >> v2:172.21.15.82:3300/0 conn(0x7f41380731c0 0x7f4138073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f413f2d1640 1 --2- 172.21.15.37:0/524049492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f413806fda0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.419+0000 7f413f2d1640 1 -- 172.21.15.37:0/524049492 >> 172.21.15.37:0/524049492 conn(0x7f41380b39a0 msgr2=0x7f41380b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.420+0000 7f413f2d1640 1 -- 172.21.15.37:0/524049492 shutdown_connections 2024-05-10T08:43:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.420+0000 7f413f2d1640 1 -- 172.21.15.37:0/524049492 wait complete. 2024-05-10T08:43:51.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.421+0000 7f413f2d1640 1 Processor -- start 2024-05-10T08:43:51.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.421+0000 7f413f2d1640 1 -- start start 2024-05-10T08:43:51.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413f2d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380731c0 0x7f4138148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413f2d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41380ce130 0x7f41381502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413f2d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f41380cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413f2d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4138165e50 con 0x7f41380731c0 2024-05-10T08:43:51.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413f2d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4138165cd0 con 0x7f41380ce130 2024-05-10T08:43:51.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413f2d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4138165fd0 con 0x7f413815c2d0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380731c0 0x7f4138148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380731c0 0x7f4138148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49398/0 (socket says 172.21.15.37:49398) 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 -- 172.21.15.37:0/914686944 learned_addr learned my addr 172.21.15.37:0/914686944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d86e640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f41380cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413c86c640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41380ce130 0x7f41381502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 -- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 msgr2=0x7f41380cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f41380cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 -- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41380ce130 msgr2=0x7f41381502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41380ce130 0x7f41381502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 -- 172.21.15.37:0/914686944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4138150d80 con 0x7f41380731c0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.422+0000 7f413d06d640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380731c0 0x7f4138148190 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4134000c00 tx=0x7f41340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.423+0000 7f412dffb640 1 -- 172.21.15.37:0/914686944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4134037040 con 0x7f41380731c0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.423+0000 7f412dffb640 1 -- 172.21.15.37:0/914686944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4134042070 con 0x7f41380731c0 2024-05-10T08:43:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.423+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4138151060 con 0x7f41380731c0 2024-05-10T08:43:51.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.423+0000 7f412dffb640 1 -- 172.21.15.37:0/914686944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41340308a0 con 0x7f41380731c0 2024-05-10T08:43:51.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.423+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4138151620 con 0x7f41380731c0 2024-05-10T08:43:51.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.424+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4138069b00 con 0x7f41380731c0 2024-05-10T08:43:51.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.425+0000 7f412dffb640 1 -- 172.21.15.37:0/914686944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f413402ad10 con 0x7f41380731c0 2024-05-10T08:43:51.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.425+0000 7f412dffb640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f411c0762d0 0x7f411c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.425+0000 7f412dffb640 1 -- 172.21.15.37:0/914686944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f41340b7890 con 0x7f41380731c0 2024-05-10T08:43:51.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.425+0000 7f413c86c640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f411c0762d0 0x7f411c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.426+0000 7f413c86c640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f411c0762d0 0x7f411c078790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f41380cf090 tx=0x7f4130009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:51.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.430+0000 7f412dffb640 1 -- 172.21.15.37:0/914686944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f41340813f0 con 0x7f41380731c0 2024-05-10T08:43:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.620+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4138152c40 con 0x7f41380731c0 2024-05-10T08:43:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.621+0000 7f412dffb640 1 -- 172.21.15.37:0/914686944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+13232 (secure 0 0 0) 0x7f4134080cf0 con 0x7f41380731c0 2024-05-10T08:43:51.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:51.621 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:43:50.289161+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/640581632":"2024-05-11T08:43:47.277726+0000","172.21.15.37:6833/640581632":"2024-05-11T08:43:47.277726+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f411c0762d0 msgr2=0x7f411c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f411c0762d0 0x7f411c078790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f41380cf090 tx=0x7f4130009040 comp rx=0 tx=0).stop 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380731c0 msgr2=0x7f4138148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380731c0 0x7f4138148190 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4134000c00 tx=0x7f41340046c0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 shutdown_connections 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f411c0762d0 0x7f411c078790 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f413815c2d0 0x7f41380cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41380ce130 0x7f41381502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 --2- 172.21.15.37:0/914686944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380731c0 0x7f4138148190 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 >> 172.21.15.37:0/914686944 conn(0x7f41380b39a0 msgr2=0x7f4138149040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 shutdown_connections 2024-05-10T08:43:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.623+0000 7f413f2d1640 1 -- 172.21.15.37:0/914686944 wait complete. 2024-05-10T08:43:51.634 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T08:40:11.341540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T08:43:51.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T08:43:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.742+0000 7fa729afc640 1 Processor -- start 2024-05-10T08:43:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.742+0000 7fa729afc640 1 -- start start 2024-05-10T08:43:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.743+0000 7fa729afc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa72406cab0 0x7fa72406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.743+0000 7fa729afc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7240d03f0 con 0x7fa72406f870 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.743+0000 7fa729afc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7240702f0 con 0x7fa72415ce80 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.743+0000 7fa729afc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa72415d970 con 0x7fa72406cab0 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.743+0000 7fa722ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa72406f870 0x7fa72406c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42816/0 (socket says 172.21.15.37:42816) 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.743+0000 7fa722ffd640 1 -- 172.21.15.37:0/3319412910 learned_addr learned my addr 172.21.15.37:0/3319412910 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.744+0000 7fa723fff640 1 --2- 172.21.15.37:0/3319412910 >> v2:172.21.15.82:3300/0 conn(0x7fa72406cab0 0x7fa72406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.744+0000 7fa7227fc640 1 -- 172.21.15.37:0/3319412910 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679639667 0 0) 0x7fa7240d03f0 con 0x7fa72406f870 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.744+0000 7fa7227fc640 1 -- 172.21.15.37:0/3319412910 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa70c003520 con 0x7fa72406f870 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.744+0000 7fa723fff640 1 -- 172.21.15.37:0/3319412910 >> v1:172.21.15.82:6789/0 conn(0x7fa72415ce80 legacy=0x7fa72415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.744+0000 7fa7227fc640 1 -- 172.21.15.37:0/3319412910 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 992955467 0 0) 0x7fa70c003520 con 0x7fa72406f870 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.744+0000 7fa723fff640 1 -- 172.21.15.37:0/3319412910 >> v1:172.21.15.37:6789/0 conn(0x7fa72406f870 legacy=0x7fa72406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.744+0000 7fa723fff640 1 -- 172.21.15.37:0/3319412910 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7240705d0 con 0x7fa72406cab0 2024-05-10T08:43:51.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.745+0000 7fa723fff640 1 --2- 172.21.15.37:0/3319412910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72406cab0 0x7fa72406fd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009d90 tx=0x7fa71c02a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09be65153ef0a68 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.745+0000 7fa7227fc640 1 -- 172.21.15.37:0/3319412910 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c035020 con 0x7fa72406cab0 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.745+0000 7fa7227fc640 1 -- 172.21.15.37:0/3319412910 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71c007540 con 0x7fa72406cab0 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.745+0000 7fa7227fc640 1 -- 172.21.15.37:0/3319412910 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718001690 con 0x7fa72406cab0 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.745+0000 7fa729afc640 1 -- 172.21.15.37:0/3319412910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72406cab0 msgr2=0x7fa72406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.745+0000 7fa729afc640 1 --2- 172.21.15.37:0/3319412910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72406cab0 0x7fa72406fd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009d90 tx=0x7fa71c02a5b0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.746+0000 7fa729afc640 1 -- 172.21.15.37:0/3319412910 shutdown_connections 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.746+0000 7fa729afc640 1 --2- 172.21.15.37:0/3319412910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72406cab0 0x7fa72406fd00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.746+0000 7fa729afc640 1 -- 172.21.15.37:0/3319412910 >> 172.21.15.37:0/3319412910 conn(0x7fa7240b3c40 msgr2=0x7fa7240b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.746+0000 7fa729afc640 1 -- 172.21.15.37:0/3319412910 shutdown_connections 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.746+0000 7fa729afc640 1 -- 172.21.15.37:0/3319412910 wait complete. 2024-05-10T08:43:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.747+0000 7fa729afc640 1 Processor -- start 2024-05-10T08:43:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.747+0000 7fa729afc640 1 -- start start 2024-05-10T08:43:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa729afc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa72406cab0 0x7fa724140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa729afc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72406f870 0x7fa724143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa729afc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72415ce80 0x7fa7241404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa729afc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7240cead0 con 0x7fa72406f870 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa729afc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7240d0690 con 0x7fa72415ce80 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa729afc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7240d0bb0 con 0x7fa72406cab0 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72406f870 0x7fa724143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72406f870 0x7fa724143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49414/0 (socket says 172.21.15.37:49414) 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 -- 172.21.15.37:0/1812100787 learned_addr learned my addr 172.21.15.37:0/1812100787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa723fff640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72415ce80 0x7fa7241404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa7237fe640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa72406cab0 0x7fa724140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 -- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa72406cab0 msgr2=0x7fa724140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa72406cab0 0x7fa724140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 -- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72415ce80 msgr2=0x7fa7241404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72415ce80 0x7fa7241404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 -- 172.21.15.37:0/1812100787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa724141500 con 0x7fa72406f870 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa7237fe640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa72406cab0 0x7fa724140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa723fff640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72415ce80 0x7fa7241404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa722ffd640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72406f870 0x7fa724143850 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c750 tx=0x7fa71800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa70bfff640 1 -- 172.21.15.37:0/1812100787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718018070 con 0x7fa72406f870 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa70bfff640 1 -- 172.21.15.37:0/1812100787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7180072f0 con 0x7fa72406f870 2024-05-10T08:43:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.748+0000 7fa70bfff640 1 -- 172.21.15.37:0/1812100787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7180047e0 con 0x7fa72406f870 2024-05-10T08:43:51.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.749+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7241417e0 con 0x7fa72406f870 2024-05-10T08:43:51.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.749+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa724141da0 con 0x7fa72406f870 2024-05-10T08:43:51.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.750+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa724069b00 con 0x7fa72406f870 2024-05-10T08:43:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.750+0000 7fa70bfff640 1 -- 172.21.15.37:0/1812100787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa718004980 con 0x7fa72406f870 2024-05-10T08:43:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.751+0000 7fa70bfff640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7100762d0 0x7fa710078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.751+0000 7fa70bfff640 1 -- 172.21.15.37:0/1812100787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fa7180968e0 con 0x7fa72406f870 2024-05-10T08:43:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.751+0000 7fa7237fe640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7100762d0 0x7fa710078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.751+0000 7fa7237fe640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7100762d0 0x7fa710078790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa714007fd0 tx=0x7fa714009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:51.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.755+0000 7fa70bfff640 1 -- 172.21.15.37:0/1812100787 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa718004c70 con 0x7fa72406f870 2024-05-10T08:43:51.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.943+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7240ce8b0 con 0x7fa72406f870 2024-05-10T08:43:51.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.943+0000 7fa70bfff640 1 -- 172.21.15.37:0/1812100787 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7fa718060330 con 0x7fa72406f870 2024-05-10T08:43:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7100762d0 msgr2=0x7fa710078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7100762d0 0x7fa710078790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa714007fd0 tx=0x7fa714009040 comp rx=0 tx=0).stop 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72406f870 msgr2=0x7fa724143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72406f870 0x7fa724143850 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c750 tx=0x7fa71800cc10 comp rx=0 tx=0).stop 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 shutdown_connections 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7100762d0 0x7fa710078790 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa72415ce80 0x7fa7241404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72406f870 0x7fa724143850 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 --2- 172.21.15.37:0/1812100787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa72406cab0 0x7fa724140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 >> 172.21.15.37:0/1812100787 conn(0x7fa7240b3c40 msgr2=0x7fa7240b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 shutdown_connections 2024-05-10T08:43:51.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:51.945+0000 7fa729afc640 1 -- 172.21.15.37:0/1812100787 wait complete. 2024-05-10T08:43:51.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-05-10T08:43:52.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.060+0000 7fccc02a7640 1 Processor -- start 2024-05-10T08:43:52.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.060+0000 7fccc02a7640 1 -- start start 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccc02a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccb815f420 0x7fccb80d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccc02a7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb80d3ca0 0x7fccb80d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccc02a7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 0x7fccb80d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccc02a7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fccb81630b0 con 0x7fccb815f420 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccc02a7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fccb80d2550 con 0x7fccb80d3ca0 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccc02a7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80d2c80 con 0x7fccb80d1eb0 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccb815f420 0x7fccb80d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccb815f420 0x7fccb80d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49428/0 (socket says 172.21.15.37:49428) 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 -- 172.21.15.37:0/4258856258 learned_addr learned my addr 172.21.15.37:0/4258856258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 -- 172.21.15.37:0/4258856258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 msgr2=0x7fccb80d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 --2- 172.21.15.37:0/4258856258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 0x7fccb80d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 -- 172.21.15.37:0/4258856258 >> v2:172.21.15.82:3300/0 conn(0x7fccb80d3ca0 msgr2=0x7fccb80d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 --2- 172.21.15.37:0/4258856258 >> v2:172.21.15.82:3300/0 conn(0x7fccb80d3ca0 0x7fccb80d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.061+0000 7fccbe043640 1 -- 172.21.15.37:0/4258856258 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80d2f60 con 0x7fccb815f420 2024-05-10T08:43:52.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.062+0000 7fccbe043640 1 --2- 172.21.15.37:0/4258856258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb815f420 0x7fccb80d3760 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fccb808f380 tx=0x7fccb402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c55799a6df1a210 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:52.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.062+0000 7fccbd041640 1 -- 172.21.15.37:0/4258856258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4037070 con 0x7fccb815f420 2024-05-10T08:43:52.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.062+0000 7fccbd041640 1 -- 172.21.15.37:0/4258856258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb4032440 con 0x7fccb815f420 2024-05-10T08:43:52.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.062+0000 7fccbd041640 1 -- 172.21.15.37:0/4258856258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4032810 con 0x7fccb815f420 2024-05-10T08:43:52.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 -- 172.21.15.37:0/4258856258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb815f420 msgr2=0x7fccb80d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:52.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4258856258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb815f420 0x7fccb80d3760 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fccb808f380 tx=0x7fccb402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 -- 172.21.15.37:0/4258856258 shutdown_connections 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4258856258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 0x7fccb80d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4258856258 >> v2:172.21.15.82:3300/0 conn(0x7fccb80d3ca0 0x7fccb80d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4258856258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb815f420 0x7fccb80d3760 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 -- 172.21.15.37:0/4258856258 >> 172.21.15.37:0/4258856258 conn(0x7fccb808eac0 msgr2=0x7fccb809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 -- 172.21.15.37:0/4258856258 shutdown_connections 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.063+0000 7fccc02a7640 1 -- 172.21.15.37:0/4258856258 wait complete. 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.064+0000 7fccc02a7640 1 Processor -- start 2024-05-10T08:43:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.064+0000 7fccc02a7640 1 -- start start 2024-05-10T08:43:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccc02a7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 0x7fccb8151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccc02a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb80ce270 0x7fccb80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccc02a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb80b3210 0x7fccb80cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccc02a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80d5200 con 0x7fccb80b3210 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccc02a7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80d2830 con 0x7fccb80ce270 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccc02a7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80d5380 con 0x7fccb80d1eb0 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb80b3210 0x7fccb80cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb80b3210 0x7fccb80cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49444/0 (socket says 172.21.15.37:49444) 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 -- 172.21.15.37:0/4264907407 learned_addr learned my addr 172.21.15.37:0/4264907407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe043640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 0x7fccb8151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbd842640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb80ce270 0x7fccb80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 -- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 msgr2=0x7fccb8151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 0x7fccb8151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 -- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb80ce270 msgr2=0x7fccb80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb80ce270 0x7fccb80b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbe844640 1 -- 172.21.15.37:0/4264907407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80cd1d0 con 0x7fccb80b3210 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.065+0000 7fccbd842640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb80ce270 0x7fccb80b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.066+0000 7fccbe844640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb80b3210 0x7fccb80cc400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b9a0 tx=0x7fccb000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.066+0000 7fccaeffd640 1 -- 172.21.15.37:0/4264907407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0019070 con 0x7fccb80b3210 2024-05-10T08:43:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.066+0000 7fccaeffd640 1 -- 172.21.15.37:0/4264907407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb000cb60 con 0x7fccb80b3210 2024-05-10T08:43:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.066+0000 7fccaeffd640 1 -- 172.21.15.37:0/4264907407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0014440 con 0x7fccb80b3210 2024-05-10T08:43:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.066+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb80cd4b0 con 0x7fccb80b3210 2024-05-10T08:43:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.066+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb80cda70 con 0x7fccb80b3210 2024-05-10T08:43:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.067+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb80693f0 con 0x7fccb80b3210 2024-05-10T08:43:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.067+0000 7fccaeffd640 1 -- 172.21.15.37:0/4264907407 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccb001c070 con 0x7fccb80b3210 2024-05-10T08:43:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.068+0000 7fccaeffd640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc9c076300 0x7fcc9c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.068+0000 7fccaeffd640 1 -- 172.21.15.37:0/4264907407 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fccb00970b0 con 0x7fccb80b3210 2024-05-10T08:43:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.068+0000 7fccbe043640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc9c076300 0x7fcc9c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.069+0000 7fccbe043640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc9c076300 0x7fcc9c0787c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fccb4034000 tx=0x7fccb402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:52.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.072+0000 7fccaeffd640 1 -- 172.21.15.37:0/4264907407 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fccb0060530 con 0x7fccb80b3210 2024-05-10T08:43:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:52.337+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7fccb80b4c50 con 0x7fccb80b3210 2024-05-10T08:43:53.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.300+0000 7fccaeffd640 1 -- 172.21.15.37:0/4264907407 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v186) ==== 169+0+0 (secure 0 0 0) 0x7fccb0064830 con 0x7fccb80b3210 2024-05-10T08:43:53.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc9c076300 msgr2=0x7fcc9c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc9c076300 0x7fcc9c0787c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fccb4034000 tx=0x7fccb402e000 comp rx=0 tx=0).stop 2024-05-10T08:43:53.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb80b3210 msgr2=0x7fccb80cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb80b3210 0x7fccb80cc400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b9a0 tx=0x7fccb000be60 comp rx=0 tx=0).stop 2024-05-10T08:43:53.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 shutdown_connections 2024-05-10T08:43:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc9c076300 0x7fcc9c0787c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccb80b3210 0x7fccb80cc400 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb80ce270 0x7fccb80b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 --2- 172.21.15.37:0/4264907407 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fccb80d1eb0 0x7fccb8151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 >> 172.21.15.37:0/4264907407 conn(0x7fccb808eac0 msgr2=0x7fccb806d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 shutdown_connections 2024-05-10T08:43:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.303+0000 7fccc02a7640 1 -- 172.21.15.37:0/4264907407 wait complete. 2024-05-10T08:43:53.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T08:43:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.430+0000 7f820fb4e640 1 Processor -- start 2024-05-10T08:43:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.430+0000 7f820fb4e640 1 -- start start 2024-05-10T08:43:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820fb4e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8208070d30 0x7f82080d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820fb4e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8208071110 0x7f820806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820fb4e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8208160720 con 0x7f82081639e0 2024-05-10T08:43:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820fb4e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f82080d1ca0 con 0x7f8208070d30 2024-05-10T08:43:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820fb4e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f82080d10d0 con 0x7f8208071110 2024-05-10T08:43:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820d8ea640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8208070d30 0x7f82080d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820d0e9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f82081639e0 0x7f82080703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42818/0 (socket says 172.21.15.37:42818) 2024-05-10T08:43:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.431+0000 7f820d0e9640 1 -- 172.21.15.37:0/811902591 learned_addr learned my addr 172.21.15.37:0/811902591 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820e0eb640 1 --2- 172.21.15.37:0/811902591 >> v2:172.21.15.82:3300/0 conn(0x7f8208071110 0x7f820806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820d8ea640 1 -- 172.21.15.37:0/811902591 >> v2:172.21.15.82:3300/0 conn(0x7f8208071110 msgr2=0x7f820806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820d8ea640 1 --2- 172.21.15.37:0/811902591 >> v2:172.21.15.82:3300/0 conn(0x7f8208071110 0x7f820806d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820d8ea640 1 -- 172.21.15.37:0/811902591 >> v1:172.21.15.37:6789/0 conn(0x7f82081639e0 legacy=0x7f82080703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820d8ea640 1 -- 172.21.15.37:0/811902591 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82080d1370 con 0x7f8208070d30 2024-05-10T08:43:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820c8e8640 1 -- 172.21.15.37:0/811902591 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172885198 0 0) 0x7f8208160720 con 0x7f82081639e0 2024-05-10T08:43:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820d8ea640 1 --2- 172.21.15.37:0/811902591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208070d30 0x7f82080d2130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f82080761d0 tx=0x7f820402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0f08ebd7eb20be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.432+0000 7f820c8e8640 1 -- 172.21.15.37:0/811902591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204037070 con 0x7f8208070d30 2024-05-10T08:43:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820c8e8640 1 -- 172.21.15.37:0/811902591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8204032440 con 0x7f8208070d30 2024-05-10T08:43:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820c8e8640 1 -- 172.21.15.37:0/811902591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204032810 con 0x7f8208070d30 2024-05-10T08:43:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 -- 172.21.15.37:0/811902591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208070d30 msgr2=0x7f82080d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 --2- 172.21.15.37:0/811902591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208070d30 0x7f82080d2130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f82080761d0 tx=0x7f820402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 -- 172.21.15.37:0/811902591 shutdown_connections 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 --2- 172.21.15.37:0/811902591 >> v2:172.21.15.82:3300/0 conn(0x7f8208071110 0x7f820806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 --2- 172.21.15.37:0/811902591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208070d30 0x7f82080d2130 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 -- 172.21.15.37:0/811902591 >> 172.21.15.37:0/811902591 conn(0x7f82080d2e90 msgr2=0x7f82080d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 -- 172.21.15.37:0/811902591 shutdown_connections 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.433+0000 7f820fb4e640 1 -- 172.21.15.37:0/811902591 wait complete. 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.434+0000 7f820fb4e640 1 Processor -- start 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.434+0000 7f820fb4e640 1 -- start start 2024-05-10T08:43:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820fb4e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8208070d30 0x7f82081572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820fb4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208071110 0x7f8208153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820fb4e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82081639e0 0x7f82081544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820fb4e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8208071540 con 0x7f8208071110 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820fb4e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f82080d1930 con 0x7f82081639e0 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820fb4e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f82080716c0 con 0x7f8208070d30 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820d0e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208071110 0x7f8208153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820d0e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208071110 0x7f8208153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49448/0 (socket says 172.21.15.37:49448) 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820d0e9640 1 -- 172.21.15.37:0/3332634233 learned_addr learned my addr 172.21.15.37:0/3332634233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820e0eb640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82081639e0 0x7f82081544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.435+0000 7f820d8ea640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8208070d30 0x7f82081572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820d0e9640 1 -- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8208070d30 msgr2=0x7f82081572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820d0e9640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8208070d30 0x7f82081572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820d0e9640 1 -- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82081639e0 msgr2=0x7f82081544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820d0e9640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82081639e0 0x7f82081544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820d0e9640 1 -- 172.21.15.37:0/3332634233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82080c7d50 con 0x7f8208071110 2024-05-10T08:43:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820d0e9640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208071110 0x7f8208153fa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c4d0 tx=0x7f81f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f81fe7fc640 1 -- 172.21.15.37:0/3332634233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8018070 con 0x7f8208071110 2024-05-10T08:43:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f81fe7fc640 1 -- 172.21.15.37:0/3332634233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8007500 con 0x7f8208071110 2024-05-10T08:43:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82080c8030 con 0x7f8208071110 2024-05-10T08:43:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f81fe7fc640 1 -- 172.21.15.37:0/3332634233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8004a20 con 0x7f8208071110 2024-05-10T08:43:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.436+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82080c85f0 con 0x7f8208071110 2024-05-10T08:43:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.437+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82080693f0 con 0x7f8208071110 2024-05-10T08:43:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.438+0000 7f81fe7fc640 1 -- 172.21.15.37:0/3332634233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f81f801b070 con 0x7f8208071110 2024-05-10T08:43:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.438+0000 7f81fe7fc640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81ec0762d0 0x7f81ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.438+0000 7f81fe7fc640 1 -- 172.21.15.37:0/3332634233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f81f8096810 con 0x7f8208071110 2024-05-10T08:43:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.438+0000 7f820d8ea640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81ec0762d0 0x7f81ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.439+0000 7f820d8ea640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81ec0762d0 0x7f81ec078790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8204034000 tx=0x7f820402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.442+0000 7f81fe7fc640 1 -- 172.21.15.37:0/3332634233 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f81f80602e0 con 0x7f8208071110 2024-05-10T08:43:53.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:43:53.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:43:53.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.634+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f82080b2100 con 0x7f8208071110 2024-05-10T08:43:53.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.638+0000 7f81fe7fc640 1 -- 172.21.15.37:0/3332634233 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f81f805fbe0 con 0x7f8208071110 2024-05-10T08:43:53.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81ec0762d0 msgr2=0x7f81ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81ec0762d0 0x7f81ec078790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8204034000 tx=0x7f820402e000 comp rx=0 tx=0).stop 2024-05-10T08:43:53.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208071110 msgr2=0x7f8208153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208071110 0x7f8208153fa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c4d0 tx=0x7f81f800c990 comp rx=0 tx=0).stop 2024-05-10T08:43:53.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 shutdown_connections 2024-05-10T08:43:53.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81ec0762d0 0x7f81ec078790 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82081639e0 0x7f82081544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8208071110 0x7f8208153fa0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 --2- 172.21.15.37:0/3332634233 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8208070d30 0x7f82081572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 >> 172.21.15.37:0/3332634233 conn(0x7f82080d2e90 msgr2=0x7f8208160910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:53.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 shutdown_connections 2024-05-10T08:43:53.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.640+0000 7f820fb4e640 1 -- 172.21.15.37:0/3332634233 wait complete. 2024-05-10T08:43:53.650 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:43:53.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:43:53.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:43:53.765 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:43:53.765 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:43:53.765 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:53.781 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:43:53.782 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:43:53.782 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:53.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:43:53.800 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:43:53.800 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:53.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:43:53.838 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:43:53.838 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:43:53.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:43:53.857 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T08:43:53.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:43:53.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.982+0000 7f8afc57f640 1 Processor -- start 2024-05-10T08:43:53.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.982+0000 7f8afc57f640 1 -- start start 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8afc57f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40c9ee0 0x7f8af40d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8afc57f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af40d3330 con 0x7f8af40d3cd0 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8afc57f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af40d2170 con 0x7f8af41629a0 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8afc57f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8af40d2450 con 0x7f8af40c9ee0 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8af9b1a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8af40d3cd0 0x7f8af40cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42822/0 (socket says 172.21.15.37:42822) 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8af9b1a640 1 -- 172.21.15.37:0/2193689987 learned_addr learned my addr 172.21.15.37:0/2193689987 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8afab1c640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40c9ee0 0x7f8af40d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343048454 0 0) 0x7f8af40d3330 con 0x7f8af40d3cd0 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.983+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ae0003520 con 0x7f8af40d3cd0 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090138881 0 0) 0x7f8af40d2170 con 0x7f8af41629a0 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af40d3330 con 0x7f8af41629a0 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2074805920 0 0) 0x7f8ae0003520 con 0x7f8af40d3cd0 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40c9ee0 msgr2=0x7f8af40d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40c9ee0 0x7f8af40d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 >> v1:172.21.15.82:6789/0 conn(0x7f8af41629a0 legacy=0x7f8af40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af40d2730 con 0x7f8af40d3cd0 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8ae40015f0 con 0x7f8af40d3cd0 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 >> v1:172.21.15.37:6789/0 conn(0x7f8af40d3cd0 legacy=0x7f8af40cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0003b70 0x7f8ae0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae0004800 0x7f8ae0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ae0005260 0x7f8ae000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8af40d2450 con 0x7f8ae0004800 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae000c140 con 0x7f8ae0003b70 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae000c340 con 0x7f8ae0005260 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8afab1c640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40c9ee0 0x7f8af40d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9b1a640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae0004800 0x7f8ae0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8afa31b640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0003b70 0x7f8ae0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8afab1c640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ae0005260 0x7f8ae000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9b1a640 1 -- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ae0005260 msgr2=0x7f8ae000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9b1a640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8ae0005260 0x7f8ae000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9b1a640 1 -- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0003b70 msgr2=0x7f8ae0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9b1a640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0003b70 0x7f8ae0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.984+0000 7f8af9b1a640 1 -- 172.21.15.37:0/2193689987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae0003520 con 0x7f8ae0004800 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.985+0000 7f8af9b1a640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae0004800 0x7f8ae0004c80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4007f60 tx=0x7f8ae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639134b195f1be2f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.985+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4007b80 con 0x7f8ae0004800 2024-05-10T08:43:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.985+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4005bb0 con 0x7f8ae0004800 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.985+0000 7f8af9319640 1 -- 172.21.15.37:0/2193689987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4007070 con 0x7f8ae0004800 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.986+0000 7f8afc57f640 1 -- 172.21.15.37:0/2193689987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae0004800 msgr2=0x7f8ae0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.986+0000 7f8afc57f640 1 --2- 172.21.15.37:0/2193689987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae0004800 0x7f8ae0004c80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4007f60 tx=0x7f8ae0005830 comp rx=0 tx=0).stop 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.986+0000 7f8afab1c640 1 -- 172.21.15.37:0/2193689987 reap_dead start 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.986+0000 7f8afc57f640 1 -- 172.21.15.37:0/2193689987 shutdown_connections 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.986+0000 7f8afc57f640 1 -- 172.21.15.37:0/2193689987 >> 172.21.15.37:0/2193689987 conn(0x7f8af40d4fe0 msgr2=0x7f8af40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.986+0000 7f8afc57f640 1 -- 172.21.15.37:0/2193689987 shutdown_connections 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.986+0000 7f8afc57f640 1 -- 172.21.15.37:0/2193689987 wait complete. 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.987+0000 7f8afc57f640 1 Processor -- start 2024-05-10T08:43:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.987+0000 7f8afc57f640 1 -- start start 2024-05-10T08:43:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afc57f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0004800 0x7f8af415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afc57f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40b8c10 0x7f8af40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afc57f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40b9090 0x7f8af40cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afc57f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8af40cf440 con 0x7f8af40b8c10 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afc57f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8af40cf2c0 con 0x7f8ae0004800 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afc57f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8af40d2dc0 con 0x7f8af40b9090 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40b8c10 0x7f8af40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40b8c10 0x7f8af40ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49456/0 (socket says 172.21.15.37:49456) 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 -- 172.21.15.37:0/3252204437 learned_addr learned my addr 172.21.15.37:0/3252204437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afa31b640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0004800 0x7f8af415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afab1c640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40b9090 0x7f8af40cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 -- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40b9090 msgr2=0x7f8af40cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40b9090 0x7f8af40cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 -- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0004800 msgr2=0x7f8af415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0004800 0x7f8af415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 -- 172.21.15.37:0/3252204437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af415e820 con 0x7f8af40b8c10 2024-05-10T08:43:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8afa31b640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0004800 0x7f8af415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8af9b1a640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40b8c10 0x7f8af40ca670 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8ae402ac60 tx=0x7f8af40b68d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.988+0000 7f8aeaffd640 1 -- 172.21.15.37:0/3252204437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4044070 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.989+0000 7f8aeaffd640 1 -- 172.21.15.37:0/3252204437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4038040 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.989+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af40b7e50 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.989+0000 7f8aeaffd640 1 -- 172.21.15.37:0/3252204437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40015f0 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.989+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af40b8410 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.990+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af40693f0 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.990+0000 7f8aeaffd640 1 -- 172.21.15.37:0/3252204437 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ae4004a00 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.990+0000 7f8aeaffd640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ad80762d0 0x7f8ad8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.991+0000 7f8aeaffd640 1 -- 172.21.15.37:0/3252204437 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f8ae40b6e70 con 0x7f8af40b8c10 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.991+0000 7f8afa31b640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ad80762d0 0x7f8ad8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.991+0000 7f8afa31b640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ad80762d0 0x7f8ad8078790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8af00010e0 tx=0x7f8af0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:53.995+0000 7f8aeaffd640 1 -- 172.21.15.37:0/3252204437 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8ae4080950 con 0x7f8af40b8c10 2024-05-10T08:43:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.225+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8af40d0db0 con 0x7f8af40b8c10 2024-05-10T08:43:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.226+0000 7f8aeaffd640 1 -- 172.21.15.37:0/3252204437 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+3866 (secure 0 0 0) 0x7f8ae4080250 con 0x7f8af40b8c10 2024-05-10T08:43:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:54.225 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3420930198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3420930198},{"type":"v1","addr":"172.21.15.37:6834","nonce":3420930198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/4184805340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4184805340},{"type":"v1","addr":"172.21.15.82:6836","nonce":4184805340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1708709325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1708709325},{"type":"v1","addr":"172.21.15.82:6837","nonce":1708709325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/533787278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":533787278},{"type":"v1","addr":"172.21.15.37:6835","nonce":533787278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[]} 2024-05-10T08:43:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2024-05-10T08:43:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ad80762d0 msgr2=0x7f8ad8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ad80762d0 0x7f8ad8078790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8af00010e0 tx=0x7f8af0009040 comp rx=0 tx=0).stop 2024-05-10T08:43:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40b8c10 msgr2=0x7f8af40ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40b8c10 0x7f8af40ca670 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8ae402ac60 tx=0x7f8af40b68d0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 shutdown_connections 2024-05-10T08:43:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ad80762d0 0x7f8ad8078790 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8af40b9090 0x7f8af40cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40b8c10 0x7f8af40ca670 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 --2- 172.21.15.37:0/3252204437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ae0004800 0x7f8af415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 >> 172.21.15.37:0/3252204437 conn(0x7f8af40d4fe0 msgr2=0x7f8af406e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 shutdown_connections 2024-05-10T08:43:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.228+0000 7f8afc57f640 1 -- 172.21.15.37:0/3252204437 wait complete. 2024-05-10T08:43:54.238 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:43:54.239 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T08:43:54.239 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:43:54.239 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:43:54.239 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:43:54.239 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T08:43:54.239 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:43:54.239 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:43:54.240 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:43:54.240 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T08:43:54.240 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:43:54.240 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:43:54.240 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:43:54.240 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T08:43:54.240 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:43:54.241 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:43:54.249 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:43:54.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:43:54.250 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:43:54.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:43:54.252 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:43:54.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:43:54.253 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:43:54.253 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:43:54.292 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:43:54.292 DEBUG:teuthology.parallel:result is None 2024-05-10T08:43:54.292 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:43:54.293 DEBUG:teuthology.parallel:result is None 2024-05-10T08:43:54.295 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:43:54.296 DEBUG:teuthology.parallel:result is None 2024-05-10T08:43:54.296 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:43:54.296 DEBUG:teuthology.parallel:result is None 2024-05-10T08:43:54.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T08:43:54.372 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:43:54.372 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:43:54.382 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:43:54.382 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:43:54.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.408+0000 7fc1bdcf8640 1 Processor -- start 2024-05-10T08:43:54.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.408+0000 7fc1bdcf8640 1 -- start start 2024-05-10T08:43:54.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1bdcf8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1b815f420 0x7fc1b80d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:54.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1bdcf8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d3ca0 0x7fc1b80d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:54.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1bdcf8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b81630b0 con 0x7fc1b80d1eb0 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1bdcf8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b80d22f0 con 0x7fc1b815f420 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1bdcf8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b80d2550 con 0x7fc1b80d3ca0 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1b77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1b815f420 0x7fc1b80d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1b77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1b815f420 0x7fc1b80d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49478/0 (socket says 172.21.15.37:49478) 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1b77fe640 1 -- 172.21.15.37:0/370398537 learned_addr learned my addr 172.21.15.37:0/370398537 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1b77fe640 1 -- 172.21.15.37:0/370398537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d3ca0 msgr2=0x7fc1b80d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1b77fe640 1 --2- 172.21.15.37:0/370398537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d3ca0 0x7fc1b80d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1b77fe640 1 -- 172.21.15.37:0/370398537 >> v1:172.21.15.82:6789/0 conn(0x7fc1b80d1eb0 legacy=0x7fc1b80d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.409+0000 7fc1b77fe640 1 -- 172.21.15.37:0/370398537 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b80d2c80 con 0x7fc1b815f420 2024-05-10T08:43:54.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1b77fe640 1 --2- 172.21.15.37:0/370398537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b815f420 0x7fc1b80d3760 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009870 tx=0x7fc1a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c0317110de73de server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1b67fc640 1 -- 172.21.15.37:0/370398537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8037070 con 0x7fc1b815f420 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1b67fc640 1 -- 172.21.15.37:0/370398537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a8032440 con 0x7fc1b815f420 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1b67fc640 1 -- 172.21.15.37:0/370398537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8032810 con 0x7fc1b815f420 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/370398537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b815f420 msgr2=0x7fc1b80d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/370398537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b815f420 0x7fc1b80d3760 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009870 tx=0x7fc1a802a210 comp rx=0 tx=0).stop 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/370398537 shutdown_connections 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.410+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/370398537 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d3ca0 0x7fc1b80d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.411+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/370398537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b815f420 0x7fc1b80d3760 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.411+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/370398537 >> 172.21.15.37:0/370398537 conn(0x7fc1b808eac0 msgr2=0x7fc1b809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.411+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/370398537 shutdown_connections 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.411+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/370398537 wait complete. 2024-05-10T08:43:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.412+0000 7fc1bdcf8640 1 Processor -- start 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.412+0000 7fc1bdcf8640 1 -- start start 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1bdcf8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d1eb0 0x7fc1b8154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1bdcf8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b81554f0 0x7fc1b80b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1bdcf8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b85c0 0x7fc1b80cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1bdcf8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b80d2830 con 0x7fc1b81554f0 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1bdcf8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b80d3240 con 0x7fc1b80b85c0 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1bdcf8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b80d53d0 con 0x7fc1b80d1eb0 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b81554f0 0x7fc1b80b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b81554f0 0x7fc1b80b8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49480/0 (socket says 172.21.15.37:49480) 2024-05-10T08:43:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 -- 172.21.15.37:0/718120078 learned_addr learned my addr 172.21.15.37:0/718120078 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b77fe640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d1eb0 0x7fc1b8154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b7fff640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b85c0 0x7fc1b80cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 -- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d1eb0 msgr2=0x7fc1b8154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d1eb0 0x7fc1b8154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 -- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b85c0 msgr2=0x7fc1b80cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b85c0 0x7fc1b80cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 -- 172.21.15.37:0/718120078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b80cc2c0 con 0x7fc1b81554f0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1b6ffd640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b81554f0 0x7fc1b80b8080 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00b4d0 tx=0x7fc1ac00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc19ffff640 1 -- 172.21.15.37:0/718120078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac014070 con 0x7fc1b81554f0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc19ffff640 1 -- 172.21.15.37:0/718120078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac010610 con 0x7fc1b81554f0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b80cc5a0 con 0x7fc1b81554f0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.413+0000 7fc19ffff640 1 -- 172.21.15.37:0/718120078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac010a00 con 0x7fc1b81554f0 2024-05-10T08:43:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.414+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b80ccb60 con 0x7fc1b81554f0 2024-05-10T08:43:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.415+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b80693f0 con 0x7fc1b81554f0 2024-05-10T08:43:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.415+0000 7fc19ffff640 1 -- 172.21.15.37:0/718120078 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc1ac017070 con 0x7fc1b81554f0 2024-05-10T08:43:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.416+0000 7fc19ffff640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1a4076300 0x7fc1a40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:54.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.416+0000 7fc19ffff640 1 -- 172.21.15.37:0/718120078 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fc1ac096dd0 con 0x7fc1b81554f0 2024-05-10T08:43:54.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.416+0000 7fc1b77fe640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1a4076300 0x7fc1a40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:54.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.417+0000 7fc1b77fe640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1a4076300 0x7fc1a40787c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8034000 tx=0x7fc1a802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.421+0000 7fc19ffff640 1 -- 172.21.15.37:0/718120078 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc1ac060250 con 0x7fc1b81554f0 2024-05-10T08:43:54.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:54.626+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc1b81628d0 con 0x7fc1b81554f0 2024-05-10T08:43:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.319+0000 7fc19ffff640 1 -- 172.21.15.37:0/718120078 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) ==== 97+0+0 (secure 0 0 0) 0x7fc1ac064550 con 0x7fc1b81554f0 2024-05-10T08:43:55.319 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1a4076300 msgr2=0x7fc1a40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1a4076300 0x7fc1a40787c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8034000 tx=0x7fc1a802e000 comp rx=0 tx=0).stop 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b81554f0 msgr2=0x7fc1b80b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b81554f0 0x7fc1b80b8080 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00b4d0 tx=0x7fc1ac00b990 comp rx=0 tx=0).stop 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 shutdown_connections 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1a4076300 0x7fc1a40787c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b85c0 0x7fc1b80cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1b81554f0 0x7fc1b80b8080 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 --2- 172.21.15.37:0/718120078 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1b80d1eb0 0x7fc1b8154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 >> 172.21.15.37:0/718120078 conn(0x7fc1b808eac0 msgr2=0x7fc1b806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 shutdown_connections 2024-05-10T08:43:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.323+0000 7fc1bdcf8640 1 -- 172.21.15.37:0/718120078 wait complete. 2024-05-10T08:43:55.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T08:43:55.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.448+0000 7f6937989640 1 Processor -- start 2024-05-10T08:43:55.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.449+0000 7f6937989640 1 -- start start 2024-05-10T08:43:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.449+0000 7f6937989640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d1970 0x7f69300d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.449+0000 7f6937989640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69300d4cc0 0x7f69300d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.449+0000 7f6937989640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69301630b0 con 0x7f693015f420 2024-05-10T08:43:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.449+0000 7f6937989640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f69300d2330 con 0x7f69300d4cc0 2024-05-10T08:43:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.449+0000 7f6937989640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69300d3e70 con 0x7f69300d1970 2024-05-10T08:43:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935f26640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69300d4cc0 0x7f69300d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6934f24640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d1970 0x7f69300d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935f26640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69300d4cc0 0x7f69300d5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:59102/0 (socket says 172.21.15.37:59102) 2024-05-10T08:43:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935f26640 1 -- 172.21.15.37:0/3602530536 learned_addr learned my addr 172.21.15.37:0/3602530536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935725640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f693015f420 0x7f69300d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:50760/0 (socket says 172.21.15.37:50760) 2024-05-10T08:43:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935f26640 1 -- 172.21.15.37:0/3602530536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d1970 msgr2=0x7f69300d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935f26640 1 --2- 172.21.15.37:0/3602530536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d1970 0x7f69300d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935f26640 1 -- 172.21.15.37:0/3602530536 >> v1:172.21.15.82:6789/0 conn(0x7f693015f420 legacy=0x7f69300d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.450+0000 7f6935f26640 1 -- 172.21.15.37:0/3602530536 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69300d5670 con 0x7f69300d4cc0 2024-05-10T08:43:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.451+0000 7f6935f26640 1 --2- 172.21.15.37:0/3602530536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69300d4cc0 0x7f69300d5130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6928009870 tx=0x7f692802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a8505767c3ff714 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.451+0000 7f6927fff640 1 -- 172.21.15.37:0/3602530536 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928037070 con 0x7f69300d4cc0 2024-05-10T08:43:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.451+0000 7f6927fff640 1 -- 172.21.15.37:0/3602530536 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6928032440 con 0x7f69300d4cc0 2024-05-10T08:43:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.451+0000 7f6927fff640 1 -- 172.21.15.37:0/3602530536 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928032810 con 0x7f69300d4cc0 2024-05-10T08:43:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.451+0000 7f6937989640 1 -- 172.21.15.37:0/3602530536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69300d4cc0 msgr2=0x7f69300d5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.451+0000 7f6937989640 1 --2- 172.21.15.37:0/3602530536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69300d4cc0 0x7f69300d5130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6928009870 tx=0x7f692802a270 comp rx=0 tx=0).stop 2024-05-10T08:43:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.452+0000 7f6937989640 1 -- 172.21.15.37:0/3602530536 shutdown_connections 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.452+0000 7f6937989640 1 --2- 172.21.15.37:0/3602530536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69300d4cc0 0x7f69300d5130 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.452+0000 7f6937989640 1 --2- 172.21.15.37:0/3602530536 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d1970 0x7f69300d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.452+0000 7f6937989640 1 -- 172.21.15.37:0/3602530536 >> 172.21.15.37:0/3602530536 conn(0x7f693008eac0 msgr2=0x7f693009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.452+0000 7f6937989640 1 -- 172.21.15.37:0/3602530536 shutdown_connections 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.452+0000 7f6937989640 1 -- 172.21.15.37:0/3602530536 wait complete. 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.453+0000 7f6937989640 1 Processor -- start 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.453+0000 7f6937989640 1 -- start start 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6937989640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69300d1970 0x7f69300c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6937989640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d4cc0 0x7f69301e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6937989640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69301f8250 0x7f693006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6937989640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69300d2f60 con 0x7f69300d1970 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6937989640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69300d2c80 con 0x7f69301f8250 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6937989640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69300d3240 con 0x7f69300d4cc0 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69300d1970 0x7f69300c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69300d1970 0x7f69300c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49486/0 (socket says 172.21.15.37:49486) 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 -- 172.21.15.37:0/2372775698 learned_addr learned my addr 172.21.15.37:0/2372775698 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935f26640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69301f8250 0x7f693006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6934f24640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d4cc0 0x7f69301e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 -- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d4cc0 msgr2=0x7f69301e8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d4cc0 0x7f69301e8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 -- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69301f8250 msgr2=0x7f693006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69301f8250 0x7f693006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 -- 172.21.15.37:0/2372775698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69300ca180 con 0x7f69300d1970 2024-05-10T08:43:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6935725640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69300d1970 0x7f69300c9af0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c7b0 tx=0x7f692c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6925ffb640 1 -- 172.21.15.37:0/2372775698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c017070 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69300ca460 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6925ffb640 1 -- 172.21.15.37:0/2372775698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c00a640 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.454+0000 7f6925ffb640 1 -- 172.21.15.37:0/2372775698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c00aa70 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.455+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69300caa20 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.456+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69300693f0 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.456+0000 7f6925ffb640 1 -- 172.21.15.37:0/2372775698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f692c01a070 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.457+0000 7f6925ffb640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69140762d0 0x7f6914078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.457+0000 7f6925ffb640 1 -- 172.21.15.37:0/2372775698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f692c096ae0 con 0x7f69300d1970 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.457+0000 7f6934f24640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69140762d0 0x7f6914078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.457+0000 7f6934f24640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69140762d0 0x7f6914078790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f69300b6240 tx=0x7f6920008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.461+0000 7f6925ffb640 1 -- 172.21.15.37:0/2372775698 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f69301630b0 con 0x7f69300d1970 2024-05-10T08:43:55.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.730+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f69300b4c50 con 0x7f69300d1970 2024-05-10T08:43:55.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.731+0000 7f6925ffb640 1 -- 172.21.15.37:0/2372775698 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f692c060580 con 0x7f69300d1970 2024-05-10T08:43:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:55.730 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:43:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-10T08:43:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-10T08:43:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg==", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ==", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:43:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA==", 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw==", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw==", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw==", 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg==", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ==", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g==", 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA==", 2024-05-10T08:43:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w==", 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg==", 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A==", 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg==", 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw==", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA==", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:43:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA83T1mpCEPLBAAZlDinj6hQh8Ccd9D/MMUDw==", 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA==", 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A==", 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:43:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:43:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:43:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:43:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:43:55.743 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:43:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69140762d0 msgr2=0x7f6914078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69140762d0 0x7f6914078790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f69300b6240 tx=0x7f6920008040 comp rx=0 tx=0).stop 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69300d1970 msgr2=0x7f69300c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69300d1970 0x7f69300c9af0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c7b0 tx=0x7f692c00cc70 comp rx=0 tx=0).stop 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 shutdown_connections 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f69140762d0 0x7f6914078790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69301f8250 0x7f693006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69300d4cc0 0x7f69301e8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 --2- 172.21.15.37:0/2372775698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69300d1970 0x7f69300c9af0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 >> 172.21.15.37:0/2372775698 conn(0x7f693008eac0 msgr2=0x7f69300b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 shutdown_connections 2024-05-10T08:43:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.733+0000 7f6937989640 1 -- 172.21.15.37:0/2372775698 wait complete. 2024-05-10T08:43:55.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:43:55.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.850+0000 7f44d29c9640 1 Processor -- start 2024-05-10T08:43:55.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.850+0000 7f44d29c9640 1 -- start start 2024-05-10T08:43:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44d29c9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc15f420 0x7f44cc0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44d29c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44cc0d3ca0 0x7f44cc0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44d29c9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44cc0d1eb0 0x7f44cc0d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44d29c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f44cc0d22f0 con 0x7f44cc0d3ca0 2024-05-10T08:43:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44d29c9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f44cc1630b0 con 0x7f44cc0d1eb0 2024-05-10T08:43:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44d29c9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc0d2550 con 0x7f44cc15f420 2024-05-10T08:43:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44cb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44cc0d3ca0 0x7f44cc0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44cb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44cc0d3ca0 0x7f44cc0d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49496/0 (socket says 172.21.15.37:49496) 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.851+0000 7f44cb7fe640 1 -- 172.21.15.37:0/3674225582 learned_addr learned my addr 172.21.15.37:0/3674225582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cbfff640 1 --2- 172.21.15.37:0/3674225582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc15f420 0x7f44cc0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44d0f66640 1 --2- 172.21.15.37:0/3674225582 >> v2:172.21.15.82:3300/0 conn(0x7f44cc0d1eb0 0x7f44cc0d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cb7fe640 1 -- 172.21.15.37:0/3674225582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc15f420 msgr2=0x7f44cc0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cb7fe640 1 --2- 172.21.15.37:0/3674225582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc15f420 0x7f44cc0d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cb7fe640 1 -- 172.21.15.37:0/3674225582 >> v2:172.21.15.82:3300/0 conn(0x7f44cc0d1eb0 msgr2=0x7f44cc0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cb7fe640 1 --2- 172.21.15.37:0/3674225582 >> v2:172.21.15.82:3300/0 conn(0x7f44cc0d1eb0 0x7f44cc0d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cb7fe640 1 -- 172.21.15.37:0/3674225582 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc0d2c80 con 0x7f44cc0d3ca0 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44d0f66640 1 --2- 172.21.15.37:0/3674225582 >> v2:172.21.15.82:3300/0 conn(0x7f44cc0d1eb0 0x7f44cc0d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cbfff640 1 --2- 172.21.15.37:0/3674225582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc15f420 0x7f44cc0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.852+0000 7f44cb7fe640 1 --2- 172.21.15.37:0/3674225582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc0d3ca0 0x7f44cc0d1970 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0d17a0 tx=0x7f44c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84961ba123bdc1c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44caffd640 1 -- 172.21.15.37:0/3674225582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0037070 con 0x7f44cc0d3ca0 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44caffd640 1 -- 172.21.15.37:0/3674225582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c0032440 con 0x7f44cc0d3ca0 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44caffd640 1 -- 172.21.15.37:0/3674225582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0032810 con 0x7f44cc0d3ca0 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 -- 172.21.15.37:0/3674225582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc0d3ca0 msgr2=0x7f44cc0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 --2- 172.21.15.37:0/3674225582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc0d3ca0 0x7f44cc0d1970 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0d17a0 tx=0x7f44c002a1e0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 -- 172.21.15.37:0/3674225582 shutdown_connections 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 --2- 172.21.15.37:0/3674225582 >> v2:172.21.15.82:3300/0 conn(0x7f44cc0d1eb0 0x7f44cc0d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 --2- 172.21.15.37:0/3674225582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc0d3ca0 0x7f44cc0d1970 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 --2- 172.21.15.37:0/3674225582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc15f420 0x7f44cc0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 -- 172.21.15.37:0/3674225582 >> 172.21.15.37:0/3674225582 conn(0x7f44cc08eac0 msgr2=0x7f44cc09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 -- 172.21.15.37:0/3674225582 shutdown_connections 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.853+0000 7f44d29c9640 1 -- 172.21.15.37:0/3674225582 wait complete. 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.854+0000 7f44d29c9640 1 Processor -- start 2024-05-10T08:43:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44d29c9640 1 -- start start 2024-05-10T08:43:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44d29c9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc0d1eb0 0x7f44cc15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44d29c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc15a1b0 0x7f44cc0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44d29c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44cc0b8c10 0x7f44cc0b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44d29c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc0d2830 con 0x7f44cc15a1b0 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44d29c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc0d3240 con 0x7f44cc0b8c10 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44d29c9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc0d5200 con 0x7f44cc0d1eb0 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc15a1b0 0x7f44cc0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.855+0000 7f44cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc15a1b0 0x7f44cc0caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49504/0 (socket says 172.21.15.37:49504) 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cb7fe640 1 -- 172.21.15.37:0/1464416753 learned_addr learned my addr 172.21.15.37:0/1464416753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cbfff640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc0d1eb0 0x7f44cc15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44d0f66640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44cc0b8c10 0x7f44cc0b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cb7fe640 1 -- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc0d1eb0 msgr2=0x7f44cc15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cb7fe640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc0d1eb0 0x7f44cc15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cb7fe640 1 -- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44cc0b8c10 msgr2=0x7f44cc0b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cb7fe640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44cc0b8c10 0x7f44cc0b90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cb7fe640 1 -- 172.21.15.37:0/1464416753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc1f8450 con 0x7f44cc15a1b0 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44cb7fe640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc15a1b0 0x7f44cc0caf60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000c00 tx=0x7f44c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44c8ff9640 1 -- 172.21.15.37:0/1464416753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0037040 con 0x7f44cc15a1b0 2024-05-10T08:43:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44c8ff9640 1 -- 172.21.15.37:0/1464416753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c0042070 con 0x7f44cc15a1b0 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44cc1f86d0 con 0x7f44cc15a1b0 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44c8ff9640 1 -- 172.21.15.37:0/1464416753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0030bb0 con 0x7f44cc15a1b0 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.856+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44cc1f8c90 con 0x7f44cc15a1b0 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.857+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44cc0693f0 con 0x7f44cc15a1b0 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.858+0000 7f44c8ff9640 1 -- 172.21.15.37:0/1464416753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f44c0047460 con 0x7f44cc15a1b0 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.858+0000 7f44c8ff9640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f44b80762d0 0x7f44b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.859+0000 7f44c8ff9640 1 -- 172.21.15.37:0/1464416753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f44c00b7fa0 con 0x7f44cc15a1b0 2024-05-10T08:43:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.859+0000 7f44cbfff640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f44b80762d0 0x7f44b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.859+0000 7f44cbfff640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f44b80762d0 0x7f44b8078790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f44cc1ea010 tx=0x7f44bc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:55.863+0000 7f44c8ff9640 1 -- 172.21.15.37:0/1464416753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f44cc1f8450 con 0x7f44cc15a1b0 2024-05-10T08:43:56.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.055+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f44cc0b4c50 con 0x7f44cc15a1b0 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.055+0000 7f44c8ff9640 1 -- 172.21.15.37:0/1464416753 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f44c00813d0 con 0x7f44cc15a1b0 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:43:56.055 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:43:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.057+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f44b80762d0 msgr2=0x7f44b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f44b80762d0 0x7f44b8078790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f44cc1ea010 tx=0x7f44bc008040 comp rx=0 tx=0).stop 2024-05-10T08:43:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc15a1b0 msgr2=0x7f44cc0caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc15a1b0 0x7f44cc0caf60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000c00 tx=0x7f44c00046c0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 shutdown_connections 2024-05-10T08:43:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f44b80762d0 0x7f44b8078790 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44cc0b8c10 0x7f44cc0b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc15a1b0 0x7f44cc0caf60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 --2- 172.21.15.37:0/1464416753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f44cc0d1eb0 0x7f44cc15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 >> 172.21.15.37:0/1464416753 conn(0x7f44cc08eac0 msgr2=0x7f44cc0b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:56.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 shutdown_connections 2024-05-10T08:43:56.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.058+0000 7f44d29c9640 1 -- 172.21.15.37:0/1464416753 wait complete. 2024-05-10T08:43:56.070 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:43:56.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.179+0000 7f5211f22640 1 Processor -- start 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.179+0000 7f5211f22640 1 -- start start 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f5211f22640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c162b70 0x7f520c0d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f5211f22640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c162f50 con 0x7f520c0d3910 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f5211f22640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c0d3ee0 con 0x7f520c0d3480 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f5211f22640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f520c0d1f60 con 0x7f520c162b70 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f520b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c162b70 0x7f520c0d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f520bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f520c0d3910 0x7f520c0b5150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42864/0 (socket says 172.21.15.37:42864) 2024-05-10T08:43:56.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f520bfff640 1 -- 172.21.15.37:0/1149988762 learned_addr learned my addr 172.21.15.37:0/1149988762 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:56.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f520b7fe640 1 -- 172.21.15.37:0/1149988762 >> v1:172.21.15.82:6789/0 conn(0x7f520c0d3480 legacy=0x7f520c0b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:56.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f520a7fc640 1 -- 172.21.15.37:0/1149988762 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651870299 0 0) 0x7f5204001490 con 0x7f520c0d3910 2024-05-10T08:43:56.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f520b7fe640 1 -- 172.21.15.37:0/1149988762 >> v1:172.21.15.37:6789/0 conn(0x7f520c0d3910 legacy=0x7f520c0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:56.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.180+0000 7f520b7fe640 1 -- 172.21.15.37:0/1149988762 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520c0d21b0 con 0x7f520c162b70 2024-05-10T08:43:56.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.181+0000 7f520b7fe640 1 --2- 172.21.15.37:0/1149988762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c162b70 0x7f520c0d2f40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0097a0 tx=0x7f51fc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f7fb27dd34cf4c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:56.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.181+0000 7f520a7fc640 1 -- 172.21.15.37:0/1149988762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc037070 con 0x7f520c162b70 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.181+0000 7f520a7fc640 1 -- 172.21.15.37:0/1149988762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51fc032440 con 0x7f520c162b70 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.181+0000 7f520a7fc640 1 -- 172.21.15.37:0/1149988762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc032810 con 0x7f520c162b70 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.182+0000 7f5211f22640 1 -- 172.21.15.37:0/1149988762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c162b70 msgr2=0x7f520c0d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.182+0000 7f5211f22640 1 --2- 172.21.15.37:0/1149988762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c162b70 0x7f520c0d2f40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0097a0 tx=0x7f51fc02a230 comp rx=0 tx=0).stop 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.182+0000 7f5211f22640 1 -- 172.21.15.37:0/1149988762 shutdown_connections 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.182+0000 7f5211f22640 1 --2- 172.21.15.37:0/1149988762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c162b70 0x7f520c0d2f40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.182+0000 7f5211f22640 1 -- 172.21.15.37:0/1149988762 >> 172.21.15.37:0/1149988762 conn(0x7f520c0d5040 msgr2=0x7f520c0d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.182+0000 7f5211f22640 1 -- 172.21.15.37:0/1149988762 shutdown_connections 2024-05-10T08:43:56.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.182+0000 7f5211f22640 1 -- 172.21.15.37:0/1149988762 wait complete. 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.183+0000 7f5211f22640 1 Processor -- start 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.183+0000 7f5211f22640 1 -- start start 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f5211f22640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f520c0d3480 0x7f520c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f5211f22640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0d3910 0x7f520c160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f5211f22640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c162b70 0x7f520c0b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f5211f22640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f520c0b42f0 con 0x7f520c0d3910 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f5211f22640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f520c0b4170 con 0x7f520c162b70 2024-05-10T08:43:56.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f5211f22640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f520c0b5860 con 0x7f520c0d3480 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0d3910 0x7f520c160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0d3910 0x7f520c160be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49536/0 (socket says 172.21.15.37:49536) 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 -- 172.21.15.37:0/2595895838 learned_addr learned my addr 172.21.15.37:0/2595895838 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520bfff640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c162b70 0x7f520c0b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520b7fe640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f520c0d3480 0x7f520c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 -- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f520c0d3480 msgr2=0x7f520c0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f520c0d3480 0x7f520c0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 -- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c162b70 msgr2=0x7f520c0b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c162b70 0x7f520c0b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.184+0000 7f520affd640 1 -- 172.21.15.37:0/2595895838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520c0b85a0 con 0x7f520c0d3910 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.185+0000 7f520affd640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0d3910 0x7f520c160be0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f520000c450 tx=0x7f520000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.185+0000 7f51f3fff640 1 -- 172.21.15.37:0/2595895838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52000052d0 con 0x7f520c0d3910 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.185+0000 7f51f3fff640 1 -- 172.21.15.37:0/2595895838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5200005470 con 0x7f520c0d3910 2024-05-10T08:43:56.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.185+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520c0cabb0 con 0x7f520c0d3910 2024-05-10T08:43:56.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.185+0000 7f51f3fff640 1 -- 172.21.15.37:0/2595895838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200012870 con 0x7f520c0d3910 2024-05-10T08:43:56.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.185+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520c0cb170 con 0x7f520c0d3910 2024-05-10T08:43:56.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.186+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f520c0693f0 con 0x7f520c0d3910 2024-05-10T08:43:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.186+0000 7f51f3fff640 1 -- 172.21.15.37:0/2595895838 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5200012a10 con 0x7f520c0d3910 2024-05-10T08:43:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.187+0000 7f51f3fff640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51f80762d0 0x7f51f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.187+0000 7f51f3fff640 1 -- 172.21.15.37:0/2595895838 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f5200097050 con 0x7f520c0d3910 2024-05-10T08:43:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.187+0000 7f520b7fe640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51f80762d0 0x7f51f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.188+0000 7f520b7fe640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51f80762d0 0x7f51f8078790 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f51fc034000 tx=0x7f51fc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:56.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.191+0000 7f51f3fff640 1 -- 172.21.15.37:0/2595895838 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5200060b70 con 0x7f520c0d3910 2024-05-10T08:43:56.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:56.382+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f520c0b66f0 con 0x7f520c0d3910 2024-05-10T08:43:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.337+0000 7f51f3fff640 1 -- 172.21.15.37:0/2595895838 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f5200060470 con 0x7f520c0d3910 2024-05-10T08:43:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.341+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51f80762d0 msgr2=0x7f51f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.341+0000 7f5211f22640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51f80762d0 0x7f51f8078790 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f51fc034000 tx=0x7f51fc02e000 comp rx=0 tx=0).stop 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.341+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0d3910 msgr2=0x7f520c160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.341+0000 7f5211f22640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0d3910 0x7f520c160be0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f520000c450 tx=0x7f520000c910 comp rx=0 tx=0).stop 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 shutdown_connections 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f51f80762d0 0x7f51f8078790 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c162b70 0x7f520c0b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0d3910 0x7f520c160be0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 --2- 172.21.15.37:0/2595895838 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f520c0d3480 0x7f520c0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 >> 172.21.15.37:0/2595895838 conn(0x7f520c0d5040 msgr2=0x7f520c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 shutdown_connections 2024-05-10T08:43:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.342+0000 7f5211f22640 1 -- 172.21.15.37:0/2595895838 wait complete. 2024-05-10T08:43:57.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:43:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.475+0000 7f2f7adf0640 1 Processor -- start 2024-05-10T08:43:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.475+0000 7f2f7adf0640 1 -- start start 2024-05-10T08:43:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f7adf0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f740b6590 0x7f2f740d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f7adf0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f740d2bb0 0x7f2f74162d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f7adf0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f74163290 0x7f2f7415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f7adf0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2f740d3320 con 0x7f2f740d2bb0 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f7adf0640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2f740d3600 con 0x7f2f740b6590 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f7adf0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2f740d38e0 con 0x7f2f74163290 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f73fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f740d2bb0 0x7f2f74162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f73fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f740d2bb0 0x7f2f74162d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49538/0 (socket says 172.21.15.37:49538) 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f73fff640 1 -- 172.21.15.37:0/2449007146 learned_addr learned my addr 172.21.15.37:0/2449007146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.476+0000 7f2f7938d640 1 --2- 172.21.15.37:0/2449007146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f74163290 0x7f2f7415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f78b8c640 1 --2- 172.21.15.37:0/2449007146 >> v2:172.21.15.82:3300/0 conn(0x7f2f740b6590 0x7f2f740d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f73fff640 1 -- 172.21.15.37:0/2449007146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f74163290 msgr2=0x7f2f7415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f73fff640 1 --2- 172.21.15.37:0/2449007146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f74163290 0x7f2f7415ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f73fff640 1 -- 172.21.15.37:0/2449007146 >> v2:172.21.15.82:3300/0 conn(0x7f2f740b6590 msgr2=0x7f2f740d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f73fff640 1 --2- 172.21.15.37:0/2449007146 >> v2:172.21.15.82:3300/0 conn(0x7f2f740b6590 0x7f2f740d0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f73fff640 1 -- 172.21.15.37:0/2449007146 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f740d3bc0 con 0x7f2f740d2bb0 2024-05-10T08:43:57.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f7938d640 1 --2- 172.21.15.37:0/2449007146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f74163290 0x7f2f7415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:57.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f73fff640 1 --2- 172.21.15.37:0/2449007146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f740d2bb0 0x7f2f74162d50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2f740d4f40 tx=0x7f2f6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90711d69a31ca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:57.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.477+0000 7f2f737fe640 1 -- 172.21.15.37:0/2449007146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68037070 con 0x7f2f740d2bb0 2024-05-10T08:43:57.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f737fe640 1 -- 172.21.15.37:0/2449007146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f68032440 con 0x7f2f740d2bb0 2024-05-10T08:43:57.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f737fe640 1 -- 172.21.15.37:0/2449007146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68032810 con 0x7f2f740d2bb0 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 -- 172.21.15.37:0/2449007146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f740d2bb0 msgr2=0x7f2f74162d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/2449007146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f740d2bb0 0x7f2f74162d50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2f740d4f40 tx=0x7f2f6802a1e0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 -- 172.21.15.37:0/2449007146 shutdown_connections 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/2449007146 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f74163290 0x7f2f7415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/2449007146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f740d2bb0 0x7f2f74162d50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/2449007146 >> v2:172.21.15.82:3300/0 conn(0x7f2f740b6590 0x7f2f740d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 -- 172.21.15.37:0/2449007146 >> 172.21.15.37:0/2449007146 conn(0x7f2f740d4fe0 msgr2=0x7f2f740d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 -- 172.21.15.37:0/2449007146 shutdown_connections 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.478+0000 7f2f7adf0640 1 -- 172.21.15.37:0/2449007146 wait complete. 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.479+0000 7f2f7adf0640 1 Processor -- start 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.479+0000 7f2f7adf0640 1 -- start start 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7adf0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f740b6590 0x7f2f74153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7adf0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f740d2bb0 0x7f2f740c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7adf0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f74163290 0x7f2f7415f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7adf0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7415f170 con 0x7f2f74163290 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7adf0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f740d3010 con 0x7f2f740d2bb0 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7adf0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7415f2f0 con 0x7f2f740b6590 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7938d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f74163290 0x7f2f7415f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7938d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f74163290 0x7f2f7415f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49550/0 (socket says 172.21.15.37:49550) 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.480+0000 7f2f7938d640 1 -- 172.21.15.37:0/691557438 learned_addr learned my addr 172.21.15.37:0/691557438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f73fff640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f740d2bb0 0x7f2f740c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f78b8c640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f740b6590 0x7f2f74153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7938d640 1 -- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f740b6590 msgr2=0x7f2f74153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7938d640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f740b6590 0x7f2f74153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7938d640 1 -- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f740d2bb0 msgr2=0x7f2f740c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7938d640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f740d2bb0 0x7f2f740c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7938d640 1 -- 172.21.15.37:0/691557438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f740c8f70 con 0x7f2f74163290 2024-05-10T08:43:57.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7938d640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f74163290 0x7f2f7415f720 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00cd50 tx=0x7f2f6c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:57.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f717fa640 1 -- 172.21.15.37:0/691557438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00f680 con 0x7f2f74163290 2024-05-10T08:43:57.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f717fa640 1 -- 172.21.15.37:0/691557438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00f840 con 0x7f2f74163290 2024-05-10T08:43:57.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f717fa640 1 -- 172.21.15.37:0/691557438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00fc30 con 0x7f2f74163290 2024-05-10T08:43:57.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f740c9250 con 0x7f2f74163290 2024-05-10T08:43:57.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.481+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f741f4dd0 con 0x7f2f74163290 2024-05-10T08:43:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.482+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f740693f0 con 0x7f2f74163290 2024-05-10T08:43:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.483+0000 7f2f717fa640 1 -- 172.21.15.37:0/691557438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f6c0213f0 con 0x7f2f74163290 2024-05-10T08:43:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.484+0000 7f2f717fa640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f600762d0 0x7f2f60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.484+0000 7f2f717fa640 1 -- 172.21.15.37:0/691557438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5619+0+0 (secure 0 0 0) 0x7f2f6c098130 con 0x7f2f74163290 2024-05-10T08:43:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.484+0000 7f2f78b8c640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f600762d0 0x7f2f60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.484+0000 7f2f78b8c640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f600762d0 0x7f2f60078790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400aac0 tx=0x7f2f64008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:57.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.488+0000 7f2f717fa640 1 -- 172.21.15.37:0/691557438 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2f6c014030 con 0x7f2f74163290 2024-05-10T08:43:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:57.680+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2f740ba6e0 con 0x7f2f74163290 2024-05-10T08:43:58.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.342+0000 7f2f717fa640 1 -- 172.21.15.37:0/691557438 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f2f6c061520 con 0x7f2f74163290 2024-05-10T08:43:58.342 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:43:58.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f600762d0 msgr2=0x7f2f60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f600762d0 0x7f2f60078790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400aac0 tx=0x7f2f64008040 comp rx=0 tx=0).stop 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f74163290 msgr2=0x7f2f7415f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f74163290 0x7f2f7415f720 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00cd50 tx=0x7f2f6c00a650 comp rx=0 tx=0).stop 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 shutdown_connections 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2f600762d0 0x7f2f60078790 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f74163290 0x7f2f7415f720 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f740d2bb0 0x7f2f740c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 --2- 172.21.15.37:0/691557438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2f740b6590 0x7f2f74153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 >> 172.21.15.37:0/691557438 conn(0x7f2f740d4fe0 msgr2=0x7f2f7415e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 shutdown_connections 2024-05-10T08:43:58.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.346+0000 7f2f7adf0640 1 -- 172.21.15.37:0/691557438 wait complete. 2024-05-10T08:43:58.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:43:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.487+0000 7f4d29875640 1 Processor -- start 2024-05-10T08:43:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.487+0000 7f4d29875640 1 -- start start 2024-05-10T08:43:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d29875640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d24163460 0x7f4d240d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d29875640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d2415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d29875640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d240d3320 con 0x7f4d240b6590 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d29875640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4d240d3600 con 0x7f4d24163460 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d29875640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4d240d38e0 con 0x7f4d240d2bb0 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d227fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d24163460 0x7f4d240d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d22ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4d240b6590 0x7f4d24162d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56688/0 (socket says 172.21.15.37:56688) 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d227fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d24163460 0x7f4d240d0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59190/0 (socket says 172.21.15.37:59190) 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d22ffd640 1 -- 172.21.15.37:0/591569839 learned_addr learned my addr 172.21.15.37:0/591569839 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d237fe640 1 --2- 172.21.15.37:0/591569839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d2415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d227fc640 1 -- 172.21.15.37:0/591569839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 msgr2=0x7f4d2415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d227fc640 1 --2- 172.21.15.37:0/591569839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d2415ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d227fc640 1 -- 172.21.15.37:0/591569839 >> v1:172.21.15.37:6789/0 conn(0x7f4d240b6590 legacy=0x7f4d24162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d227fc640 1 -- 172.21.15.37:0/591569839 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d240d3bc0 con 0x7f4d24163460 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d21ffb640 1 -- 172.21.15.37:0/591569839 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708795306 0 0) 0x7f4d240d3320 con 0x7f4d240b6590 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.488+0000 7f4d237fe640 1 --2- 172.21.15.37:0/591569839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d2415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.489+0000 7f4d227fc640 1 --2- 172.21.15.37:0/591569839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d24163460 0x7f4d240d0bd0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0097a0 tx=0x7f4d0c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924a71cbe1c2aa92 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.489+0000 7f4d21ffb640 1 -- 172.21.15.37:0/591569839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c037070 con 0x7f4d24163460 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.489+0000 7f4d21ffb640 1 -- 172.21.15.37:0/591569839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c032440 con 0x7f4d24163460 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.489+0000 7f4d21ffb640 1 -- 172.21.15.37:0/591569839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c032810 con 0x7f4d24163460 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 -- 172.21.15.37:0/591569839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d24163460 msgr2=0x7f4d240d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 --2- 172.21.15.37:0/591569839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d24163460 0x7f4d240d0bd0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0097a0 tx=0x7f4d0c02a180 comp rx=0 tx=0).stop 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 -- 172.21.15.37:0/591569839 shutdown_connections 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 --2- 172.21.15.37:0/591569839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d2415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 --2- 172.21.15.37:0/591569839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d24163460 0x7f4d240d0bd0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 -- 172.21.15.37:0/591569839 >> 172.21.15.37:0/591569839 conn(0x7f4d240d4fe0 msgr2=0x7f4d240d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 -- 172.21.15.37:0/591569839 shutdown_connections 2024-05-10T08:43:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.490+0000 7f4d29875640 1 -- 172.21.15.37:0/591569839 wait complete. 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.491+0000 7f4d29875640 1 Processor -- start 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.491+0000 7f4d29875640 1 -- start start 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d29875640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d240b6590 0x7f4d240cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d29875640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d24154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d29875640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d24163460 0x7f4d240cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d29875640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2415f170 con 0x7f4d240b6590 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d29875640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d240d3040 con 0x7f4d24163460 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d29875640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2415f2f0 con 0x7f4d240d2bb0 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d240b6590 0x7f4d240cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d240b6590 0x7f4d240cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59198/0 (socket says 172.21.15.37:59198) 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 -- 172.21.15.37:0/4242546673 learned_addr learned my addr 172.21.15.37:0/4242546673 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d227fc640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d24154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 -- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 msgr2=0x7f4d24154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d24154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 -- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d24163460 msgr2=0x7f4d240cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d237fe640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d24163460 0x7f4d240cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d24163460 0x7f4d240cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d22ffd640 1 -- 172.21.15.37:0/4242546673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d241e9190 con 0x7f4d240b6590 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d227fc640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d24154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.492+0000 7f4d237fe640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d24163460 0x7f4d240cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.493+0000 7f4d22ffd640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d240b6590 0x7f4d240cb250 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c4d0 tx=0x7f4d1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.493+0000 7f4d1bfff640 1 -- 172.21.15.37:0/4242546673 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14018070 con 0x7f4d240b6590 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.493+0000 7f4d1bfff640 1 -- 172.21.15.37:0/4242546673 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d14007500 con 0x7f4d240b6590 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.493+0000 7f4d1bfff640 1 -- 172.21.15.37:0/4242546673 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14004a20 con 0x7f4d240b6590 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.493+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d241e9470 con 0x7f4d240b6590 2024-05-10T08:43:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.493+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d240ca430 con 0x7f4d240b6590 2024-05-10T08:43:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.494+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d240693f0 con 0x7f4d240b6590 2024-05-10T08:43:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.495+0000 7f4d1bfff640 1 -- 172.21.15.37:0/4242546673 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d1401b070 con 0x7f4d240b6590 2024-05-10T08:43:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.495+0000 7f4d1bfff640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d040762d0 0x7f4d04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.495+0000 7f4d1bfff640 1 -- 172.21.15.37:0/4242546673 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6001+0+0 (secure 0 0 0) 0x7f4d140969f0 con 0x7f4d240b6590 2024-05-10T08:43:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.495+0000 7f4d227fc640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d040762d0 0x7f4d04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.496+0000 7f4d227fc640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d040762d0 0x7f4d04078790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c034000 tx=0x7f4d0c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:58.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.500+0000 7f4d1bfff640 1 -- 172.21.15.37:0/4242546673 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4d140602b0 con 0x7f4d240b6590 2024-05-10T08:43:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:58.730+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4d240d2700 con 0x7f4d240b6590 2024-05-10T08:43:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.344+0000 7f4d1bfff640 1 -- 172.21.15.37:0/4242546673 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v41) ==== 174+0+0 (secure 0 0 0) 0x7f4d1405fbb0 con 0x7f4d240b6590 2024-05-10T08:43:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 11 and data pool 12 2024-05-10T08:43:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.350+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d040762d0 msgr2=0x7f4d04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.350+0000 7f4d29875640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d040762d0 0x7f4d04078790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c034000 tx=0x7f4d0c02e000 comp rx=0 tx=0).stop 2024-05-10T08:43:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.350+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d240b6590 msgr2=0x7f4d240cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.350+0000 7f4d29875640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d240b6590 0x7f4d240cb250 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c4d0 tx=0x7f4d1400c990 comp rx=0 tx=0).stop 2024-05-10T08:43:59.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.352+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 shutdown_connections 2024-05-10T08:43:59.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.352+0000 7f4d29875640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d040762d0 0x7f4d04078790 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.352+0000 7f4d29875640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d24163460 0x7f4d240cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.352+0000 7f4d29875640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d240d2bb0 0x7f4d24154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.352+0000 7f4d29875640 1 --2- 172.21.15.37:0/4242546673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d240b6590 0x7f4d240cb250 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.352+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 >> 172.21.15.37:0/4242546673 conn(0x7f4d240d4fe0 msgr2=0x7f4d2406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:59.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.356+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 shutdown_connections 2024-05-10T08:43:59.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.356+0000 7f4d29875640 1 -- 172.21.15.37:0/4242546673 wait complete. 2024-05-10T08:43:59.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:43:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.492+0000 7f9397ff7640 1 Processor -- start 2024-05-10T08:43:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.492+0000 7f9397ff7640 1 -- start start 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9397ff7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93901524f0 0x7f93900b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9397ff7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f939015bc80 0x7f939006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9397ff7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f939006e8d0 0x7f9390073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9397ff7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f93900b51a0 con 0x7f939006e8d0 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9397ff7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f93900b4590 con 0x7f939015bc80 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9397ff7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f93900b4870 con 0x7f93901524f0 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9396594640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f939006e8d0 0x7f9390073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9396594640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f939006e8d0 0x7f9390073700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59204/0 (socket says 172.21.15.37:59204) 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.493+0000 7f9396594640 1 -- 172.21.15.37:0/2739214867 learned_addr learned my addr 172.21.15.37:0/2739214867 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9395d93640 1 --2- 172.21.15.37:0/2739214867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93901524f0 0x7f93900b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9395592640 1 --2- 172.21.15.37:0/2739214867 >> v2:172.21.15.82:3300/0 conn(0x7f939015bc80 0x7f939006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9396594640 1 -- 172.21.15.37:0/2739214867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93901524f0 msgr2=0x7f93900b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9396594640 1 --2- 172.21.15.37:0/2739214867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93901524f0 0x7f93900b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9396594640 1 -- 172.21.15.37:0/2739214867 >> v2:172.21.15.82:3300/0 conn(0x7f939015bc80 msgr2=0x7f939006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9396594640 1 --2- 172.21.15.37:0/2739214867 >> v2:172.21.15.82:3300/0 conn(0x7f939015bc80 0x7f939006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9396594640 1 -- 172.21.15.37:0/2739214867 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93900b4b50 con 0x7f939006e8d0 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9395d93640 1 --2- 172.21.15.37:0/2739214867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93901524f0 0x7f93900b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9395592640 1 --2- 172.21.15.37:0/2739214867 >> v2:172.21.15.82:3300/0 conn(0x7f939015bc80 0x7f939006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.494+0000 7f9396594640 1 --2- 172.21.15.37:0/2739214867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390073700 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f93900d14e0 tx=0x7f938802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be2392b32a7e275 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9394d91640 1 -- 172.21.15.37:0/2739214867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388036070 con 0x7f939006e8d0 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9394d91640 1 -- 172.21.15.37:0/2739214867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9388031600 con 0x7f939006e8d0 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9394d91640 1 -- 172.21.15.37:0/2739214867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93880319d0 con 0x7f939006e8d0 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 -- 172.21.15.37:0/2739214867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 msgr2=0x7f9390073700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 --2- 172.21.15.37:0/2739214867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390073700 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f93900d14e0 tx=0x7f938802a6a0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 -- 172.21.15.37:0/2739214867 shutdown_connections 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 --2- 172.21.15.37:0/2739214867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390073700 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 --2- 172.21.15.37:0/2739214867 >> v2:172.21.15.82:3300/0 conn(0x7f939015bc80 0x7f939006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 --2- 172.21.15.37:0/2739214867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93901524f0 0x7f93900b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 -- 172.21.15.37:0/2739214867 >> 172.21.15.37:0/2739214867 conn(0x7f939006c3a0 msgr2=0x7f939006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 -- 172.21.15.37:0/2739214867 shutdown_connections 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.495+0000 7f9397ff7640 1 -- 172.21.15.37:0/2739214867 wait complete. 2024-05-10T08:43:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.496+0000 7f9397ff7640 1 Processor -- start 2024-05-10T08:43:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9397ff7640 1 -- start start 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9397ff7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9397ff7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93901524f0 0x7f93900ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9397ff7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f939015bc80 0x7f93900cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9397ff7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93900b5630 con 0x7f939006e8d0 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9397ff7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93901528d0 con 0x7f93901524f0 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9397ff7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f939009dcd0 con 0x7f939015bc80 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9395d93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9395d93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59214/0 (socket says 172.21.15.37:59214) 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9395d93640 1 -- 172.21.15.37:0/4024693867 learned_addr learned my addr 172.21.15.37:0/4024693867 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9395592640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93901524f0 0x7f93900ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.497+0000 7f9396594640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f939015bc80 0x7f93900cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9395d93640 1 -- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f939015bc80 msgr2=0x7f93900cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9395d93640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f939015bc80 0x7f93900cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9395d93640 1 -- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93901524f0 msgr2=0x7f93900ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9395d93640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93901524f0 0x7f93900ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9395d93640 1 -- 172.21.15.37:0/4024693867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939009dfb0 con 0x7f939006e8d0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9395d93640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390140890 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f938c00d620 tx=0x7f938c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f93867fc640 1 -- 172.21.15.37:0/4024693867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00b040 con 0x7f939006e8d0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f93867fc640 1 -- 172.21.15.37:0/4024693867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c004230 con 0x7f939006e8d0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f93867fc640 1 -- 172.21.15.37:0/4024693867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00b720 con 0x7f939006e8d0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939009e290 con 0x7f939006e8d0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.498+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9390140dd0 con 0x7f939006e8d0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.499+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93900693f0 con 0x7f939006e8d0 2024-05-10T08:43:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.500+0000 7f93867fc640 1 -- 172.21.15.37:0/4024693867 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f938c00b8c0 con 0x7f939006e8d0 2024-05-10T08:43:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.500+0000 7f93867fc640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93740762d0 0x7f9374078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.500+0000 7f93867fc640 1 -- 172.21.15.37:0/4024693867 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f938c0977b0 con 0x7f939006e8d0 2024-05-10T08:43:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.500+0000 7f9395592640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93740762d0 0x7f9374078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.501+0000 7f9395592640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93740762d0 0x7f9374078790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93901e7f10 tx=0x7f9380008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.505+0000 7f93867fc640 1 -- 172.21.15.37:0/4024693867 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f938c015070 con 0x7f939006e8d0 2024-05-10T08:43:59.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.695+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f939015ca20 con 0x7f939006e8d0 2024-05-10T08:43:59.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.696+0000 7f93867fc640 1 -- 172.21.15.37:0/4024693867 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16898 (secure 0 0 0) 0x7f938c0609c0 con 0x7f939006e8d0 2024-05-10T08:43:59.696 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:43:59.696 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:43:58.731956+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:43:56.387579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T08:43:57.685327+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93740762d0 msgr2=0x7f9374078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93740762d0 0x7f9374078790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93901e7f10 tx=0x7f9380008040 comp rx=0 tx=0).stop 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 msgr2=0x7f9390140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390140890 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f938c00d620 tx=0x7f938c00dae0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 shutdown_connections 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93740762d0 0x7f9374078790 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f939015bc80 0x7f93900cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93901524f0 0x7f93900ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 --2- 172.21.15.37:0/4024693867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f939006e8d0 0x7f9390140890 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 >> 172.21.15.37:0/4024693867 conn(0x7f939006c3a0 msgr2=0x7f9390072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 shutdown_connections 2024-05-10T08:43:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.698+0000 7f9397ff7640 1 -- 172.21.15.37:0/4024693867 wait complete. 2024-05-10T08:43:59.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:43:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.813+0000 7f6ce3ab0640 1 Processor -- start 2024-05-10T08:43:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.814+0000 7f6ce3ab0640 1 -- start start 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.814+0000 7f6ce3ab0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc15f420 0x7f6cdc0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.814+0000 7f6ce3ab0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6cdc0d3ca0 0x7f6cdc0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce3ab0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cdc1630b0 con 0x7f6cdc0d1eb0 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce3ab0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6cdc0d22f0 con 0x7f6cdc0d3ca0 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce3ab0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc0d2550 con 0x7f6cdc15f420 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce104b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6cdc0d3ca0 0x7f6cdc0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce204d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6cdc0d1eb0 0x7f6cdc0d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56692/0 (socket says 172.21.15.37:56692) 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce204d640 1 -- 172.21.15.37:0/2426735727 learned_addr learned my addr 172.21.15.37:0/2426735727 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce184c640 1 --2- 172.21.15.37:0/2426735727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc15f420 0x7f6cdc0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce104b640 1 -- 172.21.15.37:0/2426735727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc15f420 msgr2=0x7f6cdc0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce104b640 1 --2- 172.21.15.37:0/2426735727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc15f420 0x7f6cdc0d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce104b640 1 -- 172.21.15.37:0/2426735727 >> v1:172.21.15.37:6789/0 conn(0x7f6cdc0d1eb0 legacy=0x7f6cdc0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce084a640 1 -- 172.21.15.37:0/2426735727 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482727286 0 0) 0x7f6cd4001490 con 0x7f6cdc0d1eb0 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce104b640 1 -- 172.21.15.37:0/2426735727 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc0d2c80 con 0x7f6cdc0d3ca0 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.815+0000 7f6ce184c640 1 --2- 172.21.15.37:0/2426735727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc15f420 0x7f6cdc0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.816+0000 7f6ce104b640 1 --2- 172.21.15.37:0/2426735727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0d3ca0 0x7f6cdc0d1970 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097a0 tx=0x7f6ccc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2988c742ffbc082 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.816+0000 7f6ce084a640 1 -- 172.21.15.37:0/2426735727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc037070 con 0x7f6cdc0d3ca0 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.816+0000 7f6ce084a640 1 -- 172.21.15.37:0/2426735727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ccc032440 con 0x7f6cdc0d3ca0 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.816+0000 7f6ce084a640 1 -- 172.21.15.37:0/2426735727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc032810 con 0x7f6cdc0d3ca0 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.816+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/2426735727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0d3ca0 msgr2=0x7f6cdc0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.816+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/2426735727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0d3ca0 0x7f6cdc0d1970 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097a0 tx=0x7f6ccc02a180 comp rx=0 tx=0).stop 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.817+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/2426735727 shutdown_connections 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.817+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/2426735727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0d3ca0 0x7f6cdc0d1970 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.817+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/2426735727 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc15f420 0x7f6cdc0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.817+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/2426735727 >> 172.21.15.37:0/2426735727 conn(0x7f6cdc08eac0 msgr2=0x7f6cdc09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:43:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.817+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/2426735727 shutdown_connections 2024-05-10T08:43:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.817+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/2426735727 wait complete. 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.818+0000 7f6ce3ab0640 1 Processor -- start 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.818+0000 7f6ce3ab0640 1 -- start start 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc0d1eb0 0x7f6cdc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0b7e40 0x7f6cdc0b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1e8df0 0x7f6cdc1e9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc0d2830 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc0d3240 con 0x7f6cdc1e8df0 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc0d53d0 con 0x7f6cdc0d1eb0 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0b7e40 0x7f6cdc0b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0b7e40 0x7f6cdc0b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59238/0 (socket says 172.21.15.37:59238) 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 -- 172.21.15.37:0/796335363 learned_addr learned my addr 172.21.15.37:0/796335363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:43:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce184c640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc0d1eb0 0x7f6cdc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce204d640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1e8df0 0x7f6cdc1e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 -- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc0d1eb0 msgr2=0x7f6cdc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc0d1eb0 0x7f6cdc15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 -- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1e8df0 msgr2=0x7f6cdc1e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1e8df0 0x7f6cdc1e9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 -- 172.21.15.37:0/796335363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc15e400 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce104b640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0b7e40 0x7f6cdc0b82c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097a0 tx=0x7f6ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6cd27fc640 1 -- 172.21.15.37:0/796335363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc037050 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6cd27fc640 1 -- 172.21.15.37:0/796335363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ccc038040 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6cd27fc640 1 -- 172.21.15.37:0/796335363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004470 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc0b8800 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.819+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc0b9d20 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.820+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc0693f0 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.821+0000 7f6cd27fc640 1 -- 172.21.15.37:0/796335363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ccc030900 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.821+0000 7f6cd27fc640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6cc00762d0 0x7f6cc0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:43:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.822+0000 7f6cd27fc640 1 -- 172.21.15.37:0/796335363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f6ccc0b8070 con 0x7f6cdc0b7e40 2024-05-10T08:43:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.822+0000 7f6ce184c640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6cc00762d0 0x7f6cc0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:43:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.822+0000 7f6ce184c640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6cc00762d0 0x7f6cc0078790 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8006fd0 tx=0x7f6cd8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:43:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:43:59.826+0000 7f6cd27fc640 1 -- 172.21.15.37:0/796335363 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6ccc0818d0 con 0x7f6cdc0b7e40 2024-05-10T08:44:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.018+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cdc0684e0 con 0x7f6cdc0b7e40 2024-05-10T08:44:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.019+0000 7f6cd27fc640 1 -- 172.21.15.37:0/796335363 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16898 (secure 0 0 0) 0x7f6ccc0811d0 con 0x7f6cdc0b7e40 2024-05-10T08:44:00.019 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:00.019 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:43:58.731956+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:43:56.387579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T08:43:57.685327+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6cc00762d0 msgr2=0x7f6cc0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6cc00762d0 0x7f6cc0078790 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8006fd0 tx=0x7f6cd8008040 comp rx=0 tx=0).stop 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0b7e40 msgr2=0x7f6cdc0b82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0b7e40 0x7f6cdc0b82c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097a0 tx=0x7f6ccc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 shutdown_connections 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6cc00762d0 0x7f6cc0078790 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1e8df0 0x7f6cdc1e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cdc0b7e40 0x7f6cdc0b82c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 --2- 172.21.15.37:0/796335363 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6cdc0d1eb0 0x7f6cdc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 >> 172.21.15.37:0/796335363 conn(0x7f6cdc08eac0 msgr2=0x7f6cdc0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.021+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 shutdown_connections 2024-05-10T08:44:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.022+0000 7f6ce3ab0640 1 -- 172.21.15.37:0/796335363 wait complete. 2024-05-10T08:44:00.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:44:00.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.140+0000 7ff787a45640 1 Processor -- start 2024-05-10T08:44:00.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.140+0000 7ff787a45640 1 -- start start 2024-05-10T08:44:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff787a45640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7800b6590 0x7ff7800d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff787a45640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7800d2bb0 0x7ff780162d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff787a45640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7800d3320 con 0x7ff780163290 2024-05-10T08:44:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff787a45640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff7800d3600 con 0x7ff7800d2bb0 2024-05-10T08:44:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff787a45640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff7800d38e0 con 0x7ff7800b6590 2024-05-10T08:44:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff784fe0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7800d2bb0 0x7ff780162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff785fe2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff780163290 0x7ff78015ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56698/0 (socket says 172.21.15.37:56698) 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff785fe2640 1 -- 172.21.15.37:0/2179331092 learned_addr learned my addr 172.21.15.37:0/2179331092 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff7857e1640 1 --2- 172.21.15.37:0/2179331092 >> v2:172.21.15.82:3300/0 conn(0x7ff7800b6590 0x7ff7800d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff784fe0640 1 -- 172.21.15.37:0/2179331092 >> v2:172.21.15.82:3300/0 conn(0x7ff7800b6590 msgr2=0x7ff7800d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff784fe0640 1 --2- 172.21.15.37:0/2179331092 >> v2:172.21.15.82:3300/0 conn(0x7ff7800b6590 0x7ff7800d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff784fe0640 1 -- 172.21.15.37:0/2179331092 >> v1:172.21.15.37:6789/0 conn(0x7ff780163290 legacy=0x7ff78015ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff784fe0640 1 -- 172.21.15.37:0/2179331092 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7800d3bc0 con 0x7ff7800d2bb0 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff7857e1640 1 --2- 172.21.15.37:0/2179331092 >> v2:172.21.15.82:3300/0 conn(0x7ff7800b6590 0x7ff7800d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.141+0000 7ff777fff640 1 -- 172.21.15.37:0/2179331092 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223852613 0 0) 0x7ff7800d3320 con 0x7ff780163290 2024-05-10T08:44:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.142+0000 7ff784fe0640 1 --2- 172.21.15.37:0/2179331092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff780162d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff7800d4f40 tx=0x7ff77002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c276e6098e18b335 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.142+0000 7ff777fff640 1 -- 172.21.15.37:0/2179331092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770037070 con 0x7ff7800d2bb0 2024-05-10T08:44:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.142+0000 7ff777fff640 1 -- 172.21.15.37:0/2179331092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff770032440 con 0x7ff7800d2bb0 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.142+0000 7ff777fff640 1 -- 172.21.15.37:0/2179331092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770032810 con 0x7ff7800d2bb0 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 -- 172.21.15.37:0/2179331092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 msgr2=0x7ff780162d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 --2- 172.21.15.37:0/2179331092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff780162d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff7800d4f40 tx=0x7ff77002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 -- 172.21.15.37:0/2179331092 shutdown_connections 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 --2- 172.21.15.37:0/2179331092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff780162d50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 --2- 172.21.15.37:0/2179331092 >> v2:172.21.15.82:3300/0 conn(0x7ff7800b6590 0x7ff7800d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 -- 172.21.15.37:0/2179331092 >> 172.21.15.37:0/2179331092 conn(0x7ff7800d4fe0 msgr2=0x7ff7800d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 -- 172.21.15.37:0/2179331092 shutdown_connections 2024-05-10T08:44:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.143+0000 7ff787a45640 1 -- 172.21.15.37:0/2179331092 wait complete. 2024-05-10T08:44:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.144+0000 7ff787a45640 1 Processor -- start 2024-05-10T08:44:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.144+0000 7ff787a45640 1 -- start start 2024-05-10T08:44:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff787a45640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7800b6590 0x7ff78015f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff787a45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff7800d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff787a45640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780163290 0x7ff780156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff787a45640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff78015f340 con 0x7ff7800d2bb0 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff787a45640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7800d3010 con 0x7ff780163290 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff787a45640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff78015f4c0 con 0x7ff7800b6590 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff7800d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff7800d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59254/0 (socket says 172.21.15.37:59254) 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 -- 172.21.15.37:0/1301877103 learned_addr learned my addr 172.21.15.37:0/1301877103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff7857e1640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7800b6590 0x7ff78015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 -- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7800b6590 msgr2=0x7ff78015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff785fe2640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780163290 0x7ff780156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7800b6590 0x7ff78015f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 -- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780163290 msgr2=0x7ff780156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780163290 0x7ff780156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 -- 172.21.15.37:0/1301877103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7800ce830 con 0x7ff7800d2bb0 2024-05-10T08:44:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff784fe0640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff7800d0170 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff770000c00 tx=0x7ff7700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff775ffb640 1 -- 172.21.15.37:0/1301877103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770037040 con 0x7ff7800d2bb0 2024-05-10T08:44:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff775ffb640 1 -- 172.21.15.37:0/1301877103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff770042070 con 0x7ff7800d2bb0 2024-05-10T08:44:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff775ffb640 1 -- 172.21.15.37:0/1301877103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770030bd0 con 0x7ff7800d2bb0 2024-05-10T08:44:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.145+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7800ceb10 con 0x7ff7800d2bb0 2024-05-10T08:44:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.146+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff780161340 con 0x7ff7800d2bb0 2024-05-10T08:44:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.147+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7800cece0 con 0x7ff7800d2bb0 2024-05-10T08:44:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.147+0000 7ff775ffb640 1 -- 172.21.15.37:0/1301877103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff770047460 con 0x7ff7800d2bb0 2024-05-10T08:44:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.148+0000 7ff775ffb640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff7640762d0 0x7ff764078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.148+0000 7ff775ffb640 1 -- 172.21.15.37:0/1301877103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7ff7700b82c0 con 0x7ff7800d2bb0 2024-05-10T08:44:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.148+0000 7ff7857e1640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff7640762d0 0x7ff764078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.149+0000 7ff7857e1640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff7640762d0 0x7ff764078790 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff77c006fd0 tx=0x7ff77c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.152+0000 7ff775ffb640 1 -- 172.21.15.37:0/1301877103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff770032e20 con 0x7ff7800d2bb0 2024-05-10T08:44:00.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:00.382+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff7800cef00 con 0x7ff7800d2bb0 2024-05-10T08:44:01.321 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:44:01.322+0000 7f63bba6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:44:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.374+0000 7ff775ffb640 1 -- 172.21.15.37:0/1301877103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) ==== 118+0+0 (secure 0 0 0) 0x7ff7800cef00 con 0x7ff7800d2bb0 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff7640762d0 msgr2=0x7ff764078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff7640762d0 0x7ff764078790 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff77c006fd0 tx=0x7ff77c008040 comp rx=0 tx=0).stop 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 msgr2=0x7ff7800d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff7800d0170 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff770000c00 tx=0x7ff7700046c0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 shutdown_connections 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff7640762d0 0x7ff764078790 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780163290 0x7ff780156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800d2bb0 0x7ff7800d0170 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 --2- 172.21.15.37:0/1301877103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff7800b6590 0x7ff78015f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 >> 172.21.15.37:0/1301877103 conn(0x7ff7800d4fe0 msgr2=0x7ff7800b8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 shutdown_connections 2024-05-10T08:44:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.377+0000 7ff787a45640 1 -- 172.21.15.37:0/1301877103 wait complete. 2024-05-10T08:44:01.391 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T08:44:01.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:44:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.505+0000 7fba9dcbd640 1 Processor -- start 2024-05-10T08:44:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.506+0000 7fba9dcbd640 1 -- start start 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.506+0000 7fba9dcbd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba9815f4e0 0x7fba980cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.506+0000 7fba9dcbd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba980d3aa0 0x7fba980d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.506+0000 7fba9dcbd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba980d0320 con 0x7fba980d3f00 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.506+0000 7fba9dcbd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fba980d0600 con 0x7fba980d3aa0 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.506+0000 7fba9dcbd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fba980d08e0 con 0x7fba9815f4e0 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.506+0000 7fba96ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba980d3aa0 0x7fba980d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.507+0000 7fba96ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba980d3aa0 0x7fba980d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59268/0 (socket says 172.21.15.37:59268) 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.507+0000 7fba96ffd640 1 -- 172.21.15.37:0/3093283825 learned_addr learned my addr 172.21.15.37:0/3093283825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.507+0000 7fba977fe640 1 --2- 172.21.15.37:0/3093283825 >> v2:172.21.15.82:3300/0 conn(0x7fba9815f4e0 0x7fba980cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.507+0000 7fba96ffd640 1 -- 172.21.15.37:0/3093283825 >> v2:172.21.15.82:3300/0 conn(0x7fba9815f4e0 msgr2=0x7fba980cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:01.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.507+0000 7fba96ffd640 1 --2- 172.21.15.37:0/3093283825 >> v2:172.21.15.82:3300/0 conn(0x7fba9815f4e0 0x7fba980cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.507+0000 7fba96ffd640 1 -- 172.21.15.37:0/3093283825 >> v1:172.21.15.82:6789/0 conn(0x7fba980d3f00 legacy=0x7fba980b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:01.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.507+0000 7fba96ffd640 1 -- 172.21.15.37:0/3093283825 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980d0bc0 con 0x7fba980d3aa0 2024-05-10T08:44:01.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba96ffd640 1 --2- 172.21.15.37:0/3093283825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3aa0 0x7fba980d4fa0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fba980b6230 tx=0x7fba8c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb9717afcb0327a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:01.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba967fc640 1 -- 172.21.15.37:0/3093283825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c037070 con 0x7fba980d3aa0 2024-05-10T08:44:01.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba967fc640 1 -- 172.21.15.37:0/3093283825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c032440 con 0x7fba980d3aa0 2024-05-10T08:44:01.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba967fc640 1 -- 172.21.15.37:0/3093283825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c032810 con 0x7fba980d3aa0 2024-05-10T08:44:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 -- 172.21.15.37:0/3093283825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3aa0 msgr2=0x7fba980d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/3093283825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3aa0 0x7fba980d4fa0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fba980b6230 tx=0x7fba8c02a230 comp rx=0 tx=0).stop 2024-05-10T08:44:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 -- 172.21.15.37:0/3093283825 shutdown_connections 2024-05-10T08:44:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/3093283825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3aa0 0x7fba980d4fa0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/3093283825 >> v2:172.21.15.82:3300/0 conn(0x7fba9815f4e0 0x7fba980cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 -- 172.21.15.37:0/3093283825 >> 172.21.15.37:0/3093283825 conn(0x7fba9808eac0 msgr2=0x7fba9809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 -- 172.21.15.37:0/3093283825 shutdown_connections 2024-05-10T08:44:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.508+0000 7fba9dcbd640 1 -- 172.21.15.37:0/3093283825 wait complete. 2024-05-10T08:44:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.510+0000 7fba9dcbd640 1 Processor -- start 2024-05-10T08:44:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.510+0000 7fba9dcbd640 1 -- start start 2024-05-10T08:44:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.510+0000 7fba9dcbd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980d3aa0 0x7fba981565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba9dcbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3f00 0x7fba9806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba9dcbd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9815f4e0 0x7fba9806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba9dcbd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba980d23d0 con 0x7fba980d3f00 2024-05-10T08:44:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba9dcbd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba9815f8c0 con 0x7fba9815f4e0 2024-05-10T08:44:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba9dcbd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fba980d2550 con 0x7fba980d3aa0 2024-05-10T08:44:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3f00 0x7fba9806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3f00 0x7fba9806cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59280/0 (socket says 172.21.15.37:59280) 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 -- 172.21.15.37:0/4071049058 learned_addr learned my addr 172.21.15.37:0/4071049058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba977fe640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980d3aa0 0x7fba981565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba97fff640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9815f4e0 0x7fba9806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 -- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980d3aa0 msgr2=0x7fba981565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980d3aa0 0x7fba981565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 -- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9815f4e0 msgr2=0x7fba9806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9815f4e0 0x7fba9806d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 -- 172.21.15.37:0/4071049058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980b8820 con 0x7fba980d3f00 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba977fe640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980d3aa0 0x7fba981565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba96ffd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3f00 0x7fba9806cf80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fba8c000c00 tx=0x7fba8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba7ffff640 1 -- 172.21.15.37:0/4071049058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c041020 con 0x7fba980d3f00 2024-05-10T08:44:01.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba7ffff640 1 -- 172.21.15.37:0/4071049058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c030970 con 0x7fba980d3f00 2024-05-10T08:44:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.511+0000 7fba7ffff640 1 -- 172.21.15.37:0/4071049058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c037040 con 0x7fba980d3f00 2024-05-10T08:44:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.512+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba980b8e70 con 0x7fba980d3f00 2024-05-10T08:44:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.512+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba98156b00 con 0x7fba980d3f00 2024-05-10T08:44:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.512+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba980693f0 con 0x7fba980d3f00 2024-05-10T08:44:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.513+0000 7fba7ffff640 1 -- 172.21.15.37:0/4071049058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fba8c044020 con 0x7fba980d3f00 2024-05-10T08:44:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.514+0000 7fba7ffff640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba840762d0 0x7fba84078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.514+0000 7fba7ffff640 1 -- 172.21.15.37:0/4071049058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fba8c0b8120 con 0x7fba980d3f00 2024-05-10T08:44:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.514+0000 7fba977fe640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba840762d0 0x7fba84078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.514+0000 7fba977fe640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba840762d0 0x7fba84078790 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fba88006fd0 tx=0x7fba88008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.518+0000 7fba7ffff640 1 -- 172.21.15.37:0/4071049058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fba8c04b030 con 0x7fba980d3f00 2024-05-10T08:44:01.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:01.750+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fba980b3450 con 0x7fba980d3f00 2024-05-10T08:44:02.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.379+0000 7fba7ffff640 1 -- 172.21.15.37:0/4071049058 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7fba8c081980 con 0x7fba980d3f00 2024-05-10T08:44:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba840762d0 msgr2=0x7fba84078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba840762d0 0x7fba84078790 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fba88006fd0 tx=0x7fba88008040 comp rx=0 tx=0).stop 2024-05-10T08:44:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3f00 msgr2=0x7fba9806cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3f00 0x7fba9806cf80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fba8c000c00 tx=0x7fba8c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 shutdown_connections 2024-05-10T08:44:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba840762d0 0x7fba84078790 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9815f4e0 0x7fba9806d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba980d3f00 0x7fba9806cf80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 --2- 172.21.15.37:0/4071049058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba980d3aa0 0x7fba981565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 >> 172.21.15.37:0/4071049058 conn(0x7fba9808eac0 msgr2=0x7fba980d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 shutdown_connections 2024-05-10T08:44:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.382+0000 7fba9dcbd640 1 -- 172.21.15.37:0/4071049058 wait complete. 2024-05-10T08:44:02.394 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:44:02.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:44:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.506+0000 7f0f6b10a640 1 Processor -- start 2024-05-10T08:44:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.506+0000 7f0f6b10a640 1 -- start start 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.506+0000 7f0f6b10a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f640d1970 0x7f0f640d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f6b10a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f640d4cc0 0x7f0f640d50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f6b10a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f641630b0 con 0x7f0f6415f420 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f6b10a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0f640d3e70 con 0x7f0f640d4cc0 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f6b10a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0f640d2550 con 0x7f0f640d1970 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f696a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f640d4cc0 0x7f0f640d50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f696a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f640d4cc0 0x7f0f640d50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59284/0 (socket says 172.21.15.37:59284) 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f696a7640 1 -- 172.21.15.37:0/1154052519 learned_addr learned my addr 172.21.15.37:0/1154052519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f63fff640 1 --2- 172.21.15.37:0/1154052519 >> v2:172.21.15.82:3300/0 conn(0x7f0f640d1970 0x7f0f640d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f696a7640 1 -- 172.21.15.37:0/1154052519 >> v2:172.21.15.82:3300/0 conn(0x7f0f640d1970 msgr2=0x7f0f640d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f696a7640 1 --2- 172.21.15.37:0/1154052519 >> v2:172.21.15.82:3300/0 conn(0x7f0f640d1970 0x7f0f640d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f696a7640 1 -- 172.21.15.37:0/1154052519 >> v1:172.21.15.82:6789/0 conn(0x7f0f6415f420 legacy=0x7f0f640d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.507+0000 7f0f696a7640 1 -- 172.21.15.37:0/1154052519 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f640d2c80 con 0x7f0f640d4cc0 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.508+0000 7f0f696a7640 1 --2- 172.21.15.37:0/1154052519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640d50e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0f6408f380 tx=0x7f0f5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b7d59b6775b808 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.508+0000 7f0f637fe640 1 -- 172.21.15.37:0/1154052519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c037070 con 0x7f0f640d4cc0 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.508+0000 7f0f637fe640 1 -- 172.21.15.37:0/1154052519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c032440 con 0x7f0f640d4cc0 2024-05-10T08:44:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.508+0000 7f0f637fe640 1 -- 172.21.15.37:0/1154052519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c032810 con 0x7f0f640d4cc0 2024-05-10T08:44:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.508+0000 7f0f6b10a640 1 -- 172.21.15.37:0/1154052519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 msgr2=0x7f0f640d50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.508+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/1154052519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640d50e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0f6408f380 tx=0x7f0f5c02a270 comp rx=0 tx=0).stop 2024-05-10T08:44:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.509+0000 7f0f6b10a640 1 -- 172.21.15.37:0/1154052519 shutdown_connections 2024-05-10T08:44:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.509+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/1154052519 >> v2:172.21.15.82:3300/0 conn(0x7f0f640d1970 0x7f0f640d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.509+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/1154052519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640d50e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.509+0000 7f0f6b10a640 1 -- 172.21.15.37:0/1154052519 >> 172.21.15.37:0/1154052519 conn(0x7f0f6408eac0 msgr2=0x7f0f6409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.509+0000 7f0f6b10a640 1 -- 172.21.15.37:0/1154052519 shutdown_connections 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.509+0000 7f0f6b10a640 1 -- 172.21.15.37:0/1154052519 wait complete. 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.510+0000 7f0f6b10a640 1 Processor -- start 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.510+0000 7f0f6b10a640 1 -- start start 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f6b10a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f640d1970 0x7f0f64151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f6b10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f6b10a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640ce100 0x7f0f640b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f6b10a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640d2830 con 0x7f0f640d4cc0 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f6b10a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640d3240 con 0x7f0f640ce100 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f6b10a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f640d5620 con 0x7f0f640d1970 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59300/0 (socket says 172.21.15.37:59300) 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 -- 172.21.15.37:0/3588355192 learned_addr learned my addr 172.21.15.37:0/3588355192 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f68ea6640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f640d1970 0x7f0f64151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f696a7640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640ce100 0x7f0f640b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 -- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f640d1970 msgr2=0x7f0f64151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f640d1970 0x7f0f64151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 -- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640ce100 msgr2=0x7f0f640b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640ce100 0x7f0f640b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 -- 172.21.15.37:0/3588355192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f64152340 con 0x7f0f640d4cc0 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f63fff640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640b8610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0f54007ec0 tx=0x7f0f5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.511+0000 7f0f617fa640 1 -- 172.21.15.37:0/3588355192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54014620 con 0x7f0f640d4cc0 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.512+0000 7f0f617fa640 1 -- 172.21.15.37:0/3588355192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54019070 con 0x7f0f640d4cc0 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.512+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f640ceb10 con 0x7f0f640d4cc0 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.512+0000 7f0f617fa640 1 -- 172.21.15.37:0/3588355192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54014a20 con 0x7f0f640d4cc0 2024-05-10T08:44:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.512+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f640b7e10 con 0x7f0f640d4cc0 2024-05-10T08:44:02.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.513+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f640693f0 con 0x7f0f640d4cc0 2024-05-10T08:44:02.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.513+0000 7f0f617fa640 1 -- 172.21.15.37:0/3588355192 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f54014bc0 con 0x7f0f640d4cc0 2024-05-10T08:44:02.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.514+0000 7f0f617fa640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0f440762d0 0x7f0f44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.514+0000 7f0f617fa640 1 -- 172.21.15.37:0/3588355192 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f0f540981b0 con 0x7f0f640d4cc0 2024-05-10T08:44:02.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.514+0000 7f0f68ea6640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0f440762d0 0x7f0f44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.514+0000 7f0f68ea6640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0f440762d0 0x7f0f44078790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007fd0 tx=0x7f0f4c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:02.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.518+0000 7f0f617fa640 1 -- 172.21.15.37:0/3588355192 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0f540618e0 con 0x7f0f640d4cc0 2024-05-10T08:44:02.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.747+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f640b4c50 con 0x7f0f640d4cc0 2024-05-10T08:44:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.748+0000 7f0f617fa640 1 -- 172.21.15.37:0/3588355192 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5180 (secure 0 0 0) 0x7f0f540611e0 con 0x7f0f640d4cc0 2024-05-10T08:44:02.747 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:01.751876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6108},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6108":{"gid":6108,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3151779785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3151779785},{"type":"v1","addr":"172.21.15.37:6835","nonce":3151779785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6108,"qdb_cluster":[6108]},"id":5}]} 2024-05-10T08:44:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 45 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.749+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0f440762d0 msgr2=0x7f0f44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.749+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0f440762d0 0x7f0f44078790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007fd0 tx=0x7f0f4c009040 comp rx=0 tx=0).stop 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.749+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 msgr2=0x7f0f640b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.749+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640b8610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0f54007ec0 tx=0x7f0f5400e4b0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 shutdown_connections 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0f440762d0 0x7f0f44078790 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640ce100 0x7f0f640b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f640d4cc0 0x7f0f640b8610 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 --2- 172.21.15.37:0/3588355192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f640d1970 0x7f0f64151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 >> 172.21.15.37:0/3588355192 conn(0x7f0f6408eac0 msgr2=0x7f0f64163390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 shutdown_connections 2024-05-10T08:44:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.750+0000 7f0f6b10a640 1 -- 172.21.15.37:0/3588355192 wait complete. 2024-05-10T08:44:02.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:44:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.865+0000 7f65c1b32640 1 Processor -- start 2024-05-10T08:44:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.865+0000 7f65c1b32640 1 -- start start 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.865+0000 7f65c1b32640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65bc15f420 0x7f65bc0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.865+0000 7f65c1b32640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0d3ca0 0x7f65bc0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.865+0000 7f65c1b32640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65bc1630b0 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.865+0000 7f65c1b32640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f65bc0d22f0 con 0x7f65bc15f420 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.865+0000 7f65c1b32640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc0d2550 con 0x7f65bc0d3ca0 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65bc15f420 0x7f65bc0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65bbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65bc0d1eb0 0x7f65bc0d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56704/0 (socket says 172.21.15.37:56704) 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65bbfff640 1 -- 172.21.15.37:0/4034980373 learned_addr learned my addr 172.21.15.37:0/4034980373 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65baffd640 1 --2- 172.21.15.37:0/4034980373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0d3ca0 0x7f65bc0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65bb7fe640 1 -- 172.21.15.37:0/4034980373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0d3ca0 msgr2=0x7f65bc0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65bb7fe640 1 --2- 172.21.15.37:0/4034980373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0d3ca0 0x7f65bc0d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65bb7fe640 1 -- 172.21.15.37:0/4034980373 >> v1:172.21.15.37:6789/0 conn(0x7f65bc0d1eb0 legacy=0x7f65bc0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65bb7fe640 1 -- 172.21.15.37:0/4034980373 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc0d2c80 con 0x7f65bc15f420 2024-05-10T08:44:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65ba7fc640 1 -- 172.21.15.37:0/4034980373 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472733904 0 0) 0x7f65b4001490 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.866+0000 7f65baffd640 1 --2- 172.21.15.37:0/4034980373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0d3ca0 0x7f65bc0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65bb7fe640 1 --2- 172.21.15.37:0/4034980373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc15f420 0x7f65bc0d3760 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097a0 tx=0x7f65ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4bf2742107cbf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65ba7fc640 1 -- 172.21.15.37:0/4034980373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac037070 con 0x7f65bc15f420 2024-05-10T08:44:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65ba7fc640 1 -- 172.21.15.37:0/4034980373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac032440 con 0x7f65bc15f420 2024-05-10T08:44:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65ba7fc640 1 -- 172.21.15.37:0/4034980373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac032810 con 0x7f65bc15f420 2024-05-10T08:44:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 -- 172.21.15.37:0/4034980373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc15f420 msgr2=0x7f65bc0d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 --2- 172.21.15.37:0/4034980373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc15f420 0x7f65bc0d3760 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097a0 tx=0x7f65ac02a180 comp rx=0 tx=0).stop 2024-05-10T08:44:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 -- 172.21.15.37:0/4034980373 shutdown_connections 2024-05-10T08:44:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 --2- 172.21.15.37:0/4034980373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0d3ca0 0x7f65bc0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 --2- 172.21.15.37:0/4034980373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc15f420 0x7f65bc0d3760 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 -- 172.21.15.37:0/4034980373 >> 172.21.15.37:0/4034980373 conn(0x7f65bc08eac0 msgr2=0x7f65bc09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 -- 172.21.15.37:0/4034980373 shutdown_connections 2024-05-10T08:44:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.867+0000 7f65c1b32640 1 -- 172.21.15.37:0/4034980373 wait complete. 2024-05-10T08:44:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.869+0000 7f65c1b32640 1 Processor -- start 2024-05-10T08:44:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.869+0000 7f65c1b32640 1 -- start start 2024-05-10T08:44:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.869+0000 7f65c1b32640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0d1eb0 0x7f65bc0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65c1b32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc158a30 0x7f65bc0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65c1b32640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0b5bd0 0x7f65bc0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65c1b32640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0d2830 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65c1b32640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0d3240 con 0x7f65bc158a30 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65c1b32640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc0d53d0 con 0x7f65bc0b5bd0 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0d1eb0 0x7f65bc0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0d1eb0 0x7f65bc0ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59328/0 (socket says 172.21.15.37:59328) 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 -- 172.21.15.37:0/1301726113 learned_addr learned my addr 172.21.15.37:0/1301726113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bbfff640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0b5bd0 0x7f65bc0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65baffd640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc158a30 0x7f65bc0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 -- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0b5bd0 msgr2=0x7f65bc0b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0b5bd0 0x7f65bc0b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 -- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc158a30 msgr2=0x7f65bc0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc158a30 0x7f65bc0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 -- 172.21.15.37:0/1301726113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc0caa50 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65bb7fe640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0d1eb0 0x7f65bc0ca350 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f65ac035040 tx=0x7f65ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65a3fff640 1 -- 172.21.15.37:0/1301726113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac037040 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65a3fff640 1 -- 172.21.15.37:0/1301726113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac030770 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc0cad30 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65a3fff640 1 -- 172.21.15.37:0/1301726113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac030b80 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.870+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc0cb2f0 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.871+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65bc0b6590 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.872+0000 7f65a3fff640 1 -- 172.21.15.37:0/1301726113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f65ac044020 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.872+0000 7f65a3fff640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65a80762d0 0x7f65a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.873+0000 7f65a3fff640 1 -- 172.21.15.37:0/1301726113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f65ac0b7d90 con 0x7f65bc0d1eb0 2024-05-10T08:44:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.873+0000 7f65baffd640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65a80762d0 0x7f65a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.873+0000 7f65baffd640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65a80762d0 0x7f65a8078790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0ba9f0 tx=0x7f65b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:02.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:02.877+0000 7f65a3fff640 1 -- 172.21.15.37:0/1301726113 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f65ac032e20 con 0x7f65bc0d1eb0 2024-05-10T08:44:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.072+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65bc0693f0 con 0x7f65bc0d1eb0 2024-05-10T08:44:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.073+0000 7f65a3fff640 1 -- 172.21.15.37:0/1301726113 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16885 (secure 0 0 0) 0x7f65ac081550 con 0x7f65bc0d1eb0 2024-05-10T08:44:03.072 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:03.072 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":75,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:44:00.345445+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:43:56.387579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T08:43:57.685327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:44:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65a80762d0 msgr2=0x7f65a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65a80762d0 0x7f65a8078790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0ba9f0 tx=0x7f65b0008040 comp rx=0 tx=0).stop 2024-05-10T08:44:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0d1eb0 msgr2=0x7f65bc0ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0d1eb0 0x7f65bc0ca350 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f65ac035040 tx=0x7f65ac0046c0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 shutdown_connections 2024-05-10T08:44:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f65a80762d0 0x7f65a8078790 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f65bc0b5bd0 0x7f65bc0b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc158a30 0x7f65bc0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 --2- 172.21.15.37:0/1301726113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0d1eb0 0x7f65bc0ca350 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 >> 172.21.15.37:0/1301726113 conn(0x7f65bc08eac0 msgr2=0x7f65bc0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 shutdown_connections 2024-05-10T08:44:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.075+0000 7f65c1b32640 1 -- 172.21.15.37:0/1301726113 wait complete. 2024-05-10T08:44:03.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:44:03.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:44:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.190+0000 7f43f73c1640 1 Processor -- start 2024-05-10T08:44:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.190+0000 7f43f73c1640 1 -- start start 2024-05-10T08:44:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43f73c1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43f0070d20 0x7f43f00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43f73c1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f006e110 con 0x7f43f01629b0 2024-05-10T08:44:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43f73c1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f006e3f0 con 0x7f43f00b2490 2024-05-10T08:44:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43f73c1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f43f0070a40 con 0x7f43f0070d20 2024-05-10T08:44:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43f515d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43f01629b0 0x7f43f006eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56716/0 (socket says 172.21.15.37:56716) 2024-05-10T08:44:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43f515d640 1 -- 172.21.15.37:0/3290904464 learned_addr learned my addr 172.21.15.37:0/3290904464 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43f595e640 1 --2- 172.21.15.37:0/3290904464 >> v2:172.21.15.82:3300/0 conn(0x7f43f0070d20 0x7f43f00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987301202 0 0) 0x7f43f006e110 con 0x7f43f01629b0 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.191+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43d8003520 con 0x7f43f01629b0 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 699551215 0 0) 0x7f43d8003520 con 0x7f43f01629b0 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 >> v2:172.21.15.82:3300/0 conn(0x7f43f0070d20 msgr2=0x7f43f00711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 --2- 172.21.15.37:0/3290904464 >> v2:172.21.15.82:3300/0 conn(0x7f43f0070d20 0x7f43f00711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 >> v1:172.21.15.82:6789/0 conn(0x7f43f00b2490 legacy=0x7f43f0070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f006e6d0 con 0x7f43f01629b0 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f43e8001670 con 0x7f43f01629b0 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 >> v1:172.21.15.37:6789/0 conn(0x7f43f01629b0 legacy=0x7f43f006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43d80039b0 0x7f43d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d8004800 0x7f43d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d80051c0 0x7f43d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43f0070a40 con 0x7f43d8004800 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43d800c060 con 0x7f43d80051c0 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f43d800c260 con 0x7f43d80039b0 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f495c640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d8004800 0x7f43d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f515d640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43d80039b0 0x7f43d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f595e640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d80051c0 0x7f43d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f495c640 1 -- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43d80039b0 msgr2=0x7f43d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f495c640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43d80039b0 0x7f43d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f495c640 1 -- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d80051c0 msgr2=0x7f43d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f495c640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d80051c0 0x7f43d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f495c640 1 -- 172.21.15.37:0/3290904464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d8003520 con 0x7f43d8004800 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.192+0000 7f43f595e640 1 -- 172.21.15.37:0/3290904464 reap_dead start 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.193+0000 7f43f495c640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d8004800 0x7f43d8004c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f43e4001750 tx=0x7f43d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55979c2552bbf37 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.193+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4001370 con 0x7f43d8004800 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.193+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40052d0 con 0x7f43d8004800 2024-05-10T08:44:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.193+0000 7f43effff640 1 -- 172.21.15.37:0/3290904464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e402abc0 con 0x7f43d8004800 2024-05-10T08:44:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.194+0000 7f43f73c1640 1 -- 172.21.15.37:0/3290904464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d8004800 msgr2=0x7f43d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.194+0000 7f43f73c1640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d8004800 0x7f43d8004c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f43e4001750 tx=0x7f43d8005830 comp rx=0 tx=0).stop 2024-05-10T08:44:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.194+0000 7f43f73c1640 1 -- 172.21.15.37:0/3290904464 shutdown_connections 2024-05-10T08:44:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.194+0000 7f43f73c1640 1 --2- 172.21.15.37:0/3290904464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d8004800 0x7f43d8004c80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.194+0000 7f43f73c1640 1 -- 172.21.15.37:0/3290904464 >> 172.21.15.37:0/3290904464 conn(0x7f43f00b49d0 msgr2=0x7f43f00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.194+0000 7f43f73c1640 1 -- 172.21.15.37:0/3290904464 shutdown_connections 2024-05-10T08:44:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.194+0000 7f43f73c1640 1 -- 172.21.15.37:0/3290904464 wait complete. 2024-05-10T08:44:03.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.195+0000 7f43f73c1640 1 Processor -- start 2024-05-10T08:44:03.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.195+0000 7f43f73c1640 1 -- start start 2024-05-10T08:44:03.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f73c1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d8004800 0x7f43f00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f73c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f00b79d0 0x7f43f01f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f73c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43f00b5ac0 0x7f43f00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f73c1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00711d0 con 0x7f43f00b79d0 2024-05-10T08:44:03.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f73c1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43f006dec0 con 0x7f43d8004800 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f73c1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f43f0071350 con 0x7f43f00b5ac0 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f00b79d0 0x7f43f01f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f00b79d0 0x7f43f01f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59340/0 (socket says 172.21.15.37:59340) 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 -- 172.21.15.37:0/596441916 learned_addr learned my addr 172.21.15.37:0/596441916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f515d640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d8004800 0x7f43f00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 -- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43f00b5ac0 msgr2=0x7f43f00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43f00b5ac0 0x7f43f00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 -- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d8004800 msgr2=0x7f43f00b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d8004800 0x7f43f00b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 -- 172.21.15.37:0/596441916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f00b8270 con 0x7f43f00b79d0 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.196+0000 7f43f495c640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f00b79d0 0x7f43f01f7ba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f43e4001870 tx=0x7f43e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.197+0000 7f43edffb640 1 -- 172.21.15.37:0/596441916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e403f030 con 0x7f43f00b79d0 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.197+0000 7f43edffb640 1 -- 172.21.15.37:0/596441916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4005480 con 0x7f43f00b79d0 2024-05-10T08:44:03.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.197+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f00b8550 con 0x7f43f00b79d0 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.197+0000 7f43edffb640 1 -- 172.21.15.37:0/596441916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4037040 con 0x7f43f00b79d0 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.197+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f01f80e0 con 0x7f43f00b79d0 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.198+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f00b8a70 con 0x7f43f00b79d0 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.198+0000 7f43edffb640 1 -- 172.21.15.37:0/596441916 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43e4042070 con 0x7f43f00b79d0 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.199+0000 7f43edffb640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f43dc076300 0x7f43dc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.199+0000 7f43edffb640 1 -- 172.21.15.37:0/596441916 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f43e4007640 con 0x7f43f00b79d0 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.199+0000 7f43f515d640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f43dc076300 0x7f43dc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.200+0000 7f43f515d640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f43dc076300 0x7f43dc0787c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f43f015c150 tx=0x7f43e8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.203+0000 7f43edffb640 1 -- 172.21.15.37:0/596441916 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f43f00b8a70 con 0x7f43f00b79d0 2024-05-10T08:44:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.389+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43f00693f0 con 0x7f43dc076300 2024-05-10T08:44:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.396+0000 7f43edffb640 1 -- 172.21.15.37:0/596441916 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252009 (secure 0 0 0) 0x7f43f00693f0 con 0x7f43dc076300 2024-05-10T08:44:03.398 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f43dc076300 msgr2=0x7f43dc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f43dc076300 0x7f43dc0787c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f43f015c150 tx=0x7f43e8009040 comp rx=0 tx=0).stop 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f00b79d0 msgr2=0x7f43f01f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f00b79d0 0x7f43f01f7ba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f43e4001870 tx=0x7f43e4001120 comp rx=0 tx=0).stop 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 shutdown_connections 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f43dc076300 0x7f43dc0787c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f43f00b5ac0 0x7f43f00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f00b79d0 0x7f43f01f7ba0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 --2- 172.21.15.37:0/596441916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43d8004800 0x7f43f00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 >> 172.21.15.37:0/596441916 conn(0x7f43f00b49d0 msgr2=0x7f43f00d2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 shutdown_connections 2024-05-10T08:44:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.399+0000 7f43f73c1640 1 -- 172.21.15.37:0/596441916 wait complete. 2024-05-10T08:44:03.409 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-05-10T08:44:03.379650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224472,"kb_used_data":8296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754750248,"statfs":{"total":773094113280,"available":772864253952,"internally_reserved":0,"allocated":8495104,"data_stored":4465188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001174"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.353005+0000","last_change":"2024-05-10T08:43:59.353407+0000","last_active":"2024-05-10T08:44:00.353005+0000","last_peered":"2024-05-10T08:44:00.353005+0000","last_clean":"2024-05-10T08:44:00.353005+0000","last_became_active":"2024-05-10T08:43:59.353084+0000","last_became_peered":"2024-05-10T08:43:59.353084+0000","last_unstale":"2024-05-10T08:44:00.353005+0000","last_undegraded":"2024-05-10T08:44:00.353005+0000","last_fullsized":"2024-05-10T08:44:00.353005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:46.276783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.383484+0000","last_change":"2024-05-10T08:43:59.379152+0000","last_active":"2024-05-10T08:43:59.383484+0000","last_peered":"2024-05-10T08:43:59.383484+0000","last_clean":"2024-05-10T08:43:59.383484+0000","last_became_active":"2024-05-10T08:43:59.375908+0000","last_became_peered":"2024-05-10T08:43:59.375908+0000","last_unstale":"2024-05-10T08:43:59.383484+0000","last_undegraded":"2024-05-10T08:43:59.383484+0000","last_fullsized":"2024-05-10T08:43:59.383484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:46.276783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348797+0000","last_change":"2024-05-10T08:43:59.382548+0000","last_active":"2024-05-10T08:44:00.348797+0000","last_peered":"2024-05-10T08:44:00.348797+0000","last_clean":"2024-05-10T08:44:00.348797+0000","last_became_active":"2024-05-10T08:43:59.382272+0000","last_became_peered":"2024-05-10T08:43:59.382272+0000","last_unstale":"2024-05-10T08:44:00.348797+0000","last_undegraded":"2024-05-10T08:44:00.348797+0000","last_fullsized":"2024-05-10T08:44:00.348797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:18:34.029079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352314+0000","last_change":"2024-05-10T08:43:59.364863+0000","last_active":"2024-05-10T08:44:00.352314+0000","last_peered":"2024-05-10T08:44:00.352314+0000","last_clean":"2024-05-10T08:44:00.352314+0000","last_became_active":"2024-05-10T08:43:59.364548+0000","last_became_peered":"2024-05-10T08:43:59.364548+0000","last_unstale":"2024-05-10T08:44:00.352314+0000","last_undegraded":"2024-05-10T08:44:00.352314+0000","last_fullsized":"2024-05-10T08:44:00.352314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:26.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.359141+0000","last_change":"2024-05-10T08:43:59.354467+0000","last_active":"2024-05-10T08:43:59.359141+0000","last_peered":"2024-05-10T08:43:59.359141+0000","last_clean":"2024-05-10T08:43:59.359141+0000","last_became_active":"2024-05-10T08:43:59.354188+0000","last_became_peered":"2024-05-10T08:43:59.354188+0000","last_unstale":"2024-05-10T08:43:59.359141+0000","last_undegraded":"2024-05-10T08:43:59.359141+0000","last_fullsized":"2024-05-10T08:43:59.359141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:05.814331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.368862+0000","last_change":"2024-05-10T08:43:59.365646+0000","last_active":"2024-05-10T08:43:59.368862+0000","last_peered":"2024-05-10T08:43:59.368862+0000","last_clean":"2024-05-10T08:43:59.368862+0000","last_became_active":"2024-05-10T08:43:59.365210+0000","last_became_peered":"2024-05-10T08:43:59.365210+0000","last_unstale":"2024-05-10T08:43:59.368862+0000","last_undegraded":"2024-05-10T08:43:59.368862+0000","last_fullsized":"2024-05-10T08:43:59.368862+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:15.028250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369479+0000","last_change":"2024-05-10T08:43:59.366845+0000","last_active":"2024-05-10T08:43:59.369479+0000","last_peered":"2024-05-10T08:43:59.369479+0000","last_clean":"2024-05-10T08:43:59.369479+0000","last_became_active":"2024-05-10T08:43:59.366552+0000","last_became_peered":"2024-05-10T08:43:59.366552+0000","last_unstale":"2024-05-10T08:43:59.369479+0000","last_undegraded":"2024-05-10T08:43:59.369479+0000","last_fullsized":"2024-05-10T08:43:59.369479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:37.239791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.360660+0000","last_change":"2024-05-10T08:43:59.355899+0000","last_active":"2024-05-10T08:43:59.360660+0000","last_peered":"2024-05-10T08:43:59.360660+0000","last_clean":"2024-05-10T08:43:59.360660+0000","last_became_active":"2024-05-10T08:43:59.355629+0000","last_became_peered":"2024-05-10T08:43:59.355629+0000","last_unstale":"2024-05-10T08:43:59.360660+0000","last_undegraded":"2024-05-10T08:43:59.360660+0000","last_fullsized":"2024-05-10T08:43:59.360660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:19:24.030067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.362781+0000","last_change":"2024-05-10T08:43:59.359923+0000","last_active":"2024-05-10T08:43:59.362781+0000","last_peered":"2024-05-10T08:43:59.362781+0000","last_clean":"2024-05-10T08:43:59.362781+0000","last_became_active":"2024-05-10T08:43:59.359635+0000","last_became_peered":"2024-05-10T08:43:59.359635+0000","last_unstale":"2024-05-10T08:43:59.362781+0000","last_undegraded":"2024-05-10T08:43:59.362781+0000","last_fullsized":"2024-05-10T08:43:59.362781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:49.355369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352207+0000","last_change":"2024-05-10T08:43:59.366801+0000","last_active":"2024-05-10T08:44:00.352207+0000","last_peered":"2024-05-10T08:44:00.352207+0000","last_clean":"2024-05-10T08:44:00.352207+0000","last_became_active":"2024-05-10T08:43:59.366500+0000","last_became_peered":"2024-05-10T08:43:59.366500+0000","last_unstale":"2024-05-10T08:44:00.352207+0000","last_undegraded":"2024-05-10T08:44:00.352207+0000","last_fullsized":"2024-05-10T08:44:00.352207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:44.778466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381814+0000","last_change":"2024-05-10T08:43:59.375603+0000","last_active":"2024-05-10T08:43:59.381814+0000","last_peered":"2024-05-10T08:43:59.381814+0000","last_clean":"2024-05-10T08:43:59.381814+0000","last_became_active":"2024-05-10T08:43:59.375249+0000","last_became_peered":"2024-05-10T08:43:59.375249+0000","last_unstale":"2024-05-10T08:43:59.381814+0000","last_undegraded":"2024-05-10T08:43:59.381814+0000","last_fullsized":"2024-05-10T08:43:59.381814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:18.779977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352356+0000","last_change":"2024-05-10T08:43:59.382525+0000","last_active":"2024-05-10T08:44:00.352356+0000","last_peered":"2024-05-10T08:44:00.352356+0000","last_clean":"2024-05-10T08:44:00.352356+0000","last_became_active":"2024-05-10T08:43:59.382222+0000","last_became_peered":"2024-05-10T08:43:59.382222+0000","last_unstale":"2024-05-10T08:44:00.352356+0000","last_undegraded":"2024-05-10T08:44:00.352356+0000","last_fullsized":"2024-05-10T08:44:00.352356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:57.239831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.376847+0000","last_change":"2024-05-10T08:43:59.366422+0000","last_active":"2024-05-10T08:43:59.376847+0000","last_peered":"2024-05-10T08:43:59.376847+0000","last_clean":"2024-05-10T08:43:59.376847+0000","last_became_active":"2024-05-10T08:43:59.366144+0000","last_became_peered":"2024-05-10T08:43:59.366144+0000","last_unstale":"2024-05-10T08:43:59.376847+0000","last_undegraded":"2024-05-10T08:43:59.376847+0000","last_fullsized":"2024-05-10T08:43:59.376847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:36.150043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.368843+0000","last_change":"2024-05-10T08:43:59.362957+0000","last_active":"2024-05-10T08:43:59.368843+0000","last_peered":"2024-05-10T08:43:59.368843+0000","last_clean":"2024-05-10T08:43:59.368843+0000","last_became_active":"2024-05-10T08:43:59.362238+0000","last_became_peered":"2024-05-10T08:43:59.362238+0000","last_unstale":"2024-05-10T08:43:59.368843+0000","last_undegraded":"2024-05-10T08:43:59.368843+0000","last_fullsized":"2024-05-10T08:43:59.368843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:04:39.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.383492+0000","last_change":"2024-05-10T08:43:59.379102+0000","last_active":"2024-05-10T08:43:59.383492+0000","last_peered":"2024-05-10T08:43:59.383492+0000","last_clean":"2024-05-10T08:43:59.383492+0000","last_became_active":"2024-05-10T08:43:59.376073+0000","last_became_peered":"2024-05-10T08:43:59.376073+0000","last_unstale":"2024-05-10T08:43:59.383492+0000","last_undegraded":"2024-05-10T08:43:59.383492+0000","last_fullsized":"2024-05-10T08:43:59.383492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:11.017449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352569+0000","last_change":"2024-05-10T08:43:59.358503+0000","last_active":"2024-05-10T08:44:00.352569+0000","last_peered":"2024-05-10T08:44:00.352569+0000","last_clean":"2024-05-10T08:44:00.352569+0000","last_became_active":"2024-05-10T08:43:59.358235+0000","last_became_peered":"2024-05-10T08:43:59.358235+0000","last_unstale":"2024-05-10T08:44:00.352569+0000","last_undegraded":"2024-05-10T08:44:00.352569+0000","last_fullsized":"2024-05-10T08:44:00.352569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:18.779977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377076+0000","last_change":"2024-05-10T08:43:59.368050+0000","last_active":"2024-05-10T08:43:59.377076+0000","last_peered":"2024-05-10T08:43:59.377076+0000","last_clean":"2024-05-10T08:43:59.377076+0000","last_became_active":"2024-05-10T08:43:59.367689+0000","last_became_peered":"2024-05-10T08:43:59.367689+0000","last_unstale":"2024-05-10T08:43:59.377076+0000","last_undegraded":"2024-05-10T08:43:59.377076+0000","last_fullsized":"2024-05-10T08:43:59.377076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:14.313781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348917+0000","last_change":"2024-05-10T08:43:59.364165+0000","last_active":"2024-05-10T08:44:00.348917+0000","last_peered":"2024-05-10T08:44:00.348917+0000","last_clean":"2024-05-10T08:44:00.348917+0000","last_became_active":"2024-05-10T08:43:59.361867+0000","last_became_peered":"2024-05-10T08:43:59.361867+0000","last_unstale":"2024-05-10T08:44:00.348917+0000","last_undegraded":"2024-05-10T08:44:00.348917+0000","last_fullsized":"2024-05-10T08:44:00.348917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:57.627816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381699+0000","last_change":"2024-05-10T08:43:59.377968+0000","last_active":"2024-05-10T08:43:59.381699+0000","last_peered":"2024-05-10T08:43:59.381699+0000","last_clean":"2024-05-10T08:43:59.381699+0000","last_became_active":"2024-05-10T08:43:59.377689+0000","last_became_peered":"2024-05-10T08:43:59.377689+0000","last_unstale":"2024-05-10T08:43:59.381699+0000","last_undegraded":"2024-05-10T08:43:59.381699+0000","last_fullsized":"2024-05-10T08:43:59.381699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:35:23.612623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366454+0000","last_change":"2024-05-10T08:43:59.361044+0000","last_active":"2024-05-10T08:43:59.366454+0000","last_peered":"2024-05-10T08:43:59.366454+0000","last_clean":"2024-05-10T08:43:59.366454+0000","last_became_active":"2024-05-10T08:43:59.360721+0000","last_became_peered":"2024-05-10T08:43:59.360721+0000","last_unstale":"2024-05-10T08:43:59.366454+0000","last_undegraded":"2024-05-10T08:43:59.366454+0000","last_fullsized":"2024-05-10T08:43:59.366454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:16.154004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.367029+0000","last_change":"2024-05-10T08:43:59.360667+0000","last_active":"2024-05-10T08:43:59.367029+0000","last_peered":"2024-05-10T08:43:59.367029+0000","last_clean":"2024-05-10T08:43:59.367029+0000","last_became_active":"2024-05-10T08:43:59.360398+0000","last_became_peered":"2024-05-10T08:43:59.360398+0000","last_unstale":"2024-05-10T08:43:59.367029+0000","last_undegraded":"2024-05-10T08:43:59.367029+0000","last_fullsized":"2024-05-10T08:43:59.367029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:39:09.825961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377382+0000","last_change":"2024-05-10T08:43:59.370516+0000","last_active":"2024-05-10T08:43:59.377382+0000","last_peered":"2024-05-10T08:43:59.377382+0000","last_clean":"2024-05-10T08:43:59.377382+0000","last_became_active":"2024-05-10T08:43:59.370234+0000","last_became_peered":"2024-05-10T08:43:59.370234+0000","last_unstale":"2024-05-10T08:43:59.377382+0000","last_undegraded":"2024-05-10T08:43:59.377382+0000","last_fullsized":"2024-05-10T08:43:59.377382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:26.672697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.362662+0000","last_change":"2024-05-10T08:43:59.359625+0000","last_active":"2024-05-10T08:43:59.362662+0000","last_peered":"2024-05-10T08:43:59.362662+0000","last_clean":"2024-05-10T08:43:59.362662+0000","last_became_active":"2024-05-10T08:43:59.359344+0000","last_became_peered":"2024-05-10T08:43:59.359344+0000","last_unstale":"2024-05-10T08:43:59.362662+0000","last_undegraded":"2024-05-10T08:43:59.362662+0000","last_fullsized":"2024-05-10T08:43:59.362662+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:46.689503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.382782+0000","last_change":"2024-05-10T08:43:59.372561+0000","last_active":"2024-05-10T08:43:59.382782+0000","last_peered":"2024-05-10T08:43:59.382782+0000","last_clean":"2024-05-10T08:43:59.382782+0000","last_became_active":"2024-05-10T08:43:59.372272+0000","last_became_peered":"2024-05-10T08:43:59.372272+0000","last_unstale":"2024-05-10T08:43:59.382782+0000","last_undegraded":"2024-05-10T08:43:59.382782+0000","last_fullsized":"2024-05-10T08:43:59.382782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:02.563642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381317+0000","last_change":"2024-05-10T08:43:59.371265+0000","last_active":"2024-05-10T08:43:59.381317+0000","last_peered":"2024-05-10T08:43:59.381317+0000","last_clean":"2024-05-10T08:43:59.381317+0000","last_became_active":"2024-05-10T08:43:59.370939+0000","last_became_peered":"2024-05-10T08:43:59.370939+0000","last_unstale":"2024-05-10T08:43:59.381317+0000","last_undegraded":"2024-05-10T08:43:59.381317+0000","last_fullsized":"2024-05-10T08:43:59.381317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:57.239831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352358+0000","last_change":"2024-05-10T08:43:59.382841+0000","last_active":"2024-05-10T08:44:00.352358+0000","last_peered":"2024-05-10T08:44:00.352358+0000","last_clean":"2024-05-10T08:44:00.352358+0000","last_became_active":"2024-05-10T08:43:59.382581+0000","last_became_peered":"2024-05-10T08:43:59.382581+0000","last_unstale":"2024-05-10T08:44:00.352358+0000","last_undegraded":"2024-05-10T08:44:00.352358+0000","last_fullsized":"2024-05-10T08:44:00.352358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:56.265888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352797+0000","last_change":"2024-05-10T08:43:59.360925+0000","last_active":"2024-05-10T08:44:00.352797+0000","last_peered":"2024-05-10T08:44:00.352797+0000","last_clean":"2024-05-10T08:44:00.352797+0000","last_became_active":"2024-05-10T08:43:59.360424+0000","last_became_peered":"2024-05-10T08:43:59.360424+0000","last_unstale":"2024-05-10T08:44:00.352797+0000","last_undegraded":"2024-05-10T08:44:00.352797+0000","last_fullsized":"2024-05-10T08:44:00.352797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:55.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.375079+0000","last_change":"2024-05-10T08:43:59.363278+0000","last_active":"2024-05-10T08:43:59.375079+0000","last_peered":"2024-05-10T08:43:59.375079+0000","last_clean":"2024-05-10T08:43:59.375079+0000","last_became_active":"2024-05-10T08:43:59.362970+0000","last_became_peered":"2024-05-10T08:43:59.362970+0000","last_unstale":"2024-05-10T08:43:59.375079+0000","last_undegraded":"2024-05-10T08:43:59.375079+0000","last_fullsized":"2024-05-10T08:43:59.375079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:16.815644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380892+0000","last_change":"2024-05-10T08:43:59.363329+0000","last_active":"2024-05-10T08:43:59.380892+0000","last_peered":"2024-05-10T08:43:59.380892+0000","last_clean":"2024-05-10T08:43:59.380892+0000","last_became_active":"2024-05-10T08:43:59.362962+0000","last_became_peered":"2024-05-10T08:43:59.362962+0000","last_unstale":"2024-05-10T08:43:59.380892+0000","last_undegraded":"2024-05-10T08:43:59.380892+0000","last_fullsized":"2024-05-10T08:43:59.380892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:26.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352094+0000","last_change":"2024-05-10T08:43:59.376885+0000","last_active":"2024-05-10T08:44:00.352094+0000","last_peered":"2024-05-10T08:44:00.352094+0000","last_clean":"2024-05-10T08:44:00.352094+0000","last_became_active":"2024-05-10T08:43:59.376607+0000","last_became_peered":"2024-05-10T08:43:59.376607+0000","last_unstale":"2024-05-10T08:44:00.352094+0000","last_undegraded":"2024-05-10T08:44:00.352094+0000","last_fullsized":"2024-05-10T08:44:00.352094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:42.021432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348568+0000","last_change":"2024-05-10T08:43:59.363822+0000","last_active":"2024-05-10T08:44:00.348568+0000","last_peered":"2024-05-10T08:44:00.348568+0000","last_clean":"2024-05-10T08:44:00.348568+0000","last_became_active":"2024-05-10T08:43:59.363522+0000","last_became_peered":"2024-05-10T08:43:59.363522+0000","last_unstale":"2024-05-10T08:44:00.348568+0000","last_undegraded":"2024-05-10T08:44:00.348568+0000","last_fullsized":"2024-05-10T08:44:00.348568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:37.239791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352570+0000","last_change":"2024-05-10T08:43:59.353164+0000","last_active":"2024-05-10T08:44:00.352570+0000","last_peered":"2024-05-10T08:44:00.352570+0000","last_clean":"2024-05-10T08:44:00.352570+0000","last_became_active":"2024-05-10T08:43:59.352864+0000","last_became_peered":"2024-05-10T08:43:59.352864+0000","last_unstale":"2024-05-10T08:44:00.352570+0000","last_undegraded":"2024-05-10T08:44:00.352570+0000","last_fullsized":"2024-05-10T08:44:00.352570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:44:33.733587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348515+0000","last_change":"2024-05-10T08:43:59.362154+0000","last_active":"2024-05-10T08:44:00.348515+0000","last_peered":"2024-05-10T08:44:00.348515+0000","last_clean":"2024-05-10T08:44:00.348515+0000","last_became_active":"2024-05-10T08:43:59.361836+0000","last_became_peered":"2024-05-10T08:43:59.361836+0000","last_unstale":"2024-05-10T08:44:00.348515+0000","last_undegraded":"2024-05-10T08:44:00.348515+0000","last_fullsized":"2024-05-10T08:44:00.348515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:48.822270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.379820+0000","last_change":"2024-05-10T08:43:58.365524+0000","last_active":"2024-05-10T08:43:59.379820+0000","last_peered":"2024-05-10T08:43:59.379820+0000","last_clean":"2024-05-10T08:43:59.379820+0000","last_became_active":"2024-05-10T08:43:58.363628+0000","last_became_peered":"2024-05-10T08:43:58.363628+0000","last_unstale":"2024-05-10T08:43:59.379820+0000","last_undegraded":"2024-05-10T08:43:59.379820+0000","last_fullsized":"2024-05-10T08:43:59.379820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:07.426630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381403+0000","last_change":"2024-05-10T08:43:59.372386+0000","last_active":"2024-05-10T08:43:59.381403+0000","last_peered":"2024-05-10T08:43:59.381403+0000","last_clean":"2024-05-10T08:43:59.381403+0000","last_became_active":"2024-05-10T08:43:59.372093+0000","last_became_peered":"2024-05-10T08:43:59.372093+0000","last_unstale":"2024-05-10T08:43:59.381403+0000","last_undegraded":"2024-05-10T08:43:59.381403+0000","last_fullsized":"2024-05-10T08:43:59.381403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:43.667795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352897+0000","last_change":"2024-05-10T08:43:58.357397+0000","last_active":"2024-05-10T08:44:00.352897+0000","last_peered":"2024-05-10T08:44:00.352897+0000","last_clean":"2024-05-10T08:44:00.352897+0000","last_became_active":"2024-05-10T08:43:58.357109+0000","last_became_peered":"2024-05-10T08:43:58.357109+0000","last_unstale":"2024-05-10T08:44:00.352897+0000","last_undegraded":"2024-05-10T08:44:00.352897+0000","last_fullsized":"2024-05-10T08:44:00.352897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:43.775910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366963+0000","last_change":"2024-05-10T08:43:59.361161+0000","last_active":"2024-05-10T08:43:59.366963+0000","last_peered":"2024-05-10T08:43:59.366963+0000","last_clean":"2024-05-10T08:43:59.366963+0000","last_became_active":"2024-05-10T08:43:59.360502+0000","last_became_peered":"2024-05-10T08:43:59.360502+0000","last_unstale":"2024-05-10T08:43:59.366963+0000","last_undegraded":"2024-05-10T08:43:59.366963+0000","last_fullsized":"2024-05-10T08:43:59.366963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:15.023662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352897+0000","last_change":"2024-05-10T08:43:58.364799+0000","last_active":"2024-05-10T08:44:00.352897+0000","last_peered":"2024-05-10T08:44:00.352897+0000","last_clean":"2024-05-10T08:44:00.352897+0000","last_became_active":"2024-05-10T08:43:58.364467+0000","last_became_peered":"2024-05-10T08:43:58.364467+0000","last_unstale":"2024-05-10T08:44:00.352897+0000","last_undegraded":"2024-05-10T08:44:00.352897+0000","last_fullsized":"2024-05-10T08:44:00.352897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:52.482063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.360800+0000","last_change":"2024-05-10T08:43:59.358676+0000","last_active":"2024-05-10T08:43:59.360800+0000","last_peered":"2024-05-10T08:43:59.360800+0000","last_clean":"2024-05-10T08:43:59.360800+0000","last_became_active":"2024-05-10T08:43:59.358405+0000","last_became_peered":"2024-05-10T08:43:59.358405+0000","last_unstale":"2024-05-10T08:43:59.360800+0000","last_undegraded":"2024-05-10T08:43:59.360800+0000","last_fullsized":"2024-05-10T08:43:59.360800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:01:53.850698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381133+0000","last_change":"2024-05-10T08:43:58.360383+0000","last_active":"2024-05-10T08:43:59.381133+0000","last_peered":"2024-05-10T08:43:59.381133+0000","last_clean":"2024-05-10T08:43:59.381133+0000","last_became_active":"2024-05-10T08:43:58.360116+0000","last_became_peered":"2024-05-10T08:43:58.360116+0000","last_unstale":"2024-05-10T08:43:59.381133+0000","last_undegraded":"2024-05-10T08:43:59.381133+0000","last_fullsized":"2024-05-10T08:43:59.381133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:34.982084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380993+0000","last_change":"2024-05-10T08:43:59.363124+0000","last_active":"2024-05-10T08:43:59.380993+0000","last_peered":"2024-05-10T08:43:59.380993+0000","last_clean":"2024-05-10T08:43:59.380993+0000","last_became_active":"2024-05-10T08:43:59.362790+0000","last_became_peered":"2024-05-10T08:43:59.362790+0000","last_unstale":"2024-05-10T08:43:59.380993+0000","last_undegraded":"2024-05-10T08:43:59.380993+0000","last_fullsized":"2024-05-10T08:43:59.380993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:44.778466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.372699+0000","last_change":"2024-05-10T08:43:58.362035+0000","last_active":"2024-05-10T08:43:59.372699+0000","last_peered":"2024-05-10T08:43:59.372699+0000","last_clean":"2024-05-10T08:43:59.372699+0000","last_became_active":"2024-05-10T08:43:58.361304+0000","last_became_peered":"2024-05-10T08:43:58.361304+0000","last_unstale":"2024-05-10T08:43:59.372699+0000","last_undegraded":"2024-05-10T08:43:59.372699+0000","last_fullsized":"2024-05-10T08:43:59.372699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:10.541308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381446+0000","last_change":"2024-05-10T08:43:59.371965+0000","last_active":"2024-05-10T08:43:59.381446+0000","last_peered":"2024-05-10T08:43:59.381446+0000","last_clean":"2024-05-10T08:43:59.381446+0000","last_became_active":"2024-05-10T08:43:59.363130+0000","last_became_peered":"2024-05-10T08:43:59.363130+0000","last_unstale":"2024-05-10T08:43:59.381446+0000","last_undegraded":"2024-05-10T08:43:59.381446+0000","last_fullsized":"2024-05-10T08:43:59.381446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:56.265888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.351821+0000","last_change":"2024-05-10T08:43:58.363611+0000","last_active":"2024-05-10T08:44:00.351821+0000","last_peered":"2024-05-10T08:44:00.351821+0000","last_clean":"2024-05-10T08:44:00.351821+0000","last_became_active":"2024-05-10T08:43:58.363359+0000","last_became_peered":"2024-05-10T08:43:58.363359+0000","last_unstale":"2024-05-10T08:44:00.351821+0000","last_undegraded":"2024-05-10T08:44:00.351821+0000","last_fullsized":"2024-05-10T08:44:00.351821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:40.705032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369672+0000","last_change":"2024-05-10T08:43:59.367948+0000","last_active":"2024-05-10T08:43:59.369672+0000","last_peered":"2024-05-10T08:43:59.369672+0000","last_clean":"2024-05-10T08:43:59.369672+0000","last_became_active":"2024-05-10T08:43:59.367650+0000","last_became_peered":"2024-05-10T08:43:59.367650+0000","last_unstale":"2024-05-10T08:43:59.369672+0000","last_undegraded":"2024-05-10T08:43:59.369672+0000","last_fullsized":"2024-05-10T08:43:59.369672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:56.692135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.355461+0000","last_change":"2024-05-10T08:43:58.359933+0000","last_active":"2024-05-10T08:43:59.355461+0000","last_peered":"2024-05-10T08:43:59.355461+0000","last_clean":"2024-05-10T08:43:59.355461+0000","last_became_active":"2024-05-10T08:43:58.359665+0000","last_became_peered":"2024-05-10T08:43:58.359665+0000","last_unstale":"2024-05-10T08:43:59.355461+0000","last_undegraded":"2024-05-10T08:43:59.355461+0000","last_fullsized":"2024-05-10T08:43:59.355461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:37.629131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366421+0000","last_change":"2024-05-10T08:43:59.363931+0000","last_active":"2024-05-10T08:43:59.366421+0000","last_peered":"2024-05-10T08:43:59.366421+0000","last_clean":"2024-05-10T08:43:59.366421+0000","last_became_active":"2024-05-10T08:43:59.362731+0000","last_became_peered":"2024-05-10T08:43:59.362731+0000","last_unstale":"2024-05-10T08:43:59.366421+0000","last_undegraded":"2024-05-10T08:43:59.366421+0000","last_fullsized":"2024-05-10T08:43:59.366421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:22.377614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.349404+0000","last_change":"2024-05-10T08:43:58.358065+0000","last_active":"2024-05-10T08:43:59.349404+0000","last_peered":"2024-05-10T08:43:59.349404+0000","last_clean":"2024-05-10T08:43:59.349404+0000","last_became_active":"2024-05-10T08:43:58.357779+0000","last_became_peered":"2024-05-10T08:43:58.357779+0000","last_unstale":"2024-05-10T08:43:59.349404+0000","last_undegraded":"2024-05-10T08:43:59.349404+0000","last_fullsized":"2024-05-10T08:43:59.349404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:31.584673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.382803+0000","last_change":"2024-05-10T08:43:59.374889+0000","last_active":"2024-05-10T08:43:59.382803+0000","last_peered":"2024-05-10T08:43:59.382803+0000","last_clean":"2024-05-10T08:43:59.382803+0000","last_became_active":"2024-05-10T08:43:59.374521+0000","last_became_peered":"2024-05-10T08:43:59.374521+0000","last_unstale":"2024-05-10T08:43:59.382803+0000","last_undegraded":"2024-05-10T08:43:59.382803+0000","last_fullsized":"2024-05-10T08:43:59.382803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:44:33.733587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.353104+0000","last_change":"2024-05-10T08:43:58.362518+0000","last_active":"2024-05-10T08:44:00.353104+0000","last_peered":"2024-05-10T08:44:00.353104+0000","last_clean":"2024-05-10T08:44:00.353104+0000","last_became_active":"2024-05-10T08:43:58.362258+0000","last_became_peered":"2024-05-10T08:43:58.362258+0000","last_unstale":"2024-05-10T08:44:00.353104+0000","last_undegraded":"2024-05-10T08:44:00.353104+0000","last_fullsized":"2024-05-10T08:44:00.353104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:19:48.263710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.351980+0000","last_change":"2024-05-10T08:43:59.359607+0000","last_active":"2024-05-10T08:44:00.351980+0000","last_peered":"2024-05-10T08:44:00.351980+0000","last_clean":"2024-05-10T08:44:00.351980+0000","last_became_active":"2024-05-10T08:43:59.359125+0000","last_became_peered":"2024-05-10T08:43:59.359125+0000","last_unstale":"2024-05-10T08:44:00.351980+0000","last_undegraded":"2024-05-10T08:44:00.351980+0000","last_fullsized":"2024-05-10T08:44:00.351980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:06.223000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352464+0000","last_change":"2024-05-10T08:43:58.360603+0000","last_active":"2024-05-10T08:44:00.352464+0000","last_peered":"2024-05-10T08:44:00.352464+0000","last_clean":"2024-05-10T08:44:00.352464+0000","last_became_active":"2024-05-10T08:43:58.359919+0000","last_became_peered":"2024-05-10T08:43:58.359919+0000","last_unstale":"2024-05-10T08:44:00.352464+0000","last_undegraded":"2024-05-10T08:44:00.352464+0000","last_fullsized":"2024-05-10T08:44:00.352464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:41.669376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.368819+0000","last_change":"2024-05-10T08:43:59.362258+0000","last_active":"2024-05-10T08:43:59.368819+0000","last_peered":"2024-05-10T08:43:59.368819+0000","last_clean":"2024-05-10T08:43:59.368819+0000","last_became_active":"2024-05-10T08:43:59.361803+0000","last_became_peered":"2024-05-10T08:43:59.361803+0000","last_unstale":"2024-05-10T08:43:59.368819+0000","last_undegraded":"2024-05-10T08:43:59.368819+0000","last_fullsized":"2024-05-10T08:43:59.368819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:59:11.217789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.379384+0000","last_change":"2024-05-10T08:43:58.360275+0000","last_active":"2024-05-10T08:43:59.379384+0000","last_peered":"2024-05-10T08:43:59.379384+0000","last_clean":"2024-05-10T08:43:59.379384+0000","last_became_active":"2024-05-10T08:43:58.359750+0000","last_became_peered":"2024-05-10T08:43:58.359750+0000","last_unstale":"2024-05-10T08:43:59.379384+0000","last_undegraded":"2024-05-10T08:43:59.379384+0000","last_fullsized":"2024-05-10T08:43:59.379384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:25.930859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348696+0000","last_change":"2024-05-10T08:43:59.382518+0000","last_active":"2024-05-10T08:44:00.348696+0000","last_peered":"2024-05-10T08:44:00.348696+0000","last_clean":"2024-05-10T08:44:00.348696+0000","last_became_active":"2024-05-10T08:43:59.382213+0000","last_became_peered":"2024-05-10T08:43:59.382213+0000","last_unstale":"2024-05-10T08:44:00.348696+0000","last_undegraded":"2024-05-10T08:44:00.348696+0000","last_fullsized":"2024-05-10T08:44:00.348696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:42.671932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.386650+0000","last_change":"2024-05-10T08:43:58.359823+0000","last_active":"2024-05-10T08:43:59.386650+0000","last_peered":"2024-05-10T08:43:59.386650+0000","last_clean":"2024-05-10T08:43:59.386650+0000","last_became_active":"2024-05-10T08:43:58.359547+0000","last_became_peered":"2024-05-10T08:43:58.359547+0000","last_unstale":"2024-05-10T08:43:59.386650+0000","last_undegraded":"2024-05-10T08:43:59.386650+0000","last_fullsized":"2024-05-10T08:43:59.386650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:11.176981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352453+0000","last_change":"2024-05-10T08:43:59.365517+0000","last_active":"2024-05-10T08:44:00.352453+0000","last_peered":"2024-05-10T08:44:00.352453+0000","last_clean":"2024-05-10T08:44:00.352453+0000","last_became_active":"2024-05-10T08:43:59.365184+0000","last_became_peered":"2024-05-10T08:43:59.365184+0000","last_unstale":"2024-05-10T08:44:00.352453+0000","last_undegraded":"2024-05-10T08:44:00.352453+0000","last_fullsized":"2024-05-10T08:44:00.352453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:43.667795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.351932+0000","last_change":"2024-05-10T08:43:58.357804+0000","last_active":"2024-05-10T08:44:00.351932+0000","last_peered":"2024-05-10T08:44:00.351932+0000","last_clean":"2024-05-10T08:44:00.351932+0000","last_became_active":"2024-05-10T08:43:58.357515+0000","last_became_peered":"2024-05-10T08:43:58.357515+0000","last_unstale":"2024-05-10T08:44:00.351932+0000","last_undegraded":"2024-05-10T08:44:00.351932+0000","last_fullsized":"2024-05-10T08:44:00.351932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:36.237236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366370+0000","last_change":"2024-05-10T08:43:59.361963+0000","last_active":"2024-05-10T08:43:59.366370+0000","last_peered":"2024-05-10T08:43:59.366370+0000","last_clean":"2024-05-10T08:43:59.366370+0000","last_became_active":"2024-05-10T08:43:59.361646+0000","last_became_peered":"2024-05-10T08:43:59.361646+0000","last_unstale":"2024-05-10T08:43:59.366370+0000","last_undegraded":"2024-05-10T08:43:59.366370+0000","last_fullsized":"2024-05-10T08:43:59.366370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:34.347110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352194+0000","last_change":"2024-05-10T08:43:58.360363+0000","last_active":"2024-05-10T08:44:00.352194+0000","last_peered":"2024-05-10T08:44:00.352194+0000","last_clean":"2024-05-10T08:44:00.352194+0000","last_became_active":"2024-05-10T08:43:58.360072+0000","last_became_peered":"2024-05-10T08:43:58.360072+0000","last_unstale":"2024-05-10T08:44:00.352194+0000","last_undegraded":"2024-05-10T08:44:00.352194+0000","last_fullsized":"2024-05-10T08:44:00.352194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.228637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.365636+0000","last_change":"2024-05-10T08:43:59.363928+0000","last_active":"2024-05-10T08:43:59.365636+0000","last_peered":"2024-05-10T08:43:59.365636+0000","last_clean":"2024-05-10T08:43:59.365636+0000","last_became_active":"2024-05-10T08:43:59.363555+0000","last_became_peered":"2024-05-10T08:43:59.363555+0000","last_unstale":"2024-05-10T08:43:59.365636+0000","last_undegraded":"2024-05-10T08:43:59.365636+0000","last_fullsized":"2024-05-10T08:43:59.365636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:54.675607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.348841+0000","last_change":"2024-05-10T08:43:58.365459+0000","last_active":"2024-05-10T08:43:59.348841+0000","last_peered":"2024-05-10T08:43:59.348841+0000","last_clean":"2024-05-10T08:43:59.348841+0000","last_became_active":"2024-05-10T08:43:58.363694+0000","last_became_peered":"2024-05-10T08:43:58.363694+0000","last_unstale":"2024-05-10T08:43:59.348841+0000","last_undegraded":"2024-05-10T08:43:59.348841+0000","last_fullsized":"2024-05-10T08:43:59.348841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:38.970373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369254+0000","last_change":"2024-05-10T08:43:59.366211+0000","last_active":"2024-05-10T08:43:59.369254+0000","last_peered":"2024-05-10T08:43:59.369254+0000","last_clean":"2024-05-10T08:43:59.369254+0000","last_became_active":"2024-05-10T08:43:59.365869+0000","last_became_peered":"2024-05-10T08:43:59.365869+0000","last_unstale":"2024-05-10T08:43:59.369254+0000","last_undegraded":"2024-05-10T08:43:59.369254+0000","last_fullsized":"2024-05-10T08:43:59.369254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:48.822270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.387370+0000","last_change":"2024-05-10T08:43:58.364500+0000","last_active":"2024-05-10T08:43:59.387370+0000","last_peered":"2024-05-10T08:43:59.387370+0000","last_clean":"2024-05-10T08:43:59.387370+0000","last_became_active":"2024-05-10T08:43:58.364192+0000","last_became_peered":"2024-05-10T08:43:58.364192+0000","last_unstale":"2024-05-10T08:43:59.387370+0000","last_undegraded":"2024-05-10T08:43:59.387370+0000","last_fullsized":"2024-05-10T08:43:59.387370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:19:48.263710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380245+0000","last_change":"2024-05-10T08:43:59.375528+0000","last_active":"2024-05-10T08:43:59.380245+0000","last_peered":"2024-05-10T08:43:59.380245+0000","last_clean":"2024-05-10T08:43:59.380245+0000","last_became_active":"2024-05-10T08:43:59.374975+0000","last_became_peered":"2024-05-10T08:43:59.374975+0000","last_unstale":"2024-05-10T08:43:59.380245+0000","last_undegraded":"2024-05-10T08:43:59.380245+0000","last_fullsized":"2024-05-10T08:43:59.380245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:50.119082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.353205+0000","last_change":"2024-05-10T08:43:58.365573+0000","last_active":"2024-05-10T08:44:00.353205+0000","last_peered":"2024-05-10T08:44:00.353205+0000","last_clean":"2024-05-10T08:44:00.353205+0000","last_became_active":"2024-05-10T08:43:58.365356+0000","last_became_peered":"2024-05-10T08:43:58.365356+0000","last_unstale":"2024-05-10T08:44:00.353205+0000","last_undegraded":"2024-05-10T08:44:00.353205+0000","last_fullsized":"2024-05-10T08:44:00.353205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:37.629131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377017+0000","last_change":"2024-05-10T08:43:59.365037+0000","last_active":"2024-05-10T08:43:59.377017+0000","last_peered":"2024-05-10T08:43:59.377017+0000","last_clean":"2024-05-10T08:43:59.377017+0000","last_became_active":"2024-05-10T08:43:59.364713+0000","last_became_peered":"2024-05-10T08:43:59.364713+0000","last_unstale":"2024-05-10T08:43:59.377017+0000","last_undegraded":"2024-05-10T08:43:59.377017+0000","last_fullsized":"2024-05-10T08:43:59.377017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:01.542435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377304+0000","last_change":"2024-05-10T08:43:58.366719+0000","last_active":"2024-05-10T08:43:59.377304+0000","last_peered":"2024-05-10T08:43:59.377304+0000","last_clean":"2024-05-10T08:43:59.377304+0000","last_became_active":"2024-05-10T08:43:58.366473+0000","last_became_peered":"2024-05-10T08:43:58.366473+0000","last_unstale":"2024-05-10T08:43:59.377304+0000","last_undegraded":"2024-05-10T08:43:59.377304+0000","last_fullsized":"2024-05-10T08:43:59.377304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:42.483051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.383784+0000","last_change":"2024-05-10T08:43:59.377438+0000","last_active":"2024-05-10T08:43:59.383784+0000","last_peered":"2024-05-10T08:43:59.383784+0000","last_clean":"2024-05-10T08:43:59.383784+0000","last_became_active":"2024-05-10T08:43:59.376430+0000","last_became_peered":"2024-05-10T08:43:59.376430+0000","last_unstale":"2024-05-10T08:43:59.383784+0000","last_undegraded":"2024-05-10T08:43:59.383784+0000","last_fullsized":"2024-05-10T08:43:59.383784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.645498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377220+0000","last_change":"2024-05-10T08:43:58.360042+0000","last_active":"2024-05-10T08:43:59.377220+0000","last_peered":"2024-05-10T08:43:59.377220+0000","last_clean":"2024-05-10T08:43:59.377220+0000","last_became_active":"2024-05-10T08:43:58.359400+0000","last_became_peered":"2024-05-10T08:43:58.359400+0000","last_unstale":"2024-05-10T08:43:59.377220+0000","last_undegraded":"2024-05-10T08:43:59.377220+0000","last_fullsized":"2024-05-10T08:43:59.377220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:32.337777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381792+0000","last_change":"2024-05-10T08:43:59.378063+0000","last_active":"2024-05-10T08:43:59.381792+0000","last_peered":"2024-05-10T08:43:59.381792+0000","last_clean":"2024-05-10T08:43:59.381792+0000","last_became_active":"2024-05-10T08:43:59.377732+0000","last_became_peered":"2024-05-10T08:43:59.377732+0000","last_unstale":"2024-05-10T08:43:59.381792+0000","last_undegraded":"2024-05-10T08:43:59.381792+0000","last_fullsized":"2024-05-10T08:43:59.381792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:50.718811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348696+0000","last_change":"2024-05-10T08:43:58.358061+0000","last_active":"2024-05-10T08:44:00.348696+0000","last_peered":"2024-05-10T08:44:00.348696+0000","last_clean":"2024-05-10T08:44:00.348696+0000","last_became_active":"2024-05-10T08:43:58.357771+0000","last_became_peered":"2024-05-10T08:43:58.357771+0000","last_unstale":"2024-05-10T08:44:00.348696+0000","last_undegraded":"2024-05-10T08:44:00.348696+0000","last_fullsized":"2024-05-10T08:44:00.348696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:24.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381446+0000","last_change":"2024-05-10T08:43:59.372809+0000","last_active":"2024-05-10T08:43:59.381446+0000","last_peered":"2024-05-10T08:43:59.381446+0000","last_clean":"2024-05-10T08:43:59.381446+0000","last_became_active":"2024-05-10T08:43:59.372573+0000","last_became_peered":"2024-05-10T08:43:59.372573+0000","last_unstale":"2024-05-10T08:43:59.381446+0000","last_undegraded":"2024-05-10T08:43:59.381446+0000","last_fullsized":"2024-05-10T08:43:59.381446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:41.133875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380284+0000","last_change":"2024-05-10T08:43:58.367145+0000","last_active":"2024-05-10T08:43:59.380284+0000","last_peered":"2024-05-10T08:43:59.380284+0000","last_clean":"2024-05-10T08:43:59.380284+0000","last_became_active":"2024-05-10T08:43:58.366531+0000","last_became_peered":"2024-05-10T08:43:58.366531+0000","last_unstale":"2024-05-10T08:43:59.380284+0000","last_undegraded":"2024-05-10T08:43:59.380284+0000","last_fullsized":"2024-05-10T08:43:59.380284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:19:54.907584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381716+0000","last_change":"2024-05-10T08:43:59.376269+0000","last_active":"2024-05-10T08:43:59.381716+0000","last_peered":"2024-05-10T08:43:59.381716+0000","last_clean":"2024-05-10T08:43:59.381716+0000","last_became_active":"2024-05-10T08:43:59.375599+0000","last_became_peered":"2024-05-10T08:43:59.375599+0000","last_unstale":"2024-05-10T08:43:59.381716+0000","last_undegraded":"2024-05-10T08:43:59.381716+0000","last_fullsized":"2024-05-10T08:43:59.381716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:55.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.353458+0000","last_change":"2024-05-10T08:43:58.367827+0000","last_active":"2024-05-10T08:43:59.353458+0000","last_peered":"2024-05-10T08:43:59.353458+0000","last_clean":"2024-05-10T08:43:59.353458+0000","last_became_active":"2024-05-10T08:43:58.367606+0000","last_became_peered":"2024-05-10T08:43:58.367606+0000","last_unstale":"2024-05-10T08:43:59.353458+0000","last_undegraded":"2024-05-10T08:43:59.353458+0000","last_fullsized":"2024-05-10T08:43:59.353458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:41.611317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366990+0000","last_change":"2024-05-10T08:43:59.364066+0000","last_active":"2024-05-10T08:43:59.366990+0000","last_peered":"2024-05-10T08:43:59.366990+0000","last_clean":"2024-05-10T08:43:59.366990+0000","last_became_active":"2024-05-10T08:43:59.362239+0000","last_became_peered":"2024-05-10T08:43:59.362239+0000","last_unstale":"2024-05-10T08:43:59.366990+0000","last_undegraded":"2024-05-10T08:43:59.366990+0000","last_fullsized":"2024-05-10T08:43:59.366990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:21.265796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.352555+0000","last_change":"2024-05-10T08:43:58.368063+0000","last_active":"2024-05-10T08:43:59.352555+0000","last_peered":"2024-05-10T08:43:59.352555+0000","last_clean":"2024-05-10T08:43:59.352555+0000","last_became_active":"2024-05-10T08:43:58.367758+0000","last_became_peered":"2024-05-10T08:43:58.367758+0000","last_unstale":"2024-05-10T08:43:59.352555+0000","last_undegraded":"2024-05-10T08:43:59.352555+0000","last_fullsized":"2024-05-10T08:43:59.352555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:00.614684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.364377+0000","last_change":"2024-05-10T08:43:59.362665+0000","last_active":"2024-05-10T08:43:59.364377+0000","last_peered":"2024-05-10T08:43:59.364377+0000","last_clean":"2024-05-10T08:43:59.364377+0000","last_became_active":"2024-05-10T08:43:59.362389+0000","last_became_peered":"2024-05-10T08:43:59.362389+0000","last_unstale":"2024-05-10T08:43:59.364377+0000","last_undegraded":"2024-05-10T08:43:59.364377+0000","last_fullsized":"2024-05-10T08:43:59.364377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:05:43.206484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352174+0000","last_change":"2024-05-10T08:43:58.365115+0000","last_active":"2024-05-10T08:44:00.352174+0000","last_peered":"2024-05-10T08:44:00.352174+0000","last_clean":"2024-05-10T08:44:00.352174+0000","last_became_active":"2024-05-10T08:43:58.364772+0000","last_became_peered":"2024-05-10T08:43:58.364772+0000","last_unstale":"2024-05-10T08:44:00.352174+0000","last_undegraded":"2024-05-10T08:44:00.352174+0000","last_fullsized":"2024-05-10T08:44:00.352174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:47.819715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369283+0000","last_change":"2024-05-10T08:43:59.365411+0000","last_active":"2024-05-10T08:43:59.369283+0000","last_peered":"2024-05-10T08:43:59.369283+0000","last_clean":"2024-05-10T08:43:59.369283+0000","last_became_active":"2024-05-10T08:43:59.365176+0000","last_became_peered":"2024-05-10T08:43:59.365176+0000","last_unstale":"2024-05-10T08:43:59.369283+0000","last_undegraded":"2024-05-10T08:43:59.369283+0000","last_fullsized":"2024-05-10T08:43:59.369283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:41.707588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.355680+0000","last_change":"2024-05-10T08:43:58.362201+0000","last_active":"2024-05-10T08:43:59.355680+0000","last_peered":"2024-05-10T08:43:59.355680+0000","last_clean":"2024-05-10T08:43:59.355680+0000","last_became_active":"2024-05-10T08:43:58.361886+0000","last_became_peered":"2024-05-10T08:43:58.361886+0000","last_unstale":"2024-05-10T08:43:59.355680+0000","last_undegraded":"2024-05-10T08:43:59.355680+0000","last_fullsized":"2024-05-10T08:43:59.355680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:05.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366986+0000","last_change":"2024-05-10T08:43:59.361464+0000","last_active":"2024-05-10T08:43:59.366986+0000","last_peered":"2024-05-10T08:43:59.366986+0000","last_clean":"2024-05-10T08:43:59.366986+0000","last_became_active":"2024-05-10T08:43:59.360280+0000","last_became_peered":"2024-05-10T08:43:59.360280+0000","last_unstale":"2024-05-10T08:43:59.366986+0000","last_undegraded":"2024-05-10T08:43:59.366986+0000","last_fullsized":"2024-05-10T08:43:59.366986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:27:03.662329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352994+0000","last_change":"2024-05-10T08:43:58.358291+0000","last_active":"2024-05-10T08:44:00.352994+0000","last_peered":"2024-05-10T08:44:00.352994+0000","last_clean":"2024-05-10T08:44:00.352994+0000","last_became_active":"2024-05-10T08:43:58.358003+0000","last_became_peered":"2024-05-10T08:43:58.358003+0000","last_unstale":"2024-05-10T08:44:00.352994+0000","last_undegraded":"2024-05-10T08:44:00.352994+0000","last_fullsized":"2024-05-10T08:44:00.352994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:52.015119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381719+0000","last_change":"2024-05-10T08:43:59.373382+0000","last_active":"2024-05-10T08:43:59.381719+0000","last_peered":"2024-05-10T08:43:59.381719+0000","last_clean":"2024-05-10T08:43:59.381719+0000","last_became_active":"2024-05-10T08:43:59.372467+0000","last_became_peered":"2024-05-10T08:43:59.372467+0000","last_unstale":"2024-05-10T08:43:59.381719+0000","last_undegraded":"2024-05-10T08:43:59.381719+0000","last_fullsized":"2024-05-10T08:43:59.381719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:42.021432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352796+0000","last_change":"2024-05-10T08:43:58.358073+0000","last_active":"2024-05-10T08:44:00.352796+0000","last_peered":"2024-05-10T08:44:00.352796+0000","last_clean":"2024-05-10T08:44:00.352796+0000","last_became_active":"2024-05-10T08:43:58.357790+0000","last_became_peered":"2024-05-10T08:43:58.357790+0000","last_unstale":"2024-05-10T08:44:00.352796+0000","last_undegraded":"2024-05-10T08:44:00.352796+0000","last_fullsized":"2024-05-10T08:44:00.352796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:05.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369148+0000","last_change":"2024-05-10T08:43:59.364812+0000","last_active":"2024-05-10T08:43:59.369148+0000","last_peered":"2024-05-10T08:43:59.369148+0000","last_clean":"2024-05-10T08:43:59.369148+0000","last_became_active":"2024-05-10T08:43:59.364549+0000","last_became_peered":"2024-05-10T08:43:59.364549+0000","last_unstale":"2024-05-10T08:43:59.369148+0000","last_undegraded":"2024-05-10T08:43:59.369148+0000","last_fullsized":"2024-05-10T08:43:59.369148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:26.942455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.358123+0000","last_change":"2024-05-10T08:43:58.358963+0000","last_active":"2024-05-10T08:43:59.358123+0000","last_peered":"2024-05-10T08:43:59.358123+0000","last_clean":"2024-05-10T08:43:59.358123+0000","last_became_active":"2024-05-10T08:43:58.358669+0000","last_became_peered":"2024-05-10T08:43:58.358669+0000","last_unstale":"2024-05-10T08:43:59.358123+0000","last_undegraded":"2024-05-10T08:43:59.358123+0000","last_fullsized":"2024-05-10T08:43:59.358123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:34.619825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366392+0000","last_change":"2024-05-10T08:43:59.362626+0000","last_active":"2024-05-10T08:43:59.366392+0000","last_peered":"2024-05-10T08:43:59.366392+0000","last_clean":"2024-05-10T08:43:59.366392+0000","last_became_active":"2024-05-10T08:43:59.362299+0000","last_became_peered":"2024-05-10T08:43:59.362299+0000","last_unstale":"2024-05-10T08:43:59.366392+0000","last_undegraded":"2024-05-10T08:43:59.366392+0000","last_fullsized":"2024-05-10T08:43:59.366392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:48.938309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.348900+0000","last_change":"2024-05-10T08:43:58.365026+0000","last_active":"2024-05-10T08:43:59.348900+0000","last_peered":"2024-05-10T08:43:59.348900+0000","last_clean":"2024-05-10T08:43:59.348900+0000","last_became_active":"2024-05-10T08:43:58.363582+0000","last_became_peered":"2024-05-10T08:43:58.363582+0000","last_unstale":"2024-05-10T08:43:59.348900+0000","last_undegraded":"2024-05-10T08:43:59.348900+0000","last_fullsized":"2024-05-10T08:43:59.348900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:14.986297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.349059+0000","last_change":"2024-05-10T08:43:59.377338+0000","last_active":"2024-05-10T08:44:00.349059+0000","last_peered":"2024-05-10T08:44:00.349059+0000","last_clean":"2024-05-10T08:44:00.349059+0000","last_became_active":"2024-05-10T08:43:59.377009+0000","last_became_peered":"2024-05-10T08:43:59.377009+0000","last_unstale":"2024-05-10T08:44:00.349059+0000","last_undegraded":"2024-05-10T08:44:00.349059+0000","last_fullsized":"2024-05-10T08:44:00.349059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:53.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.359114+0000","last_change":"2024-05-10T08:43:58.363915+0000","last_active":"2024-05-10T08:43:59.359114+0000","last_peered":"2024-05-10T08:43:59.359114+0000","last_clean":"2024-05-10T08:43:59.359114+0000","last_became_active":"2024-05-10T08:43:58.363624+0000","last_became_peered":"2024-05-10T08:43:58.363624+0000","last_unstale":"2024-05-10T08:43:59.359114+0000","last_undegraded":"2024-05-10T08:43:59.359114+0000","last_fullsized":"2024-05-10T08:43:59.359114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:24.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348989+0000","last_change":"2024-05-10T08:43:59.364529+0000","last_active":"2024-05-10T08:44:00.348989+0000","last_peered":"2024-05-10T08:44:00.348989+0000","last_clean":"2024-05-10T08:44:00.348989+0000","last_became_active":"2024-05-10T08:43:59.364268+0000","last_became_peered":"2024-05-10T08:43:59.364268+0000","last_unstale":"2024-05-10T08:44:00.348989+0000","last_undegraded":"2024-05-10T08:44:00.348989+0000","last_fullsized":"2024-05-10T08:44:00.348989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:12.231192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348464+0000","last_change":"2024-05-10T08:43:58.362185+0000","last_active":"2024-05-10T08:44:00.348464+0000","last_peered":"2024-05-10T08:44:00.348464+0000","last_clean":"2024-05-10T08:44:00.348464+0000","last_became_active":"2024-05-10T08:43:58.361877+0000","last_became_peered":"2024-05-10T08:43:58.361877+0000","last_unstale":"2024-05-10T08:44:00.348464+0000","last_undegraded":"2024-05-10T08:44:00.348464+0000","last_fullsized":"2024-05-10T08:44:00.348464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:34.619825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352954+0000","last_change":"2024-05-10T08:43:59.360684+0000","last_active":"2024-05-10T08:44:00.352954+0000","last_peered":"2024-05-10T08:44:00.352954+0000","last_clean":"2024-05-10T08:44:00.352954+0000","last_became_active":"2024-05-10T08:43:59.360078+0000","last_became_peered":"2024-05-10T08:43:59.360078+0000","last_unstale":"2024-05-10T08:44:00.352954+0000","last_undegraded":"2024-05-10T08:44:00.352954+0000","last_fullsized":"2024-05-10T08:44:00.352954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:11.017449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.357131+0000","last_change":"2024-05-10T08:43:58.368008+0000","last_active":"2024-05-10T08:43:59.357131+0000","last_peered":"2024-05-10T08:43:59.357131+0000","last_clean":"2024-05-10T08:43:59.357131+0000","last_became_active":"2024-05-10T08:43:58.367691+0000","last_became_peered":"2024-05-10T08:43:58.367691+0000","last_unstale":"2024-05-10T08:43:59.357131+0000","last_undegraded":"2024-05-10T08:43:59.357131+0000","last_fullsized":"2024-05-10T08:43:59.357131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:23.541942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":211,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352656+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:44:00.352656+0000","last_peered":"2024-05-10T08:44:00.352656+0000","last_clean":"2024-05-10T08:44:00.352656+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:44:00.352656+0000","last_undegraded":"2024-05-10T08:44:00.352656+0000","last_fullsized":"2024-05-10T08:44:00.352656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1503232,"data_stored":1000344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":411566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":409988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":411670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":410536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":410696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":913408,"data_stored":410066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1499136,"data_stored":1000322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:44:03.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:44:03.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.554+0000 7f2bd0815640 1 Processor -- start 2024-05-10T08:44:03.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.554+0000 7f2bd0815640 1 -- start start 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bd0815640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc15f380 0x7f2bcc0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bd0815640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2bcc0d3cd0 0x7f2bcc0b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bd0815640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bcc0d1760 con 0x7f2bcc0d0cf0 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bd0815640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2bcc0d30f0 con 0x7f2bcc0d3cd0 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bd0815640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2bcc0d1150 con 0x7f2bcc15f380 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bca59c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc15f380 0x7f2bcc0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bc9d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2bcc0d0cf0 0x7f2bcc0d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:43650/0 (socket says 172.21.15.37:43650) 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bcad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2bcc0d3cd0 0x7f2bcc0b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bc9d9b640 1 -- 172.21.15.37:0/627868912 learned_addr learned my addr 172.21.15.37:0/627868912 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:03.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bc959a640 1 -- 172.21.15.37:0/627868912 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217640313 0 0) 0x7f2bcc0d1760 con 0x7f2bcc0d0cf0 2024-05-10T08:44:03.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bc959a640 1 -- 172.21.15.37:0/627868912 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bb4003520 con 0x7f2bcc0d0cf0 2024-05-10T08:44:03.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bca59c640 1 -- 172.21.15.37:0/627868912 >> v2:172.21.15.82:3300/0 conn(0x7f2bcc0d3cd0 msgr2=0x7f2bcc0b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:03.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bca59c640 1 --2- 172.21.15.37:0/627868912 >> v2:172.21.15.82:3300/0 conn(0x7f2bcc0d3cd0 0x7f2bcc0b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bca59c640 1 -- 172.21.15.37:0/627868912 >> v1:172.21.15.82:6789/0 conn(0x7f2bcc0d0cf0 legacy=0x7f2bcc0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bca59c640 1 -- 172.21.15.37:0/627868912 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc0d1a40 con 0x7f2bcc15f380 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.555+0000 7f2bcad9d640 1 --2- 172.21.15.37:0/627868912 >> v2:172.21.15.82:3300/0 conn(0x7f2bcc0d3cd0 0x7f2bcc0b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.556+0000 7f2bca59c640 1 --2- 172.21.15.37:0/627868912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc15f380 0x7f2bcc0d07b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0097a0 tx=0x7f2bbc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d10916ae173809 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.556+0000 7f2bc959a640 1 -- 172.21.15.37:0/627868912 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc037070 con 0x7f2bcc15f380 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.556+0000 7f2bc959a640 1 -- 172.21.15.37:0/627868912 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc032440 con 0x7f2bcc15f380 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.556+0000 7f2bc959a640 1 -- 172.21.15.37:0/627868912 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc032810 con 0x7f2bcc15f380 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 -- 172.21.15.37:0/627868912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc15f380 msgr2=0x7f2bcc0d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 --2- 172.21.15.37:0/627868912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc15f380 0x7f2bcc0d07b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0097a0 tx=0x7f2bbc02a180 comp rx=0 tx=0).stop 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 -- 172.21.15.37:0/627868912 shutdown_connections 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 --2- 172.21.15.37:0/627868912 >> v2:172.21.15.82:3300/0 conn(0x7f2bcc0d3cd0 0x7f2bcc0b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 --2- 172.21.15.37:0/627868912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc15f380 0x7f2bcc0d07b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 -- 172.21.15.37:0/627868912 >> 172.21.15.37:0/627868912 conn(0x7f2bcc0d4fe0 msgr2=0x7f2bcc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:03.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 -- 172.21.15.37:0/627868912 shutdown_connections 2024-05-10T08:44:03.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.557+0000 7f2bd0815640 1 -- 172.21.15.37:0/627868912 wait complete. 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.558+0000 7f2bd0815640 1 Processor -- start 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.558+0000 7f2bd0815640 1 -- start start 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bd0815640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bcc0d0cf0 0x7f2bcc1f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bd0815640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc0d3cd0 0x7f2bcc0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bd0815640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bcc15f380 0x7f2bcc14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bd0815640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc0d2000 con 0x7f2bcc15f380 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bd0815640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc0d2370 con 0x7f2bcc0d0cf0 2024-05-10T08:44:03.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bd0815640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2bcc15f760 con 0x7f2bcc0d3cd0 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bcad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bcc15f380 0x7f2bcc14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bcad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bcc15f380 0x7f2bcc14f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59348/0 (socket says 172.21.15.37:59348) 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bcad9d640 1 -- 172.21.15.37:0/79015210 learned_addr learned my addr 172.21.15.37:0/79015210 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bca59c640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bcc0d0cf0 0x7f2bcc1f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.559+0000 7f2bc9d9b640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc0d3cd0 0x7f2bcc0b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bcad9d640 1 -- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc0d3cd0 msgr2=0x7f2bcc0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bcad9d640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc0d3cd0 0x7f2bcc0b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bcad9d640 1 -- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bcc0d0cf0 msgr2=0x7f2bcc1f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bcad9d640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bcc0d0cf0 0x7f2bcc1f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bcad9d640 1 -- 172.21.15.37:0/79015210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc153730 con 0x7f2bcc15f380 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bcad9d640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bcc15f380 0x7f2bcc14f440 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009eb0 tx=0x7f2bc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bbaffd640 1 -- 172.21.15.37:0/79015210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4018020 con 0x7f2bcc15f380 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bcc14ffb0 con 0x7f2bcc15f380 2024-05-10T08:44:03.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bbaffd640 1 -- 172.21.15.37:0/79015210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc4014480 con 0x7f2bcc15f380 2024-05-10T08:44:03.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bbaffd640 1 -- 172.21.15.37:0/79015210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4014850 con 0x7f2bcc15f380 2024-05-10T08:44:03.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.560+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bcc1f8220 con 0x7f2bcc15f380 2024-05-10T08:44:03.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.561+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bcc0693f0 con 0x7f2bcc15f380 2024-05-10T08:44:03.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.562+0000 7f2bbaffd640 1 -- 172.21.15.37:0/79015210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2bc4005d10 con 0x7f2bcc15f380 2024-05-10T08:44:03.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.562+0000 7f2bbaffd640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.562+0000 7f2bbaffd640 1 -- 172.21.15.37:0/79015210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2bc40984d0 con 0x7f2bcc15f380 2024-05-10T08:44:03.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.562+0000 7f2bca59c640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.563+0000 7f2bca59c640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2bac0762d0 0x7f2bac078790 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc034000 tx=0x7f2bbc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.567+0000 7f2bbaffd640 1 -- 172.21.15.37:0/79015210 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2bc4022030 con 0x7f2bcc15f380 2024-05-10T08:44:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.757+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2bcc0b5f10 con 0x7f2bac0762d0 2024-05-10T08:44:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.763+0000 7f2bbaffd640 1 -- 172.21.15.37:0/79015210 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252009 (secure 0 0 0) 0x7f2bcc0b5f10 con 0x7f2bac0762d0 2024-05-10T08:44:03.765 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.766+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2bac0762d0 msgr2=0x7f2bac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.766+0000 7f2bd0815640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2bac0762d0 0x7f2bac078790 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc034000 tx=0x7f2bbc02e000 comp rx=0 tx=0).stop 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.766+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bcc15f380 msgr2=0x7f2bcc14f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.766+0000 7f2bd0815640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bcc15f380 0x7f2bcc14f440 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009eb0 tx=0x7f2bc400c490 comp rx=0 tx=0).stop 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 shutdown_connections 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bcc15f380 0x7f2bcc14f440 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bcc0d3cd0 0x7f2bcc0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 --2- 172.21.15.37:0/79015210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bcc0d0cf0 0x7f2bcc1f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 >> 172.21.15.37:0/79015210 conn(0x7f2bcc0d4fe0 msgr2=0x7f2bcc0cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 shutdown_connections 2024-05-10T08:44:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.767+0000 7f2bd0815640 1 -- 172.21.15.37:0/79015210 wait complete. 2024-05-10T08:44:03.777 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-05-10T08:44:03.379650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224472,"kb_used_data":8296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754750248,"statfs":{"total":773094113280,"available":772864253952,"internally_reserved":0,"allocated":8495104,"data_stored":4465188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001174"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.353005+0000","last_change":"2024-05-10T08:43:59.353407+0000","last_active":"2024-05-10T08:44:00.353005+0000","last_peered":"2024-05-10T08:44:00.353005+0000","last_clean":"2024-05-10T08:44:00.353005+0000","last_became_active":"2024-05-10T08:43:59.353084+0000","last_became_peered":"2024-05-10T08:43:59.353084+0000","last_unstale":"2024-05-10T08:44:00.353005+0000","last_undegraded":"2024-05-10T08:44:00.353005+0000","last_fullsized":"2024-05-10T08:44:00.353005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:46.276783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.383484+0000","last_change":"2024-05-10T08:43:59.379152+0000","last_active":"2024-05-10T08:43:59.383484+0000","last_peered":"2024-05-10T08:43:59.383484+0000","last_clean":"2024-05-10T08:43:59.383484+0000","last_became_active":"2024-05-10T08:43:59.375908+0000","last_became_peered":"2024-05-10T08:43:59.375908+0000","last_unstale":"2024-05-10T08:43:59.383484+0000","last_undegraded":"2024-05-10T08:43:59.383484+0000","last_fullsized":"2024-05-10T08:43:59.383484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:46.276783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348797+0000","last_change":"2024-05-10T08:43:59.382548+0000","last_active":"2024-05-10T08:44:00.348797+0000","last_peered":"2024-05-10T08:44:00.348797+0000","last_clean":"2024-05-10T08:44:00.348797+0000","last_became_active":"2024-05-10T08:43:59.382272+0000","last_became_peered":"2024-05-10T08:43:59.382272+0000","last_unstale":"2024-05-10T08:44:00.348797+0000","last_undegraded":"2024-05-10T08:44:00.348797+0000","last_fullsized":"2024-05-10T08:44:00.348797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:18:34.029079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352314+0000","last_change":"2024-05-10T08:43:59.364863+0000","last_active":"2024-05-10T08:44:00.352314+0000","last_peered":"2024-05-10T08:44:00.352314+0000","last_clean":"2024-05-10T08:44:00.352314+0000","last_became_active":"2024-05-10T08:43:59.364548+0000","last_became_peered":"2024-05-10T08:43:59.364548+0000","last_unstale":"2024-05-10T08:44:00.352314+0000","last_undegraded":"2024-05-10T08:44:00.352314+0000","last_fullsized":"2024-05-10T08:44:00.352314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:26.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.359141+0000","last_change":"2024-05-10T08:43:59.354467+0000","last_active":"2024-05-10T08:43:59.359141+0000","last_peered":"2024-05-10T08:43:59.359141+0000","last_clean":"2024-05-10T08:43:59.359141+0000","last_became_active":"2024-05-10T08:43:59.354188+0000","last_became_peered":"2024-05-10T08:43:59.354188+0000","last_unstale":"2024-05-10T08:43:59.359141+0000","last_undegraded":"2024-05-10T08:43:59.359141+0000","last_fullsized":"2024-05-10T08:43:59.359141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:05.814331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.368862+0000","last_change":"2024-05-10T08:43:59.365646+0000","last_active":"2024-05-10T08:43:59.368862+0000","last_peered":"2024-05-10T08:43:59.368862+0000","last_clean":"2024-05-10T08:43:59.368862+0000","last_became_active":"2024-05-10T08:43:59.365210+0000","last_became_peered":"2024-05-10T08:43:59.365210+0000","last_unstale":"2024-05-10T08:43:59.368862+0000","last_undegraded":"2024-05-10T08:43:59.368862+0000","last_fullsized":"2024-05-10T08:43:59.368862+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:15.028250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369479+0000","last_change":"2024-05-10T08:43:59.366845+0000","last_active":"2024-05-10T08:43:59.369479+0000","last_peered":"2024-05-10T08:43:59.369479+0000","last_clean":"2024-05-10T08:43:59.369479+0000","last_became_active":"2024-05-10T08:43:59.366552+0000","last_became_peered":"2024-05-10T08:43:59.366552+0000","last_unstale":"2024-05-10T08:43:59.369479+0000","last_undegraded":"2024-05-10T08:43:59.369479+0000","last_fullsized":"2024-05-10T08:43:59.369479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:37.239791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.360660+0000","last_change":"2024-05-10T08:43:59.355899+0000","last_active":"2024-05-10T08:43:59.360660+0000","last_peered":"2024-05-10T08:43:59.360660+0000","last_clean":"2024-05-10T08:43:59.360660+0000","last_became_active":"2024-05-10T08:43:59.355629+0000","last_became_peered":"2024-05-10T08:43:59.355629+0000","last_unstale":"2024-05-10T08:43:59.360660+0000","last_undegraded":"2024-05-10T08:43:59.360660+0000","last_fullsized":"2024-05-10T08:43:59.360660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:19:24.030067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.362781+0000","last_change":"2024-05-10T08:43:59.359923+0000","last_active":"2024-05-10T08:43:59.362781+0000","last_peered":"2024-05-10T08:43:59.362781+0000","last_clean":"2024-05-10T08:43:59.362781+0000","last_became_active":"2024-05-10T08:43:59.359635+0000","last_became_peered":"2024-05-10T08:43:59.359635+0000","last_unstale":"2024-05-10T08:43:59.362781+0000","last_undegraded":"2024-05-10T08:43:59.362781+0000","last_fullsized":"2024-05-10T08:43:59.362781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:49.355369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352207+0000","last_change":"2024-05-10T08:43:59.366801+0000","last_active":"2024-05-10T08:44:00.352207+0000","last_peered":"2024-05-10T08:44:00.352207+0000","last_clean":"2024-05-10T08:44:00.352207+0000","last_became_active":"2024-05-10T08:43:59.366500+0000","last_became_peered":"2024-05-10T08:43:59.366500+0000","last_unstale":"2024-05-10T08:44:00.352207+0000","last_undegraded":"2024-05-10T08:44:00.352207+0000","last_fullsized":"2024-05-10T08:44:00.352207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:44.778466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381814+0000","last_change":"2024-05-10T08:43:59.375603+0000","last_active":"2024-05-10T08:43:59.381814+0000","last_peered":"2024-05-10T08:43:59.381814+0000","last_clean":"2024-05-10T08:43:59.381814+0000","last_became_active":"2024-05-10T08:43:59.375249+0000","last_became_peered":"2024-05-10T08:43:59.375249+0000","last_unstale":"2024-05-10T08:43:59.381814+0000","last_undegraded":"2024-05-10T08:43:59.381814+0000","last_fullsized":"2024-05-10T08:43:59.381814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:18.779977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352356+0000","last_change":"2024-05-10T08:43:59.382525+0000","last_active":"2024-05-10T08:44:00.352356+0000","last_peered":"2024-05-10T08:44:00.352356+0000","last_clean":"2024-05-10T08:44:00.352356+0000","last_became_active":"2024-05-10T08:43:59.382222+0000","last_became_peered":"2024-05-10T08:43:59.382222+0000","last_unstale":"2024-05-10T08:44:00.352356+0000","last_undegraded":"2024-05-10T08:44:00.352356+0000","last_fullsized":"2024-05-10T08:44:00.352356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:57.239831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.376847+0000","last_change":"2024-05-10T08:43:59.366422+0000","last_active":"2024-05-10T08:43:59.376847+0000","last_peered":"2024-05-10T08:43:59.376847+0000","last_clean":"2024-05-10T08:43:59.376847+0000","last_became_active":"2024-05-10T08:43:59.366144+0000","last_became_peered":"2024-05-10T08:43:59.366144+0000","last_unstale":"2024-05-10T08:43:59.376847+0000","last_undegraded":"2024-05-10T08:43:59.376847+0000","last_fullsized":"2024-05-10T08:43:59.376847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:36.150043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.368843+0000","last_change":"2024-05-10T08:43:59.362957+0000","last_active":"2024-05-10T08:43:59.368843+0000","last_peered":"2024-05-10T08:43:59.368843+0000","last_clean":"2024-05-10T08:43:59.368843+0000","last_became_active":"2024-05-10T08:43:59.362238+0000","last_became_peered":"2024-05-10T08:43:59.362238+0000","last_unstale":"2024-05-10T08:43:59.368843+0000","last_undegraded":"2024-05-10T08:43:59.368843+0000","last_fullsized":"2024-05-10T08:43:59.368843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:04:39.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.383492+0000","last_change":"2024-05-10T08:43:59.379102+0000","last_active":"2024-05-10T08:43:59.383492+0000","last_peered":"2024-05-10T08:43:59.383492+0000","last_clean":"2024-05-10T08:43:59.383492+0000","last_became_active":"2024-05-10T08:43:59.376073+0000","last_became_peered":"2024-05-10T08:43:59.376073+0000","last_unstale":"2024-05-10T08:43:59.383492+0000","last_undegraded":"2024-05-10T08:43:59.383492+0000","last_fullsized":"2024-05-10T08:43:59.383492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:11.017449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352569+0000","last_change":"2024-05-10T08:43:59.358503+0000","last_active":"2024-05-10T08:44:00.352569+0000","last_peered":"2024-05-10T08:44:00.352569+0000","last_clean":"2024-05-10T08:44:00.352569+0000","last_became_active":"2024-05-10T08:43:59.358235+0000","last_became_peered":"2024-05-10T08:43:59.358235+0000","last_unstale":"2024-05-10T08:44:00.352569+0000","last_undegraded":"2024-05-10T08:44:00.352569+0000","last_fullsized":"2024-05-10T08:44:00.352569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:26:18.779977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377076+0000","last_change":"2024-05-10T08:43:59.368050+0000","last_active":"2024-05-10T08:43:59.377076+0000","last_peered":"2024-05-10T08:43:59.377076+0000","last_clean":"2024-05-10T08:43:59.377076+0000","last_became_active":"2024-05-10T08:43:59.367689+0000","last_became_peered":"2024-05-10T08:43:59.367689+0000","last_unstale":"2024-05-10T08:43:59.377076+0000","last_undegraded":"2024-05-10T08:43:59.377076+0000","last_fullsized":"2024-05-10T08:43:59.377076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:21:14.313781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348917+0000","last_change":"2024-05-10T08:43:59.364165+0000","last_active":"2024-05-10T08:44:00.348917+0000","last_peered":"2024-05-10T08:44:00.348917+0000","last_clean":"2024-05-10T08:44:00.348917+0000","last_became_active":"2024-05-10T08:43:59.361867+0000","last_became_peered":"2024-05-10T08:43:59.361867+0000","last_unstale":"2024-05-10T08:44:00.348917+0000","last_undegraded":"2024-05-10T08:44:00.348917+0000","last_fullsized":"2024-05-10T08:44:00.348917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:57.627816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381699+0000","last_change":"2024-05-10T08:43:59.377968+0000","last_active":"2024-05-10T08:43:59.381699+0000","last_peered":"2024-05-10T08:43:59.381699+0000","last_clean":"2024-05-10T08:43:59.381699+0000","last_became_active":"2024-05-10T08:43:59.377689+0000","last_became_peered":"2024-05-10T08:43:59.377689+0000","last_unstale":"2024-05-10T08:43:59.381699+0000","last_undegraded":"2024-05-10T08:43:59.381699+0000","last_fullsized":"2024-05-10T08:43:59.381699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:35:23.612623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366454+0000","last_change":"2024-05-10T08:43:59.361044+0000","last_active":"2024-05-10T08:43:59.366454+0000","last_peered":"2024-05-10T08:43:59.366454+0000","last_clean":"2024-05-10T08:43:59.366454+0000","last_became_active":"2024-05-10T08:43:59.360721+0000","last_became_peered":"2024-05-10T08:43:59.360721+0000","last_unstale":"2024-05-10T08:43:59.366454+0000","last_undegraded":"2024-05-10T08:43:59.366454+0000","last_fullsized":"2024-05-10T08:43:59.366454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:16.154004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.367029+0000","last_change":"2024-05-10T08:43:59.360667+0000","last_active":"2024-05-10T08:43:59.367029+0000","last_peered":"2024-05-10T08:43:59.367029+0000","last_clean":"2024-05-10T08:43:59.367029+0000","last_became_active":"2024-05-10T08:43:59.360398+0000","last_became_peered":"2024-05-10T08:43:59.360398+0000","last_unstale":"2024-05-10T08:43:59.367029+0000","last_undegraded":"2024-05-10T08:43:59.367029+0000","last_fullsized":"2024-05-10T08:43:59.367029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:39:09.825961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377382+0000","last_change":"2024-05-10T08:43:59.370516+0000","last_active":"2024-05-10T08:43:59.377382+0000","last_peered":"2024-05-10T08:43:59.377382+0000","last_clean":"2024-05-10T08:43:59.377382+0000","last_became_active":"2024-05-10T08:43:59.370234+0000","last_became_peered":"2024-05-10T08:43:59.370234+0000","last_unstale":"2024-05-10T08:43:59.377382+0000","last_undegraded":"2024-05-10T08:43:59.377382+0000","last_fullsized":"2024-05-10T08:43:59.377382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:00:26.672697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.362662+0000","last_change":"2024-05-10T08:43:59.359625+0000","last_active":"2024-05-10T08:43:59.362662+0000","last_peered":"2024-05-10T08:43:59.362662+0000","last_clean":"2024-05-10T08:43:59.362662+0000","last_became_active":"2024-05-10T08:43:59.359344+0000","last_became_peered":"2024-05-10T08:43:59.359344+0000","last_unstale":"2024-05-10T08:43:59.362662+0000","last_undegraded":"2024-05-10T08:43:59.362662+0000","last_fullsized":"2024-05-10T08:43:59.362662+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:52:46.689503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.382782+0000","last_change":"2024-05-10T08:43:59.372561+0000","last_active":"2024-05-10T08:43:59.382782+0000","last_peered":"2024-05-10T08:43:59.382782+0000","last_clean":"2024-05-10T08:43:59.382782+0000","last_became_active":"2024-05-10T08:43:59.372272+0000","last_became_peered":"2024-05-10T08:43:59.372272+0000","last_unstale":"2024-05-10T08:43:59.382782+0000","last_undegraded":"2024-05-10T08:43:59.382782+0000","last_fullsized":"2024-05-10T08:43:59.382782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:13:02.563642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381317+0000","last_change":"2024-05-10T08:43:59.371265+0000","last_active":"2024-05-10T08:43:59.381317+0000","last_peered":"2024-05-10T08:43:59.381317+0000","last_clean":"2024-05-10T08:43:59.381317+0000","last_became_active":"2024-05-10T08:43:59.370939+0000","last_became_peered":"2024-05-10T08:43:59.370939+0000","last_unstale":"2024-05-10T08:43:59.381317+0000","last_undegraded":"2024-05-10T08:43:59.381317+0000","last_fullsized":"2024-05-10T08:43:59.381317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:57.239831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352358+0000","last_change":"2024-05-10T08:43:59.382841+0000","last_active":"2024-05-10T08:44:00.352358+0000","last_peered":"2024-05-10T08:44:00.352358+0000","last_clean":"2024-05-10T08:44:00.352358+0000","last_became_active":"2024-05-10T08:43:59.382581+0000","last_became_peered":"2024-05-10T08:43:59.382581+0000","last_unstale":"2024-05-10T08:44:00.352358+0000","last_undegraded":"2024-05-10T08:44:00.352358+0000","last_fullsized":"2024-05-10T08:44:00.352358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:56.265888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352797+0000","last_change":"2024-05-10T08:43:59.360925+0000","last_active":"2024-05-10T08:44:00.352797+0000","last_peered":"2024-05-10T08:44:00.352797+0000","last_clean":"2024-05-10T08:44:00.352797+0000","last_became_active":"2024-05-10T08:43:59.360424+0000","last_became_peered":"2024-05-10T08:43:59.360424+0000","last_unstale":"2024-05-10T08:44:00.352797+0000","last_undegraded":"2024-05-10T08:44:00.352797+0000","last_fullsized":"2024-05-10T08:44:00.352797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:55.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.375079+0000","last_change":"2024-05-10T08:43:59.363278+0000","last_active":"2024-05-10T08:43:59.375079+0000","last_peered":"2024-05-10T08:43:59.375079+0000","last_clean":"2024-05-10T08:43:59.375079+0000","last_became_active":"2024-05-10T08:43:59.362970+0000","last_became_peered":"2024-05-10T08:43:59.362970+0000","last_unstale":"2024-05-10T08:43:59.375079+0000","last_undegraded":"2024-05-10T08:43:59.375079+0000","last_fullsized":"2024-05-10T08:43:59.375079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:25:16.815644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380892+0000","last_change":"2024-05-10T08:43:59.363329+0000","last_active":"2024-05-10T08:43:59.380892+0000","last_peered":"2024-05-10T08:43:59.380892+0000","last_clean":"2024-05-10T08:43:59.380892+0000","last_became_active":"2024-05-10T08:43:59.362962+0000","last_became_peered":"2024-05-10T08:43:59.362962+0000","last_unstale":"2024-05-10T08:43:59.380892+0000","last_undegraded":"2024-05-10T08:43:59.380892+0000","last_fullsized":"2024-05-10T08:43:59.380892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:26.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352094+0000","last_change":"2024-05-10T08:43:59.376885+0000","last_active":"2024-05-10T08:44:00.352094+0000","last_peered":"2024-05-10T08:44:00.352094+0000","last_clean":"2024-05-10T08:44:00.352094+0000","last_became_active":"2024-05-10T08:43:59.376607+0000","last_became_peered":"2024-05-10T08:43:59.376607+0000","last_unstale":"2024-05-10T08:44:00.352094+0000","last_undegraded":"2024-05-10T08:44:00.352094+0000","last_fullsized":"2024-05-10T08:44:00.352094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:42.021432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348568+0000","last_change":"2024-05-10T08:43:59.363822+0000","last_active":"2024-05-10T08:44:00.348568+0000","last_peered":"2024-05-10T08:44:00.348568+0000","last_clean":"2024-05-10T08:44:00.348568+0000","last_became_active":"2024-05-10T08:43:59.363522+0000","last_became_peered":"2024-05-10T08:43:59.363522+0000","last_unstale":"2024-05-10T08:44:00.348568+0000","last_undegraded":"2024-05-10T08:44:00.348568+0000","last_fullsized":"2024-05-10T08:44:00.348568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:37.239791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352570+0000","last_change":"2024-05-10T08:43:59.353164+0000","last_active":"2024-05-10T08:44:00.352570+0000","last_peered":"2024-05-10T08:44:00.352570+0000","last_clean":"2024-05-10T08:44:00.352570+0000","last_became_active":"2024-05-10T08:43:59.352864+0000","last_became_peered":"2024-05-10T08:43:59.352864+0000","last_unstale":"2024-05-10T08:44:00.352570+0000","last_undegraded":"2024-05-10T08:44:00.352570+0000","last_fullsized":"2024-05-10T08:44:00.352570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:44:33.733587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348515+0000","last_change":"2024-05-10T08:43:59.362154+0000","last_active":"2024-05-10T08:44:00.348515+0000","last_peered":"2024-05-10T08:44:00.348515+0000","last_clean":"2024-05-10T08:44:00.348515+0000","last_became_active":"2024-05-10T08:43:59.361836+0000","last_became_peered":"2024-05-10T08:43:59.361836+0000","last_unstale":"2024-05-10T08:44:00.348515+0000","last_undegraded":"2024-05-10T08:44:00.348515+0000","last_fullsized":"2024-05-10T08:44:00.348515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:48.822270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.379820+0000","last_change":"2024-05-10T08:43:58.365524+0000","last_active":"2024-05-10T08:43:59.379820+0000","last_peered":"2024-05-10T08:43:59.379820+0000","last_clean":"2024-05-10T08:43:59.379820+0000","last_became_active":"2024-05-10T08:43:58.363628+0000","last_became_peered":"2024-05-10T08:43:58.363628+0000","last_unstale":"2024-05-10T08:43:59.379820+0000","last_undegraded":"2024-05-10T08:43:59.379820+0000","last_fullsized":"2024-05-10T08:43:59.379820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:07.426630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381403+0000","last_change":"2024-05-10T08:43:59.372386+0000","last_active":"2024-05-10T08:43:59.381403+0000","last_peered":"2024-05-10T08:43:59.381403+0000","last_clean":"2024-05-10T08:43:59.381403+0000","last_became_active":"2024-05-10T08:43:59.372093+0000","last_became_peered":"2024-05-10T08:43:59.372093+0000","last_unstale":"2024-05-10T08:43:59.381403+0000","last_undegraded":"2024-05-10T08:43:59.381403+0000","last_fullsized":"2024-05-10T08:43:59.381403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:43.667795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352897+0000","last_change":"2024-05-10T08:43:58.357397+0000","last_active":"2024-05-10T08:44:00.352897+0000","last_peered":"2024-05-10T08:44:00.352897+0000","last_clean":"2024-05-10T08:44:00.352897+0000","last_became_active":"2024-05-10T08:43:58.357109+0000","last_became_peered":"2024-05-10T08:43:58.357109+0000","last_unstale":"2024-05-10T08:44:00.352897+0000","last_undegraded":"2024-05-10T08:44:00.352897+0000","last_fullsized":"2024-05-10T08:44:00.352897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:43.775910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366963+0000","last_change":"2024-05-10T08:43:59.361161+0000","last_active":"2024-05-10T08:43:59.366963+0000","last_peered":"2024-05-10T08:43:59.366963+0000","last_clean":"2024-05-10T08:43:59.366963+0000","last_became_active":"2024-05-10T08:43:59.360502+0000","last_became_peered":"2024-05-10T08:43:59.360502+0000","last_unstale":"2024-05-10T08:43:59.366963+0000","last_undegraded":"2024-05-10T08:43:59.366963+0000","last_fullsized":"2024-05-10T08:43:59.366963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:15.023662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352897+0000","last_change":"2024-05-10T08:43:58.364799+0000","last_active":"2024-05-10T08:44:00.352897+0000","last_peered":"2024-05-10T08:44:00.352897+0000","last_clean":"2024-05-10T08:44:00.352897+0000","last_became_active":"2024-05-10T08:43:58.364467+0000","last_became_peered":"2024-05-10T08:43:58.364467+0000","last_unstale":"2024-05-10T08:44:00.352897+0000","last_undegraded":"2024-05-10T08:44:00.352897+0000","last_fullsized":"2024-05-10T08:44:00.352897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:52.482063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.360800+0000","last_change":"2024-05-10T08:43:59.358676+0000","last_active":"2024-05-10T08:43:59.360800+0000","last_peered":"2024-05-10T08:43:59.360800+0000","last_clean":"2024-05-10T08:43:59.360800+0000","last_became_active":"2024-05-10T08:43:59.358405+0000","last_became_peered":"2024-05-10T08:43:59.358405+0000","last_unstale":"2024-05-10T08:43:59.360800+0000","last_undegraded":"2024-05-10T08:43:59.360800+0000","last_fullsized":"2024-05-10T08:43:59.360800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:01:53.850698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381133+0000","last_change":"2024-05-10T08:43:58.360383+0000","last_active":"2024-05-10T08:43:59.381133+0000","last_peered":"2024-05-10T08:43:59.381133+0000","last_clean":"2024-05-10T08:43:59.381133+0000","last_became_active":"2024-05-10T08:43:58.360116+0000","last_became_peered":"2024-05-10T08:43:58.360116+0000","last_unstale":"2024-05-10T08:43:59.381133+0000","last_undegraded":"2024-05-10T08:43:59.381133+0000","last_fullsized":"2024-05-10T08:43:59.381133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:34.982084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380993+0000","last_change":"2024-05-10T08:43:59.363124+0000","last_active":"2024-05-10T08:43:59.380993+0000","last_peered":"2024-05-10T08:43:59.380993+0000","last_clean":"2024-05-10T08:43:59.380993+0000","last_became_active":"2024-05-10T08:43:59.362790+0000","last_became_peered":"2024-05-10T08:43:59.362790+0000","last_unstale":"2024-05-10T08:43:59.380993+0000","last_undegraded":"2024-05-10T08:43:59.380993+0000","last_fullsized":"2024-05-10T08:43:59.380993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:44.778466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.372699+0000","last_change":"2024-05-10T08:43:58.362035+0000","last_active":"2024-05-10T08:43:59.372699+0000","last_peered":"2024-05-10T08:43:59.372699+0000","last_clean":"2024-05-10T08:43:59.372699+0000","last_became_active":"2024-05-10T08:43:58.361304+0000","last_became_peered":"2024-05-10T08:43:58.361304+0000","last_unstale":"2024-05-10T08:43:59.372699+0000","last_undegraded":"2024-05-10T08:43:59.372699+0000","last_fullsized":"2024-05-10T08:43:59.372699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:10.541308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381446+0000","last_change":"2024-05-10T08:43:59.371965+0000","last_active":"2024-05-10T08:43:59.381446+0000","last_peered":"2024-05-10T08:43:59.381446+0000","last_clean":"2024-05-10T08:43:59.381446+0000","last_became_active":"2024-05-10T08:43:59.363130+0000","last_became_peered":"2024-05-10T08:43:59.363130+0000","last_unstale":"2024-05-10T08:43:59.381446+0000","last_undegraded":"2024-05-10T08:43:59.381446+0000","last_fullsized":"2024-05-10T08:43:59.381446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:56.265888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.351821+0000","last_change":"2024-05-10T08:43:58.363611+0000","last_active":"2024-05-10T08:44:00.351821+0000","last_peered":"2024-05-10T08:44:00.351821+0000","last_clean":"2024-05-10T08:44:00.351821+0000","last_became_active":"2024-05-10T08:43:58.363359+0000","last_became_peered":"2024-05-10T08:43:58.363359+0000","last_unstale":"2024-05-10T08:44:00.351821+0000","last_undegraded":"2024-05-10T08:44:00.351821+0000","last_fullsized":"2024-05-10T08:44:00.351821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:40.705032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369672+0000","last_change":"2024-05-10T08:43:59.367948+0000","last_active":"2024-05-10T08:43:59.369672+0000","last_peered":"2024-05-10T08:43:59.369672+0000","last_clean":"2024-05-10T08:43:59.369672+0000","last_became_active":"2024-05-10T08:43:59.367650+0000","last_became_peered":"2024-05-10T08:43:59.367650+0000","last_unstale":"2024-05-10T08:43:59.369672+0000","last_undegraded":"2024-05-10T08:43:59.369672+0000","last_fullsized":"2024-05-10T08:43:59.369672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:56.692135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.355461+0000","last_change":"2024-05-10T08:43:58.359933+0000","last_active":"2024-05-10T08:43:59.355461+0000","last_peered":"2024-05-10T08:43:59.355461+0000","last_clean":"2024-05-10T08:43:59.355461+0000","last_became_active":"2024-05-10T08:43:58.359665+0000","last_became_peered":"2024-05-10T08:43:58.359665+0000","last_unstale":"2024-05-10T08:43:59.355461+0000","last_undegraded":"2024-05-10T08:43:59.355461+0000","last_fullsized":"2024-05-10T08:43:59.355461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:37.629131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366421+0000","last_change":"2024-05-10T08:43:59.363931+0000","last_active":"2024-05-10T08:43:59.366421+0000","last_peered":"2024-05-10T08:43:59.366421+0000","last_clean":"2024-05-10T08:43:59.366421+0000","last_became_active":"2024-05-10T08:43:59.362731+0000","last_became_peered":"2024-05-10T08:43:59.362731+0000","last_unstale":"2024-05-10T08:43:59.366421+0000","last_undegraded":"2024-05-10T08:43:59.366421+0000","last_fullsized":"2024-05-10T08:43:59.366421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:22.377614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.349404+0000","last_change":"2024-05-10T08:43:58.358065+0000","last_active":"2024-05-10T08:43:59.349404+0000","last_peered":"2024-05-10T08:43:59.349404+0000","last_clean":"2024-05-10T08:43:59.349404+0000","last_became_active":"2024-05-10T08:43:58.357779+0000","last_became_peered":"2024-05-10T08:43:58.357779+0000","last_unstale":"2024-05-10T08:43:59.349404+0000","last_undegraded":"2024-05-10T08:43:59.349404+0000","last_fullsized":"2024-05-10T08:43:59.349404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:31.584673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.382803+0000","last_change":"2024-05-10T08:43:59.374889+0000","last_active":"2024-05-10T08:43:59.382803+0000","last_peered":"2024-05-10T08:43:59.382803+0000","last_clean":"2024-05-10T08:43:59.382803+0000","last_became_active":"2024-05-10T08:43:59.374521+0000","last_became_peered":"2024-05-10T08:43:59.374521+0000","last_unstale":"2024-05-10T08:43:59.382803+0000","last_undegraded":"2024-05-10T08:43:59.382803+0000","last_fullsized":"2024-05-10T08:43:59.382803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:44:33.733587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.353104+0000","last_change":"2024-05-10T08:43:58.362518+0000","last_active":"2024-05-10T08:44:00.353104+0000","last_peered":"2024-05-10T08:44:00.353104+0000","last_clean":"2024-05-10T08:44:00.353104+0000","last_became_active":"2024-05-10T08:43:58.362258+0000","last_became_peered":"2024-05-10T08:43:58.362258+0000","last_unstale":"2024-05-10T08:44:00.353104+0000","last_undegraded":"2024-05-10T08:44:00.353104+0000","last_fullsized":"2024-05-10T08:44:00.353104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:19:48.263710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.351980+0000","last_change":"2024-05-10T08:43:59.359607+0000","last_active":"2024-05-10T08:44:00.351980+0000","last_peered":"2024-05-10T08:44:00.351980+0000","last_clean":"2024-05-10T08:44:00.351980+0000","last_became_active":"2024-05-10T08:43:59.359125+0000","last_became_peered":"2024-05-10T08:43:59.359125+0000","last_unstale":"2024-05-10T08:44:00.351980+0000","last_undegraded":"2024-05-10T08:44:00.351980+0000","last_fullsized":"2024-05-10T08:44:00.351980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:06.223000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352464+0000","last_change":"2024-05-10T08:43:58.360603+0000","last_active":"2024-05-10T08:44:00.352464+0000","last_peered":"2024-05-10T08:44:00.352464+0000","last_clean":"2024-05-10T08:44:00.352464+0000","last_became_active":"2024-05-10T08:43:58.359919+0000","last_became_peered":"2024-05-10T08:43:58.359919+0000","last_unstale":"2024-05-10T08:44:00.352464+0000","last_undegraded":"2024-05-10T08:44:00.352464+0000","last_fullsized":"2024-05-10T08:44:00.352464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:41.669376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.368819+0000","last_change":"2024-05-10T08:43:59.362258+0000","last_active":"2024-05-10T08:43:59.368819+0000","last_peered":"2024-05-10T08:43:59.368819+0000","last_clean":"2024-05-10T08:43:59.368819+0000","last_became_active":"2024-05-10T08:43:59.361803+0000","last_became_peered":"2024-05-10T08:43:59.361803+0000","last_unstale":"2024-05-10T08:43:59.368819+0000","last_undegraded":"2024-05-10T08:43:59.368819+0000","last_fullsized":"2024-05-10T08:43:59.368819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:59:11.217789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.379384+0000","last_change":"2024-05-10T08:43:58.360275+0000","last_active":"2024-05-10T08:43:59.379384+0000","last_peered":"2024-05-10T08:43:59.379384+0000","last_clean":"2024-05-10T08:43:59.379384+0000","last_became_active":"2024-05-10T08:43:58.359750+0000","last_became_peered":"2024-05-10T08:43:58.359750+0000","last_unstale":"2024-05-10T08:43:59.379384+0000","last_undegraded":"2024-05-10T08:43:59.379384+0000","last_fullsized":"2024-05-10T08:43:59.379384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:25.930859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348696+0000","last_change":"2024-05-10T08:43:59.382518+0000","last_active":"2024-05-10T08:44:00.348696+0000","last_peered":"2024-05-10T08:44:00.348696+0000","last_clean":"2024-05-10T08:44:00.348696+0000","last_became_active":"2024-05-10T08:43:59.382213+0000","last_became_peered":"2024-05-10T08:43:59.382213+0000","last_unstale":"2024-05-10T08:44:00.348696+0000","last_undegraded":"2024-05-10T08:44:00.348696+0000","last_fullsized":"2024-05-10T08:44:00.348696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:14:42.671932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.386650+0000","last_change":"2024-05-10T08:43:58.359823+0000","last_active":"2024-05-10T08:43:59.386650+0000","last_peered":"2024-05-10T08:43:59.386650+0000","last_clean":"2024-05-10T08:43:59.386650+0000","last_became_active":"2024-05-10T08:43:58.359547+0000","last_became_peered":"2024-05-10T08:43:58.359547+0000","last_unstale":"2024-05-10T08:43:59.386650+0000","last_undegraded":"2024-05-10T08:43:59.386650+0000","last_fullsized":"2024-05-10T08:43:59.386650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:11.176981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352453+0000","last_change":"2024-05-10T08:43:59.365517+0000","last_active":"2024-05-10T08:44:00.352453+0000","last_peered":"2024-05-10T08:44:00.352453+0000","last_clean":"2024-05-10T08:44:00.352453+0000","last_became_active":"2024-05-10T08:43:59.365184+0000","last_became_peered":"2024-05-10T08:43:59.365184+0000","last_unstale":"2024-05-10T08:44:00.352453+0000","last_undegraded":"2024-05-10T08:44:00.352453+0000","last_fullsized":"2024-05-10T08:44:00.352453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:43.667795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.351932+0000","last_change":"2024-05-10T08:43:58.357804+0000","last_active":"2024-05-10T08:44:00.351932+0000","last_peered":"2024-05-10T08:44:00.351932+0000","last_clean":"2024-05-10T08:44:00.351932+0000","last_became_active":"2024-05-10T08:43:58.357515+0000","last_became_peered":"2024-05-10T08:43:58.357515+0000","last_unstale":"2024-05-10T08:44:00.351932+0000","last_undegraded":"2024-05-10T08:44:00.351932+0000","last_fullsized":"2024-05-10T08:44:00.351932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:36.237236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366370+0000","last_change":"2024-05-10T08:43:59.361963+0000","last_active":"2024-05-10T08:43:59.366370+0000","last_peered":"2024-05-10T08:43:59.366370+0000","last_clean":"2024-05-10T08:43:59.366370+0000","last_became_active":"2024-05-10T08:43:59.361646+0000","last_became_peered":"2024-05-10T08:43:59.361646+0000","last_unstale":"2024-05-10T08:43:59.366370+0000","last_undegraded":"2024-05-10T08:43:59.366370+0000","last_fullsized":"2024-05-10T08:43:59.366370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:44:34.347110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352194+0000","last_change":"2024-05-10T08:43:58.360363+0000","last_active":"2024-05-10T08:44:00.352194+0000","last_peered":"2024-05-10T08:44:00.352194+0000","last_clean":"2024-05-10T08:44:00.352194+0000","last_became_active":"2024-05-10T08:43:58.360072+0000","last_became_peered":"2024-05-10T08:43:58.360072+0000","last_unstale":"2024-05-10T08:44:00.352194+0000","last_undegraded":"2024-05-10T08:44:00.352194+0000","last_fullsized":"2024-05-10T08:44:00.352194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:11.228637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.365636+0000","last_change":"2024-05-10T08:43:59.363928+0000","last_active":"2024-05-10T08:43:59.365636+0000","last_peered":"2024-05-10T08:43:59.365636+0000","last_clean":"2024-05-10T08:43:59.365636+0000","last_became_active":"2024-05-10T08:43:59.363555+0000","last_became_peered":"2024-05-10T08:43:59.363555+0000","last_unstale":"2024-05-10T08:43:59.365636+0000","last_undegraded":"2024-05-10T08:43:59.365636+0000","last_fullsized":"2024-05-10T08:43:59.365636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:54.675607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.348841+0000","last_change":"2024-05-10T08:43:58.365459+0000","last_active":"2024-05-10T08:43:59.348841+0000","last_peered":"2024-05-10T08:43:59.348841+0000","last_clean":"2024-05-10T08:43:59.348841+0000","last_became_active":"2024-05-10T08:43:58.363694+0000","last_became_peered":"2024-05-10T08:43:58.363694+0000","last_unstale":"2024-05-10T08:43:59.348841+0000","last_undegraded":"2024-05-10T08:43:59.348841+0000","last_fullsized":"2024-05-10T08:43:59.348841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:38.970373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369254+0000","last_change":"2024-05-10T08:43:59.366211+0000","last_active":"2024-05-10T08:43:59.369254+0000","last_peered":"2024-05-10T08:43:59.369254+0000","last_clean":"2024-05-10T08:43:59.369254+0000","last_became_active":"2024-05-10T08:43:59.365869+0000","last_became_peered":"2024-05-10T08:43:59.365869+0000","last_unstale":"2024-05-10T08:43:59.369254+0000","last_undegraded":"2024-05-10T08:43:59.369254+0000","last_fullsized":"2024-05-10T08:43:59.369254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:48.822270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.387370+0000","last_change":"2024-05-10T08:43:58.364500+0000","last_active":"2024-05-10T08:43:59.387370+0000","last_peered":"2024-05-10T08:43:59.387370+0000","last_clean":"2024-05-10T08:43:59.387370+0000","last_became_active":"2024-05-10T08:43:58.364192+0000","last_became_peered":"2024-05-10T08:43:58.364192+0000","last_unstale":"2024-05-10T08:43:59.387370+0000","last_undegraded":"2024-05-10T08:43:59.387370+0000","last_fullsized":"2024-05-10T08:43:59.387370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:19:48.263710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380245+0000","last_change":"2024-05-10T08:43:59.375528+0000","last_active":"2024-05-10T08:43:59.380245+0000","last_peered":"2024-05-10T08:43:59.380245+0000","last_clean":"2024-05-10T08:43:59.380245+0000","last_became_active":"2024-05-10T08:43:59.374975+0000","last_became_peered":"2024-05-10T08:43:59.374975+0000","last_unstale":"2024-05-10T08:43:59.380245+0000","last_undegraded":"2024-05-10T08:43:59.380245+0000","last_fullsized":"2024-05-10T08:43:59.380245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:50.119082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.353205+0000","last_change":"2024-05-10T08:43:58.365573+0000","last_active":"2024-05-10T08:44:00.353205+0000","last_peered":"2024-05-10T08:44:00.353205+0000","last_clean":"2024-05-10T08:44:00.353205+0000","last_became_active":"2024-05-10T08:43:58.365356+0000","last_became_peered":"2024-05-10T08:43:58.365356+0000","last_unstale":"2024-05-10T08:44:00.353205+0000","last_undegraded":"2024-05-10T08:44:00.353205+0000","last_fullsized":"2024-05-10T08:44:00.353205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:37.629131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377017+0000","last_change":"2024-05-10T08:43:59.365037+0000","last_active":"2024-05-10T08:43:59.377017+0000","last_peered":"2024-05-10T08:43:59.377017+0000","last_clean":"2024-05-10T08:43:59.377017+0000","last_became_active":"2024-05-10T08:43:59.364713+0000","last_became_peered":"2024-05-10T08:43:59.364713+0000","last_unstale":"2024-05-10T08:43:59.377017+0000","last_undegraded":"2024-05-10T08:43:59.377017+0000","last_fullsized":"2024-05-10T08:43:59.377017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:01.542435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377304+0000","last_change":"2024-05-10T08:43:58.366719+0000","last_active":"2024-05-10T08:43:59.377304+0000","last_peered":"2024-05-10T08:43:59.377304+0000","last_clean":"2024-05-10T08:43:59.377304+0000","last_became_active":"2024-05-10T08:43:58.366473+0000","last_became_peered":"2024-05-10T08:43:58.366473+0000","last_unstale":"2024-05-10T08:43:59.377304+0000","last_undegraded":"2024-05-10T08:43:59.377304+0000","last_fullsized":"2024-05-10T08:43:59.377304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:42.483051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.383784+0000","last_change":"2024-05-10T08:43:59.377438+0000","last_active":"2024-05-10T08:43:59.383784+0000","last_peered":"2024-05-10T08:43:59.383784+0000","last_clean":"2024-05-10T08:43:59.383784+0000","last_became_active":"2024-05-10T08:43:59.376430+0000","last_became_peered":"2024-05-10T08:43:59.376430+0000","last_unstale":"2024-05-10T08:43:59.383784+0000","last_undegraded":"2024-05-10T08:43:59.383784+0000","last_fullsized":"2024-05-10T08:43:59.383784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.645498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.377220+0000","last_change":"2024-05-10T08:43:58.360042+0000","last_active":"2024-05-10T08:43:59.377220+0000","last_peered":"2024-05-10T08:43:59.377220+0000","last_clean":"2024-05-10T08:43:59.377220+0000","last_became_active":"2024-05-10T08:43:58.359400+0000","last_became_peered":"2024-05-10T08:43:58.359400+0000","last_unstale":"2024-05-10T08:43:59.377220+0000","last_undegraded":"2024-05-10T08:43:59.377220+0000","last_fullsized":"2024-05-10T08:43:59.377220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:32.337777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381792+0000","last_change":"2024-05-10T08:43:59.378063+0000","last_active":"2024-05-10T08:43:59.381792+0000","last_peered":"2024-05-10T08:43:59.381792+0000","last_clean":"2024-05-10T08:43:59.381792+0000","last_became_active":"2024-05-10T08:43:59.377732+0000","last_became_peered":"2024-05-10T08:43:59.377732+0000","last_unstale":"2024-05-10T08:43:59.381792+0000","last_undegraded":"2024-05-10T08:43:59.381792+0000","last_fullsized":"2024-05-10T08:43:59.381792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:50.718811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348696+0000","last_change":"2024-05-10T08:43:58.358061+0000","last_active":"2024-05-10T08:44:00.348696+0000","last_peered":"2024-05-10T08:44:00.348696+0000","last_clean":"2024-05-10T08:44:00.348696+0000","last_became_active":"2024-05-10T08:43:58.357771+0000","last_became_peered":"2024-05-10T08:43:58.357771+0000","last_unstale":"2024-05-10T08:44:00.348696+0000","last_undegraded":"2024-05-10T08:44:00.348696+0000","last_fullsized":"2024-05-10T08:44:00.348696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:24.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381446+0000","last_change":"2024-05-10T08:43:59.372809+0000","last_active":"2024-05-10T08:43:59.381446+0000","last_peered":"2024-05-10T08:43:59.381446+0000","last_clean":"2024-05-10T08:43:59.381446+0000","last_became_active":"2024-05-10T08:43:59.372573+0000","last_became_peered":"2024-05-10T08:43:59.372573+0000","last_unstale":"2024-05-10T08:43:59.381446+0000","last_undegraded":"2024-05-10T08:43:59.381446+0000","last_fullsized":"2024-05-10T08:43:59.381446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:41.133875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.380284+0000","last_change":"2024-05-10T08:43:58.367145+0000","last_active":"2024-05-10T08:43:59.380284+0000","last_peered":"2024-05-10T08:43:59.380284+0000","last_clean":"2024-05-10T08:43:59.380284+0000","last_became_active":"2024-05-10T08:43:58.366531+0000","last_became_peered":"2024-05-10T08:43:58.366531+0000","last_unstale":"2024-05-10T08:43:59.380284+0000","last_undegraded":"2024-05-10T08:43:59.380284+0000","last_fullsized":"2024-05-10T08:43:59.380284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:19:54.907584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381716+0000","last_change":"2024-05-10T08:43:59.376269+0000","last_active":"2024-05-10T08:43:59.381716+0000","last_peered":"2024-05-10T08:43:59.381716+0000","last_clean":"2024-05-10T08:43:59.381716+0000","last_became_active":"2024-05-10T08:43:59.375599+0000","last_became_peered":"2024-05-10T08:43:59.375599+0000","last_unstale":"2024-05-10T08:43:59.381716+0000","last_undegraded":"2024-05-10T08:43:59.381716+0000","last_fullsized":"2024-05-10T08:43:59.381716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:55.862451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.353458+0000","last_change":"2024-05-10T08:43:58.367827+0000","last_active":"2024-05-10T08:43:59.353458+0000","last_peered":"2024-05-10T08:43:59.353458+0000","last_clean":"2024-05-10T08:43:59.353458+0000","last_became_active":"2024-05-10T08:43:58.367606+0000","last_became_peered":"2024-05-10T08:43:58.367606+0000","last_unstale":"2024-05-10T08:43:59.353458+0000","last_undegraded":"2024-05-10T08:43:59.353458+0000","last_fullsized":"2024-05-10T08:43:59.353458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:41.611317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366990+0000","last_change":"2024-05-10T08:43:59.364066+0000","last_active":"2024-05-10T08:43:59.366990+0000","last_peered":"2024-05-10T08:43:59.366990+0000","last_clean":"2024-05-10T08:43:59.366990+0000","last_became_active":"2024-05-10T08:43:59.362239+0000","last_became_peered":"2024-05-10T08:43:59.362239+0000","last_unstale":"2024-05-10T08:43:59.366990+0000","last_undegraded":"2024-05-10T08:43:59.366990+0000","last_fullsized":"2024-05-10T08:43:59.366990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:44:21.265796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.352555+0000","last_change":"2024-05-10T08:43:58.368063+0000","last_active":"2024-05-10T08:43:59.352555+0000","last_peered":"2024-05-10T08:43:59.352555+0000","last_clean":"2024-05-10T08:43:59.352555+0000","last_became_active":"2024-05-10T08:43:58.367758+0000","last_became_peered":"2024-05-10T08:43:58.367758+0000","last_unstale":"2024-05-10T08:43:59.352555+0000","last_undegraded":"2024-05-10T08:43:59.352555+0000","last_fullsized":"2024-05-10T08:43:59.352555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:29:00.614684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.364377+0000","last_change":"2024-05-10T08:43:59.362665+0000","last_active":"2024-05-10T08:43:59.364377+0000","last_peered":"2024-05-10T08:43:59.364377+0000","last_clean":"2024-05-10T08:43:59.364377+0000","last_became_active":"2024-05-10T08:43:59.362389+0000","last_became_peered":"2024-05-10T08:43:59.362389+0000","last_unstale":"2024-05-10T08:43:59.364377+0000","last_undegraded":"2024-05-10T08:43:59.364377+0000","last_fullsized":"2024-05-10T08:43:59.364377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:05:43.206484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352174+0000","last_change":"2024-05-10T08:43:58.365115+0000","last_active":"2024-05-10T08:44:00.352174+0000","last_peered":"2024-05-10T08:44:00.352174+0000","last_clean":"2024-05-10T08:44:00.352174+0000","last_became_active":"2024-05-10T08:43:58.364772+0000","last_became_peered":"2024-05-10T08:43:58.364772+0000","last_unstale":"2024-05-10T08:44:00.352174+0000","last_undegraded":"2024-05-10T08:44:00.352174+0000","last_fullsized":"2024-05-10T08:44:00.352174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:47.819715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369283+0000","last_change":"2024-05-10T08:43:59.365411+0000","last_active":"2024-05-10T08:43:59.369283+0000","last_peered":"2024-05-10T08:43:59.369283+0000","last_clean":"2024-05-10T08:43:59.369283+0000","last_became_active":"2024-05-10T08:43:59.365176+0000","last_became_peered":"2024-05-10T08:43:59.365176+0000","last_unstale":"2024-05-10T08:43:59.369283+0000","last_undegraded":"2024-05-10T08:43:59.369283+0000","last_fullsized":"2024-05-10T08:43:59.369283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:41.707588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.355680+0000","last_change":"2024-05-10T08:43:58.362201+0000","last_active":"2024-05-10T08:43:59.355680+0000","last_peered":"2024-05-10T08:43:59.355680+0000","last_clean":"2024-05-10T08:43:59.355680+0000","last_became_active":"2024-05-10T08:43:58.361886+0000","last_became_peered":"2024-05-10T08:43:58.361886+0000","last_unstale":"2024-05-10T08:43:59.355680+0000","last_undegraded":"2024-05-10T08:43:59.355680+0000","last_fullsized":"2024-05-10T08:43:59.355680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:05.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366986+0000","last_change":"2024-05-10T08:43:59.361464+0000","last_active":"2024-05-10T08:43:59.366986+0000","last_peered":"2024-05-10T08:43:59.366986+0000","last_clean":"2024-05-10T08:43:59.366986+0000","last_became_active":"2024-05-10T08:43:59.360280+0000","last_became_peered":"2024-05-10T08:43:59.360280+0000","last_unstale":"2024-05-10T08:43:59.366986+0000","last_undegraded":"2024-05-10T08:43:59.366986+0000","last_fullsized":"2024-05-10T08:43:59.366986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:27:03.662329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352994+0000","last_change":"2024-05-10T08:43:58.358291+0000","last_active":"2024-05-10T08:44:00.352994+0000","last_peered":"2024-05-10T08:44:00.352994+0000","last_clean":"2024-05-10T08:44:00.352994+0000","last_became_active":"2024-05-10T08:43:58.358003+0000","last_became_peered":"2024-05-10T08:43:58.358003+0000","last_unstale":"2024-05-10T08:44:00.352994+0000","last_undegraded":"2024-05-10T08:44:00.352994+0000","last_fullsized":"2024-05-10T08:44:00.352994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:52.015119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.381719+0000","last_change":"2024-05-10T08:43:59.373382+0000","last_active":"2024-05-10T08:43:59.381719+0000","last_peered":"2024-05-10T08:43:59.381719+0000","last_clean":"2024-05-10T08:43:59.381719+0000","last_became_active":"2024-05-10T08:43:59.372467+0000","last_became_peered":"2024-05-10T08:43:59.372467+0000","last_unstale":"2024-05-10T08:43:59.381719+0000","last_undegraded":"2024-05-10T08:43:59.381719+0000","last_fullsized":"2024-05-10T08:43:59.381719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:33:42.021432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352796+0000","last_change":"2024-05-10T08:43:58.358073+0000","last_active":"2024-05-10T08:44:00.352796+0000","last_peered":"2024-05-10T08:44:00.352796+0000","last_clean":"2024-05-10T08:44:00.352796+0000","last_became_active":"2024-05-10T08:43:58.357790+0000","last_became_peered":"2024-05-10T08:43:58.357790+0000","last_unstale":"2024-05-10T08:44:00.352796+0000","last_undegraded":"2024-05-10T08:44:00.352796+0000","last_fullsized":"2024-05-10T08:44:00.352796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:05.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.369148+0000","last_change":"2024-05-10T08:43:59.364812+0000","last_active":"2024-05-10T08:43:59.369148+0000","last_peered":"2024-05-10T08:43:59.369148+0000","last_clean":"2024-05-10T08:43:59.369148+0000","last_became_active":"2024-05-10T08:43:59.364549+0000","last_became_peered":"2024-05-10T08:43:59.364549+0000","last_unstale":"2024-05-10T08:43:59.369148+0000","last_undegraded":"2024-05-10T08:43:59.369148+0000","last_fullsized":"2024-05-10T08:43:59.369148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:26.942455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.358123+0000","last_change":"2024-05-10T08:43:58.358963+0000","last_active":"2024-05-10T08:43:59.358123+0000","last_peered":"2024-05-10T08:43:59.358123+0000","last_clean":"2024-05-10T08:43:59.358123+0000","last_became_active":"2024-05-10T08:43:58.358669+0000","last_became_peered":"2024-05-10T08:43:58.358669+0000","last_unstale":"2024-05-10T08:43:59.358123+0000","last_undegraded":"2024-05-10T08:43:59.358123+0000","last_fullsized":"2024-05-10T08:43:59.358123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:34.619825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.366392+0000","last_change":"2024-05-10T08:43:59.362626+0000","last_active":"2024-05-10T08:43:59.366392+0000","last_peered":"2024-05-10T08:43:59.366392+0000","last_clean":"2024-05-10T08:43:59.366392+0000","last_became_active":"2024-05-10T08:43:59.362299+0000","last_became_peered":"2024-05-10T08:43:59.362299+0000","last_unstale":"2024-05-10T08:43:59.366392+0000","last_undegraded":"2024-05-10T08:43:59.366392+0000","last_fullsized":"2024-05-10T08:43:59.366392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:48.938309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.348900+0000","last_change":"2024-05-10T08:43:58.365026+0000","last_active":"2024-05-10T08:43:59.348900+0000","last_peered":"2024-05-10T08:43:59.348900+0000","last_clean":"2024-05-10T08:43:59.348900+0000","last_became_active":"2024-05-10T08:43:58.363582+0000","last_became_peered":"2024-05-10T08:43:58.363582+0000","last_unstale":"2024-05-10T08:43:59.348900+0000","last_undegraded":"2024-05-10T08:43:59.348900+0000","last_fullsized":"2024-05-10T08:43:59.348900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:14.986297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.349059+0000","last_change":"2024-05-10T08:43:59.377338+0000","last_active":"2024-05-10T08:44:00.349059+0000","last_peered":"2024-05-10T08:44:00.349059+0000","last_clean":"2024-05-10T08:44:00.349059+0000","last_became_active":"2024-05-10T08:43:59.377009+0000","last_became_peered":"2024-05-10T08:43:59.377009+0000","last_unstale":"2024-05-10T08:44:00.349059+0000","last_undegraded":"2024-05-10T08:44:00.349059+0000","last_fullsized":"2024-05-10T08:44:00.349059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:53.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.359114+0000","last_change":"2024-05-10T08:43:58.363915+0000","last_active":"2024-05-10T08:43:59.359114+0000","last_peered":"2024-05-10T08:43:59.359114+0000","last_clean":"2024-05-10T08:43:59.359114+0000","last_became_active":"2024-05-10T08:43:58.363624+0000","last_became_peered":"2024-05-10T08:43:58.363624+0000","last_unstale":"2024-05-10T08:43:59.359114+0000","last_undegraded":"2024-05-10T08:43:59.359114+0000","last_fullsized":"2024-05-10T08:43:59.359114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:24.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348989+0000","last_change":"2024-05-10T08:43:59.364529+0000","last_active":"2024-05-10T08:44:00.348989+0000","last_peered":"2024-05-10T08:44:00.348989+0000","last_clean":"2024-05-10T08:44:00.348989+0000","last_became_active":"2024-05-10T08:43:59.364268+0000","last_became_peered":"2024-05-10T08:43:59.364268+0000","last_unstale":"2024-05-10T08:44:00.348989+0000","last_undegraded":"2024-05-10T08:44:00.348989+0000","last_fullsized":"2024-05-10T08:44:00.348989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:43:12.231192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.348464+0000","last_change":"2024-05-10T08:43:58.362185+0000","last_active":"2024-05-10T08:44:00.348464+0000","last_peered":"2024-05-10T08:44:00.348464+0000","last_clean":"2024-05-10T08:44:00.348464+0000","last_became_active":"2024-05-10T08:43:58.361877+0000","last_became_peered":"2024-05-10T08:43:58.361877+0000","last_unstale":"2024-05-10T08:44:00.348464+0000","last_undegraded":"2024-05-10T08:44:00.348464+0000","last_fullsized":"2024-05-10T08:44:00.348464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:34.619825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352954+0000","last_change":"2024-05-10T08:43:59.360684+0000","last_active":"2024-05-10T08:44:00.352954+0000","last_peered":"2024-05-10T08:44:00.352954+0000","last_clean":"2024-05-10T08:44:00.352954+0000","last_became_active":"2024-05-10T08:43:59.360078+0000","last_became_peered":"2024-05-10T08:43:59.360078+0000","last_unstale":"2024-05-10T08:44:00.352954+0000","last_undegraded":"2024-05-10T08:44:00.352954+0000","last_fullsized":"2024-05-10T08:44:00.352954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:58.338518+0000","last_clean_scrub_stamp":"2024-05-10T08:43:58.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:11.017449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-05-10T08:43:59.357131+0000","last_change":"2024-05-10T08:43:58.368008+0000","last_active":"2024-05-10T08:43:59.357131+0000","last_peered":"2024-05-10T08:43:59.357131+0000","last_clean":"2024-05-10T08:43:59.357131+0000","last_became_active":"2024-05-10T08:43:58.367691+0000","last_became_peered":"2024-05-10T08:43:58.367691+0000","last_unstale":"2024-05-10T08:43:59.357131+0000","last_undegraded":"2024-05-10T08:43:59.357131+0000","last_fullsized":"2024-05-10T08:43:59.357131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:43:57.335962+0000","last_clean_scrub_stamp":"2024-05-10T08:43:57.335962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:23.541942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":211,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-10T08:44:00.352656+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:44:00.352656+0000","last_peered":"2024-05-10T08:44:00.352656+0000","last_clean":"2024-05-10T08:44:00.352656+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:44:00.352656+0000","last_undegraded":"2024-05-10T08:44:00.352656+0000","last_fullsized":"2024-05-10T08:44:00.352656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1503232,"data_stored":1000344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":411566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":409988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":411670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":410536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":410696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":913408,"data_stored":410066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1499136,"data_stored":1000322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:44:03.780 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:44:03.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T08:44:03.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.929+0000 7f690bc59640 1 Processor -- start 2024-05-10T08:44:03.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.929+0000 7f690bc59640 1 -- start start 2024-05-10T08:44:03.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690bc59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f690415f380 0x7f69040d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690bc59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69040b3f30 0x7f69040d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690bc59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f69040b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690bc59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f69040b1c90 con 0x7f690415f380 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690bc59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f69040d0a50 con 0x7f69040b3f30 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690bc59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69040d0d30 con 0x7f69040b2420 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f690415f380 0x7f69040d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f690415f380 0x7f69040d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59362/0 (socket says 172.21.15.37:59362) 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 -- 172.21.15.37:0/2345168304 learned_addr learned my addr 172.21.15.37:0/2345168304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690a1f6640 1 --2- 172.21.15.37:0/2345168304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f69040b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69091f4640 1 --2- 172.21.15.37:0/2345168304 >> v2:172.21.15.82:3300/0 conn(0x7f69040b3f30 0x7f69040d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 -- 172.21.15.37:0/2345168304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 msgr2=0x7f69040b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 --2- 172.21.15.37:0/2345168304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f69040b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 -- 172.21.15.37:0/2345168304 >> v2:172.21.15.82:3300/0 conn(0x7f69040b3f30 msgr2=0x7f69040d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 --2- 172.21.15.37:0/2345168304 >> v2:172.21.15.82:3300/0 conn(0x7f69040b3f30 0x7f69040d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f69099f5640 1 -- 172.21.15.37:0/2345168304 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69040b1f00 con 0x7f690415f380 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.930+0000 7f690a1f6640 1 --2- 172.21.15.37:0/2345168304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f69040b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:03.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.931+0000 7f69099f5640 1 --2- 172.21.15.37:0/2345168304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040d35c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f690406cc70 tx=0x7f690002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc00acbef09b1e5e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.931+0000 7f69089f3640 1 -- 172.21.15.37:0/2345168304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900037070 con 0x7f690415f380 2024-05-10T08:44:03.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.931+0000 7f69089f3640 1 -- 172.21.15.37:0/2345168304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6900032440 con 0x7f690415f380 2024-05-10T08:44:03.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.931+0000 7f69089f3640 1 -- 172.21.15.37:0/2345168304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900032810 con 0x7f690415f380 2024-05-10T08:44:03.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 -- 172.21.15.37:0/2345168304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 msgr2=0x7f69040d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 --2- 172.21.15.37:0/2345168304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040d35c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f690406cc70 tx=0x7f690002a1e0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 -- 172.21.15.37:0/2345168304 shutdown_connections 2024-05-10T08:44:03.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 --2- 172.21.15.37:0/2345168304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f69040b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 --2- 172.21.15.37:0/2345168304 >> v2:172.21.15.82:3300/0 conn(0x7f69040b3f30 0x7f69040d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 --2- 172.21.15.37:0/2345168304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040d35c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 -- 172.21.15.37:0/2345168304 >> 172.21.15.37:0/2345168304 conn(0x7f69040d4fe0 msgr2=0x7f69040d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 -- 172.21.15.37:0/2345168304 shutdown_connections 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.932+0000 7f690bc59640 1 -- 172.21.15.37:0/2345168304 wait complete. 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.933+0000 7f690bc59640 1 Processor -- start 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.933+0000 7f690bc59640 1 -- start start 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690bc59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f6904157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690bc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69040b3f30 0x7f69041596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690bc59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690bc59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69040d06e0 con 0x7f690415f380 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690bc59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69040d1010 con 0x7f69040b3f30 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690bc59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69040b2db0 con 0x7f69040b2420 2024-05-10T08:44:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59368/0 (socket says 172.21.15.37:59368) 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 -- 172.21.15.37:0/1409312729 learned_addr learned my addr 172.21.15.37:0/1409312729 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 -- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 msgr2=0x7f6904157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f69091f4640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69040b3f30 0x7f69041596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f69099f5640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f6904157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f6904157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 -- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69040b3f30 msgr2=0x7f69041596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69040b3f30 0x7f69041596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 -- 172.21.15.37:0/1409312729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69040b7e90 con 0x7f690415f380 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.934+0000 7f690a1f6640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040b9910 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007ef0 tx=0x7f68fc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.935+0000 7f68fa7fc640 1 -- 172.21.15.37:0/1409312729 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc01a070 con 0x7f690415f380 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.935+0000 7f68fa7fc640 1 -- 172.21.15.37:0/1409312729 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc003b90 con 0x7f690415f380 2024-05-10T08:44:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.935+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69040cc2e0 con 0x7f690415f380 2024-05-10T08:44:03.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.935+0000 7f68fa7fc640 1 -- 172.21.15.37:0/1409312729 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc004030 con 0x7f690415f380 2024-05-10T08:44:03.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.935+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69040cc8a0 con 0x7f690415f380 2024-05-10T08:44:03.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.936+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69040693f0 con 0x7f690415f380 2024-05-10T08:44:03.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.936+0000 7f68fa7fc640 1 -- 172.21.15.37:0/1409312729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f68fc01d070 con 0x7f690415f380 2024-05-10T08:44:03.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.937+0000 7f68fa7fc640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68e80762d0 0x7f68e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:03.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.937+0000 7f68fa7fc640 1 -- 172.21.15.37:0/1409312729 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f68fc097940 con 0x7f690415f380 2024-05-10T08:44:03.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.937+0000 7f69099f5640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68e80762d0 0x7f68e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:03.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.938+0000 7f69099f5640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68e80762d0 0x7f68e8078790 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6900034000 tx=0x7f690002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:03.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:03.941+0000 7f68fa7fc640 1 -- 172.21.15.37:0/1409312729 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f68fc010070 con 0x7f690415f380 2024-05-10T08:44:04.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.204+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f69040d5660 con 0x7f690415f380 2024-05-10T08:44:04.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.206+0000 7f68fa7fc640 1 -- 172.21.15.37:0/1409312729 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f68fc060ac0 con 0x7f690415f380 2024-05-10T08:44:04.206 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:44:04.206 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:44:04.206 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-10T08:44:04.206 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-10T08:44:04.206 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T08:44:04.206 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-10T08:44:04.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68e80762d0 msgr2=0x7f68e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68e80762d0 0x7f68e8078790 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6900034000 tx=0x7f690002e000 comp rx=0 tx=0).stop 2024-05-10T08:44:04.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 msgr2=0x7f69040b9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040b9910 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007ef0 tx=0x7f68fc00d4a0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 shutdown_connections 2024-05-10T08:44:04.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f68e80762d0 0x7f68e8078790 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f690415f380 0x7f69040b9910 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69040b3f30 0x7f69041596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 --2- 172.21.15.37:0/1409312729 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69040b2420 0x7f6904157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 >> 172.21.15.37:0/1409312729 conn(0x7f69040d4fe0 msgr2=0x7f69041619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:04.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 shutdown_connections 2024-05-10T08:44:04.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.209+0000 7f690bc59640 1 -- 172.21.15.37:0/1409312729 wait complete. 2024-05-10T08:44:04.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:44:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.323+0000 7fdce7146640 1 Processor -- start 2024-05-10T08:44:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.323+0000 7fdce7146640 1 -- start start 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdce7146640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdce7146640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce0163d80 con 0x7fdce0071110 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdce7146640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce00d1300 con 0x7fdce0163920 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdce7146640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdce00d10d0 con 0x7fdce0070d30 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdce56e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdce0071110 0x7fdce006d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56728/0 (socket says 172.21.15.37:56728) 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdce56e3640 1 -- 172.21.15.37:0/3821408697 learned_addr learned my addr 172.21.15.37:0/3821408697 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdce4ee2640 1 --2- 172.21.15.37:0/3821408697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112781527 0 0) 0x7fdce0163d80 con 0x7fdce0071110 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc8003520 con 0x7fdce0071110 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595776032 0 0) 0x7fdce00d1300 con 0x7fdce0163920 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.324+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce0163d80 con 0x7fdce0163920 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.325+0000 7fdce4ee2640 1 -- 172.21.15.37:0/3821408697 >> v1:172.21.15.82:6789/0 conn(0x7fdce0163920 legacy=0x7fdce00703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.325+0000 7fdce4ee2640 1 -- 172.21.15.37:0/3821408697 >> v1:172.21.15.37:6789/0 conn(0x7fdce0071110 legacy=0x7fdce006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.325+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 799589719 0 0) 0x7fdcc8003520 con 0x7fdce0071110 2024-05-10T08:44:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.325+0000 7fdce4ee2640 1 -- 172.21.15.37:0/3821408697 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce00d15e0 con 0x7fdce0070d30 2024-05-10T08:44:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.325+0000 7fdce4ee2640 1 --2- 172.21.15.37:0/3821408697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00d20c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0097d0 tx=0x7fdcdc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc9f5c239239dd14 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc037070 con 0x7fdce0070d30 2024-05-10T08:44:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc02ac30 con 0x7fdce0070d30 2024-05-10T08:44:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdcd77fe640 1 -- 172.21.15.37:0/3821408697 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd80019f0 con 0x7fdce0070d30 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdce7146640 1 -- 172.21.15.37:0/3821408697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 msgr2=0x7fdce00d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdce7146640 1 --2- 172.21.15.37:0/3821408697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00d20c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0097d0 tx=0x7fdcdc02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdce7146640 1 -- 172.21.15.37:0/3821408697 shutdown_connections 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdce7146640 1 --2- 172.21.15.37:0/3821408697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00d20c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdce7146640 1 -- 172.21.15.37:0/3821408697 >> 172.21.15.37:0/3821408697 conn(0x7fdce00d2e90 msgr2=0x7fdce00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdce7146640 1 -- 172.21.15.37:0/3821408697 shutdown_connections 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.326+0000 7fdce7146640 1 -- 172.21.15.37:0/3821408697 wait complete. 2024-05-10T08:44:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.327+0000 7fdce7146640 1 Processor -- start 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.327+0000 7fdce7146640 1 -- start start 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdce7146640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdce7146640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce0071110 0x7fdce00ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdce7146640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdce0163920 0x7fdce00cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdce7146640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdce00d1c30 con 0x7fdce0071110 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdce7146640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0070b80 con 0x7fdce0163920 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdce7146640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdce00715a0 con 0x7fdce0070d30 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdcd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce0071110 0x7fdce00ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdcd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce0071110 0x7fdce00ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59374/0 (socket says 172.21.15.37:59374) 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.328+0000 7fdcd7fff640 1 -- 172.21.15.37:0/3009713963 learned_addr learned my addr 172.21.15.37:0/3009713963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdce4ee2640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdce56e3640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdce0163920 0x7fdce00cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd7fff640 1 -- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 msgr2=0x7fdce00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd7fff640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd7fff640 1 -- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdce0163920 msgr2=0x7fdce00cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd7fff640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdce0163920 0x7fdce00cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd7fff640 1 -- 172.21.15.37:0/3009713963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce01f66e0 con 0x7fdce0071110 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd7fff640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce0071110 0x7fdce00ca4a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000c3f0 tx=0x7fdcd000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd57fa640 1 -- 172.21.15.37:0/3009713963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0017070 con 0x7fdce0071110 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd57fa640 1 -- 172.21.15.37:0/3009713963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd00052f0 con 0x7fdce0071110 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce01f69c0 con 0x7fdce0071110 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdcd57fa640 1 -- 172.21.15.37:0/3009713963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0003830 con 0x7fdce0071110 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.329+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce00b7220 con 0x7fdce0071110 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.330+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce00b7420 con 0x7fdce0071110 2024-05-10T08:44:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.331+0000 7fdcd57fa640 1 -- 172.21.15.37:0/3009713963 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdcd001a070 con 0x7fdce0071110 2024-05-10T08:44:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.331+0000 7fdcd57fa640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdccc0762d0 0x7fdccc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.332+0000 7fdcd57fa640 1 -- 172.21.15.37:0/3009713963 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fdcd0096b30 con 0x7fdce0071110 2024-05-10T08:44:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.332+0000 7fdce4ee2640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdccc0762d0 0x7fdccc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.332+0000 7fdce4ee2640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdccc0762d0 0x7fdccc078790 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc034000 tx=0x7fdcdc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.336+0000 7fdcd57fa640 1 -- 172.21.15.37:0/3009713963 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdce00b7420 con 0x7fdce0071110 2024-05-10T08:44:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.567+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdce00693f0 con 0x7fdce0071110 2024-05-10T08:44:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.568+0000 7fdcd57fa640 1 -- 172.21.15.37:0/3009713963 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5180 (secure 0 0 0) 0x7fdcd00603d0 con 0x7fdce0071110 2024-05-10T08:44:04.567 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:04.567 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:01.751876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6108},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6108":{"gid":6108,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3151779785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3151779785},{"type":"v1","addr":"172.21.15.37:6835","nonce":3151779785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6108,"qdb_cluster":[6108]},"id":5}]} 2024-05-10T08:44:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 45 2024-05-10T08:44:04.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdccc0762d0 msgr2=0x7fdccc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdccc0762d0 0x7fdccc078790 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc034000 tx=0x7fdcdc02e000 comp rx=0 tx=0).stop 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce0071110 msgr2=0x7fdce00ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce0071110 0x7fdce00ca4a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000c3f0 tx=0x7fdcd000c8b0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 shutdown_connections 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdccc0762d0 0x7fdccc078790 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdce0163920 0x7fdce00cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce0071110 0x7fdce00ca4a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 --2- 172.21.15.37:0/3009713963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdce0070d30 0x7fdce00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 >> 172.21.15.37:0/3009713963 conn(0x7fdce00d2e90 msgr2=0x7fdce0160d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 shutdown_connections 2024-05-10T08:44:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:04.570+0000 7fdce7146640 1 -- 172.21.15.37:0/3009713963 wait complete. 2024-05-10T08:44:04.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:43:58.731926+0000', 'modified': '2024-05-10T08:44:01.751876+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6108}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6108': {'gid': 6108, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/3151779785', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3151779785}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3151779785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6108, 'qdb_cluster': [6108]} 2024-05-10T08:44:04.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:44:04.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:44:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.096+0000 7f2d444d1640 1 Processor -- start 2024-05-10T08:44:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.096+0000 7f2d444d1640 1 -- start start 2024-05-10T08:44:05.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d444d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d3c072840 0x7f2d3c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d444d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e4d0 0x7f2d3c0aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d444d1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c15c920 con 0x7f2d3c06e0f0 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d444d1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3c15cc00 con 0x7f2d3c072840 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d444d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3c15cee0 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d41a6c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d3c072840 0x7f2d3c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d41a6c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d3c072840 0x7f2d3c15c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59376/0 (socket says 172.21.15.37:59376) 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3513859031 learned_addr learned my addr 172.21.15.37:0/3513859031 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d42a6e640 1 --2- 172.21.15.37:0/3513859031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e4d0 0x7f2d3c0aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3513859031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e4d0 msgr2=0x7f2d3c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/3513859031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e4d0 0x7f2d3c0aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3513859031 >> v1:172.21.15.82:6789/0 conn(0x7f2d3c06e0f0 legacy=0x7f2d3c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.097+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3513859031 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c15d1c0 con 0x7f2d3c072840 2024-05-10T08:44:05.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.098+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/3513859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c072840 0x7f2d3c15c340 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009870 tx=0x7f2d2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a44b9ad230a455 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.098+0000 7f2d4126b640 1 -- 172.21.15.37:0/3513859031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c037070 con 0x7f2d3c072840 2024-05-10T08:44:05.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.098+0000 7f2d4126b640 1 -- 172.21.15.37:0/3513859031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c032440 con 0x7f2d3c072840 2024-05-10T08:44:05.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.098+0000 7f2d4126b640 1 -- 172.21.15.37:0/3513859031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c032810 con 0x7f2d3c072840 2024-05-10T08:44:05.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 -- 172.21.15.37:0/3513859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c072840 msgr2=0x7f2d3c15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3513859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c072840 0x7f2d3c15c340 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009870 tx=0x7f2d2c02a270 comp rx=0 tx=0).stop 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 -- 172.21.15.37:0/3513859031 shutdown_connections 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3513859031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e4d0 0x7f2d3c0aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3513859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c072840 0x7f2d3c15c340 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 -- 172.21.15.37:0/3513859031 >> 172.21.15.37:0/3513859031 conn(0x7f2d3c06c3a0 msgr2=0x7f2d3c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 -- 172.21.15.37:0/3513859031 shutdown_connections 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.099+0000 7f2d444d1640 1 -- 172.21.15.37:0/3513859031 wait complete. 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.100+0000 7f2d444d1640 1 Processor -- start 2024-05-10T08:44:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.100+0000 7f2d444d1640 1 -- start start 2024-05-10T08:44:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d444d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e0f0 0x7f2d3c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d444d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c06e4d0 0x7f2d3c158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d444d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c072840 0x7f2d3c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d444d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c0ae7d0 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d444d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c0ae650 con 0x7f2d3c072840 2024-05-10T08:44:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d444d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3c1530b0 con 0x7f2d3c06e0f0 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c06e4d0 0x7f2d3c158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c06e4d0 0x7f2d3c158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59388/0 (socket says 172.21.15.37:59388) 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3769846579 learned_addr learned my addr 172.21.15.37:0/3769846579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d4226d640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e0f0 0x7f2d3c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d42a6e640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c072840 0x7f2d3c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e0f0 msgr2=0x7f2d3c1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e0f0 0x7f2d3c1524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c072840 msgr2=0x7f2d3c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c072840 0x7f2d3c0b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.101+0000 7f2d41a6c640 1 -- 172.21.15.37:0/3769846579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c0cefb0 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.102+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c06e4d0 0x7f2d3c158480 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c02a2b0 tx=0x7f2d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.102+0000 7f2d32ffd640 1 -- 172.21.15.37:0/3769846579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c041030 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.102+0000 7f2d32ffd640 1 -- 172.21.15.37:0/3769846579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c030440 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.102+0000 7f2d32ffd640 1 -- 172.21.15.37:0/3769846579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c037040 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.102+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c0cf290 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.102+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c0cf850 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.103+0000 7f2d32ffd640 1 -- 172.21.15.37:0/3769846579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d2c044070 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.104+0000 7f2d32ffd640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d200762d0 0x7f2d20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.104+0000 7f2d32ffd640 1 -- 172.21.15.37:0/3769846579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2d2c0b7d40 con 0x7f2d3c06e4d0 2024-05-10T08:44:05.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.104+0000 7f2d4226d640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d200762d0 0x7f2d20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.105+0000 7f2d471ee740 1 Processor -- start 2024-05-10T08:44:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.105+0000 7f2d4226d640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d200762d0 0x7f2d20078790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2d38007fd0 tx=0x7f2d38009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.105+0000 7f2d471ee740 1 -- start start 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae12e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae0febb0 0x5636ae1023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d471ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5636ae0688d0 con 0x5636ae12bf50 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5636ae021c10 con 0x5636ae0febb0 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5636ae064890 con 0x5636ae12c330 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae12e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae12e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59392/0 (socket says 172.21.15.37:59392) 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 -- 172.21.15.37:0/1205435980 learned_addr learned my addr 172.21.15.37:0/1205435980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d42a6e640 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae0febb0 0x5636ae1023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 -- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 msgr2=0x5636ae12eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 -- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae0febb0 msgr2=0x5636ae1023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae0febb0 0x5636ae1023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 -- 172.21.15.37:0/1205435980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ae0295d0 con 0x5636ae12bf50 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.106+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae12e760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2d38003d80 tx=0x7f2d38010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898e1efbfcf2417c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d1ffff640 1 -- 172.21.15.37:0/1205435980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d380055d0 con 0x5636ae12bf50 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d1ffff640 1 -- 172.21.15.37:0/1205435980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d38005770 con 0x5636ae12bf50 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d1ffff640 1 -- 172.21.15.37:0/1205435980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d38021610 con 0x5636ae12bf50 2024-05-10T08:44:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 -- 172.21.15.37:0/1205435980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 msgr2=0x5636ae12e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae12e760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2d38003d80 tx=0x7f2d38010000 comp rx=0 tx=0).stop 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 -- 172.21.15.37:0/1205435980 shutdown_connections 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae0febb0 0x5636ae1023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1205435980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae12e760 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 -- 172.21.15.37:0/1205435980 >> 172.21.15.37:0/1205435980 conn(0x5636ae100e20 msgr2=0x5636ae149760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 -- 172.21.15.37:0/1205435980 shutdown_connections 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.107+0000 7f2d471ee740 1 -- 172.21.15.37:0/1205435980 wait complete. 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.108+0000 7f2d471ee740 1 -- start start 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.108+0000 7f2d471ee740 1 Processor -- start 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae12f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d471ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5636ae103fd0 con 0x5636ae12bf50 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5636ae025760 con 0x5636ae150b20 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5636ae1042b0 con 0x5636ae12c330 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d471ee740 10 client.0 _ll_register_callbacks cb 0x5636ae05ecf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae14c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59398/0 (socket says 172.21.15.37:59398) 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 -- 172.21.15.37:0/1164311923 learned_addr learned my addr 172.21.15.37:0/1164311923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d42a6e640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae12f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 -- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 msgr2=0x5636ae12f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 -- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 msgr2=0x5636ae12f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae12f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d4226d640 1 -- 172.21.15.37:0/1164311923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636add7a2d0 con 0x5636ae12bf50 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.109+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae14c2a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5636ae1064b0 tx=0x7f2d38000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7893f29e8ff0986 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1164311923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d380055d0 con 0x5636ae12bf50 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1164311923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2d3801d050 con 0x5636ae12bf50 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d38005770 con 0x5636ae12bf50 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1164311923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f2d38033050 con 0x5636ae12bf50 2024-05-10T08:44:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 10 client.6240 fetch_fsmap learned FSMap version 45 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x5636ade446b0 con 0x5636ae12bf50 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1164311923 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d38005770 con 0x5636ae12bf50 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1164311923 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7f2d38036020 con 0x5636ae12bf50 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 10 client.6240 fetch_fsmap finished waiting for FSMap version 45 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 10 client.6240 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 20 client.6240 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae15d6a0 0x5636ae130ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 4 client.6240 mds_command: new command op to 6108 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.110+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 --> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636adfec760 con 0x5636ae15d6a0 2024-05-10T08:44:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.111+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae15d6a0 0x5636ae130ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.111+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae15d6a0 0x5636ae130ad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e42cf076f76a7f server_cookie=c431a8c79fbc39e7 in_seq=0 out_seq=0 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.111+0000 7f2d1d7fa640 10 client.6240 ms_handle_connect on v2:172.21.15.37:6833/3151779785 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.111+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1164311923 <== mds.0 v2:172.21.15.37:6833/3151779785 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5636adfec760 con 0x5636ae15d6a0 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.111+0000 7f2d1d7fa640 10 client.6240 handle_command_reply: tid=0 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.111+0000 7f2d471ee740 1 client.6240 shutdown 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 msgr2=0x5636ae14c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae14c2a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5636ae1064b0 tx=0x7f2d38000f40 comp rx=0 tx=0).stop 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 shutdown_connections 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae15d6a0 0x5636ae130ad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae12f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12c330 0x5636ae12f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1164311923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12bf50 0x5636ae14c2a0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d1d7fa640 0 client.6240 ms_handle_reset on v2:172.21.15.37:6833/3151779785 2024-05-10T08:44:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 >> 172.21.15.37:0/1164311923 conn(0x5636ae0febb0 msgr2=0x5636ae0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 shutdown_connections 2024-05-10T08:44:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 1 -- 172.21.15.37:0/1164311923 wait complete. 2024-05-10T08:44:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.112+0000 7f2d471ee740 20 client.6240 trim_cache size 0 max 16384 2024-05-10T08:44:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.131+0000 7f2d471ee740 1 Processor -- start 2024-05-10T08:44:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.131+0000 7f2d471ee740 1 -- start start 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae12bf50 0x5636ae14f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae150b20 0x5636ae12a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d471ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c200ee0 con 0x5636ae12c330 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c154fa0 con 0x5636ae12bf50 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3c2008c0 con 0x5636ae150b20 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59412/0 (socket says 172.21.15.37:59412) 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1949604103 learned_addr learned my addr 172.21.15.37:0/1949604103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d42a6e640 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae150b20 0x5636ae12a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae12bf50 0x5636ae14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae150b20 msgr2=0x5636ae12a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae150b20 0x5636ae12a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae12bf50 msgr2=0x5636ae14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae12bf50 0x5636ae14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1949604103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ae150670 con 0x5636ae12c330 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae102cc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c080e10 tx=0x7f2d2c03bfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba1b18e7a9b05c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d1f7fe640 1 -- 172.21.15.37:0/1949604103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c089c50 con 0x5636ae12c330 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d1f7fe640 1 -- 172.21.15.37:0/1949604103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c07d110 con 0x5636ae12c330 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.132+0000 7f2d1f7fe640 1 -- 172.21.15.37:0/1949604103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0899e0 con 0x5636ae12c330 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 -- 172.21.15.37:0/1949604103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 msgr2=0x5636ae102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae102cc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c080e10 tx=0x7f2d2c03bfe0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 -- 172.21.15.37:0/1949604103 shutdown_connections 2024-05-10T08:44:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae150b20 0x5636ae12a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae102cc0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1949604103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae12bf50 0x5636ae14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 -- 172.21.15.37:0/1949604103 >> 172.21.15.37:0/1949604103 conn(0x5636ae0febb0 msgr2=0x5636ae146420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 -- 172.21.15.37:0/1949604103 shutdown_connections 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 -- 172.21.15.37:0/1949604103 wait complete. 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 -- start start 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.133+0000 7f2d471ee740 1 Processor -- start 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12bf50 0x5636ae0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae0fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d471ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d471ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5636ae15d520 con 0x5636ae12c330 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5636ae151ac0 con 0x5636ae150b20 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d471ee740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5636ae15db70 con 0x5636ae12bf50 2024-05-10T08:44:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d471ee740 10 client.0 _ll_register_callbacks cb 0x7f2d34009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.134+0000 7f2d41a6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae0fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae0fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59426/0 (socket says 172.21.15.37:59426) 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1812520283 learned_addr learned my addr 172.21.15.37:0/1812520283 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12bf50 0x5636ae0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d42a6e640 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12bf50 msgr2=0x5636ae0fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12bf50 0x5636ae0fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 msgr2=0x5636ae14dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae14dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 -- 172.21.15.37:0/1812520283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636ae15c250 con 0x5636ae12c330 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d41a6c640 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae0fe5e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c080e10 tx=0x7f2d2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80030ffa923a1df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1812520283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0a2060 con 0x5636ae12c330 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1812520283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2d2c0800e0 con 0x5636ae12c330 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d2c07d110 con 0x5636ae12c330 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1812520283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f2d2c080e80 con 0x5636ae12c330 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d471ee740 10 client.6246 fetch_fsmap learned FSMap version 45 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x5636ae15c810 con 0x5636ae12c330 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1812520283 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c07d110 con 0x5636ae12c330 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1812520283 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 3494+0+0 (secure 0 0 0) 0x7f2d2c0b0030 con 0x5636ae12c330 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.135+0000 7f2d471ee740 10 client.6246 fetch_fsmap finished waiting for FSMap version 45 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 10 client.6246 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 20 client.6246 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae131840 0x5636ae14a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 4 client.6246 mds_command: new command op to 6108 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 --> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] -- command(tid 0: {"prefix": "status"}) -- 0x5636ae0764e0 con 0x5636ae131840 2024-05-10T08:44:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae131840 0x5636ae14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d1d7fa640 10 client.6246 ms_handle_connect on v2:172.21.15.37:6833/3151779785 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d4226d640 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae131840 0x5636ae14a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a8f752d96865de server_cookie=d9efc1daaf848a58 in_seq=0 out_seq=0 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d1d7fa640 1 -- 172.21.15.37:0/1812520283 <== mds.0 v2:172.21.15.37:6833/3151779785 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5636ae0764e0 con 0x5636ae131840 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d1d7fa640 10 client.6246 handle_command_reply: tid=0 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 client.6246 shutdown 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 msgr2=0x5636ae0fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae0fe5e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c080e10 tx=0x7f2d2c000bc0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 shutdown_connections 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:6833/3151779785,v1:172.21.15.37:6835/3151779785] conn(0x5636ae131840 0x5636ae14a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636ae150b20 0x5636ae14dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d1d7fa640 0 client.6246 ms_handle_reset on v2:172.21.15.37:6833/3151779785 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5636ae12c330 0x5636ae0fe5e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 --2- 172.21.15.37:0/1812520283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5636ae12bf50 0x5636ae0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.136+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 >> 172.21.15.37:0/1812520283 conn(0x5636ae0febb0 msgr2=0x5636ae12e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 shutdown_connections 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d471ee740 1 -- 172.21.15.37:0/1812520283 wait complete. 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d471ee740 20 client.6246 trim_cache size 0 max 16384 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6108, 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:44:05.144 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:44:05.145 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:44:05.145 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.7915651170000002, 2024-05-10T08:44:05.145 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 45, 2024-05-10T08:44:05.145 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 75, 2024-05-10T08:44:05.145 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 75, 2024-05-10T08:44:05.145 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 10.761928275000001 2024-05-10T08:44:05.145 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d200762d0 msgr2=0x7f2d20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d200762d0 0x7f2d20078790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2d38007fd0 tx=0x7f2d38009040 comp rx=0 tx=0).stop 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c06e4d0 msgr2=0x7f2d3c158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c06e4d0 0x7f2d3c158480 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c02a2b0 tx=0x7f2d2c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 shutdown_connections 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d200762d0 0x7f2d20078790 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d3c072840 0x7f2d3c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d3c06e4d0 0x7f2d3c158480 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 --2- 172.21.15.37:0/3769846579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d3c06e0f0 0x7f2d3c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 >> 172.21.15.37:0/3769846579 conn(0x7f2d3c06c3a0 msgr2=0x7f2d3c0cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 shutdown_connections 2024-05-10T08:44:05.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.137+0000 7f2d444d1640 1 -- 172.21.15.37:0/3769846579 wait complete. 2024-05-10T08:44:05.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:44:05.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.252+0000 7f8c80932640 1 Processor -- start 2024-05-10T08:44:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.252+0000 7f8c80932640 1 -- start start 2024-05-10T08:44:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c80932640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8c7c15f420 0x7f8c7c0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c80932640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c7c0d3ca0 0x7f8c7c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c80932640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c1630b0 con 0x7f8c7c0d1eb0 2024-05-10T08:44:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c80932640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7c0d2550 con 0x7f8c7c0d3ca0 2024-05-10T08:44:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c80932640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7c0d2c80 con 0x7f8c7c15f420 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c79d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c7c0d3ca0 0x7f8c7c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c79d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c7c0d3ca0 0x7f8c7c0d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59440/0 (socket says 172.21.15.37:59440) 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.253+0000 7f8c79d9b640 1 -- 172.21.15.37:0/2973559404 learned_addr learned my addr 172.21.15.37:0/2973559404 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.254+0000 7f8c7a59c640 1 --2- 172.21.15.37:0/2973559404 >> v2:172.21.15.82:3300/0 conn(0x7f8c7c15f420 0x7f8c7c0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.254+0000 7f8c79d9b640 1 -- 172.21.15.37:0/2973559404 >> v2:172.21.15.82:3300/0 conn(0x7f8c7c15f420 msgr2=0x7f8c7c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.254+0000 7f8c79d9b640 1 --2- 172.21.15.37:0/2973559404 >> v2:172.21.15.82:3300/0 conn(0x7f8c7c15f420 0x7f8c7c0d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.254+0000 7f8c79d9b640 1 -- 172.21.15.37:0/2973559404 >> v1:172.21.15.82:6789/0 conn(0x7f8c7c0d1eb0 legacy=0x7f8c7c0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.254+0000 7f8c79d9b640 1 -- 172.21.15.37:0/2973559404 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c0d2f60 con 0x7f8c7c0d3ca0 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.254+0000 7f8c79d9b640 1 --2- 172.21.15.37:0/2973559404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0d3ca0 0x7f8c7c0d1970 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0d5ec0 tx=0x7f8c6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa18393bb04e1204 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c7959a640 1 -- 172.21.15.37:0/2973559404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64037070 con 0x7f8c7c0d3ca0 2024-05-10T08:44:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c7959a640 1 -- 172.21.15.37:0/2973559404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c64032440 con 0x7f8c7c0d3ca0 2024-05-10T08:44:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c7959a640 1 -- 172.21.15.37:0/2973559404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64032810 con 0x7f8c7c0d3ca0 2024-05-10T08:44:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 -- 172.21.15.37:0/2973559404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0d3ca0 msgr2=0x7f8c7c0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 --2- 172.21.15.37:0/2973559404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0d3ca0 0x7f8c7c0d1970 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0d5ec0 tx=0x7f8c6402a270 comp rx=0 tx=0).stop 2024-05-10T08:44:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 -- 172.21.15.37:0/2973559404 shutdown_connections 2024-05-10T08:44:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 --2- 172.21.15.37:0/2973559404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0d3ca0 0x7f8c7c0d1970 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 --2- 172.21.15.37:0/2973559404 >> v2:172.21.15.82:3300/0 conn(0x7f8c7c15f420 0x7f8c7c0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 -- 172.21.15.37:0/2973559404 >> 172.21.15.37:0/2973559404 conn(0x7f8c7c08eac0 msgr2=0x7f8c7c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 -- 172.21.15.37:0/2973559404 shutdown_connections 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.255+0000 7f8c80932640 1 -- 172.21.15.37:0/2973559404 wait complete. 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 Processor -- start 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 -- start start 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0d1eb0 0x7f8c7c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0cb2f0 0x7f8c7c1f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c7c1f5970 0x7f8c7c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c0d53d0 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c0d2830 con 0x7f8c7c0d1eb0 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.257+0000 7f8c80932640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c0d5550 con 0x7f8c7c1f5970 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0cb2f0 0x7f8c7c1f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0cb2f0 0x7f8c7c1f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59454/0 (socket says 172.21.15.37:59454) 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 -- 172.21.15.37:0/459201650 learned_addr learned my addr 172.21.15.37:0/459201650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c7a59c640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0d1eb0 0x7f8c7c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c7ad9d640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c7c1f5970 0x7f8c7c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 -- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c7c1f5970 msgr2=0x7f8c7c1f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c7c1f5970 0x7f8c7c1f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 -- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0d1eb0 msgr2=0x7f8c7c15de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0d1eb0 0x7f8c7c15de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 -- 172.21.15.37:0/459201650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c0c8b00 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c79d9b640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0cb2f0 0x7f8c7c1f5430 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8c6402a2b0 tx=0x7f8c640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c72ffd640 1 -- 172.21.15.37:0/459201650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64041020 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c72ffd640 1 -- 172.21.15.37:0/459201650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c640306c0 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c0b8820 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c72ffd640 1 -- 172.21.15.37:0/459201650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64037040 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.258+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7c0b8de0 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.259+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c7c0693f0 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.260+0000 7f8c72ffd640 1 -- 172.21.15.37:0/459201650 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c64044020 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.260+0000 7f8c72ffd640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c5c076300 0x7f8c5c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.261+0000 7f8c72ffd640 1 -- 172.21.15.37:0/459201650 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8c640b7f10 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.261+0000 7f8c7a59c640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c5c076300 0x7f8c5c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.261+0000 7f8c7a59c640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c5c076300 0x7f8c5c0787c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007330 tx=0x7f8c6c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.265+0000 7f8c72ffd640 1 -- 172.21.15.37:0/459201650 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8c6404b030 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.497+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8c7c0b4c50 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.498+0000 7f8c72ffd640 1 -- 172.21.15.37:0/459201650 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) ==== 53+0+73 (secure 0 0 0) 0x7f8c640816e0 con 0x7f8c7c0cb2f0 2024-05-10T08:44:05.497 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:44:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c5c076300 msgr2=0x7f8c5c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c5c076300 0x7f8c5c0787c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007330 tx=0x7f8c6c00b040 comp rx=0 tx=0).stop 2024-05-10T08:44:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0cb2f0 msgr2=0x7f8c7c1f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0cb2f0 0x7f8c7c1f5430 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8c6402a2b0 tx=0x7f8c640046c0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 shutdown_connections 2024-05-10T08:44:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8c5c076300 0x7f8c5c0787c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c7c1f5970 0x7f8c7c1f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7c0cb2f0 0x7f8c7c1f5430 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 --2- 172.21.15.37:0/459201650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7c0d1eb0 0x7f8c7c15de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 >> 172.21.15.37:0/459201650 conn(0x7f8c7c08eac0 msgr2=0x7f8c7c06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 shutdown_connections 2024-05-10T08:44:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05.500+0000 7f8c80932640 1 -- 172.21.15.37:0/459201650 wait complete. 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:44:05.510 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:44:05.511 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:44:05.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:05.511 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:44:05.528 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42516sec preferred_lft 42516sec 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:44:05.529 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:05.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:05.531 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:44:05.592 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:44:05.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:05.594 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:44:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:44:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:44:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:44:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:44:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:44:05.652 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:44:05.652 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:44:05.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:44:05.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:44:05.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:44:05.652 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:44:05.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:44:05.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:44:05.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:05.781 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:44:05.797 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:44:05.797 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:44:05.797 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:44:05.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:05.797 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:44:05.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:44:05.863 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:05.920 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:44:05.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:44:05.921 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:05.977 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:44:05.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:05.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:06.062 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:06.062 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:44:06.063 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:44:06.071 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:06.071 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:44:06.071 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:44:06.071 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:44:06.071 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:44:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:44:06.077 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:44:06.077 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:44:06.077 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:44:06.077 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:44:06.077 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:44:06.079 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:44:06.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:06.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:06.108 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:44:06.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:44:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:44:06.211 INFO:teuthology.orchestra.run.smithi037.stdout:client6255 2024-05-10T08:44:06.212 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:44:06.212 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:44:06.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:06.229 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-05-10T08:44:06.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:06.290 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-05-10T08:44:06.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:06.348 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-05-10T08:44:06.405 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:44:06.405 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:44:06.405 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:44:06.405 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:44:06.405 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-05-10T08:44:06.405 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:44:06.513 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2024-05-10T08:44:06.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:44:06.522 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:44:06.522 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:44:06.580 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:44:06.580 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:44:06.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:44:06.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.782+0000 7f31ac1c8640 1 Processor -- start 2024-05-10T08:44:06.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.782+0000 7f31ac1c8640 1 -- start start 2024-05-10T08:44:06.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.783+0000 7f31ac1c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31a406ee00 0x7f31a4073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.783+0000 7f31ac1c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a415f810 con 0x7f31a415f430 2024-05-10T08:44:06.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.783+0000 7f31ac1c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a4072d80 con 0x7f31a40b5f60 2024-05-10T08:44:06.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.783+0000 7f31ac1c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f31a4073060 con 0x7f31a406ee00 2024-05-10T08:44:06.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.783+0000 7f31a9f64640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31a415f430 0x7f31a4072480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56734/0 (socket says 172.21.15.37:56734) 2024-05-10T08:44:06.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.783+0000 7f31a9f64640 1 -- 172.21.15.37:0/3512964121 learned_addr learned my addr 172.21.15.37:0/3512964121 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31aa765640 1 --2- 172.21.15.37:0/3512964121 >> v2:172.21.15.82:3300/0 conn(0x7f31a406ee00 0x7f31a4073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764762621 0 0) 0x7f31a415f810 con 0x7f31a415f430 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f318c003520 con 0x7f31a415f430 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 735973528 0 0) 0x7f318c003520 con 0x7f31a415f430 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 >> v2:172.21.15.82:3300/0 conn(0x7f31a406ee00 msgr2=0x7f31a4073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 --2- 172.21.15.37:0/3512964121 >> v2:172.21.15.82:3300/0 conn(0x7f31a406ee00 0x7f31a4073e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 >> v1:172.21.15.82:6789/0 conn(0x7f31a40b5f60 legacy=0x7f31a406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a4073340 con 0x7f31a415f430 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f319c001670 con 0x7f31a415f430 2024-05-10T08:44:06.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 >> v1:172.21.15.37:6789/0 conn(0x7f31a415f430 legacy=0x7f31a4072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f318c0039e0 0x7f318c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f318c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f318c0051c0 0x7f318c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4073060 con 0x7f318c004800 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f318c00c0c0 con 0x7f318c0039e0 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f318c00c2c0 con 0x7f318c0051c0 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a9763640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f318c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31a9f64640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f318c0039e0 0x7f318c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.784+0000 7f31aa765640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f318c0051c0 0x7f318c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a9763640 1 -- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f318c0051c0 msgr2=0x7f318c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a9763640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f318c0051c0 0x7f318c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a9763640 1 -- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f318c0039e0 msgr2=0x7f318c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a9763640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f318c0039e0 0x7f318c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:06.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a9763640 1 -- 172.21.15.37:0/3512964121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c003520 con 0x7f318c004800 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31aa765640 1 -- 172.21.15.37:0/3512964121 reap_dead start 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a9f64640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f318c0039e0 0x7f318c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a9763640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f318c004c80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3198001830 tx=0x7f318c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e2910851b8acb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3198037070 con 0x7f318c004800 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.785+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319802abb0 con 0x7f318c004800 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31a8f62640 1 -- 172.21.15.37:0/3512964121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3198001430 con 0x7f318c004800 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3512964121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 msgr2=0x7f318c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f318c004c80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3198001830 tx=0x7f318c005830 comp rx=0 tx=0).stop 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3512964121 shutdown_connections 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3512964121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f318c004c80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3512964121 >> 172.21.15.37:0/3512964121 conn(0x7f31a40b2cc0 msgr2=0x7f31a40b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:06.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3512964121 shutdown_connections 2024-05-10T08:44:06.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.786+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3512964121 wait complete. 2024-05-10T08:44:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.787+0000 7f31ac1c8640 1 Processor -- start 2024-05-10T08:44:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.787+0000 7f31ac1c8640 1 -- start start 2024-05-10T08:44:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31ac1c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f31a4161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31ac1c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a415fa20 0x7f31a4162260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31ac1c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31a414eac0 0x7f31a409d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31ac1c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4073fa0 con 0x7f318c004800 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31ac1c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4073e20 con 0x7f31a415fa20 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31ac1c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f31a4074120 con 0x7f31a414eac0 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31a9f64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f31a4161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31a9f64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f31a4161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59472/0 (socket says 172.21.15.37:59472) 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31a9f64640 1 -- 172.21.15.37:0/3189819391 learned_addr learned my addr 172.21.15.37:0/3189819391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31a9763640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a415fa20 0x7f31a4162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.788+0000 7f31aa765640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31a414eac0 0x7f31a409d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a9f64640 1 -- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31a414eac0 msgr2=0x7f31a409d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a9f64640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31a414eac0 0x7f31a409d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a9f64640 1 -- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a415fa20 msgr2=0x7f31a4162260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a9f64640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a415fa20 0x7f31a4162260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a9f64640 1 -- 172.21.15.37:0/3189819391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a415ffe0 con 0x7f318c004800 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a9763640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a415fa20 0x7f31a4162260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:06.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a9f64640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f31a4161080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f319c0072f0 tx=0x7f319c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a27fc640 1 -- 172.21.15.37:0/3189819391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c01a070 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a27fc640 1 -- 172.21.15.37:0/3189819391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319c00f980 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a41602c0 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31a27fc640 1 -- 172.21.15.37:0/3189819391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c007d30 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.789+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a4160880 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.790+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a406a8e0 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.791+0000 7f31a27fc640 1 -- 172.21.15.37:0/3189819391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f319c01d070 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.791+0000 7f31a27fc640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f31900762d0 0x7f3190078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.791+0000 7f31a27fc640 1 -- 172.21.15.37:0/3189819391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f319c097190 con 0x7f318c004800 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.791+0000 7f31a9763640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f31900762d0 0x7f3190078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:06.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.792+0000 7f31a9763640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f31900762d0 0x7f3190078790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3198034000 tx=0x7f3198009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.795+0000 7f31a27fc640 1 -- 172.21.15.37:0/3189819391 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f31a406a8e0 con 0x7f318c004800 2024-05-10T08:44:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.998+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f31a40693f0 con 0x7f318c004800 2024-05-10T08:44:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:06.998+0000 7f31a27fc640 1 -- 172.21.15.37:0/3189819391 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f319c007b30 con 0x7f318c004800 2024-05-10T08:44:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:44:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f31900762d0 msgr2=0x7f3190078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f31900762d0 0x7f3190078790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3198034000 tx=0x7f3198009030 comp rx=0 tx=0).stop 2024-05-10T08:44:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 msgr2=0x7f31a4161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f31a4161080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f319c0072f0 tx=0x7f319c0077b0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 shutdown_connections 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f31900762d0 0x7f3190078790 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f31a414eac0 0x7f31a409d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a415fa20 0x7f31a4162260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 --2- 172.21.15.37:0/3189819391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318c004800 0x7f31a4161080 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 >> 172.21.15.37:0/3189819391 conn(0x7f31a40b2cc0 msgr2=0x7f31a40b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 shutdown_connections 2024-05-10T08:44:07.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.000+0000 7f31ac1c8640 1 -- 172.21.15.37:0/3189819391 wait complete. 2024-05-10T08:44:07.010 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:44:07.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:07.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:07.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:44:07.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:07.065 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:44:07.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:44:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.237+0000 7ff4c6409640 1 Processor -- start 2024-05-10T08:44:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.237+0000 7ff4c6409640 1 -- start start 2024-05-10T08:44:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4c6409640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff4c006e0f0 0x7ff4c015c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4c6409640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 0x7ff4c00d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4c6409640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c00d14b0 con 0x7ff4c006e4d0 2024-05-10T08:44:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4c6409640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c015c920 con 0x7ff4c006e0f0 2024-05-10T08:44:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4c6409640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c015cc00 con 0x7ff4c0072840 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4c49a6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4c006e4d0 0x7ff4c00b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56736/0 (socket says 172.21.15.37:56736) 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4c49a6640 1 -- 172.21.15.37:0/1537121144 learned_addr learned my addr 172.21.15.37:0/1537121144 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 0x7ff4c00d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4bffff640 1 --2- 172.21.15.37:0/1537121144 >> v2:172.21.15.82:3300/0 conn(0x7ff4c006e0f0 0x7ff4c015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892542017 0 0) 0x7ff4c00d14b0 con 0x7ff4c006e4d0 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.238+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4ac003520 con 0x7ff4c006e4d0 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1730207847 0 0) 0x7ff4ac003520 con 0x7ff4c006e4d0 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 msgr2=0x7ff4c00d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 0x7ff4c00d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 >> v2:172.21.15.82:3300/0 conn(0x7ff4c006e0f0 msgr2=0x7ff4c015c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 --2- 172.21.15.37:0/1537121144 >> v2:172.21.15.82:3300/0 conn(0x7ff4c006e0f0 0x7ff4c015c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c015cee0 con 0x7ff4c006e4d0 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7ff4b80019f0 con 0x7ff4c006e4d0 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 >> v1:172.21.15.37:6789/0 conn(0x7ff4c006e4d0 legacy=0x7ff4c00b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 0x7ff4ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4ac004d40 0x7ff4ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c015c920 con 0x7ff4ac003f30 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c015cc00 con 0x7ff4ac004d40 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac00b9c0 con 0x7ff4c0072840 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4bffff640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 0x7ff4ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4c49a6640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4ac004d40 0x7ff4ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4b7fff640 1 -- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 msgr2=0x7ff4ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c0072840 0x7ff4ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4b7fff640 1 -- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4ac004d40 msgr2=0x7ff4ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4ac004d40 0x7ff4ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.239+0000 7ff4b7fff640 1 -- 172.21.15.37:0/1537121144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac003520 con 0x7ff4ac003f30 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.240+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4ac004800 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009a90 tx=0x7ff4ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fa6ab1f2fd3de2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.240+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8036070 con 0x7ff4ac003f30 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.240+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a8031400 con 0x7ff4ac003f30 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.240+0000 7ff4bf7fe640 1 -- 172.21.15.37:0/1537121144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8009690 con 0x7ff4ac003f30 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.241+0000 7ff4c6409640 1 -- 172.21.15.37:0/1537121144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 msgr2=0x7ff4ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.241+0000 7ff4c6409640 1 --2- 172.21.15.37:0/1537121144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4ac004800 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009a90 tx=0x7ff4ac005830 comp rx=0 tx=0).stop 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.241+0000 7ff4c49a6640 1 -- 172.21.15.37:0/1537121144 reap_dead start 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.241+0000 7ff4c6409640 1 -- 172.21.15.37:0/1537121144 shutdown_connections 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.241+0000 7ff4c6409640 1 -- 172.21.15.37:0/1537121144 >> 172.21.15.37:0/1537121144 conn(0x7ff4c006c3a0 msgr2=0x7ff4c006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.241+0000 7ff4c6409640 1 -- 172.21.15.37:0/1537121144 shutdown_connections 2024-05-10T08:44:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.241+0000 7ff4c6409640 1 -- 172.21.15.37:0/1537121144 wait complete. 2024-05-10T08:44:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.242+0000 7ff4c6409640 1 Processor -- start 2024-05-10T08:44:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.242+0000 7ff4c6409640 1 -- start start 2024-05-10T08:44:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c6409640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4c014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c6409640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c00cc170 0x7ff4c0151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c6409640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c00cc5f0 0x7ff4c01521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c6409640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c00ae650 con 0x7ff4ac003f30 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c6409640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c006e980 con 0x7ff4c00cc5f0 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c6409640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c00ae7d0 con 0x7ff4c00cc170 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4c014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4c014cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59496/0 (socket says 172.21.15.37:59496) 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 -- 172.21.15.37:0/2095258587 learned_addr learned my addr 172.21.15.37:0/2095258587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c00cc170 0x7ff4c0151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c49a6640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c00cc5f0 0x7ff4c01521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 -- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c00cc170 msgr2=0x7ff4c0151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c00cc170 0x7ff4c0151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 -- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c00cc5f0 msgr2=0x7ff4c01521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c00cc5f0 0x7ff4c01521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 -- 172.21.15.37:0/2095258587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c00ccb50 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4c49a6640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c00cc5f0 0x7ff4c01521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.243+0000 7ff4bffff640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4c014cca0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0011aa0 tx=0x7ff4b0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.244+0000 7ff4bd7fa640 1 -- 172.21.15.37:0/2095258587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000fb80 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.244+0000 7ff4bd7fa640 1 -- 172.21.15.37:0/2095258587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b000fd20 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.244+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c00cce30 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.244+0000 7ff4bd7fa640 1 -- 172.21.15.37:0/2095258587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0014660 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.244+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c014d840 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.245+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c00693f0 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.245+0000 7ff4bd7fa640 1 -- 172.21.15.37:0/2095258587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4b0012040 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.246+0000 7ff4bd7fa640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4a00762d0 0x7ff4a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.246+0000 7ff4bd7fa640 1 -- 172.21.15.37:0/2095258587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7ff4b0097e70 con 0x7ff4ac003f30 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.246+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4a00762d0 0x7ff4a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.247+0000 7ff4b7fff640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4a00762d0 0x7ff4a0078790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8033000 tx=0x7ff4a8008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.250+0000 7ff4bd7fa640 1 -- 172.21.15.37:0/2095258587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff4b0019030 con 0x7ff4ac003f30 2024-05-10T08:44:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.487+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c00b5c20 con 0x7ff4ac003f30 2024-05-10T08:44:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.488+0000 7ff4bd7fa640 1 -- 172.21.15.37:0/2095258587 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5180 (secure 0 0 0) 0x7ff4b0061640 con 0x7ff4ac003f30 2024-05-10T08:44:07.487 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:07.487 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:01.751876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6108},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6108":{"gid":6108,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3151779785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3151779785},{"type":"v1","addr":"172.21.15.37:6835","nonce":3151779785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6108,"qdb_cluster":[6108]},"id":5}]} 2024-05-10T08:44:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 45 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4a00762d0 msgr2=0x7ff4a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4a00762d0 0x7ff4a0078790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8033000 tx=0x7ff4a8008030 comp rx=0 tx=0).stop 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 msgr2=0x7ff4c014cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4c014cca0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0011aa0 tx=0x7ff4b0011f60 comp rx=0 tx=0).stop 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 shutdown_connections 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff4a00762d0 0x7ff4a0078790 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4c00cc5f0 0x7ff4c01521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff4c00cc170 0x7ff4c0151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 --2- 172.21.15.37:0/2095258587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac003f30 0x7ff4c014cca0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 >> 172.21.15.37:0/2095258587 conn(0x7ff4c006c3a0 msgr2=0x7ff4c015b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 shutdown_connections 2024-05-10T08:44:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.490+0000 7ff4c6409640 1 -- 172.21.15.37:0/2095258587 wait complete. 2024-05-10T08:44:07.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T08:44:07.628 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2024-05-10T08:44:07.629 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:44:07.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:44:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.734+0000 7f67dfdd0640 1 Processor -- start 2024-05-10T08:44:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.734+0000 7f67dfdd0640 1 -- start start 2024-05-10T08:44:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67dfdd0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67d815f430 0x7f67d8073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67dfdd0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 0x7f67d8072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67dfdd0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d815f810 con 0x7f67d806e6f0 2024-05-10T08:44:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67dfdd0640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f67d8072d80 con 0x7f67d815f430 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67dfdd0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f67d8073060 con 0x7f67d80b5f60 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67de36d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67d806e6f0 0x7f67d80cefd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33660/0 (socket says 172.21.15.37:33660) 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67de36d640 1 -- 172.21.15.37:0/3575969099 learned_addr learned my addr 172.21.15.37:0/3575969099 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67dd36b640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 0x7f67d8072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/3575969099 >> v2:172.21.15.82:3300/0 conn(0x7f67d815f430 0x7f67d8073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.735+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344277122 0 0) 0x7f67d815f810 con 0x7f67d806e6f0 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67c4003520 con 0x7f67d806e6f0 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3108939529 0 0) 0x7f67c4003520 con 0x7f67d806e6f0 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 msgr2=0x7f67d8072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 0x7f67d8072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 >> v2:172.21.15.82:3300/0 conn(0x7f67d815f430 msgr2=0x7f67d8073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 --2- 172.21.15.37:0/3575969099 >> v2:172.21.15.82:3300/0 conn(0x7f67d815f430 0x7f67d8073e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d8073340 con 0x7f67d806e6f0 2024-05-10T08:44:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f67d00019f0 con 0x7f67d806e6f0 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dd36b640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 0x7f67d8072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/3575969099 >> v2:172.21.15.82:3300/0 conn(0x7f67d815f430 0x7f67d8073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 >> v1:172.21.15.37:6789/0 conn(0x7f67d806e6f0 legacy=0x7f67d80cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40039b0 0x7f67c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 0x7f67c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67c4004d40 0x7f67c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8072d80 con 0x7f67c40039b0 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8073060 con 0x7f67c4004d40 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f67c400b9c0 con 0x7f67d80b5f60 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40039b0 0x7f67c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67dd36b640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 0x7f67c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67de36d640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67c4004d40 0x7f67c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67ddb6c640 1 -- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 msgr2=0x7f67c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67d80b5f60 0x7f67c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67ddb6c640 1 -- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67c4004d40 msgr2=0x7f67c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67c4004d40 0x7f67c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.736+0000 7f67ddb6c640 1 -- 172.21.15.37:0/3575969099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c4003520 con 0x7f67c40039b0 2024-05-10T08:44:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.737+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40039b0 0x7f67c4003dd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009c90 tx=0x7f67c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8208b09d88e5f6f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.737+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4036070 con 0x7f67c40039b0 2024-05-10T08:44:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.737+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d4031400 con 0x7f67c40039b0 2024-05-10T08:44:07.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.737+0000 7f67dcb6a640 1 -- 172.21.15.37:0/3575969099 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4009860 con 0x7f67c40039b0 2024-05-10T08:44:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.738+0000 7f67dfdd0640 1 -- 172.21.15.37:0/3575969099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40039b0 msgr2=0x7f67c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.738+0000 7f67dfdd0640 1 --2- 172.21.15.37:0/3575969099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40039b0 0x7f67c4003dd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009c90 tx=0x7f67c4005830 comp rx=0 tx=0).stop 2024-05-10T08:44:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.738+0000 7f67de36d640 1 -- 172.21.15.37:0/3575969099 reap_dead start 2024-05-10T08:44:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.738+0000 7f67dfdd0640 1 -- 172.21.15.37:0/3575969099 shutdown_connections 2024-05-10T08:44:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.738+0000 7f67dfdd0640 1 -- 172.21.15.37:0/3575969099 >> 172.21.15.37:0/3575969099 conn(0x7f67d80b2cc0 msgr2=0x7f67d80b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.738+0000 7f67dfdd0640 1 -- 172.21.15.37:0/3575969099 shutdown_connections 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.738+0000 7f67dfdd0640 1 -- 172.21.15.37:0/3575969099 wait complete. 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.739+0000 7f67dfdd0640 1 Processor -- start 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.739+0000 7f67dfdd0640 1 -- start start 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dfdd0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c40039b0 0x7f67d8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dfdd0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d8157e90 0x7f67d8159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dfdd0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d815ad90 0x7f67d815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dfdd0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67d806ed00 con 0x7f67d8157e90 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dfdd0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67d806eb80 con 0x7f67d815ad90 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dfdd0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f67d806ee80 con 0x7f67c40039b0 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d8157e90 0x7f67d8159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d8157e90 0x7f67d8159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45402/0 (socket says 172.21.15.37:45402) 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 -- 172.21.15.37:0/1451152929 learned_addr learned my addr 172.21.15.37:0/1451152929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c40039b0 0x7f67d8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67de36d640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d815ad90 0x7f67d815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 -- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c40039b0 msgr2=0x7f67d8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c40039b0 0x7f67d8157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 -- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d815ad90 msgr2=0x7f67d815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d815ad90 0x7f67d815b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 -- 172.21.15.37:0/1451152929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d809d020 con 0x7f67d8157e90 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c40039b0 0x7f67d8157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67de36d640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d815ad90 0x7f67d815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.740+0000 7f67dd36b640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d8157e90 0x7f67d8159460 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f67c8011990 tx=0x7f67c8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.741+0000 7f67ce7fc640 1 -- 172.21.15.37:0/1451152929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c800fad0 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.741+0000 7f67ce7fc640 1 -- 172.21.15.37:0/1451152929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c800fc70 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.741+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d8159af0 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.741+0000 7f67ce7fc640 1 -- 172.21.15.37:0/1451152929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8004030 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.741+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d815a0b0 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.742+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d80693f0 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.742+0000 7f67ce7fc640 1 -- 172.21.15.37:0/1451152929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f67c8012040 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.743+0000 7f67ce7fc640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67bc0762d0 0x7f67bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.743+0000 7f67ce7fc640 1 -- 172.21.15.37:0/1451152929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f67c8097ac0 con 0x7f67d8157e90 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.743+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67bc0762d0 0x7f67bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.743+0000 7f67ddb6c640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67bc0762d0 0x7f67bc078790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67d4033000 tx=0x7f67d4008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.747+0000 7f67ce7fc640 1 -- 172.21.15.37:0/1451152929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f67d809d020 con 0x7f67d8157e90 2024-05-10T08:44:07.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.976+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f67d80b2a30 con 0x7f67d8157e90 2024-05-10T08:44:07.975 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:44:07.976+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:44:07.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.977+0000 7f67ce7fc640 1 -- 172.21.15.37:0/1451152929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) ==== 161+0+0 (secure 0 0 0) 0x7f67c8019070 con 0x7f67d8157e90 2024-05-10T08:44:07.977 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:44:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67bc0762d0 msgr2=0x7f67bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67bc0762d0 0x7f67bc078790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67d4033000 tx=0x7f67d4008030 comp rx=0 tx=0).stop 2024-05-10T08:44:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d8157e90 msgr2=0x7f67d8159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d8157e90 0x7f67d8159460 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f67c8011990 tx=0x7f67c8011e50 comp rx=0 tx=0).stop 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 shutdown_connections 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f67bc0762d0 0x7f67bc078790 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d815ad90 0x7f67d815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d8157e90 0x7f67d8159460 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 --2- 172.21.15.37:0/1451152929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67c40039b0 0x7f67d8157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 >> 172.21.15.37:0/1451152929 conn(0x7f67d80b2cc0 msgr2=0x7f67d80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 shutdown_connections 2024-05-10T08:44:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:07.981+0000 7f67dfdd0640 1 -- 172.21.15.37:0/1451152929 wait complete. 2024-05-10T08:44:07.982 INFO:tasks.ceph.mds.c.smithi037.stderr: -4629> 2024-05-10T08:44:01.322+0000 7f63bba6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:44:07.992 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-05-10T08:44:08.013 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:44:08.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.041+0000 7fac35849f40 1 Processor -- start 2024-05-10T08:44:08.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.041+0000 7fac35849f40 1 -- start start 2024-05-10T08:44:08.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac35849f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 0x55a7fb4070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac35849f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb409980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac35849f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 0x55a7fb48b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac35849f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a7fb3c4810 con 0x55a7fb40a9a0 2024-05-10T08:44:08.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac35849f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a7fb3c23e0 con 0x55a7fb3c1f70 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac35849f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55a7fb3c4af0 con 0x55a7fb49a6e0 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb409980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb409980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45432/0 (socket says 172.21.15.37:45432) 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 -- 172.21.15.37:0/2572310303 learned_addr learned my addr 172.21.15.37:0/2572310303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac33343640 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 0x55a7fb4070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac33b44640 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 0x55a7fb48b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 -- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 msgr2=0x55a7fb48b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 0x55a7fb48b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 -- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 msgr2=0x55a7fb4070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 0x55a7fb4070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.042+0000 7fac2bfff640 1 -- 172.21.15.37:0/2572310303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7fb32c350 con 0x55a7fb40a9a0 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac2bfff640 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb409980 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00a610 tx=0x7fac1c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a49d05a7f189be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac32341640 1 -- 172.21.15.37:0/2572310303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c008a60 con 0x55a7fb40a9a0 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac32341640 1 -- 172.21.15.37:0/2572310303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c008c00 con 0x55a7fb40a9a0 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac32341640 1 -- 172.21.15.37:0/2572310303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c013440 con 0x55a7fb40a9a0 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 -- 172.21.15.37:0/2572310303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 msgr2=0x55a7fb409980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb409980 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00a610 tx=0x7fac1c005f90 comp rx=0 tx=0).stop 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 -- 172.21.15.37:0/2572310303 shutdown_connections 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 0x55a7fb48b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb409980 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 --2- 172.21.15.37:0/2572310303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 0x55a7fb4070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 -- 172.21.15.37:0/2572310303 >> 172.21.15.37:0/2572310303 conn(0x55a7fb3c2b40 msgr2=0x55a7fb49d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 -- 172.21.15.37:0/2572310303 shutdown_connections 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.043+0000 7fac35849f40 1 -- 172.21.15.37:0/2572310303 wait complete. 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.044+0000 7fac35849f40 1 Processor -- start 2024-05-10T08:44:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.044+0000 7fac35849f40 1 -- start start 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac35849f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 0x55a7fb4897d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac35849f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb49d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac35849f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 0x55a7fb49d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac35849f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a7fb4975d0 con 0x55a7fb40a9a0 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac35849f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a7fb49bc70 con 0x55a7fb3c1f70 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac35849f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55a7fb407db0 con 0x55a7fb49a6e0 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb49d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb49d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45436/0 (socket says 172.21.15.37:45436) 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 -- 172.21.15.37:0/1220839248 learned_addr learned my addr 172.21.15.37:0/1220839248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac33343640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 0x55a7fb4897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac33b44640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 0x55a7fb49d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 -- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 msgr2=0x55a7fb49d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55a7fb49a6e0 0x55a7fb49d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 -- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 msgr2=0x55a7fb4897d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7fb3c1f70 0x55a7fb4897d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 -- 172.21.15.37:0/1220839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7fb529340 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac2bfff640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb49d2a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fac1c010000 tx=0x7fac1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac3133f640 1 -- 172.21.15.37:0/1220839248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c022020 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac3133f640 1 -- 172.21.15.37:0/1220839248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c005340 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7fb48a1f0 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.045+0000 7fac3133f640 1 -- 172.21.15.37:0/1220839248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c018040 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.046+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7fb497400 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.047+0000 7fac3133f640 1 -- 172.21.15.37:0/1220839248 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac1c025020 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.047+0000 7fac3133f640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fac14074cb0 0x7fac14077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.048+0000 7fac3133f640 1 -- 172.21.15.37:0/1220839248 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fac1c097ee0 con 0x55a7fb40a9a0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.048+0000 7fac33343640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fac14074cb0 0x7fac14077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.048+0000 7fac35849f40 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55a7fb4079d0 0x55a7fb48ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.048+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) -- 0x55a7fb3ef520 con 0x55a7fb4079d0 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.048+0000 7fac33b44640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55a7fb4079d0 0x55a7fb48ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.048+0000 7fac33b44640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55a7fb4079d0 0x55a7fb48ed90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.048+0000 7fac33343640 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fac14074cb0 0x7fac14077170 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fac24057000 tx=0x7fac24052000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac33b44640 1 -- 172.21.15.37:0/1220839248 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v76'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fac2c00d750 con 0x55a7fb4079d0 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55a7fb4079d0 msgr2=0x55a7fb48ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55a7fb4079d0 0x55a7fb48ed90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fac14074cb0 msgr2=0x7fac14077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fac14074cb0 0x7fac14077170 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fac24057000 tx=0x7fac24052000 comp rx=0 tx=0).stop 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 msgr2=0x55a7fb49d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 --2- 172.21.15.37:0/1220839248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7fb40a9a0 0x55a7fb49d2a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fac1c010000 tx=0x7fac1c002fb0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac33b44640 1 -- 172.21.15.37:0/1220839248 reap_dead start 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 shutdown_connections 2024-05-10T08:44:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 >> 172.21.15.37:0/1220839248 conn(0x55a7fb3c2b40 msgr2=0x55a7fb408ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:08.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 shutdown_connections 2024-05-10T08:44:08.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.050+0000 7fac35849f40 1 -- 172.21.15.37:0/1220839248 wait complete. 2024-05-10T08:44:08.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T08:44:08.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.203+0000 7f557dd11640 1 Processor -- start 2024-05-10T08:44:08.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.203+0000 7f557dd11640 1 -- start start 2024-05-10T08:44:08.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f557dd11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f557806e0f0 0x7f557815c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f557dd11640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f55780d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f557dd11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55780d14b0 con 0x7f557806e4d0 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f557dd11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f557815c920 con 0x7f557806e0f0 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f557dd11640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f557815cc00 con 0x7f5578072840 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f55777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f557806e0f0 0x7f557815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f55777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f557806e0f0 0x7f557815c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45448/0 (socket says 172.21.15.37:45448) 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f5577fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f557806e4d0 0x7f55780b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33682/0 (socket says 172.21.15.37:33682) 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f55777fe640 1 -- 172.21.15.37:0/1689921361 learned_addr learned my addr 172.21.15.37:0/1689921361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f5576ffd640 1 --2- 172.21.15.37:0/1689921361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f55780d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.204+0000 7f55767fc640 1 -- 172.21.15.37:0/1689921361 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382441823 0 0) 0x7f55780d14b0 con 0x7f557806e4d0 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55767fc640 1 -- 172.21.15.37:0/1689921361 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5564003520 con 0x7f557806e4d0 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55777fe640 1 -- 172.21.15.37:0/1689921361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 msgr2=0x7f55780d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55777fe640 1 --2- 172.21.15.37:0/1689921361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f55780d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55777fe640 1 -- 172.21.15.37:0/1689921361 >> v1:172.21.15.37:6789/0 conn(0x7f557806e4d0 legacy=0x7f55780b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55777fe640 1 -- 172.21.15.37:0/1689921361 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557815cee0 con 0x7f557806e0f0 2024-05-10T08:44:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55777fe640 1 --2- 172.21.15.37:0/1689921361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e0f0 0x7f557815c340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5568009e50 tx=0x7f556802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8fba0797be3e4a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55767fc640 1 -- 172.21.15.37:0/1689921361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568036070 con 0x7f557806e0f0 2024-05-10T08:44:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55767fc640 1 -- 172.21.15.37:0/1689921361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5568031600 con 0x7f557806e0f0 2024-05-10T08:44:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.205+0000 7f55767fc640 1 -- 172.21.15.37:0/1689921361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55680319d0 con 0x7f557806e0f0 2024-05-10T08:44:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 -- 172.21.15.37:0/1689921361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e0f0 msgr2=0x7f557815c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 --2- 172.21.15.37:0/1689921361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e0f0 0x7f557815c340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5568009e50 tx=0x7f556802a710 comp rx=0 tx=0).stop 2024-05-10T08:44:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 -- 172.21.15.37:0/1689921361 shutdown_connections 2024-05-10T08:44:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 --2- 172.21.15.37:0/1689921361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f55780d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 --2- 172.21.15.37:0/1689921361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e0f0 0x7f557815c340 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 -- 172.21.15.37:0/1689921361 >> 172.21.15.37:0/1689921361 conn(0x7f557806c3a0 msgr2=0x7f557806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 -- 172.21.15.37:0/1689921361 shutdown_connections 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.206+0000 7f557dd11640 1 -- 172.21.15.37:0/1689921361 wait complete. 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.207+0000 7f557dd11640 1 Processor -- start 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.207+0000 7f557dd11640 1 -- start start 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f557dd11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557806e0f0 0x7f5578148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f557dd11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e4d0 0x7f5578153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f557dd11640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f5578154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f557dd11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55780ae650 con 0x7f557806e4d0 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f557dd11640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f557806e980 con 0x7f557806e0f0 2024-05-10T08:44:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f557dd11640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f55780ae7d0 con 0x7f5578072840 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f5576ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e4d0 0x7f5578153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f5576ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e4d0 0x7f5578153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45460/0 (socket says 172.21.15.37:45460) 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f5576ffd640 1 -- 172.21.15.37:0/276154003 learned_addr learned my addr 172.21.15.37:0/276154003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.208+0000 7f5577fff640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f5578154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f55777fe640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557806e0f0 0x7f5578148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f5576ffd640 1 -- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 msgr2=0x7f5578154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f5576ffd640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f5578154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f5576ffd640 1 -- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557806e0f0 msgr2=0x7f5578148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f5576ffd640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557806e0f0 0x7f5578148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f5576ffd640 1 -- 172.21.15.37:0/276154003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557809be50 con 0x7f557806e4d0 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f5577fff640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f5578154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f55777fe640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557806e0f0 0x7f5578148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f5576ffd640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e4d0 0x7f5578153ac0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f556000e840 tx=0x7f556000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f556ffff640 1 -- 172.21.15.37:0/276154003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560017070 con 0x7f557806e4d0 2024-05-10T08:44:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f556ffff640 1 -- 172.21.15.37:0/276154003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556000c940 con 0x7f557806e4d0 2024-05-10T08:44:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5578154710 con 0x7f557806e4d0 2024-05-10T08:44:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f556ffff640 1 -- 172.21.15.37:0/276154003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556000cd10 con 0x7f557806e4d0 2024-05-10T08:44:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.209+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5578154cd0 con 0x7f557806e4d0 2024-05-10T08:44:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.210+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55780693f0 con 0x7f557806e4d0 2024-05-10T08:44:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.211+0000 7f556ffff640 1 -- 172.21.15.37:0/276154003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f556001a070 con 0x7f557806e4d0 2024-05-10T08:44:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.211+0000 7f556ffff640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55580762d0 0x7f5558078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.211+0000 7f556ffff640 1 -- 172.21.15.37:0/276154003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f5560097660 con 0x7f557806e4d0 2024-05-10T08:44:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.211+0000 7f55777fe640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55580762d0 0x7f5558078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.212+0000 7f55777fe640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55580762d0 0x7f5558078790 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5568033000 tx=0x7f5568009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.216+0000 7f556ffff640 1 -- 172.21.15.37:0/276154003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5560060de0 con 0x7f557806e4d0 2024-05-10T08:44:08.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.453+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f5578073ea0 con 0x7f557806e4d0 2024-05-10T08:44:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.720+0000 7f556ffff640 1 -- 172.21.15.37:0/276154003 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v47) ==== 162+0+0 (secure 0 0 0) 0x7f55600606e0 con 0x7f557806e4d0 2024-05-10T08:44:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T08:44:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55580762d0 msgr2=0x7f5558078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55580762d0 0x7f5558078790 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5568033000 tx=0x7f5568009000 comp rx=0 tx=0).stop 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e4d0 msgr2=0x7f5578153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e4d0 0x7f5578153ac0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f556000e840 tx=0x7f556000ed00 comp rx=0 tx=0).stop 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 shutdown_connections 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55580762d0 0x7f5558078790 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5578072840 0x7f5578154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f557806e4d0 0x7f5578153ac0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 --2- 172.21.15.37:0/276154003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557806e0f0 0x7f5578148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 >> 172.21.15.37:0/276154003 conn(0x7f557806c3a0 msgr2=0x7f557815d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 shutdown_connections 2024-05-10T08:44:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.723+0000 7f557dd11640 1 -- 172.21.15.37:0/276154003 wait complete. 2024-05-10T08:44:08.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:44:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.841+0000 7fcc52958640 1 Processor -- start 2024-05-10T08:44:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.841+0000 7fcc52958640 1 -- start start 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc52958640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c0d20c0 0x7fcc4c163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc52958640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc4c071110 0x7fcc4c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc52958640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc4c0d1300 con 0x7fcc4c070d30 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc52958640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcc4c0d10d0 con 0x7fcc4c071110 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc52958640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4c070b80 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc50ef5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc4c071110 0x7fcc4c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c0d20c0 0x7fcc4c163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc50ef5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc4c071110 0x7fcc4c06d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:51956/0 (socket says 172.21.15.37:51956) 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc4bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcc4c070d30 0x7fcc4c0703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:42580/0 (socket says 172.21.15.37:42580) 2024-05-10T08:44:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc50ef5640 1 -- 172.21.15.37:0/3888073845 learned_addr learned my addr 172.21.15.37:0/3888073845 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc4b7fe640 1 -- 172.21.15.37:0/3888073845 >> v2:172.21.15.82:3300/0 conn(0x7fcc4c071110 msgr2=0x7fcc4c06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc4b7fe640 1 --2- 172.21.15.37:0/3888073845 >> v2:172.21.15.82:3300/0 conn(0x7fcc4c071110 0x7fcc4c06d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc4b7fe640 1 -- 172.21.15.37:0/3888073845 >> v1:172.21.15.82:6789/0 conn(0x7fcc4c070d30 legacy=0x7fcc4c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc4b7fe640 1 -- 172.21.15.37:0/3888073845 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c0d15e0 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.842+0000 7fcc50ef5640 1 --2- 172.21.15.37:0/3888073845 >> v2:172.21.15.82:3300/0 conn(0x7fcc4c071110 0x7fcc4c06d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.843+0000 7fcc4b7fe640 1 --2- 172.21.15.37:0/3888073845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c0d20c0 0x7fcc4c163920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097a0 tx=0x7fcc4002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cdf8c8f1d8e2a61 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.843+0000 7fcc4affd640 1 -- 172.21.15.37:0/3888073845 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40037070 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc4affd640 1 -- 172.21.15.37:0/3888073845 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc40032440 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc4affd640 1 -- 172.21.15.37:0/3888073845 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40032810 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 -- 172.21.15.37:0/3888073845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c0d20c0 msgr2=0x7fcc4c163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 --2- 172.21.15.37:0/3888073845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c0d20c0 0x7fcc4c163920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097a0 tx=0x7fcc4002a180 comp rx=0 tx=0).stop 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 -- 172.21.15.37:0/3888073845 shutdown_connections 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 --2- 172.21.15.37:0/3888073845 >> v2:172.21.15.82:3300/0 conn(0x7fcc4c071110 0x7fcc4c06d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 --2- 172.21.15.37:0/3888073845 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c0d20c0 0x7fcc4c163920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 -- 172.21.15.37:0/3888073845 >> 172.21.15.37:0/3888073845 conn(0x7fcc4c0d2e90 msgr2=0x7fcc4c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 -- 172.21.15.37:0/3888073845 shutdown_connections 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.844+0000 7fcc52958640 1 -- 172.21.15.37:0/3888073845 wait complete. 2024-05-10T08:44:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.845+0000 7fcc52958640 1 Processor -- start 2024-05-10T08:44:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc52958640 1 -- start start 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc52958640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c070d30 0x7fcc4c1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc52958640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc4c071110 0x7fcc4c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc52958640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c0d20c0 0x7fcc4c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc52958640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c071580 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc52958640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c0d1c30 con 0x7fcc4c071110 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc52958640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4c071700 con 0x7fcc4c070d30 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc50ef5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c0d20c0 0x7fcc4c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc50ef5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c0d20c0 0x7fcc4c0b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45462/0 (socket says 172.21.15.37:45462) 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.846+0000 7fcc50ef5640 1 -- 172.21.15.37:0/123798437 learned_addr learned my addr 172.21.15.37:0/123798437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc4b7fe640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc4c071110 0x7fcc4c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc4bfff640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c070d30 0x7fcc4c1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc50ef5640 1 -- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c070d30 msgr2=0x7fcc4c1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc50ef5640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c070d30 0x7fcc4c1f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc50ef5640 1 -- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc4c071110 msgr2=0x7fcc4c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc50ef5640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc4c071110 0x7fcc4c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc50ef5640 1 -- 172.21.15.37:0/123798437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c1f5e70 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc50ef5640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c0d20c0 0x7fcc4c0b27f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400efc0 tx=0x7fcc4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc48ff9640 1 -- 172.21.15.37:0/123798437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400cb80 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc48ff9640 1 -- 172.21.15.37:0/123798437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4400cd20 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4c1f6110 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc48ff9640 1 -- 172.21.15.37:0/123798437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44003bb0 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.847+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4c1f66d0 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.848+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc4c0693f0 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.849+0000 7fcc48ff9640 1 -- 172.21.15.37:0/123798437 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc4401b030 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.849+0000 7fcc48ff9640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc380762d0 0x7fcc38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.849+0000 7fcc48ff9640 1 -- 172.21.15.37:0/123798437 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fcc44097aa0 con 0x7fcc4c0d20c0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.850+0000 7fcc4bfff640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc380762d0 0x7fcc38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.850+0000 7fcc4bfff640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc380762d0 0x7fcc38078790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c154bf0 tx=0x7fcc3c007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:08.854+0000 7fcc48ff9640 1 -- 172.21.15.37:0/123798437 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcc44022020 con 0x7fcc4c0d20c0 2024-05-10T08:44:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.084+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc4c0d3d70 con 0x7fcc4c0d20c0 2024-05-10T08:44:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.084+0000 7fcc48ff9640 1 -- 172.21.15.37:0/123798437 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5174 (secure 0 0 0) 0x7fcc44069030 con 0x7fcc4c0d20c0 2024-05-10T08:44:09.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:09.084 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:08.718402+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-05-10T08:44:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc380762d0 msgr2=0x7fcc38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc380762d0 0x7fcc38078790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c154bf0 tx=0x7fcc3c007e80 comp rx=0 tx=0).stop 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c0d20c0 msgr2=0x7fcc4c0b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c0d20c0 0x7fcc4c0b27f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400efc0 tx=0x7fcc4400c490 comp rx=0 tx=0).stop 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 shutdown_connections 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc380762d0 0x7fcc38078790 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c0d20c0 0x7fcc4c0b27f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc4c071110 0x7fcc4c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 --2- 172.21.15.37:0/123798437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc4c070d30 0x7fcc4c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 >> 172.21.15.37:0/123798437 conn(0x7fcc4c0d2e90 msgr2=0x7fcc4c163600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 shutdown_connections 2024-05-10T08:44:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:09.086+0000 7fcc52958640 1 -- 172.21.15.37:0/123798437 wait complete. 2024-05-10T08:44:09.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:43:58.731926+0000', 'modified': '2024-05-10T08:44:08.718402+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6282': {'gid': 6282, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6835/3086098191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3086098191}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3086098191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:44:09.499 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6282:up:replay 2024-05-10T08:44:10.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:44:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.618+0000 7fa9aa587640 1 Processor -- start 2024-05-10T08:44:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.618+0000 7fa9aa587640 1 -- start start 2024-05-10T08:44:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.619+0000 7fa9aa587640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.619+0000 7fa9aa587640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9a406e4d0 0x7fa9a40aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.619+0000 7fa9aa587640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9a415c920 con 0x7fa9a4072840 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.619+0000 7fa9aa587640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa9a415cc00 con 0x7fa9a406e4d0 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.619+0000 7fa9aa587640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a415cee0 con 0x7fa9a406e0f0 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.619+0000 7fa9a8b24640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9a406e4d0 0x7fa9a40aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.620+0000 7fa9a8b24640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9a406e4d0 0x7fa9a40aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45468/0 (socket says 172.21.15.37:45468) 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.620+0000 7fa9a8b24640 1 -- 172.21.15.37:0/4249796661 learned_addr learned my addr 172.21.15.37:0/4249796661 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.620+0000 7fa9a3fff640 1 --2- 172.21.15.37:0/4249796661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.620+0000 7fa9a8b24640 1 -- 172.21.15.37:0/4249796661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 msgr2=0x7fa9a415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.620+0000 7fa9a8b24640 1 --2- 172.21.15.37:0/4249796661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.620+0000 7fa9a8b24640 1 -- 172.21.15.37:0/4249796661 >> v1:172.21.15.82:6789/0 conn(0x7fa9a4072840 legacy=0x7fa9a40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.620+0000 7fa9a8b24640 1 -- 172.21.15.37:0/4249796661 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a415d1c0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.621+0000 7fa9a8b24640 1 --2- 172.21.15.37:0/4249796661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a40aec30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009e50 tx=0x7fa99c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caf1e1d67082c1a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.621+0000 7fa9a37fe640 1 -- 172.21.15.37:0/4249796661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c036070 con 0x7fa9a406e4d0 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.621+0000 7fa9a37fe640 1 -- 172.21.15.37:0/4249796661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c031600 con 0x7fa9a406e4d0 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.621+0000 7fa9a37fe640 1 -- 172.21.15.37:0/4249796661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c0319d0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.621+0000 7fa9aa587640 1 -- 172.21.15.37:0/4249796661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 msgr2=0x7fa9a40aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.621+0000 7fa9aa587640 1 --2- 172.21.15.37:0/4249796661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a40aec30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009e50 tx=0x7fa99c02a710 comp rx=0 tx=0).stop 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.622+0000 7fa9aa587640 1 -- 172.21.15.37:0/4249796661 shutdown_connections 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.622+0000 7fa9aa587640 1 --2- 172.21.15.37:0/4249796661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a40aec30 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.622+0000 7fa9aa587640 1 --2- 172.21.15.37:0/4249796661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.622+0000 7fa9aa587640 1 -- 172.21.15.37:0/4249796661 >> 172.21.15.37:0/4249796661 conn(0x7fa9a406c3a0 msgr2=0x7fa9a406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.622+0000 7fa9aa587640 1 -- 172.21.15.37:0/4249796661 shutdown_connections 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.622+0000 7fa9aa587640 1 -- 172.21.15.37:0/4249796661 wait complete. 2024-05-10T08:44:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.623+0000 7fa9aa587640 1 Processor -- start 2024-05-10T08:44:10.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.623+0000 7fa9aa587640 1 -- start start 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9aa587640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a40cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9aa587640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a4148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9aa587640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4072840 0x7fa9a40b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9aa587640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40ae7d0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9aa587640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40ae650 con 0x7fa9a4072840 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9aa587640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a41530b0 con 0x7fa9a406e0f0 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a4148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a4148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45474/0 (socket says 172.21.15.37:45474) 2024-05-10T08:44:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 -- 172.21.15.37:0/2968451906 learned_addr learned my addr 172.21.15.37:0/2968451906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9a8b24640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4072840 0x7fa9a40b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9a3fff640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a40cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 -- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 msgr2=0x7fa9a40cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a40cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 -- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4072840 msgr2=0x7fa9a40b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4072840 0x7fa9a40b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 -- 172.21.15.37:0/2968451906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a409bdb0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9a3fff640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a40cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9a8b24640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4072840 0x7fa9a40b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa99bfff640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a4148550 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00c440 tx=0x7fa98c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9a17fa640 1 -- 172.21.15.37:0/2968451906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0052d0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9a17fa640 1 -- 172.21.15.37:0/2968451906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa98c005470 con 0x7fa9a406e4d0 2024-05-10T08:44:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.624+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a409c090 con 0x7fa9a406e4d0 2024-05-10T08:44:10.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.625+0000 7fa9a17fa640 1 -- 172.21.15.37:0/2968451906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c007260 con 0x7fa9a406e4d0 2024-05-10T08:44:10.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.625+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a409c650 con 0x7fa9a406e4d0 2024-05-10T08:44:10.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.625+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a40693f0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.626+0000 7fa9a17fa640 1 -- 172.21.15.37:0/2968451906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa98c007400 con 0x7fa9a406e4d0 2024-05-10T08:44:10.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.627+0000 7fa9a17fa640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa9840762d0 0x7fa984078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:10.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.627+0000 7fa9a17fa640 1 -- 172.21.15.37:0/2968451906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fa98c096cc0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.627+0000 7fa9a3fff640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa9840762d0 0x7fa984078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:10.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.628+0000 7fa9a3fff640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa9840762d0 0x7fa984078790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa994006fd0 tx=0x7fa994008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:10.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.631+0000 7fa9a17fa640 1 -- 172.21.15.37:0/2968451906 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa98c060440 con 0x7fa9a406e4d0 2024-05-10T08:44:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.865+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9a40cd2a0 con 0x7fa9a406e4d0 2024-05-10T08:44:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.865+0000 7fa9a17fa640 1 -- 172.21.15.37:0/2968451906 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5174 (secure 0 0 0) 0x7fa98c068430 con 0x7fa9a406e4d0 2024-05-10T08:44:10.865 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:10.865 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:09.727623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-05-10T08:44:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 49 2024-05-10T08:44:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa9840762d0 msgr2=0x7fa984078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa9840762d0 0x7fa984078790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa994006fd0 tx=0x7fa994008040 comp rx=0 tx=0).stop 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 msgr2=0x7fa9a4148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a4148550 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00c440 tx=0x7fa98c001e70 comp rx=0 tx=0).stop 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 shutdown_connections 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa9840762d0 0x7fa984078790 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9a4072840 0x7fa9a40b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a406e4d0 0x7fa9a4148550 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 --2- 172.21.15.37:0/2968451906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa9a406e0f0 0x7fa9a40cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 >> 172.21.15.37:0/2968451906 conn(0x7fa9a406c3a0 msgr2=0x7fa9a415aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 shutdown_connections 2024-05-10T08:44:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:10.868+0000 7fa9aa587640 1 -- 172.21.15.37:0/2968451906 wait complete. 2024-05-10T08:44:11.281 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:43:58.731926+0000', 'modified': '2024-05-10T08:44:09.727623+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6282': {'gid': 6282, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.37:6835/3086098191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3086098191}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3086098191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:44:11.281 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6282:up:rejoin 2024-05-10T08:44:12.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:44:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.401+0000 7f51b3b14640 1 Processor -- start 2024-05-10T08:44:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.401+0000 7f51b3b14640 1 -- start start 2024-05-10T08:44:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b3b14640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51ac15f420 0x7f51ac0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b3b14640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0d2080 0x7f51ac0d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b3b14640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac1630b0 con 0x7f51ac0d3ca0 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b3b14640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f51ac0d2550 con 0x7f51ac15f420 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b3b14640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac0d2c80 con 0x7f51ac0d2080 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b18b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51ac15f420 0x7f51ac0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b18b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51ac15f420 0x7f51ac0d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45484/0 (socket says 172.21.15.37:45484) 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b10af640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f51ac0d3ca0 0x7f51ac0d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33690/0 (socket says 172.21.15.37:33690) 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b18b0640 1 -- 172.21.15.37:0/4045115865 learned_addr learned my addr 172.21.15.37:0/4045115865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b20b1640 1 --2- 172.21.15.37:0/4045115865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0d2080 0x7f51ac0d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b18b0640 1 -- 172.21.15.37:0/4045115865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0d2080 msgr2=0x7f51ac0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b18b0640 1 --2- 172.21.15.37:0/4045115865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0d2080 0x7f51ac0d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b18b0640 1 -- 172.21.15.37:0/4045115865 >> v1:172.21.15.37:6789/0 conn(0x7f51ac0d3ca0 legacy=0x7f51ac0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b18b0640 1 -- 172.21.15.37:0/4045115865 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac0d2f60 con 0x7f51ac15f420 2024-05-10T08:44:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.402+0000 7f51b08ae640 1 -- 172.21.15.37:0/4045115865 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385856730 0 0) 0x7f51a0001110 con 0x7f51ac0d3ca0 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.403+0000 7f51b18b0640 1 --2- 172.21.15.37:0/4045115865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac15f420 0x7f51ac0d3760 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009870 tx=0x7f51a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7965e2f23a97765e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.403+0000 7f51b08ae640 1 -- 172.21.15.37:0/4045115865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8037070 con 0x7f51ac15f420 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.403+0000 7f51b08ae640 1 -- 172.21.15.37:0/4045115865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a8032440 con 0x7f51ac15f420 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.403+0000 7f51b08ae640 1 -- 172.21.15.37:0/4045115865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8032810 con 0x7f51ac15f420 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 -- 172.21.15.37:0/4045115865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac15f420 msgr2=0x7f51ac0d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 --2- 172.21.15.37:0/4045115865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac15f420 0x7f51ac0d3760 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009870 tx=0x7f51a802a270 comp rx=0 tx=0).stop 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 -- 172.21.15.37:0/4045115865 shutdown_connections 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 --2- 172.21.15.37:0/4045115865 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0d2080 0x7f51ac0d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 --2- 172.21.15.37:0/4045115865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac15f420 0x7f51ac0d3760 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 -- 172.21.15.37:0/4045115865 >> 172.21.15.37:0/4045115865 conn(0x7f51ac08eac0 msgr2=0x7f51ac09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 -- 172.21.15.37:0/4045115865 shutdown_connections 2024-05-10T08:44:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.404+0000 7f51b3b14640 1 -- 172.21.15.37:0/4045115865 wait complete. 2024-05-10T08:44:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.405+0000 7f51b3b14640 1 Processor -- start 2024-05-10T08:44:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.405+0000 7f51b3b14640 1 -- start start 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b3b14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac0d2080 0x7f51ac158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b3b14640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0b9e60 0x7f51ac0ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b3b14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ac161200 0x7f51ac161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b3b14640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac0d5200 con 0x7f51ac0d2080 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b3b14640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac0d2830 con 0x7f51ac161200 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b3b14640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac0d5380 con 0x7f51ac0b9e60 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac0d2080 0x7f51ac158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac0d2080 0x7f51ac158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45488/0 (socket says 172.21.15.37:45488) 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 -- 172.21.15.37:0/2577685358 learned_addr learned my addr 172.21.15.37:0/2577685358 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 -- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0b9e60 msgr2=0x7f51ac0ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b10af640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0b9e60 0x7f51ac0ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b20b1640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ac161200 0x7f51ac161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0b9e60 0x7f51ac0ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 -- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ac161200 msgr2=0x7f51ac161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ac161200 0x7f51ac161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 -- 172.21.15.37:0/2577685358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac15f9f0 con 0x7f51ac0d2080 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b20b1640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ac161200 0x7f51ac161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b10af640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0b9e60 0x7f51ac0ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.406+0000 7f51b18b0640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac0d2080 0x7f51ac158870 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009870 tx=0x7f51a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.407+0000 7f519e7fc640 1 -- 172.21.15.37:0/2577685358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8037040 con 0x7f51ac0d2080 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.407+0000 7f519e7fc640 1 -- 172.21.15.37:0/2577685358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a8004030 con 0x7f51ac0d2080 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.407+0000 7f519e7fc640 1 -- 172.21.15.37:0/2577685358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8004440 con 0x7f51ac0d2080 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.407+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac15fcd0 con 0x7f51ac0d2080 2024-05-10T08:44:12.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.407+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac160290 con 0x7f51ac0d2080 2024-05-10T08:44:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.408+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac0693f0 con 0x7f51ac0d2080 2024-05-10T08:44:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.408+0000 7f519e7fc640 1 -- 172.21.15.37:0/2577685358 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f51a803a070 con 0x7f51ac0d2080 2024-05-10T08:44:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.409+0000 7f519e7fc640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5190076300 0x7f51900787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.409+0000 7f519e7fc640 1 -- 172.21.15.37:0/2577685358 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f51a80b7dc0 con 0x7f51ac0d2080 2024-05-10T08:44:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.409+0000 7f51b10af640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5190076300 0x7f51900787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.410+0000 7f51b10af640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5190076300 0x7f51900787c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f51a00013b0 tx=0x7f51a0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.413+0000 7f519e7fc640 1 -- 172.21.15.37:0/2577685358 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f51a8041020 con 0x7f51ac0d2080 2024-05-10T08:44:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.645+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51ac0b4c50 con 0x7f51ac0d2080 2024-05-10T08:44:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.645+0000 7f519e7fc640 1 -- 172.21.15.37:0/2577685358 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5181 (secure 0 0 0) 0x7f51a8081540 con 0x7f51ac0d2080 2024-05-10T08:44:12.644 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:12.645 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:11.732616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":5}]} 2024-05-10T08:44:12.645 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5190076300 msgr2=0x7f51900787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5190076300 0x7f51900787c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f51a00013b0 tx=0x7f51a0009040 comp rx=0 tx=0).stop 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac0d2080 msgr2=0x7f51ac158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac0d2080 0x7f51ac158870 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009870 tx=0x7f51a80046c0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 shutdown_connections 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5190076300 0x7f51900787c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ac161200 0x7f51ac161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f51ac0b9e60 0x7f51ac0ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 --2- 172.21.15.37:0/2577685358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51ac0d2080 0x7f51ac158870 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 >> 172.21.15.37:0/2577685358 conn(0x7f51ac08eac0 msgr2=0x7f51ac06d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 shutdown_connections 2024-05-10T08:44:12.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:12.647+0000 7f51b3b14640 1 -- 172.21.15.37:0/2577685358 wait complete. 2024-05-10T08:44:13.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:43:58.731926+0000', 'modified': '2024-05-10T08:44:11.732616+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6282': {'gid': 6282, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6835/3086098191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3086098191}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3086098191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6282, 'qdb_cluster': [6282]} 2024-05-10T08:44:13.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:44:13.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:44:13.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.169+0000 7f16c1a64640 1 Processor -- start 2024-05-10T08:44:13.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.169+0000 7f16c1a64640 1 -- start start 2024-05-10T08:44:13.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16c1a64640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f16bc1629a0 0x7f16bc0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16c1a64640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16bc0d0cb0 0x7f16bc0d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16c1a64640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc0d3330 con 0x7f16bc0d2dc0 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16c1a64640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc0d2170 con 0x7f16bc0d0cb0 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16c1a64640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc0d2450 con 0x7f16bc1629a0 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16bbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16bc0d0cb0 0x7f16bc0d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16baffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f16bc0d2dc0 0x7f16bc0c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33696/0 (socket says 172.21.15.37:33696) 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16baffd640 1 -- 172.21.15.37:0/1806655111 learned_addr learned my addr 172.21.15.37:0/1806655111 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/1806655111 >> v2:172.21.15.82:3300/0 conn(0x7f16bc1629a0 0x7f16bc0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16bbfff640 1 -- 172.21.15.37:0/1806655111 >> v2:172.21.15.82:3300/0 conn(0x7f16bc1629a0 msgr2=0x7f16bc0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16bbfff640 1 --2- 172.21.15.37:0/1806655111 >> v2:172.21.15.82:3300/0 conn(0x7f16bc1629a0 0x7f16bc0d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16bbfff640 1 -- 172.21.15.37:0/1806655111 >> v1:172.21.15.37:6789/0 conn(0x7f16bc0d2dc0 legacy=0x7f16bc0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16ba7fc640 1 -- 172.21.15.37:0/1806655111 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944362174 0 0) 0x7f16bc0d3330 con 0x7f16bc0d2dc0 2024-05-10T08:44:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.170+0000 7f16bbfff640 1 -- 172.21.15.37:0/1806655111 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc0d2730 con 0x7f16bc0d0cb0 2024-05-10T08:44:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.171+0000 7f16bbfff640 1 --2- 172.21.15.37:0/1806655111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc0d0cb0 0x7f16bc0d3b00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0768a0 tx=0x7f16b402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84350a79dbb386c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.171+0000 7f16ba7fc640 1 -- 172.21.15.37:0/1806655111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4007740 con 0x7f16bc0d0cb0 2024-05-10T08:44:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.171+0000 7f16ba7fc640 1 -- 172.21.15.37:0/1806655111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b40078e0 con 0x7f16bc0d0cb0 2024-05-10T08:44:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.171+0000 7f16ba7fc640 1 -- 172.21.15.37:0/1806655111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4007cb0 con 0x7f16bc0d0cb0 2024-05-10T08:44:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 -- 172.21.15.37:0/1806655111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc0d0cb0 msgr2=0x7f16bc0d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 --2- 172.21.15.37:0/1806655111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc0d0cb0 0x7f16bc0d3b00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0768a0 tx=0x7f16b402a560 comp rx=0 tx=0).stop 2024-05-10T08:44:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 -- 172.21.15.37:0/1806655111 shutdown_connections 2024-05-10T08:44:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 --2- 172.21.15.37:0/1806655111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc0d0cb0 0x7f16bc0d3b00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 --2- 172.21.15.37:0/1806655111 >> v2:172.21.15.82:3300/0 conn(0x7f16bc1629a0 0x7f16bc0d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 -- 172.21.15.37:0/1806655111 >> 172.21.15.37:0/1806655111 conn(0x7f16bc0d4fe0 msgr2=0x7f16bc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 -- 172.21.15.37:0/1806655111 shutdown_connections 2024-05-10T08:44:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.172+0000 7f16c1a64640 1 -- 172.21.15.37:0/1806655111 wait complete. 2024-05-10T08:44:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.173+0000 7f16c1a64640 1 Processor -- start 2024-05-10T08:44:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.173+0000 7f16c1a64640 1 -- start start 2024-05-10T08:44:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16c1a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc0d0cb0 0x7f16bc0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16c1a64640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16bc0d2dc0 0x7f16bc1f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16c1a64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc1629a0 0x7f16bc0b9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16c1a64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0cf440 con 0x7f16bc1629a0 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16c1a64640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0cf2c0 con 0x7f16bc0d0cb0 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16c1a64640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc0c95e0 con 0x7f16bc0d2dc0 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc1629a0 0x7f16bc0b9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc1629a0 0x7f16bc0b9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45500/0 (socket says 172.21.15.37:45500) 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 -- 172.21.15.37:0/812847179 learned_addr learned my addr 172.21.15.37:0/812847179 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc0d0cb0 0x7f16bc0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 -- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16bc0d2dc0 msgr2=0x7f16bc1f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16baffd640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16bc0d2dc0 0x7f16bc1f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16bc0d2dc0 0x7f16bc1f4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 -- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc0d0cb0 msgr2=0x7f16bc0b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc0d0cb0 0x7f16bc0b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.174+0000 7f16bbfff640 1 -- 172.21.15.37:0/812847179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc0b7c00 con 0x7f16bc1629a0 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.175+0000 7f16bbfff640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc1629a0 0x7f16bc0b9870 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f16b402ab50 tx=0x7f16b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.175+0000 7f16a3fff640 1 -- 172.21.15.37:0/812847179 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4040070 con 0x7f16bc1629a0 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.175+0000 7f16a3fff640 1 -- 172.21.15.37:0/812847179 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b4031bc0 con 0x7f16bc1629a0 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.175+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc0b7ee0 con 0x7f16bc1629a0 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.175+0000 7f16a3fff640 1 -- 172.21.15.37:0/812847179 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4045460 con 0x7f16bc1629a0 2024-05-10T08:44:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.175+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc0b84a0 con 0x7f16bc1629a0 2024-05-10T08:44:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.177+0000 7f16a3fff640 1 -- 172.21.15.37:0/812847179 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16b4039040 con 0x7f16bc1629a0 2024-05-10T08:44:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.177+0000 7f16a3fff640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f16a8076300 0x7f16a80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.177+0000 7f16a3fff640 1 -- 172.21.15.37:0/812847179 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f16b40b90d0 con 0x7f16bc1629a0 2024-05-10T08:44:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.177+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f16a8076300 0x7f16a80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.178+0000 7f16c4780740 1 Processor -- start 2024-05-10T08:44:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.178+0000 7f16c4780740 1 -- start start 2024-05-10T08:44:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.178+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f16a8076300 0x7f16a80787c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f16ac006fd0 tx=0x7f16ac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16c4780740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639af50 0x55c99639d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639b330 0x55c99639dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99636dbb0 0x55c9963713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16c4780740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c9962d78d0 con 0x55c99639af50 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c996290c10 con 0x55c99636dbb0 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c9962d3890 con 0x55c99639b330 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639af50 0x55c99639d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639af50 0x55c99639d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45516/0 (socket says 172.21.15.37:45516) 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 -- 172.21.15.37:0/255146049 learned_addr learned my addr 172.21.15.37:0/255146049 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16baffd640 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639b330 0x55c99639dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bbfff640 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99636dbb0 0x55c9963713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 -- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639b330 msgr2=0x55c99639dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639b330 0x55c99639dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 -- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99636dbb0 msgr2=0x55c9963713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99636dbb0 0x55c9963713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 -- 172.21.15.37:0/255146049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9962985d0 con 0x55c99639af50 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16baffd640 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639b330 0x55c99639dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bbfff640 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99636dbb0 0x55c9963713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639af50 0x55c99639d760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00f9c0 tx=0x7f16ac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee8a00839267391 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16a17fa640 1 -- 172.21.15.37:0/255146049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac01b050 con 0x55c99639af50 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16a17fa640 1 -- 172.21.15.37:0/255146049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac025070 con 0x55c99639af50 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.179+0000 7f16a17fa640 1 -- 172.21.15.37:0/255146049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac014de0 con 0x55c99639af50 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 -- 172.21.15.37:0/255146049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639af50 msgr2=0x55c99639d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639af50 0x55c99639d760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00f9c0 tx=0x7f16ac012000 comp rx=0 tx=0).stop 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 -- 172.21.15.37:0/255146049 shutdown_connections 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99636dbb0 0x55c9963713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639b330 0x55c99639dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 --2- 172.21.15.37:0/255146049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639af50 0x55c99639d760 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 -- 172.21.15.37:0/255146049 >> 172.21.15.37:0/255146049 conn(0x55c99636fe20 msgr2=0x55c9963b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 -- 172.21.15.37:0/255146049 shutdown_connections 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.180+0000 7f16c4780740 1 -- 172.21.15.37:0/255146049 wait complete. 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.181+0000 7f16c4780740 1 -- start start 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.181+0000 7f16c4780740 1 Processor -- start 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639af50 0x55c9963911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639b330 0x55c9963bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c9963bdd20 0x55c9963bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c996372fd0 con 0x55c99639b330 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c996294760 con 0x55c99639af50 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c9963732b0 con 0x55c9963bdd20 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 10 client.0 _ll_register_callbacks cb 0x55c9962cdcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639b330 0x55c9963bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639b330 0x55c9963bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45532/0 (socket says 172.21.15.37:45532) 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 -- 172.21.15.37:0/2207189717 learned_addr learned my addr 172.21.15.37:0/2207189717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639af50 0x55c9963911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16bbfff640 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c9963bdd20 0x55c9963bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 -- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c9963bdd20 msgr2=0x55c9963bb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c9963bdd20 0x55c9963bb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 -- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639af50 msgr2=0x55c9963911b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639af50 0x55c9963911b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 -- 172.21.15.37:0/2207189717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c995fe92d0 con 0x55c99639b330 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16baffd640 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639b330 0x55c9963bae80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0ce7f0 tx=0x7f16b0001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60271a484dc21baf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f169a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f169a7fc640 1 -- 172.21.15.37:0/2207189717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0019060 con 0x55c99639b330 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f169a7fc640 1 -- 172.21.15.37:0/2207189717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f16b0007610 con 0x55c99639b330 2024-05-10T08:44:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.182+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ac025070 con 0x55c99639b330 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f169a7fc640 1 -- 172.21.15.37:0/2207189717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f16b00114c0 con 0x55c99639b330 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 10 client.6333 fetch_fsmap learned FSMap version 50 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55c9960b36b0 con 0x55c99639b330 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f169a7fc640 1 -- 172.21.15.37:0/2207189717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac025070 con 0x55c99639b330 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f169a7fc640 1 -- 172.21.15.37:0/2207189717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7f16b0011660 con 0x55c99639b330 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 10 client.6333 fetch_fsmap finished waiting for FSMap version 50 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 10 client.6333 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 20 client.6333 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c9963c02a0 0x55c99639e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 4 client.6333 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c99625b760 con 0x55c9963c02a0 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c9963c02a0 0x55c99639e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c9963c02a0 0x55c99639e670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a601b77e5d673be4 server_cookie=909effe52aea8715 in_seq=0 out_seq=0 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.183+0000 7f169a7fc640 10 client.6333 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f169a7fc640 1 -- 172.21.15.37:0/2207189717 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c99625b760 con 0x55c9963c02a0 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f169a7fc640 10 client.6333 handle_command_reply: tid=0 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 client.6333 shutdown 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639b330 msgr2=0x55c9963bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639b330 0x55c9963bae80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0ce7f0 tx=0x7f16b0001680 comp rx=0 tx=0).stop 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 shutdown_connections 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c9963c02a0 0x55c99639e670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c9963bdd20 0x55c9963bb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c99639b330 0x55c9963bae80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f169a7fc640 0 client.6333 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 --2- 172.21.15.37:0/2207189717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639af50 0x55c9963911b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 >> 172.21.15.37:0/2207189717 conn(0x55c99636dbb0 msgr2=0x55c99639d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 shutdown_connections 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 1 -- 172.21.15.37:0/2207189717 wait complete. 2024-05-10T08:44:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.184+0000 7f16c4780740 20 client.6333 trim_cache size 0 max 16384 2024-05-10T08:44:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.203+0000 7f16c4780740 1 Processor -- start 2024-05-10T08:44:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.203+0000 7f16c4780740 1 -- start start 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 0x55c99636cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 0x55c99636d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16c4780740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c9963bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16c4780740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc200d70 con 0x55c9963bdd20 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0cce70 con 0x55c99639b330 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc200700 con 0x55c99639af50 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c9963bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c9963bcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45536/0 (socket says 172.21.15.37:45536) 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.204+0000 7f16bbfff640 1 -- 172.21.15.37:0/2083299568 learned_addr learned my addr 172.21.15.37:0/2083299568 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16bbfff640 1 -- 172.21.15.37:0/2083299568 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 msgr2=0x55c99636cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16bbfff640 1 --2- 172.21.15.37:0/2083299568 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 0x55c99636cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16bbfff640 1 -- 172.21.15.37:0/2083299568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 msgr2=0x55c99636d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16bbfff640 1 --2- 172.21.15.37:0/2083299568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 0x55c99636d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16bbfff640 1 -- 172.21.15.37:0/2083299568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9963bc8d0 con 0x55c9963bdd20 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16bbfff640 1 --2- 172.21.15.37:0/2083299568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c9963bcef0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f16b40820e0 tx=0x7f16b402aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2749729b70e15f0c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16a0ff9640 1 -- 172.21.15.37:0/2083299568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4086500 con 0x55c9963bdd20 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16a0ff9640 1 -- 172.21.15.37:0/2083299568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b408af20 con 0x55c9963bdd20 2024-05-10T08:44:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16a0ff9640 1 -- 172.21.15.37:0/2083299568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4086130 con 0x55c9963bdd20 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16c4780740 1 -- 172.21.15.37:0/2083299568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 msgr2=0x55c9963bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.205+0000 7f16c4780740 1 --2- 172.21.15.37:0/2083299568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c9963bcef0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f16b40820e0 tx=0x7f16b402aa60 comp rx=0 tx=0).stop 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 -- 172.21.15.37:0/2083299568 shutdown_connections 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 --2- 172.21.15.37:0/2083299568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c9963bcef0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 --2- 172.21.15.37:0/2083299568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 0x55c99636d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 --2- 172.21.15.37:0/2083299568 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 0x55c99636cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 -- 172.21.15.37:0/2083299568 >> 172.21.15.37:0/2083299568 conn(0x55c99636dbb0 msgr2=0x55c9963724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 -- 172.21.15.37:0/2083299568 shutdown_connections 2024-05-10T08:44:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 -- 172.21.15.37:0/2083299568 wait complete. 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 -- start start 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.206+0000 7f16c4780740 1 Processor -- start 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 0x55c9963b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16c4780740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 0x55c9963b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16c4780740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c99638e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16c4780740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c9963a0080 con 0x55c9963bdd20 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c9963bfb60 con 0x55c99639b330 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16c4780740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c9963c0770 con 0x55c99639af50 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16c4780740 10 client.0 _ll_register_callbacks cb 0x7f16b0007c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c99638e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c99638e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45546/0 (socket says 172.21.15.37:45546) 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 -- 172.21.15.37:0/4237701864 learned_addr learned my addr 172.21.15.37:0/4237701864 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 0x55c9963b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16baffd640 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 0x55c9963b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 -- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 msgr2=0x55c9963b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 0x55c9963b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 -- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 msgr2=0x55c9963b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 0x55c9963b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.207+0000 7f16bbfff640 1 -- 172.21.15.37:0/4237701864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c99638f420 con 0x55c9963bdd20 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16bbfff640 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c99638e500 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f16b40b7470 tx=0x7f16b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43915d3e6abcf9d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f169a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f169a7fc640 1 -- 172.21.15.37:0/4237701864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b40a0060 con 0x55c9963bdd20 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f169a7fc640 1 -- 172.21.15.37:0/4237701864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f16b40823b0 con 0x55c9963bdd20 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b408af20 con 0x55c9963bdd20 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f169a7fc640 1 -- 172.21.15.37:0/4237701864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f16b408c070 con 0x55c9963bdd20 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 10 client.6339 fetch_fsmap learned FSMap version 50 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55c99638f160 con 0x55c9963bdd20 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f169a7fc640 1 -- 172.21.15.37:0/4237701864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b408af20 con 0x55c9963bdd20 2024-05-10T08:44:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f169a7fc640 1 -- 172.21.15.37:0/4237701864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7f16b408aa90 con 0x55c9963bdd20 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 10 client.6339 fetch_fsmap finished waiting for FSMap version 50 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 10 client.6339 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 20 client.6339 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c99638ea40 0x55c9963ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 4 client.6339 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "status"}) -- 0x55c9962e54e0 con 0x55c99638ea40 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.208+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c99638ea40 0x55c9963ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16bb7fe640 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c99638ea40 0x55c9963ae0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=110155871927211e server_cookie=f7316898bcd256ec in_seq=0 out_seq=0 2024-05-10T08:44:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f169a7fc640 10 client.6339 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f169a7fc640 1 -- 172.21.15.37:0/4237701864 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c9962e54e0 con 0x55c99638ea40 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f169a7fc640 10 client.6339 handle_command_reply: tid=0 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 client.6339 shutdown 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 msgr2=0x55c99638e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c99638e500 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f16b40b7470 tx=0x7f16b4009750 comp rx=0 tx=0).stop 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 shutdown_connections 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55c99638ea40 0x55c9963ae0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9963bdd20 0x55c99638e500 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c99639b330 0x55c9963b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f169a7fc640 0 client.6339 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 --2- 172.21.15.37:0/4237701864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c99639af50 0x55c9963b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 >> 172.21.15.37:0/4237701864 conn(0x55c99636dbb0 msgr2=0x55c996390fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 shutdown_connections 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 1 -- 172.21.15.37:0/4237701864 wait complete. 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.209+0000 7f16c4780740 20 client.6339 trim_cache size 0 max 16384 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6282, 2024-05-10T08:44:13.215 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.4878783990000004, 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 50, 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 76, 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 5.1929601859999996 2024-05-10T08:44:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f16a8076300 msgr2=0x7f16a80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f16a8076300 0x7f16a80787c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f16ac006fd0 tx=0x7f16ac008040 comp rx=0 tx=0).stop 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc1629a0 msgr2=0x7f16bc0b9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc1629a0 0x7f16bc0b9870 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f16b402ab50 tx=0x7f16b4004a40 comp rx=0 tx=0).stop 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 shutdown_connections 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f16a8076300 0x7f16a80787c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16bc1629a0 0x7f16bc0b9870 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f16bc0d2dc0 0x7f16bc1f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 --2- 172.21.15.37:0/812847179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16bc0d0cb0 0x7f16bc0b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 >> 172.21.15.37:0/812847179 conn(0x7f16bc0d4fe0 msgr2=0x7f16bc0b7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 shutdown_connections 2024-05-10T08:44:13.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.210+0000 7f16c1a64640 1 -- 172.21.15.37:0/812847179 wait complete. 2024-05-10T08:44:13.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:44:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.324+0000 7faf9ad51640 1 Processor -- start 2024-05-10T08:44:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.324+0000 7faf9ad51640 1 -- start start 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf9ad51640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf940d0ec0 0x7faf940d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf9ad51640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf940d3b00 0x7faf940b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf9ad51640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf940d1760 con 0x7faf9415f380 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf9ad51640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7faf940d30f0 con 0x7faf940d3b00 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf9ad51640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7faf940d2370 con 0x7faf940d0ec0 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf992ee640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf940d3b00 0x7faf940b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf992ee640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf940d3b00 0x7faf940b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45550/0 (socket says 172.21.15.37:45550) 2024-05-10T08:44:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf992ee640 1 -- 172.21.15.37:0/2920145027 learned_addr learned my addr 172.21.15.37:0/2920145027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf98aed640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf9415f380 0x7faf940d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33702/0 (socket says 172.21.15.37:33702) 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf93fff640 1 --2- 172.21.15.37:0/2920145027 >> v2:172.21.15.82:3300/0 conn(0x7faf940d0ec0 0x7faf940d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf992ee640 1 -- 172.21.15.37:0/2920145027 >> v2:172.21.15.82:3300/0 conn(0x7faf940d0ec0 msgr2=0x7faf940d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf992ee640 1 --2- 172.21.15.37:0/2920145027 >> v2:172.21.15.82:3300/0 conn(0x7faf940d0ec0 0x7faf940d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf992ee640 1 -- 172.21.15.37:0/2920145027 >> v1:172.21.15.37:6789/0 conn(0x7faf9415f380 legacy=0x7faf940d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf992ee640 1 -- 172.21.15.37:0/2920145027 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf940d1a40 con 0x7faf940d3b00 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.325+0000 7faf937fe640 1 -- 172.21.15.37:0/2920145027 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282650335 0 0) 0x7faf940d1760 con 0x7faf9415f380 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.326+0000 7faf992ee640 1 --2- 172.21.15.37:0/2920145027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b7e30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7faf940b7b00 tx=0x7faf8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a9c7419c0ac343 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.326+0000 7faf937fe640 1 -- 172.21.15.37:0/2920145027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c037070 con 0x7faf940d3b00 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.326+0000 7faf937fe640 1 -- 172.21.15.37:0/2920145027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c032440 con 0x7faf940d3b00 2024-05-10T08:44:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.326+0000 7faf937fe640 1 -- 172.21.15.37:0/2920145027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c032810 con 0x7faf940d3b00 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.326+0000 7faf9ad51640 1 -- 172.21.15.37:0/2920145027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 msgr2=0x7faf940b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.326+0000 7faf9ad51640 1 --2- 172.21.15.37:0/2920145027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b7e30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7faf940b7b00 tx=0x7faf8c02a270 comp rx=0 tx=0).stop 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.327+0000 7faf9ad51640 1 -- 172.21.15.37:0/2920145027 shutdown_connections 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.327+0000 7faf9ad51640 1 --2- 172.21.15.37:0/2920145027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b7e30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.327+0000 7faf9ad51640 1 --2- 172.21.15.37:0/2920145027 >> v2:172.21.15.82:3300/0 conn(0x7faf940d0ec0 0x7faf940d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.327+0000 7faf9ad51640 1 -- 172.21.15.37:0/2920145027 >> 172.21.15.37:0/2920145027 conn(0x7faf940d4fe0 msgr2=0x7faf940d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.327+0000 7faf9ad51640 1 -- 172.21.15.37:0/2920145027 shutdown_connections 2024-05-10T08:44:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.327+0000 7faf9ad51640 1 -- 172.21.15.37:0/2920145027 wait complete. 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.328+0000 7faf9ad51640 1 Processor -- start 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.328+0000 7faf9ad51640 1 -- start start 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf9ad51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf940d0ec0 0x7faf940b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf9ad51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf9ad51640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf9415f380 0x7faf941562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf9ad51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf940d2000 con 0x7faf940d3b00 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf9ad51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf940d3f30 con 0x7faf940d0ec0 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf9ad51640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7faf9415f760 con 0x7faf9415f380 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45556/0 (socket says 172.21.15.37:45556) 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 -- 172.21.15.37:0/964063542 learned_addr learned my addr 172.21.15.37:0/964063542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf98aed640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf940d0ec0 0x7faf940b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf992ee640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf9415f380 0x7faf941562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 -- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf9415f380 msgr2=0x7faf941562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf9415f380 0x7faf941562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 -- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf940d0ec0 msgr2=0x7faf940b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf940d0ec0 0x7faf940b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 -- 172.21.15.37:0/964063542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf940b21d0 con 0x7faf940d3b00 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf98aed640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf940d0ec0 0x7faf940b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf93fff640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b55e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00efc0 tx=0x7faf7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf917fa640 1 -- 172.21.15.37:0/964063542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c018020 con 0x7faf940d3b00 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf917fa640 1 -- 172.21.15.37:0/964063542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c014480 con 0x7faf940d3b00 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.329+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf940b24b0 con 0x7faf940d3b00 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.330+0000 7faf917fa640 1 -- 172.21.15.37:0/964063542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c014870 con 0x7faf940d3b00 2024-05-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.330+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf940b2d50 con 0x7faf940d3b00 2024-05-10T08:44:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.330+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf940b2680 con 0x7faf940d3b00 2024-05-10T08:44:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.331+0000 7faf917fa640 1 -- 172.21.15.37:0/964063542 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf7c005d10 con 0x7faf940d3b00 2024-05-10T08:44:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.332+0000 7faf917fa640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf740762d0 0x7faf74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.332+0000 7faf917fa640 1 -- 172.21.15.37:0/964063542 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7faf7c098280 con 0x7faf940d3b00 2024-05-10T08:44:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.332+0000 7faf98aed640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf740762d0 0x7faf74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.332+0000 7faf98aed640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf740762d0 0x7faf74078790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faf84000f60 tx=0x7faf84007c10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:13.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.336+0000 7faf917fa640 1 -- 172.21.15.37:0/964063542 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7faf7c022070 con 0x7faf940d3b00 2024-05-10T08:44:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.566+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faf940693f0 con 0x7faf940d3b00 2024-05-10T08:44:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.566+0000 7faf917fa640 1 -- 172.21.15.37:0/964063542 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) ==== 53+0+73 (secure 0 0 0) 0x7faf7c010040 con 0x7faf940d3b00 2024-05-10T08:44:13.565 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf740762d0 msgr2=0x7faf74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf740762d0 0x7faf74078790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faf84000f60 tx=0x7faf84007c10 comp rx=0 tx=0).stop 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 msgr2=0x7faf940b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b55e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00efc0 tx=0x7faf7c00c490 comp rx=0 tx=0).stop 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 shutdown_connections 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7faf740762d0 0x7faf74078790 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf9415f380 0x7faf941562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf940d3b00 0x7faf940b55e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 --2- 172.21.15.37:0/964063542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf940d0ec0 0x7faf940b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 >> 172.21.15.37:0/964063542 conn(0x7faf940d4fe0 msgr2=0x7faf940cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 shutdown_connections 2024-05-10T08:44:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13.568+0000 7faf9ad51640 1 -- 172.21.15.37:0/964063542 wait complete. 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:44:13.579 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:44:13.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:13.580 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:44:13.596 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42508sec preferred_lft 42508sec 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:44:13.597 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:44:13.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:44:13.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:13.599 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:44:13.660 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:44:13.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:13.662 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:44:13.719 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:44:13.719 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:44:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:44:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:44:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:44:13.720 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:44:13.720 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:44:13.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:44:13.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:44:13.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:44:13.720 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:44:13.726 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:44:13.727+0000 7fa7141e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:44:13.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:44:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:44:13.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:13.816 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:44:13.832 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:44:13.832 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:44:13.833 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:44:13.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:13.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:44:13.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:44:13.899 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:13.956 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:44:13.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:44:13.956 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:14.012 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:44:14.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:14.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:14.097 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:14.097 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:44:14.097 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:44:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:44:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:44:14.106 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:44:14.106 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:44:14.115 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:44:14.116 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:44:14.116 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:44:14.116 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:44:14.116 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:44:14.116 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:44:14.118 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:44:14.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:14.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:14.144 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:44:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:44:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:44:14.246 INFO:teuthology.orchestra.run.smithi037.stdout:client5540 2024-05-10T08:44:14.247 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:44:14.247 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:44:14.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:14.263 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-05-10T08:44:14.321 INFO:teuthology.orchestra.run.smithi037.stdout:file_undamaged 2024-05-10T08:44:14.322 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:44:14.322 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:44:14.322 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> import json 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> import sys 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> try: 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> except OSError as e: 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> sys.exit(e.errno) 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> print(json.dumps( 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> dict([(a, getattr(s, a)) for a in attrs]), 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> indent=2)) 2024-05-10T08:44:14.323 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:44:14.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-05-10T08:44:14.440 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-10T08:44:14.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:14.441 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-05-10T08:44:14.497 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-10T08:44:14.498 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:44:14.498 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:44:14.554 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:44:14.555 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:44:14.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:44:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.758+0000 7fd4d397f640 1 Processor -- start 2024-05-10T08:44:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.759+0000 7fd4d397f640 1 -- start start 2024-05-10T08:44:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.759+0000 7fd4d397f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4cc0d1970 0x7fd4cc0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d397f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4cc1630b0 con 0x7fd4cc15f420 2024-05-10T08:44:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d397f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4cc0d3e70 con 0x7fd4cc0d4cc0 2024-05-10T08:44:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d397f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd4cc0d2550 con 0x7fd4cc0d1970 2024-05-10T08:44:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d171b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd4cc15f420 0x7fd4cc0d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33714/0 (socket says 172.21.15.37:33714) 2024-05-10T08:44:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d171b640 1 -- 172.21.15.37:0/838064583 learned_addr learned my addr 172.21.15.37:0/838064583 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d0f1a640 1 --2- 172.21.15.37:0/838064583 >> v2:172.21.15.37:3300/0 conn(0x7fd4cc0d1970 0x7fd4cc0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d0f1a640 1 -- 172.21.15.37:0/838064583 >> v1:172.21.15.82:6789/0 conn(0x7fd4cc0d4cc0 legacy=0x7fd4cc0d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d0f1a640 1 -- 172.21.15.37:0/838064583 >> v1:172.21.15.37:6789/0 conn(0x7fd4cc15f420 legacy=0x7fd4cc0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4d0f1a640 1 -- 172.21.15.37:0/838064583 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc0d2c80 con 0x7fd4cc0d1970 2024-05-10T08:44:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.760+0000 7fd4c3fff640 1 -- 172.21.15.37:0/838064583 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615447920 0 0) 0x7fd4c8001110 con 0x7fd4cc15f420 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4d0f1a640 1 --2- 172.21.15.37:0/838064583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc0d1e20 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0097a0 tx=0x7fd4bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eea5b8cbc98b3a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4c3fff640 1 -- 172.21.15.37:0/838064583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc037070 con 0x7fd4cc0d1970 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4c3fff640 1 -- 172.21.15.37:0/838064583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc032440 con 0x7fd4cc0d1970 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4c3fff640 1 -- 172.21.15.37:0/838064583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc032810 con 0x7fd4cc0d1970 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4d397f640 1 -- 172.21.15.37:0/838064583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 msgr2=0x7fd4cc0d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4d397f640 1 --2- 172.21.15.37:0/838064583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc0d1e20 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0097a0 tx=0x7fd4bc02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4d397f640 1 -- 172.21.15.37:0/838064583 shutdown_connections 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4d397f640 1 --2- 172.21.15.37:0/838064583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc0d1e20 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.761+0000 7fd4d397f640 1 -- 172.21.15.37:0/838064583 >> 172.21.15.37:0/838064583 conn(0x7fd4cc08eac0 msgr2=0x7fd4cc09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.762+0000 7fd4d397f640 1 -- 172.21.15.37:0/838064583 shutdown_connections 2024-05-10T08:44:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.762+0000 7fd4d397f640 1 -- 172.21.15.37:0/838064583 wait complete. 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 Processor -- start 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 -- start start 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4cc0d4cc0 0x7fd4cc0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4cc0cd2a0 0x7fd4cc0d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc0d2830 con 0x7fd4cc0d1970 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc0d3240 con 0x7fd4cc0d4cc0 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.763+0000 7fd4d397f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd4cc0cfb20 con 0x7fd4cc0cd2a0 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45584/0 (socket says 172.21.15.37:45584) 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 -- 172.21.15.37:0/1078800970 learned_addr learned my addr 172.21.15.37:0/1078800970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d0f1a640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4cc0d4cc0 0x7fd4cc0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d1f1c640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4cc0cd2a0 0x7fd4cc0d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 -- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4cc0cd2a0 msgr2=0x7fd4cc0d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4cc0cd2a0 0x7fd4cc0d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 -- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4cc0d4cc0 msgr2=0x7fd4cc0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4cc0d4cc0 0x7fd4cc0ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 -- 172.21.15.37:0/1078800970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc15dd70 con 0x7fd4cc0d1970 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d171b640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc15d830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c430 tx=0x7fd4c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4c1ffb640 1 -- 172.21.15.37:0/1078800970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80074e0 con 0x7fd4cc0d1970 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4c1ffb640 1 -- 172.21.15.37:0/1078800970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c80047e0 con 0x7fd4cc0d1970 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4cc162410 con 0x7fd4cc0d1970 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.764+0000 7fd4c1ffb640 1 -- 172.21.15.37:0/1078800970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8004bd0 con 0x7fd4cc0d1970 2024-05-10T08:44:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.765+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4cc0cc560 con 0x7fd4cc0d1970 2024-05-10T08:44:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.766+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4cc0693f0 con 0x7fd4cc0d1970 2024-05-10T08:44:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.766+0000 7fd4c1ffb640 1 -- 172.21.15.37:0/1078800970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd4c8011070 con 0x7fd4cc0d1970 2024-05-10T08:44:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.767+0000 7fd4c1ffb640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd4b00762d0 0x7fd4b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.767+0000 7fd4c1ffb640 1 -- 172.21.15.37:0/1078800970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fd4c8097430 con 0x7fd4cc0d1970 2024-05-10T08:44:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.767+0000 7fd4d0f1a640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd4b00762d0 0x7fd4b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.767+0000 7fd4d0f1a640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd4b00762d0 0x7fd4b0078790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc034000 tx=0x7fd4bc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.771+0000 7fd4c1ffb640 1 -- 172.21.15.37:0/1078800970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd4cc1630b0 con 0x7fd4cc0d1970 2024-05-10T08:44:14.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.973+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4cc0b4c50 con 0x7fd4cc0d1970 2024-05-10T08:44:14.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.974+0000 7fd4c1ffb640 1 -- 172.21.15.37:0/1078800970 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) ==== 80+0+122 (secure 0 0 0) 0x7fd4c8060bb0 con 0x7fd4cc0d1970 2024-05-10T08:44:14.973 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6835/3151779785 2024-05-11T08:44:07.977457+0000 2024-05-10T08:44:14.973 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6833/3151779785 2024-05-11T08:44:07.977457+0000 2024-05-10T08:44:14.974 INFO:teuthology.orchestra.run.smithi037.stderr:listed 2 entries 2024-05-10T08:44:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd4b00762d0 msgr2=0x7fd4b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd4b00762d0 0x7fd4b0078790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc034000 tx=0x7fd4bc02e000 comp rx=0 tx=0).stop 2024-05-10T08:44:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 msgr2=0x7fd4cc15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc15d830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c430 tx=0x7fd4c800c8f0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 shutdown_connections 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd4b00762d0 0x7fd4b0078790 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4cc0cd2a0 0x7fd4cc0d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4cc0d4cc0 0x7fd4cc0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 --2- 172.21.15.37:0/1078800970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc0d1970 0x7fd4cc15d830 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 >> 172.21.15.37:0/1078800970 conn(0x7fd4cc08eac0 msgr2=0x7fd4cc06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 shutdown_connections 2024-05-10T08:44:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:14.976+0000 7fd4d397f640 1 -- 172.21.15.37:0/1078800970 wait complete. 2024-05-10T08:44:14.986 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:44:14.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:14.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:44:15.016 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:44:15.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:15.016 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:44:15.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:15.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-05-10T08:44:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.223+0000 7f8c1aad1640 1 Processor -- start 2024-05-10T08:44:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.223+0000 7f8c1aad1640 1 -- start start 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1aad1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c1406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1aad1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8c1406c8e0 0x7f8c140aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1aad1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c140af4d0 0x7f8c1406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1aad1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8c140b1660 con 0x7f8c140af4d0 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1aad1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8c141600d0 con 0x7f8c1406c8e0 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1aad1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c140af960 con 0x7f8c14159770 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c140af4d0 0x7f8c1406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c140af4d0 0x7f8c1406ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45588/0 (socket says 172.21.15.37:45588) 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 -- 172.21.15.37:0/3718778489 learned_addr learned my addr 172.21.15.37:0/3718778489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1886d640 1 --2- 172.21.15.37:0/3718778489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c1406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c13fff640 1 --2- 172.21.15.37:0/3718778489 >> v2:172.21.15.82:3300/0 conn(0x7f8c1406c8e0 0x7f8c140aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 -- 172.21.15.37:0/3718778489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 msgr2=0x7f8c1406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 --2- 172.21.15.37:0/3718778489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c1406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 -- 172.21.15.37:0/3718778489 >> v2:172.21.15.82:3300/0 conn(0x7f8c1406c8e0 msgr2=0x7f8c140aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 --2- 172.21.15.37:0/3718778489 >> v2:172.21.15.82:3300/0 conn(0x7f8c1406c8e0 0x7f8c140aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.224+0000 7f8c1906e640 1 -- 172.21.15.37:0/3718778489 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c140afbe0 con 0x7f8c140af4d0 2024-05-10T08:44:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.225+0000 7f8c1906e640 1 --2- 172.21.15.37:0/3718778489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c1406ffe0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8c1406d480 tx=0x7f8bfc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7868b68463e43af server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.225+0000 7f8c137fe640 1 -- 172.21.15.37:0/3718778489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc037070 con 0x7f8c140af4d0 2024-05-10T08:44:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.225+0000 7f8c137fe640 1 -- 172.21.15.37:0/3718778489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc032440 con 0x7f8c140af4d0 2024-05-10T08:44:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.225+0000 7f8c137fe640 1 -- 172.21.15.37:0/3718778489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc032810 con 0x7f8c140af4d0 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 -- 172.21.15.37:0/3718778489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 msgr2=0x7f8c1406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/3718778489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c1406ffe0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8c1406d480 tx=0x7f8bfc02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 -- 172.21.15.37:0/3718778489 shutdown_connections 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/3718778489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c1406ffe0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/3718778489 >> v2:172.21.15.82:3300/0 conn(0x7f8c1406c8e0 0x7f8c140aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/3718778489 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c1406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 -- 172.21.15.37:0/3718778489 >> 172.21.15.37:0/3718778489 conn(0x7f8c140b3aa0 msgr2=0x7f8c140b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 -- 172.21.15.37:0/3718778489 shutdown_connections 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.226+0000 7f8c1aad1640 1 -- 172.21.15.37:0/3718778489 wait complete. 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.227+0000 7f8c1aad1640 1 Processor -- start 2024-05-10T08:44:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.227+0000 7f8c1aad1640 1 -- start start 2024-05-10T08:44:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1aad1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c1406c8e0 0x7f8c14146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1aad1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c141e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1aad1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c141e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1aad1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c14159b50 con 0x7f8c140af4d0 2024-05-10T08:44:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1aad1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1415fd60 con 0x7f8c1406c8e0 2024-05-10T08:44:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1aad1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1415f730 con 0x7f8c14159770 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c141e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c141e79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45602/0 (socket says 172.21.15.37:45602) 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c13fff640 1 -- 172.21.15.37:0/565043060 learned_addr learned my addr 172.21.15.37:0/565043060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1886d640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c1406c8e0 0x7f8c14146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.228+0000 7f8c1906e640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c141e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c13fff640 1 -- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 msgr2=0x7f8c141e9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c13fff640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c141e9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c13fff640 1 -- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c1406c8e0 msgr2=0x7f8c14146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c13fff640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c1406c8e0 0x7f8c14146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c13fff640 1 -- 172.21.15.37:0/565043060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c141e82a0 con 0x7f8c140af4d0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c13fff640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c141e79c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400e890 tx=0x7f8c0400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c117fa640 1 -- 172.21.15.37:0/565043060 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04017070 con 0x7f8c140af4d0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c117fa640 1 -- 172.21.15.37:0/565043060 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0400c940 con 0x7f8c140af4d0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c141e8580 con 0x7f8c140af4d0 2024-05-10T08:44:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c117fa640 1 -- 172.21.15.37:0/565043060 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400cd10 con 0x7f8c140af4d0 2024-05-10T08:44:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.229+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c141e8b40 con 0x7f8c140af4d0 2024-05-10T08:44:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.231+0000 7f8c117fa640 1 -- 172.21.15.37:0/565043060 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c0401a070 con 0x7f8c140af4d0 2024-05-10T08:44:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.232+0000 7f8c117fa640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf40762d0 0x7f8bf4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.232+0000 7f8c117fa640 1 -- 172.21.15.37:0/565043060 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8c04097b00 con 0x7f8c140af4d0 2024-05-10T08:44:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.232+0000 7f8c1886d640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf40762d0 0x7f8bf4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.232+0000 7f8c1d7ea740 1 Processor -- start 2024-05-10T08:44:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.232+0000 7f8c1d7ea740 1 -- start start 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.232+0000 7f8c1886d640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf40762d0 0x7f8bf4078790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8c141572e0 tx=0x7f8c0c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c42830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c72340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72880 0x560b95c47690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560b95bac1c0 con 0x560b95c72880 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b95b65ca0 con 0x560b95c8fea0 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x560b95ba8180 con 0x560b95c72fc0 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72880 0x560b95c47690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1886d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c42830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72880 0x560b95c47690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45616/0 (socket says 172.21.15.37:45616) 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 -- 172.21.15.37:0/3938189289 learned_addr learned my addr 172.21.15.37:0/3938189289 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c13fff640 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c72340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 -- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 msgr2=0x560b95c72340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c72340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 -- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 msgr2=0x560b95c42830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c42830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1906e640 1 -- 172.21.15.37:0/3938189289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b95b49db0 con 0x560b95c72880 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.233+0000 7f8c1886d640 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c42830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.234+0000 7f8c1906e640 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72880 0x560b95c47690 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009960 tx=0x7f8bfc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51855e994ff73f17 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.234+0000 7f8c0a7fc640 1 -- 172.21.15.37:0/3938189289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc042070 con 0x560b95c72880 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.234+0000 7f8c0a7fc640 1 -- 172.21.15.37:0/3938189289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc03e660 con 0x560b95c72880 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.234+0000 7f8c0a7fc640 1 -- 172.21.15.37:0/3938189289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc037040 con 0x560b95c72880 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.234+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/3938189289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72880 msgr2=0x560b95c47690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.234+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72880 0x560b95c47690 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009960 tx=0x7f8bfc02c000 comp rx=0 tx=0).stop 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/3938189289 shutdown_connections 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72880 0x560b95c47690 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c72340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/3938189289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c42830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/3938189289 >> 172.21.15.37:0/3938189289 conn(0x560b95c44aa0 msgr2=0x560b95c8d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/3938189289 shutdown_connections 2024-05-10T08:44:15.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/3938189289 wait complete. 2024-05-10T08:44:15.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 -- start start 2024-05-10T08:44:15.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.235+0000 7f8c1d7ea740 1 Processor -- start 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c5d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c84070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c60a20 0x560b95c8ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560b95c46c50 con 0x560b95c60a20 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b95b32be0 con 0x560b95c8fea0 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x560b95c46040 con 0x560b95c72fc0 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1d7ea740 10 client.0 _ll_register_callbacks cb 0x560b95b60810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1906e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c60a20 0x560b95c8ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1906e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c60a20 0x560b95c8ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45622/0 (socket says 172.21.15.37:45622) 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1906e640 1 -- 172.21.15.37:0/2675322232 learned_addr learned my addr 172.21.15.37:0/2675322232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c1886d640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c5d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.236+0000 7f8c13fff640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c84070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1906e640 1 -- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 msgr2=0x560b95c5d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1906e640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c5d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1906e640 1 -- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 msgr2=0x560b95c84070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1906e640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c84070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1906e640 1 -- 172.21.15.37:0/2675322232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b95989a20 con 0x560b95c60a20 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c13fff640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c84070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1906e640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c60a20 0x560b95c8ecd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0043b0 tx=0x7f8bfc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e40dec250bf4297 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8bf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8bf37fe640 1 -- 172.21.15.37:0/2675322232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc037070 con 0x560b95c60a20 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8bf37fe640 1 -- 172.21.15.37:0/2675322232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8bfc03ea20 con 0x560b95c60a20 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bfc03e660 con 0x560b95c60a20 2024-05-10T08:44:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8bf37fe640 1 -- 172.21.15.37:0/2675322232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f8bfc050050 con 0x560b95c60a20 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 10 client.6369 fetch_fsmap learned FSMap version 50 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x560b9587d310 con 0x560b95c60a20 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8bf37fe640 1 -- 172.21.15.37:0/2675322232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc03e660 con 0x560b95c60a20 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8bf37fe640 1 -- 172.21.15.37:0/2675322232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7f8bfc053020 con 0x560b95c60a20 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 10 client.6369 fetch_fsmap finished waiting for FSMap version 50 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 10 client.6369 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 20 client.6369 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c8aef0 0x560b95c8b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 4 client.6369 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.237+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b95c09570 con 0x560b95c8aef0 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.238+0000 7f8c1886d640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c8aef0 0x560b95c8b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.238+0000 7f8bf37fe640 10 client.6369 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.238+0000 7f8c1886d640 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c8aef0 0x560b95c8b320 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576b0daa0cf15168 server_cookie=af41713ea5e07886 in_seq=0 out_seq=0 2024-05-10T08:44:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.238+0000 7f8bf37fe640 1 -- 172.21.15.37:0/2675322232 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560b95c09570 con 0x560b95c8aef0 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.238+0000 7f8bf37fe640 10 client.6369 handle_command_reply: tid=0 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 client.6369 shutdown 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c60a20 msgr2=0x560b95c8ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c60a20 0x560b95c8ecd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0043b0 tx=0x7f8bfc004730 comp rx=0 tx=0).stop 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 shutdown_connections 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c8aef0 0x560b95c8b320 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c60a20 0x560b95c8ecd0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c84070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8bf37fe640 0 client.6369 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2675322232 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c72fc0 0x560b95c5d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 >> 172.21.15.37:0/2675322232 conn(0x560b95c72880 msgr2=0x560b95c41f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 shutdown_connections 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2675322232 wait complete. 2024-05-10T08:44:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.239+0000 7f8c1d7ea740 20 client.6369 trim_cache size 0 max 16384 2024-05-10T08:44:15.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.257+0000 7f8c1d7ea740 1 Processor -- start 2024-05-10T08:44:15.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.257+0000 7f8c1d7ea740 1 -- start start 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95c84a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c5fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560b95c9dde0 con 0x560b95c72fc0 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c14201f00 con 0x560b95c8fea0 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c14200f20 con 0x560b95c60a20 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45626/0 (socket says 172.21.15.37:45626) 2024-05-10T08:44:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 -- 172.21.15.37:0/2235643984 learned_addr learned my addr 172.21.15.37:0/2235643984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1886d640 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95c84a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c1906e640 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c5fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 -- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 msgr2=0x560b95c84a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95c84a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 -- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 msgr2=0x560b95c5fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c5fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 -- 172.21.15.37:0/2235643984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b959ea1b0 con 0x560b95c72fc0 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.258+0000 7f8c13fff640 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8da40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009720 tx=0x7f8c04060380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51a95f1d46ca2da server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c09ffb640 1 -- 172.21.15.37:0/2235643984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04079070 con 0x560b95c72fc0 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c09ffb640 1 -- 172.21.15.37:0/2235643984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c04092020 con 0x560b95c72fc0 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c09ffb640 1 -- 172.21.15.37:0/2235643984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04021030 con 0x560b95c72fc0 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2235643984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 msgr2=0x560b95c8da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8da40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009720 tx=0x7f8c04060380 comp rx=0 tx=0).stop 2024-05-10T08:44:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2235643984 shutdown_connections 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c5fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8da40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/2235643984 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95c84a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2235643984 >> 172.21.15.37:0/2235643984 conn(0x560b95c72880 msgr2=0x560b95c8e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2235643984 shutdown_connections 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.259+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/2235643984 wait complete. 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.260+0000 7f8c1d7ea740 1 -- start start 2024-05-10T08:44:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.260+0000 7f8c1d7ea740 1 Processor -- start 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95d0e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c8b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c142008d0 con 0x560b95c72fc0 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c14154fe0 con 0x560b95c8fea0 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x560b95c9dde0 con 0x560b95c60a20 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 10 client.0 _ll_register_callbacks cb 0x7f8c0c009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45636/0 (socket says 172.21.15.37:45636) 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 -- 172.21.15.37:0/714032014 learned_addr learned my addr 172.21.15.37:0/714032014 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1886d640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95d0e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1906e640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c8b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 -- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 msgr2=0x560b95d0e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95d0e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 -- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 msgr2=0x560b95c8b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c8b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 -- 172.21.15.37:0/714032014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b95856490 con 0x560b95c72fc0 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1906e640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c8b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c13fff640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8b300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8c04095f30 tx=0x7f8c040096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d573649fbfddeba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8bf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8bf37fe640 1 -- 172.21.15.37:0/714032014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0407f020 con 0x560b95c72fc0 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8bf37fe640 1 -- 172.21.15.37:0/714032014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8c04060100 con 0x560b95c72fc0 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.261+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c04092020 con 0x560b95c72fc0 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8bf37fe640 1 -- 172.21.15.37:0/714032014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f8c04021040 con 0x560b95c72fc0 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 10 client.6375 fetch_fsmap learned FSMap version 50 2024-05-10T08:44:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x560b95c5cae0 con 0x560b95c72fc0 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8bf37fe640 1 -- 172.21.15.37:0/714032014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c04092020 con 0x560b95c72fc0 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8bf37fe640 1 -- 172.21.15.37:0/714032014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7f8c040671c0 con 0x560b95c72fc0 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 10 client.6375 fetch_fsmap finished waiting for FSMap version 50 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 10 client.6375 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 20 client.6375 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c5eed0 0x560b95c90760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 4 client.6375 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-05-10T08:44:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) -- 0x560b95b4a910 con 0x560b95c5eed0 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1886d640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c5eed0 0x560b95c90760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8bf37fe640 10 client.6375 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.262+0000 7f8c1886d640 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c5eed0 0x560b95c90760 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea733fc63ef683db server_cookie=3c4b63be81d611b6 in_seq=0 out_seq=0 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8bf37fe640 1 -- 172.21.15.37:0/714032014 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560b95b4a910 con 0x560b95c5eed0 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8bf37fe640 10 client.6375 handle_command_reply: tid=0 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 client.6375 shutdown 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 msgr2=0x560b95c8b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8b300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8c04095f30 tx=0x7f8c040096b0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 shutdown_connections 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560b95c5eed0 0x560b95c90760 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b95c8fea0 0x560b95c8b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560b95c72fc0 0x560b95c8b300 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8bf37fe640 0 client.6375 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 --2- 172.21.15.37:0/714032014 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560b95c60a20 0x560b95d0e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 >> 172.21.15.37:0/714032014 conn(0x560b95c72880 msgr2=0x560b95c45640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 shutdown_connections 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 1 -- 172.21.15.37:0/714032014 wait complete. 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.263+0000 7f8c1d7ea740 20 client.6375 trim_cache size 0 max 16384 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "4666ea33-d1db-46a1-acd0-e4a335e97f50", 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:44:15.269 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:44:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf40762d0 msgr2=0x7f8bf4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf40762d0 0x7f8bf4078790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8c141572e0 tx=0x7f8c0c00b040 comp rx=0 tx=0).stop 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 msgr2=0x7f8c141e79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c141e79c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400e890 tx=0x7f8c0400ed50 comp rx=0 tx=0).stop 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 shutdown_connections 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf40762d0 0x7f8bf4078790 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c14159770 0x7f8c141e9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c140af4d0 0x7f8c141e79c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 --2- 172.21.15.37:0/565043060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c1406c8e0 0x7f8c14146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 >> 172.21.15.37:0/565043060 conn(0x7f8c140b3aa0 msgr2=0x7f8c140b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 shutdown_connections 2024-05-10T08:44:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.264+0000 7f8c1aad1640 1 -- 172.21.15.37:0/565043060 wait complete. 2024-05-10T08:44:15.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:15.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T08:44:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.383+0000 7fe89b519640 1 Processor -- start 2024-05-10T08:44:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.383+0000 7fe89b519640 1 -- start start 2024-05-10T08:44:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe89b519640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe89415f420 0x7fe8940d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe89b519640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8940d3ca0 0x7fe8940d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe89b519640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8941630b0 con 0x7fe8940d1eb0 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe89b519640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe8940d22f0 con 0x7fe8940d3ca0 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe89b519640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe8940d2550 con 0x7fe89415f420 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe898ab4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8940d3ca0 0x7fe8940d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe8992b5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe89415f420 0x7fe8940d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe898ab4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8940d3ca0 0x7fe8940d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:52128/0 (socket says 172.21.15.37:52128) 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe898ab4640 1 -- 172.21.15.37:0/197557167 learned_addr learned my addr 172.21.15.37:0/197557167 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe899ab6640 1 --1- 172.21.15.37:0/197557167 >> v1:172.21.15.82:6789/0 conn(0x7fe8940d1eb0 0x7fe8940d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:42626/0 (socket says 172.21.15.37:42626) 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe898ab4640 1 -- 172.21.15.37:0/197557167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe89415f420 msgr2=0x7fe8940d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe898ab4640 1 --2- 172.21.15.37:0/197557167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe89415f420 0x7fe8940d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe898ab4640 1 -- 172.21.15.37:0/197557167 >> v1:172.21.15.82:6789/0 conn(0x7fe8940d1eb0 legacy=0x7fe8940d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.384+0000 7fe898ab4640 1 -- 172.21.15.37:0/197557167 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8940d2c80 con 0x7fe8940d3ca0 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.385+0000 7fe898ab4640 1 --2- 172.21.15.37:0/197557167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8940d3ca0 0x7fe8940d1970 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe884009870 tx=0x7fe88402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf265e92e37f60c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.385+0000 7fe88bfff640 1 -- 172.21.15.37:0/197557167 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037070 con 0x7fe8940d3ca0 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.385+0000 7fe88bfff640 1 -- 172.21.15.37:0/197557167 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe884032440 con 0x7fe8940d3ca0 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.385+0000 7fe88bfff640 1 -- 172.21.15.37:0/197557167 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884032810 con 0x7fe8940d3ca0 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 -- 172.21.15.37:0/197557167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8940d3ca0 msgr2=0x7fe8940d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 --2- 172.21.15.37:0/197557167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8940d3ca0 0x7fe8940d1970 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe884009870 tx=0x7fe88402a270 comp rx=0 tx=0).stop 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 -- 172.21.15.37:0/197557167 shutdown_connections 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 --2- 172.21.15.37:0/197557167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8940d3ca0 0x7fe8940d1970 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 --2- 172.21.15.37:0/197557167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe89415f420 0x7fe8940d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 -- 172.21.15.37:0/197557167 >> 172.21.15.37:0/197557167 conn(0x7fe89408eac0 msgr2=0x7fe89409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 -- 172.21.15.37:0/197557167 shutdown_connections 2024-05-10T08:44:15.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.386+0000 7fe89b519640 1 -- 172.21.15.37:0/197557167 wait complete. 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.387+0000 7fe89b519640 1 Processor -- start 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.387+0000 7fe89b519640 1 -- start start 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe89b519640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8940d1eb0 0x7fe89415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe89b519640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8941ea930 0x7fe8940b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe89b519640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8941eadb0 0x7fe8940b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe89b519640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8940d2830 con 0x7fe8940d1eb0 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe89b519640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8940d3240 con 0x7fe8941eadb0 2024-05-10T08:44:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe89b519640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe8940d53d0 con 0x7fe8941ea930 2024-05-10T08:44:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8940d1eb0 0x7fe89415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8940d1eb0 0x7fe89415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45638/0 (socket says 172.21.15.37:45638) 2024-05-10T08:44:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 -- 172.21.15.37:0/2720689486 learned_addr learned my addr 172.21.15.37:0/2720689486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe898ab4640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8941ea930 0x7fe8940b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe899ab6640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8941eadb0 0x7fe8940b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 -- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8941ea930 msgr2=0x7fe8940b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8941ea930 0x7fe8940b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 -- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8941eadb0 msgr2=0x7fe8940b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8941eadb0 0x7fe8940b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe8992b5640 1 -- 172.21.15.37:0/2720689486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe894162680 con 0x7fe8940d1eb0 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.388+0000 7fe899ab6640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8941eadb0 0x7fe8940b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.389+0000 7fe8992b5640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8940d1eb0 0x7fe89415e690 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe89000e870 tx=0x7fe89000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.389+0000 7fe889ffb640 1 -- 172.21.15.37:0/2720689486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890017070 con 0x7fe8940d1eb0 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.389+0000 7fe889ffb640 1 -- 172.21.15.37:0/2720689486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89000c940 con 0x7fe8940d1eb0 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.389+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe894161b00 con 0x7fe8940d1eb0 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.389+0000 7fe889ffb640 1 -- 172.21.15.37:0/2720689486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89000cd30 con 0x7fe8940d1eb0 2024-05-10T08:44:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.389+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8941620c0 con 0x7fe8940d1eb0 2024-05-10T08:44:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.391+0000 7fe889ffb640 1 -- 172.21.15.37:0/2720689486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe89001a070 con 0x7fe8940d1eb0 2024-05-10T08:44:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.391+0000 7fe889ffb640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8780762d0 0x7fe878078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.391+0000 7fe889ffb640 1 -- 172.21.15.37:0/2720689486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fe890097590 con 0x7fe8940d1eb0 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.391+0000 7fe898ab4640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8780762d0 0x7fe878078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 Processor -- start 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 -- start start 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe898ab4640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8780762d0 0x7fe878078790 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe884034000 tx=0x7fe88402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d25af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d55600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d55b40 0x55ace5d2a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ace5cf2690 con 0x55ace5d56280 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ace5c8ff30 con 0x55ace5d55b40 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.392+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ace5c48b20 con 0x55ace5d73160 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe898ab4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d55600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d25af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d25af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:42118/0 (socket says 172.21.15.37:42118) 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe898ab4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d55600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45640/0 (socket says 172.21.15.37:45640) 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 -- 172.21.15.37:0/4205412515 learned_addr learned my addr 172.21.15.37:0/4205412515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe899ab6640 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d55b40 0x55ace5d2a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 -- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d55b40 msgr2=0x55ace5d2a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d55b40 0x55ace5d2a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 -- 172.21.15.37:0/4205412515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 msgr2=0x55ace5d55600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d55600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 -- 172.21.15.37:0/4205412515 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace5c40e60 con 0x55ace5d73160 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe898ab4640 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d55600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe8992b5640 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d25af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe89005ccb0 tx=0x7fe89005fe30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5afa8bf482441f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe87effd640 1 -- 172.21.15.37:0/4205412515 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890021040 con 0x55ace5d73160 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe87effd640 1 -- 172.21.15.37:0/4205412515 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8900649c0 con 0x55ace5d73160 2024-05-10T08:44:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.393+0000 7fe87effd640 1 -- 172.21.15.37:0/4205412515 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890065d50 con 0x55ace5d73160 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 -- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 msgr2=0x55ace5d25af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d25af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe89005ccb0 tx=0x7fe89005fe30 comp rx=0 tx=0).stop 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 -- 172.21.15.37:0/4205412515 shutdown_connections 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d55b40 0x55ace5d2a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d55600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 --2- 172.21.15.37:0/4205412515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d25af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 -- 172.21.15.37:0/4205412515 >> 172.21.15.37:0/4205412515 conn(0x55ace5d27d60 msgr2=0x55ace5d70600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 -- 172.21.15.37:0/4205412515 shutdown_connections 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 -- 172.21.15.37:0/4205412515 wait complete. 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.394+0000 7fe89e238740 1 -- start start 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.395+0000 7fe89e238740 1 Processor -- start 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.395+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d57d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.395+0000 7fe89e238740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.395+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d67810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.395+0000 7fe89e238740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ace5c4c5e0 con 0x55ace5d73160 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.395+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ace5c8bef0 con 0x55ace5d67390 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.395+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ace5d29f10 con 0x55ace5d56280 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe89e238740 10 client.0 _ll_register_callbacks cb 0x55ace5c47320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe898ab4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe898ab4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45648/0 (socket says 172.21.15.37:45648) 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe898ab4640 1 -- 172.21.15.37:0/199252213 learned_addr learned my addr 172.21.15.37:0/199252213 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe8992b5640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d57d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe899ab6640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d67810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe8992b5640 1 -- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 msgr2=0x55ace5d67810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe8992b5640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d67810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe8992b5640 1 -- 172.21.15.37:0/199252213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 msgr2=0x55ace5d689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe8992b5640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe8992b5640 1 -- 172.21.15.37:0/199252213 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55ace5a6b7d0 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe899ab6640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe8992b5640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d57d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8900603c0 tx=0x7fe890000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd8e83a2b8c92d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe873fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3301/0 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe873fff640 1 -- 172.21.15.37:0/199252213 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890021070 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8900649c0 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.396+0000 7fe873fff640 1 -- 172.21.15.37:0/199252213 <== mon.2 v2:172.21.15.82:3301/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fe89005f920 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe873fff640 1 -- 172.21.15.37:0/199252213 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe89005cd10 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 10 client.5573 fetch_fsmap learned FSMap version 50 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55ace59a13f0 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe873fff640 1 -- 172.21.15.37:0/199252213 <== mon.2 v2:172.21.15.82:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8900649c0 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe873fff640 1 -- 172.21.15.37:0/199252213 <== mon.2 v2:172.21.15.82:3301/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7fe890024060 con 0x55ace5d56280 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 10 client.5573 fetch_fsmap finished waiting for FSMap version 50 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 10 client.5573 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 20 client.5573 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d43c10 0x55ace5d44020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 4 client.5573 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ace5c9db40 con 0x55ace5d43c10 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe898ab4640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d43c10 0x55ace5d44020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe873fff640 10 client.5573 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.397+0000 7fe898ab4640 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d43c10 0x55ace5d44020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d541c79c4e47211 server_cookie=d85d8403659961f0 in_seq=0 out_seq=0 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe873fff640 1 -- 172.21.15.37:0/199252213 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ace5c9db40 con 0x55ace5d43c10 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe873fff640 10 client.5573 handle_command_reply: tid=0 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 client.5573 shutdown 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 msgr2=0x55ace5d57d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d57d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8900603c0 tx=0x7fe890000bc0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 shutdown_connections 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d43c10 0x55ace5d44020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 --2- 172.21.15.37:0/199252213 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d57d70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe873fff640 0 client.5573 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 >> 172.21.15.37:0/199252213 conn(0x55ace5d55b40 msgr2=0x55ace5d296c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 shutdown_connections 2024-05-10T08:44:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 1 -- 172.21.15.37:0/199252213 wait complete. 2024-05-10T08:44:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.398+0000 7fe89e238740 20 client.5573 trim_cache size 0 max 16384 2024-05-10T08:44:15.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.416+0000 7fe89e238740 1 Processor -- start 2024-05-10T08:44:15.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe89e238740 1 -- start start 2024-05-10T08:44:15.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe89e238740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d24b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d8a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d8a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe89e238740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe894201f90 con 0x55ace5d56280 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe894200fb0 con 0x55ace5d67390 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe8940cdaa0 con 0x55ace5d73160 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe8992b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d24b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe8992b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d24b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45658/0 (socket says 172.21.15.37:45658) 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.417+0000 7fe8992b5640 1 -- 172.21.15.37:0/1721187719 learned_addr learned my addr 172.21.15.37:0/1721187719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe8992b5640 1 -- 172.21.15.37:0/1721187719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 msgr2=0x55ace5d8a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe8992b5640 1 --2- 172.21.15.37:0/1721187719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d8a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe8992b5640 1 -- 172.21.15.37:0/1721187719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 msgr2=0x55ace5d8a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe8992b5640 1 --2- 172.21.15.37:0/1721187719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d8a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe8992b5640 1 -- 172.21.15.37:0/1721187719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace59610f0 con 0x55ace5d56280 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe8992b5640 1 --2- 172.21.15.37:0/1721187719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d24b90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe890060650 tx=0x7fe890077040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5c98ae88e7cb83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe87e7fc640 1 -- 172.21.15.37:0/1721187719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890021030 con 0x55ace5d56280 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe87e7fc640 1 -- 172.21.15.37:0/1721187719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89005f920 con 0x55ace5d56280 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe87e7fc640 1 -- 172.21.15.37:0/1721187719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89005c270 con 0x55ace5d56280 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 -- 172.21.15.37:0/1721187719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 msgr2=0x55ace5d24b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 --2- 172.21.15.37:0/1721187719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d24b90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe890060650 tx=0x7fe890077040 comp rx=0 tx=0).stop 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 -- 172.21.15.37:0/1721187719 shutdown_connections 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 --2- 172.21.15.37:0/1721187719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d73160 0x55ace5d8a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 --2- 172.21.15.37:0/1721187719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5d8a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 --2- 172.21.15.37:0/1721187719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d56280 0x55ace5d24b90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 -- 172.21.15.37:0/1721187719 >> 172.21.15.37:0/1721187719 conn(0x55ace5d55b40 msgr2=0x55ace5d552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 -- 172.21.15.37:0/1721187719 shutdown_connections 2024-05-10T08:44:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.418+0000 7fe89e238740 1 -- 172.21.15.37:0/1721187719 wait complete. 2024-05-10T08:44:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.419+0000 7fe89e238740 1 -- start start 2024-05-10T08:44:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.419+0000 7fe89e238740 1 Processor -- start 2024-05-10T08:44:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d93a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe89e238740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5decb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe89e238740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d65f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe89e238740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe894200a20 con 0x55ace5d73160 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ace5c9db40 con 0x55ace5d67390 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe89e238740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ace5d72a30 con 0x55ace5d56280 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe89e238740 10 client.0 _ll_register_callbacks cb 0x7fe890009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d65f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d65f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45666/0 (socket says 172.21.15.37:45666) 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 -- 172.21.15.37:0/3391633805 learned_addr learned my addr 172.21.15.37:0/3391633805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe8992b5640 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d93a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe898ab4640 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5decb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 -- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 msgr2=0x55ace5d93a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d93a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 -- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 msgr2=0x55ace5decb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5decb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 -- 172.21.15.37:0/3391633805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ace5d691d0 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe899ab6640 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d65f90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe88c014a30 tx=0x7fe88c014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5da33d739b1d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.420+0000 7fe873fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe873fff640 1 -- 172.21.15.37:0/3391633805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c012a50 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe873fff640 1 -- 172.21.15.37:0/3391633805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fe88c012bf0 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe89005f920 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe873fff640 1 -- 172.21.15.37:0/3391633805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe88c026050 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 10 client.6390 fetch_fsmap learned FSMap version 50 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55ace5d66750 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe873fff640 1 -- 172.21.15.37:0/3391633805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89005f920 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe873fff640 1 -- 172.21.15.37:0/3391633805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 3494+0+0 (secure 0 0 0) 0x7fe88c029020 con 0x55ace5d73160 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 10 client.6390 fetch_fsmap finished waiting for FSMap version 50 2024-05-10T08:44:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 10 client.6390 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 20 client.6390 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d69a60 0x55ace5d69e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 4 client.6390 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ace5c979b0 con 0x55ace5d69a60 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.421+0000 7fe8992b5640 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d69a60 0x55ace5d69e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe873fff640 10 client.6390 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe8992b5640 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d69a60 0x55ace5d69e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3db6c020db252f24 server_cookie=b18abe15d162f7aa in_seq=0 out_seq=0 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe873fff640 1 -- 172.21.15.37:0/3391633805 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ace5c979b0 con 0x55ace5d69a60 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe873fff640 10 client.6390 handle_command_reply: tid=0 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 client.6390 shutdown 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 msgr2=0x55ace5d65f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d65f90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe88c014a30 tx=0x7fe88c014ef0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 shutdown_connections 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55ace5d69a60 0x55ace5d69e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace5d73160 0x55ace5d65f90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe873fff640 0 client.6390 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ace5d67390 0x55ace5decb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 --2- 172.21.15.37:0/3391633805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ace5d56280 0x55ace5d93a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 >> 172.21.15.37:0/3391633805 conn(0x55ace5d55b40 msgr2=0x55ace5d67ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 shutdown_connections 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 1 -- 172.21.15.37:0/3391633805 wait complete. 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.422+0000 7fe89e238740 20 client.6390 trim_cache size 0 max 16384 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:44:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: "4666ea33-d1db-46a1-acd0-e4a335e97f50": { 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/subdir", 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "4666ea33-d1db-46a1-acd0-e4a335e97f50", 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive" 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:44:15.428 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:44:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8780762d0 msgr2=0x7fe878078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8780762d0 0x7fe878078790 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe884034000 tx=0x7fe88402e000 comp rx=0 tx=0).stop 2024-05-10T08:44:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8940d1eb0 msgr2=0x7fe89415e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8940d1eb0 0x7fe89415e690 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe89000e870 tx=0x7fe89000ed30 comp rx=0 tx=0).stop 2024-05-10T08:44:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 shutdown_connections 2024-05-10T08:44:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8780762d0 0x7fe878078790 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8941eadb0 0x7fe8940b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8941ea930 0x7fe8940b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 --2- 172.21.15.37:0/2720689486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8940d1eb0 0x7fe89415e690 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 >> 172.21.15.37:0/2720689486 conn(0x7fe89408eac0 msgr2=0x7fe8940b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 shutdown_connections 2024-05-10T08:44:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:15.423+0000 7fe89b519640 1 -- 172.21.15.37:0/2720689486 wait complete. 2024-05-10T08:44:15.433 INFO:tasks.cephfs.filesystem:scrub status for tag:4666ea33-d1db-46a1-acd0-e4a335e97f50 - {'path': '/subdir', 'tag': '4666ea33-d1db-46a1-acd0-e4a335e97f50', 'options': 'recursive'} 2024-05-10T08:44:18.747 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:44:18.748+0000 7fdeb3164640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T08:44:23.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:44:23.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:44:45.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:45.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T08:44:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.555+0000 7feeba87b640 1 Processor -- start 2024-05-10T08:44:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.555+0000 7feeba87b640 1 -- start start 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeba87b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feeb40b2490 0x7feeb4070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeba87b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feeb4070d20 0x7feeb40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeba87b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb406e110 con 0x7feeb41629b0 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeba87b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7feeb406dec0 con 0x7feeb4070d20 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeba87b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7feeb406e3f0 con 0x7feeb40b2490 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb8e18640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feeb4070d20 0x7feeb40711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feeb41629b0 0x7feeb406eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57692/0 (socket says 172.21.15.37:57692) 2024-05-10T08:44:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb3fff640 1 -- 172.21.15.37:0/3747681405 learned_addr learned my addr 172.21.15.37:0/3747681405 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb37fe640 1 --2- 172.21.15.37:0/3747681405 >> v2:172.21.15.82:3300/0 conn(0x7feeb40b2490 0x7feeb4070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb8e18640 1 -- 172.21.15.37:0/3747681405 >> v2:172.21.15.82:3300/0 conn(0x7feeb40b2490 msgr2=0x7feeb4070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb8e18640 1 --2- 172.21.15.37:0/3747681405 >> v2:172.21.15.82:3300/0 conn(0x7feeb40b2490 0x7feeb4070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb8e18640 1 -- 172.21.15.37:0/3747681405 >> v1:172.21.15.37:6789/0 conn(0x7feeb41629b0 legacy=0x7feeb406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.556+0000 7feeb8e18640 1 -- 172.21.15.37:0/3747681405 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb406e6d0 con 0x7feeb4070d20 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.557+0000 7feeb8e18640 1 --2- 172.21.15.37:0/3747681405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40711d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7feeb40b8fb0 tx=0x7feeac02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c284b3a5a24cf65b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.557+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3747681405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac007740 con 0x7feeb4070d20 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.557+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3747681405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac0078e0 con 0x7feeb4070d20 2024-05-10T08:44:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.557+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3747681405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac007cb0 con 0x7feeb4070d20 2024-05-10T08:44:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 -- 172.21.15.37:0/3747681405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 msgr2=0x7feeb40711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 --2- 172.21.15.37:0/3747681405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40711d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7feeb40b8fb0 tx=0x7feeac02a680 comp rx=0 tx=0).stop 2024-05-10T08:44:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 -- 172.21.15.37:0/3747681405 shutdown_connections 2024-05-10T08:44:45.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 --2- 172.21.15.37:0/3747681405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40711d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 --2- 172.21.15.37:0/3747681405 >> v2:172.21.15.82:3300/0 conn(0x7feeb40b2490 0x7feeb4070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 -- 172.21.15.37:0/3747681405 >> 172.21.15.37:0/3747681405 conn(0x7feeb40b49d0 msgr2=0x7feeb40b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 -- 172.21.15.37:0/3747681405 shutdown_connections 2024-05-10T08:44:45.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.558+0000 7feeba87b640 1 -- 172.21.15.37:0/3747681405 wait complete. 2024-05-10T08:44:45.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.559+0000 7feeba87b640 1 Processor -- start 2024-05-10T08:44:45.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.559+0000 7feeba87b640 1 -- start start 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeba87b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeba87b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeb40b2490 0x7feeb41472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeba87b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb41629b0 0x7feeb4147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeba87b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40709f0 con 0x7feeb4070d20 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeba87b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4070870 con 0x7feeb41629b0 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeba87b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7feeb40afcb0 con 0x7feeb40b2490 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55898/0 (socket says 172.21.15.37:55898) 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeb3fff640 1 -- 172.21.15.37:0/472709590 learned_addr learned my addr 172.21.15.37:0/472709590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeb37fe640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeb40b2490 0x7feeb41472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.560+0000 7feeb8e18640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb41629b0 0x7feeb4147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb3fff640 1 -- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeb40b2490 msgr2=0x7feeb41472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb3fff640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeb40b2490 0x7feeb41472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb3fff640 1 -- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb41629b0 msgr2=0x7feeb4147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb3fff640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb41629b0 0x7feeb4147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb3fff640 1 -- 172.21.15.37:0/472709590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb4160430 con 0x7feeb4070d20 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb37fe640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeb40b2490 0x7feeb41472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb8e18640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb41629b0 0x7feeb4147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb3fff640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40b5ac0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feea400c3f0 tx=0x7feea400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb0ff9640 1 -- 172.21.15.37:0/472709590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4017070 con 0x7feeb4070d20 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb0ff9640 1 -- 172.21.15.37:0/472709590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea4005ce0 con 0x7feeb4070d20 2024-05-10T08:44:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb4160710 con 0x7feeb4070d20 2024-05-10T08:44:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeb0ff9640 1 -- 172.21.15.37:0/472709590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea40072f0 con 0x7feeb4070d20 2024-05-10T08:44:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.561+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb4160cd0 con 0x7feeb4070d20 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.563+0000 7feeb0ff9640 1 -- 172.21.15.37:0/472709590 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feea401a070 con 0x7feeb4070d20 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.563+0000 7feeb0ff9640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7feea0076300 0x7feea00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.563+0000 7feeb0ff9640 1 -- 172.21.15.37:0/472709590 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7feea4096b20 con 0x7feeb4070d20 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.563+0000 7feeb37fe640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7feea0076300 0x7feea00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.564+0000 7feebd595740 1 Processor -- start 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.564+0000 7feebd595740 1 -- start start 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.564+0000 7feeb37fe640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7feea0076300 0x7feea00787c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feeb4161f40 tx=0x7feea8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.564+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76ab160 0x55dfb765daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.564+0000 7feebd595740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb768d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.564+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768db40 0x55dfb7662950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feebd595740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dfb762a690 con 0x55dfb768e280 2024-05-10T08:44:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dfb75c7f30 con 0x55dfb768db40 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55dfb7580b20 con 0x55dfb76ab160 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb768d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb768d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55902/0 (socket says 172.21.15.37:55902) 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 -- 172.21.15.37:0/425898113 learned_addr learned my addr 172.21.15.37:0/425898113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76ab160 0x55dfb765daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb8e18640 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768db40 0x55dfb7662950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 -- 172.21.15.37:0/425898113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76ab160 msgr2=0x55dfb765daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76ab160 0x55dfb765daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 -- 172.21.15.37:0/425898113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768db40 msgr2=0x55dfb7662950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768db40 0x55dfb7662950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 -- 172.21.15.37:0/425898113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfb7578e60 con 0x55dfb768e280 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.565+0000 7feeb37fe640 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb768d600 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feea800fab0 tx=0x7feea8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcd8460a8280264 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7fee99ffb640 1 -- 172.21.15.37:0/425898113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea801b050 con 0x55dfb768e280 2024-05-10T08:44:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7fee99ffb640 1 -- 172.21.15.37:0/425898113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8025070 con 0x55dfb768e280 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7fee99ffb640 1 -- 172.21.15.37:0/425898113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8020440 con 0x55dfb768e280 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 -- 172.21.15.37:0/425898113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 msgr2=0x55dfb768d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb768d600 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feea800fab0 tx=0x7feea8012000 comp rx=0 tx=0).stop 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 -- 172.21.15.37:0/425898113 shutdown_connections 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768db40 0x55dfb7662950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb768d600 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 --2- 172.21.15.37:0/425898113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76ab160 0x55dfb765daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 -- 172.21.15.37:0/425898113 >> 172.21.15.37:0/425898113 conn(0x55dfb765fd60 msgr2=0x55dfb76a8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 -- 172.21.15.37:0/425898113 shutdown_connections 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.566+0000 7feebd595740 1 -- 172.21.15.37:0/425898113 wait complete. 2024-05-10T08:44:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.567+0000 7feebd595740 1 -- start start 2024-05-10T08:44:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.567+0000 7feebd595740 1 Processor -- start 2024-05-10T08:44:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feebd595740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb76bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76ab160 0x55dfb76623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feebd595740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dfb75845e0 con 0x55dfb768e280 2024-05-10T08:44:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dfb75c3ef0 con 0x55dfb76ab160 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55dfb7661f10 con 0x55dfb76892b0 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feebd595740 10 client.0 _ll_register_callbacks cb 0x55dfb757f320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb76bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb76bbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55908/0 (socket says 172.21.15.37:55908) 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 -- 172.21.15.37:0/2828551995 learned_addr learned my addr 172.21.15.37:0/2828551995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb37fe640 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76ab160 0x55dfb76623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb8e18640 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 -- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 msgr2=0x55dfb76628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 -- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76ab160 msgr2=0x55dfb76623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76ab160 0x55dfb76623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.568+0000 7feeb3fff640 1 -- 172.21.15.37:0/2828551995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfb73a37d0 con 0x55dfb768e280 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feeb3fff640 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb76bbb30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7feea4094e70 tx=0x7feea40601c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87d12d8b4cffcb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7fee92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7fee92ffd640 1 -- 172.21.15.37:0/2828551995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4079060 con 0x55dfb768e280 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7fee92ffd640 1 -- 172.21.15.37:0/2828551995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7feea4066150 con 0x55dfb768e280 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feea8025070 con 0x55dfb768e280 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7fee92ffd640 1 -- 172.21.15.37:0/2828551995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7feea4094050 con 0x55dfb768e280 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 10 client.6405 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55dfb72d93f0 con 0x55dfb768e280 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7fee92ffd640 1 -- 172.21.15.37:0/2828551995 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8025070 con 0x55dfb768e280 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7fee92ffd640 1 -- 172.21.15.37:0/2828551995 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7feea405b510 con 0x55dfb768e280 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 10 client.6405 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 10 client.6405 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 20 client.6405 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76b9fa0 0x55dfb76ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 4 client.6405 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfb75d5b40 con 0x55dfb76b9fa0 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.569+0000 7feeb37fe640 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76b9fa0 0x55dfb76ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.570+0000 7feeb37fe640 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76b9fa0 0x55dfb76ba3a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4b1231260296162 server_cookie=5d5f08631ec4bda3 in_seq=0 out_seq=0 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.570+0000 7fee92ffd640 10 client.6405 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.570+0000 7fee92ffd640 1 -- 172.21.15.37:0/2828551995 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dfb75d5b40 con 0x55dfb76b9fa0 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.570+0000 7fee92ffd640 10 client.6405 handle_command_reply: tid=0 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.570+0000 7feebd595740 1 client.6405 shutdown 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.570+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 msgr2=0x55dfb76bbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.570+0000 7feebd595740 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb76bbb30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7feea4094e70 tx=0x7feea40601c0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 shutdown_connections 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76b9fa0 0x55dfb76ba3a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76ab160 0x55dfb76623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 --2- 172.21.15.37:0/2828551995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb768e280 0x55dfb76bbb30 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 >> 172.21.15.37:0/2828551995 conn(0x55dfb768db40 msgr2=0x55dfb765d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7fee92ffd640 0 client.6405 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 shutdown_connections 2024-05-10T08:44:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 1 -- 172.21.15.37:0/2828551995 wait complete. 2024-05-10T08:44:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.571+0000 7feebd595740 20 client.6405 trim_cache size 0 max 16384 2024-05-10T08:44:45.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.589+0000 7feebd595740 1 Processor -- start 2024-05-10T08:44:45.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.589+0000 7feebd595740 1 -- start start 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768e280 0x55dfb76a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feebd595740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76885b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feebd595740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feeb42020a0 con 0x55dfb76ab160 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4201080 con 0x55dfb768e280 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7feeb4200410 con 0x55dfb76892b0 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76885b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76885b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55916/0 (socket says 172.21.15.37:55916) 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 -- 172.21.15.37:0/2610739831 learned_addr learned my addr 172.21.15.37:0/2610739831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb37fe640 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768e280 0x55dfb76a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb3fff640 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 -- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 msgr2=0x55dfb76cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 -- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768e280 msgr2=0x55dfb76a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768e280 0x55dfb76a85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 -- 172.21.15.37:0/2610739831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfb7660ea0 con 0x55dfb76ab160 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.590+0000 7feeb8e18640 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76885b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7feeac007810 tx=0x7feeac02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b79485b81172160 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7fee997fa640 1 -- 172.21.15.37:0/2610739831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac007bb0 con 0x55dfb76ab160 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7fee997fa640 1 -- 172.21.15.37:0/2610739831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac04c070 con 0x55dfb76ab160 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7fee997fa640 1 -- 172.21.15.37:0/2610739831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac03d430 con 0x55dfb76ab160 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 -- 172.21.15.37:0/2610739831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 msgr2=0x55dfb76885b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76885b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7feeac007810 tx=0x7feeac02e000 comp rx=0 tx=0).stop 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 -- 172.21.15.37:0/2610739831 shutdown_connections 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76885b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb768e280 0x55dfb76a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 --2- 172.21.15.37:0/2610739831 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb76892b0 0x55dfb76cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 -- 172.21.15.37:0/2610739831 >> 172.21.15.37:0/2610739831 conn(0x55dfb768db40 msgr2=0x55dfb76cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 -- 172.21.15.37:0/2610739831 shutdown_connections 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.591+0000 7feebd595740 1 -- 172.21.15.37:0/2610739831 wait complete. 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.592+0000 7feebd595740 1 -- start start 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.592+0000 7feebd595740 1 Processor -- start 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76892b0 0x55dfb7687200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb768e280 0x55dfb765d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dfb765f110 con 0x55dfb76ab160 2024-05-10T08:44:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4200a30 con 0x55dfb76892b0 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55dfb76a94a0 con 0x55dfb768e280 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 10 client.0 _ll_register_callbacks cb 0x7feea405f560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55918/0 (socket says 172.21.15.37:55918) 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 -- 172.21.15.37:0/4087403619 learned_addr learned my addr 172.21.15.37:0/4087403619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb37fe640 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb768e280 0x55dfb765d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb3fff640 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76892b0 0x55dfb7687200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 -- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb768e280 msgr2=0x55dfb765d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb768e280 0x55dfb765d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 -- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76892b0 msgr2=0x55dfb7687200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76892b0 0x55dfb7687200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 -- 172.21.15.37:0/4087403619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfb72990f0 con 0x55dfb76ab160 2024-05-10T08:44:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feeb8e18640 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76617b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7feeac048000 tx=0x7feeac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640842f4a4a82707 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7fee92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7fee92ffd640 1 -- 172.21.15.37:0/4087403619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac004240 con 0x55dfb76ab160 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7fee92ffd640 1 -- 172.21.15.37:0/4087403619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7feeac0043e0 con 0x55dfb76ab160 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.593+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeac04c070 con 0x55dfb76ab160 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7fee92ffd640 1 -- 172.21.15.37:0/4087403619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7feeac061050 con 0x55dfb76ab160 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 10 client.6411 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55dfb76aa240 con 0x55dfb76ab160 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7fee92ffd640 1 -- 172.21.15.37:0/4087403619 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac04c070 con 0x55dfb76ab160 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7fee92ffd640 1 -- 172.21.15.37:0/4087403619 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7feeac064020 con 0x55dfb76ab160 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 10 client.6411 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 10 client.6411 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 20 client.6411 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76ac430 0x55dfb7661cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 4 client.6411 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dfb75cf9b0 con 0x55dfb76ac430 2024-05-10T08:44:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feeb3fff640 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76ac430 0x55dfb7661cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7fee92ffd640 10 client.6411 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.594+0000 7feeb3fff640 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76ac430 0x55dfb7661cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=485b05f07e5b19d6 server_cookie=564e124765ed3e4b in_seq=0 out_seq=0 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7fee92ffd640 1 -- 172.21.15.37:0/4087403619 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dfb75cf9b0 con 0x55dfb76ac430 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7fee92ffd640 10 client.6411 handle_command_reply: tid=0 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 client.6411 shutdown 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 msgr2=0x55dfb76617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76617b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7feeac048000 tx=0x7feeac004ab0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 shutdown_connections 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55dfb76ac430 0x55dfb7661cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfb76ab160 0x55dfb76617b0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dfb768e280 0x55dfb765d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 --2- 172.21.15.37:0/4087403619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfb76892b0 0x55dfb7687200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7fee92ffd640 0 client.6411 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 >> 172.21.15.37:0/4087403619 conn(0x55dfb768db40 msgr2=0x55dfb769fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 shutdown_connections 2024-05-10T08:44:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 1 -- 172.21.15.37:0/4087403619 wait complete. 2024-05-10T08:44:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feebd595740 20 client.6411 trim_cache size 0 max 16384 2024-05-10T08:44:45.601 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:44:45.601 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:44:45.601 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:44:45.601 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:44:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7feea0076300 msgr2=0x7feea00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feeba87b640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7feea0076300 0x7feea00787c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feeb4161f40 tx=0x7feea8008040 comp rx=0 tx=0).stop 2024-05-10T08:44:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 msgr2=0x7feeb40b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.595+0000 7feeba87b640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40b5ac0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feea400c3f0 tx=0x7feea400c8b0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 shutdown_connections 2024-05-10T08:44:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7feea0076300 0x7feea00787c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb41629b0 0x7feeb4147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feeb40b2490 0x7feeb41472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 --2- 172.21.15.37:0/472709590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb4070d20 0x7feeb40b5ac0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 >> 172.21.15.37:0/472709590 conn(0x7feeb40b49d0 msgr2=0x7feeb40b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 shutdown_connections 2024-05-10T08:44:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.596+0000 7feeba87b640 1 -- 172.21.15.37:0/472709590 wait complete. 2024-05-10T08:44:45.606 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:44:45.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:44:45.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.711+0000 7ff648790640 1 Processor -- start 2024-05-10T08:44:45.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.711+0000 7ff648790640 1 -- start start 2024-05-10T08:44:45.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff648790640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6401629b0 0x7ff64006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff648790640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff648790640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64006e110 con 0x7ff6400b2490 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff648790640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff640070a40 con 0x7ff6401629b0 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff648790640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff64006dec0 con 0x7ff640070d20 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff645d2b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff6400b2490 0x7ff640070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57702/0 (socket says 172.21.15.37:57702) 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff645d2b640 1 -- 172.21.15.37:0/490635904 learned_addr learned my addr 172.21.15.37:0/490635904 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff646d2d640 1 --2- 172.21.15.37:0/490635904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff64652c640 1 --2- 172.21.15.37:0/490635904 >> v2:172.21.15.82:3300/0 conn(0x7ff6401629b0 0x7ff64006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff64552a640 1 -- 172.21.15.37:0/490635904 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588946813 0 0) 0x7ff64006e110 con 0x7ff6400b2490 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff64552a640 1 -- 172.21.15.37:0/490635904 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff62c003520 con 0x7ff6400b2490 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff64552a640 1 -- 172.21.15.37:0/490635904 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2012296814 0 0) 0x7ff62c003520 con 0x7ff6400b2490 2024-05-10T08:44:45.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff646d2d640 1 -- 172.21.15.37:0/490635904 >> v2:172.21.15.82:3300/0 conn(0x7ff6401629b0 msgr2=0x7ff64006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff646d2d640 1 --2- 172.21.15.37:0/490635904 >> v2:172.21.15.82:3300/0 conn(0x7ff6401629b0 0x7ff64006eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff646d2d640 1 -- 172.21.15.37:0/490635904 >> v1:172.21.15.37:6789/0 conn(0x7ff6400b2490 legacy=0x7ff640070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff646d2d640 1 -- 172.21.15.37:0/490635904 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64006e3f0 con 0x7ff640070d20 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.712+0000 7ff64652c640 1 --2- 172.21.15.37:0/490635904 >> v2:172.21.15.82:3300/0 conn(0x7ff6401629b0 0x7ff64006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.713+0000 7ff646d2d640 1 --2- 172.21.15.37:0/490635904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400711d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6380097a0 tx=0x7ff63802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31e2cb0379a0171 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.713+0000 7ff64552a640 1 -- 172.21.15.37:0/490635904 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638037070 con 0x7ff640070d20 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.713+0000 7ff64552a640 1 -- 172.21.15.37:0/490635904 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63802aba0 con 0x7ff640070d20 2024-05-10T08:44:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.713+0000 7ff64552a640 1 -- 172.21.15.37:0/490635904 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630001670 con 0x7ff640070d20 2024-05-10T08:44:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 -- 172.21.15.37:0/490635904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 msgr2=0x7ff6400711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 --2- 172.21.15.37:0/490635904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400711d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6380097a0 tx=0x7ff63802a110 comp rx=0 tx=0).stop 2024-05-10T08:44:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 -- 172.21.15.37:0/490635904 shutdown_connections 2024-05-10T08:44:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 --2- 172.21.15.37:0/490635904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400711d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 --2- 172.21.15.37:0/490635904 >> v2:172.21.15.82:3300/0 conn(0x7ff6401629b0 0x7ff64006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 -- 172.21.15.37:0/490635904 >> 172.21.15.37:0/490635904 conn(0x7ff6400b49d0 msgr2=0x7ff6400b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 -- 172.21.15.37:0/490635904 shutdown_connections 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.714+0000 7ff648790640 1 -- 172.21.15.37:0/490635904 wait complete. 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.715+0000 7ff648790640 1 Processor -- start 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.715+0000 7ff648790640 1 -- start start 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff648790640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff648790640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6400b2490 0x7ff6400cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff648790640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6401629b0 0x7ff6400b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff648790640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff64006f410 con 0x7ff6400b2490 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff648790640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff64006e9b0 con 0x7ff6401629b0 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff648790640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff6400afcb0 con 0x7ff640070d20 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6400b2490 0x7ff6400cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6400b2490 0x7ff6400cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55928/0 (socket says 172.21.15.37:55928) 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 -- 172.21.15.37:0/3744990050 learned_addr learned my addr 172.21.15.37:0/3744990050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff646d2d640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6401629b0 0x7ff6400b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff64652c640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 -- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 msgr2=0x7ff6400c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 -- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6401629b0 msgr2=0x7ff6400b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6401629b0 0x7ff6400b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.716+0000 7ff645d2b640 1 -- 172.21.15.37:0/3744990050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6401f2450 con 0x7ff6400b2490 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff64652c640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff646d2d640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6401629b0 0x7ff6400b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff645d2b640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6400b2490 0x7ff6400cf930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c780 tx=0x7ff63000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff636ffd640 1 -- 172.21.15.37:0/3744990050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630017070 con 0x7ff6400b2490 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff636ffd640 1 -- 172.21.15.37:0/3744990050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff630005ad0 con 0x7ff6400b2490 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6400d00a0 con 0x7ff6400b2490 2024-05-10T08:44:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff636ffd640 1 -- 172.21.15.37:0/3744990050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630007070 con 0x7ff6400b2490 2024-05-10T08:44:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.717+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6400b0110 con 0x7ff6400b2490 2024-05-10T08:44:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.718+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6400b47f0 con 0x7ff6400b2490 2024-05-10T08:44:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.718+0000 7ff636ffd640 1 -- 172.21.15.37:0/3744990050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff63001a070 con 0x7ff6400b2490 2024-05-10T08:44:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.719+0000 7ff636ffd640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6240762d0 0x7ff624078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.719+0000 7ff636ffd640 1 -- 172.21.15.37:0/3744990050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7ff630096cd0 con 0x7ff6400b2490 2024-05-10T08:44:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.719+0000 7ff64652c640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6240762d0 0x7ff624078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.720+0000 7ff64652c640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6240762d0 0x7ff624078790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff63c007440 tx=0x7ff63c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.724+0000 7ff636ffd640 1 -- 172.21.15.37:0/3744990050 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff6400b47f0 con 0x7ff6400b2490 2024-05-10T08:44:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.957+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6400693f0 con 0x7ff6400b2490 2024-05-10T08:44:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.957+0000 7ff636ffd640 1 -- 172.21.15.37:0/3744990050 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5181 (secure 0 0 0) 0x7ff6300604e0 con 0x7ff6400b2490 2024-05-10T08:44:45.957 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:45.957 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:18.732462+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":5}]} 2024-05-10T08:44:45.957 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 51 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6240762d0 msgr2=0x7ff624078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6240762d0 0x7ff624078790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff63c007440 tx=0x7ff63c00b040 comp rx=0 tx=0).stop 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6400b2490 msgr2=0x7ff6400cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6400b2490 0x7ff6400cf930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c780 tx=0x7ff63000cc40 comp rx=0 tx=0).stop 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 shutdown_connections 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff6240762d0 0x7ff624078790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6401629b0 0x7ff6400b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6400b2490 0x7ff6400cf930 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 --2- 172.21.15.37:0/3744990050 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff640070d20 0x7ff6400c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 >> 172.21.15.37:0/3744990050 conn(0x7ff6400b49d0 msgr2=0x7ff640070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 shutdown_connections 2024-05-10T08:44:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:45.960+0000 7ff648790640 1 -- 172.21.15.37:0/3744990050 wait complete. 2024-05-10T08:44:45.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-05-10T08:44:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.076+0000 7f2ea58fc640 1 Processor -- start 2024-05-10T08:44:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.076+0000 7f2ea58fc640 1 -- start start 2024-05-10T08:44:46.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.077+0000 7f2ea58fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ea00d56d0 0x7f2ea00b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.077+0000 7f2ea58fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 0x7f2ea00d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.077+0000 7f2ea58fc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea01606c0 con 0x7f2ea015f2d0 2024-05-10T08:44:46.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.077+0000 7f2ea58fc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea00b5810 con 0x7f2ea00d56d0 2024-05-10T08:44:46.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.077+0000 7f2ea58fc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea00b4f00 con 0x7f2ea00d1c00 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.077+0000 7f2e9effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ea015f2d0 0x7f2ea00d4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57714/0 (socket says 172.21.15.37:57714) 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.077+0000 7f2e9effd640 1 -- 172.21.15.37:0/968735150 learned_addr learned my addr 172.21.15.37:0/968735150 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 0x7f2ea00d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/968735150 >> v2:172.21.15.82:3300/0 conn(0x7f2ea00d56d0 0x7f2ea00b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052576675 0 0) 0x7f2ea01606c0 con 0x7f2ea015f2d0 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8c003520 con 0x7f2ea015f2d0 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2389340924 0 0) 0x7f2e8c003520 con 0x7f2ea015f2d0 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 msgr2=0x7f2ea00d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 0x7f2ea00d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 >> v2:172.21.15.82:3300/0 conn(0x7f2ea00d56d0 msgr2=0x7f2ea00b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 --2- 172.21.15.37:0/968735150 >> v2:172.21.15.82:3300/0 conn(0x7f2ea00d56d0 0x7f2ea00b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea00b51c0 con 0x7f2ea015f2d0 2024-05-10T08:44:46.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f2e90001670 con 0x7f2ea015f2d0 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 >> v1:172.21.15.37:6789/0 conn(0x7f2ea015f2d0 legacy=0x7f2ea00d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2e8c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8c004800 0x7f2e8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 0x7f2e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00b5810 con 0x7f2e8c0039b0 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00b4f00 con 0x7f2e8c004800 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c00b9c0 con 0x7f2ea00d1c00 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/968735150 >> v2:172.21.15.82:3300/0 conn(0x7f2ea00d56d0 0x7f2ea00b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9effd640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2e8c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 0x7f2e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8c004800 0x7f2e8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9effd640 1 -- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 msgr2=0x7f2e8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9effd640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea00d1c00 0x7f2e8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9effd640 1 -- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8c004800 msgr2=0x7f2e8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9effd640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8c004800 0x7f2e8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.078+0000 7f2e9effd640 1 -- 172.21.15.37:0/968735150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c003520 con 0x7f2e8c0039b0 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.079+0000 7f2e9effd640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2e8c003df0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c210 tx=0x7f2e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebdb81e78103c18 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.079+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90007d50 con 0x7f2e8c0039b0 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.079+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9002e070 con 0x7f2e8c0039b0 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.079+0000 7f2e9dffb640 1 -- 172.21.15.37:0/968735150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90005d30 con 0x7f2e8c0039b0 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.080+0000 7f2ea58fc640 1 -- 172.21.15.37:0/968735150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 msgr2=0x7f2e8c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.080+0000 7f2ea58fc640 1 --2- 172.21.15.37:0/968735150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2e8c003df0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c210 tx=0x7f2e8c005830 comp rx=0 tx=0).stop 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.080+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/968735150 reap_dead start 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.080+0000 7f2ea58fc640 1 -- 172.21.15.37:0/968735150 shutdown_connections 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.080+0000 7f2ea58fc640 1 -- 172.21.15.37:0/968735150 >> 172.21.15.37:0/968735150 conn(0x7f2ea00746d0 msgr2=0x7f2ea009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.080+0000 7f2ea58fc640 1 -- 172.21.15.37:0/968735150 shutdown_connections 2024-05-10T08:44:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.080+0000 7f2ea58fc640 1 -- 172.21.15.37:0/968735150 wait complete. 2024-05-10T08:44:46.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.081+0000 7f2ea58fc640 1 Processor -- start 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.081+0000 7f2ea58fc640 1 -- start start 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2ea58fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2ea00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2ea58fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea00b7c50 0x7f2ea0155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2ea58fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea01608b0 0x7f2ea0160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2ea58fc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00d21d0 con 0x7f2e8c0039b0 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2ea58fc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00d2050 con 0x7f2ea00b7c50 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2ea58fc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea00d2350 con 0x7f2ea01608b0 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2ea00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2ea00cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55946/0 (socket says 172.21.15.37:55946) 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9effd640 1 -- 172.21.15.37:0/1344739658 learned_addr learned my addr 172.21.15.37:0/1344739658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea01608b0 0x7f2ea0160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea00b7c50 0x7f2ea0155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9effd640 1 -- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea01608b0 msgr2=0x7f2ea0160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9effd640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea01608b0 0x7f2ea0160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9effd640 1 -- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea00b7c50 msgr2=0x7f2ea0155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.082+0000 7f2e9effd640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea00b7c50 0x7f2ea0155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2e9effd640 1 -- 172.21.15.37:0/1344739658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea00b81c0 con 0x7f2e8c0039b0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea01608b0 0x7f2ea0160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2e9effd640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2ea00cb5b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c330 tx=0x7f2ea00b6760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2e97fff640 1 -- 172.21.15.37:0/1344739658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90007d50 con 0x7f2e8c0039b0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2e97fff640 1 -- 172.21.15.37:0/1344739658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e90004e20 con 0x7f2e8c0039b0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2e97fff640 1 -- 172.21.15.37:0/1344739658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90007270 con 0x7f2e8c0039b0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea00c8c00 con 0x7f2e8c0039b0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.083+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea00c91c0 con 0x7f2e8c0039b0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.085+0000 7f2e97fff640 1 -- 172.21.15.37:0/1344739658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e90046030 con 0x7f2e8c0039b0 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.085+0000 7f2e97fff640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.086+0000 7f2e97fff640 1 -- 172.21.15.37:0/1344739658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f2e900b7870 con 0x7f2e8c0039b0 2024-05-10T08:44:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.086+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.086+0000 7f2ea8615740 1 Processor -- start 2024-05-10T08:44:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.086+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e80076300 0x7f2e800787c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00baff0 tx=0x7f2e88008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.086+0000 7f2ea8615740 1 -- start start 2024-05-10T08:44:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0281c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f0284bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c0b0 0x556f02820ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2ea8615740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f0270c920 con 0x556f0284c7f0 2024-05-10T08:44:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f02781dd0 con 0x556f0284c0b0 2024-05-10T08:44:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556f027323e0 con 0x556f028696d0 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2e9e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f0284bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.087+0000 7f2e9e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f0284bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55954/0 (socket says 172.21.15.37:55954) 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9e7fc640 1 -- 172.21.15.37:0/593715651 learned_addr learned my addr 172.21.15.37:0/593715651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9effd640 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0281c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c0b0 0x556f02820ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9e7fc640 1 -- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 msgr2=0x556f0281c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0281c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9e7fc640 1 -- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c0b0 msgr2=0x556f02820ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c0b0 0x556f02820ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9e7fc640 1 -- 172.21.15.37:0/593715651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f025637c0 con 0x556f0284c7f0 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f0284bb70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2e88013de0 tx=0x7f2e88016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2338755d12612b4f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e957fa640 1 -- 172.21.15.37:0/593715651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88029070 con 0x556f0284c7f0 2024-05-10T08:44:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e957fa640 1 -- 172.21.15.37:0/593715651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8801f050 con 0x556f0284c7f0 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.088+0000 7f2e957fa640 1 -- 172.21.15.37:0/593715651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88003d90 con 0x556f0284c7f0 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 -- 172.21.15.37:0/593715651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 msgr2=0x556f0284bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f0284bb70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2e88013de0 tx=0x7f2e88016000 comp rx=0 tx=0).stop 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 -- 172.21.15.37:0/593715651 shutdown_connections 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c0b0 0x556f02820ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f0284bb70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 --2- 172.21.15.37:0/593715651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0281c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 -- 172.21.15.37:0/593715651 >> 172.21.15.37:0/593715651 conn(0x556f0281e560 msgr2=0x556f02866b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 -- 172.21.15.37:0/593715651 shutdown_connections 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 -- 172.21.15.37:0/593715651 wait complete. 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.089+0000 7f2ea8615740 1 -- start start 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 1 Processor -- start 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f02847430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0287ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028684a0 0x556f02868920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f0278a440 con 0x556f028684a0 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f02785120 con 0x556f0284c7f0 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556f02793210 con 0x556f028696d0 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.090+0000 7f2ea8615740 10 client.0 _ll_register_callbacks cb 0x556f0272a690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028684a0 0x556f02868920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f02847430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028684a0 0x556f02868920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55968/0 (socket says 172.21.15.37:55968) 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3562396995 learned_addr learned my addr 172.21.15.37:0/3562396995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0287ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3562396995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 msgr2=0x556f0287ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0287ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3562396995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 msgr2=0x556f02847430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f02847430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3562396995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f025c3f50 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028684a0 0x556f02868920 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2e98004300 tx=0x7f2e980043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330e4e8b9454ce7e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/3562396995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980168f0 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/3562396995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f2e98016a90 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e8801f050 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/3562396995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f2e98027050 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2ea8615740 10 client.6429 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x556f024570b0 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.091+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/3562396995 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8801f050 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/3562396995 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7f2e9802a020 con 0x556f028684a0 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2ea8615740 10 client.6429 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2ea8615740 10 client.6429 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:44:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2ea8615740 20 client.6429 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f0284cf20 0x556f0284d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2ea8615740 4 client.6429 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f02793a20 con 0x556f0284cf20 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2e9effd640 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f0284cf20 0x556f0284d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2e7e7fc640 10 client.6429 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.092+0000 7f2e9effd640 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f0284cf20 0x556f0284d300 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e19882a6410d4f7 server_cookie=8037c82a1b8fa934 in_seq=0 out_seq=0 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/3562396995 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556f02793a20 con 0x556f0284cf20 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2e7e7fc640 10 client.6429 handle_command_reply: tid=0 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 client.6429 shutdown 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028684a0 msgr2=0x556f02868920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028684a0 0x556f02868920 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2e98004300 tx=0x7f2e980043f0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 shutdown_connections 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f0284cf20 0x556f0284d300 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028684a0 0x556f02868920 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028696d0 0x556f0287ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3562396995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f02847430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2e7e7fc640 0 client.6429 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 >> 172.21.15.37:0/3562396995 conn(0x556f0284c0b0 msgr2=0x556f0281ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 shutdown_connections 2024-05-10T08:44:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 1 -- 172.21.15.37:0/3562396995 wait complete. 2024-05-10T08:44:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.093+0000 7f2ea8615740 20 client.6429 trim_cache size 0 max 16384 2024-05-10T08:44:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 Processor -- start 2024-05-10T08:44:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 -- start start 2024-05-10T08:44:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f0285cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02866e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028696d0 0x556f0285ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0201780 con 0x556f028696d0 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0200b70 con 0x556f0284c7f0 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.107+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea0201130 con 0x556f028684a0 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028696d0 0x556f0285ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028696d0 0x556f0285ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55972/0 (socket says 172.21.15.37:55972) 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3516590268 learned_addr learned my addr 172.21.15.37:0/3516590268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02866e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9effd640 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f0285cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 msgr2=0x556f02866e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02866e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 msgr2=0x556f0285cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f0285cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 -- 172.21.15.37:0/3516590268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f027882b0 con 0x556f028696d0 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9effd640 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f0285cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028696d0 0x556f0285ee70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2e98016e50 tx=0x7f2e98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9289dfdde96bb207 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e94ff9640 1 -- 172.21.15.37:0/3516590268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9802f070 con 0x556f028696d0 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e94ff9640 1 -- 172.21.15.37:0/3516590268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9801b030 con 0x556f028696d0 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.108+0000 7f2e94ff9640 1 -- 172.21.15.37:0/3516590268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98020630 con 0x556f028696d0 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 -- 172.21.15.37:0/3516590268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028696d0 msgr2=0x556f0285ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028696d0 0x556f0285ee70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2e98016e50 tx=0x7f2e98019000 comp rx=0 tx=0).stop 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 -- 172.21.15.37:0/3516590268 shutdown_connections 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f028696d0 0x556f0285ee70 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02866e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 --2- 172.21.15.37:0/3516590268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f0284c7f0 0x556f0285cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 -- 172.21.15.37:0/3516590268 >> 172.21.15.37:0/3516590268 conn(0x556f0284c0b0 msgr2=0x556f02868880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 -- 172.21.15.37:0/3516590268 shutdown_connections 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 -- 172.21.15.37:0/3516590268 wait complete. 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.109+0000 7f2ea8615740 1 -- start start 2024-05-10T08:44:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 1 Processor -- start 2024-05-10T08:44:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f028e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02848d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f028696d0 0x556f028e48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f0285d830 con 0x556f0284c7f0 2024-05-10T08:44:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f0273ba20 con 0x556f028696d0 2024-05-10T08:44:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556f02865d50 con 0x556f028684a0 2024-05-10T08:44:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2ea8615740 10 client.0 _ll_register_callbacks cb 0x7f2e98009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2e9effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f028e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2e9effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f028e1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55988/0 (socket says 172.21.15.37:55988) 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.110+0000 7f2e9effd640 1 -- 172.21.15.37:0/2605417960 learned_addr learned my addr 172.21.15.37:0/2605417960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9f7fe640 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f028696d0 0x556f028e48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02848d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9effd640 1 -- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 msgr2=0x556f02848d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9effd640 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02848d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9effd640 1 -- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f028696d0 msgr2=0x556f028e48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9effd640 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f028696d0 0x556f028e48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9effd640 1 -- 172.21.15.37:0/2605417960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f028495d0 con 0x556f0284c7f0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e9effd640 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f028e1f60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2e90004fd0 tx=0x7f2e90040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f712304c39fceb2f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/2605417960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90080860 con 0x556f0284c7f0 2024-05-10T08:44:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/2605417960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f2e90081da0 con 0x556f0284c7f0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e9801b030 con 0x556f0284c7f0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/2605417960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f2e90084c10 con 0x556f0284c7f0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 10 client.6435 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x556f028e5370 con 0x556f0284c7f0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/2605417960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9801b030 con 0x556f0284c7f0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/2605417960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7f2e9007fac0 con 0x556f0284c7f0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 10 client.6435 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 10 client.6435 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 20 client.6435 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f02866070 0x556f02866450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 4 client.6435 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.111+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x556f0278d890 con 0x556f02866070 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f02866070 0x556f02866450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2e9e7fc640 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f02866070 0x556f02866450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=678b28b6a410dab5 server_cookie=732f9395a447e81c in_seq=0 out_seq=0 2024-05-10T08:44:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2e7e7fc640 10 client.6435 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2e7e7fc640 1 -- 172.21.15.37:0/2605417960 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x556f0278d890 con 0x556f02866070 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2e7e7fc640 10 client.6435 handle_command_reply: tid=0 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 client.6435 shutdown 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 msgr2=0x556f028e1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f028e1f60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2e90004fd0 tx=0x7f2e90040040 comp rx=0 tx=0).stop 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 shutdown_connections 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556f02866070 0x556f02866450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f028696d0 0x556f028e48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556f028684a0 0x556f02848d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2e7e7fc640 0 client.6435 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 --2- 172.21.15.37:0/2605417960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0284c7f0 0x556f028e1f60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 >> 172.21.15.37:0/2605417960 conn(0x556f0284c0b0 msgr2=0x556f0285c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 shutdown_connections 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.112+0000 7f2ea8615740 1 -- 172.21.15.37:0/2605417960 wait complete. 2024-05-10T08:44:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea8615740 20 client.6435 trim_cache size 0 max 16384 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: "damage_type": "dentry", 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 1302193790, 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627776, 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: "frag": "*", 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "file_to_be_damaged", 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_id": "head", 2024-05-10T08:44:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/subdir/file_to_be_damaged" 2024-05-10T08:44:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:44:46.119 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:44:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e80076300 msgr2=0x7f2e800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e80076300 0x7f2e800787c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00baff0 tx=0x7f2e88008040 comp rx=0 tx=0).stop 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 msgr2=0x7f2ea00cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2ea00cb5b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c330 tx=0x7f2ea00b6760 comp rx=0 tx=0).stop 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 shutdown_connections 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2e80076300 0x7f2e800787c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2ea01608b0 0x7f2ea0160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea00b7c50 0x7f2ea0155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 --2- 172.21.15.37:0/1344739658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e8c0039b0 0x7f2ea00cb5b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 >> 172.21.15.37:0/1344739658 conn(0x7f2ea00746d0 msgr2=0x7f2ea006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 shutdown_connections 2024-05-10T08:44:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.113+0000 7f2ea58fc640 1 -- 172.21.15.37:0/1344739658 wait complete. 2024-05-10T08:44:46.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T08:44:46.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.226+0000 7f37199c9640 1 Processor -- start 2024-05-10T08:44:46.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.226+0000 7f37199c9640 1 -- start start 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37199c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37140ce130 0x7f371406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37199c9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37140731c0 0x7f37140735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37199c9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37140b55a0 con 0x7f371415c2d0 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37199c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f37140aed80 con 0x7f37140ce130 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37199c9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3714073b30 con 0x7f37140731c0 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37127fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37140ce130 0x7f371406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37127fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37140ce130 0x7f371406fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55990/0 (socket says 172.21.15.37:55990) 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.227+0000 7f37127fc640 1 -- 172.21.15.37:0/1444404732 learned_addr learned my addr 172.21.15.37:0/1444404732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.228+0000 7f37137fe640 1 --2- 172.21.15.37:0/1444404732 >> v2:172.21.15.82:3300/0 conn(0x7f37140731c0 0x7f37140735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.228+0000 7f37127fc640 1 -- 172.21.15.37:0/1444404732 >> v2:172.21.15.82:3300/0 conn(0x7f37140731c0 msgr2=0x7f37140735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.228+0000 7f37127fc640 1 --2- 172.21.15.37:0/1444404732 >> v2:172.21.15.82:3300/0 conn(0x7f37140731c0 0x7f37140735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.228+0000 7f37127fc640 1 -- 172.21.15.37:0/1444404732 >> v1:172.21.15.82:6789/0 conn(0x7f371415c2d0 legacy=0x7f37140b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.228+0000 7f37127fc640 1 -- 172.21.15.37:0/1444404732 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37140b5880 con 0x7f37140ce130 2024-05-10T08:44:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.228+0000 7f37137fe640 1 --2- 172.21.15.37:0/1444404732 >> v2:172.21.15.82:3300/0 conn(0x7f37140731c0 0x7f37140735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.228+0000 7f37127fc640 1 --2- 172.21.15.37:0/1444404732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37140ce130 0x7f371406fda0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f371409ffa0 tx=0x7f36fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b5ae4d5eb779d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f3711ffb640 1 -- 172.21.15.37:0/1444404732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc037070 con 0x7f37140ce130 2024-05-10T08:44:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f3711ffb640 1 -- 172.21.15.37:0/1444404732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc032440 con 0x7f37140ce130 2024-05-10T08:44:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f3711ffb640 1 -- 172.21.15.37:0/1444404732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc032810 con 0x7f37140ce130 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 -- 172.21.15.37:0/1444404732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37140ce130 msgr2=0x7f371406fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 --2- 172.21.15.37:0/1444404732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37140ce130 0x7f371406fda0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f371409ffa0 tx=0x7f36fc02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 -- 172.21.15.37:0/1444404732 shutdown_connections 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 --2- 172.21.15.37:0/1444404732 >> v2:172.21.15.82:3300/0 conn(0x7f37140731c0 0x7f37140735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 --2- 172.21.15.37:0/1444404732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37140ce130 0x7f371406fda0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 -- 172.21.15.37:0/1444404732 >> 172.21.15.37:0/1444404732 conn(0x7f37140b39a0 msgr2=0x7f37140b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 -- 172.21.15.37:0/1444404732 shutdown_connections 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.229+0000 7f37199c9640 1 -- 172.21.15.37:0/1444404732 wait complete. 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.230+0000 7f37199c9640 1 Processor -- start 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.231+0000 7f37199c9640 1 -- start start 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.231+0000 7f37199c9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37140731c0 0x7f371415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.231+0000 7f37199c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37140ce130 0x7f37140b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.231+0000 7f37199c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371415c2d0 0x7f371414e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.231+0000 7f37199c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3714165cd0 con 0x7f371415c2d0 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.231+0000 7f37199c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37140b5e40 con 0x7f37140ce130 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.231+0000 7f37199c9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3714165e50 con 0x7f37140731c0 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371415c2d0 0x7f371414e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371415c2d0 0x7f371414e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56006/0 (socket says 172.21.15.37:56006) 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 -- 172.21.15.37:0/171844717 learned_addr learned my addr 172.21.15.37:0/171844717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f3712ffd640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37140731c0 0x7f371415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37127fc640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37140ce130 0x7f37140b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 -- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37140731c0 msgr2=0x7f371415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37140731c0 0x7f371415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 -- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37140ce130 msgr2=0x7f37140b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37140ce130 0x7f37140b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 -- 172.21.15.37:0/171844717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371415d230 con 0x7f371415c2d0 2024-05-10T08:44:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37137fe640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371415c2d0 0x7f371414e500 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f370c00e7e0 tx=0x7f370c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f370bfff640 1 -- 172.21.15.37:0/171844717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c00f040 con 0x7f371415c2d0 2024-05-10T08:44:46.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f370bfff640 1 -- 172.21.15.37:0/171844717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f370c004030 con 0x7f371415c2d0 2024-05-10T08:44:46.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f370bfff640 1 -- 172.21.15.37:0/171844717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c0043e0 con 0x7f371415c2d0 2024-05-10T08:44:46.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371415d510 con 0x7f371415c2d0 2024-05-10T08:44:46.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.232+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371415ddb0 con 0x7f371415c2d0 2024-05-10T08:44:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.233+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371415d900 con 0x7f371415c2d0 2024-05-10T08:44:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.234+0000 7f370bfff640 1 -- 172.21.15.37:0/171844717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f370c00c6d0 con 0x7f371415c2d0 2024-05-10T08:44:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.235+0000 7f370bfff640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36f40762d0 0x7f36f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.235+0000 7f370bfff640 1 -- 172.21.15.37:0/171844717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f370c097460 con 0x7f371415c2d0 2024-05-10T08:44:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.235+0000 7f3712ffd640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36f40762d0 0x7f36f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.235+0000 7f3712ffd640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36f40762d0 0x7f36f4078790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3704001e70 tx=0x7f3704009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.239+0000 7f370bfff640 1 -- 172.21.15.37:0/171844717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f370c017020 con 0x7f371415c2d0 2024-05-10T08:44:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.480+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3714069b00 con 0x7f371415c2d0 2024-05-10T08:44:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.480+0000 7f370bfff640 1 -- 172.21.15.37:0/171844717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f370c060580 con 0x7f371415c2d0 2024-05-10T08:44:46.479 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:44:46.479 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-05-10T08:44:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36f40762d0 msgr2=0x7f36f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36f40762d0 0x7f36f4078790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3704001e70 tx=0x7f3704009040 comp rx=0 tx=0).stop 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371415c2d0 msgr2=0x7f371414e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371415c2d0 0x7f371414e500 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f370c00e7e0 tx=0x7f370c00eca0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 shutdown_connections 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36f40762d0 0x7f36f4078790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371415c2d0 0x7f371414e500 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37140ce130 0x7f37140b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 --2- 172.21.15.37:0/171844717 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37140731c0 0x7f371415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 >> 172.21.15.37:0/171844717 conn(0x7f37140b39a0 msgr2=0x7f37140af110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 shutdown_connections 2024-05-10T08:44:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.482+0000 7f37199c9640 1 -- 172.21.15.37:0/171844717 wait complete. 2024-05-10T08:44:46.492 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T08:44:46.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:46.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-05-10T08:44:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.601+0000 7fa12ef04640 1 Processor -- start 2024-05-10T08:44:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.601+0000 7fa12ef04640 1 -- start start 2024-05-10T08:44:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa12ef04640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa12815c7d0 0x7fa1280737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa12ef04640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1280d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa12ef04640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa128072270 con 0x7fa12815c3f0 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa12ef04640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa128072550 con 0x7fa12815c7d0 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa12ef04640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa128072830 con 0x7fa128073d20 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa127fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa12815c7d0 0x7fa1280737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa127fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa12815c7d0 0x7fa1280737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56020/0 (socket says 172.21.15.37:56020) 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa127fff640 1 -- 172.21.15.37:0/1077339122 learned_addr learned my addr 172.21.15.37:0/1077339122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/1077339122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1280d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa127fff640 1 -- 172.21.15.37:0/1077339122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 msgr2=0x7fa1280d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa127fff640 1 --2- 172.21.15.37:0/1077339122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1280d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa127fff640 1 -- 172.21.15.37:0/1077339122 >> v1:172.21.15.82:6789/0 conn(0x7fa12815c3f0 legacy=0x7fa12806ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.602+0000 7fa127fff640 1 -- 172.21.15.37:0/1077339122 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa128072b10 con 0x7fa12815c7d0 2024-05-10T08:44:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.603+0000 7fa127fff640 1 --2- 172.21.15.37:0/1077339122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa1280737e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098a0 tx=0x7fa11402a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49757584574a194 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.603+0000 7fa1277fe640 1 -- 172.21.15.37:0/1077339122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114037070 con 0x7fa12815c7d0 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.603+0000 7fa1277fe640 1 -- 172.21.15.37:0/1077339122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114032440 con 0x7fa12815c7d0 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.603+0000 7fa1277fe640 1 -- 172.21.15.37:0/1077339122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114032810 con 0x7fa12815c7d0 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 -- 172.21.15.37:0/1077339122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 msgr2=0x7fa1280737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 --2- 172.21.15.37:0/1077339122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa1280737e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098a0 tx=0x7fa11402a2e0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 -- 172.21.15.37:0/1077339122 shutdown_connections 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 --2- 172.21.15.37:0/1077339122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1280d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 --2- 172.21.15.37:0/1077339122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa1280737e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 -- 172.21.15.37:0/1077339122 >> 172.21.15.37:0/1077339122 conn(0x7fa12806c3a0 msgr2=0x7fa12806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 -- 172.21.15.37:0/1077339122 shutdown_connections 2024-05-10T08:44:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.604+0000 7fa12ef04640 1 -- 172.21.15.37:0/1077339122 wait complete. 2024-05-10T08:44:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.605+0000 7fa12ef04640 1 Processor -- start 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.605+0000 7fa12ef04640 1 -- start start 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12ef04640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1281e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12ef04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12815c3f0 0x7fa128158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12ef04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa128158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12ef04640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa12806f110 con 0x7fa12815c7d0 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12ef04640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa128073310 con 0x7fa12815c3f0 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12ef04640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa1280d1130 con 0x7fa128073d20 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa128158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa128158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56036/0 (socket says 172.21.15.37:56036) 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3466248204 learned_addr learned my addr 172.21.15.37:0/3466248204 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12cca0640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1281e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 msgr2=0x7fa1281e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1281e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12815c3f0 msgr2=0x7fa128158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa127fff640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12815c3f0 0x7fa128158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12815c3f0 0x7fa128158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3466248204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa128157950 con 0x7fa12815c7d0 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.606+0000 7fa12cca0640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1281e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.607+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa128158aa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa120007e70 tx=0x7fa12000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.607+0000 7fa1257fa640 1 -- 172.21.15.37:0/3466248204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120014420 con 0x7fa12815c7d0 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.607+0000 7fa1257fa640 1 -- 172.21.15.37:0/3466248204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120019070 con 0x7fa12815c7d0 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.607+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1281590d0 con 0x7fa12815c7d0 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.607+0000 7fa1257fa640 1 -- 172.21.15.37:0/3466248204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120014820 con 0x7fa12815c7d0 2024-05-10T08:44:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.607+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1281e53f0 con 0x7fa12815c7d0 2024-05-10T08:44:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.609+0000 7fa1257fa640 1 -- 172.21.15.37:0/3466248204 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1200149c0 con 0x7fa12815c7d0 2024-05-10T08:44:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.610+0000 7fa1257fa640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa10c0762d0 0x7fa10c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.610+0000 7fa1257fa640 1 -- 172.21.15.37:0/3466248204 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fa120098030 con 0x7fa12815c7d0 2024-05-10T08:44:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.610+0000 7fa12cca0640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa10c0762d0 0x7fa10c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.610+0000 7fa131c16740 1 Processor -- start 2024-05-10T08:44:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.610+0000 7fa131c16740 1 -- start start 2024-05-10T08:44:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.610+0000 7fa12cca0640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa10c0762d0 0x7fa10c078790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa11c003eb0 tx=0x7fa11c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f57195a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f57193cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa131c16740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa131c16740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f570f7ef0 con 0x560f571be390 2024-05-10T08:44:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560f570b1010 con 0x560f571cffa0 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x560f570f3eb0 con 0x560f571938d0 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56050/0 (socket says 172.21.15.37:56050) 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 -- 172.21.15.37:0/1685064810 learned_addr learned my addr 172.21.15.37:0/1685064810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12cca0640 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f57195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa127fff640 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f57193cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 -- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 msgr2=0x560f57195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f57195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 -- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 msgr2=0x560f57193cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f57193cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 -- 172.21.15.37:0/1685064810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f56ed1a50 con 0x560f571be390 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa127fff640 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f57193cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.611+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571be810 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa12005d730 tx=0x7fa1200609b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a74efe3dcc7fca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa1127fc640 1 -- 172.21.15.37:0/1685064810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12007a020 con 0x560f571be390 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa1127fc640 1 -- 172.21.15.37:0/1685064810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120061140 con 0x560f571be390 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa1127fc640 1 -- 172.21.15.37:0/1685064810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1200654f0 con 0x560f571be390 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 -- 172.21.15.37:0/1685064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 msgr2=0x560f571be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571be810 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa12005d730 tx=0x7fa1200609b0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 -- 172.21.15.37:0/1685064810 shutdown_connections 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571be810 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f57193cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 --2- 172.21.15.37:0/1685064810 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f57195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 -- 172.21.15.37:0/1685064810 >> 172.21.15.37:0/1685064810 conn(0x560f5715b3e0 msgr2=0x560f571d9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 -- 172.21.15.37:0/1685064810 shutdown_connections 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.612+0000 7fa131c16740 1 -- 172.21.15.37:0/1685064810 wait complete. 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.613+0000 7fa131c16740 1 -- start start 2024-05-10T08:44:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.613+0000 7fa131c16740 1 Processor -- start 2024-05-10T08:44:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa131c16740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571938d0 0x560f571bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571cffa0 0x560f571ab790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa131c16740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f570b4b40 con 0x560f571938d0 2024-05-10T08:44:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560f571bbee0 con 0x560f571be390 2024-05-10T08:44:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x560f571c1a10 con 0x560f571cffa0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa131c16740 10 client.0 _ll_register_callbacks cb 0x560f570a1b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571938d0 0x560f571bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571938d0 0x560f571bb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56054/0 (socket says 172.21.15.37:56054) 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 -- 172.21.15.37:0/265234048 learned_addr learned my addr 172.21.15.37:0/265234048 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa127fff640 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571cffa0 0x560f571ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 -- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571cffa0 msgr2=0x560f571ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571cffa0 0x560f571ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 -- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 msgr2=0x560f571d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571d3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 -- 172.21.15.37:0/265234048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f56dc93e0 con 0x560f571938d0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa12cca0640 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571938d0 0x560f571bb080 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00dfa0 tx=0x7fa11c003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0d24162945bb8c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.614+0000 7fa1077fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa1077fe640 1 -- 172.21.15.37:0/265234048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c024030 con 0x560f571938d0 2024-05-10T08:44:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa1077fe640 1 -- 172.21.15.37:0/265234048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fa11c01d040 con 0x560f571938d0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa120061140 con 0x560f571938d0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa1077fe640 1 -- 172.21.15.37:0/265234048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa11c02d050 con 0x560f571938d0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 10 client.6453 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x560f56f321e0 con 0x560f571938d0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa1077fe640 1 -- 172.21.15.37:0/265234048 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120061140 con 0x560f571938d0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa1077fe640 1 -- 172.21.15.37:0/265234048 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7fa11c030020 con 0x560f571938d0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 10 client.6453 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 10 client.6453 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 20 client.6453 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f571be7d0 0x560f571bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 4 client.6453 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f57105b00 con 0x560f571be7d0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.615+0000 7fa127fff640 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f571be7d0 0x560f571bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa127fff640 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f571be7d0 0x560f571bec10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99db14dd1503883e server_cookie=f32f3413734ed3b8 in_seq=0 out_seq=0 2024-05-10T08:44:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa1077fe640 10 client.6453 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa1077fe640 1 -- 172.21.15.37:0/265234048 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560f57105b00 con 0x560f571be7d0 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa1077fe640 10 client.6453 handle_command_reply: tid=0 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 client.6453 shutdown 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571938d0 msgr2=0x560f571bb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571938d0 0x560f571bb080 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00dfa0 tx=0x7fa11c003760 comp rx=0 tx=0).stop 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 shutdown_connections 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f571be7d0 0x560f571bec10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571cffa0 0x560f571ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa1077fe640 0 client.6453 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.616+0000 7fa131c16740 1 --2- 172.21.15.37:0/265234048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571938d0 0x560f571bb080 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.617+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 >> 172.21.15.37:0/265234048 conn(0x560f5715b3e0 msgr2=0x560f571bc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.617+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 shutdown_connections 2024-05-10T08:44:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.617+0000 7fa131c16740 1 -- 172.21.15.37:0/265234048 wait complete. 2024-05-10T08:44:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.617+0000 7fa131c16740 20 client.6453 trim_cache size 0 max 16384 2024-05-10T08:44:46.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 Processor -- start 2024-05-10T08:44:46.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 -- start start 2024-05-10T08:44:46.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571cffa0 0x560f571ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1281ffca0 con 0x560f571cffa0 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa1281fec80 con 0x560f571be390 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa1281e6c10 con 0x560f571938d0 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa12d4a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571cffa0 0x560f571ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa12d4a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571cffa0 0x560f571ebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56070/0 (socket says 172.21.15.37:56070) 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.636+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3260108459 learned_addr learned my addr 172.21.15.37:0/3260108459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 msgr2=0x560f571bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa12cca0640 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 msgr2=0x560f571b9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa127fff640 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571b9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa12d4a1640 1 -- 172.21.15.37:0/3260108459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f56da24a0 con 0x560f571cffa0 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571cffa0 0x560f571ebb70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa12005d730 tx=0x7fa120063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4324495afa0810c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa111ffb640 1 -- 172.21.15.37:0/3260108459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12007a040 con 0x560f571cffa0 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa111ffb640 1 -- 172.21.15.37:0/3260108459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120061140 con 0x560f571cffa0 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.637+0000 7fa111ffb640 1 -- 172.21.15.37:0/3260108459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120069f10 con 0x560f571cffa0 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 -- 172.21.15.37:0/3260108459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571cffa0 msgr2=0x560f571ebb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571cffa0 0x560f571ebb70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa12005d730 tx=0x7fa120063000 comp rx=0 tx=0).stop 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 -- 172.21.15.37:0/3260108459 shutdown_connections 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571cffa0 0x560f571ebb70 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571be390 0x560f571b9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 --2- 172.21.15.37:0/3260108459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 -- 172.21.15.37:0/3260108459 >> 172.21.15.37:0/3260108459 conn(0x560f5715b3e0 msgr2=0x560f571db6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 -- 172.21.15.37:0/3260108459 shutdown_connections 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 -- 172.21.15.37:0/3260108459 wait complete. 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 -- start start 2024-05-10T08:44:46.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.638+0000 7fa131c16740 1 Processor -- start 2024-05-10T08:44:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571c0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa131c16740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa131c16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f571bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa131c16740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f571fd650 con 0x560f571be390 2024-05-10T08:44:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa1281fe610 con 0x560f571cffa0 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa131c16740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x560f571d5fb0 con 0x560f571938d0 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa131c16740 10 client.0 _ll_register_callbacks cb 0x7fa11c00dc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa127fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa127fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571bbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56072/0 (socket says 172.21.15.37:56072) 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa127fff640 1 -- 172.21.15.37:0/519239488 learned_addr learned my addr 172.21.15.37:0/519239488 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa12cca0640 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.639+0000 7fa12d4a1640 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f571bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa127fff640 1 -- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 msgr2=0x560f571c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa127fff640 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa127fff640 1 -- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 msgr2=0x560f571bc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa127fff640 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f571bc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa127fff640 1 -- 172.21.15.37:0/519239488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f571ebc90 con 0x560f571be390 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa127fff640 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571bbeb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa11402a8d0 tx=0x7fa11402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe2a62c52909690 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa1077fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa1077fe640 1 -- 172.21.15.37:0/519239488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11404c060 con 0x560f571be390 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa1077fe640 1 -- 172.21.15.37:0/519239488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fa114046420 con 0x560f571be390 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa120061140 con 0x560f571be390 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa1077fe640 1 -- 172.21.15.37:0/519239488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa114052050 con 0x560f571be390 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 10 client.6459 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x560f571cfb00 con 0x560f571be390 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa1077fe640 1 -- 172.21.15.37:0/519239488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120061140 con 0x560f571be390 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa1077fe640 1 -- 172.21.15.37:0/519239488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7fa114055020 con 0x560f571be390 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 10 client.6459 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 10 client.6459 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 20 client.6459 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f5725f050 0x560f571ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 4 client.6459 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.640+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) -- 0x560f570ff970 con 0x560f5725f050 2024-05-10T08:44:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.641+0000 7fa12cca0640 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f5725f050 0x560f571ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.641+0000 7fa1077fe640 10 client.6459 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.641+0000 7fa12cca0640 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f5725f050 0x560f571ced20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d359fc21240b2dd2 server_cookie=afa3521fd83ede9a in_seq=0 out_seq=0 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa1077fe640 1 -- 172.21.15.37:0/519239488 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f570ff970 con 0x560f5725f050 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa1077fe640 10 client.6459 handle_command_reply: tid=0 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 client.6459 shutdown 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 msgr2=0x560f571bbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571bbeb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa11402a8d0 tx=0x7fa11402c070 comp rx=0 tx=0).stop 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 shutdown_connections 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x560f5725f050 0x560f571ced20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f571cffa0 0x560f571bc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f571be390 0x560f571bbeb0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 --2- 172.21.15.37:0/519239488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x560f571938d0 0x560f571c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa1077fe640 0 client.6459 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 >> 172.21.15.37:0/519239488 conn(0x560f5715b3e0 msgr2=0x560f571d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 shutdown_connections 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 1 -- 172.21.15.37:0/519239488 wait complete. 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa131c16740 20 client.6459 trim_cache size 0 max 16384 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "8c8fa85c-61c6-49e0-bb94-9c37183412a1", 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:44:46.647 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:44:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa10c0762d0 msgr2=0x7fa10c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa12ef04640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa10c0762d0 0x7fa10c078790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa11c003eb0 tx=0x7fa11c009040 comp rx=0 tx=0).stop 2024-05-10T08:44:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 msgr2=0x7fa128158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.642+0000 7fa12ef04640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa128158aa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa120007e70 tx=0x7fa12000e4b0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 shutdown_connections 2024-05-10T08:44:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa10c0762d0 0x7fa10c078790 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12815c7d0 0x7fa128158aa0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa12815c3f0 0x7fa128158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 --2- 172.21.15.37:0/3466248204 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa128073d20 0x7fa1281e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 >> 172.21.15.37:0/3466248204 conn(0x7fa12806c3a0 msgr2=0x7fa12815f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 shutdown_connections 2024-05-10T08:44:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.643+0000 7fa12ef04640 1 -- 172.21.15.37:0/3466248204 wait complete. 2024-05-10T08:44:46.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:44:46.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T08:44:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.760+0000 7f70ca90a640 1 Processor -- start 2024-05-10T08:44:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.760+0000 7f70ca90a640 1 -- start start 2024-05-10T08:44:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.760+0000 7f70ca90a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70c41629b0 0x7f70c406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70ca90a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f70c40b2490 0x7f70c4070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70ca90a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c406e110 con 0x7f70c4070d20 2024-05-10T08:44:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70ca90a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f70c406dec0 con 0x7f70c41629b0 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70ca90a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f70c406e3f0 con 0x7f70c40b2490 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70c41629b0 0x7f70c406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70c41629b0 0x7f70c406eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56082/0 (socket says 172.21.15.37:56082) 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c3fff640 1 -- 172.21.15.37:0/1060639850 learned_addr learned my addr 172.21.15.37:0/1060639850 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c37fe640 1 --2- 172.21.15.37:0/1060639850 >> v2:172.21.15.82:3300/0 conn(0x7f70c40b2490 0x7f70c4070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c3fff640 1 -- 172.21.15.37:0/1060639850 >> v2:172.21.15.82:3300/0 conn(0x7f70c40b2490 msgr2=0x7f70c4070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c3fff640 1 --2- 172.21.15.37:0/1060639850 >> v2:172.21.15.82:3300/0 conn(0x7f70c40b2490 0x7f70c4070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c3fff640 1 -- 172.21.15.37:0/1060639850 >> v1:172.21.15.82:6789/0 conn(0x7f70c4070d20 legacy=0x7f70c40afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c3fff640 1 -- 172.21.15.37:0/1060639850 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c406e6d0 con 0x7f70c41629b0 2024-05-10T08:44:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.761+0000 7f70c37fe640 1 --2- 172.21.15.37:0/1060639850 >> v2:172.21.15.82:3300/0 conn(0x7f70c40b2490 0x7f70c4070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70c3fff640 1 --2- 172.21.15.37:0/1060639850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c406eed0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f70c40b8fb0 tx=0x7f70b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb5783eff00c320 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70c2ffd640 1 -- 172.21.15.37:0/1060639850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4037070 con 0x7f70c41629b0 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70c2ffd640 1 -- 172.21.15.37:0/1060639850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b4032440 con 0x7f70c41629b0 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70c2ffd640 1 -- 172.21.15.37:0/1060639850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4032810 con 0x7f70c41629b0 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70ca90a640 1 -- 172.21.15.37:0/1060639850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 msgr2=0x7f70c406eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70ca90a640 1 --2- 172.21.15.37:0/1060639850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c406eed0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f70c40b8fb0 tx=0x7f70b402a270 comp rx=0 tx=0).stop 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70ca90a640 1 -- 172.21.15.37:0/1060639850 shutdown_connections 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70ca90a640 1 --2- 172.21.15.37:0/1060639850 >> v2:172.21.15.82:3300/0 conn(0x7f70c40b2490 0x7f70c4070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70ca90a640 1 --2- 172.21.15.37:0/1060639850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c406eed0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.762+0000 7f70ca90a640 1 -- 172.21.15.37:0/1060639850 >> 172.21.15.37:0/1060639850 conn(0x7f70c40b49d0 msgr2=0x7f70c40b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.763+0000 7f70ca90a640 1 -- 172.21.15.37:0/1060639850 shutdown_connections 2024-05-10T08:44:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.763+0000 7f70ca90a640 1 -- 172.21.15.37:0/1060639850 wait complete. 2024-05-10T08:44:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.764+0000 7f70ca90a640 1 Processor -- start 2024-05-10T08:44:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.764+0000 7f70ca90a640 1 -- start start 2024-05-10T08:44:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70ca90a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c4070d20 0x7f70c4153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70ca90a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70c40b2490 0x7f70c40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70ca90a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c40c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70ca90a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70c4070870 con 0x7f70c41629b0 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70ca90a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70c406f410 con 0x7f70c4070d20 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70ca90a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f70c40709f0 con 0x7f70c40b2490 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c40c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c40c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56086/0 (socket says 172.21.15.37:56086) 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 -- 172.21.15.37:0/2321281809 learned_addr learned my addr 172.21.15.37:0/2321281809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c37fe640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70c40b2490 0x7f70c40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c3fff640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c4070d20 0x7f70c4153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 -- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70c40b2490 msgr2=0x7f70c40c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70c40b2490 0x7f70c40c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 -- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c4070d20 msgr2=0x7f70c4153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c4070d20 0x7f70c4153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 -- 172.21.15.37:0/2321281809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40b76c0 con 0x7f70c41629b0 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c3fff640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c4070d20 0x7f70c4153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:44:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c40c8920 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c7d0 tx=0x7f70bc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c0ff9640 1 -- 172.21.15.37:0/2321281809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc003b70 con 0x7f70c41629b0 2024-05-10T08:44:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.765+0000 7f70c0ff9640 1 -- 172.21.15.37:0/2321281809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc003d30 con 0x7f70c41629b0 2024-05-10T08:44:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.766+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c40b79a0 con 0x7f70c41629b0 2024-05-10T08:44:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.766+0000 7f70c0ff9640 1 -- 172.21.15.37:0/2321281809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc00aa90 con 0x7f70c41629b0 2024-05-10T08:44:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.766+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c40b7f60 con 0x7f70c41629b0 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.768+0000 7f70c0ff9640 1 -- 172.21.15.37:0/2321281809 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f70bc00ac30 con 0x7f70c41629b0 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.768+0000 7f70c0ff9640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f70b00762d0 0x7f70b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.768+0000 7f70c0ff9640 1 -- 172.21.15.37:0/2321281809 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f70bc097630 con 0x7f70c41629b0 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.769+0000 7f70c3fff640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f70b00762d0 0x7f70b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.769+0000 7f70cd624740 1 Processor -- start 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.769+0000 7f70cd624740 1 -- start start 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.769+0000 7f70c3fff640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f70b00762d0 0x7f70b0078790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f70b4034000 tx=0x7f70b402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70cd624740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf15af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf45600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf45b40 0x5565acf1a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70cd624740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565acee2690 con 0x5565acf63160 2024-05-10T08:44:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565ace7ff30 con 0x5565acf45b40 2024-05-10T08:44:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5565ace38b20 con 0x5565acf46280 2024-05-10T08:44:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf15af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf15af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56094/0 (socket says 172.21.15.37:56094) 2024-05-10T08:44:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 -- 172.21.15.37:0/2995748930 learned_addr learned my addr 172.21.15.37:0/2995748930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c37fe640 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf45600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf45b40 0x5565acf1a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 -- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 msgr2=0x5565acf45600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf45600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 -- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf45b40 msgr2=0x5565acf1a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf45b40 0x5565acf1a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 -- 172.21.15.37:0/2995748930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565ace30e60 con 0x5565acf63160 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70c3fff640 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf15af0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f70b402a860 tx=0x7f70b4008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3791ee543d24de3a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70a9ffb640 1 -- 172.21.15.37:0/2995748930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b404e070 con 0x5565acf63160 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70a9ffb640 1 -- 172.21.15.37:0/2995748930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b4032d20 con 0x5565acf63160 2024-05-10T08:44:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.770+0000 7f70a9ffb640 1 -- 172.21.15.37:0/2995748930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4037040 con 0x5565acf63160 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 -- 172.21.15.37:0/2995748930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 msgr2=0x5565acf15af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf15af0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f70b402a860 tx=0x7f70b4008030 comp rx=0 tx=0).stop 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 -- 172.21.15.37:0/2995748930 shutdown_connections 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf45b40 0x5565acf1a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf45600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 --2- 172.21.15.37:0/2995748930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf15af0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 -- 172.21.15.37:0/2995748930 >> 172.21.15.37:0/2995748930 conn(0x5565acf17d60 msgr2=0x5565acf60600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 -- 172.21.15.37:0/2995748930 shutdown_connections 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.771+0000 7f70cd624740 1 -- 172.21.15.37:0/2995748930 wait complete. 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.772+0000 7f70cd624740 1 -- start start 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.772+0000 7f70cd624740 1 Processor -- start 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf61f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf63160 0x5565acf572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf32b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565ace3c5e0 con 0x5565acf57800 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565ace7bef0 con 0x5565acf63160 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5565acf19f10 con 0x5565acf46280 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 10 client.0 _ll_register_callbacks cb 0x5565ace37320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf32b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf32b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56096/0 (socket says 172.21.15.37:56096) 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 -- 172.21.15.37:0/957036304 learned_addr learned my addr 172.21.15.37:0/957036304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c3fff640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf61f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c37fe640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf63160 0x5565acf572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 -- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 msgr2=0x5565acf61f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf61f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 -- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf63160 msgr2=0x5565acf572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf63160 0x5565acf572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 -- 172.21.15.37:0/957036304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565acc5b7d0 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c37fe640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf63160 0x5565acf572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf32b10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c7a0 tx=0x7f70bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93521e059b1be0bf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70a2ffd640 1 -- 172.21.15.37:0/957036304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc079020 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70a2ffd640 1 -- 172.21.15.37:0/957036304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f70bc05c020 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.773+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b4032d20 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70a2ffd640 1 -- 172.21.15.37:0/957036304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f70bc060db0 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 10 client.6471 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x5565acb913f0 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70a2ffd640 1 -- 172.21.15.37:0/957036304 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b4032d20 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70a2ffd640 1 -- 172.21.15.37:0/957036304 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7f70bc08eb20 con 0x5565acf57800 2024-05-10T08:44:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 10 client.6471 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 10 client.6471 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 20 client.6471 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf33980 0x5565acf33d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 4 client.6471 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565ace8db40 con 0x5565acf33980 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70c3fff640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf33980 0x5565acf33d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70a2ffd640 10 client.6471 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.774+0000 7f70c3fff640 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf33980 0x5565acf33d60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb72c209687ac74e server_cookie=991356c7a501d660 in_seq=0 out_seq=0 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70a2ffd640 1 -- 172.21.15.37:0/957036304 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5565ace8db40 con 0x5565acf33980 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70a2ffd640 10 client.6471 handle_command_reply: tid=0 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 client.6471 shutdown 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 msgr2=0x5565acf32b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf32b10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c7a0 tx=0x7f70bc012000 comp rx=0 tx=0).stop 2024-05-10T08:44:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 shutdown_connections 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf33980 0x5565acf33d60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf32b10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf63160 0x5565acf572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70a2ffd640 0 client.6471 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 --2- 172.21.15.37:0/957036304 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf46280 0x5565acf61f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 >> 172.21.15.37:0/957036304 conn(0x5565acf45b40 msgr2=0x5565acf195e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 shutdown_connections 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 1 -- 172.21.15.37:0/957036304 wait complete. 2024-05-10T08:44:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.775+0000 7f70cd624740 20 client.6471 trim_cache size 0 max 16384 2024-05-10T08:44:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.793+0000 7f70cd624740 1 Processor -- start 2024-05-10T08:44:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.793+0000 7f70cd624740 1 -- start start 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70cd624740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf49170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf63160 0x5565acf496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70cd624740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70c4202010 con 0x5565acf57800 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70c4201090 con 0x5565acf46280 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f70c40c7880 con 0x5565acf63160 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf49170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf49170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56112/0 (socket says 172.21.15.37:56112) 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70c37fe640 1 -- 172.21.15.37:0/982603881 learned_addr learned my addr 172.21.15.37:0/982603881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70c37fe640 1 -- 172.21.15.37:0/982603881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf63160 msgr2=0x5565acf496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70c37fe640 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf63160 0x5565acf496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.794+0000 7f70c37fe640 1 -- 172.21.15.37:0/982603881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 msgr2=0x5565acf169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70c3fff640 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70c37fe640 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf169e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70c37fe640 1 -- 172.21.15.37:0/982603881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565acb510f0 con 0x5565acf57800 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70c37fe640 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf49170 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009940 tx=0x7f70b8009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd14c8b14ab7a6f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70a97fa640 1 -- 172.21.15.37:0/982603881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b801b070 con 0x5565acf57800 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70a97fa640 1 -- 172.21.15.37:0/982603881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b8004230 con 0x5565acf57800 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70a97fa640 1 -- 172.21.15.37:0/982603881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b800f040 con 0x5565acf57800 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70cd624740 1 -- 172.21.15.37:0/982603881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 msgr2=0x5565acf49170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.795+0000 7f70cd624740 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf49170 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009940 tx=0x7f70b8009e00 comp rx=0 tx=0).stop 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 -- 172.21.15.37:0/982603881 shutdown_connections 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf63160 0x5565acf496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf57800 0x5565acf49170 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 --2- 172.21.15.37:0/982603881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 -- 172.21.15.37:0/982603881 >> 172.21.15.37:0/982603881 conn(0x5565acf45b40 msgr2=0x5565acf195e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 -- 172.21.15.37:0/982603881 shutdown_connections 2024-05-10T08:44:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 -- 172.21.15.37:0/982603881 wait complete. 2024-05-10T08:44:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 -- start start 2024-05-10T08:44:46.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.796+0000 7f70cd624740 1 Processor -- start 2024-05-10T08:44:46.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf1a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70cd624740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf57800 0x5565acfe1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70cd624740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf14a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70cd624740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70c4200a40 con 0x5565acf63160 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565acf33d60 con 0x5565acf46280 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70cd624740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5565acf1aba0 con 0x5565acf57800 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70cd624740 10 client.0 _ll_register_callbacks cb 0x7f70bc05cdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70c8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf14a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70c8ea7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf14a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56124/0 (socket says 172.21.15.37:56124) 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70c8ea7640 1 -- 172.21.15.37:0/342174276 learned_addr learned my addr 172.21.15.37:0/342174276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70c37fe640 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf57800 0x5565acfe1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.797+0000 7f70c3fff640 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf1a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.798+0000 7f70c8ea7640 1 -- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf57800 msgr2=0x5565acfe1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.798+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf57800 0x5565acfe1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.798+0000 7f70c8ea7640 1 -- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 msgr2=0x5565acf1a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:44:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.798+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf1a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.798+0000 7f70c8ea7640 1 -- 172.21.15.37:0/342174276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565acf477a0 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.798+0000 7f70c8ea7640 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf14a10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f70bc060640 tx=0x7f70bc095850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d697e67fc2df8d9c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.798+0000 7f70a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70a2ffd640 1 -- 172.21.15.37:0/342174276 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc079040 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70a2ffd640 1 -- 172.21.15.37:0/342174276 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f70bc05c220 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b8004230 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70a2ffd640 1 -- 172.21.15.37:0/342174276 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f70bc05fe20 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 10 client.6477 fetch_fsmap learned FSMap version 51 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x5565acfe1580 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70a2ffd640 1 -- 172.21.15.37:0/342174276 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b8004230 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70a2ffd640 1 -- 172.21.15.37:0/342174276 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 3494+0+0 (secure 0 0 0) 0x7f70bc05f380 con 0x5565acf63160 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 10 client.6477 fetch_fsmap finished waiting for FSMap version 51 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 10 client.6477 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:44:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 20 client.6477 populate_metadata read hostname 'smithi037' 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf63a20 0x5565acf601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 4 client.6477 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565ace879b0 con 0x5565acf63a20 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.800+0000 7f70c3fff640 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf63a20 0x5565acf601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70a2ffd640 10 client.6477 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70c3fff640 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf63a20 0x5565acf601c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9250f35037eae866 server_cookie=4ed7f5f1cd49456d in_seq=0 out_seq=0 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70a2ffd640 1 -- 172.21.15.37:0/342174276 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x5565ace879b0 con 0x5565acf63a20 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70a2ffd640 10 client.6477 handle_command_reply: tid=0 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 client.6477 shutdown 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 msgr2=0x5565acf14a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf14a10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f70bc060640 tx=0x7f70bc095850 comp rx=0 tx=0).stop 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 shutdown_connections 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x5565acf63a20 0x5565acf601c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565acf63160 0x5565acf14a10 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5565acf57800 0x5565acfe1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 --2- 172.21.15.37:0/342174276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565acf46280 0x5565acf1a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70a2ffd640 0 client.6477 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 >> 172.21.15.37:0/342174276 conn(0x5565acf45b40 msgr2=0x5565acf49170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 shutdown_connections 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 1 -- 172.21.15.37:0/342174276 wait complete. 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.801+0000 7f70cd624740 20 client.6477 trim_cache size 0 max 16384 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:44:46.805 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:44:46.806 INFO:teuthology.orchestra.run.smithi037.stdout: "8c8fa85c-61c6-49e0-bb94-9c37183412a1": { 2024-05-10T08:44:46.806 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/subdir", 2024-05-10T08:44:46.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "8c8fa85c-61c6-49e0-bb94-9c37183412a1", 2024-05-10T08:44:46.806 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2024-05-10T08:44:46.806 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:44:46.806 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:44:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f70b00762d0 msgr2=0x7f70b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f70b00762d0 0x7f70b0078790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f70b4034000 tx=0x7f70b402e000 comp rx=0 tx=0).stop 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 msgr2=0x7f70c40c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c40c8920 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c7d0 tx=0x7f70bc00cc90 comp rx=0 tx=0).stop 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 shutdown_connections 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f70b00762d0 0x7f70b0078790 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c41629b0 0x7f70c40c8920 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f70c40b2490 0x7f70c40c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 --2- 172.21.15.37:0/2321281809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c4070d20 0x7f70c4153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:44:46.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 >> 172.21.15.37:0/2321281809 conn(0x7f70c40b49d0 msgr2=0x7f70c4161930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:44:46.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 shutdown_connections 2024-05-10T08:44:46.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:44:46.802+0000 7f70ca90a640 1 -- 172.21.15.37:0/2321281809 wait complete. 2024-05-10T08:44:46.812 INFO:tasks.cephfs.filesystem:scrub status for tag:8c8fa85c-61c6-49e0-bb94-9c37183412a1 - {'path': '/subdir', 'tag': '8c8fa85c-61c6-49e0-bb94-9c37183412a1', 'options': 'recursive,repair'} 2024-05-10T08:44:53.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:44:53.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:45:16.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:16.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-05-10T08:45:16.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.933+0000 7f8e7ff9d640 1 Processor -- start 2024-05-10T08:45:16.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.934+0000 7f8e7ff9d640 1 -- start start 2024-05-10T08:45:16.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7ff9d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e7815f420 0x7f8e780d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7ff9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e780d2080 0x7f8e780d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7ff9d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e781630b0 con 0x7f8e780d3ca0 2024-05-10T08:45:16.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7ff9d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8e780d2550 con 0x7f8e780d2080 2024-05-10T08:45:16.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7ff9d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8e780d2c80 con 0x7f8e7815f420 2024-05-10T08:45:16.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7e53a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e780d2080 0x7f8e780d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7e53a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e780d2080 0x7f8e780d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45042/0 (socket says 172.21.15.37:45042) 2024-05-10T08:45:16.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1267296748 learned_addr learned my addr 172.21.15.37:0/1267296748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:16.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/1267296748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e7815f420 0x7f8e780d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1267296748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e7815f420 msgr2=0x7f8e780d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/1267296748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e7815f420 0x7f8e780d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1267296748 >> v1:172.21.15.82:6789/0 conn(0x7f8e780d3ca0 legacy=0x7f8e780d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.935+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1267296748 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e780d2f60 con 0x7f8e780d2080 2024-05-10T08:45:16.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.936+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/1267296748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e780d2080 0x7f8e780d4cc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009e50 tx=0x7f8e7002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a793923df480b901 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:16.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.936+0000 7f8e7cd37640 1 -- 172.21.15.37:0/1267296748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70036070 con 0x7f8e780d2080 2024-05-10T08:45:16.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.936+0000 7f8e7cd37640 1 -- 172.21.15.37:0/1267296748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70031600 con 0x7f8e780d2080 2024-05-10T08:45:16.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.936+0000 7f8e7cd37640 1 -- 172.21.15.37:0/1267296748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700319d0 con 0x7f8e780d2080 2024-05-10T08:45:16.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/1267296748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e780d2080 msgr2=0x7f8e780d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/1267296748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e780d2080 0x7f8e780d4cc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009e50 tx=0x7f8e7002a710 comp rx=0 tx=0).stop 2024-05-10T08:45:16.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/1267296748 shutdown_connections 2024-05-10T08:45:16.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/1267296748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e780d2080 0x7f8e780d4cc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/1267296748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e7815f420 0x7f8e780d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/1267296748 >> 172.21.15.37:0/1267296748 conn(0x7f8e7808eac0 msgr2=0x7f8e7809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:16.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/1267296748 shutdown_connections 2024-05-10T08:45:16.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.937+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/1267296748 wait complete. 2024-05-10T08:45:16.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.938+0000 7f8e7ff9d640 1 Processor -- start 2024-05-10T08:45:16.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.938+0000 7f8e7ff9d640 1 -- start start 2024-05-10T08:45:16.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7ff9d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e780d2080 0x7f8e780cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7ff9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e781e9e80 0x7f8e780c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7ff9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e78159810 0x7f8e780d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7ff9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780d5200 con 0x7f8e78159810 2024-05-10T08:45:16.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7ff9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780d2830 con 0x7f8e781e9e80 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7ff9d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8e780d5380 con 0x7f8e780d2080 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e78159810 0x7f8e780d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e78159810 0x7f8e780d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45056/0 (socket says 172.21.15.37:45056) 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 -- 172.21.15.37:0/692438640 learned_addr learned my addr 172.21.15.37:0/692438640 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e780d2080 0x7f8e780cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7d538640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e781e9e80 0x7f8e780c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 -- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e780d2080 msgr2=0x7f8e780cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e780d2080 0x7f8e780cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 -- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e781e9e80 msgr2=0x7f8e780c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e781e9e80 0x7f8e780c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 -- 172.21.15.37:0/692438640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e780ca410 con 0x7f8e78159810 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.939+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e78159810 0x7f8e780d0b30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009f70 tx=0x7f8e70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.940+0000 7f8e6e7fc640 1 -- 172.21.15.37:0/692438640 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7003f020 con 0x7f8e78159810 2024-05-10T08:45:16.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.940+0000 7f8e6e7fc640 1 -- 172.21.15.37:0/692438640 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70037040 con 0x7f8e78159810 2024-05-10T08:45:16.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.940+0000 7f8e6e7fc640 1 -- 172.21.15.37:0/692438640 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70036070 con 0x7f8e78159810 2024-05-10T08:45:16.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.940+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e780ca6f0 con 0x7f8e78159810 2024-05-10T08:45:16.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.940+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e780cacb0 con 0x7f8e78159810 2024-05-10T08:45:16.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.941+0000 7f8e6e7fc640 1 -- 172.21.15.37:0/692438640 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e70042020 con 0x7f8e78159810 2024-05-10T08:45:16.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.942+0000 7f8e6e7fc640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8e5c076300 0x7f8e5c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.942+0000 7f8e6e7fc640 1 -- 172.21.15.37:0/692438640 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8e700b7b00 con 0x7f8e78159810 2024-05-10T08:45:16.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.942+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8e5c076300 0x7f8e5c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.943+0000 7f8e82d94740 1 Processor -- start 2024-05-10T08:45:16.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.943+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8e5c076300 0x7f8e5c0787c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8e781e8ca0 tx=0x7f8e74008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:16.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.943+0000 7f8e82d94740 1 -- start start 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5e1280 0x55f61e5e0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e0b40 0x55f61e5b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e82d94740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f61e57d690 con 0x55f61e5e0b40 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f61e51af30 con 0x55f61e5e1280 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f61e4d3b20 con 0x55f61e5fe160 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e0b40 0x55f61e5b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e0b40 0x55f61e5b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45068/0 (socket says 172.21.15.37:45068) 2024-05-10T08:45:16.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1653632357 learned_addr learned my addr 172.21.15.37:0/1653632357 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7d538640 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5e1280 0x55f61e5e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 msgr2=0x55f61e5b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5e1280 msgr2=0x55f61e5e0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5e1280 0x55f61e5e0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 -- 172.21.15.37:0/1653632357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f61e4cbe60 con 0x55f61e5e0b40 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7d538640 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5e1280 0x55f61e5e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e0b40 0x55f61e5b5950 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8e7007ccb0 tx=0x7f8e70080640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2661a4a90fb2157 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/1653632357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700892a0 con 0x55f61e5e0b40 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/1653632357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7009a070 con 0x55f61e5e0b40 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.944+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/1653632357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700896e0 con 0x55f61e5e0b40 2024-05-10T08:45:16.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 -- 172.21.15.37:0/1653632357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e0b40 msgr2=0x55f61e5b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e0b40 0x55f61e5b5950 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8e7007ccb0 tx=0x7f8e70080640 comp rx=0 tx=0).stop 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 -- 172.21.15.37:0/1653632357 shutdown_connections 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e0b40 0x55f61e5b5950 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5e1280 0x55f61e5e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1653632357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 -- 172.21.15.37:0/1653632357 >> 172.21.15.37:0/1653632357 conn(0x55f61e5b2d60 msgr2=0x55f61e5fb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 -- 172.21.15.37:0/1653632357 shutdown_connections 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.945+0000 7f8e82d94740 1 -- 172.21.15.37:0/1653632357 wait complete. 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.946+0000 7f8e82d94740 1 -- start start 2024-05-10T08:45:16.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.946+0000 7f8e82d94740 1 Processor -- start 2024-05-10T08:45:16.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5db490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e60b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e5e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f61e4d75e0 con 0x55f61e5e1280 2024-05-10T08:45:16.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f61e516ef0 con 0x55f61e5dbff0 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f61e57d690 con 0x55f61e5fe160 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 10 client.0 _ll_register_callbacks cb 0x55f61e4d2320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5db490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5db490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45080/0 (socket says 172.21.15.37:45080) 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 -- 172.21.15.37:0/793463589 learned_addr learned my addr 172.21.15.37:0/793463589 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 -- 172.21.15.37:0/793463589 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 msgr2=0x55f61e60b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e60b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 -- 172.21.15.37:0/793463589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 msgr2=0x55f61e5e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e5e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 -- 172.21.15.37:0/793463589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f61e2f67d0 con 0x55f61e5e1280 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5db490 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8e74016780 tx=0x7f8e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e5c3b1f59107a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e58ff9640 1 -- 172.21.15.37:0/793463589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74026020 con 0x55f61e5e1280 2024-05-10T08:45:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e58ff9640 1 -- 172.21.15.37:0/793463589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8e740149b0 con 0x55f61e5e1280 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.947+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e7009a070 con 0x55f61e5e1280 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e58ff9640 1 -- 172.21.15.37:0/793463589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8e7401c030 con 0x55f61e5e1280 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 10 client.6489 fetch_fsmap learned FSMap version 52 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55f61e22c3f0 con 0x55f61e5e1280 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e58ff9640 1 -- 172.21.15.37:0/793463589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7009a070 con 0x55f61e5e1280 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e58ff9640 1 -- 172.21.15.37:0/793463589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f8e74033080 con 0x55f61e5e1280 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 10 client.6489 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 10 client.6489 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 20 client.6489 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e5e4440 0x55f61e5fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 4 client.6489 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f61e528b40 con 0x55f61e5e4440 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e7d538640 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e5e4440 0x55f61e5fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e7d538640 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e5e4440 0x55f61e5fcc00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607ba29627f16c92 server_cookie=3b4e8783540c36a5 in_seq=0 out_seq=0 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.948+0000 7f8e58ff9640 10 client.6489 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e58ff9640 1 -- 172.21.15.37:0/793463589 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f61e528b40 con 0x55f61e5e4440 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e58ff9640 10 client.6489 handle_command_reply: tid=0 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 client.6489 shutdown 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 msgr2=0x55f61e5db490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5db490 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8e74016780 tx=0x7f8e740046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 shutdown_connections 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e5e4440 0x55f61e5fcc00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e5e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e60b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e58ff9640 0 client.6489 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 --2- 172.21.15.37:0/793463589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5db490 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 >> 172.21.15.37:0/793463589 conn(0x55f61e5e0b40 msgr2=0x55f61e5b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 shutdown_connections 2024-05-10T08:45:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.949+0000 7f8e82d94740 1 -- 172.21.15.37:0/793463589 wait complete. 2024-05-10T08:45:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.950+0000 7f8e82d94740 20 client.6489 trim_cache size 0 max 16384 2024-05-10T08:45:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 Processor -- start 2024-05-10T08:45:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 -- start start 2024-05-10T08:45:16.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e61dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5d9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5d9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e782020a0 con 0x55f61e5e1280 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e782010c0 con 0x55f61e5dbff0 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.968+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8e780c96a0 con 0x55f61e5fe160 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5d9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45090/0 (socket says 172.21.15.37:45090) 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 -- 172.21.15.37:0/130496368 learned_addr learned my addr 172.21.15.37:0/130496368 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5d9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 -- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 msgr2=0x55f61e5d9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e61dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5d9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 -- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 msgr2=0x55f61e61dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e61dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 -- 172.21.15.37:0/130496368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f61e5b3ea0 con 0x55f61e5e1280 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5d9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e61dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e7d538640 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5d9900 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8e780d3ae0 tx=0x7f8e680188d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ce5c683cf42e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e5affd640 1 -- 172.21.15.37:0/130496368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68004b60 con 0x55f61e5e1280 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e5affd640 1 -- 172.21.15.37:0/130496368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e68004d00 con 0x55f61e5e1280 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.969+0000 7f8e5affd640 1 -- 172.21.15.37:0/130496368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68004eb0 con 0x55f61e5e1280 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 -- 172.21.15.37:0/130496368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 msgr2=0x55f61e5d9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5d9900 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8e780d3ae0 tx=0x7f8e680188d0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 -- 172.21.15.37:0/130496368 shutdown_connections 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5fe160 0x55f61e5d9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5e1280 0x55f61e5d9900 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 --2- 172.21.15.37:0/130496368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5dbff0 0x55f61e61dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 -- 172.21.15.37:0/130496368 >> 172.21.15.37:0/130496368 conn(0x55f61e5e0b40 msgr2=0x55f61e5b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:16.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 -- 172.21.15.37:0/130496368 shutdown_connections 2024-05-10T08:45:16.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 -- 172.21.15.37:0/130496368 wait complete. 2024-05-10T08:45:16.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.970+0000 7f8e82d94740 1 -- start start 2024-05-10T08:45:16.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 1 Processor -- start 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5dbff0 0x55f61e614790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5e1280 0x55f61e5db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5fe160 0x55f61e5db7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f61e5fd0e0 con 0x55f61e5dbff0 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e78200a70 con 0x55f61e5fe160 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55f61e5dac00 con 0x55f61e5e1280 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.971+0000 7f8e82d94740 10 client.0 _ll_register_callbacks cb 0x7f8e74007650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:16.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5dbff0 0x55f61e614790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5dbff0 0x55f61e614790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45094/0 (socket says 172.21.15.37:45094) 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 -- 172.21.15.37:0/1308777722 learned_addr learned my addr 172.21.15.37:0/1308777722 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7d538640 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5e1280 0x55f61e5db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7e53a640 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5fe160 0x55f61e5db7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 -- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5e1280 msgr2=0x55f61e5db2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5e1280 0x55f61e5db2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 -- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5fe160 msgr2=0x55f61e5db7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5fe160 0x55f61e5db7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 -- 172.21.15.37:0/1308777722 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f61e1ec0f0 con 0x55f61e5dbff0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e7dd39640 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5dbff0 0x55f61e614790 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8e74014830 tx=0x7f8e74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4492b57165429299 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e58ff9640 1 -- 172.21.15.37:0/1308777722 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74026070 con 0x55f61e5dbff0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e58ff9640 1 -- 172.21.15.37:0/1308777722 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f8e74005ba0 con 0x55f61e5dbff0 2024-05-10T08:45:16.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e68004d00 con 0x55f61e5dbff0 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e58ff9640 1 -- 172.21.15.37:0/1308777722 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8e74042050 con 0x55f61e5dbff0 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.972+0000 7f8e82d94740 10 client.6495 fetch_fsmap learned FSMap version 52 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55f61e5dd9a0 con 0x55f61e5dbff0 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e58ff9640 1 -- 172.21.15.37:0/1308777722 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e68004d00 con 0x55f61e5dbff0 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e58ff9640 1 -- 172.21.15.37:0/1308777722 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f8e74039030 con 0x55f61e5dbff0 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 10 client.6495 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 10 client.6495 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 20 client.6495 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e6764e0 0x55f61e678d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 4 client.6495 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f61e5f3310 con 0x55f61e6764e0 2024-05-10T08:45:16.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e7d538640 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e6764e0 0x55f61e678d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e7d538640 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e6764e0 0x55f61e678d80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5aa90d4cba37e5 server_cookie=82b5c9d9ced8f6fd in_seq=0 out_seq=0 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e58ff9640 10 client.6495 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e58ff9640 1 -- 172.21.15.37:0/1308777722 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f61e5f3310 con 0x55f61e6764e0 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e58ff9640 10 client.6495 handle_command_reply: tid=0 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.973+0000 7f8e82d94740 1 client.6495 shutdown 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5dbff0 msgr2=0x55f61e614790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5dbff0 0x55f61e614790 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8e74014830 tx=0x7f8e74017000 comp rx=0 tx=0).stop 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 shutdown_connections 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x55f61e6764e0 0x55f61e678d80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f61e5fe160 0x55f61e5db7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55f61e5e1280 0x55f61e5db2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e58ff9640 0 client.6495 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 --2- 172.21.15.37:0/1308777722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f61e5dbff0 0x55f61e614790 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 >> 172.21.15.37:0/1308777722 conn(0x55f61e5e0b40 msgr2=0x55f61e5b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:16.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 shutdown_connections 2024-05-10T08:45:16.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 1 -- 172.21.15.37:0/1308777722 wait complete. 2024-05-10T08:45:16.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e82d94740 20 client.6495 trim_cache size 0 max 16384 2024-05-10T08:45:16.980 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:45:16.980 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:45:16.980 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:45:16.980 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:45:16.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8e5c076300 msgr2=0x7f8e5c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8e5c076300 0x7f8e5c0787c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8e781e8ca0 tx=0x7f8e74008040 comp rx=0 tx=0).stop 2024-05-10T08:45:16.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e78159810 msgr2=0x7f8e780d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e78159810 0x7f8e780d0b30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009f70 tx=0x7f8e70004a40 comp rx=0 tx=0).stop 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 shutdown_connections 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8e5c076300 0x7f8e5c0787c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e78159810 0x7f8e780d0b30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e781e9e80 0x7f8e780c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 --2- 172.21.15.37:0/692438640 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e780d2080 0x7f8e780cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.974+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 >> 172.21.15.37:0/692438640 conn(0x7f8e7808eac0 msgr2=0x7f8e780b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.975+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 shutdown_connections 2024-05-10T08:45:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:16.975+0000 7f8e7ff9d640 1 -- 172.21.15.37:0/692438640 wait complete. 2024-05-10T08:45:16.985 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:45:16.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.090+0000 7fc1510d9640 1 Processor -- start 2024-05-10T08:45:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.090+0000 7fc1510d9640 1 -- start start 2024-05-10T08:45:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc1510d9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc14c06fc30 0x7fc14c0af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc1510d9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c0b48a0 0x7fc14c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc1510d9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14c0701d0 con 0x7fc14c157540 2024-05-10T08:45:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc1510d9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc14c0b01c0 con 0x7fc14c06fc30 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc1510d9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c0b3dc0 con 0x7fc14c0b48a0 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14b59e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c0b48a0 0x7fc14c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc14c06fc30 0x7fc14c0af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14ad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc14c157540 0x7fc14c15e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:55204/0 (socket says 172.21.15.37:55204) 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14ad9d640 1 -- 172.21.15.37:0/2365854787 learned_addr learned my addr 172.21.15.37:0/2365854787 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14a59c640 1 -- 172.21.15.37:0/2365854787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c0b48a0 msgr2=0x7fc14c0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14a59c640 1 --2- 172.21.15.37:0/2365854787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c0b48a0 0x7fc14c0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14a59c640 1 -- 172.21.15.37:0/2365854787 >> v1:172.21.15.82:6789/0 conn(0x7fc14c157540 legacy=0x7fc14c15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.091+0000 7fc14a59c640 1 -- 172.21.15.37:0/2365854787 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c0b40a0 con 0x7fc14c06fc30 2024-05-10T08:45:17.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.092+0000 7fc14a59c640 1 --2- 172.21.15.37:0/2365854787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c06fc30 0x7fc14c0af740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097a0 tx=0x7fc14002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=931bc11fb9db95b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.092+0000 7fc149d9b640 1 -- 172.21.15.37:0/2365854787 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140037070 con 0x7fc14c06fc30 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.092+0000 7fc149d9b640 1 -- 172.21.15.37:0/2365854787 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc140032440 con 0x7fc14c06fc30 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.092+0000 7fc149d9b640 1 -- 172.21.15.37:0/2365854787 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140032810 con 0x7fc14c06fc30 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 -- 172.21.15.37:0/2365854787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c06fc30 msgr2=0x7fc14c0af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2365854787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c06fc30 0x7fc14c0af740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097a0 tx=0x7fc14002a180 comp rx=0 tx=0).stop 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 -- 172.21.15.37:0/2365854787 shutdown_connections 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2365854787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c0b48a0 0x7fc14c0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2365854787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c06fc30 0x7fc14c0af740 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 -- 172.21.15.37:0/2365854787 >> 172.21.15.37:0/2365854787 conn(0x7fc14c06c3a0 msgr2=0x7fc14c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 -- 172.21.15.37:0/2365854787 shutdown_connections 2024-05-10T08:45:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.093+0000 7fc1510d9640 1 -- 172.21.15.37:0/2365854787 wait complete. 2024-05-10T08:45:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.094+0000 7fc1510d9640 1 Processor -- start 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.094+0000 7fc1510d9640 1 -- start start 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc1510d9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c06fc30 0x7fc14c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc1510d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc14c0b48a0 0x7fc14c14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc1510d9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c157540 0x7fc14c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc1510d9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c157aa0 con 0x7fc14c0b48a0 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc1510d9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c157920 con 0x7fc14c157540 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc1510d9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c0ced20 con 0x7fc14c06fc30 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc14a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc14c0b48a0 0x7fc14c14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc14a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc14c0b48a0 0x7fc14c14fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45110/0 (socket says 172.21.15.37:45110) 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.095+0000 7fc14a59c640 1 -- 172.21.15.37:0/2237127111 learned_addr learned my addr 172.21.15.37:0/2237127111 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14ad9d640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c06fc30 0x7fc14c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14b59e640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c157540 0x7fc14c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14a59c640 1 -- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c06fc30 msgr2=0x7fc14c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14a59c640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c06fc30 0x7fc14c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14a59c640 1 -- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c157540 msgr2=0x7fc14c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14a59c640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c157540 0x7fc14c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14a59c640 1 -- 172.21.15.37:0/2237127111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c0ce760 con 0x7fc14c0b48a0 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14b59e640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c157540 0x7fc14c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc14a59c640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc14c0b48a0 0x7fc14c14fdd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc14002a1c0 tx=0x7fc1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc1337fe640 1 -- 172.21.15.37:0/2237127111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140041020 con 0x7fc14c0b48a0 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc1337fe640 1 -- 172.21.15.37:0/2237127111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc140030700 con 0x7fc14c0b48a0 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c0cea40 con 0x7fc14c0b48a0 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc1337fe640 1 -- 172.21.15.37:0/2237127111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140037040 con 0x7fc14c0b48a0 2024-05-10T08:45:17.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.096+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c15eba0 con 0x7fc14c0b48a0 2024-05-10T08:45:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.097+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14c15e6f0 con 0x7fc14c0b48a0 2024-05-10T08:45:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.098+0000 7fc1337fe640 1 -- 172.21.15.37:0/2237127111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc140044020 con 0x7fc14c0b48a0 2024-05-10T08:45:17.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.098+0000 7fc1337fe640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1380762d0 0x7fc138078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.099+0000 7fc1337fe640 1 -- 172.21.15.37:0/2237127111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fc1400b7f90 con 0x7fc14c0b48a0 2024-05-10T08:45:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.099+0000 7fc14ad9d640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1380762d0 0x7fc138078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.099+0000 7fc14ad9d640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1380762d0 0x7fc138078790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc13c000f60 tx=0x7fc13c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.103+0000 7fc1337fe640 1 -- 172.21.15.37:0/2237127111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc14004b030 con 0x7fc14c0b48a0 2024-05-10T08:45:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.333+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc14c0693f0 con 0x7fc14c0b48a0 2024-05-10T08:45:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.334+0000 7fc1337fe640 1 -- 172.21.15.37:0/2237127111 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5182 (secure 0 0 0) 0x7fc1400817a0 con 0x7fc14c0b48a0 2024-05-10T08:45:17.333 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:17.333 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:50.735103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":14,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":5}]} 2024-05-10T08:45:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 52 2024-05-10T08:45:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1380762d0 msgr2=0x7fc138078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1380762d0 0x7fc138078790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc13c000f60 tx=0x7fc13c009040 comp rx=0 tx=0).stop 2024-05-10T08:45:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc14c0b48a0 msgr2=0x7fc14c14fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc14c0b48a0 0x7fc14c14fdd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc14002a1c0 tx=0x7fc1400046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 shutdown_connections 2024-05-10T08:45:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1380762d0 0x7fc138078790 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14c157540 0x7fc14c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc14c0b48a0 0x7fc14c14fdd0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 --2- 172.21.15.37:0/2237127111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc14c06fc30 0x7fc14c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 >> 172.21.15.37:0/2237127111 conn(0x7fc14c06c3a0 msgr2=0x7fc14c0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 shutdown_connections 2024-05-10T08:45:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.336+0000 7fc1510d9640 1 -- 172.21.15.37:0/2237127111 wait complete. 2024-05-10T08:45:17.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-05-10T08:45:17.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.453+0000 7fb2e3646640 1 Processor -- start 2024-05-10T08:45:17.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.453+0000 7fb2e3646640 1 -- start start 2024-05-10T08:45:17.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2e3646640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2e3646640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2dc06e110 con 0x7fb2dc0b2490 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2e3646640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2dc06e3f0 con 0x7fb2dc070d20 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2e3646640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb2dc070a40 con 0x7fb2dc1629b0 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2e0be1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb2dc0b2490 0x7fb2dc070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40864/0 (socket says 172.21.15.37:40864) 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2e0be1640 1 -- 172.21.15.37:0/960068651 learned_addr learned my addr 172.21.15.37:0/960068651 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/960068651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106936779 0 0) 0x7fb2dc06e110 con 0x7fb2dc0b2490 2024-05-10T08:45:17.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2c8003520 con 0x7fb2dc0b2490 2024-05-10T08:45:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521189743 0 0) 0x7fb2dc06e3f0 con 0x7fb2dc070d20 2024-05-10T08:45:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.454+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2dc06e110 con 0x7fb2dc070d20 2024-05-10T08:45:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.455+0000 7fb2e13e2640 1 -- 172.21.15.37:0/960068651 >> v1:172.21.15.82:6789/0 conn(0x7fb2dc070d20 legacy=0x7fb2dc0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.455+0000 7fb2e13e2640 1 -- 172.21.15.37:0/960068651 >> v1:172.21.15.37:6789/0 conn(0x7fb2dc0b2490 legacy=0x7fb2dc070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.455+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1548387287 0 0) 0x7fb2c8003520 con 0x7fb2dc0b2490 2024-05-10T08:45:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.455+0000 7fb2e13e2640 1 -- 172.21.15.37:0/960068651 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc06e6d0 con 0x7fb2dc1629b0 2024-05-10T08:45:17.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.455+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/960068651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc06eed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097d0 tx=0x7fb2d802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51aa6f5dd27a09a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8037070 con 0x7fb2dc1629b0 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d802ac30 con 0x7fb2dc1629b0 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2d3fff640 1 -- 172.21.15.37:0/960068651 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc001670 con 0x7fb2dc1629b0 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2e3646640 1 -- 172.21.15.37:0/960068651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 msgr2=0x7fb2dc06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2e3646640 1 --2- 172.21.15.37:0/960068651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc06eed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097d0 tx=0x7fb2d802a1a0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2e3646640 1 -- 172.21.15.37:0/960068651 shutdown_connections 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2e3646640 1 --2- 172.21.15.37:0/960068651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc06eed0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2e3646640 1 -- 172.21.15.37:0/960068651 >> 172.21.15.37:0/960068651 conn(0x7fb2dc0b49d0 msgr2=0x7fb2dc0b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2e3646640 1 -- 172.21.15.37:0/960068651 shutdown_connections 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.456+0000 7fb2e3646640 1 -- 172.21.15.37:0/960068651 wait complete. 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.457+0000 7fb2e3646640 1 Processor -- start 2024-05-10T08:45:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e3646640 1 -- start start 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e3646640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2dc070d20 0x7fb2dc0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e3646640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2dc0b2490 0x7fb2dc0c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e3646640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc0c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e3646640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc06f410 con 0x7fb2dc070d20 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e3646640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc06dec0 con 0x7fb2dc0b2490 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e3646640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb2dc0b03c0 con 0x7fb2dc1629b0 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e13e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2dc070d20 0x7fb2dc0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e13e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2dc070d20 0x7fb2dc0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45124/0 (socket says 172.21.15.37:45124) 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e13e2640 1 -- 172.21.15.37:0/217733253 learned_addr learned my addr 172.21.15.37:0/217733253 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.458+0000 7fb2e1be3640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc0c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2dc0b2490 0x7fb2dc0c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e13e2640 1 -- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 msgr2=0x7fb2dc0c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc0c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e13e2640 1 -- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2dc0b2490 msgr2=0x7fb2dc0c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2dc0b2490 0x7fb2dc0c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e13e2640 1 -- 172.21.15.37:0/217733253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc1f5020 con 0x7fb2dc070d20 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2dc0b2490 0x7fb2dc0c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2dc070d20 0x7fb2dc0c8f00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097d0 tx=0x7fb2d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2d1ffb640 1 -- 172.21.15.37:0/217733253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8041020 con 0x7fb2dc070d20 2024-05-10T08:45:17.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2d1ffb640 1 -- 172.21.15.37:0/217733253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d803d640 con 0x7fb2dc070d20 2024-05-10T08:45:17.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2dc0c7410 con 0x7fb2dc070d20 2024-05-10T08:45:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2d1ffb640 1 -- 172.21.15.37:0/217733253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8037040 con 0x7fb2dc070d20 2024-05-10T08:45:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.459+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2dc0c79d0 con 0x7fb2dc070d20 2024-05-10T08:45:17.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.461+0000 7fb2d1ffb640 1 -- 172.21.15.37:0/217733253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2d8044020 con 0x7fb2dc070d20 2024-05-10T08:45:17.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.462+0000 7fb2d1ffb640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2c00762d0 0x7fb2c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.462+0000 7fb2d1ffb640 1 -- 172.21.15.37:0/217733253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb2d80b7d30 con 0x7fb2dc070d20 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.462+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2c00762d0 0x7fb2c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.462+0000 7fb2e6434740 1 Processor -- start 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.462+0000 7fb2e6434740 1 -- start start 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.462+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2c00762d0 0x7fb2c0078790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc1f93a0 tx=0x7fb2cc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786e06d0 0x556b786932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c37f0 0x556b786c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c30b0 0x556b78697ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e6434740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b78583920 con 0x556b786c37f0 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556b785f8dd0 con 0x556b786e06d0 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556b785a93e0 con 0x556b786c30b0 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c37f0 0x556b786c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c37f0 0x556b786c2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45134/0 (socket says 172.21.15.37:45134) 2024-05-10T08:45:17.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1128388748 learned_addr learned my addr 172.21.15.37:0/1128388748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786e06d0 0x556b786932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e1be3640 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c30b0 0x556b78697ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c30b0 msgr2=0x556b78697ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c30b0 0x556b78697ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786e06d0 msgr2=0x556b786932f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786e06d0 0x556b786932f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.463+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1128388748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b783da7c0 con 0x556b786c37f0 2024-05-10T08:45:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c37f0 0x556b786c2b70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc005a40 tx=0x7fb2cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb58e43084b816b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2c6ffd640 1 -- 172.21.15.37:0/1128388748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0070d0 con 0x556b786c37f0 2024-05-10T08:45:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2c6ffd640 1 -- 172.21.15.37:0/1128388748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc007270 con 0x556b786c37f0 2024-05-10T08:45:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2c6ffd640 1 -- 172.21.15.37:0/1128388748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc007620 con 0x556b786c37f0 2024-05-10T08:45:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 -- 172.21.15.37:0/1128388748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c37f0 msgr2=0x556b786c2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c37f0 0x556b786c2b70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc005a40 tx=0x7fb2cc001e70 comp rx=0 tx=0).stop 2024-05-10T08:45:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 -- 172.21.15.37:0/1128388748 shutdown_connections 2024-05-10T08:45:17.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c30b0 0x556b78697ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c37f0 0x556b786c2b70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1128388748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786e06d0 0x556b786932f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 -- 172.21.15.37:0/1128388748 >> 172.21.15.37:0/1128388748 conn(0x556b78695560 msgr2=0x556b786ddb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.464+0000 7fb2e6434740 1 -- 172.21.15.37:0/1128388748 shutdown_connections 2024-05-10T08:45:17.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.465+0000 7fb2e6434740 1 -- 172.21.15.37:0/1128388748 wait complete. 2024-05-10T08:45:17.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.465+0000 7fb2e6434740 1 -- start start 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.465+0000 7fb2e6434740 1 Processor -- start 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786e06d0 0x556b786c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786deca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e6434740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b78601440 con 0x556b786e06d0 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556b785fc120 con 0x556b786c1100 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556b7860a210 con 0x556b786c37f0 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e6434740 10 client.0 _ll_register_callbacks cb 0x556b785a1690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786e06d0 0x556b786c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786e06d0 0x556b786c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45138/0 (socket says 172.21.15.37:45138) 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1160060070 learned_addr learned my addr 172.21.15.37:0/1160060070 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e1be3640 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 msgr2=0x556b786b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.466+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 msgr2=0x556b786deca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786deca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e0be1640 1 -- 172.21.15.37:0/1160060070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b7843af50 con 0x556b786e06d0 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786e06d0 0x556b786c0bc0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc001e40 tx=0x7fb2cc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227cae054517831e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2bbfff640 1 -- 172.21.15.37:0/1160060070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0070d0 con 0x556b786e06d0 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2bbfff640 1 -- 172.21.15.37:0/1160060070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb2cc013420 con 0x556b786e06d0 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2cc007270 con 0x556b786e06d0 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2bbfff640 1 -- 172.21.15.37:0/1160060070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fb2cc013620 con 0x556b786e06d0 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 10 client.6510 fetch_fsmap learned FSMap version 52 2024-05-10T08:45:17.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x556b782ce0b0 con 0x556b786e06d0 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2bbfff640 1 -- 172.21.15.37:0/1160060070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc007270 con 0x556b786e06d0 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2bbfff640 1 -- 172.21.15.37:0/1160060070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7fb2cc0137c0 con 0x556b786e06d0 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 10 client.6510 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 10 client.6510 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 20 client.6510 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786c2050 0x556b786c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 4 client.6510 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b7860aa20 con 0x556b786c2050 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.467+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786c2050 0x556b786c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.468+0000 7fb2bbfff640 10 client.6510 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.468+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786c2050 0x556b786c2430 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f90613d017fbb41 server_cookie=bf77801e7f1d75e7 in_seq=0 out_seq=0 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.468+0000 7fb2bbfff640 1 -- 172.21.15.37:0/1160060070 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fb2d80b5c70 con 0x556b786c2050 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.468+0000 7fb2bbfff640 10 client.6510 handle_command_reply: tid=0 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.468+0000 7fb2e6434740 1 client.6510 shutdown 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.468+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786e06d0 msgr2=0x556b786c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.468+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786e06d0 0x556b786c0bc0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc001e40 tx=0x7fb2cc011000 comp rx=0 tx=0).stop 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 shutdown_connections 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786c2050 0x556b786c2430 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2bbfff640 0 client.6510 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786e06d0 0x556b786c0bc0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 --2- 172.21.15.37:0/1160060070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 >> 172.21.15.37:0/1160060070 conn(0x556b786c30b0 msgr2=0x556b78692a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 shutdown_connections 2024-05-10T08:45:17.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 1 -- 172.21.15.37:0/1160060070 wait complete. 2024-05-10T08:45:17.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.469+0000 7fb2e6434740 20 client.6510 trim_cache size 0 max 16384 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.482+0000 7fb2e6434740 1 Processor -- start 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.482+0000 7fb2e6434740 1 -- start start 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c1100 0x556b78754000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b786dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c37f0 0x556b786ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e6434740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc200f80 con 0x556b786c2050 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc0cc840 con 0x556b786c37f0 2024-05-10T08:45:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb2dc200930 con 0x556b786c1100 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b786dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b786dd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45140/0 (socket says 172.21.15.37:45140) 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3058684303 learned_addr learned my addr 172.21.15.37:0/3058684303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c1100 0x556b78754000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e1be3640 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c37f0 0x556b786ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c1100 msgr2=0x556b78754000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.483+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c1100 0x556b78754000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c37f0 msgr2=0x556b786ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c37f0 0x556b786ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3058684303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b786dfaa0 con 0x556b786c2050 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e1be3640 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c37f0 0x556b786ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b786dd970 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00e5a0 tx=0x7fb2cc017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14a2f8695c64303 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2c67fc640 1 -- 172.21.15.37:0/3058684303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc013420 con 0x556b786c2050 2024-05-10T08:45:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2c67fc640 1 -- 172.21.15.37:0/3058684303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc007630 con 0x556b786c2050 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2c67fc640 1 -- 172.21.15.37:0/3058684303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0070d0 con 0x556b786c2050 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e6434740 1 -- 172.21.15.37:0/3058684303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 msgr2=0x556b786dd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b786dd970 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00e5a0 tx=0x7fb2cc017070 comp rx=0 tx=0).stop 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e6434740 1 -- 172.21.15.37:0/3058684303 shutdown_connections 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c37f0 0x556b786ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b786dd970 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3058684303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c1100 0x556b78754000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.484+0000 7fb2e6434740 1 -- 172.21.15.37:0/3058684303 >> 172.21.15.37:0/3058684303 conn(0x556b786c30b0 msgr2=0x556b786b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.485+0000 7fb2e6434740 1 -- 172.21.15.37:0/3058684303 shutdown_connections 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.485+0000 7fb2e6434740 1 -- 172.21.15.37:0/3058684303 wait complete. 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.485+0000 7fb2e6434740 1 -- start start 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.485+0000 7fb2e6434740 1 Processor -- start 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786ed490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b78750340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e6434740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e6434740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b786c4ac0 con 0x556b786c2050 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556b785b2a20 con 0x556b786c1100 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e6434740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556b786c3d60 con 0x556b786c37f0 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e6434740 10 client.0 _ll_register_callbacks cb 0x7fb2d80069c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b78750340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b78750340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45144/0 (socket says 172.21.15.37:45144) 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3661786942 learned_addr learned my addr 172.21.15.37:0/3661786942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e1be3640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 msgr2=0x556b786e0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786e0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 msgr2=0x556b786ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e0be1640 1 -- 172.21.15.37:0/3661786942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b786dea10 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.486+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e0be1640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b78750340 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00ec40 tx=0x7fb2cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d500f2bc8e800af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2bbfff640 1 -- 172.21.15.37:0/3661786942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc03c030 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2bbfff640 1 -- 172.21.15.37:0/3661786942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb2cc029040 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2cc007630 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2bbfff640 1 -- 172.21.15.37:0/3661786942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fb2cc045050 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 10 client.6516 fetch_fsmap learned FSMap version 52 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x556b786c1520 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2bbfff640 1 -- 172.21.15.37:0/3661786942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc007630 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2bbfff640 1 -- 172.21.15.37:0/3661786942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7fb2cc048020 con 0x556b786c2050 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 10 client.6516 fetch_fsmap finished waiting for FSMap version 52 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 10 client.6516 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:45:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 20 client.6516 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786e06d0 0x556b786efd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 4 client.6516 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 --> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x556b78604890 con 0x556b786e06d0 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.487+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786e06d0 0x556b786efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e13e2640 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786e06d0 0x556b786efd60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ce3cea14cbb183 server_cookie=efb8aab84ac18add in_seq=0 out_seq=0 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2bbfff640 10 client.6516 ms_handle_connect on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2bbfff640 1 -- 172.21.15.37:0/3661786942 <== mds.0 v2:172.21.15.37:6833/3086098191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b78604890 con 0x556b786e06d0 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2bbfff640 10 client.6516 handle_command_reply: tid=0 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 client.6516 shutdown 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 msgr2=0x556b78750340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b78750340 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00ec40 tx=0x7fb2cc000ed0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 shutdown_connections 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:6833/3086098191,v1:172.21.15.37:6835/3086098191] conn(0x556b786e06d0 0x556b786efd60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556b786c37f0 0x556b786e0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b786c2050 0x556b78750340 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2bbfff640 0 client.6516 ms_handle_reset on v2:172.21.15.37:6833/3086098191 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 --2- 172.21.15.37:0/3661786942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b786c1100 0x556b786ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 >> 172.21.15.37:0/3661786942 conn(0x556b786c30b0 msgr2=0x556b78698880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 shutdown_connections 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 1 -- 172.21.15.37:0/3661786942 wait complete. 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.488+0000 7fb2e6434740 20 client.6516 trim_cache size 0 max 16384 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:17.495 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-10T08:45:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2c00762d0 msgr2=0x7fb2c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2c00762d0 0x7fb2c0078790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc1f93a0 tx=0x7fb2cc009040 comp rx=0 tx=0).stop 2024-05-10T08:45:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2dc070d20 msgr2=0x7fb2dc0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2dc070d20 0x7fb2dc0c8f00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097d0 tx=0x7fb2d80046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 shutdown_connections 2024-05-10T08:45:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2c00762d0 0x7fb2c0078790 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2dc1629b0 0x7fb2dc0c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2dc0b2490 0x7fb2dc0c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 --2- 172.21.15.37:0/217733253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2dc070d20 0x7fb2dc0c8f00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 >> 172.21.15.37:0/217733253 conn(0x7fb2dc0b49d0 msgr2=0x7fb2dc070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 shutdown_connections 2024-05-10T08:45:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.489+0000 7fb2e3646640 1 -- 172.21.15.37:0/217733253 wait complete. 2024-05-10T08:45:17.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T08:45:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.602+0000 7fb9191f7640 1 Processor -- start 2024-05-10T08:45:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.602+0000 7fb9191f7640 1 -- start start 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb9191f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9140d0590 0x7fb9140ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb9191f7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9140ce610 0x7fb9140709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb9191f7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9140d15c0 con 0x7fb9141606d0 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb9191f7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb9140d18a0 con 0x7fb9140d0590 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb9191f7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb9140d1b80 con 0x7fb9140ce610 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb90a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9140d0590 0x7fb9140ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb912d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9141606d0 0x7fb9140cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40874/0 (socket says 172.21.15.37:40874) 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb912d9d640 1 -- 172.21.15.37:0/3556008364 learned_addr learned my addr 172.21.15.37:0/3556008364 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb91359e640 1 --2- 172.21.15.37:0/3556008364 >> v2:172.21.15.82:3300/0 conn(0x7fb9140ce610 0x7fb9140709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb90a59c640 1 -- 172.21.15.37:0/3556008364 >> v2:172.21.15.82:3300/0 conn(0x7fb9140ce610 msgr2=0x7fb9140709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb90a59c640 1 --2- 172.21.15.37:0/3556008364 >> v2:172.21.15.82:3300/0 conn(0x7fb9140ce610 0x7fb9140709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb90a59c640 1 -- 172.21.15.37:0/3556008364 >> v1:172.21.15.37:6789/0 conn(0x7fb9141606d0 legacy=0x7fb9140cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.603+0000 7fb90a59c640 1 -- 172.21.15.37:0/3556008364 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9140704d0 con 0x7fb9140d0590 2024-05-10T08:45:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb90a59c640 1 --2- 172.21.15.37:0/3556008364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140ce0d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb9140b8e20 tx=0x7fb8fc02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d49e47d274a5f9a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb91259c640 1 -- 172.21.15.37:0/3556008364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc037070 con 0x7fb9140d0590 2024-05-10T08:45:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb91259c640 1 -- 172.21.15.37:0/3556008364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc02add0 con 0x7fb9140d0590 2024-05-10T08:45:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb91259c640 1 -- 172.21.15.37:0/3556008364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc032660 con 0x7fb9140d0590 2024-05-10T08:45:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb9191f7640 1 -- 172.21.15.37:0/3556008364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 msgr2=0x7fb9140ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb9191f7640 1 --2- 172.21.15.37:0/3556008364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140ce0d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb9140b8e20 tx=0x7fb8fc02a080 comp rx=0 tx=0).stop 2024-05-10T08:45:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb9191f7640 1 -- 172.21.15.37:0/3556008364 shutdown_connections 2024-05-10T08:45:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb9191f7640 1 --2- 172.21.15.37:0/3556008364 >> v2:172.21.15.82:3300/0 conn(0x7fb9140ce610 0x7fb9140709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.604+0000 7fb9191f7640 1 --2- 172.21.15.37:0/3556008364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140ce0d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.605+0000 7fb9191f7640 1 -- 172.21.15.37:0/3556008364 >> 172.21.15.37:0/3556008364 conn(0x7fb9140b49d0 msgr2=0x7fb9140b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.605+0000 7fb9191f7640 1 -- 172.21.15.37:0/3556008364 shutdown_connections 2024-05-10T08:45:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.605+0000 7fb9191f7640 1 -- 172.21.15.37:0/3556008364 wait complete. 2024-05-10T08:45:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.606+0000 7fb9191f7640 1 Processor -- start 2024-05-10T08:45:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.606+0000 7fb9191f7640 1 -- start start 2024-05-10T08:45:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb9191f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9140ce610 0x7fb9140c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb9191f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb9191f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9141606d0 0x7fb9140ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb9191f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140710b0 con 0x7fb9140d0590 2024-05-10T08:45:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb9191f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb914070f30 con 0x7fb9140ce610 2024-05-10T08:45:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb9191f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb914071230 con 0x7fb9141606d0 2024-05-10T08:45:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45154/0 (socket says 172.21.15.37:45154) 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 -- 172.21.15.37:0/2220956458 learned_addr learned my addr 172.21.15.37:0/2220956458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb91359e640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9141606d0 0x7fb9140ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb912d9d640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9140ce610 0x7fb9140c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 -- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9141606d0 msgr2=0x7fb9140ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9141606d0 0x7fb9140ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 -- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9140ce610 msgr2=0x7fb9140c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9140ce610 0x7fb9140c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 -- 172.21.15.37:0/2220956458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9140cccd0 con 0x7fb9140d0590 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb912d9d640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9140ce610 0x7fb9140c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90a59c640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140cc5f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc000c00 tx=0x7fb8fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.607+0000 7fb90bfff640 1 -- 172.21.15.37:0/2220956458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc037040 con 0x7fb9140d0590 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.608+0000 7fb90bfff640 1 -- 172.21.15.37:0/2220956458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc042070 con 0x7fb9140d0590 2024-05-10T08:45:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.608+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9140b7af0 con 0x7fb9140d0590 2024-05-10T08:45:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.608+0000 7fb90bfff640 1 -- 172.21.15.37:0/2220956458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc03b890 con 0x7fb9140d0590 2024-05-10T08:45:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.608+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9140b80b0 con 0x7fb9140d0590 2024-05-10T08:45:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.609+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9140693f0 con 0x7fb9140d0590 2024-05-10T08:45:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.609+0000 7fb90bfff640 1 -- 172.21.15.37:0/2220956458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8fc02ac50 con 0x7fb9140d0590 2024-05-10T08:45:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.610+0000 7fb90bfff640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f40762d0 0x7fb8f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.610+0000 7fb90bfff640 1 -- 172.21.15.37:0/2220956458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fb8fc0b7e30 con 0x7fb9140d0590 2024-05-10T08:45:17.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.610+0000 7fb912d9d640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f40762d0 0x7fb8f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.610+0000 7fb912d9d640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f40762d0 0x7fb8f4078790 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9140c8460 tx=0x7fb904009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.614+0000 7fb90bfff640 1 -- 172.21.15.37:0/2220956458 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb8fc081510 con 0x7fb9140d0590 2024-05-10T08:45:17.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.847+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb914069d00 con 0x7fb9140d0590 2024-05-10T08:45:17.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.847+0000 7fb90bfff640 1 -- 172.21.15.37:0/2220956458 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb8fc080e10 con 0x7fb9140d0590 2024-05-10T08:45:17.847 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:17.847 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T08:45:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f40762d0 msgr2=0x7fb8f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f40762d0 0x7fb8f4078790 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9140c8460 tx=0x7fb904009040 comp rx=0 tx=0).stop 2024-05-10T08:45:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 msgr2=0x7fb9140cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140cc5f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc000c00 tx=0x7fb8fc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 shutdown_connections 2024-05-10T08:45:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f40762d0 0x7fb8f4078790 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9141606d0 0x7fb9140ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9140d0590 0x7fb9140cc5f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 --2- 172.21.15.37:0/2220956458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9140ce610 0x7fb9140c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 >> 172.21.15.37:0/2220956458 conn(0x7fb9140b49d0 msgr2=0x7fb9140cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 shutdown_connections 2024-05-10T08:45:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.850+0000 7fb9191f7640 1 -- 172.21.15.37:0/2220956458 wait complete. 2024-05-10T08:45:17.860 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T08:45:17.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:45:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.964+0000 7f096e82a640 1 Processor -- start 2024-05-10T08:45:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.964+0000 7f096e82a640 1 -- start start 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f096e82a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f09680d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f096e82a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09680d1760 con 0x7f09680d3cd0 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f096e82a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09680d1a40 con 0x7f09680d0cf0 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f096e82a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f09680d30f0 con 0x7f096815f380 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f096cdc7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09680d3cd0 0x7f09680b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48660/0 (socket says 172.21.15.37:48660) 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f096cdc7640 1 -- 172.21.15.37:0/1234079312 learned_addr learned my addr 172.21.15.37:0/1234079312 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f0967fff640 1 --2- 172.21.15.37:0/1234079312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f09680d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2505851794 0 0) 0x7f09680d1760 con 0x7f09680d3cd0 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.965+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0954003520 con 0x7f09680d3cd0 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.966+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780467259 0 0) 0x7f09680d1a40 con 0x7f09680d0cf0 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.966+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09680d1760 con 0x7f09680d0cf0 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.966+0000 7f0967fff640 1 -- 172.21.15.37:0/1234079312 >> v1:172.21.15.82:6789/0 conn(0x7f09680d0cf0 legacy=0x7f09680d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.966+0000 7f0967fff640 1 -- 172.21.15.37:0/1234079312 >> v1:172.21.15.37:6789/0 conn(0x7f09680d3cd0 legacy=0x7f09680b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.966+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3312584463 0 0) 0x7f0954003520 con 0x7f09680d3cd0 2024-05-10T08:45:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.966+0000 7f0967fff640 1 -- 172.21.15.37:0/1234079312 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09680d1d20 con 0x7f096815f380 2024-05-10T08:45:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f0967fff640 1 --2- 172.21.15.37:0/1234079312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f09680d07b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09580097d0 tx=0x7f095802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d25f4d55974ea9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958037070 con 0x7f096815f380 2024-05-10T08:45:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095802ac30 con 0x7f096815f380 2024-05-10T08:45:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f09677fe640 1 -- 172.21.15.37:0/1234079312 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600019f0 con 0x7f096815f380 2024-05-10T08:45:17.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f096e82a640 1 -- 172.21.15.37:0/1234079312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 msgr2=0x7f09680d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f096e82a640 1 --2- 172.21.15.37:0/1234079312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f09680d07b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09580097d0 tx=0x7f095802a1a0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f096e82a640 1 -- 172.21.15.37:0/1234079312 shutdown_connections 2024-05-10T08:45:17.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f096e82a640 1 --2- 172.21.15.37:0/1234079312 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f09680d07b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f096e82a640 1 -- 172.21.15.37:0/1234079312 >> 172.21.15.37:0/1234079312 conn(0x7f09680d4fe0 msgr2=0x7f09680d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f096e82a640 1 -- 172.21.15.37:0/1234079312 shutdown_connections 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.967+0000 7f096e82a640 1 -- 172.21.15.37:0/1234079312 wait complete. 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.968+0000 7f096e82a640 1 Processor -- start 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f096e82a640 1 -- start start 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f096e82a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09680d0cf0 0x7f09680a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f096e82a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09680d3cd0 0x7f09681f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f096e82a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f096809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f096e82a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09680d2370 con 0x7f09680d3cd0 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f096e82a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f096815f760 con 0x7f09680d0cf0 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f096e82a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f09680d2800 con 0x7f096815f380 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f095ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09680d3cd0 0x7f09681f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f095ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09680d3cd0 0x7f09681f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40326/0 (socket says 172.21.15.37:40326) 2024-05-10T08:45:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f095ffff640 1 -- 172.21.15.37:0/3011587287 learned_addr learned my addr 172.21.15.37:0/3011587287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.969+0000 7f0967fff640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09680d0cf0 0x7f09680a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f096cdc7640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f096809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f095ffff640 1 -- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 msgr2=0x7f096809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f095ffff640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f096809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f095ffff640 1 -- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09680d0cf0 msgr2=0x7f09680a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f095ffff640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09680d0cf0 0x7f09680a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f095ffff640 1 -- 172.21.15.37:0/3011587287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09681f64a0 con 0x7f09680d3cd0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f095ffff640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09680d3cd0 0x7f09681f5f60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f095000c430 tx=0x7f095000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f09657fa640 1 -- 172.21.15.37:0/3011587287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950017070 con 0x7f09680d3cd0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f09657fa640 1 -- 172.21.15.37:0/3011587287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09500052f0 con 0x7f09680d3cd0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09680a1200 con 0x7f09680d3cd0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f09657fa640 1 -- 172.21.15.37:0/3011587287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950003830 con 0x7f09680d3cd0 2024-05-10T08:45:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.970+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09680a17c0 con 0x7f09680d3cd0 2024-05-10T08:45:17.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.971+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09680693f0 con 0x7f09680d3cd0 2024-05-10T08:45:17.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.972+0000 7f09657fa640 1 -- 172.21.15.37:0/3011587287 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f095001a070 con 0x7f09680d3cd0 2024-05-10T08:45:17.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.972+0000 7f09657fa640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09480762d0 0x7f0948078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:17.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.972+0000 7f09657fa640 1 -- 172.21.15.37:0/3011587287 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f0950096a70 con 0x7f09680d3cd0 2024-05-10T08:45:17.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.973+0000 7f0967fff640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09480762d0 0x7f0948078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:17.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.973+0000 7f0967fff640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09480762d0 0x7f0948078790 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0958034000 tx=0x7f095802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:17.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:17.977+0000 7f09657fa640 1 -- 172.21.15.37:0/3011587287 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f095005fc30 con 0x7f09680d3cd0 2024-05-10T08:45:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.204+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f09680b64b0 con 0x7f09680d3cd0 2024-05-10T08:45:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.205+0000 7f09657fa640 1 -- 172.21.15.37:0/3011587287 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7f0950068270 con 0x7f09680d3cd0 2024-05-10T08:45:18.204 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:45:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09480762d0 msgr2=0x7f0948078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09480762d0 0x7f0948078790 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0958034000 tx=0x7f095802e000 comp rx=0 tx=0).stop 2024-05-10T08:45:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09680d3cd0 msgr2=0x7f09681f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09680d3cd0 0x7f09681f5f60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f095000c430 tx=0x7f095000c8f0 comp rx=0 tx=0).stop 2024-05-10T08:45:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 shutdown_connections 2024-05-10T08:45:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09480762d0 0x7f0948078790 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f096815f380 0x7f096809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09680d3cd0 0x7f09681f5f60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 --2- 172.21.15.37:0/3011587287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09680d0cf0 0x7f09680a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 >> 172.21.15.37:0/3011587287 conn(0x7f09680d4fe0 msgr2=0x7f09680ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 shutdown_connections 2024-05-10T08:45:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18.207+0000 7f096e82a640 1 -- 172.21.15.37:0/3011587287 wait complete. 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:45:18.217 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:45:18.218 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:18.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.218 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:18.235 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42444sec preferred_lft 42444sec 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:18.236 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:18.237 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:45:18.238 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:45:18.238 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:45:18.238 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:18.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.238 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:45:18.299 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:45:18.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.301 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:45:18.358 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:45:18.358 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:45:18.358 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:45:18.358 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:45:18.358 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:45:18.358 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:45:18.358 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:45:18.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:45:18.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:45:18.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:45:18.359 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:45:18.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:45:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:45:18.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.488 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:45:18.504 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:45:18.505 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:45:18.505 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:18.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:45:18.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:45:18.571 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:18.628 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:18.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:45:18.628 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:18.686 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:45:18.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:18.770 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:18.771 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:18.771 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:18.779 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:18.780 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:18.780 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:18.780 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:45:18.780 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:45:18.786 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:18.786 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:18.786 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:18.787 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:45:18.787 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:45:18.787 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:45:18.787 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:45:18.788 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:45:18.789 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:45:18.789 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:45:18.789 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:45:18.790 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:45:18.790 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:45:18.790 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:45:18.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:18.816 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:45:18.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:45:18.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:45:18.915 INFO:teuthology.orchestra.run.smithi037.stdout:client5684 2024-05-10T08:45:18.915 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:18.915 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:18.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:18.932 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-05-10T08:45:18.991 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:45:18.991 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-05-10T08:45:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.077+0000 7f78e7f1ff40 1 Processor -- start 2024-05-10T08:45:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.077+0000 7f78e7f1ff40 1 -- start start 2024-05-10T08:45:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e7f1ff40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e7f1ff40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 0x55ff6a1bc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e7f1ff40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a120c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e7f1ff40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff6a11ff30 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e7f1ff40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ff6a09df50 con 0x55ff6a1cb120 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e7f1ff40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ff6a1249d0 con 0x55ff6a1cb500 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e57d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e57d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a120c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40342/0 (socket says 172.21.15.37:40342) 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e57d3640 1 -- 172.21.15.37:0/174598229 learned_addr learned my addr 172.21.15.37:0/174598229 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78dffff640 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 0x55ff6a1bc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.078+0000 7f78e4fd2640 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e57d3640 1 -- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 msgr2=0x55ff6a1bc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e57d3640 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 0x55ff6a1bc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e57d3640 1 -- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 msgr2=0x55ff6a1c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e57d3640 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e57d3640 1 -- 172.21.15.37:0/174598229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff6a0f5d50 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e4fd2640 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e57d3640 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a120c30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f78e0001550 tx=0x7f78e0001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2693d7f1ce3dab2d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78deffd640 1 -- 172.21.15.37:0/174598229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0017070 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78deffd640 1 -- 172.21.15.37:0/174598229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e000f710 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78deffd640 1 -- 172.21.15.37:0/174598229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e000fb20 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/174598229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 msgr2=0x55ff6a120c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a120c30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f78e0001550 tx=0x7f78e0001a10 comp rx=0 tx=0).stop 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/174598229 shutdown_connections 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a120c30 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 0x55ff6a1bc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/174598229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/174598229 >> 172.21.15.37:0/174598229 conn(0x55ff6a0f57f0 msgr2=0x55ff6a123ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/174598229 shutdown_connections 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.079+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/174598229 wait complete. 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.080+0000 7f78e7f1ff40 1 Processor -- start 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.080+0000 7f78e7f1ff40 1 -- start start 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e7f1ff40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e7f1ff40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 0x55ff6a123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e7f1ff40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a123790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e7f1ff40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff6a1bcaa0 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e7f1ff40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ff6a13ed40 con 0x55ff6a1cb120 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e7f1ff40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ff6a13ea60 con 0x55ff6a1cb500 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a123790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a123790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40354/0 (socket says 172.21.15.37:40354) 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 -- 172.21.15.37:0/2695860795 learned_addr learned my addr 172.21.15.37:0/2695860795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e4fd2640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78dffff640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 0x55ff6a123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 -- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 msgr2=0x55ff6a123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ff6a1cb500 0x55ff6a123250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 -- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 msgr2=0x55ff6a1b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 -- 172.21.15.37:0/2695860795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff6a259e40 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e4fd2640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff6a1cb120 0x55ff6a1b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78e57d3640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a123790 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f78e0015040 tx=0x7f78e0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78ddffb640 1 -- 172.21.15.37:0/2695860795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0017040 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.081+0000 7f78ddffb640 1 -- 172.21.15.37:0/2695860795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e0011640 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.082+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff6a259880 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.082+0000 7f78ddffb640 1 -- 172.21.15.37:0/2695860795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0011a70 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.082+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff6a1b68e0 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.083+0000 7f78ddffb640 1 -- 172.21.15.37:0/2695860795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f78e0011c10 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.083+0000 7f78ddffb640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78c8074cb0 0x7f78c8077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.084+0000 7f78ddffb640 1 -- 172.21.15.37:0/2695860795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f78e0097960 con 0x55ff6a1cb8e0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.084+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55ff6a1ba220 0x55ff6a1ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.084+0000 7f78e4fd2640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78c8074cb0 0x7f78c8077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.084+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) -- 0x55ff6a1c3c20 con 0x55ff6a1ba220 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.084+0000 7f78dffff640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55ff6a1ba220 0x55ff6a1ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.084+0000 7f78dffff640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55ff6a1ba220 0x55ff6a1ccc10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.084+0000 7f78e4fd2640 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78c8074cb0 0x7f78c8077170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f78d8007720 tx=0x7f78d8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78dffff640 1 -- 172.21.15.37:0/2695860795 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v76'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f78d0057030 con 0x55ff6a1ba220 2024-05-10T08:45:19.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55ff6a1ba220 msgr2=0x55ff6a1ccc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55ff6a1ba220 0x55ff6a1ccc10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78c8074cb0 msgr2=0x7f78c8077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f78c8074cb0 0x7f78c8077170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f78d8007720 tx=0x7f78d8009040 comp rx=0 tx=0).stop 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 msgr2=0x55ff6a123790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 --2- 172.21.15.37:0/2695860795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff6a1cb8e0 0x55ff6a123790 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f78e0015040 tx=0x7f78e0001250 comp rx=0 tx=0).stop 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e57d3640 1 -- 172.21.15.37:0/2695860795 reap_dead start 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 shutdown_connections 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 >> 172.21.15.37:0/2695860795 conn(0x55ff6a0f57f0 msgr2=0x55ff6a1c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 shutdown_connections 2024-05-10T08:45:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.086+0000 7f78e7f1ff40 1 -- 172.21.15.37:0/2695860795 wait complete. 2024-05-10T08:45:19.093 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:45:19.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:45:19.134 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:45:19.177 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:45:19.177 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:45:19.177 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:19.177 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:19.195 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:19.195 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:19.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:45:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.400+0000 7f07ef338640 1 Processor -- start 2024-05-10T08:45:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.400+0000 7f07ef338640 1 -- start start 2024-05-10T08:45:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ef338640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e80b2490 0x7f07e8070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ef338640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07e8070d20 0x7f07e80711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ef338640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e806e110 con 0x7f07e81629b0 2024-05-10T08:45:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ef338640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f07e806dec0 con 0x7f07e8070d20 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ef338640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07e806e3f0 con 0x7f07e80b2490 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ed8d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07e8070d20 0x7f07e80711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ed8d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07e8070d20 0x7f07e80711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40356/0 (socket says 172.21.15.37:40356) 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ed8d5640 1 -- 172.21.15.37:0/339884329 learned_addr learned my addr 172.21.15.37:0/339884329 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ec8d3640 1 --2- 172.21.15.37:0/339884329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e80b2490 0x7f07e8070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ed8d5640 1 -- 172.21.15.37:0/339884329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e80b2490 msgr2=0x7f07e8070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ed8d5640 1 --2- 172.21.15.37:0/339884329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e80b2490 0x7f07e8070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ed8d5640 1 -- 172.21.15.37:0/339884329 >> v1:172.21.15.82:6789/0 conn(0x7f07e81629b0 legacy=0x7f07e806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.401+0000 7f07ed8d5640 1 -- 172.21.15.37:0/339884329 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e806e6d0 con 0x7f07e8070d20 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.402+0000 7f07ed8d5640 1 --2- 172.21.15.37:0/339884329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e8070d20 0x7f07e80711a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009e50 tx=0x7f07e002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7519a7f47a5e6a89 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.402+0000 7f07dffff640 1 -- 172.21.15.37:0/339884329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0036070 con 0x7f07e8070d20 2024-05-10T08:45:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.402+0000 7f07dffff640 1 -- 172.21.15.37:0/339884329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e0031600 con 0x7f07e8070d20 2024-05-10T08:45:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.402+0000 7f07dffff640 1 -- 172.21.15.37:0/339884329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e00319d0 con 0x7f07e8070d20 2024-05-10T08:45:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.402+0000 7f07ef338640 1 -- 172.21.15.37:0/339884329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e8070d20 msgr2=0x7f07e80711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.402+0000 7f07ef338640 1 --2- 172.21.15.37:0/339884329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e8070d20 0x7f07e80711a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009e50 tx=0x7f07e002a6c0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.403+0000 7f07ef338640 1 -- 172.21.15.37:0/339884329 shutdown_connections 2024-05-10T08:45:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.403+0000 7f07ef338640 1 --2- 172.21.15.37:0/339884329 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e80b2490 0x7f07e8070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.403+0000 7f07ef338640 1 --2- 172.21.15.37:0/339884329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e8070d20 0x7f07e80711a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.403+0000 7f07ef338640 1 -- 172.21.15.37:0/339884329 >> 172.21.15.37:0/339884329 conn(0x7f07e80b49d0 msgr2=0x7f07e80b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.403+0000 7f07ef338640 1 -- 172.21.15.37:0/339884329 shutdown_connections 2024-05-10T08:45:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.403+0000 7f07ef338640 1 -- 172.21.15.37:0/339884329 wait complete. 2024-05-10T08:45:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.404+0000 7f07ef338640 1 Processor -- start 2024-05-10T08:45:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.404+0000 7f07ef338640 1 -- start start 2024-05-10T08:45:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ef338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e8070d20 0x7f07e80b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ef338640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e80b2490 0x7f07e80b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ef338640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e81629b0 0x7f07e80b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ef338640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07e80709f0 con 0x7f07e80b2490 2024-05-10T08:45:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ef338640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8070870 con 0x7f07e8070d20 2024-05-10T08:45:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ef338640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07e80afcb0 con 0x7f07e81629b0 2024-05-10T08:45:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e80b2490 0x7f07e80b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e80b2490 0x7f07e80b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40368/0 (socket says 172.21.15.37:40368) 2024-05-10T08:45:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 -- 172.21.15.37:0/788200492 learned_addr learned my addr 172.21.15.37:0/788200492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ed8d5640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e81629b0 0x7f07e80b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ed0d4640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e8070d20 0x7f07e80b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 -- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e81629b0 msgr2=0x7f07e80b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e81629b0 0x7f07e80b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 -- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e8070d20 msgr2=0x7f07e80b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e8070d20 0x7f07e80b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 -- 172.21.15.37:0/788200492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e80b8810 con 0x7f07e80b2490 2024-05-10T08:45:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ed0d4640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e8070d20 0x7f07e80b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ec8d3640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e80b2490 0x7f07e80b38e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c7f0 tx=0x7f07d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ddffb640 1 -- 172.21.15.37:0/788200492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8015070 con 0x7f07e80b2490 2024-05-10T08:45:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ddffb640 1 -- 172.21.15.37:0/788200492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d8004240 con 0x7f07e80b2490 2024-05-10T08:45:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ddffb640 1 -- 172.21.15.37:0/788200492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8007620 con 0x7f07e80b2490 2024-05-10T08:45:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.405+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e81f8780 con 0x7f07e80b2490 2024-05-10T08:45:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.406+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e81f8d40 con 0x7f07e80b2490 2024-05-10T08:45:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.406+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e80722a0 con 0x7f07e80b2490 2024-05-10T08:45:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.407+0000 7f07ddffb640 1 -- 172.21.15.37:0/788200492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07d80079d0 con 0x7f07e80b2490 2024-05-10T08:45:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.408+0000 7f07ddffb640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07cc0762d0 0x7f07cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.408+0000 7f07ddffb640 1 -- 172.21.15.37:0/788200492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f07d8097bb0 con 0x7f07e80b2490 2024-05-10T08:45:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.408+0000 7f07ed0d4640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07cc0762d0 0x7f07cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.408+0000 7f07ed0d4640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07cc0762d0 0x7f07cc078790 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f07e4006fd0 tx=0x7f07e4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.412+0000 7f07ddffb640 1 -- 172.21.15.37:0/788200492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f07d8060ce0 con 0x7f07e80b2490 2024-05-10T08:45:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.615+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07e81f8570 con 0x7f07e80b2490 2024-05-10T08:45:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.615+0000 7f07ddffb640 1 -- 172.21.15.37:0/788200492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) ==== 80+0+122 (secure 0 0 0) 0x7f07d8069320 con 0x7f07e80b2490 2024-05-10T08:45:19.615 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6835/3151779785 2024-05-11T08:44:07.977457+0000 2024-05-10T08:45:19.616 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6833/3151779785 2024-05-11T08:44:07.977457+0000 2024-05-10T08:45:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:listed 2 entries 2024-05-10T08:45:19.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07cc0762d0 msgr2=0x7f07cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07cc0762d0 0x7f07cc078790 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f07e4006fd0 tx=0x7f07e4008040 comp rx=0 tx=0).stop 2024-05-10T08:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e80b2490 msgr2=0x7f07e80b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e80b2490 0x7f07e80b38e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c7f0 tx=0x7f07d800ccb0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 shutdown_connections 2024-05-10T08:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07cc0762d0 0x7f07cc078790 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e81629b0 0x7f07e80b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07e80b2490 0x7f07e80b38e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 --2- 172.21.15.37:0/788200492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e8070d20 0x7f07e80b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 >> 172.21.15.37:0/788200492 conn(0x7f07e80b49d0 msgr2=0x7f07e80b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 shutdown_connections 2024-05-10T08:45:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.618+0000 7f07ef338640 1 -- 172.21.15.37:0/788200492 wait complete. 2024-05-10T08:45:19.628 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:45:19.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:19.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:19.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:45:19.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:19.659 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:45:19.715 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:45:19.715 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:45:19.715 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:19.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:45:19.735 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:45:19.735 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:19.735 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:19.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:45:19.772 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:45:19.772 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:45:19.772 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:19.795 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:45:19.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.917+0000 7ffb653e5640 1 Processor -- start 2024-05-10T08:45:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.918+0000 7ffb653e5640 1 -- start start 2024-05-10T08:45:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.918+0000 7ffb653e5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb6015f420 0x7ffb600d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.918+0000 7ffb653e5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600d2080 0x7ffb600d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.918+0000 7ffb653e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb601630b0 con 0x7ffb600d3ca0 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.918+0000 7ffb653e5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ffb600d2550 con 0x7ffb6015f420 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.918+0000 7ffb653e5640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffb600d2c80 con 0x7ffb600d2080 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb6015f420 0x7ffb600d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb6015f420 0x7ffb600d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40384/0 (socket says 172.21.15.37:40384) 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 -- 172.21.15.37:0/1713903815 learned_addr learned my addr 172.21.15.37:0/1713903815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5f7fe640 1 --2- 172.21.15.37:0/1713903815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600d2080 0x7ffb600d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 -- 172.21.15.37:0/1713903815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600d2080 msgr2=0x7ffb600d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 --2- 172.21.15.37:0/1713903815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600d2080 0x7ffb600d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 -- 172.21.15.37:0/1713903815 >> v1:172.21.15.82:6789/0 conn(0x7ffb600d3ca0 legacy=0x7ffb600d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 -- 172.21.15.37:0/1713903815 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb600d2f60 con 0x7ffb6015f420 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.919+0000 7ffb5effd640 1 --2- 172.21.15.37:0/1713903815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb6015f420 0x7ffb600d3760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009870 tx=0x7ffb5802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba5aea96647f6c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb5dffb640 1 -- 172.21.15.37:0/1713903815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58037070 con 0x7ffb6015f420 2024-05-10T08:45:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb5dffb640 1 -- 172.21.15.37:0/1713903815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb58032440 con 0x7ffb6015f420 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb5dffb640 1 -- 172.21.15.37:0/1713903815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58032810 con 0x7ffb6015f420 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 -- 172.21.15.37:0/1713903815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb6015f420 msgr2=0x7ffb600d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1713903815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb6015f420 0x7ffb600d3760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009870 tx=0x7ffb5802a210 comp rx=0 tx=0).stop 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 -- 172.21.15.37:0/1713903815 shutdown_connections 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1713903815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600d2080 0x7ffb600d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1713903815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb6015f420 0x7ffb600d3760 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 -- 172.21.15.37:0/1713903815 >> 172.21.15.37:0/1713903815 conn(0x7ffb6008eac0 msgr2=0x7ffb6009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 -- 172.21.15.37:0/1713903815 shutdown_connections 2024-05-10T08:45:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.920+0000 7ffb653e5640 1 -- 172.21.15.37:0/1713903815 wait complete. 2024-05-10T08:45:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 Processor -- start 2024-05-10T08:45:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 -- start start 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb600d2080 0x7ffb60162340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb60161270 0x7ffb60158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600b26f0 0x7ffb600b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb600d5200 con 0x7ffb600d2080 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb600d2830 con 0x7ffb60161270 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.922+0000 7ffb653e5640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffb600d5380 con 0x7ffb600b26f0 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb600d2080 0x7ffb60162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb600d2080 0x7ffb60162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40400/0 (socket says 172.21.15.37:40400) 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 -- 172.21.15.37:0/1741050231 learned_addr learned my addr 172.21.15.37:0/1741050231 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5f7fe640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600b26f0 0x7ffb600b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5e7fc640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb60161270 0x7ffb60158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 -- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600b26f0 msgr2=0x7ffb600b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600b26f0 0x7ffb600b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 -- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb60161270 msgr2=0x7ffb60158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb60161270 0x7ffb60158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 -- 172.21.15.37:0/1741050231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb601616f0 con 0x7ffb600d2080 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5f7fe640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600b26f0 0x7ffb600b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb5effd640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb600d2080 0x7ffb60162340 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ffb58000c00 tx=0x7ffb580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb577fe640 1 -- 172.21.15.37:0/1741050231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58041020 con 0x7ffb600d2080 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb577fe640 1 -- 172.21.15.37:0/1741050231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb580306c0 con 0x7ffb600d2080 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb600c8f30 con 0x7ffb600d2080 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb577fe640 1 -- 172.21.15.37:0/1741050231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58037040 con 0x7ffb600d2080 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.923+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb600c94c0 con 0x7ffb600d2080 2024-05-10T08:45:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.924+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb600693f0 con 0x7ffb600d2080 2024-05-10T08:45:19.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.925+0000 7ffb577fe640 1 -- 172.21.15.37:0/1741050231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb58044020 con 0x7ffb600d2080 2024-05-10T08:45:19.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.926+0000 7ffb577fe640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffb400762d0 0x7ffb40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:19.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.926+0000 7ffb577fe640 1 -- 172.21.15.37:0/1741050231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7ffb580b7be0 con 0x7ffb600d2080 2024-05-10T08:45:19.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.926+0000 7ffb5e7fc640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffb400762d0 0x7ffb40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:19.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.926+0000 7ffb5e7fc640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffb400762d0 0x7ffb40078790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffb600cf6d0 tx=0x7ffb48009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:19.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:19.930+0000 7ffb577fe640 1 -- 172.21.15.37:0/1741050231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ffb5804b070 con 0x7ffb600d2080 2024-05-10T08:45:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.159+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb600b4c50 con 0x7ffb600d2080 2024-05-10T08:45:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.159+0000 7ffb577fe640 1 -- 172.21.15.37:0/1741050231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5182 (secure 0 0 0) 0x7ffb601616f0 con 0x7ffb600d2080 2024-05-10T08:45:20.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:20.159 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:50.735103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":14,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":5}]} 2024-05-10T08:45:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 52 2024-05-10T08:45:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffb400762d0 msgr2=0x7ffb40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffb400762d0 0x7ffb40078790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffb600cf6d0 tx=0x7ffb48009040 comp rx=0 tx=0).stop 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb600d2080 msgr2=0x7ffb60162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb600d2080 0x7ffb60162340 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ffb58000c00 tx=0x7ffb580046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 shutdown_connections 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffb400762d0 0x7ffb40078790 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffb600b26f0 0x7ffb600b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb60161270 0x7ffb60158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 --2- 172.21.15.37:0/1741050231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb600d2080 0x7ffb60162340 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 >> 172.21.15.37:0/1741050231 conn(0x7ffb6008eac0 msgr2=0x7ffb600cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 shutdown_connections 2024-05-10T08:45:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.162+0000 7ffb653e5640 1 -- 172.21.15.37:0/1741050231 wait complete. 2024-05-10T08:45:20.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:20.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.277+0000 7fbd16959640 1 Processor -- start 2024-05-10T08:45:20.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.277+0000 7fbd16959640 1 -- start start 2024-05-10T08:45:20.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd16959640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd101629a0 0x7fbd100d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd16959640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd100d2dc0 0x7fbd100d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd16959640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd100c8ed0 0x7fbd100c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd16959640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbd100d3330 con 0x7fbd101629a0 2024-05-10T08:45:20.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd16959640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbd100d2170 con 0x7fbd100d2dc0 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd16959640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbd100d2450 con 0x7fbd100c8ed0 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd101629a0 0x7fbd100d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd101629a0 0x7fbd100d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40408/0 (socket says 172.21.15.37:40408) 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 -- 172.21.15.37:0/1373650633 learned_addr learned my addr 172.21.15.37:0/1373650633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd14ef6640 1 --2- 172.21.15.37:0/1373650633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd100c8ed0 0x7fbd100c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0f7fe640 1 --2- 172.21.15.37:0/1373650633 >> v2:172.21.15.82:3300/0 conn(0x7fbd100d2dc0 0x7fbd100d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 -- 172.21.15.37:0/1373650633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd100c8ed0 msgr2=0x7fbd100c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 --2- 172.21.15.37:0/1373650633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd100c8ed0 0x7fbd100c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 -- 172.21.15.37:0/1373650633 >> v2:172.21.15.82:3300/0 conn(0x7fbd100d2dc0 msgr2=0x7fbd100d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 --2- 172.21.15.37:0/1373650633 >> v2:172.21.15.82:3300/0 conn(0x7fbd100d2dc0 0x7fbd100d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0ffff640 1 -- 172.21.15.37:0/1373650633 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd100d2730 con 0x7fbd101629a0 2024-05-10T08:45:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd14ef6640 1 --2- 172.21.15.37:0/1373650633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd100c8ed0 0x7fbd100c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.278+0000 7fbd0f7fe640 1 --2- 172.21.15.37:0/1373650633 >> v2:172.21.15.82:3300/0 conn(0x7fbd100d2dc0 0x7fbd100d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.279+0000 7fbd0ffff640 1 --2- 172.21.15.37:0/1373650633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd101629a0 0x7fbd100d35c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbd100b7ae0 tx=0x7fbd0002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe930e2fd6c88124 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.279+0000 7fbd0effd640 1 -- 172.21.15.37:0/1373650633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd00037070 con 0x7fbd101629a0 2024-05-10T08:45:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.279+0000 7fbd0effd640 1 -- 172.21.15.37:0/1373650633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0002ae00 con 0x7fbd101629a0 2024-05-10T08:45:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.279+0000 7fbd0effd640 1 -- 172.21.15.37:0/1373650633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd00032660 con 0x7fbd101629a0 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 -- 172.21.15.37:0/1373650633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd101629a0 msgr2=0x7fbd100d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 --2- 172.21.15.37:0/1373650633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd101629a0 0x7fbd100d35c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbd100b7ae0 tx=0x7fbd0002a0b0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 -- 172.21.15.37:0/1373650633 shutdown_connections 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 --2- 172.21.15.37:0/1373650633 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd100c8ed0 0x7fbd100c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 --2- 172.21.15.37:0/1373650633 >> v2:172.21.15.82:3300/0 conn(0x7fbd100d2dc0 0x7fbd100d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 --2- 172.21.15.37:0/1373650633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd101629a0 0x7fbd100d35c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 -- 172.21.15.37:0/1373650633 >> 172.21.15.37:0/1373650633 conn(0x7fbd100d4fe0 msgr2=0x7fbd100d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 -- 172.21.15.37:0/1373650633 shutdown_connections 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.280+0000 7fbd16959640 1 -- 172.21.15.37:0/1373650633 wait complete. 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.281+0000 7fbd16959640 1 Processor -- start 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.281+0000 7fbd16959640 1 -- start start 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd16959640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd100c8ed0 0x7fbd1009fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd16959640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd100d2dc0 0x7fbd100b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd16959640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd101629a0 0x7fbd100a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd16959640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100cf440 con 0x7fbd100d2dc0 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd16959640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100cf2c0 con 0x7fbd100c8ed0 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd16959640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbd100c98a0 con 0x7fbd101629a0 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd100d2dc0 0x7fbd100b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd100d2dc0 0x7fbd100b92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40414/0 (socket says 172.21.15.37:40414) 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 -- 172.21.15.37:0/1235497005 learned_addr learned my addr 172.21.15.37:0/1235497005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd14ef6640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd101629a0 0x7fbd100a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 -- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd101629a0 msgr2=0x7fbd100a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0ffff640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd100c8ed0 0x7fbd1009fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd101629a0 0x7fbd100a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 -- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd100c8ed0 msgr2=0x7fbd1009fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd100c8ed0 0x7fbd1009fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 -- 172.21.15.37:0/1235497005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd101f59b0 con 0x7fbd100d2dc0 2024-05-10T08:45:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.282+0000 7fbd0f7fe640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd100d2dc0 0x7fbd100b92e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400c7f0 tx=0x7fbd0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.283+0000 7fbd0cff9640 1 -- 172.21.15.37:0/1235497005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04015070 con 0x7fbd100d2dc0 2024-05-10T08:45:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.283+0000 7fbd0cff9640 1 -- 172.21.15.37:0/1235497005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd040079d0 con 0x7fbd100d2dc0 2024-05-10T08:45:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.283+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1009ee30 con 0x7fbd100d2dc0 2024-05-10T08:45:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.283+0000 7fbd0cff9640 1 -- 172.21.15.37:0/1235497005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04007da0 con 0x7fbd100d2dc0 2024-05-10T08:45:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.283+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1009f6d0 con 0x7fbd100d2dc0 2024-05-10T08:45:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.284+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1009f220 con 0x7fbd100d2dc0 2024-05-10T08:45:20.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.284+0000 7fbd0cff9640 1 -- 172.21.15.37:0/1235497005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd04018070 con 0x7fbd100d2dc0 2024-05-10T08:45:20.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.285+0000 7fbd0cff9640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbcfc0762d0 0x7fbcfc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.285+0000 7fbd0cff9640 1 -- 172.21.15.37:0/1235497005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fbd04097630 con 0x7fbd100d2dc0 2024-05-10T08:45:20.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.285+0000 7fbd0ffff640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbcfc0762d0 0x7fbcfc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.286+0000 7fbd0ffff640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbcfc0762d0 0x7fbcfc078790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbd00034000 tx=0x7fbd0002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.289+0000 7fbd0cff9640 1 -- 172.21.15.37:0/1235497005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbd04060e40 con 0x7fbd100d2dc0 2024-05-10T08:45:20.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.521+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd100693f0 con 0x7fbd100d2dc0 2024-05-10T08:45:20.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.522+0000 7fbd0cff9640 1 -- 172.21.15.37:0/1235497005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5182 (secure 0 0 0) 0x7fbd04060740 con 0x7fbd100d2dc0 2024-05-10T08:45:20.522 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:20.522 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:50.735103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":14,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":5}]} 2024-05-10T08:45:20.522 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 52 2024-05-10T08:45:20.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbcfc0762d0 msgr2=0x7fbcfc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbcfc0762d0 0x7fbcfc078790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbd00034000 tx=0x7fbd0002e000 comp rx=0 tx=0).stop 2024-05-10T08:45:20.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd100d2dc0 msgr2=0x7fbd100b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd100d2dc0 0x7fbd100b92e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400c7f0 tx=0x7fbd0400cbf0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 shutdown_connections 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbcfc0762d0 0x7fbcfc078790 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd101629a0 0x7fbd100a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd100d2dc0 0x7fbd100b92e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 --2- 172.21.15.37:0/1235497005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd100c8ed0 0x7fbd1009fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 >> 172.21.15.37:0/1235497005 conn(0x7fbd100d4fe0 msgr2=0x7fbd100cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 shutdown_connections 2024-05-10T08:45:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.524+0000 7fbd16959640 1 -- 172.21.15.37:0/1235497005 wait complete. 2024-05-10T08:45:20.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:45:20.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.639+0000 7fc589e7e640 1 Processor -- start 2024-05-10T08:45:20.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.639+0000 7fc589e7e640 1 -- start start 2024-05-10T08:45:20.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc589e7e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc58406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc589e7e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc58415f830 0x7fc58406d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc589e7e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5840d0700 0x7fc58406dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc589e7e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc58406d690 con 0x7fc58415f830 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc589e7e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc5840d0cb0 con 0x7fc5840d0700 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc589e7e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5840d0f90 con 0x7fc58415f450 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc582ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc58415f830 0x7fc58406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc582ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc58415f830 0x7fc58406d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40430/0 (socket says 172.21.15.37:40430) 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc582ffd640 1 -- 172.21.15.37:0/3000355522 learned_addr learned my addr 172.21.15.37:0/3000355522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc5837fe640 1 --2- 172.21.15.37:0/3000355522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc58406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.640+0000 7fc583fff640 1 --2- 172.21.15.37:0/3000355522 >> v2:172.21.15.82:3300/0 conn(0x7fc5840d0700 0x7fc58406dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc582ffd640 1 -- 172.21.15.37:0/3000355522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 msgr2=0x7fc58406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc582ffd640 1 --2- 172.21.15.37:0/3000355522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc58406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc582ffd640 1 -- 172.21.15.37:0/3000355522 >> v2:172.21.15.82:3300/0 conn(0x7fc5840d0700 msgr2=0x7fc58406dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:20.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc582ffd640 1 --2- 172.21.15.37:0/3000355522 >> v2:172.21.15.82:3300/0 conn(0x7fc5840d0700 0x7fc58406dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc582ffd640 1 -- 172.21.15.37:0/3000355522 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5840d2fe0 con 0x7fc58415f830 2024-05-10T08:45:20.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc582ffd640 1 --2- 172.21.15.37:0/3000355522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc58415f830 0x7fc58406d830 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc5840d6120 tx=0x7fc57802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b900d892e92aac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc5827fc640 1 -- 172.21.15.37:0/3000355522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578037070 con 0x7fc58415f830 2024-05-10T08:45:20.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc5827fc640 1 -- 172.21.15.37:0/3000355522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc578032440 con 0x7fc58415f830 2024-05-10T08:45:20.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.641+0000 7fc5827fc640 1 -- 172.21.15.37:0/3000355522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578032810 con 0x7fc58415f830 2024-05-10T08:45:20.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 -- 172.21.15.37:0/3000355522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc58415f830 msgr2=0x7fc58406d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 --2- 172.21.15.37:0/3000355522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc58415f830 0x7fc58406d830 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc5840d6120 tx=0x7fc57802a1e0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 -- 172.21.15.37:0/3000355522 shutdown_connections 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 --2- 172.21.15.37:0/3000355522 >> v2:172.21.15.82:3300/0 conn(0x7fc5840d0700 0x7fc58406dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 --2- 172.21.15.37:0/3000355522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc58415f830 0x7fc58406d830 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 --2- 172.21.15.37:0/3000355522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc58406d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 -- 172.21.15.37:0/3000355522 >> 172.21.15.37:0/3000355522 conn(0x7fc5840d5040 msgr2=0x7fc5840d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 -- 172.21.15.37:0/3000355522 shutdown_connections 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.642+0000 7fc589e7e640 1 -- 172.21.15.37:0/3000355522 wait complete. 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.643+0000 7fc589e7e640 1 Processor -- start 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.643+0000 7fc589e7e640 1 -- start start 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc589e7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5840d0700 0x7fc5840cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc589e7e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc5841543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc589e7e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58415f830 0x7fc5841618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc589e7e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc5840d1960 con 0x7fc5840d0700 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc589e7e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5840d17e0 con 0x7fc58415f830 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc589e7e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5840d1ae0 con 0x7fc58415f450 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5840d0700 0x7fc5840cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5840d0700 0x7fc5840cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40440/0 (socket says 172.21.15.37:40440) 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc5837fe640 1 -- 172.21.15.37:0/787751058 learned_addr learned my addr 172.21.15.37:0/787751058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc582ffd640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc5841543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.644+0000 7fc583fff640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58415f830 0x7fc5841618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc5837fe640 1 -- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 msgr2=0x7fc5841543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc5837fe640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc5841543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc5837fe640 1 -- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58415f830 msgr2=0x7fc5841618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc5837fe640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58415f830 0x7fc5841618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc5837fe640 1 -- 172.21.15.37:0/787751058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5840cbbb0 con 0x7fc5840d0700 2024-05-10T08:45:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc5837fe640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5840d0700 0x7fc5840cb670 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc57400e9b0 tx=0x7fc57400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc56bfff640 1 -- 172.21.15.37:0/787751058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574017070 con 0x7fc5840d0700 2024-05-10T08:45:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc56bfff640 1 -- 172.21.15.37:0/787751058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57400c9a0 con 0x7fc5840d0700 2024-05-10T08:45:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58415fe60 con 0x7fc5840d0700 2024-05-10T08:45:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc56bfff640 1 -- 172.21.15.37:0/787751058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57400cd90 con 0x7fc5840d0700 2024-05-10T08:45:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.645+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc584160420 con 0x7fc5840d0700 2024-05-10T08:45:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.646+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5840693f0 con 0x7fc5840d0700 2024-05-10T08:45:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.647+0000 7fc56bfff640 1 -- 172.21.15.37:0/787751058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc57401a070 con 0x7fc5840d0700 2024-05-10T08:45:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.647+0000 7fc56bfff640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5700762d0 0x7fc570078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.647+0000 7fc56bfff640 1 -- 172.21.15.37:0/787751058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fc574097810 con 0x7fc5840d0700 2024-05-10T08:45:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.648+0000 7fc582ffd640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5700762d0 0x7fc570078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.648+0000 7fc582ffd640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5700762d0 0x7fc570078790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc578034000 tx=0x7fc57802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.652+0000 7fc56bfff640 1 -- 172.21.15.37:0/787751058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc5740608c0 con 0x7fc5840d0700 2024-05-10T08:45:20.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.842+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5840d4620 con 0x7fc5840d0700 2024-05-10T08:45:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.843+0000 7fc56bfff640 1 -- 172.21.15.37:0/787751058 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17014 (secure 0 0 0) 0x7fc5740670e0 con 0x7fc5840d0700 2024-05-10T08:45:20.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:20.842 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:44:07.977481+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:43:56.387579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T08:43:57.685327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3151779785":"2024-05-11T08:44:07.977457+0000","172.21.15.37:6833/3151779785":"2024-05-11T08:44:07.977457+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:45:20.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5700762d0 msgr2=0x7fc570078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5700762d0 0x7fc570078790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc578034000 tx=0x7fc57802e000 comp rx=0 tx=0).stop 2024-05-10T08:45:20.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5840d0700 msgr2=0x7fc5840cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5840d0700 0x7fc5840cb670 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc57400e9b0 tx=0x7fc57400ee70 comp rx=0 tx=0).stop 2024-05-10T08:45:20.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 shutdown_connections 2024-05-10T08:45:20.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5700762d0 0x7fc570078790 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58415f830 0x7fc5841618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc58415f450 0x7fc5841543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 --2- 172.21.15.37:0/787751058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5840d0700 0x7fc5840cb670 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 >> 172.21.15.37:0/787751058 conn(0x7fc5840d5040 msgr2=0x7fc5840b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:20.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 shutdown_connections 2024-05-10T08:45:20.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.845+0000 7fc589e7e640 1 -- 172.21.15.37:0/787751058 wait complete. 2024-05-10T08:45:20.856 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:45:20.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.961+0000 7fbf51685640 1 Processor -- start 2024-05-10T08:45:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.961+0000 7fbf51685640 1 -- start start 2024-05-10T08:45:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.961+0000 7fbf51685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf4c15bc80 0x7fbf4c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.961+0000 7fbf51685640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbf4c06e8d0 0x7fbf4c073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.961+0000 7fbf51685640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf4c0b4590 con 0x7fbf4c1524f0 2024-05-10T08:45:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.961+0000 7fbf51685640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4c06ed40 con 0x7fbf4c15bc80 2024-05-10T08:45:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.961+0000 7fbf51685640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4c0b51a0 con 0x7fbf4c06e8d0 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4a7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf4c15bc80 0x7fbf4c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4a7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf4c15bc80 0x7fbf4c06e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40448/0 (socket says 172.21.15.37:40448) 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/3133801301 learned_addr learned my addr 172.21.15.37:0/3133801301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4affd640 1 --1- 172.21.15.37:0/3133801301 >> v1:172.21.15.37:6789/0 conn(0x7fbf4c1524f0 0x7fbf4c0b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48662/0 (socket says 172.21.15.37:48662) 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4b7fe640 1 --2- 172.21.15.37:0/3133801301 >> v2:172.21.15.82:3300/0 conn(0x7fbf4c06e8d0 0x7fbf4c073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/3133801301 >> v2:172.21.15.82:3300/0 conn(0x7fbf4c06e8d0 msgr2=0x7fbf4c073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4a7fc640 1 --2- 172.21.15.37:0/3133801301 >> v2:172.21.15.82:3300/0 conn(0x7fbf4c06e8d0 0x7fbf4c073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/3133801301 >> v1:172.21.15.37:6789/0 conn(0x7fbf4c1524f0 legacy=0x7fbf4c0b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/3133801301 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c0b4870 con 0x7fbf4c15bc80 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf49ffb640 1 -- 172.21.15.37:0/3133801301 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714796594 0 0) 0x7fbf4c0b4590 con 0x7fbf4c1524f0 2024-05-10T08:45:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.962+0000 7fbf4b7fe640 1 --2- 172.21.15.37:0/3133801301 >> v2:172.21.15.82:3300/0 conn(0x7fbf4c06e8d0 0x7fbf4c073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:20.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf4a7fc640 1 --2- 172.21.15.37:0/3133801301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c15bc80 0x7fbf4c06e390 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c159670 tx=0x7fbf4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15ae681483da90c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf49ffb640 1 -- 172.21.15.37:0/3133801301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40037070 con 0x7fbf4c15bc80 2024-05-10T08:45:20.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf49ffb640 1 -- 172.21.15.37:0/3133801301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf40032440 con 0x7fbf4c15bc80 2024-05-10T08:45:20.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf49ffb640 1 -- 172.21.15.37:0/3133801301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40032810 con 0x7fbf4c15bc80 2024-05-10T08:45:20.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf51685640 1 -- 172.21.15.37:0/3133801301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c15bc80 msgr2=0x7fbf4c06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf51685640 1 --2- 172.21.15.37:0/3133801301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c15bc80 0x7fbf4c06e390 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c159670 tx=0x7fbf4002a270 comp rx=0 tx=0).stop 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf51685640 1 -- 172.21.15.37:0/3133801301 shutdown_connections 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf51685640 1 --2- 172.21.15.37:0/3133801301 >> v2:172.21.15.82:3300/0 conn(0x7fbf4c06e8d0 0x7fbf4c073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf51685640 1 --2- 172.21.15.37:0/3133801301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c15bc80 0x7fbf4c06e390 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.963+0000 7fbf51685640 1 -- 172.21.15.37:0/3133801301 >> 172.21.15.37:0/3133801301 conn(0x7fbf4c06c3a0 msgr2=0x7fbf4c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.964+0000 7fbf51685640 1 -- 172.21.15.37:0/3133801301 shutdown_connections 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.964+0000 7fbf51685640 1 -- 172.21.15.37:0/3133801301 wait complete. 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.965+0000 7fbf51685640 1 Processor -- start 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.965+0000 7fbf51685640 1 -- start start 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf51685640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf4c06e8d0 0x7fbf4c1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf51685640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c1524f0 0x7fbf4c0ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf51685640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf4c15bc80 0x7fbf4c0cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf51685640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c0b4e30 con 0x7fbf4c1524f0 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf51685640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c0b4330 con 0x7fbf4c15bc80 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf51685640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4c1528d0 con 0x7fbf4c06e8d0 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c1524f0 0x7fbf4c0ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c1524f0 0x7fbf4c0ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40454/0 (socket says 172.21.15.37:40454) 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/1432151057 learned_addr learned my addr 172.21.15.37:0/1432151057 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4affd640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf4c06e8d0 0x7fbf4c1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4b7fe640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf4c15bc80 0x7fbf4c0cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf4c06e8d0 msgr2=0x7fbf4c1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf4c06e8d0 0x7fbf4c1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf4c15bc80 msgr2=0x7fbf4c0cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf4c15bc80 0x7fbf4c0cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 -- 172.21.15.37:0/1432151057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c0d00b0 con 0x7fbf4c1524f0 2024-05-10T08:45:20.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf4a7fc640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c1524f0 0x7fbf4c0ae120 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbf40000c00 tx=0x7fbf400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf337fe640 1 -- 172.21.15.37:0/1432151057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf40037040 con 0x7fbf4c1524f0 2024-05-10T08:45:20.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf337fe640 1 -- 172.21.15.37:0/1432151057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf40004230 con 0x7fbf4c1524f0 2024-05-10T08:45:20.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4c0d0390 con 0x7fbf4c1524f0 2024-05-10T08:45:20.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.966+0000 7fbf337fe640 1 -- 172.21.15.37:0/1432151057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4003c670 con 0x7fbf4c1524f0 2024-05-10T08:45:20.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.967+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf4c1f5470 con 0x7fbf4c1524f0 2024-05-10T08:45:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.967+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf4c0693f0 con 0x7fbf4c1524f0 2024-05-10T08:45:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.968+0000 7fbf337fe640 1 -- 172.21.15.37:0/1432151057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf4003a070 con 0x7fbf4c1524f0 2024-05-10T08:45:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.969+0000 7fbf337fe640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbf380762d0 0x7fbf38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.969+0000 7fbf337fe640 1 -- 172.21.15.37:0/1432151057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fbf400b7fd0 con 0x7fbf4c1524f0 2024-05-10T08:45:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.969+0000 7fbf4affd640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbf380762d0 0x7fbf38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:20.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.969+0000 7fbf4affd640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbf380762d0 0x7fbf38078790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c000f60 tx=0x7fbf3c007b50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:20.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:20.973+0000 7fbf337fe640 1 -- 172.21.15.37:0/1432151057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbf40041020 con 0x7fbf4c1524f0 2024-05-10T08:45:21.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.204+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf4c072220 con 0x7fbf4c1524f0 2024-05-10T08:45:21.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.205+0000 7fbf337fe640 1 -- 172.21.15.37:0/1432151057 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5182 (secure 0 0 0) 0x7fbf40081750 con 0x7fbf4c1524f0 2024-05-10T08:45:21.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:21.204 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:50.735103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":14,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":5}]} 2024-05-10T08:45:21.204 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 52 2024-05-10T08:45:21.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbf380762d0 msgr2=0x7fbf38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbf380762d0 0x7fbf38078790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c000f60 tx=0x7fbf3c007b50 comp rx=0 tx=0).stop 2024-05-10T08:45:21.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c1524f0 msgr2=0x7fbf4c0ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c1524f0 0x7fbf4c0ae120 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbf40000c00 tx=0x7fbf400046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 shutdown_connections 2024-05-10T08:45:21.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbf380762d0 0x7fbf38078790 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf4c15bc80 0x7fbf4c0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf4c1524f0 0x7fbf4c0ae120 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 --2- 172.21.15.37:0/1432151057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbf4c06e8d0 0x7fbf4c1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 >> 172.21.15.37:0/1432151057 conn(0x7fbf4c06c3a0 msgr2=0x7fbf4c0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:21.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 shutdown_connections 2024-05-10T08:45:21.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.207+0000 7fbf51685640 1 -- 172.21.15.37:0/1432151057 wait complete. 2024-05-10T08:45:21.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.321+0000 7fa715759640 1 Processor -- start 2024-05-10T08:45:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.321+0000 7fa715759640 1 -- start start 2024-05-10T08:45:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa715759640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa71015f420 0x7fa7100d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa715759640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d3ca0 0x7fa7100d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa715759640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7101630b0 con 0x7fa7100d1eb0 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa715759640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa7100d22f0 con 0x7fa71015f420 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa715759640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7100d2550 con 0x7fa7100d3ca0 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa70effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa71015f420 0x7fa7100d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa70effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa71015f420 0x7fa7100d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40466/0 (socket says 172.21.15.37:40466) 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa70f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa7100d1eb0 0x7fa7100d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48668/0 (socket says 172.21.15.37:48668) 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.322+0000 7fa70effd640 1 -- 172.21.15.37:0/2287702039 learned_addr learned my addr 172.21.15.37:0/2287702039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.323+0000 7fa70e7fc640 1 --2- 172.21.15.37:0/2287702039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d3ca0 0x7fa7100d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.323+0000 7fa70effd640 1 -- 172.21.15.37:0/2287702039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d3ca0 msgr2=0x7fa7100d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.323+0000 7fa70effd640 1 --2- 172.21.15.37:0/2287702039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d3ca0 0x7fa7100d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.323+0000 7fa70effd640 1 -- 172.21.15.37:0/2287702039 >> v1:172.21.15.37:6789/0 conn(0x7fa7100d1eb0 legacy=0x7fa7100d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.323+0000 7fa70effd640 1 -- 172.21.15.37:0/2287702039 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7100d2c80 con 0x7fa71015f420 2024-05-10T08:45:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.323+0000 7fa70effd640 1 --2- 172.21.15.37:0/2287702039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71015f420 0x7fa7100d3760 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa708009e50 tx=0x7fa70802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ce0676b8de3580 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa70dffb640 1 -- 172.21.15.37:0/2287702039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708036070 con 0x7fa71015f420 2024-05-10T08:45:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa70dffb640 1 -- 172.21.15.37:0/2287702039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa708031600 con 0x7fa71015f420 2024-05-10T08:45:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa70dffb640 1 -- 172.21.15.37:0/2287702039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7080319d0 con 0x7fa71015f420 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 -- 172.21.15.37:0/2287702039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71015f420 msgr2=0x7fa7100d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 --2- 172.21.15.37:0/2287702039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71015f420 0x7fa7100d3760 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa708009e50 tx=0x7fa70802a710 comp rx=0 tx=0).stop 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 -- 172.21.15.37:0/2287702039 shutdown_connections 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 --2- 172.21.15.37:0/2287702039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d3ca0 0x7fa7100d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 --2- 172.21.15.37:0/2287702039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71015f420 0x7fa7100d3760 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 -- 172.21.15.37:0/2287702039 >> 172.21.15.37:0/2287702039 conn(0x7fa71008eac0 msgr2=0x7fa71009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 -- 172.21.15.37:0/2287702039 shutdown_connections 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.324+0000 7fa715759640 1 -- 172.21.15.37:0/2287702039 wait complete. 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 Processor -- start 2024-05-10T08:45:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 -- start start 2024-05-10T08:45:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100d1eb0 0x7fa7100cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71014f5e0 0x7fa7100b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d0350 0x7fa7100d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7100d2830 con 0x7fa71014f5e0 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7100d3240 con 0x7fa7100d1eb0 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa715759640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7100d53d0 con 0x7fa7100d0350 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa70e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71014f5e0 0x7fa7100b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa70e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71014f5e0 0x7fa7100b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40482/0 (socket says 172.21.15.37:40482) 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.326+0000 7fa70e7fc640 1 -- 172.21.15.37:0/1522085414 learned_addr learned my addr 172.21.15.37:0/1522085414 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70f7fe640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d0350 0x7fa7100d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70e7fc640 1 -- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d0350 msgr2=0x7fa7100d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70e7fc640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d0350 0x7fa7100d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70e7fc640 1 -- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100d1eb0 msgr2=0x7fa7100cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70effd640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100d1eb0 0x7fa7100cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70e7fc640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100d1eb0 0x7fa7100cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70e7fc640 1 -- 172.21.15.37:0/1522085414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7100b8170 con 0x7fa71014f5e0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70effd640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100d1eb0 0x7fa7100cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa70e7fc640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71014f5e0 0x7fa7100b7c30 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800d800 tx=0x7fa6f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa7077fe640 1 -- 172.21.15.37:0/1522085414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800b6c0 con 0x7fa71014f5e0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa7077fe640 1 -- 172.21.15.37:0/1522085414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f8019070 con 0x7fa71014f5e0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7100b83f0 con 0x7fa71014f5e0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa7077fe640 1 -- 172.21.15.37:0/1522085414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800ba80 con 0x7fa71014f5e0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.327+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7100b89b0 con 0x7fa71014f5e0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.328+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7100693f0 con 0x7fa71014f5e0 2024-05-10T08:45:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.329+0000 7fa7077fe640 1 -- 172.21.15.37:0/1522085414 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa6f800bc20 con 0x7fa71014f5e0 2024-05-10T08:45:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.329+0000 7fa7077fe640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6f00762d0 0x7fa6f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.329+0000 7fa7077fe640 1 -- 172.21.15.37:0/1522085414 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fa6f8097c80 con 0x7fa71014f5e0 2024-05-10T08:45:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.329+0000 7fa70effd640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6f00762d0 0x7fa6f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.330+0000 7fa70effd640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6f00762d0 0x7fa6f0078790 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa708033000 tx=0x7fa708009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.333+0000 7fa7077fe640 1 -- 172.21.15.37:0/1522085414 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa7100b8170 con 0x7fa71014f5e0 2024-05-10T08:45:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.566+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7100b4c50 con 0x7fa71014f5e0 2024-05-10T08:45:21.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.567+0000 7fa7077fe640 1 -- 172.21.15.37:0/1522085414 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5182 (secure 0 0 0) 0x7fa6f8061400 con 0x7fa71014f5e0 2024-05-10T08:45:21.566 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:21.566 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:43:58.731926+0000","modified":"2024-05-10T08:44:50.735103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":14,"addr":"172.21.15.37:6835/3086098191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3086098191},{"type":"v1","addr":"172.21.15.37:6835","nonce":3086098191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":5}]} 2024-05-10T08:45:21.566 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 52 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6f00762d0 msgr2=0x7fa6f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6f00762d0 0x7fa6f0078790 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa708033000 tx=0x7fa708009000 comp rx=0 tx=0).stop 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71014f5e0 msgr2=0x7fa7100b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71014f5e0 0x7fa7100b7c30 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800d800 tx=0x7fa6f800dcc0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 shutdown_connections 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6f00762d0 0x7fa6f0078790 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7100d0350 0x7fa7100d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71014f5e0 0x7fa7100b7c30 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 --2- 172.21.15.37:0/1522085414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100d1eb0 0x7fa7100cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 >> 172.21.15.37:0/1522085414 conn(0x7fa71008eac0 msgr2=0x7fa71006e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:21.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 shutdown_connections 2024-05-10T08:45:21.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.569+0000 7fa715759640 1 -- 172.21.15.37:0/1522085414 wait complete. 2024-05-10T08:45:21.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:45:21.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.684+0000 7f0eb25a4640 1 Processor -- start 2024-05-10T08:45:21.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.684+0000 7f0eb25a4640 1 -- start start 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.684+0000 7f0eb25a4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eac15f420 0x7f0eac0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.684+0000 7f0eb25a4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eac1630b0 con 0x7f0eac0d3ca0 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.684+0000 7f0eb25a4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eac0d2550 con 0x7f0eac0d2080 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.684+0000 7f0eb25a4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0eac0d2c80 con 0x7f0eac15f420 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0ea3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0eac0d3ca0 0x7f0eac0d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48676/0 (socket says 172.21.15.37:48676) 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0ea3fff640 1 -- 172.21.15.37:0/869353201 learned_addr learned my addr 172.21.15.37:0/869353201 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0eabfff640 1 --2- 172.21.15.37:0/869353201 >> v2:172.21.15.82:3300/0 conn(0x7f0eac15f420 0x7f0eac0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0eab7fe640 1 -- 172.21.15.37:0/869353201 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375271015 0 0) 0x7f0e94001110 con 0x7f0eac0d3ca0 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0eab7fe640 1 -- 172.21.15.37:0/869353201 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e98003520 con 0x7f0eac0d3ca0 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0eab7fe640 1 -- 172.21.15.37:0/869353201 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2744104849 0 0) 0x7f0e98003520 con 0x7f0eac0d3ca0 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0eabfff640 1 -- 172.21.15.37:0/869353201 >> v1:172.21.15.82:6789/0 conn(0x7f0eac0d2080 legacy=0x7f0eac0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0eabfff640 1 -- 172.21.15.37:0/869353201 >> v1:172.21.15.37:6789/0 conn(0x7f0eac0d3ca0 legacy=0x7f0eac0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.685+0000 7f0eabfff640 1 -- 172.21.15.37:0/869353201 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac0d2f60 con 0x7f0eac15f420 2024-05-10T08:45:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.686+0000 7f0eabfff640 1 --2- 172.21.15.37:0/869353201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac15f420 0x7f0eac0d3760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0097a0 tx=0x7f0e9c02a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664172e58cb857f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.686+0000 7f0eab7fe640 1 -- 172.21.15.37:0/869353201 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c037070 con 0x7f0eac15f420 2024-05-10T08:45:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.686+0000 7f0eab7fe640 1 -- 172.21.15.37:0/869353201 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9c02ab60 con 0x7f0eac15f420 2024-05-10T08:45:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.686+0000 7f0eab7fe640 1 -- 172.21.15.37:0/869353201 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94001840 con 0x7f0eac15f420 2024-05-10T08:45:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.687+0000 7f0eb25a4640 1 -- 172.21.15.37:0/869353201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac15f420 msgr2=0x7f0eac0d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.687+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/869353201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac15f420 0x7f0eac0d3760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0097a0 tx=0x7f0e9c02a0d0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.687+0000 7f0eb25a4640 1 -- 172.21.15.37:0/869353201 shutdown_connections 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.687+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/869353201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac15f420 0x7f0eac0d3760 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.687+0000 7f0eb25a4640 1 -- 172.21.15.37:0/869353201 >> 172.21.15.37:0/869353201 conn(0x7f0eac08eac0 msgr2=0x7f0eac09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.687+0000 7f0eb25a4640 1 -- 172.21.15.37:0/869353201 shutdown_connections 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.687+0000 7f0eb25a4640 1 -- 172.21.15.37:0/869353201 wait complete. 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.688+0000 7f0eb25a4640 1 Processor -- start 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.688+0000 7f0eb25a4640 1 -- start start 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb25a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d2080 0x7f0eac0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb25a4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eac14a620 0x7f0eac0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb25a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eac0b3a30 0x7f0eac14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb25a4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac0d53d0 con 0x7f0eac0b3a30 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb25a4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac0d2830 con 0x7f0eac0d2080 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb25a4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0eac0d5550 con 0x7f0eac14a620 2024-05-10T08:45:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eac0b3a30 0x7f0eac14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eac0b3a30 0x7f0eac14ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40498/0 (socket says 172.21.15.37:40498) 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 -- 172.21.15.37:0/4266696238 learned_addr learned my addr 172.21.15.37:0/4266696238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0ea3fff640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eac14a620 0x7f0eac0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eabfff640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d2080 0x7f0eac0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 -- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eac14a620 msgr2=0x7f0eac0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eac14a620 0x7f0eac0b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 -- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d2080 msgr2=0x7f0eac0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d2080 0x7f0eac0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 -- 172.21.15.37:0/4266696238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac0c8b80 con 0x7f0eac0b3a30 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.689+0000 7f0eb0b41640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eac0b3a30 0x7f0eac14ac20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400c890 tx=0x7f0ea400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.690+0000 7f0ea97fa640 1 -- 172.21.15.37:0/4266696238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4018070 con 0x7f0eac0b3a30 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.690+0000 7f0ea97fa640 1 -- 172.21.15.37:0/4266696238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea4003da0 con 0x7f0eac0b3a30 2024-05-10T08:45:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.690+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eac0c8e60 con 0x7f0eac0b3a30 2024-05-10T08:45:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.690+0000 7f0ea97fa640 1 -- 172.21.15.37:0/4266696238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4006d30 con 0x7f0eac0b3a30 2024-05-10T08:45:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.690+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eac0b2fd0 con 0x7f0eac0b3a30 2024-05-10T08:45:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.691+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eac0b31d0 con 0x7f0eac0b3a30 2024-05-10T08:45:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.691+0000 7f0ea97fa640 1 -- 172.21.15.37:0/4266696238 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ea4005070 con 0x7f0eac0b3a30 2024-05-10T08:45:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.692+0000 7f0ea97fa640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0e8c0762d0 0x7f0e8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.692+0000 7f0ea97fa640 1 -- 172.21.15.37:0/4266696238 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f0ea4096d80 con 0x7f0eac0b3a30 2024-05-10T08:45:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.692+0000 7f0eabfff640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0e8c0762d0 0x7f0e8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.693+0000 7f0eabfff640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0e8c0762d0 0x7f0e8c078790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c034000 tx=0x7f0e9c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.696+0000 7f0ea97fa640 1 -- 172.21.15.37:0/4266696238 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0eac0b31d0 con 0x7f0eac0b3a30 2024-05-10T08:45:21.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.890+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0eac0693f0 con 0x7f0eac0b3a30 2024-05-10T08:45:21.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.892+0000 7f0ea97fa640 1 -- 172.21.15.37:0/4266696238 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17014 (secure 0 0 0) 0x7f0ea405fe30 con 0x7f0eac0b3a30 2024-05-10T08:45:21.891 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:21.891 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:44:07.977481+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:43:56.387579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-10T08:43:57.685327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3151779785":"2024-05-11T08:44:07.977457+0000","172.21.15.37:6833/3151779785":"2024-05-11T08:44:07.977457+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:45:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0e8c0762d0 msgr2=0x7f0e8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0e8c0762d0 0x7f0e8c078790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c034000 tx=0x7f0e9c02e000 comp rx=0 tx=0).stop 2024-05-10T08:45:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eac0b3a30 msgr2=0x7f0eac14ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eac0b3a30 0x7f0eac14ac20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400c890 tx=0x7f0ea400cd50 comp rx=0 tx=0).stop 2024-05-10T08:45:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 shutdown_connections 2024-05-10T08:45:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0e8c0762d0 0x7f0e8c078790 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eac0b3a30 0x7f0eac14ac20 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0eac14a620 0x7f0eac0b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 --2- 172.21.15.37:0/4266696238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d2080 0x7f0eac0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 >> 172.21.15.37:0/4266696238 conn(0x7f0eac08eac0 msgr2=0x7f0eac06e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 shutdown_connections 2024-05-10T08:45:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:21.894+0000 7f0eb25a4640 1 -- 172.21.15.37:0/4266696238 wait complete. 2024-05-10T08:45:21.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:45:22.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.010+0000 7f0390f9d640 1 Processor -- start 2024-05-10T08:45:22.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.010+0000 7f0390f9d640 1 -- start start 2024-05-10T08:45:22.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.011+0000 7f0390f9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f038c072840 0x7f038c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.011+0000 7f0390f9d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c15c920 con 0x7f038c06e4d0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.011+0000 7f0390f9d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c15cc00 con 0x7f038c06e0f0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.011+0000 7f0390f9d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f038c15cee0 con 0x7f038c072840 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.011+0000 7f038ad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f038c06e4d0 0x7f038c0aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48692/0 (socket says 172.21.15.37:48692) 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.011+0000 7f038ad9d640 1 -- 172.21.15.37:0/1352793462 learned_addr learned my addr 172.21.15.37:0/1352793462 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119732376 0 0) 0x7f038c15c920 con 0x7f038c06e4d0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f0389d9b640 1 --2- 172.21.15.37:0/1352793462 >> v2:172.21.15.82:3300/0 conn(0x7f038c072840 0x7f038c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0374003520 con 0x7f038c06e4d0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 527034347 0 0) 0x7f0374003520 con 0x7f038c06e4d0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 >> v2:172.21.15.82:3300/0 conn(0x7f038c072840 msgr2=0x7f038c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 --2- 172.21.15.37:0/1352793462 >> v2:172.21.15.82:3300/0 conn(0x7f038c072840 0x7f038c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 >> v1:172.21.15.82:6789/0 conn(0x7f038c06e0f0 legacy=0x7f038c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c15d1c0 con 0x7f038c06e4d0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f03840019f0 con 0x7f038c06e4d0 2024-05-10T08:45:22.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 >> v1:172.21.15.37:6789/0 conn(0x7f038c06e4d0 legacy=0x7f038c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0374003a00 0x7f0374003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f0374004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03740051c0 0x7f037400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f038c15cee0 con 0x7f0374004800 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f037400c0c0 con 0x7f03740051c0 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f037400c2c0 con 0x7f0374003a00 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f0389d9b640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f0374004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038a59c640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0374003a00 0x7f0374003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038ad9d640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03740051c0 0x7f037400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f0389d9b640 1 -- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0374003a00 msgr2=0x7f0374003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f0389d9b640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0374003a00 0x7f0374003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f0389d9b640 1 -- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03740051c0 msgr2=0x7f037400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f0389d9b640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03740051c0 0x7f037400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f0389d9b640 1 -- 172.21.15.37:0/1352793462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0374003520 con 0x7f0374004800 2024-05-10T08:45:22.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.012+0000 7f038ad9d640 1 -- 172.21.15.37:0/1352793462 reap_dead start 2024-05-10T08:45:22.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.013+0000 7f0389d9b640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f0374004c80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f038000bf90 tx=0x7f0374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79fa76966d4be40 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:22.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.013+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380038070 con 0x7f0374004800 2024-05-10T08:45:22.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.013+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0380033600 con 0x7f0374004800 2024-05-10T08:45:22.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.013+0000 7f038959a640 1 -- 172.21.15.37:0/1352793462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038000bc10 con 0x7f0374004800 2024-05-10T08:45:22.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.014+0000 7f0390f9d640 1 -- 172.21.15.37:0/1352793462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 msgr2=0x7f0374004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.014+0000 7f0390f9d640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f0374004c80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f038000bf90 tx=0x7f0374005830 comp rx=0 tx=0).stop 2024-05-10T08:45:22.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.014+0000 7f0390f9d640 1 -- 172.21.15.37:0/1352793462 shutdown_connections 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.014+0000 7f0390f9d640 1 --2- 172.21.15.37:0/1352793462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f0374004c80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.014+0000 7f0390f9d640 1 -- 172.21.15.37:0/1352793462 >> 172.21.15.37:0/1352793462 conn(0x7f038c06c3a0 msgr2=0x7f038c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.014+0000 7f0390f9d640 1 -- 172.21.15.37:0/1352793462 shutdown_connections 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.014+0000 7f0390f9d640 1 -- 172.21.15.37:0/1352793462 wait complete. 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.015+0000 7f0390f9d640 1 Processor -- start 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.015+0000 7f0390f9d640 1 -- start start 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f0390f9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f038c140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f0390f9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f038c143890 0x7f038c1f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f0390f9d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f038c1f42e0 0x7f038c15e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f0390f9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0ae7d0 con 0x7f0374004800 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f0390f9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0ae650 con 0x7f038c143890 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f0390f9d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f038c1530b0 con 0x7f038c1f42e0 2024-05-10T08:45:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f038a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f038c140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f038a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f038c140690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40516/0 (socket says 172.21.15.37:40516) 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.016+0000 7f038a59c640 1 -- 172.21.15.37:0/2543076997 learned_addr learned my addr 172.21.15.37:0/2543076997 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f038a59c640 1 -- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f038c1f42e0 msgr2=0x7f038c15e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f038a59c640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f038c1f42e0 0x7f038c15e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f038a59c640 1 -- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f038c143890 msgr2=0x7f038c1f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f0389d9b640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f038c143890 0x7f038c1f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f038a59c640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f038c143890 0x7f038c1f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f038a59c640 1 -- 172.21.15.37:0/2543076997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c1f4760 con 0x7f0374004800 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f0389d9b640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f038c143890 0x7f038c1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f038a59c640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f038c140690 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f037c00f570 tx=0x7f037c00fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f037affd640 1 -- 172.21.15.37:0/2543076997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0052e0 con 0x7f0374004800 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f037affd640 1 -- 172.21.15.37:0/2543076997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c018070 con 0x7f0374004800 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f037affd640 1 -- 172.21.15.37:0/2543076997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c003810 con 0x7f0374004800 2024-05-10T08:45:22.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c1f4a40 con 0x7f0374004800 2024-05-10T08:45:22.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.017+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c154e40 con 0x7f0374004800 2024-05-10T08:45:22.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.018+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c0693f0 con 0x7f0374004800 2024-05-10T08:45:22.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.019+0000 7f037affd640 1 -- 172.21.15.37:0/2543076997 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f037c0039b0 con 0x7f0374004800 2024-05-10T08:45:22.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.019+0000 7f037affd640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f036c0762d0 0x7f036c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.019+0000 7f037affd640 1 -- 172.21.15.37:0/2543076997 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f037c097510 con 0x7f0374004800 2024-05-10T08:45:22.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.019+0000 7f0389d9b640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f036c0762d0 0x7f036c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.020+0000 7f0389d9b640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f036c0762d0 0x7f036c078790 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0380035000 tx=0x7f0380030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:22.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.023+0000 7f037affd640 1 -- 172.21.15.37:0/2543076997 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f037c060c90 con 0x7f0374004800 2024-05-10T08:45:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.253+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f038c0b5a10 con 0x7f0374004800 2024-05-10T08:45:22.253 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:45:22.254+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:45:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.258+0000 7f037affd640 1 -- 172.21.15.37:0/2543076997 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) ==== 161+0+0 (secure 0 0 0) 0x7f037c060590 con 0x7f0374004800 2024-05-10T08:45:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:45:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.259+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f036c0762d0 msgr2=0x7f036c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.259+0000 7f0390f9d640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f036c0762d0 0x7f036c078790 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0380035000 tx=0x7f0380030000 comp rx=0 tx=0).stop 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.259+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 msgr2=0x7f038c140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.259+0000 7f0390f9d640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f038c140690 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f037c00f570 tx=0x7f037c00fa30 comp rx=0 tx=0).stop 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 shutdown_connections 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f036c0762d0 0x7f036c078790 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f038c1f42e0 0x7f038c15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f038c143890 0x7f038c1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 --2- 172.21.15.37:0/2543076997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0374004800 0x7f038c140690 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 >> 172.21.15.37:0/2543076997 conn(0x7f038c06c3a0 msgr2=0x7f038c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 shutdown_connections 2024-05-10T08:45:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.260+0000 7f0390f9d640 1 -- 172.21.15.37:0/2543076997 wait complete. 2024-05-10T08:45:22.263 INFO:tasks.ceph.mds.c.smithi037.stderr: -4007> 2024-05-10T08:44:13.727+0000 7fa7141e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:45:22.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:45:22.297 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:45:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.384+0000 7fa6acb91640 1 Processor -- start 2024-05-10T08:45:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.384+0000 7fa6acb91640 1 -- start start 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6acb91640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 0x7fa6a80b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6acb91640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a809ff30 con 0x7fa6a80aedf0 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6acb91640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a815d750 con 0x7fa6a815d180 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6acb91640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a815e360 con 0x7fa6a806c3a0 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a5d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa6a80aedf0 0x7fa6a806c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48712/0 (socket says 172.21.15.37:48712) 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a5d9b640 1 -- 172.21.15.37:0/4279667455 learned_addr learned my addr 172.21.15.37:0/4279667455 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a659c640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 0x7fa6a80b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893416916 0 0) 0x7fa6a809ff30 con 0x7fa6a80aedf0 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa690003520 con 0x7fa6a80aedf0 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2631898817 0 0) 0x7fa690003520 con 0x7fa6a80aedf0 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 msgr2=0x7fa6a80b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 0x7fa6a80b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 >> v1:172.21.15.82:6789/0 conn(0x7fa6a815d180 legacy=0x7fa6a80b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a815da30 con 0x7fa6a80aedf0 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fa69c001670 con 0x7fa6a80aedf0 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 >> v1:172.21.15.37:6789/0 conn(0x7fa6a80aedf0 legacy=0x7fa6a806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.385+0000 7fa6a559a640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa690003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a559a640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 0x7fa690004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a559a640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa690004d40 0x7fa6900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a815e360 con 0x7fa6900039e0 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa69000ba70 con 0x7fa690004d40 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa69000bc70 con 0x7fa6a806c3a0 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a659c640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa690003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a5d9b640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 0x7fa690004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a6d9d640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa690004d40 0x7fa6900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a659c640 1 -- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 msgr2=0x7fa690004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a659c640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a806c3a0 0x7fa690004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a659c640 1 -- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa690004d40 msgr2=0x7fa6900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a659c640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa690004d40 0x7fa6900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.386+0000 7fa6a659c640 1 -- 172.21.15.37:0/4279667455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa690003520 con 0x7fa6900039e0 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6a659c640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa690003e00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa698009a90 tx=0x7fa690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52656125b23d463 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698036070 con 0x7fa6900039e0 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa698031400 con 0x7fa6900039e0 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6a559a640 1 -- 172.21.15.37:0/4279667455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698009690 con 0x7fa6900039e0 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6acb91640 1 -- 172.21.15.37:0/4279667455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 msgr2=0x7fa690003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6acb91640 1 --2- 172.21.15.37:0/4279667455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa690003e00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa698009a90 tx=0x7fa690005830 comp rx=0 tx=0).stop 2024-05-10T08:45:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6a6d9d640 1 -- 172.21.15.37:0/4279667455 reap_dead start 2024-05-10T08:45:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6acb91640 1 -- 172.21.15.37:0/4279667455 shutdown_connections 2024-05-10T08:45:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6acb91640 1 -- 172.21.15.37:0/4279667455 >> 172.21.15.37:0/4279667455 conn(0x7fa6a80b3b10 msgr2=0x7fa6a80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6acb91640 1 -- 172.21.15.37:0/4279667455 shutdown_connections 2024-05-10T08:45:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.387+0000 7fa6acb91640 1 -- 172.21.15.37:0/4279667455 wait complete. 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.389+0000 7fa6acb91640 1 Processor -- start 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.389+0000 7fa6acb91640 1 -- start start 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa6a8148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6a815b780 0x7fa6a8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a80d2110 0x7fa6a80d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a80b13f0 con 0x7fa6900039e0 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a815dff0 con 0x7fa6a815b780 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a80b1570 con 0x7fa6a80d2110 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa6a8148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa6a8148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40540/0 (socket says 172.21.15.37:40540) 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 -- 172.21.15.37:0/2004967206 learned_addr learned my addr 172.21.15.37:0/2004967206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a6d9d640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a80d2110 0x7fa6a80d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a5d9b640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6a815b780 0x7fa6a8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 -- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a80d2110 msgr2=0x7fa6a80d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a80d2110 0x7fa6a80d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 -- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6a815b780 msgr2=0x7fa6a8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6a815b780 0x7fa6a8159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 -- 172.21.15.37:0/2004967206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a815b060 con 0x7fa6900039e0 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a6d9d640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a80d2110 0x7fa6a80d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a5d9b640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6a815b780 0x7fa6a8159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6a659c640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa6a8148840 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa698034040 tx=0x7fa698004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa696ffd640 1 -- 172.21.15.37:0/2004967206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698040020 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa696ffd640 1 -- 172.21.15.37:0/2004967206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa698003bc0 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a815a7c0 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa696ffd640 1 -- 172.21.15.37:0/2004967206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698036040 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.390+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a815ad80 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.391+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a806a8f0 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.392+0000 7fa696ffd640 1 -- 172.21.15.37:0/2004967206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa698043020 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.393+0000 7fa696ffd640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6880762d0 0x7fa688078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.393+0000 7fa696ffd640 1 -- 172.21.15.37:0/2004967206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6273+0+0 (secure 0 0 0) 0x7fa6980b7820 con 0x7fa6900039e0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.393+0000 7fa6a5d9b640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6880762d0 0x7fa688078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.393+0000 7fa6a5d9b640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6880762d0 0x7fa688078790 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa6a815bbc0 tx=0x7fa69c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:22.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.397+0000 7fa696ffd640 1 -- 172.21.15.37:0/2004967206 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa69804a070 con 0x7fa6900039e0 2024-05-10T08:45:22.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:22.626+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa6a8159430 con 0x7fa6900039e0 2024-05-10T08:45:23.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.259+0000 7fa696ffd640 1 -- 172.21.15.37:0/2004967206 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) ==== 104+0+0 (secure 0 0 0) 0x7fa6980044e0 con 0x7fa6900039e0 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6880762d0 msgr2=0x7fa688078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6880762d0 0x7fa688078790 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa6a815bbc0 tx=0x7fa69c009040 comp rx=0 tx=0).stop 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 msgr2=0x7fa6a8148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa6a8148840 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa698034040 tx=0x7fa698004730 comp rx=0 tx=0).stop 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 shutdown_connections 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa6880762d0 0x7fa688078790 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa6a80d2110 0x7fa6a80d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6a815b780 0x7fa6a8159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 --2- 172.21.15.37:0/2004967206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6900039e0 0x7fa6a8148840 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 >> 172.21.15.37:0/2004967206 conn(0x7fa6a80b3b10 msgr2=0x7fa6a815f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 shutdown_connections 2024-05-10T08:45:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.261+0000 7fa6acb91640 1 -- 172.21.15.37:0/2004967206 wait complete. 2024-05-10T08:45:23.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.427+0000 7f18d82e1640 1 Processor -- start 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.427+0000 7f18d82e1640 1 -- start start 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d82e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 0x7f18d0070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d82e1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18d00cef40 0x7f18d0169b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d82e1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d00d2030 con 0x7f18d00cf8f0 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d82e1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f18d015f8d0 con 0x7f18d00cef40 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d82e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f18d00d22b0 con 0x7f18d00d3920 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d687e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18d00cef40 0x7f18d0169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d607d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f18d00cf8f0 0x7f18d0070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48728/0 (socket says 172.21.15.37:48728) 2024-05-10T08:45:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d607d640 1 -- 172.21.15.37:0/2401676819 learned_addr learned my addr 172.21.15.37:0/2401676819 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.428+0000 7f18d587c640 1 --2- 172.21.15.37:0/2401676819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 0x7f18d0070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.429+0000 7f18d687e640 1 -- 172.21.15.37:0/2401676819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 msgr2=0x7f18d0070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.429+0000 7f18d687e640 1 --2- 172.21.15.37:0/2401676819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 0x7f18d0070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.429+0000 7f18d687e640 1 -- 172.21.15.37:0/2401676819 >> v1:172.21.15.37:6789/0 conn(0x7f18d00cf8f0 legacy=0x7f18d0070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.429+0000 7f18d687e640 1 -- 172.21.15.37:0/2401676819 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d00d2590 con 0x7f18d00cef40 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.429+0000 7f18d507b640 1 -- 172.21.15.37:0/2401676819 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186350468 0 0) 0x7f18c8001110 con 0x7f18d00cf8f0 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.429+0000 7f18d687e640 1 --2- 172.21.15.37:0/2401676819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d0169b30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009d90 tx=0x7f18c002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983b22adc3d977fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d507b640 1 -- 172.21.15.37:0/2401676819 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0007740 con 0x7f18d00cef40 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d507b640 1 -- 172.21.15.37:0/2401676819 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c00078e0 con 0x7f18d00cef40 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d507b640 1 -- 172.21.15.37:0/2401676819 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0007cb0 con 0x7f18d00cef40 2024-05-10T08:45:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 -- 172.21.15.37:0/2401676819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 msgr2=0x7f18d0169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2401676819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d0169b30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009d90 tx=0x7f18c002a6f0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 -- 172.21.15.37:0/2401676819 shutdown_connections 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2401676819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d0169b30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2401676819 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 0x7f18d0070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 -- 172.21.15.37:0/2401676819 >> 172.21.15.37:0/2401676819 conn(0x7f18d00d2e00 msgr2=0x7f18d00d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 -- 172.21.15.37:0/2401676819 shutdown_connections 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.430+0000 7f18d82e1640 1 -- 172.21.15.37:0/2401676819 wait complete. 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.431+0000 7f18d82e1640 1 Processor -- start 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.431+0000 7f18d82e1640 1 -- start start 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d82e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d00a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d82e1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18d00cf8f0 0x7f18d00cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d82e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 0x7f18d015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d82e1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00cda10 con 0x7f18d00cef40 2024-05-10T08:45:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d82e1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00cd730 con 0x7f18d00cf8f0 2024-05-10T08:45:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d82e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f18d0071610 con 0x7f18d00d3920 2024-05-10T08:45:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d607d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d00a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d607d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d00a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40548/0 (socket says 172.21.15.37:40548) 2024-05-10T08:45:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d607d640 1 -- 172.21.15.37:0/2198954122 learned_addr learned my addr 172.21.15.37:0/2198954122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d607d640 1 -- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 msgr2=0x7f18d015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d607d640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 0x7f18d015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d607d640 1 -- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18d00cf8f0 msgr2=0x7f18d00cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.432+0000 7f18d607d640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18d00cf8f0 0x7f18d00cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.433+0000 7f18d607d640 1 -- 172.21.15.37:0/2198954122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d00a0b80 con 0x7f18d00cef40 2024-05-10T08:45:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.433+0000 7f18d607d640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d00a0640 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c460 tx=0x7f18c800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.433+0000 7f18ceffd640 1 -- 172.21.15.37:0/2198954122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8018070 con 0x7f18d00cef40 2024-05-10T08:45:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.433+0000 7f18ceffd640 1 -- 172.21.15.37:0/2198954122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c8007500 con 0x7f18d00cef40 2024-05-10T08:45:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.433+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d00cc1c0 con 0x7f18d00cef40 2024-05-10T08:45:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.433+0000 7f18ceffd640 1 -- 172.21.15.37:0/2198954122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8004a20 con 0x7f18d00cef40 2024-05-10T08:45:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.433+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d00cc780 con 0x7f18d00cef40 2024-05-10T08:45:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.434+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d00693f0 con 0x7f18d00cef40 2024-05-10T08:45:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.434+0000 7f18ceffd640 1 -- 172.21.15.37:0/2198954122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18c801b070 con 0x7f18d00cef40 2024-05-10T08:45:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.435+0000 7f18ceffd640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18bc0762d0 0x7f18bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.435+0000 7f18ceffd640 1 -- 172.21.15.37:0/2198954122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6273+0+0 (secure 0 0 0) 0x7f18c8096a80 con 0x7f18d00cef40 2024-05-10T08:45:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.435+0000 7f18d587c640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18bc0762d0 0x7f18bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.436+0000 7f18d587c640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18bc0762d0 0x7f18bc078790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f18c4006a90 tx=0x7f18c4006a20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.439+0000 7f18ceffd640 1 -- 172.21.15.37:0/2198954122 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f18d00d2030 con 0x7f18d00cef40 2024-05-10T08:45:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:23.630+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f18d006dfa0 con 0x7f18d00cef40 2024-05-10T08:45:23.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:45:23.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:45:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.263+0000 7f18ceffd640 1 -- 172.21.15.37:0/2198954122 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7f18c80601a0 con 0x7f18d00cef40 2024-05-10T08:45:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:45:24.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18bc0762d0 msgr2=0x7f18bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18bc0762d0 0x7f18bc078790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f18c4006a90 tx=0x7f18c4006a20 comp rx=0 tx=0).stop 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 msgr2=0x7f18d00a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d00a0640 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c460 tx=0x7f18c800c920 comp rx=0 tx=0).stop 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 shutdown_connections 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f18bc0762d0 0x7f18bc078790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18d00d3920 0x7f18d015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18d00cf8f0 0x7f18d00cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 --2- 172.21.15.37:0/2198954122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00cef40 0x7f18d00a0640 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 >> 172.21.15.37:0/2198954122 conn(0x7f18d00d2e00 msgr2=0x7f18d015dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 shutdown_connections 2024-05-10T08:45:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.267+0000 7f18d82e1640 1 -- 172.21.15.37:0/2198954122 wait complete. 2024-05-10T08:45:24.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:45:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.390+0000 7fe01bf5f640 1 Processor -- start 2024-05-10T08:45:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.391+0000 7fe01bf5f640 1 -- start start 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.391+0000 7fe01bf5f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe014162b70 0x7fe0140d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.391+0000 7fe01bf5f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe014162f50 con 0x7fe0140d3910 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.391+0000 7fe01bf5f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0140d3ee0 con 0x7fe0140d3480 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.391+0000 7fe01bf5f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe0140d1f60 con 0x7fe014162b70 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe019cfb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe014162b70 0x7fe0140d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe019cfb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe014162b70 0x7fe0140d2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40558/0 (socket says 172.21.15.37:40558) 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe019cfb640 1 -- 172.21.15.37:0/1249566616 learned_addr learned my addr 172.21.15.37:0/1249566616 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe01a4fc640 1 --1- 172.21.15.37:0/1249566616 >> v1:172.21.15.37:6789/0 conn(0x7fe0140d3910 0x7fe0140b5150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48730/0 (socket says 172.21.15.37:48730) 2024-05-10T08:45:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe019cfb640 1 -- 172.21.15.37:0/1249566616 >> v1:172.21.15.82:6789/0 conn(0x7fe0140d3480 legacy=0x7fe0140b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe019cfb640 1 -- 172.21.15.37:0/1249566616 >> v1:172.21.15.37:6789/0 conn(0x7fe0140d3910 legacy=0x7fe0140b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe019cfb640 1 -- 172.21.15.37:0/1249566616 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0140d21b0 con 0x7fe014162b70 2024-05-10T08:45:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.392+0000 7fe018cf9640 1 -- 172.21.15.37:0/1249566616 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188091895 0 0) 0x7fe004001490 con 0x7fe0140d3910 2024-05-10T08:45:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe019cfb640 1 --2- 172.21.15.37:0/1249566616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe014162b70 0x7fe0140d2f40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009870 tx=0x7fe00c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eb068a1c4ad3b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe018cf9640 1 -- 172.21.15.37:0/1249566616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c037070 con 0x7fe014162b70 2024-05-10T08:45:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe018cf9640 1 -- 172.21.15.37:0/1249566616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c032440 con 0x7fe014162b70 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe018cf9640 1 -- 172.21.15.37:0/1249566616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c032810 con 0x7fe014162b70 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe01bf5f640 1 -- 172.21.15.37:0/1249566616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe014162b70 msgr2=0x7fe0140d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/1249566616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe014162b70 0x7fe0140d2f40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009870 tx=0x7fe00c02a2a0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe01bf5f640 1 -- 172.21.15.37:0/1249566616 shutdown_connections 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/1249566616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe014162b70 0x7fe0140d2f40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe01bf5f640 1 -- 172.21.15.37:0/1249566616 >> 172.21.15.37:0/1249566616 conn(0x7fe0140d5040 msgr2=0x7fe0140d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe01bf5f640 1 -- 172.21.15.37:0/1249566616 shutdown_connections 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.393+0000 7fe01bf5f640 1 -- 172.21.15.37:0/1249566616 wait complete. 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 Processor -- start 2024-05-10T08:45:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 -- start start 2024-05-10T08:45:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0140d3480 0x7fe0140ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0140d3910 0x7fe0140b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe014162b70 0x7fe0140b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0140b42f0 con 0x7fe0140d3910 2024-05-10T08:45:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0140b4170 con 0x7fe0140d3480 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe01bf5f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0140b5860 con 0x7fe014162b70 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.395+0000 7fe0194fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0140d3910 0x7fe0140b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0140d3910 0x7fe0140b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40570/0 (socket says 172.21.15.37:40570) 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 -- 172.21.15.37:0/2046993072 learned_addr learned my addr 172.21.15.37:0/2046993072 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe019cfb640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0140d3480 0x7fe0140ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe01a4fc640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe014162b70 0x7fe0140b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 -- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe014162b70 msgr2=0x7fe0140b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe014162b70 0x7fe0140b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 -- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0140d3480 msgr2=0x7fe0140ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0140d3480 0x7fe0140ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 -- 172.21.15.37:0/2046993072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0140b7f40 con 0x7fe0140d3910 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0194fa640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0140d3910 0x7fe0140b77c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c430 tx=0x7fe00800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0127fc640 1 -- 172.21.15.37:0/2046993072 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008011790 con 0x7fe0140d3910 2024-05-10T08:45:24.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0127fc640 1 -- 172.21.15.37:0/2046993072 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe008017070 con 0x7fe0140d3910 2024-05-10T08:45:24.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0140b8220 con 0x7fe0140d3910 2024-05-10T08:45:24.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe0127fc640 1 -- 172.21.15.37:0/2046993072 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008011bb0 con 0x7fe0140d3910 2024-05-10T08:45:24.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.396+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0140b87e0 con 0x7fe0140d3910 2024-05-10T08:45:24.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.397+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0140693f0 con 0x7fe0140d3910 2024-05-10T08:45:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.398+0000 7fe0127fc640 1 -- 172.21.15.37:0/2046993072 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe00801c460 con 0x7fe0140d3910 2024-05-10T08:45:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.398+0000 7fe0127fc640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0000762d0 0x7fe000078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.399+0000 7fe0127fc640 1 -- 172.21.15.37:0/2046993072 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5835+0+0 (secure 0 0 0) 0x7fe008097470 con 0x7fe0140d3910 2024-05-10T08:45:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.399+0000 7fe019cfb640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0000762d0 0x7fe000078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.399+0000 7fe019cfb640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0000762d0 0x7fe000078790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe00c034000 tx=0x7fe00c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:24.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.403+0000 7fe0127fc640 1 -- 172.21.15.37:0/2046993072 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe008060660 con 0x7fe0140d3910 2024-05-10T08:45:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:24.591+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0140b8be0 con 0x7fe0140d3910 2024-05-10T08:45:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.265+0000 7fe0127fc640 1 -- 172.21.15.37:0/2046993072 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7fe008064960 con 0x7fe0140d3910 2024-05-10T08:45:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0000762d0 msgr2=0x7fe000078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0000762d0 0x7fe000078790 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe00c034000 tx=0x7fe00c02e000 comp rx=0 tx=0).stop 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0140d3910 msgr2=0x7fe0140b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0140d3910 0x7fe0140b77c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c430 tx=0x7fe00800c8f0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 shutdown_connections 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0000762d0 0x7fe000078790 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe014162b70 0x7fe0140b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0140d3910 0x7fe0140b77c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 --2- 172.21.15.37:0/2046993072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0140d3480 0x7fe0140ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.270+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 >> 172.21.15.37:0/2046993072 conn(0x7fe0140d5040 msgr2=0x7fe0140cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:25.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.272+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 shutdown_connections 2024-05-10T08:45:25.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.273+0000 7fe01bf5f640 1 -- 172.21.15.37:0/2046993072 wait complete. 2024-05-10T08:45:25.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T08:45:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.403+0000 7efe8c0da640 1 Processor -- start 2024-05-10T08:45:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.403+0000 7efe8c0da640 1 -- start start 2024-05-10T08:45:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe8c0da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe84070d30 0x7efe840d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe8c0da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84163920 0x7efe840703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe8c0da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe84071110 0x7efe8406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe8c0da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efe840d10d0 con 0x7efe84070d30 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe8c0da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efe84070b80 con 0x7efe84071110 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe8c0da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efe840d1c30 con 0x7efe84163920 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe84070d30 0x7efe840d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe84070d30 0x7efe840d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40578/0 (socket says 172.21.15.37:40578) 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 -- 172.21.15.37:0/2867246624 learned_addr learned my addr 172.21.15.37:0/2867246624 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89675640 1 --2- 172.21.15.37:0/2867246624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84163920 0x7efe840703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe8a677640 1 --2- 172.21.15.37:0/2867246624 >> v2:172.21.15.82:3300/0 conn(0x7efe84071110 0x7efe8406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 -- 172.21.15.37:0/2867246624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84163920 msgr2=0x7efe840703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 --2- 172.21.15.37:0/2867246624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84163920 0x7efe840703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 -- 172.21.15.37:0/2867246624 >> v2:172.21.15.82:3300/0 conn(0x7efe84071110 msgr2=0x7efe8406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 --2- 172.21.15.37:0/2867246624 >> v2:172.21.15.82:3300/0 conn(0x7efe84071110 0x7efe8406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.404+0000 7efe89e76640 1 -- 172.21.15.37:0/2867246624 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe84163d80 con 0x7efe84070d30 2024-05-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.405+0000 7efe89e76640 1 --2- 172.21.15.37:0/2867246624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840d20c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7efe84073310 tx=0x7efe8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b869c1916caec3b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.405+0000 7efe88e74640 1 -- 172.21.15.37:0/2867246624 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80037070 con 0x7efe84070d30 2024-05-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.405+0000 7efe88e74640 1 -- 172.21.15.37:0/2867246624 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe80032440 con 0x7efe84070d30 2024-05-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.405+0000 7efe88e74640 1 -- 172.21.15.37:0/2867246624 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80032810 con 0x7efe84070d30 2024-05-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 -- 172.21.15.37:0/2867246624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 msgr2=0x7efe840d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 --2- 172.21.15.37:0/2867246624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840d20c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7efe84073310 tx=0x7efe8002a1e0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 -- 172.21.15.37:0/2867246624 shutdown_connections 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 --2- 172.21.15.37:0/2867246624 >> v2:172.21.15.82:3300/0 conn(0x7efe84071110 0x7efe8406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 --2- 172.21.15.37:0/2867246624 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84163920 0x7efe840703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 --2- 172.21.15.37:0/2867246624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840d20c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 -- 172.21.15.37:0/2867246624 >> 172.21.15.37:0/2867246624 conn(0x7efe840d2e90 msgr2=0x7efe840d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 -- 172.21.15.37:0/2867246624 shutdown_connections 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.406+0000 7efe8c0da640 1 -- 172.21.15.37:0/2867246624 wait complete. 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.407+0000 7efe8c0da640 1 Processor -- start 2024-05-10T08:45:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.407+0000 7efe8c0da640 1 -- start start 2024-05-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe8c0da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe8c0da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84071110 0x7efe8406e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe8c0da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe84163920 0x7efe840cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe8c0da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe840d15e0 con 0x7efe84070d30 2024-05-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe8c0da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efe840708e0 con 0x7efe84163920 2024-05-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe8c0da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efe840d18c0 con 0x7efe84071110 2024-05-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40582/0 (socket says 172.21.15.37:40582) 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 -- 172.21.15.37:0/3926636804 learned_addr learned my addr 172.21.15.37:0/3926636804 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89675640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84071110 0x7efe8406e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 -- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84071110 msgr2=0x7efe8406e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe8a677640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe84163920 0x7efe840cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84071110 0x7efe8406e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 -- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe84163920 msgr2=0x7efe840cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe84163920 0x7efe840cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 -- 172.21.15.37:0/3926636804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe840ca1b0 con 0x7efe84070d30 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.408+0000 7efe89e76640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840caf70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7efe8002a220 tx=0x7efe800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.409+0000 7efe7a7fc640 1 -- 172.21.15.37:0/3926636804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80041020 con 0x7efe84070d30 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.409+0000 7efe7a7fc640 1 -- 172.21.15.37:0/3926636804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe800306c0 con 0x7efe84070d30 2024-05-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.409+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe840ca490 con 0x7efe84070d30 2024-05-10T08:45:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.409+0000 7efe7a7fc640 1 -- 172.21.15.37:0/3926636804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80037040 con 0x7efe84070d30 2024-05-10T08:45:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.409+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe840caa50 con 0x7efe84070d30 2024-05-10T08:45:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.410+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe840693f0 con 0x7efe84070d30 2024-05-10T08:45:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.410+0000 7efe7a7fc640 1 -- 172.21.15.37:0/3926636804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe80044020 con 0x7efe84070d30 2024-05-10T08:45:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.411+0000 7efe7a7fc640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe680762d0 0x7efe68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.411+0000 7efe7a7fc640 1 -- 172.21.15.37:0/3926636804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7efe800b7d10 con 0x7efe84070d30 2024-05-10T08:45:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.411+0000 7efe89675640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe680762d0 0x7efe68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.412+0000 7efe89675640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe680762d0 0x7efe68078790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efe841627f0 tx=0x7efe74008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.415+0000 7efe7a7fc640 1 -- 172.21.15.37:0/3926636804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efe8004b030 con 0x7efe84070d30 2024-05-10T08:45:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.608+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7efe840d3d70 con 0x7efe84070d30 2024-05-10T08:45:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.614+0000 7efe7a7fc640 1 -- 172.21.15.37:0/3926636804 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7efe80081790 con 0x7efe84070d30 2024-05-10T08:45:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe680762d0 msgr2=0x7efe68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe680762d0 0x7efe68078790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efe841627f0 tx=0x7efe74008040 comp rx=0 tx=0).stop 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 msgr2=0x7efe840caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840caf70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7efe8002a220 tx=0x7efe800046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 shutdown_connections 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe680762d0 0x7efe68078790 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe84163920 0x7efe840cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe84071110 0x7efe8406e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 --2- 172.21.15.37:0/3926636804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe84070d30 0x7efe840caf70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 >> 172.21.15.37:0/3926636804 conn(0x7efe840d2e90 msgr2=0x7efe84160a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 shutdown_connections 2024-05-10T08:45:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.616+0000 7efe8c0da640 1 -- 172.21.15.37:0/3926636804 wait complete. 2024-05-10T08:45:25.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-05-10T08:45:25.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.735+0000 7f5974bc8640 1 Processor -- start 2024-05-10T08:45:25.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.735+0000 7f5974bc8640 1 -- start start 2024-05-10T08:45:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.736+0000 7f5974bc8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f597006f130 0x7f5970160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.736+0000 7f5974bc8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5970160840 con 0x7f59700d0dd0 2024-05-10T08:45:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.736+0000 7f5974bc8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597006d5e0 con 0x7f59700d0300 2024-05-10T08:45:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.736+0000 7f5974bc8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f59700cf8b0 con 0x7f597006f130 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.736+0000 7f596e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f59700d0dd0 0x7f59700d11b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48744/0 (socket says 172.21.15.37:48744) 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596e59c640 1 -- 172.21.15.37:0/610708421 learned_addr learned my addr 172.21.15.37:0/610708421 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596dd9b640 1 --2- 172.21.15.37:0/610708421 >> v2:172.21.15.82:3300/0 conn(0x7f597006f130 0x7f5970160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518404775 0 0) 0x7f5970160840 con 0x7f59700d0dd0 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f595c003520 con 0x7f59700d0dd0 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200984801 0 0) 0x7f597006d5e0 con 0x7f59700d0300 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5970160840 con 0x7f59700d0300 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 666099167 0 0) 0x7f595c003520 con 0x7f59700d0dd0 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596dd9b640 1 -- 172.21.15.37:0/610708421 >> v1:172.21.15.82:6789/0 conn(0x7f59700d0300 legacy=0x7f59700d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596dd9b640 1 -- 172.21.15.37:0/610708421 >> v1:172.21.15.37:6789/0 conn(0x7f59700d0dd0 legacy=0x7f59700d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.737+0000 7f596dd9b640 1 -- 172.21.15.37:0/610708421 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597006d8c0 con 0x7f597006f130 2024-05-10T08:45:25.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.738+0000 7f596dd9b640 1 --2- 172.21.15.37:0/610708421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f5970160300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59580097a0 tx=0x7f595802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d89fc065dda53e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.738+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958037070 con 0x7f597006f130 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.738+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595802abc0 con 0x7f597006f130 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.738+0000 7f596d59a640 1 -- 172.21.15.37:0/610708421 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680019f0 con 0x7f597006f130 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.739+0000 7f5974bc8640 1 -- 172.21.15.37:0/610708421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 msgr2=0x7f5970160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.739+0000 7f5974bc8640 1 --2- 172.21.15.37:0/610708421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f5970160300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59580097a0 tx=0x7f595802a130 comp rx=0 tx=0).stop 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.739+0000 7f5974bc8640 1 -- 172.21.15.37:0/610708421 shutdown_connections 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.739+0000 7f5974bc8640 1 --2- 172.21.15.37:0/610708421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f5970160300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.739+0000 7f5974bc8640 1 -- 172.21.15.37:0/610708421 >> 172.21.15.37:0/610708421 conn(0x7f597009ba40 msgr2=0x7f597009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.739+0000 7f5974bc8640 1 -- 172.21.15.37:0/610708421 shutdown_connections 2024-05-10T08:45:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.739+0000 7f5974bc8640 1 -- 172.21.15.37:0/610708421 wait complete. 2024-05-10T08:45:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.740+0000 7f5974bc8640 1 Processor -- start 2024-05-10T08:45:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.740+0000 7f5974bc8640 1 -- start start 2024-05-10T08:45:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f5974bc8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f597014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f5974bc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59700d0300 0x7f59701598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f5974bc8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59700d0dd0 0x7f59701f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f5974bc8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59700d3d60 con 0x7f59700d0300 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f5974bc8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f597015d330 con 0x7f597006f130 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f5974bc8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f59700d2de0 con 0x7f59700d0dd0 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59700d0300 0x7f59701598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59700d0300 0x7f59701598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40590/0 (socket says 172.21.15.37:40590) 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 -- 172.21.15.37:0/942527120 learned_addr learned my addr 172.21.15.37:0/942527120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596e59c640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f597014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596ed9d640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59700d0dd0 0x7f59701f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 -- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59700d0dd0 msgr2=0x7f59701f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59700d0dd0 0x7f59701f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 -- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 msgr2=0x7f597014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f597014db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596dd9b640 1 -- 172.21.15.37:0/942527120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59701f5fe0 con 0x7f59700d0300 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596ed9d640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59700d0dd0 0x7f59701f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.741+0000 7f596e59c640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f597014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.742+0000 7f596dd9b640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59700d0300 0x7f59701598b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f59580098c0 tx=0x7f59580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.742+0000 7f5966ffd640 1 -- 172.21.15.37:0/942527120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958037050 con 0x7f59700d0300 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.742+0000 7f5966ffd640 1 -- 172.21.15.37:0/942527120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5958043070 con 0x7f59700d0300 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.742+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5970158810 con 0x7f59700d0300 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.742+0000 7f5966ffd640 1 -- 172.21.15.37:0/942527120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958006e10 con 0x7f59700d0300 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.742+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5970158dd0 con 0x7f59700d0300 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.743+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5970069b00 con 0x7f59700d0300 2024-05-10T08:45:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.744+0000 7f5966ffd640 1 -- 172.21.15.37:0/942527120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f595803ca10 con 0x7f59700d0300 2024-05-10T08:45:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.744+0000 7f5966ffd640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59500762d0 0x7f5950078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.744+0000 7f5966ffd640 1 -- 172.21.15.37:0/942527120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f59580b7e80 con 0x7f59700d0300 2024-05-10T08:45:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.744+0000 7f596e59c640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59500762d0 0x7f5950078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.745+0000 7f596e59c640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59500762d0 0x7f5950078790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5968001b60 tx=0x7f5968009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:25.748+0000 7f5966ffd640 1 -- 172.21.15.37:0/942527120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f59701f5fe0 con 0x7f59700d0300 2024-05-10T08:45:26.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.018+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f597015f0b0 con 0x7f59700d0300 2024-05-10T08:45:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.270+0000 7f5966ffd640 1 -- 172.21.15.37:0/942527120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v252) ==== 166+0+0 (secure 0 0 0) 0x7f5958081990 con 0x7f59700d0300 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59500762d0 msgr2=0x7f5950078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59500762d0 0x7f5950078790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5968001b60 tx=0x7f5968009040 comp rx=0 tx=0).stop 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59700d0300 msgr2=0x7f59701598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59700d0300 0x7f59701598b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f59580098c0 tx=0x7f59580046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 shutdown_connections 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f59500762d0 0x7f5950078790 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f59700d0dd0 0x7f59701f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59700d0300 0x7f59701598b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 --2- 172.21.15.37:0/942527120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597006f130 0x7f597014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 >> 172.21.15.37:0/942527120 conn(0x7f597009ba40 msgr2=0x7f59700d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 shutdown_connections 2024-05-10T08:45:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.273+0000 7f5974bc8640 1 -- 172.21.15.37:0/942527120 wait complete. 2024-05-10T08:45:26.283 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-05-10T08:45:26.283 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-05-10T08:45:26.284 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T08:45:26.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:45:26.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.389+0000 7f472bc50640 1 Processor -- start 2024-05-10T08:45:26.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.390+0000 7f472bc50640 1 -- start start 2024-05-10T08:45:26.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.390+0000 7f472bc50640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47240b21f0 0x7f472406e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f472bc50640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4724162f50 0x7f47241633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f472bc50640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47240d0500 con 0x7f47240cf790 2024-05-10T08:45:26.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f472bc50640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f47241638f0 con 0x7f47240b21f0 2024-05-10T08:45:26.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f472bc50640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f472406d810 con 0x7f4724162f50 2024-05-10T08:45:26.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f472a1ed640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47240cf790 0x7f47240cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48752/0 (socket says 172.21.15.37:48752) 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f472a1ed640 1 -- 172.21.15.37:0/2435234565 learned_addr learned my addr 172.21.15.37:0/2435234565 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47291eb640 1 --2- 172.21.15.37:0/2435234565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4724162f50 0x7f47241633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47299ec640 1 --2- 172.21.15.37:0/2435234565 >> v2:172.21.15.82:3300/0 conn(0x7f47240b21f0 0x7f472406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47289ea640 1 -- 172.21.15.37:0/2435234565 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975226638 0 0) 0x7f47240d0500 con 0x7f47240cf790 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47289ea640 1 -- 172.21.15.37:0/2435234565 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f470c003520 con 0x7f47240cf790 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47291eb640 1 -- 172.21.15.37:0/2435234565 >> v2:172.21.15.82:3300/0 conn(0x7f47240b21f0 msgr2=0x7f472406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47291eb640 1 --2- 172.21.15.37:0/2435234565 >> v2:172.21.15.82:3300/0 conn(0x7f47240b21f0 0x7f472406e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47291eb640 1 -- 172.21.15.37:0/2435234565 >> v1:172.21.15.37:6789/0 conn(0x7f47240cf790 legacy=0x7f47240cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.391+0000 7f47291eb640 1 -- 172.21.15.37:0/2435234565 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472406da60 con 0x7f4724162f50 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.392+0000 7f47291eb640 1 --2- 172.21.15.37:0/2435234565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4724162f50 0x7f47241633b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47180097a0 tx=0x7f471802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec2c281add73e62 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.392+0000 7f47289ea640 1 -- 172.21.15.37:0/2435234565 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718037070 con 0x7f4724162f50 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.392+0000 7f47289ea640 1 -- 172.21.15.37:0/2435234565 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471802adb0 con 0x7f4724162f50 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.392+0000 7f47289ea640 1 -- 172.21.15.37:0/2435234565 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718032640 con 0x7f4724162f50 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 -- 172.21.15.37:0/2435234565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4724162f50 msgr2=0x7f47241633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 --2- 172.21.15.37:0/2435234565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4724162f50 0x7f47241633b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47180097a0 tx=0x7f471802a060 comp rx=0 tx=0).stop 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 -- 172.21.15.37:0/2435234565 shutdown_connections 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 --2- 172.21.15.37:0/2435234565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4724162f50 0x7f47241633b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 --2- 172.21.15.37:0/2435234565 >> v2:172.21.15.82:3300/0 conn(0x7f47240b21f0 0x7f472406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 -- 172.21.15.37:0/2435234565 >> 172.21.15.37:0/2435234565 conn(0x7f472409ba40 msgr2=0x7f472409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:26.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 -- 172.21.15.37:0/2435234565 shutdown_connections 2024-05-10T08:45:26.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.393+0000 7f472bc50640 1 -- 172.21.15.37:0/2435234565 wait complete. 2024-05-10T08:45:26.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.394+0000 7f472bc50640 1 Processor -- start 2024-05-10T08:45:26.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.394+0000 7f472bc50640 1 -- start start 2024-05-10T08:45:26.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472bc50640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47240b21f0 0x7f47240c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472bc50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47240cf790 0x7f47240a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472bc50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4724162f50 0x7f472415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472bc50640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f472406ea80 con 0x7f4724162f50 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472bc50640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f472406e0b0 con 0x7f47240cf790 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472bc50640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f47240b25d0 con 0x7f47240b21f0 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472a1ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4724162f50 0x7f472415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472a1ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4724162f50 0x7f472415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40598/0 (socket says 172.21.15.37:40598) 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472a1ed640 1 -- 172.21.15.37:0/1708641160 learned_addr learned my addr 172.21.15.37:0/1708641160 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f47299ec640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47240b21f0 0x7f47240c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f47291eb640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47240cf790 0x7f47240a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472a1ed640 1 -- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47240b21f0 msgr2=0x7f47240c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472a1ed640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47240b21f0 0x7f47240c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472a1ed640 1 -- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47240cf790 msgr2=0x7f47240a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.395+0000 7f472a1ed640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47240cf790 0x7f47240a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.396+0000 7f472a1ed640 1 -- 172.21.15.37:0/1708641160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47240c9800 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.396+0000 7f472a1ed640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4724162f50 0x7f472415cf00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f471400cb40 tx=0x7f471400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.396+0000 7f47227fc640 1 -- 172.21.15.37:0/1708641160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4714017070 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.396+0000 7f47227fc640 1 -- 172.21.15.37:0/1708641160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471400aca0 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.396+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47240b5bd0 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.396+0000 7f47227fc640 1 -- 172.21.15.37:0/1708641160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4714012620 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.396+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47240d2c80 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.397+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4724069b00 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.397+0000 7f47227fc640 1 -- 172.21.15.37:0/1708641160 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f471401a070 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.398+0000 7f47227fc640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47100762d0 0x7f4710078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.398+0000 7f47227fc640 1 -- 172.21.15.37:0/1708641160 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f47140971e0 con 0x7f4724162f50 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.398+0000 7f47299ec640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47100762d0 0x7f4710078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.399+0000 7f47299ec640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47100762d0 0x7f4710078790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f471c009aa0 tx=0x7f471c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:26.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.402+0000 7f47227fc640 1 -- 172.21.15.37:0/1708641160 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f47140606a0 con 0x7f4724162f50 2024-05-10T08:45:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.598+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47240b0450 con 0x7f4724162f50 2024-05-10T08:45:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.599+0000 7f47227fc640 1 -- 172.21.15.37:0/1708641160 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+13364 (secure 0 0 0) 0x7f47140649a0 con 0x7f4724162f50 2024-05-10T08:45:26.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:26.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":79,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:45:25.264932+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3086098191":"2024-05-11T08:45:22.255237+0000","172.21.15.37:6833/3086098191":"2024-05-11T08:45:22.255237+0000","172.21.15.37:6835/3151779785":"2024-05-11T08:44:07.977457+0000","172.21.15.37:6833/3151779785":"2024-05-11T08:44:07.977457+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:45:26.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47100762d0 msgr2=0x7f4710078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47100762d0 0x7f4710078790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f471c009aa0 tx=0x7f471c009190 comp rx=0 tx=0).stop 2024-05-10T08:45:26.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4724162f50 msgr2=0x7f472415cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4724162f50 0x7f472415cf00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f471400cb40 tx=0x7f471400a060 comp rx=0 tx=0).stop 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 shutdown_connections 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47100762d0 0x7f4710078790 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4724162f50 0x7f472415cf00 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47240cf790 0x7f47240a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 --2- 172.21.15.37:0/1708641160 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47240b21f0 0x7f47240c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 >> 172.21.15.37:0/1708641160 conn(0x7f472409ba40 msgr2=0x7f47240d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 shutdown_connections 2024-05-10T08:45:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.601+0000 7f472bc50640 1 -- 172.21.15.37:0/1708641160 wait complete. 2024-05-10T08:45:26.611 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T08:40:11.341540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T08:45:26.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T08:45:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.719+0000 7f1eb083f640 1 Processor -- start 2024-05-10T08:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.719+0000 7f1eb083f640 1 -- start start 2024-05-10T08:45:26.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.720+0000 7f1eb083f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0b6590 0x7f1eac0d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.720+0000 7f1eb083f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1eac163460 0x7f1eac15ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.720+0000 7f1eb083f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eac0d3320 con 0x7f1eac0d2bb0 2024-05-10T08:45:26.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.720+0000 7f1eb083f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1eac0d3600 con 0x7f1eac163460 2024-05-10T08:45:26.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.720+0000 7f1eb083f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1eac0d38e0 con 0x7f1eac0b6590 2024-05-10T08:45:26.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.720+0000 7f1ea9d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1eac0d2bb0 0x7f1eac162d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48766/0 (socket says 172.21.15.37:48766) 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.720+0000 7f1ea9d9b640 1 -- 172.21.15.37:0/2558170904 learned_addr learned my addr 172.21.15.37:0/2558170904 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1eaa59c640 1 --2- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0b6590 0x7f1eac0d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1eaad9d640 1 --2- 172.21.15.37:0/2558170904 >> v2:172.21.15.82:3300/0 conn(0x7f1eac163460 0x7f1eac15ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1ea959a640 1 -- 172.21.15.37:0/2558170904 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807998123 0 0) 0x7f1eac0d3320 con 0x7f1eac0d2bb0 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1ea959a640 1 -- 172.21.15.37:0/2558170904 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e94003520 con 0x7f1eac0d2bb0 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1eaad9d640 1 -- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0b6590 msgr2=0x7f1eac0d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1eaad9d640 1 --2- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0b6590 0x7f1eac0d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1ea959a640 1 -- 172.21.15.37:0/2558170904 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3864441627 0 0) 0x7f1e94003520 con 0x7f1eac0d2bb0 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1eaad9d640 1 -- 172.21.15.37:0/2558170904 >> v1:172.21.15.37:6789/0 conn(0x7f1eac0d2bb0 legacy=0x7f1eac162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1eaad9d640 1 -- 172.21.15.37:0/2558170904 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eac0d3bc0 con 0x7f1eac163460 2024-05-10T08:45:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.721+0000 7f1eaa59c640 1 --2- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0b6590 0x7f1eac0d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1eaad9d640 1 --2- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac163460 0x7f1eac15ec30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009d90 tx=0x7f1ea402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c1db1d2b2bdf78 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1ea959a640 1 -- 172.21.15.37:0/2558170904 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0001670 con 0x7f1eac163460 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1ea959a640 1 -- 172.21.15.37:0/2558170904 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea4007540 con 0x7f1eac163460 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1ea959a640 1 -- 172.21.15.37:0/2558170904 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4007910 con 0x7f1eac163460 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1eb083f640 1 -- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac163460 msgr2=0x7f1eac15ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1eb083f640 1 --2- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac163460 0x7f1eac15ec30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009d90 tx=0x7f1ea402a5f0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1eb083f640 1 -- 172.21.15.37:0/2558170904 shutdown_connections 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1eb083f640 1 --2- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac163460 0x7f1eac15ec30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1eb083f640 1 --2- 172.21.15.37:0/2558170904 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0b6590 0x7f1eac0d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.722+0000 7f1eb083f640 1 -- 172.21.15.37:0/2558170904 >> 172.21.15.37:0/2558170904 conn(0x7f1eac0d4fe0 msgr2=0x7f1eac0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.723+0000 7f1eb083f640 1 -- 172.21.15.37:0/2558170904 shutdown_connections 2024-05-10T08:45:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.723+0000 7f1eb083f640 1 -- 172.21.15.37:0/2558170904 wait complete. 2024-05-10T08:45:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.724+0000 7f1eb083f640 1 Processor -- start 2024-05-10T08:45:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.724+0000 7f1eb083f640 1 -- start start 2024-05-10T08:45:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eb083f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac0b6590 0x7f1eac14b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eb083f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0d2bb0 0x7f1eac149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eb083f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac163460 0x7f1eac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eb083f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac15f170 con 0x7f1eac163460 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eb083f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac0d3010 con 0x7f1eac0b6590 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eb083f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1eac15f2f0 con 0x7f1eac0d2bb0 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac163460 0x7f1eac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac163460 0x7f1eac06e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40602/0 (socket says 172.21.15.37:40602) 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 -- 172.21.15.37:0/52826350 learned_addr learned my addr 172.21.15.37:0/52826350 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1ea9d9b640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0d2bb0 0x7f1eac149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaa59c640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac0b6590 0x7f1eac14b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 -- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0d2bb0 msgr2=0x7f1eac149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0d2bb0 0x7f1eac149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 -- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac0b6590 msgr2=0x7f1eac14b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac0b6590 0x7f1eac14b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 -- 172.21.15.37:0/52826350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eac14bb10 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1eaad9d640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac163460 0x7f1eac06e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009d90 tx=0x7f1ea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.725+0000 7f1e9affd640 1 -- 172.21.15.37:0/52826350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea403f070 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.726+0000 7f1e9affd640 1 -- 172.21.15.37:0/52826350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea4031b40 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.726+0000 7f1e9affd640 1 -- 172.21.15.37:0/52826350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4007e90 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.726+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eac14bdf0 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.726+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eac14c3b0 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.727+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eac068c40 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.727+0000 7f1e9affd640 1 -- 172.21.15.37:0/52826350 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ea403b410 con 0x7f1eac163460 2024-05-10T08:45:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.728+0000 7f1e9affd640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e8c076300 0x7f1e8c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.728+0000 7f1e9affd640 1 -- 172.21.15.37:0/52826350 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f1ea40b8910 con 0x7f1eac163460 2024-05-10T08:45:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.728+0000 7f1eaa59c640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e8c076300 0x7f1e8c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.728+0000 7f1eaa59c640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e8c076300 0x7f1e8c0787c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009560 tx=0x7f1e9c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.732+0000 7f1e9affd640 1 -- 172.21.15.37:0/52826350 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1eac068c40 con 0x7f1eac163460 2024-05-10T08:45:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.920+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1eac15e1f0 con 0x7f1eac163460 2024-05-10T08:45:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.920+0000 7f1e9affd640 1 -- 172.21.15.37:0/52826350 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f1ea40822f0 con 0x7f1eac163460 2024-05-10T08:45:26.919 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e8c076300 msgr2=0x7f1e8c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e8c076300 0x7f1e8c0787c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009560 tx=0x7f1e9c008040 comp rx=0 tx=0).stop 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac163460 msgr2=0x7f1eac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac163460 0x7f1eac06e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009d90 tx=0x7f1ea4004a40 comp rx=0 tx=0).stop 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 shutdown_connections 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1e8c076300 0x7f1e8c0787c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac163460 0x7f1eac06e2f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1eac0d2bb0 0x7f1eac149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 --2- 172.21.15.37:0/52826350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1eac0b6590 0x7f1eac14b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 >> 172.21.15.37:0/52826350 conn(0x7f1eac0d4fe0 msgr2=0x7f1eac06d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 shutdown_connections 2024-05-10T08:45:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:26.922+0000 7f1eb083f640 1 -- 172.21.15.37:0/52826350 wait complete. 2024-05-10T08:45:26.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-05-10T08:45:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.039+0000 7f47f9672640 1 Processor -- start 2024-05-10T08:45:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.039+0000 7f47f9672640 1 -- start start 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f9672640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47f415f380 0x7f47f40d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f9672640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 0x7f47f40b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f9672640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f40d1760 con 0x7f47f40d0cf0 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f9672640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f47f40d30f0 con 0x7f47f415f380 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f9672640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f47f40d2370 con 0x7f47f40d3cd0 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47f415f380 0x7f47f40d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47f415f380 0x7f47f40d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40610/0 (socket says 172.21.15.37:40610) 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f2ffd640 1 -- 172.21.15.37:0/311232215 learned_addr learned my addr 172.21.15.37:0/311232215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f27fc640 1 --1- 172.21.15.37:0/311232215 >> v1:172.21.15.37:6789/0 conn(0x7f47f40d0cf0 0x7f47f40d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48778/0 (socket says 172.21.15.37:48778) 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.040+0000 7f47f37fe640 1 --2- 172.21.15.37:0/311232215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 0x7f47f40b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f2ffd640 1 -- 172.21.15.37:0/311232215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 msgr2=0x7f47f40b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f2ffd640 1 --2- 172.21.15.37:0/311232215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 0x7f47f40b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f2ffd640 1 -- 172.21.15.37:0/311232215 >> v1:172.21.15.37:6789/0 conn(0x7f47f40d0cf0 legacy=0x7f47f40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f2ffd640 1 -- 172.21.15.37:0/311232215 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f40d1a40 con 0x7f47f415f380 2024-05-10T08:45:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f2ffd640 1 --2- 172.21.15.37:0/311232215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f415f380 0x7f47f40d07b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009870 tx=0x7f47e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbef88588618cd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f1ffb640 1 -- 172.21.15.37:0/311232215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4037070 con 0x7f47f415f380 2024-05-10T08:45:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f1ffb640 1 -- 172.21.15.37:0/311232215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e4032440 con 0x7f47f415f380 2024-05-10T08:45:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.041+0000 7f47f1ffb640 1 -- 172.21.15.37:0/311232215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4032810 con 0x7f47f415f380 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 -- 172.21.15.37:0/311232215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f415f380 msgr2=0x7f47f40d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 --2- 172.21.15.37:0/311232215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f415f380 0x7f47f40d07b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009870 tx=0x7f47e402a270 comp rx=0 tx=0).stop 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 -- 172.21.15.37:0/311232215 shutdown_connections 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 --2- 172.21.15.37:0/311232215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 0x7f47f40b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 --2- 172.21.15.37:0/311232215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f415f380 0x7f47f40d07b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 -- 172.21.15.37:0/311232215 >> 172.21.15.37:0/311232215 conn(0x7f47f40d4fe0 msgr2=0x7f47f40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 -- 172.21.15.37:0/311232215 shutdown_connections 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.042+0000 7f47f9672640 1 -- 172.21.15.37:0/311232215 wait complete. 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.043+0000 7f47f9672640 1 Processor -- start 2024-05-10T08:45:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.043+0000 7f47f9672640 1 -- start start 2024-05-10T08:45:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f9672640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f40d0cf0 0x7f47f41f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f9672640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 0x7f47f41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f9672640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47f415f380 0x7f47f41586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f9672640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47f415f760 con 0x7f47f40d0cf0 2024-05-10T08:45:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f9672640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47f40d2000 con 0x7f47f415f380 2024-05-10T08:45:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f9672640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f47f40d2800 con 0x7f47f40d3cd0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f40d0cf0 0x7f47f41f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f40d0cf0 0x7f47f41f4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40616/0 (socket says 172.21.15.37:40616) 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f2ffd640 1 -- 172.21.15.37:0/1200264949 learned_addr learned my addr 172.21.15.37:0/1200264949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f2ffd640 1 -- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 msgr2=0x7f47f41581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f2ffd640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 0x7f47f41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.044+0000 7f47f2ffd640 1 -- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47f415f380 msgr2=0x7f47f41586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47f37fe640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47f415f380 0x7f47f41586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47f2ffd640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47f415f380 0x7f47f41586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47f2ffd640 1 -- 172.21.15.37:0/1200264949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f40cc490 con 0x7f47f40d0cf0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47f2ffd640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f40d0cf0 0x7f47f41f4ef0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000c00 tx=0x7f47e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47eb7fe640 1 -- 172.21.15.37:0/1200264949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4041020 con 0x7f47f40d0cf0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47eb7fe640 1 -- 172.21.15.37:0/1200264949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40306c0 con 0x7f47f40d0cf0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47eb7fe640 1 -- 172.21.15.37:0/1200264949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4037040 con 0x7f47f40d0cf0 2024-05-10T08:45:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f40cc770 con 0x7f47f40d0cf0 2024-05-10T08:45:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.045+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f40ccd30 con 0x7f47f40d0cf0 2024-05-10T08:45:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.046+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f40693f0 con 0x7f47f40d0cf0 2024-05-10T08:45:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.047+0000 7f47eb7fe640 1 -- 172.21.15.37:0/1200264949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47e4044020 con 0x7f47f40d0cf0 2024-05-10T08:45:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.047+0000 7f47eb7fe640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47d40762d0 0x7f47d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.047+0000 7f47eb7fe640 1 -- 172.21.15.37:0/1200264949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f47e40b7bc0 con 0x7f47f40d0cf0 2024-05-10T08:45:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.047+0000 7f47f27fc640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47d40762d0 0x7f47d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.048+0000 7f47f27fc640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47d40762d0 0x7f47d4078790 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f47dc000f60 tx=0x7f47dc007a00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.052+0000 7f47eb7fe640 1 -- 172.21.15.37:0/1200264949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f47e404b030 con 0x7f47f40d0cf0 2024-05-10T08:45:27.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:27.320+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f47f40d3940 con 0x7f47f40d0cf0 2024-05-10T08:45:28.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.276+0000 7f47eb7fe640 1 -- 172.21.15.37:0/1200264949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v254) ==== 170+0+0 (secure 0 0 0) 0x7f47e40816d0 con 0x7f47f40d0cf0 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47d40762d0 msgr2=0x7f47d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47d40762d0 0x7f47d4078790 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f47dc000f60 tx=0x7f47dc007a00 comp rx=0 tx=0).stop 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f40d0cf0 msgr2=0x7f47f41f4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f40d0cf0 0x7f47f41f4ef0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000c00 tx=0x7f47e40046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 shutdown_connections 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47d40762d0 0x7f47d4078790 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47f415f380 0x7f47f41586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47f40d3cd0 0x7f47f41581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 --2- 172.21.15.37:0/1200264949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f40d0cf0 0x7f47f41f4ef0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.279+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 >> 172.21.15.37:0/1200264949 conn(0x7f47f40d4fe0 msgr2=0x7f47f40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.280+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 shutdown_connections 2024-05-10T08:45:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.280+0000 7f47f9672640 1 -- 172.21.15.37:0/1200264949 wait complete. 2024-05-10T08:45:28.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T08:45:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.406+0000 7f8a0e5f7640 1 Processor -- start 2024-05-10T08:45:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.406+0000 7f8a0e5f7640 1 -- start start 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f8a0e5f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a0815f4e0 0x7f8a080cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f8a0e5f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a080d56b0 0x7f8a080d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f8a0e5f7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a080d0320 con 0x7f8a080d3aa0 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f8a0e5f7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8a080d0600 con 0x7f8a080d56b0 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f8a0e5f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a080d08e0 con 0x7f8a0815f4e0 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f8a0cb94640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a080d56b0 0x7f8a080d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f89fffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8a080d3aa0 0x7f8a080d4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59780/0 (socket says 172.21.15.37:59780) 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f89fffff640 1 -- 172.21.15.37:0/4157709786 learned_addr learned my addr 172.21.15.37:0/4157709786 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.407+0000 7f8a0cb94640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a080d56b0 0x7f8a080d13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55496/0 (socket says 172.21.15.37:55496) 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.408+0000 7f8a07fff640 1 --2- 172.21.15.37:0/4157709786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a0815f4e0 0x7f8a080cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.408+0000 7f8a0cb94640 1 -- 172.21.15.37:0/4157709786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a0815f4e0 msgr2=0x7f8a080cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.408+0000 7f8a0cb94640 1 --2- 172.21.15.37:0/4157709786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a0815f4e0 0x7f8a080cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.408+0000 7f8a0cb94640 1 -- 172.21.15.37:0/4157709786 >> v1:172.21.15.37:6789/0 conn(0x7f8a080d3aa0 legacy=0x7f8a080d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.408+0000 7f8a077fe640 1 -- 172.21.15.37:0/4157709786 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672981177 0 0) 0x7f8a080d0320 con 0x7f8a080d3aa0 2024-05-10T08:45:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.408+0000 7f8a0cb94640 1 -- 172.21.15.37:0/4157709786 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a080d0bc0 con 0x7f8a080d56b0 2024-05-10T08:45:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0cb94640 1 --2- 172.21.15.37:0/4157709786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080d13c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009d90 tx=0x7f8a0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99737b0873a435 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a077fe640 1 -- 172.21.15.37:0/4157709786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00007740 con 0x7f8a080d56b0 2024-05-10T08:45:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a077fe640 1 -- 172.21.15.37:0/4157709786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a000078e0 con 0x7f8a080d56b0 2024-05-10T08:45:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a077fe640 1 -- 172.21.15.37:0/4157709786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00007cb0 con 0x7f8a080d56b0 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/4157709786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 msgr2=0x7f8a080d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/4157709786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080d13c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009d90 tx=0x7f8a0002a660 comp rx=0 tx=0).stop 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/4157709786 shutdown_connections 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/4157709786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080d13c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/4157709786 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a0815f4e0 0x7f8a080cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/4157709786 >> 172.21.15.37:0/4157709786 conn(0x7f8a0808eac0 msgr2=0x7f8a0809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/4157709786 shutdown_connections 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.409+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/4157709786 wait complete. 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.411+0000 7f8a0e5f7640 1 Processor -- start 2024-05-10T08:45:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.411+0000 7f8a0e5f7640 1 -- start start 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.411+0000 7f8a0e5f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a080d3aa0 0x7f8a081f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.411+0000 7f8a0e5f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a0e5f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a0815f4e0 0x7f8a080b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a0e5f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a080d3f00 con 0x7f8a080d56b0 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a0e5f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0815f8c0 con 0x7f8a0815f4e0 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a0e5f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a080d4080 con 0x7f8a080d3aa0 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55508/0 (socket says 172.21.15.37:55508) 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 -- 172.21.15.37:0/332291742 learned_addr learned my addr 172.21.15.37:0/332291742 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a07fff640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a080d3aa0 0x7f8a081f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a0cb94640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a0815f4e0 0x7f8a080b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 -- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a080d3aa0 msgr2=0x7f8a081f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a080d3aa0 0x7f8a081f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 -- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a0815f4e0 msgr2=0x7f8a080b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a0815f4e0 0x7f8a080b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 -- 172.21.15.37:0/332291742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a081f8780 con 0x7f8a080d56b0 2024-05-10T08:45:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f89fffff640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080b2470 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c4d0 tx=0x7f89f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a057fa640 1 -- 172.21.15.37:0/332291742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0018070 con 0x7f8a080d56b0 2024-05-10T08:45:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a057fa640 1 -- 172.21.15.37:0/332291742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f0007500 con 0x7f8a080d56b0 2024-05-10T08:45:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a057fa640 1 -- 172.21.15.37:0/332291742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0004a20 con 0x7f8a080d56b0 2024-05-10T08:45:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a081f8a60 con 0x7f8a080d56b0 2024-05-10T08:45:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.412+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a081567d0 con 0x7f8a080d56b0 2024-05-10T08:45:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.413+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a080693f0 con 0x7f8a080d56b0 2024-05-10T08:45:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.414+0000 7f8a057fa640 1 -- 172.21.15.37:0/332291742 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f89f001b070 con 0x7f8a080d56b0 2024-05-10T08:45:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.415+0000 7f8a057fa640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89e8076300 0x7f89e80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.415+0000 7f8a057fa640 1 -- 172.21.15.37:0/332291742 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f89f0096830 con 0x7f8a080d56b0 2024-05-10T08:45:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.415+0000 7f8a07fff640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89e8076300 0x7f89e80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.415+0000 7f8a07fff640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89e8076300 0x7f89e80787c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006fd0 tx=0x7f89f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.419+0000 7f8a057fa640 1 -- 172.21.15.37:0/332291742 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f89f00602a0 con 0x7f8a080d56b0 2024-05-10T08:45:28.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.608+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8a0806dca0 con 0x7f8a080d56b0 2024-05-10T08:45:28.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.612+0000 7f8a057fa640 1 -- 172.21.15.37:0/332291742 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f89f005fba0 con 0x7f8a080d56b0 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89e8076300 msgr2=0x7f89e80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89e8076300 0x7f89e80787c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006fd0 tx=0x7f89f8008040 comp rx=0 tx=0).stop 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 msgr2=0x7f8a080b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080b2470 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c4d0 tx=0x7f89f000c990 comp rx=0 tx=0).stop 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 shutdown_connections 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89e8076300 0x7f89e80787c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a0815f4e0 0x7f8a080b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a080d56b0 0x7f8a080b2470 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 --2- 172.21.15.37:0/332291742 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a080d3aa0 0x7f8a081f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 >> 172.21.15.37:0/332291742 conn(0x7f8a0808eac0 msgr2=0x7f8a080d2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 shutdown_connections 2024-05-10T08:45:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.614+0000 7f8a0e5f7640 1 -- 172.21.15.37:0/332291742 wait complete. 2024-05-10T08:45:28.624 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:45:28.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:45:28.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:45:28.711 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:45:28.711 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:28.711 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:28.727 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:45:28.727 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:45:28.728 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:28.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:45:28.769 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:28.769 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:28.785 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:45:28.786 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:45:28.786 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:28.828 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:45:28.828 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T08:45:28.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.932+0000 7f1c95a85640 1 Processor -- start 2024-05-10T08:45:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.933+0000 7f1c95a85640 1 -- start start 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.933+0000 7f1c95a85640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 0x7f1c90163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.933+0000 7f1c95a85640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c90071110 0x7f1c9006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.933+0000 7f1c95a85640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c900d1300 con 0x7f1c90070d30 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.933+0000 7f1c95a85640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1c900d10d0 con 0x7f1c90071110 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.933+0000 7f1c95a85640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1c90070b80 con 0x7f1c900d20c0 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.933+0000 7f1c8f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1c90070d30 0x7f1c900703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59796/0 (socket says 172.21.15.37:59796) 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8f7fe640 1 -- 172.21.15.37:0/3187627857 learned_addr learned my addr 172.21.15.37:0/3187627857 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/3187627857 >> v2:172.21.15.82:3300/0 conn(0x7f1c90071110 0x7f1c9006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8effd640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 0x7f1c90163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036112930 0 0) 0x7f1c900d1300 con 0x7f1c90070d30 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c78003520 con 0x7f1c90070d30 2024-05-10T08:45:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3639328892 0 0) 0x7f1c78003520 con 0x7f1c90070d30 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 msgr2=0x7f1c90163920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 0x7f1c90163920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 >> v2:172.21.15.82:3300/0 conn(0x7f1c90071110 msgr2=0x7f1c9006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 --2- 172.21.15.37:0/3187627857 >> v2:172.21.15.82:3300/0 conn(0x7f1c90071110 0x7f1c9006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c900d15e0 con 0x7f1c90070d30 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f1c80001670 con 0x7f1c90070d30 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 >> v1:172.21.15.37:6789/0 conn(0x7f1c90070d30 legacy=0x7f1c900703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c780039b0 0x7f1c78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c78004800 0x7f1c78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 0x7f1c780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90070b80 con 0x7f1c78004800 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7800b9c0 con 0x7f1c780039b0 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1c7800bb40 con 0x7f1c900d20c0 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8effd640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c78004800 0x7f1c78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8f7fe640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c780039b0 0x7f1c78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 0x7f1c780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8effd640 1 -- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 msgr2=0x7f1c780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8effd640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c900d20c0 0x7f1c780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8effd640 1 -- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c780039b0 msgr2=0x7f1c78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.934+0000 7f1c8effd640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c780039b0 0x7f1c78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.935+0000 7f1c8effd640 1 -- 172.21.15.37:0/3187627857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c78003520 con 0x7f1c78004800 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.935+0000 7f1c8effd640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c78004800 0x7f1c78004c80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009ac0 tx=0x7f1c78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f647e54dfb46233 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.935+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84036070 con 0x7f1c78004800 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.935+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c84031400 con 0x7f1c78004800 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.935+0000 7f1c8e7fc640 1 -- 172.21.15.37:0/3187627857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84009690 con 0x7f1c78004800 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.936+0000 7f1c95a85640 1 -- 172.21.15.37:0/3187627857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c78004800 msgr2=0x7f1c78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.936+0000 7f1c95a85640 1 --2- 172.21.15.37:0/3187627857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c78004800 0x7f1c78004c80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009ac0 tx=0x7f1c78005830 comp rx=0 tx=0).stop 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.936+0000 7f1c8ffff640 1 -- 172.21.15.37:0/3187627857 reap_dead start 2024-05-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.936+0000 7f1c95a85640 1 -- 172.21.15.37:0/3187627857 shutdown_connections 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.936+0000 7f1c95a85640 1 -- 172.21.15.37:0/3187627857 >> 172.21.15.37:0/3187627857 conn(0x7f1c900d2e90 msgr2=0x7f1c900d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.936+0000 7f1c95a85640 1 -- 172.21.15.37:0/3187627857 shutdown_connections 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.936+0000 7f1c95a85640 1 -- 172.21.15.37:0/3187627857 wait complete. 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.937+0000 7f1c95a85640 1 Processor -- start 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.937+0000 7f1c95a85640 1 -- start start 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c95a85640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c78004800 0x7f1c900c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c95a85640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c9015e3b0 0x7f1c901f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c95a85640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c901f5f70 0x7f1c901f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c95a85640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90071580 con 0x7f1c9015e3b0 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c95a85640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c900d1c30 con 0x7f1c901f5f70 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c95a85640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1c90071700 con 0x7f1c78004800 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c8effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c9015e3b0 0x7f1c901f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c8effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c9015e3b0 0x7f1c901f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55520/0 (socket says 172.21.15.37:55520) 2024-05-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c8effd640 1 -- 172.21.15.37:0/1416334912 learned_addr learned my addr 172.21.15.37:0/1416334912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c8f7fe640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c78004800 0x7f1c900c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.938+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c901f5f70 0x7f1c901f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8effd640 1 -- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c78004800 msgr2=0x7f1c900c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8effd640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c78004800 0x7f1c900c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8effd640 1 -- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c901f5f70 msgr2=0x7f1c901f9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8effd640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c901f5f70 0x7f1c901f9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8effd640 1 -- 172.21.15.37:0/1416334912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c901f63f0 con 0x7f1c9015e3b0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8f7fe640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c78004800 0x7f1c900c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c901f5f70 0x7f1c901f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c8effd640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c9015e3b0 0x7f1c901f5a30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009ac0 tx=0x7f1c84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c77fff640 1 -- 172.21.15.37:0/1416334912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84040020 con 0x7f1c9015e3b0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c77fff640 1 -- 172.21.15.37:0/1416334912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c84003bc0 con 0x7f1c9015e3b0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9015be00 con 0x7f1c9015e3b0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c77fff640 1 -- 172.21.15.37:0/1416334912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84036040 con 0x7f1c9015e3b0 2024-05-10T08:45:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.939+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9015c3c0 con 0x7f1c9015e3b0 2024-05-10T08:45:28.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.940+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c90163920 con 0x7f1c9015e3b0 2024-05-10T08:45:28.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.941+0000 7f1c77fff640 1 -- 172.21.15.37:0/1416334912 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c84043020 con 0x7f1c9015e3b0 2024-05-10T08:45:28.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.941+0000 7f1c77fff640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1c7c0762d0 0x7f1c7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:28.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.941+0000 7f1c77fff640 1 -- 172.21.15.37:0/1416334912 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f1c840b7500 con 0x7f1c9015e3b0 2024-05-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.941+0000 7f1c8f7fe640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1c7c0762d0 0x7f1c7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.942+0000 7f1c8f7fe640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1c7c0762d0 0x7f1c7c078790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:28.946+0000 7f1c77fff640 1 -- 172.21.15.37:0/1416334912 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1c90163920 con 0x7f1c9015e3b0 2024-05-10T08:45:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.180+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c900693f0 con 0x7f1c9015e3b0 2024-05-10T08:45:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.181+0000 7f1c77fff640 1 -- 172.21.15.37:0/1416334912 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+3866 (secure 0 0 0) 0x7f1c8404a070 con 0x7f1c9015e3b0 2024-05-10T08:45:29.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:29.180 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/597227834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":597227834},{"type":"v1","addr":"172.21.15.82:6836","nonce":597227834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2719444023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2719444023},{"type":"v1","addr":"172.21.15.82:6837","nonce":2719444023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6105,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2613013889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2613013889},{"type":"v1","addr":"172.21.15.37:6834","nonce":2613013889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2488815288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2488815288},{"type":"v1","addr":"172.21.15.37:6835","nonce":2488815288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[]} 2024-05-10T08:45:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 54 2024-05-10T08:45:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1c7c0762d0 msgr2=0x7f1c7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1c7c0762d0 0x7f1c7c078790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c80009040 comp rx=0 tx=0).stop 2024-05-10T08:45:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c9015e3b0 msgr2=0x7f1c901f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c9015e3b0 0x7f1c901f5a30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009ac0 tx=0x7f1c84004730 comp rx=0 tx=0).stop 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 shutdown_connections 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1c7c0762d0 0x7f1c7c078790 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c901f5f70 0x7f1c901f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c9015e3b0 0x7f1c901f5a30 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 --2- 172.21.15.37:0/1416334912 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1c78004800 0x7f1c900c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 >> 172.21.15.37:0/1416334912 conn(0x7f1c900d2e90 msgr2=0x7f1c900b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 shutdown_connections 2024-05-10T08:45:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.183+0000 7f1c95a85640 1 -- 172.21.15.37:0/1416334912 wait complete. 2024-05-10T08:45:29.193 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:45:29.194 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T08:45:29.194 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:45:29.194 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:45:29.194 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:45:29.194 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T08:45:29.194 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:45:29.195 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:45:29.195 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:45:29.195 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T08:45:29.195 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:45:29.195 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:45:29.195 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:45:29.195 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T08:45:29.195 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:45:29.196 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:45:29.203 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:45:29.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:45:29.204 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:45:29.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:45:29.207 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:45:29.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:45:29.208 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:45:29.208 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:45:29.246 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:45:29.247 DEBUG:teuthology.parallel:result is None 2024-05-10T08:45:29.247 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:45:29.247 DEBUG:teuthology.parallel:result is None 2024-05-10T08:45:29.249 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:45:29.250 DEBUG:teuthology.parallel:result is None 2024-05-10T08:45:29.250 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:45:29.250 DEBUG:teuthology.parallel:result is None 2024-05-10T08:45:29.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T08:45:29.325 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:45:29.326 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:45:29.331 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:45:29.332 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:45:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.362+0000 7f93ecb1c640 1 Processor -- start 2024-05-10T08:45:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.362+0000 7f93ecb1c640 1 -- start start 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93ecb1c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93e815f420 0x7f93e80d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93ecb1c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e81630b0 con 0x7f93e80d3ca0 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93ecb1c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e80d2550 con 0x7f93e80d2080 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93ecb1c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f93e80d2c80 con 0x7f93e815f420 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93e5d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f93e80d3ca0 0x7f93e80d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59820/0 (socket says 172.21.15.37:59820) 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93e5d9b640 1 -- 172.21.15.37:0/1717138076 learned_addr learned my addr 172.21.15.37:0/1717138076 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93e659c640 1 --2- 172.21.15.37:0/1717138076 >> v2:172.21.15.82:3300/0 conn(0x7f93e815f420 0x7f93e80d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93e559a640 1 -- 172.21.15.37:0/1717138076 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543119381 0 0) 0x7f93d0001110 con 0x7f93e80d3ca0 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93e559a640 1 -- 172.21.15.37:0/1717138076 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93d4003520 con 0x7f93e80d3ca0 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93e559a640 1 -- 172.21.15.37:0/1717138076 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941571518 0 0) 0x7f93e80d2550 con 0x7f93e80d2080 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.363+0000 7f93e559a640 1 -- 172.21.15.37:0/1717138076 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93d0001110 con 0x7f93e80d2080 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.364+0000 7f93e659c640 1 -- 172.21.15.37:0/1717138076 >> v1:172.21.15.82:6789/0 conn(0x7f93e80d2080 legacy=0x7f93e80d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.364+0000 7f93e659c640 1 -- 172.21.15.37:0/1717138076 >> v1:172.21.15.37:6789/0 conn(0x7f93e80d3ca0 legacy=0x7f93e80d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:29.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.364+0000 7f93e659c640 1 -- 172.21.15.37:0/1717138076 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e80d2f60 con 0x7f93e815f420 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.364+0000 7f93e659c640 1 --2- 172.21.15.37:0/1717138076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f420 0x7f93e80d3760 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93e00097a0 tx=0x7f93e002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff5fbc47cf091ce6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.364+0000 7f93e559a640 1 -- 172.21.15.37:0/1717138076 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0037070 con 0x7f93e815f420 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.364+0000 7f93e559a640 1 -- 172.21.15.37:0/1717138076 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e0032440 con 0x7f93e815f420 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93e559a640 1 -- 172.21.15.37:0/1717138076 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0032810 con 0x7f93e815f420 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93ecb1c640 1 -- 172.21.15.37:0/1717138076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f420 msgr2=0x7f93e80d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/1717138076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f420 0x7f93e80d3760 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93e00097a0 tx=0x7f93e002a230 comp rx=0 tx=0).stop 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93ecb1c640 1 -- 172.21.15.37:0/1717138076 shutdown_connections 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/1717138076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f420 0x7f93e80d3760 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93ecb1c640 1 -- 172.21.15.37:0/1717138076 >> 172.21.15.37:0/1717138076 conn(0x7f93e808eac0 msgr2=0x7f93e809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93ecb1c640 1 -- 172.21.15.37:0/1717138076 shutdown_connections 2024-05-10T08:45:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.365+0000 7f93ecb1c640 1 -- 172.21.15.37:0/1717138076 wait complete. 2024-05-10T08:45:29.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.366+0000 7f93ecb1c640 1 Processor -- start 2024-05-10T08:45:29.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93ecb1c640 1 -- start start 2024-05-10T08:45:29.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93ecb1c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93e80d2080 0x7f93e8161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:29.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93ecb1c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f880 0x7f93e80cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:29.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93ecb1c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e80cb5e0 0x7f93e8151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93ecb1c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80d53d0 con 0x7f93e80cb5e0 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93ecb1c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80d2830 con 0x7f93e815f880 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93ecb1c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f93e80d5550 con 0x7f93e80d2080 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93e6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e80cb5e0 0x7f93e8151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93e6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e80cb5e0 0x7f93e8151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55554/0 (socket says 172.21.15.37:55554) 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93e6d9d640 1 -- 172.21.15.37:0/3512655161 learned_addr learned my addr 172.21.15.37:0/3512655161 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.367+0000 7f93e659c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93e80d2080 0x7f93e8161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e5d9b640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f880 0x7f93e80cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e6d9d640 1 -- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93e80d2080 msgr2=0x7f93e8161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e6d9d640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93e80d2080 0x7f93e8161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e6d9d640 1 -- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f880 msgr2=0x7f93e80cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e6d9d640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f880 0x7f93e80cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e6d9d640 1 -- 172.21.15.37:0/3512655161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e80cc280 con 0x7f93e80cb5e0 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e659c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93e80d2080 0x7f93e8161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:45:29.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93e6d9d640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e80cb5e0 0x7f93e8151fe0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c7a0 tx=0x7f93d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93deffd640 1 -- 172.21.15.37:0/3512655161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8003b70 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93deffd640 1 -- 172.21.15.37:0/3512655161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d8003d10 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e80cc560 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93deffd640 1 -- 172.21.15.37:0/3512655161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d800aa90 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.368+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e80ccb20 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.369+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e80ccd20 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.370+0000 7f93deffd640 1 -- 172.21.15.37:0/3512655161 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93d800ac30 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.370+0000 7f93deffd640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93c80762d0 0x7f93c8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.371+0000 7f93deffd640 1 -- 172.21.15.37:0/3512655161 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f93d8097310 con 0x7f93e80cb5e0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.371+0000 7f93e659c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93c80762d0 0x7f93c8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:29.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.371+0000 7f93e659c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93c80762d0 0x7f93c8078790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93e0034000 tx=0x7f93e002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:29.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.375+0000 7f93deffd640 1 -- 172.21.15.37:0/3512655161 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f93e80ccd20 con 0x7f93e80cb5e0 2024-05-10T08:45:29.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:29.578+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f93e80b4c50 con 0x7f93e80cb5e0 2024-05-10T08:45:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.291+0000 7f93deffd640 1 -- 172.21.15.37:0/3512655161 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) ==== 97+0+0 (secure 0 0 0) 0x7f93d80970d0 con 0x7f93e80cb5e0 2024-05-10T08:45:30.290 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-10T08:45:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93c80762d0 msgr2=0x7f93c8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93c80762d0 0x7f93c8078790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93e0034000 tx=0x7f93e002e000 comp rx=0 tx=0).stop 2024-05-10T08:45:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e80cb5e0 msgr2=0x7f93e8151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e80cb5e0 0x7f93e8151fe0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c7a0 tx=0x7f93d800cc60 comp rx=0 tx=0).stop 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 shutdown_connections 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f93c80762d0 0x7f93c8078790 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e80cb5e0 0x7f93e8151fe0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e815f880 0x7f93e80cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 --2- 172.21.15.37:0/3512655161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f93e80d2080 0x7f93e8161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 >> 172.21.15.37:0/3512655161 conn(0x7f93e808eac0 msgr2=0x7f93e8163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 shutdown_connections 2024-05-10T08:45:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.294+0000 7f93ecb1c640 1 -- 172.21.15.37:0/3512655161 wait complete. 2024-05-10T08:45:30.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T08:45:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.419+0000 7f8a28b2b640 1 Processor -- start 2024-05-10T08:45:30.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.420+0000 7f8a28b2b640 1 -- start start 2024-05-10T08:45:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a28b2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 0x7f8a24071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a28b2b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2415fae0 con 0x7f8a2406c3a0 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a28b2b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a24160600 con 0x7f8a2415f680 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a28b2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2415fd60 con 0x7f8a240b1050 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a22d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8a2406c3a0 0x7f8a24163230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59828/0 (socket says 172.21.15.37:59828) 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a22d9d640 1 -- 172.21.15.37:0/2590557506 learned_addr learned my addr 172.21.15.37:0/2590557506 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2259c640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 0x7f8a24071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971060343 0 0) 0x7f8a1c001490 con 0x7f8a2406c3a0 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a10003520 con 0x7f8a2406c3a0 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197724360 0 0) 0x7f8a24160600 con 0x7f8a2415f680 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a1c001490 con 0x7f8a2415f680 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3716440855 0 0) 0x7f8a10003520 con 0x7f8a2406c3a0 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 msgr2=0x7f8a24071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 0x7f8a24071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 >> v1:172.21.15.82:6789/0 conn(0x7f8a2415f680 legacy=0x7f8a240b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a24160040 con 0x7f8a2406c3a0 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f8a1c001bc0 con 0x7f8a2406c3a0 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 >> v1:172.21.15.37:6789/0 conn(0x7f8a2406c3a0 legacy=0x7f8a24163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 0x7f8a10003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a10004120 0x7f8a10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2415fd60 con 0x7f8a10004d40 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1000bb00 con 0x7f8a10004120 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.421+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1000bd00 con 0x7f8a240b1050 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a22d9d640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a2259c640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 0x7f8a10003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a21d9b640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a10004120 0x7f8a10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a22d9d640 1 -- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 msgr2=0x7f8a10003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a22d9d640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a240b1050 0x7f8a10003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a22d9d640 1 -- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a10004120 msgr2=0x7f8a10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a22d9d640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a10004120 0x7f8a10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.422+0000 7f8a22d9d640 1 -- 172.21.15.37:0/2590557506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a10003520 con 0x7f8a10004d40 2024-05-10T08:45:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a22d9d640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a100051c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00a920 tx=0x7f8a10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c987ec7ccf66364 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00a540 con 0x7f8a10004d40 2024-05-10T08:45:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c02f070 con 0x7f8a10004d40 2024-05-10T08:45:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a2159a640 1 -- 172.21.15.37:0/2590557506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c02bda0 con 0x7f8a10004d40 2024-05-10T08:45:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a28b2b640 1 -- 172.21.15.37:0/2590557506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 msgr2=0x7f8a100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a28b2b640 1 --2- 172.21.15.37:0/2590557506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a100051c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00a920 tx=0x7f8a10005830 comp rx=0 tx=0).stop 2024-05-10T08:45:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a22d9d640 1 -- 172.21.15.37:0/2590557506 reap_dead start 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a28b2b640 1 -- 172.21.15.37:0/2590557506 shutdown_connections 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a28b2b640 1 -- 172.21.15.37:0/2590557506 >> 172.21.15.37:0/2590557506 conn(0x7f8a240b3c40 msgr2=0x7f8a240b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a28b2b640 1 -- 172.21.15.37:0/2590557506 shutdown_connections 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.423+0000 7f8a28b2b640 1 -- 172.21.15.37:0/2590557506 wait complete. 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.425+0000 7f8a28b2b640 1 Processor -- start 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.425+0000 7f8a28b2b640 1 -- start start 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a2413cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a2413d310 0x7f8a241581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a2413e920 0x7f8a2413eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a240b5dc0 con 0x7f8a10004d40 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24162d10 con 0x7f8a2413d310 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a240701e0 con 0x7f8a2413e920 2024-05-10T08:45:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a2413cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a2413cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55582/0 (socket says 172.21.15.37:55582) 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 -- 172.21.15.37:0/3643537731 learned_addr learned my addr 172.21.15.37:0/3643537731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a22d9d640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a2413e920 0x7f8a2413eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a21d9b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a2413d310 0x7f8a241581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 -- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a2413e920 msgr2=0x7f8a2413eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a2413e920 0x7f8a2413eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 -- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a2413d310 msgr2=0x7f8a241581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a2413d310 0x7f8a241581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 -- 172.21.15.37:0/3643537731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2413d010 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a2259c640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a2413cad0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8a14011a00 tx=0x7f8a14011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a1affd640 1 -- 172.21.15.37:0/3643537731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400fb50 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a1affd640 1 -- 172.21.15.37:0/3643537731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1400fcf0 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2413d880 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a1affd640 1 -- 172.21.15.37:0/3643537731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400fea0 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.426+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2413de40 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.427+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a24069b00 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.428+0000 7f8a1affd640 1 -- 172.21.15.37:0/3643537731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a14012040 con 0x7f8a10004d40 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.428+0000 7f8a1affd640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a04076300 0x7f8a040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.429+0000 7f8a1affd640 1 -- 172.21.15.37:0/3643537731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f8a14097860 con 0x7f8a10004d40 2024-05-10T08:45:30.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.429+0000 7f8a21d9b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a04076300 0x7f8a040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.429+0000 7f8a21d9b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a04076300 0x7f8a040787c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a24161d10 tx=0x7f8a0c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:30.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.433+0000 7f8a1affd640 1 -- 172.21.15.37:0/3643537731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8a14019030 con 0x7f8a10004d40 2024-05-10T08:45:30.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.699+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8a2406d290 con 0x7f8a10004d40 2024-05-10T08:45:30.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.699+0000 7f8a1affd640 1 -- 172.21.15.37:0/3643537731 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f8a14060dc0 con 0x7f8a10004d40 2024-05-10T08:45:30.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:30.698 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg==", 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ==", 2024-05-10T08:45:30.699 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA==", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.700 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw==", 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw==", 2024-05-10T08:45:30.701 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw==", 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg==", 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ==", 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.703 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g==", 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-10T08:45:30.704 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA==", 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w==", 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.705 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg==", 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:45:30.706 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A==", 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-10T08:45:30.707 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg==", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw==", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:45:30.708 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA==", 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-10T08:45:30.709 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA83T1mpCEPLBAAZlDinj6hQh8Ccd9D/MMUDw==", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA==", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:45:30.710 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A==", 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:45:30.711 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a04076300 msgr2=0x7f8a040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a04076300 0x7f8a040787c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a24161d10 tx=0x7f8a0c009040 comp rx=0 tx=0).stop 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 msgr2=0x7f8a2413cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a2413cad0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8a14011a00 tx=0x7f8a14011ec0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 shutdown_connections 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8a04076300 0x7f8a040787c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a2413e920 0x7f8a2413eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a2413d310 0x7f8a241581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 --2- 172.21.15.37:0/3643537731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a10004d40 0x7f8a2413cad0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 >> 172.21.15.37:0/3643537731 conn(0x7f8a240b3c40 msgr2=0x7f8a240aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 shutdown_connections 2024-05-10T08:45:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.701+0000 7f8a28b2b640 1 -- 172.21.15.37:0/3643537731 wait complete. 2024-05-10T08:45:30.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:45:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.819+0000 7f775c3da640 1 Processor -- start 2024-05-10T08:45:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.819+0000 7f775c3da640 1 -- start start 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775c3da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f77540d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775c3da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77540d2dc0 0x7f77540d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775c3da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77540c8ed0 0x7f77540c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775c3da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f77540d3330 con 0x7f77540d2dc0 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775c3da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f77540d2170 con 0x7f77540c8ed0 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775c3da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f77540d2450 con 0x7f77541629a0 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77540d2dc0 0x7f77540d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77540d2dc0 0x7f77540d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55596/0 (socket says 172.21.15.37:55596) 2024-05-10T08:45:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 -- 172.21.15.37:0/2623561606 learned_addr learned my addr 172.21.15.37:0/2623561606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775a977640 1 --2- 172.21.15.37:0/2623561606 >> v2:172.21.15.82:3300/0 conn(0x7f77540c8ed0 0x7f77540c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f775a176640 1 --2- 172.21.15.37:0/2623561606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f77540d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 -- 172.21.15.37:0/2623561606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 msgr2=0x7f77540d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 --2- 172.21.15.37:0/2623561606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f77540d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 -- 172.21.15.37:0/2623561606 >> v2:172.21.15.82:3300/0 conn(0x7f77540c8ed0 msgr2=0x7f77540c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 --2- 172.21.15.37:0/2623561606 >> v2:172.21.15.82:3300/0 conn(0x7f77540c8ed0 0x7f77540c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.820+0000 7f7759975640 1 -- 172.21.15.37:0/2623561606 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77540d2730 con 0x7f77540d2dc0 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.821+0000 7f7759975640 1 --2- 172.21.15.37:0/2623561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540d3b00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f775408e4c0 tx=0x7f774402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decefa5f51f6b324 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.821+0000 7f7759174640 1 -- 172.21.15.37:0/2623561606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744037070 con 0x7f77540d2dc0 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.821+0000 7f7759174640 1 -- 172.21.15.37:0/2623561606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774402ae00 con 0x7f77540d2dc0 2024-05-10T08:45:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.821+0000 7f7759174640 1 -- 172.21.15.37:0/2623561606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744032660 con 0x7f77540d2dc0 2024-05-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 -- 172.21.15.37:0/2623561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 msgr2=0x7f77540d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 --2- 172.21.15.37:0/2623561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540d3b00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f775408e4c0 tx=0x7f774402a0b0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 -- 172.21.15.37:0/2623561606 shutdown_connections 2024-05-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 --2- 172.21.15.37:0/2623561606 >> v2:172.21.15.82:3300/0 conn(0x7f77540c8ed0 0x7f77540c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 --2- 172.21.15.37:0/2623561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540d3b00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 --2- 172.21.15.37:0/2623561606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f77540d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 -- 172.21.15.37:0/2623561606 >> 172.21.15.37:0/2623561606 conn(0x7f77540d4fe0 msgr2=0x7f77540d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 -- 172.21.15.37:0/2623561606 shutdown_connections 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.822+0000 7f775c3da640 1 -- 172.21.15.37:0/2623561606 wait complete. 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.823+0000 7f775c3da640 1 Processor -- start 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.823+0000 7f775c3da640 1 -- start start 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77540c8ed0 0x7f77540b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f775415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77540cf440 con 0x7f77540d2dc0 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77540cf2c0 con 0x7f77540c8ed0 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f77540c98a0 con 0x7f77541629a0 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55608/0 (socket says 172.21.15.37:55608) 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 -- 172.21.15.37:0/1322951120 learned_addr learned my addr 172.21.15.37:0/1322951120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775a176640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77540c8ed0 0x7f77540b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775a977640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f775415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 -- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 msgr2=0x7f775415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f775415e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 -- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77540c8ed0 msgr2=0x7f77540b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77540c8ed0 0x7f77540b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 -- 172.21.15.37:0/1322951120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77540b2700 con 0x7f77540d2dc0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f7759975640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540b1f90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f774402a0f0 tx=0x7f77440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f774affd640 1 -- 172.21.15.37:0/1322951120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744042070 con 0x7f77540d2dc0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f774affd640 1 -- 172.21.15.37:0/1322951120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774403e460 con 0x7f77540d2dc0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77540b29e0 con 0x7f77540d2dc0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f774affd640 1 -- 172.21.15.37:0/1322951120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744037040 con 0x7f77540d2dc0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.824+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77540b2fa0 con 0x7f77540d2dc0 2024-05-10T08:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.825+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77540b63d0 con 0x7f77540d2dc0 2024-05-10T08:45:30.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.826+0000 7f774affd640 1 -- 172.21.15.37:0/1322951120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f774403a040 con 0x7f77540d2dc0 2024-05-10T08:45:30.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.826+0000 7f774affd640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77380762d0 0x7f7738078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:30.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.827+0000 7f774affd640 1 -- 172.21.15.37:0/1322951120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f77440b72c0 con 0x7f77540d2dc0 2024-05-10T08:45:30.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.827+0000 7f775a176640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77380762d0 0x7f7738078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:30.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.827+0000 7f775a176640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77380762d0 0x7f7738078790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f77540b94a0 tx=0x7f7750009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:30.831+0000 7f774affd640 1 -- 172.21.15.37:0/1322951120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f77540b63d0 con 0x7f77540d2dc0 2024-05-10T08:45:31.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.024+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f77540693f0 con 0x7f77540d2dc0 2024-05-10T08:45:31.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.024+0000 7f774affd640 1 -- 172.21.15.37:0/1322951120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) ==== 84+0+65 (secure 0 0 0) 0x7f77440806f0 con 0x7f77540d2dc0 2024-05-10T08:45:31.023 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:31.024 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:45:31.024 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:45:31.024 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:45:31.024 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:45:31.024 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:31.024 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:45:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77380762d0 msgr2=0x7f7738078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77380762d0 0x7f7738078790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f77540b94a0 tx=0x7f7750009190 comp rx=0 tx=0).stop 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 msgr2=0x7f77540b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540b1f90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f774402a0f0 tx=0x7f77440046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 shutdown_connections 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f77380762d0 0x7f7738078790 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77541629a0 0x7f775415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77540d2dc0 0x7f77540b1f90 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 --2- 172.21.15.37:0/1322951120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77540c8ed0 0x7f77540b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 >> 172.21.15.37:0/1322951120 conn(0x7f77540d4fe0 msgr2=0x7f775406d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 shutdown_connections 2024-05-10T08:45:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.026+0000 7f775c3da640 1 -- 172.21.15.37:0/1322951120 wait complete. 2024-05-10T08:45:31.036 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:45:31.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.146+0000 7f48e05dd640 1 Processor -- start 2024-05-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.146+0000 7f48e05dd640 1 -- start start 2024-05-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48e05dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48d80cef40 0x7f48d816ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48e05dd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d80d2030 con 0x7f48d80cf8f0 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48e05dd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d815f8d0 con 0x7f48d80d3920 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48e05dd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f48d8071320 con 0x7f48d80cef40 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48deb7a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48d80cef40 0x7f48d816ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48de379640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f48d80cf8f0 0x7f48d8070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59840/0 (socket says 172.21.15.37:59840) 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48de379640 1 -- 172.21.15.37:0/1967179945 learned_addr learned my addr 172.21.15.37:0/1967179945 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48deb7a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48d80cef40 0x7f48d816ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55618/0 (socket says 172.21.15.37:55618) 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48deb7a640 1 -- 172.21.15.37:0/1967179945 >> v1:172.21.15.82:6789/0 conn(0x7f48d80d3920 legacy=0x7f48d8070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48deb7a640 1 -- 172.21.15.37:0/1967179945 >> v1:172.21.15.37:6789/0 conn(0x7f48d80cf8f0 legacy=0x7f48d8070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.147+0000 7f48dd377640 1 -- 172.21.15.37:0/1967179945 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210059282 0 0) 0x7f48d4001110 con 0x7f48d80cf8f0 2024-05-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.148+0000 7f48deb7a640 1 -- 172.21.15.37:0/1967179945 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d80d22b0 con 0x7f48d80cef40 2024-05-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.148+0000 7f48deb7a640 1 --2- 172.21.15.37:0/1967179945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cef40 0x7f48d816ab40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009d90 tx=0x7f48d002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7627ad62f533890f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.148+0000 7f48dd377640 1 -- 172.21.15.37:0/1967179945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0007740 con 0x7f48d80cef40 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.148+0000 7f48dd377640 1 -- 172.21.15.37:0/1967179945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d00078e0 con 0x7f48d80cef40 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.148+0000 7f48dd377640 1 -- 172.21.15.37:0/1967179945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0007cb0 con 0x7f48d80cef40 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.149+0000 7f48e05dd640 1 -- 172.21.15.37:0/1967179945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cef40 msgr2=0x7f48d816ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.149+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1967179945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cef40 0x7f48d816ab40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009d90 tx=0x7f48d002a730 comp rx=0 tx=0).stop 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.149+0000 7f48e05dd640 1 -- 172.21.15.37:0/1967179945 shutdown_connections 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.149+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1967179945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cef40 0x7f48d816ab40 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.149+0000 7f48e05dd640 1 -- 172.21.15.37:0/1967179945 >> 172.21.15.37:0/1967179945 conn(0x7f48d80d2e00 msgr2=0x7f48d80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.149+0000 7f48e05dd640 1 -- 172.21.15.37:0/1967179945 shutdown_connections 2024-05-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.149+0000 7f48e05dd640 1 -- 172.21.15.37:0/1967179945 wait complete. 2024-05-10T08:45:31.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.150+0000 7f48e05dd640 1 Processor -- start 2024-05-10T08:45:31.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.150+0000 7f48e05dd640 1 -- start start 2024-05-10T08:45:31.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48e05dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48d80cef40 0x7f48d8157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48e05dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cf8f0 0x7f48d8158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48e05dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d80d3920 0x7f48d80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48e05dd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80cd730 con 0x7f48d80cf8f0 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48e05dd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80cd450 con 0x7f48d80d3920 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48e05dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f48d80cda10 con 0x7f48d80cef40 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cf8f0 0x7f48d8158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cf8f0 0x7f48d8158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55634/0 (socket says 172.21.15.37:55634) 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 -- 172.21.15.37:0/1988095090 learned_addr learned my addr 172.21.15.37:0/1988095090 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48deb7a640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d80d3920 0x7f48d80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48de379640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48d80cef40 0x7f48d8157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 -- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48d80cef40 msgr2=0x7f48d8157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48d80cef40 0x7f48d8157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 -- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d80d3920 msgr2=0x7f48d80cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d80d3920 0x7f48d80cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.151+0000 7f48ddb78640 1 -- 172.21.15.37:0/1988095090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d80c7770 con 0x7f48d80cf8f0 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.152+0000 7f48ddb78640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cf8f0 0x7f48d8158420 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f48c800c430 tx=0x7f48c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.152+0000 7f48ceffd640 1 -- 172.21.15.37:0/1988095090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8011790 con 0x7f48d80cf8f0 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.152+0000 7f48ceffd640 1 -- 172.21.15.37:0/1988095090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8017070 con 0x7f48d80cf8f0 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.152+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d815a580 con 0x7f48d80cf8f0 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.152+0000 7f48ceffd640 1 -- 172.21.15.37:0/1988095090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8011b70 con 0x7f48d80cf8f0 2024-05-10T08:45:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.152+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d815ab40 con 0x7f48d80cf8f0 2024-05-10T08:45:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.153+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d815ad40 con 0x7f48d80cf8f0 2024-05-10T08:45:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.154+0000 7f48ceffd640 1 -- 172.21.15.37:0/1988095090 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f48c8011d10 con 0x7f48d80cf8f0 2024-05-10T08:45:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.154+0000 7f48ceffd640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f48bc0762d0 0x7f48bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.154+0000 7f48ceffd640 1 -- 172.21.15.37:0/1988095090 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f48c8097220 con 0x7f48d80cf8f0 2024-05-10T08:45:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.154+0000 7f48de379640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f48bc0762d0 0x7f48bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:31.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.155+0000 7f48de379640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f48bc0762d0 0x7f48bc078790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f48d4000f60 tx=0x7f48d4007c00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:31.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.158+0000 7f48ceffd640 1 -- 172.21.15.37:0/1988095090 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f48d815ad40 con 0x7f48d80cf8f0 2024-05-10T08:45:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:31.351+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f48d80693f0 con 0x7f48d80cf8f0 2024-05-10T08:45:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.297+0000 7f48ceffd640 1 -- 172.21.15.37:0/1988095090 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) ==== 138+0+0 (secure 0 0 0) 0x7f48c8060dd0 con 0x7f48d80cf8f0 2024-05-10T08:45:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:45:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f48bc0762d0 msgr2=0x7f48bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f48bc0762d0 0x7f48bc078790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f48d4000f60 tx=0x7f48d4007c00 comp rx=0 tx=0).stop 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cf8f0 msgr2=0x7f48d8158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cf8f0 0x7f48d8158420 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f48c800c430 tx=0x7f48c800c8f0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 shutdown_connections 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f48bc0762d0 0x7f48bc078790 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d80d3920 0x7f48d80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d80cf8f0 0x7f48d8158420 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 --2- 172.21.15.37:0/1988095090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f48d80cef40 0x7f48d8157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 >> 172.21.15.37:0/1988095090 conn(0x7f48d80d2e00 msgr2=0x7f48d80d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 shutdown_connections 2024-05-10T08:45:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.301+0000 7f48e05dd640 1 -- 172.21.15.37:0/1988095090 wait complete. 2024-05-10T08:45:32.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:45:32.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.437+0000 7f61e3124640 1 Processor -- start 2024-05-10T08:45:32.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.437+0000 7f61e3124640 1 -- start start 2024-05-10T08:45:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.437+0000 7f61e3124640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 0x7f61dc15d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.437+0000 7f61e3124640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f61dc070b90 0x7f61dc071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.437+0000 7f61e3124640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61dc0718c0 con 0x7f61dc15ccb0 2024-05-10T08:45:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.437+0000 7f61e3124640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f61dc0afba0 con 0x7f61dc070b90 2024-05-10T08:45:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.437+0000 7f61e3124640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc071ba0 con 0x7f61dc0d33f0 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61e0ec0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f61dc15ccb0 0x7f61dc0d2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59842/0 (socket says 172.21.15.37:59842) 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61e0ec0640 1 -- 172.21.15.37:0/343696837 learned_addr learned my addr 172.21.15.37:0/343696837 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61e16c1640 1 --2- 172.21.15.37:0/343696837 >> v2:172.21.15.82:3300/0 conn(0x7f61dc070b90 0x7f61dc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61dbfff640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 0x7f61dc15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991426216 0 0) 0x7f61dc0718c0 con 0x7f61dc15ccb0 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61cc003520 con 0x7f61dc15ccb0 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4039395033 0 0) 0x7f61cc003520 con 0x7f61dc15ccb0 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 msgr2=0x7f61dc15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 0x7f61dc15d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 >> v2:172.21.15.82:3300/0 conn(0x7f61dc070b90 msgr2=0x7f61dc071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 --2- 172.21.15.37:0/343696837 >> v2:172.21.15.82:3300/0 conn(0x7f61dc070b90 0x7f61dc071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc071e80 con 0x7f61dc15ccb0 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f61d0001670 con 0x7f61dc15ccb0 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 >> v1:172.21.15.37:6789/0 conn(0x7f61dc15ccb0 legacy=0x7f61dc0d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0039b0 0x7f61cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc004800 0x7f61cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 0x7f61cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc071ba0 con 0x7f61cc004800 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc00b9c0 con 0x7f61cc0039b0 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f61cc00bb40 con 0x7f61dc0d33f0 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61dbfff640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc004800 0x7f61cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.438+0000 7f61e0ec0640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0039b0 0x7f61cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.439+0000 7f61e16c1640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 0x7f61cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.439+0000 7f61dbfff640 1 -- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 msgr2=0x7f61cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:32.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.439+0000 7f61dbfff640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0d33f0 0x7f61cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.439+0000 7f61dbfff640 1 -- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0039b0 msgr2=0x7f61cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.439+0000 7f61dbfff640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0039b0 0x7f61cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.439+0000 7f61dbfff640 1 -- 172.21.15.37:0/343696837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc003520 con 0x7f61cc004800 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61dbfff640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc004800 0x7f61cc004c80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009af0 tx=0x7f61cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc7085000cc1484 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8036070 con 0x7f61cc004800 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c8031400 con 0x7f61cc004800 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61db7fe640 1 -- 172.21.15.37:0/343696837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8009690 con 0x7f61cc004800 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61e3124640 1 -- 172.21.15.37:0/343696837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc004800 msgr2=0x7f61cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61e3124640 1 --2- 172.21.15.37:0/343696837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc004800 0x7f61cc004c80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009af0 tx=0x7f61cc005830 comp rx=0 tx=0).stop 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61e16c1640 1 -- 172.21.15.37:0/343696837 reap_dead start 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61e3124640 1 -- 172.21.15.37:0/343696837 shutdown_connections 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61e3124640 1 -- 172.21.15.37:0/343696837 >> 172.21.15.37:0/343696837 conn(0x7f61dc09ba40 msgr2=0x7f61dc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:32.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61e3124640 1 -- 172.21.15.37:0/343696837 shutdown_connections 2024-05-10T08:45:32.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.440+0000 7f61e3124640 1 -- 172.21.15.37:0/343696837 wait complete. 2024-05-10T08:45:32.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.442+0000 7f61e3124640 1 Processor -- start 2024-05-10T08:45:32.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.442+0000 7f61e3124640 1 -- start start 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.442+0000 7f61e3124640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc004800 0x7f61dc0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.442+0000 7f61e3124640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61dc14f160 0x7f61dc0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e3124640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0c9280 0x7f61dc1f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e3124640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc15d090 con 0x7f61dc14f160 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e3124640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc071560 con 0x7f61cc004800 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e3124640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc15d210 con 0x7f61dc0c9280 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61dc14f160 0x7f61dc0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61dc14f160 0x7f61dc0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55644/0 (socket says 172.21.15.37:55644) 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 -- 172.21.15.37:0/3656618324 learned_addr learned my addr 172.21.15.37:0/3656618324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e0ec0640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc004800 0x7f61dc0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e16c1640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0c9280 0x7f61dc1f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 -- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0c9280 msgr2=0x7f61dc1f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0c9280 0x7f61dc1f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 -- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc004800 msgr2=0x7f61dc0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc004800 0x7f61dc0cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 -- 172.21.15.37:0/3656618324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc0c9f00 con 0x7f61dc14f160 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e0ec0640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc004800 0x7f61dc0cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61dbfff640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61dc14f160 0x7f61dc0c8d40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009af0 tx=0x7f61c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61d97fa640 1 -- 172.21.15.37:0/3656618324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8041020 con 0x7f61dc14f160 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61d97fa640 1 -- 172.21.15.37:0/3656618324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c803c470 con 0x7f61dc14f160 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc0ca1e0 con 0x7f61dc14f160 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61d97fa640 1 -- 172.21.15.37:0/3656618324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8036040 con 0x7f61dc14f160 2024-05-10T08:45:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.443+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc0ca7a0 con 0x7f61dc14f160 2024-05-10T08:45:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.444+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61dc069b00 con 0x7f61dc14f160 2024-05-10T08:45:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.445+0000 7f61d97fa640 1 -- 172.21.15.37:0/3656618324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f61c8044020 con 0x7f61dc14f160 2024-05-10T08:45:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.446+0000 7f61d97fa640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f61c0076300 0x7f61c00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.446+0000 7f61d97fa640 1 -- 172.21.15.37:0/3656618324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5619+0+0 (secure 0 0 0) 0x7f61c80b7cc0 con 0x7f61dc14f160 2024-05-10T08:45:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.446+0000 7f61e0ec0640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f61c0076300 0x7f61c00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.446+0000 7f61e0ec0640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f61c0076300 0x7f61c00787c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f61d0001050 tx=0x7f61d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.450+0000 7f61d97fa640 1 -- 172.21.15.37:0/3656618324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f61c80be080 con 0x7f61dc14f160 2024-05-10T08:45:32.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:32.640+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f61dc070380 con 0x7f61dc14f160 2024-05-10T08:45:33.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.300+0000 7f61d97fa640 1 -- 172.21.15.37:0/3656618324 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7f61c804b030 con 0x7f61dc14f160 2024-05-10T08:45:33.299 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:45:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f61c0076300 msgr2=0x7f61c00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f61c0076300 0x7f61c00787c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f61d0001050 tx=0x7f61d0009040 comp rx=0 tx=0).stop 2024-05-10T08:45:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61dc14f160 msgr2=0x7f61dc0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61dc14f160 0x7f61dc0c8d40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009af0 tx=0x7f61c8004730 comp rx=0 tx=0).stop 2024-05-10T08:45:33.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 shutdown_connections 2024-05-10T08:45:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f61c0076300 0x7f61c00787c0 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f61d0001050 tx=0x7f61d0009040 comp rx=0 tx=0).stop 2024-05-10T08:45:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f61dc0c9280 0x7f61dc1f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61dc14f160 0x7f61dc0c8d40 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 --2- 172.21.15.37:0/3656618324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc004800 0x7f61dc0cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 >> 172.21.15.37:0/3656618324 conn(0x7f61dc09ba40 msgr2=0x7f61dc0b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.304+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 shutdown_connections 2024-05-10T08:45:33.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.305+0000 7f61e3124640 1 -- 172.21.15.37:0/3656618324 wait complete. 2024-05-10T08:45:33.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.442+0000 7f2a63693640 1 Processor -- start 2024-05-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.442+0000 7f2a63693640 1 -- start start 2024-05-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a63693640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2a5c0cfcd0 0x7f2a5c0d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a63693640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5c0d0320 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a63693640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5c0d0600 con 0x7f2a5c15f4e0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a63693640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5c0d41b0 con 0x7f2a5c0cfcd0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a61c30640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a5c0d54e0 0x7f2a5c0d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59858/0 (socket says 172.21.15.37:59858) 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a61c30640 1 -- 172.21.15.37:0/838215698 learned_addr learned my addr 172.21.15.37:0/838215698 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a60c2e640 1 --2- 172.21.15.37:0/838215698 >> v2:172.21.15.82:3300/0 conn(0x7f2a5c0cfcd0 0x7f2a5c0d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a4ffff640 1 -- 172.21.15.37:0/838215698 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708750906 0 0) 0x7f2a5c0d0320 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.443+0000 7f2a4ffff640 1 -- 172.21.15.37:0/838215698 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a48003520 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.444+0000 7f2a4ffff640 1 -- 172.21.15.37:0/838215698 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085943581 0 0) 0x7f2a5c0d0600 con 0x7f2a5c15f4e0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.444+0000 7f2a4ffff640 1 -- 172.21.15.37:0/838215698 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a5c0d0320 con 0x7f2a5c15f4e0 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.444+0000 7f2a60c2e640 1 -- 172.21.15.37:0/838215698 >> v1:172.21.15.82:6789/0 conn(0x7f2a5c15f4e0 legacy=0x7f2a5c0d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.444+0000 7f2a60c2e640 1 -- 172.21.15.37:0/838215698 >> v1:172.21.15.37:6789/0 conn(0x7f2a5c0d54e0 legacy=0x7f2a5c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.444+0000 7f2a60c2e640 1 -- 172.21.15.37:0/838215698 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c0d08e0 con 0x7f2a5c0cfcd0 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.444+0000 7f2a60c2e640 1 --2- 172.21.15.37:0/838215698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0cfcd0 0x7f2a5c0d4fa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2a580097a0 tx=0x7f2a5802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf8a906146303fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a4ffff640 1 -- 172.21.15.37:0/838215698 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58037070 con 0x7f2a5c0cfcd0 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a4ffff640 1 -- 172.21.15.37:0/838215698 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a58032440 con 0x7f2a5c0cfcd0 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a4ffff640 1 -- 172.21.15.37:0/838215698 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58032810 con 0x7f2a5c0cfcd0 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a63693640 1 -- 172.21.15.37:0/838215698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0cfcd0 msgr2=0x7f2a5c0d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a63693640 1 --2- 172.21.15.37:0/838215698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0cfcd0 0x7f2a5c0d4fa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2a580097a0 tx=0x7f2a5802a230 comp rx=0 tx=0).stop 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a63693640 1 -- 172.21.15.37:0/838215698 shutdown_connections 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a63693640 1 --2- 172.21.15.37:0/838215698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0cfcd0 0x7f2a5c0d4fa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a63693640 1 -- 172.21.15.37:0/838215698 >> 172.21.15.37:0/838215698 conn(0x7f2a5c08eac0 msgr2=0x7f2a5c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a63693640 1 -- 172.21.15.37:0/838215698 shutdown_connections 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.445+0000 7f2a63693640 1 -- 172.21.15.37:0/838215698 wait complete. 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.446+0000 7f2a63693640 1 Processor -- start 2024-05-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.446+0000 7f2a63693640 1 -- start start 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a63693640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0cfcd0 0x7f2a5c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a63693640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a5c0d54e0 0x7f2a5c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a63693640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c15f4e0 0x7f2a5c161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a63693640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c15f8c0 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a63693640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c0d0ea0 con 0x7f2a5c15f4e0 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a63693640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c0d1ad0 con 0x7f2a5c0cfcd0 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a60c2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a5c0d54e0 0x7f2a5c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a60c2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a5c0d54e0 0x7f2a5c152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55654/0 (socket says 172.21.15.37:55654) 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a60c2e640 1 -- 172.21.15.37:0/528723149 learned_addr learned my addr 172.21.15.37:0/528723149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a61c30640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c15f4e0 0x7f2a5c161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.447+0000 7f2a6142f640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0cfcd0 0x7f2a5c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a60c2e640 1 -- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0cfcd0 msgr2=0x7f2a5c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a60c2e640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0cfcd0 0x7f2a5c0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a60c2e640 1 -- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c15f4e0 msgr2=0x7f2a5c161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a60c2e640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c15f4e0 0x7f2a5c161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a60c2e640 1 -- 172.21.15.37:0/528723149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c0cf2b0 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a60c2e640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a5c0d54e0 0x7f2a5c152ba0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2a58035040 tx=0x7f2a580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a4dffb640 1 -- 172.21.15.37:0/528723149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58041030 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a4dffb640 1 -- 172.21.15.37:0/528723149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5803d4e0 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c153810 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a4dffb640 1 -- 172.21.15.37:0/528723149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58037040 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.448+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c0b85f0 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.449+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c0693f0 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.450+0000 7f2a4dffb640 1 -- 172.21.15.37:0/528723149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2a58044070 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.450+0000 7f2a4dffb640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2a400762d0 0x7f2a40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.451+0000 7f2a4dffb640 1 -- 172.21.15.37:0/528723149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6001+0+0 (secure 0 0 0) 0x7f2a580b7c20 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.451+0000 7f2a6142f640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2a400762d0 0x7f2a40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.451+0000 7f2a6142f640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2a400762d0 0x7f2a40078790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2a500011e0 tx=0x7f2a50009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.455+0000 7f2a4dffb640 1 -- 172.21.15.37:0/528723149 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2a58080e10 con 0x7f2a5c0d54e0 2024-05-10T08:45:33.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:33.690+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2a5c09e5f0 con 0x7f2a5c0d54e0 2024-05-10T08:45:34.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.345+0000 7f2a4dffb640 1 -- 172.21.15.37:0/528723149 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v57) ==== 174+0+0 (secure 0 0 0) 0x7f2a58085110 con 0x7f2a5c0d54e0 2024-05-10T08:45:34.348 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 13 and data pool 14 2024-05-10T08:45:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.356+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2a400762d0 msgr2=0x7f2a40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.356+0000 7f2a63693640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2a400762d0 0x7f2a40078790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2a500011e0 tx=0x7f2a50009040 comp rx=0 tx=0).stop 2024-05-10T08:45:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.356+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a5c0d54e0 msgr2=0x7f2a5c152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.356+0000 7f2a63693640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a5c0d54e0 0x7f2a5c152ba0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2a58035040 tx=0x7f2a580046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.356+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 shutdown_connections 2024-05-10T08:45:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.357+0000 7f2a63693640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2a400762d0 0x7f2a40078790 secure :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2a500011e0 tx=0x7f2a50009040 comp rx=0 tx=0).stop 2024-05-10T08:45:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.357+0000 7f2a63693640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c15f4e0 0x7f2a5c161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.357+0000 7f2a63693640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a5c0d54e0 0x7f2a5c152ba0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.357+0000 7f2a63693640 1 --2- 172.21.15.37:0/528723149 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0cfcd0 0x7f2a5c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.357+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 >> 172.21.15.37:0/528723149 conn(0x7f2a5c08eac0 msgr2=0x7f2a5c06daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.360+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 shutdown_connections 2024-05-10T08:45:34.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.360+0000 7f2a63693640 1 -- 172.21.15.37:0/528723149 wait complete. 2024-05-10T08:45:34.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:45:34.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.488+0000 7fa71b0dc640 1 Processor -- start 2024-05-10T08:45:34.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.488+0000 7fa71b0dc640 1 -- start start 2024-05-10T08:45:34.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa71b0dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa71b0dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa714072840 0x7fa7140d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa71b0dc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7140d14b0 con 0x7fa71406e4d0 2024-05-10T08:45:34.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa71b0dc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa71415c920 con 0x7fa714072840 2024-05-10T08:45:34.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa71b0dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa71415cc00 con 0x7fa71406e0f0 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa70bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa714072840 0x7fa7140d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa719679640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa71406e4d0 0x7fa7140b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59862/0 (socket says 172.21.15.37:59862) 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa719679640 1 -- 172.21.15.37:0/3955939839 learned_addr learned my addr 172.21.15.37:0/3955939839 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa70bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa714072840 0x7fa7140d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55668/0 (socket says 172.21.15.37:55668) 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa718e78640 1 --2- 172.21.15.37:0/3955939839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa70bfff640 1 -- 172.21.15.37:0/3955939839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 msgr2=0x7fa71415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa70bfff640 1 --2- 172.21.15.37:0/3955939839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa70b7fe640 1 -- 172.21.15.37:0/3955939839 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733502628 0 0) 0x7fa7140d14b0 con 0x7fa71406e4d0 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa70bfff640 1 -- 172.21.15.37:0/3955939839 >> v1:172.21.15.37:6789/0 conn(0x7fa71406e4d0 legacy=0x7fa7140b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.489+0000 7fa70bfff640 1 -- 172.21.15.37:0/3955939839 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71415cee0 con 0x7fa714072840 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.490+0000 7fa70bfff640 1 --2- 172.21.15.37:0/3955939839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa714072840 0x7fa7140d0f70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097a0 tx=0x7fa70402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97d37d751c88850 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.490+0000 7fa70b7fe640 1 -- 172.21.15.37:0/3955939839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704037070 con 0x7fa714072840 2024-05-10T08:45:34.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.490+0000 7fa70b7fe640 1 -- 172.21.15.37:0/3955939839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa704032440 con 0x7fa714072840 2024-05-10T08:45:34.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.490+0000 7fa70b7fe640 1 -- 172.21.15.37:0/3955939839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704032810 con 0x7fa714072840 2024-05-10T08:45:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 -- 172.21.15.37:0/3955939839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa714072840 msgr2=0x7fa7140d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/3955939839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa714072840 0x7fa7140d0f70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097a0 tx=0x7fa70402a180 comp rx=0 tx=0).stop 2024-05-10T08:45:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 -- 172.21.15.37:0/3955939839 shutdown_connections 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/3955939839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa714072840 0x7fa7140d0f70 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/3955939839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 -- 172.21.15.37:0/3955939839 >> 172.21.15.37:0/3955939839 conn(0x7fa71406c3a0 msgr2=0x7fa71406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 -- 172.21.15.37:0/3955939839 shutdown_connections 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.491+0000 7fa71b0dc640 1 -- 172.21.15.37:0/3955939839 wait complete. 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.492+0000 7fa71b0dc640 1 Processor -- start 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.492+0000 7fa71b0dc640 1 -- start start 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa71b0dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71409e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa71b0dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406e4d0 0x7fa714145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa71b0dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa714072840 0x7fa714155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa71b0dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7140ae650 con 0x7fa71406e4d0 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa71b0dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa71406e980 con 0x7fa714072840 2024-05-10T08:45:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa71b0dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7140ae7d0 con 0x7fa71406e0f0 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406e4d0 0x7fa714145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406e4d0 0x7fa714145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55672/0 (socket says 172.21.15.37:55672) 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 -- 172.21.15.37:0/735568162 learned_addr learned my addr 172.21.15.37:0/735568162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa718e78640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71409e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa719679640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa714072840 0x7fa714155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 -- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 msgr2=0x7fa71409e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71409e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 -- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa714072840 msgr2=0x7fa714155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa714072840 0x7fa714155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa70bfff640 1 -- 172.21.15.37:0/735568162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71409eea0 con 0x7fa71406e4d0 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.493+0000 7fa719679640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa714072840 0x7fa714155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.494+0000 7fa70bfff640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406e4d0 0x7fa714145ca0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097a0 tx=0x7fa7040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.494+0000 7fa7097fa640 1 -- 172.21.15.37:0/735568162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704037040 con 0x7fa71406e4d0 2024-05-10T08:45:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.494+0000 7fa7097fa640 1 -- 172.21.15.37:0/735568162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa704004030 con 0x7fa71406e4d0 2024-05-10T08:45:34.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.494+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa714154e80 con 0x7fa71406e4d0 2024-05-10T08:45:34.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.494+0000 7fa7097fa640 1 -- 172.21.15.37:0/735568162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704006e10 con 0x7fa71406e4d0 2024-05-10T08:45:34.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.494+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa714155440 con 0x7fa71406e4d0 2024-05-10T08:45:34.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.495+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7140693f0 con 0x7fa71406e4d0 2024-05-10T08:45:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.495+0000 7fa7097fa640 1 -- 172.21.15.37:0/735568162 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa704030770 con 0x7fa71406e4d0 2024-05-10T08:45:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.496+0000 7fa7097fa640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7000762d0 0x7fa700078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.496+0000 7fa7097fa640 1 -- 172.21.15.37:0/735568162 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa7040b8950 con 0x7fa71406e4d0 2024-05-10T08:45:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.496+0000 7fa718e78640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7000762d0 0x7fa700078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.497+0000 7fa718e78640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7000762d0 0x7fa700078790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa710006fd0 tx=0x7fa710008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.501+0000 7fa7097fa640 1 -- 172.21.15.37:0/735568162 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa704082120 con 0x7fa71406e4d0 2024-05-10T08:45:34.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.691+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7140765b0 con 0x7fa71406e4d0 2024-05-10T08:45:34.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.693+0000 7fa7097fa640 1 -- 172.21.15.37:0/735568162 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16838 (secure 0 0 0) 0x7fa704081a20 con 0x7fa71406e4d0 2024-05-10T08:45:34.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:34.692 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:45:33.691642+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:45:31.356272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T08:45:32.644920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.694+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7000762d0 msgr2=0x7fa700078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7000762d0 0x7fa700078790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa710006fd0 tx=0x7fa710008040 comp rx=0 tx=0).stop 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406e4d0 msgr2=0x7fa714145ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406e4d0 0x7fa714145ca0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097a0 tx=0x7fa7040046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 shutdown_connections 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7000762d0 0x7fa700078790 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa714072840 0x7fa714155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406e4d0 0x7fa714145ca0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 --2- 172.21.15.37:0/735568162 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa71406e0f0 0x7fa71409e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 >> 172.21.15.37:0/735568162 conn(0x7fa71406c3a0 msgr2=0x7fa714159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 shutdown_connections 2024-05-10T08:45:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.695+0000 7fa71b0dc640 1 -- 172.21.15.37:0/735568162 wait complete. 2024-05-10T08:45:34.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:45:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.811+0000 7ff2cc311640 1 Processor -- start 2024-05-10T08:45:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.811+0000 7ff2cc311640 1 -- start start 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2cc311640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2c406e0f0 0x7ff2c415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2cc311640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c415c920 con 0x7ff2c406e4d0 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2cc311640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c415cc00 con 0x7ff2c4072840 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2cc311640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c415cee0 con 0x7ff2c406e0f0 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2ca0ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2c406e0f0 0x7ff2c415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2ca0ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2c406e0f0 0x7ff2c415c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55680/0 (socket says 172.21.15.37:55680) 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2ca0ad640 1 -- 172.21.15.37:0/1944379530 learned_addr learned my addr 172.21.15.37:0/1944379530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.812+0000 7ff2ca8ae640 1 --1- 172.21.15.37:0/1944379530 >> v1:172.21.15.37:6789/0 conn(0x7ff2c406e4d0 0x7ff2c40aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59864/0 (socket says 172.21.15.37:59864) 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.813+0000 7ff2ca0ad640 1 -- 172.21.15.37:0/1944379530 >> v1:172.21.15.82:6789/0 conn(0x7ff2c4072840 legacy=0x7ff2c40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.813+0000 7ff2ca0ad640 1 -- 172.21.15.37:0/1944379530 >> v1:172.21.15.37:6789/0 conn(0x7ff2c406e4d0 legacy=0x7ff2c40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.813+0000 7ff2c90ab640 1 -- 172.21.15.37:0/1944379530 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065183578 0 0) 0x7ff2c415c920 con 0x7ff2c406e4d0 2024-05-10T08:45:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.813+0000 7ff2ca0ad640 1 -- 172.21.15.37:0/1944379530 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c415d1c0 con 0x7ff2c406e0f0 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.813+0000 7ff2ca0ad640 1 --2- 172.21.15.37:0/1944379530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e0f0 0x7ff2c415c340 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000d150 tx=0x7ff2c002c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af603f997260aff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2c90ab640 1 -- 172.21.15.37:0/1944379530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0035020 con 0x7ff2c406e0f0 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2c90ab640 1 -- 172.21.15.37:0/1944379530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c000b2d0 con 0x7ff2c406e0f0 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2c90ab640 1 -- 172.21.15.37:0/1944379530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000b480 con 0x7ff2c406e0f0 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2cc311640 1 -- 172.21.15.37:0/1944379530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e0f0 msgr2=0x7ff2c415c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1944379530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e0f0 0x7ff2c415c340 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000d150 tx=0x7ff2c002c9c0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2cc311640 1 -- 172.21.15.37:0/1944379530 shutdown_connections 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1944379530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e0f0 0x7ff2c415c340 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2cc311640 1 -- 172.21.15.37:0/1944379530 >> 172.21.15.37:0/1944379530 conn(0x7ff2c406c3a0 msgr2=0x7ff2c406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2cc311640 1 -- 172.21.15.37:0/1944379530 shutdown_connections 2024-05-10T08:45:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.814+0000 7ff2cc311640 1 -- 172.21.15.37:0/1944379530 wait complete. 2024-05-10T08:45:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.815+0000 7ff2cc311640 1 Processor -- start 2024-05-10T08:45:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.815+0000 7ff2cc311640 1 -- start start 2024-05-10T08:45:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2cc311640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c406e0f0 0x7ff2c4147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2cc311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e4d0 0x7ff2c40b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2cc311640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2c4072840 0x7ff2c40cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2cc311640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c40ae7d0 con 0x7ff2c406e4d0 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2cc311640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c40ae650 con 0x7ff2c406e0f0 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2cc311640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c41530b0 con 0x7ff2c4072840 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2c98ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e4d0 0x7ff2c40b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2c98ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e4d0 0x7ff2c40b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55692/0 (socket says 172.21.15.37:55692) 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2c98ac640 1 -- 172.21.15.37:0/1476101763 learned_addr learned my addr 172.21.15.37:0/1476101763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2ca0ad640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c406e0f0 0x7ff2c4147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.816+0000 7ff2ca8ae640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2c4072840 0x7ff2c40cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2c98ac640 1 -- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2c4072840 msgr2=0x7ff2c40cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2c98ac640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2c4072840 0x7ff2c40cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2c98ac640 1 -- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c406e0f0 msgr2=0x7ff2c4147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2c98ac640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c406e0f0 0x7ff2c4147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2c98ac640 1 -- 172.21.15.37:0/1476101763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c40b5410 con 0x7ff2c406e4d0 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2ca0ad640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c406e0f0 0x7ff2c4147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2ca8ae640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2c4072840 0x7ff2c40cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2c98ac640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e4d0 0x7ff2c40b4a30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400c3c0 tx=0x7ff2b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2baffd640 1 -- 172.21.15.37:0/1476101763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4017070 con 0x7ff2c406e4d0 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2baffd640 1 -- 172.21.15.37:0/1476101763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b40052f0 con 0x7ff2c406e4d0 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c40b56f0 con 0x7ff2c406e4d0 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2baffd640 1 -- 172.21.15.37:0/1476101763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4003830 con 0x7ff2c406e4d0 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.817+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c40cb0c0 con 0x7ff2c406e4d0 2024-05-10T08:45:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.818+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c40693f0 con 0x7ff2c406e4d0 2024-05-10T08:45:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.819+0000 7ff2baffd640 1 -- 172.21.15.37:0/1476101763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff2b401a070 con 0x7ff2c406e4d0 2024-05-10T08:45:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.819+0000 7ff2baffd640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff2a80762d0 0x7ff2a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.819+0000 7ff2baffd640 1 -- 172.21.15.37:0/1476101763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7ff2b4096a30 con 0x7ff2c406e4d0 2024-05-10T08:45:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.820+0000 7ff2ca0ad640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff2a80762d0 0x7ff2a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.820+0000 7ff2ca0ad640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff2a80762d0 0x7ff2a8078790 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0036000 tx=0x7ff2c000b000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:34.824+0000 7ff2baffd640 1 -- 172.21.15.37:0/1476101763 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff2b4060290 con 0x7ff2c406e4d0 2024-05-10T08:45:35.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.016+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2c4147ed0 con 0x7ff2c406e4d0 2024-05-10T08:45:35.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.017+0000 7ff2baffd640 1 -- 172.21.15.37:0/1476101763 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16838 (secure 0 0 0) 0x7ff2b4068280 con 0x7ff2c406e4d0 2024-05-10T08:45:35.016 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:35.017 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:45:33.691642+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:45:31.356272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T08:45:32.644920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff2a80762d0 msgr2=0x7ff2a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff2a80762d0 0x7ff2a8078790 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0036000 tx=0x7ff2c000b000 comp rx=0 tx=0).stop 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e4d0 msgr2=0x7ff2c40b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e4d0 0x7ff2c40b4a30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400c3c0 tx=0x7ff2b400c880 comp rx=0 tx=0).stop 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 shutdown_connections 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff2a80762d0 0x7ff2a8078790 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff2c4072840 0x7ff2c40cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c406e4d0 0x7ff2c40b4a30 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 --2- 172.21.15.37:0/1476101763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c406e0f0 0x7ff2c4147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 >> 172.21.15.37:0/1476101763 conn(0x7ff2c406c3a0 msgr2=0x7ff2c415daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 shutdown_connections 2024-05-10T08:45:35.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.019+0000 7ff2cc311640 1 -- 172.21.15.37:0/1476101763 wait complete. 2024-05-10T08:45:35.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:45:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.138+0000 7fd5ad8a9640 1 Processor -- start 2024-05-10T08:45:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.138+0000 7fd5ad8a9640 1 -- start start 2024-05-10T08:45:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5ad8a9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd5a8163460 0x7fd5a80d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5ad8a9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a80d3320 con 0x7fd5a80d2bb0 2024-05-10T08:45:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5ad8a9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a80d3600 con 0x7fd5a80b6590 2024-05-10T08:45:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5ad8a9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a80d38e0 con 0x7fd5a8163460 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5a77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd5a80d2bb0 0x7fd5a815ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59870/0 (socket says 172.21.15.37:59870) 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5a77fe640 1 -- 172.21.15.37:0/834894684 learned_addr learned my addr 172.21.15.37:0/834894684 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5a67fc640 1 --2- 172.21.15.37:0/834894684 >> v2:172.21.15.82:3300/0 conn(0x7fd5a8163460 0x7fd5a80d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613490946 0 0) 0x7fd5a80d3320 con 0x7fd5a80d2bb0 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd594003520 con 0x7fd5a80d2bb0 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918048288 0 0) 0x7fd5a80d3600 con 0x7fd5a80b6590 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.139+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5a80d3320 con 0x7fd5a80b6590 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.140+0000 7fd5a67fc640 1 -- 172.21.15.37:0/834894684 >> v1:172.21.15.82:6789/0 conn(0x7fd5a80b6590 legacy=0x7fd5a8162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.140+0000 7fd5a67fc640 1 -- 172.21.15.37:0/834894684 >> v1:172.21.15.37:6789/0 conn(0x7fd5a80d2bb0 legacy=0x7fd5a815ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.140+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605991936 0 0) 0x7fd594003520 con 0x7fd5a80d2bb0 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.140+0000 7fd5a67fc640 1 -- 172.21.15.37:0/834894684 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a80d3bc0 con 0x7fd5a8163460 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.140+0000 7fd5a67fc640 1 --2- 172.21.15.37:0/834894684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 0x7fd5a80d0bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5900097a0 tx=0x7fd59002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d750c3c411895001 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.140+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590037070 con 0x7fd5a8163460 2024-05-10T08:45:35.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59002ac50 con 0x7fd5a8163460 2024-05-10T08:45:35.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5a5ffb640 1 -- 172.21.15.37:0/834894684 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980019f0 con 0x7fd5a8163460 2024-05-10T08:45:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/834894684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 msgr2=0x7fd5a80d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/834894684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 0x7fd5a80d0bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5900097a0 tx=0x7fd59002a1c0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/834894684 shutdown_connections 2024-05-10T08:45:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/834894684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 0x7fd5a80d0bd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/834894684 >> 172.21.15.37:0/834894684 conn(0x7fd5a80d4fe0 msgr2=0x7fd5a80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/834894684 shutdown_connections 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.141+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/834894684 wait complete. 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.142+0000 7fd5ad8a9640 1 Processor -- start 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.142+0000 7fd5ad8a9640 1 -- start start 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5ad8a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a80b6590 0x7fd5a8159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5ad8a9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5a80d2bb0 0x7fd5a81ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5ad8a9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 0x7fd5a815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5ad8a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a80b9080 con 0x7fd5a80b6590 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5ad8a9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a80d3020 con 0x7fd5a8163460 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5ad8a9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a80b9200 con 0x7fd5a80d2bb0 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a80b6590 0x7fd5a8159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a80b6590 0x7fd5a8159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55696/0 (socket says 172.21.15.37:55696) 2024-05-10T08:45:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.143+0000 7fd5a6ffd640 1 -- 172.21.15.37:0/2414342740 learned_addr learned my addr 172.21.15.37:0/2414342740 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5a6ffd640 1 -- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5a80d2bb0 msgr2=0x7fd5a81ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5a6ffd640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5a80d2bb0 0x7fd5a81ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5a77fe640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 0x7fd5a815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5a6ffd640 1 -- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 msgr2=0x7fd5a815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5a6ffd640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 0x7fd5a815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5a6ffd640 1 -- 172.21.15.37:0/2414342740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a815a4b0 con 0x7fd5a80b6590 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5a6ffd640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a80b6590 0x7fd5a8159f70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000c460 tx=0x7fd5a000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd59ffff640 1 -- 172.21.15.37:0/2414342740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0017070 con 0x7fd5a80b6590 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd59ffff640 1 -- 172.21.15.37:0/2414342740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a00052f0 con 0x7fd5a80b6590 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd59ffff640 1 -- 172.21.15.37:0/2414342740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0003830 con 0x7fd5a80b6590 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a81eac10 con 0x7fd5a80b6590 2024-05-10T08:45:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.144+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a815dad0 con 0x7fd5a80b6590 2024-05-10T08:45:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.145+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a80693f0 con 0x7fd5a80b6590 2024-05-10T08:45:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.146+0000 7fd59ffff640 1 -- 172.21.15.37:0/2414342740 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd5a001a070 con 0x7fd5a80b6590 2024-05-10T08:45:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.146+0000 7fd59ffff640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5880762d0 0x7fd588078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.146+0000 7fd59ffff640 1 -- 172.21.15.37:0/2414342740 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fd5a0096af0 con 0x7fd5a80b6590 2024-05-10T08:45:35.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.146+0000 7fd5a67fc640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5880762d0 0x7fd588078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:35.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.147+0000 7fd5a67fc640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5880762d0 0x7fd588078790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd590034000 tx=0x7fd59002c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.151+0000 7fd59ffff640 1 -- 172.21.15.37:0/2414342740 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd5a00602c0 con 0x7fd5a80b6590 2024-05-10T08:45:35.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:35.391+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd5a80d4520 con 0x7fd5a80b6590 2024-05-10T08:45:36.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.349+0000 7fd59ffff640 1 -- 172.21.15.37:0/2414342740 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) ==== 118+0+0 (secure 0 0 0) 0x7fd5a00682b0 con 0x7fd5a80b6590 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5880762d0 msgr2=0x7fd588078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5880762d0 0x7fd588078790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd590034000 tx=0x7fd59002c000 comp rx=0 tx=0).stop 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a80b6590 msgr2=0x7fd5a8159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a80b6590 0x7fd5a8159f70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000c460 tx=0x7fd5a000c920 comp rx=0 tx=0).stop 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 shutdown_connections 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd5880762d0 0x7fd588078790 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a8163460 0x7fd5a815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5a80d2bb0 0x7fd5a81ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 --2- 172.21.15.37:0/2414342740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a80b6590 0x7fd5a8159f70 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 >> 172.21.15.37:0/2414342740 conn(0x7fd5a80d4fe0 msgr2=0x7fd5a806d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.352+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 shutdown_connections 2024-05-10T08:45:36.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.353+0000 7fd5ad8a9640 1 -- 172.21.15.37:0/2414342740 wait complete. 2024-05-10T08:45:36.365 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T08:45:36.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:45:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.480+0000 7fa7b5d5f640 1 Processor -- start 2024-05-10T08:45:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.480+0000 7fa7b5d5f640 1 -- start start 2024-05-10T08:45:36.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.480+0000 7fa7b5d5f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa7b015f4e0 0x7fa7b00cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7b5d5f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 0x7fa7b00d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7b5d5f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b00d0320 con 0x7fa7b00d3f00 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7b5d5f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b00d0600 con 0x7fa7b015f4e0 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7b5d5f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b00d08e0 con 0x7fa7b00d3aa0 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7affff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa7b00d3f00 0x7fa7b00b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59884/0 (socket says 172.21.15.37:59884) 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7affff640 1 -- 172.21.15.37:0/2391441278 learned_addr learned my addr 172.21.15.37:0/2391441278 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7af7fe640 1 --2- 172.21.15.37:0/2391441278 >> v2:172.21.15.82:3300/0 conn(0x7fa7b015f4e0 0x7fa7b00cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 0x7fa7b00d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086855137 0 0) 0x7fa7b00d0320 con 0x7fa7b00d3f00 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa79c003520 con 0x7fa7b00d3f00 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3030696412 0 0) 0x7fa79c003520 con 0x7fa7b00d3f00 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 msgr2=0x7fa7b00d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 0x7fa7b00d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 >> v2:172.21.15.82:3300/0 conn(0x7fa7b015f4e0 msgr2=0x7fa7b00cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 --2- 172.21.15.37:0/2391441278 >> v2:172.21.15.82:3300/0 conn(0x7fa7b015f4e0 0x7fa7b00cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b00d0bc0 con 0x7fa7b00d3f00 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fa7a80019f0 con 0x7fa7b00d3f00 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 >> v1:172.21.15.37:6789/0 conn(0x7fa7b00d3f00 legacy=0x7fa7b00b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 0x7fa79c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa79c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c004d40 0x7fa79c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b00d0600 con 0x7fa79c003f30 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b00d08e0 con 0x7fa79c004d40 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.481+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c00b9c0 con 0x7fa7b00d3aa0 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa79c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7af7fe640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 0x7fa79c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7affff640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c004d40 0x7fa79c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7a6ffd640 1 -- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 msgr2=0x7fa79c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:36.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b00d3aa0 0x7fa79c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7a6ffd640 1 -- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c004d40 msgr2=0x7fa79c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c004d40 0x7fa79c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.482+0000 7fa7a6ffd640 1 -- 172.21.15.37:0/2391441278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c003520 con 0x7fa79c003f30 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa79c004800 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa798009ac0 tx=0x7fa79c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ff7004002abd05 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798036070 con 0x7fa79c003f30 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa798031400 con 0x7fa79c003f30 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7aeffd640 1 -- 172.21.15.37:0/2391441278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798009690 con 0x7fa79c003f30 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/2391441278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 msgr2=0x7fa79c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7b5d5f640 1 --2- 172.21.15.37:0/2391441278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa79c004800 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa798009ac0 tx=0x7fa79c005830 comp rx=0 tx=0).stop 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7affff640 1 -- 172.21.15.37:0/2391441278 reap_dead start 2024-05-10T08:45:36.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/2391441278 shutdown_connections 2024-05-10T08:45:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/2391441278 >> 172.21.15.37:0/2391441278 conn(0x7fa7b008eac0 msgr2=0x7fa7b009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/2391441278 shutdown_connections 2024-05-10T08:45:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.483+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/2391441278 wait complete. 2024-05-10T08:45:36.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.485+0000 7fa7b5d5f640 1 Processor -- start 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.485+0000 7fa7b5d5f640 1 -- start start 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.485+0000 7fa7b5d5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa7b00baae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.485+0000 7fa7b5d5f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7b00cea40 0x7fa7b00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7b5d5f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b0158f10 0x7fa7b00b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7b5d5f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b00d23d0 con 0x7fa79c003f30 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7b5d5f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b015f8c0 con 0x7fa7b00cea40 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7b5d5f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b00d2550 con 0x7fa7b0158f10 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa7b00baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa7b00baae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55710/0 (socket says 172.21.15.37:55710) 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 -- 172.21.15.37:0/1707716612 learned_addr learned my addr 172.21.15.37:0/1707716612 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7b00cea40 0x7fa7b00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7affff640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b0158f10 0x7fa7b00b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 -- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b0158f10 msgr2=0x7fa7b00b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b0158f10 0x7fa7b00b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 -- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7b00cea40 msgr2=0x7fa7b00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7b00cea40 0x7fa7b00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 -- 172.21.15.37:0/1707716612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b00cd9a0 con 0x7fa79c003f30 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7b00cea40 0x7fa7b00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7affff640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b0158f10 0x7fa7b00b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7af7fe640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa7b00baae0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0011a70 tx=0x7fa7a0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7acff9640 1 -- 172.21.15.37:0/1707716612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000fb50 con 0x7fa79c003f30 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7acff9640 1 -- 172.21.15.37:0/1707716612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a000fcf0 con 0x7fa79c003f30 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b00cdc80 con 0x7fa79c003f30 2024-05-10T08:45:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7acff9640 1 -- 172.21.15.37:0/1707716612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000fea0 con 0x7fa79c003f30 2024-05-10T08:45:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.486+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b00ce240 con 0x7fa79c003f30 2024-05-10T08:45:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.487+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b006e1d0 con 0x7fa79c003f30 2024-05-10T08:45:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.488+0000 7fa7acff9640 1 -- 172.21.15.37:0/1707716612 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa7a0012040 con 0x7fa79c003f30 2024-05-10T08:45:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.489+0000 7fa7acff9640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7900762d0 0x7fa790078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.489+0000 7fa7acff9640 1 -- 172.21.15.37:0/1707716612 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fa7a0097ee0 con 0x7fa79c003f30 2024-05-10T08:45:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.489+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7900762d0 0x7fa790078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.489+0000 7fa7a6ffd640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7900762d0 0x7fa790078790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa798033000 tx=0x7fa798008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.493+0000 7fa7acff9640 1 -- 172.21.15.37:0/1707716612 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa7b006e1d0 con 0x7fa79c003f30 2024-05-10T08:45:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:36.720+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa7b00b4900 con 0x7fa79c003f30 2024-05-10T08:45:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.350+0000 7fa7acff9640 1 -- 172.21.15.37:0/1707716612 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) ==== 122+0+0 (secure 0 0 0) 0x7fa7b00b4900 con 0x7fa79c003f30 2024-05-10T08:45:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7900762d0 msgr2=0x7fa790078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7900762d0 0x7fa790078790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa798033000 tx=0x7fa798008030 comp rx=0 tx=0).stop 2024-05-10T08:45:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 msgr2=0x7fa7b00baae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa7b00baae0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0011a70 tx=0x7fa7a0011f30 comp rx=0 tx=0).stop 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 shutdown_connections 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7900762d0 0x7fa790078790 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7b0158f10 0x7fa7b00b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7b00cea40 0x7fa7b00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 --2- 172.21.15.37:0/1707716612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c003f30 0x7fa7b00baae0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 >> 172.21.15.37:0/1707716612 conn(0x7fa7b008eac0 msgr2=0x7fa7b006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 shutdown_connections 2024-05-10T08:45:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.353+0000 7fa7b5d5f640 1 -- 172.21.15.37:0/1707716612 wait complete. 2024-05-10T08:45:37.365 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:45:37.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:37.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.475+0000 7f262c1af640 1 Processor -- start 2024-05-10T08:45:37.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.476+0000 7f262c1af640 1 -- start start 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.476+0000 7f262c1af640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f262415f420 0x7f26240d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.476+0000 7f262c1af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26241630b0 con 0x7f26240d3ca0 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.476+0000 7f262c1af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26240d2550 con 0x7f26240d2080 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.476+0000 7f262c1af640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f26240d2c80 con 0x7f262415f420 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.477+0000 7f2629f4b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f262415f420 0x7f26240d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.477+0000 7f262974a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26240d3ca0 0x7f26240d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59886/0 (socket says 172.21.15.37:59886) 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.477+0000 7f262974a640 1 -- 172.21.15.37:0/3859100266 learned_addr learned my addr 172.21.15.37:0/3859100266 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.477+0000 7f2629f4b640 1 -- 172.21.15.37:0/3859100266 >> v1:172.21.15.82:6789/0 conn(0x7f26240d2080 legacy=0x7f26240d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.477+0000 7f2629f4b640 1 -- 172.21.15.37:0/3859100266 >> v1:172.21.15.37:6789/0 conn(0x7f26240d3ca0 legacy=0x7f26240d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.477+0000 7f2629f4b640 1 -- 172.21.15.37:0/3859100266 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26240d2f60 con 0x7f262415f420 2024-05-10T08:45:37.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f2629f4b640 1 --2- 172.21.15.37:0/3859100266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262415f420 0x7f26240d3760 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f26200097a0 tx=0x7f262002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1aa4e578167ee3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:37.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f2628f49640 1 -- 172.21.15.37:0/3859100266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620037070 con 0x7f262415f420 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f2628f49640 1 -- 172.21.15.37:0/3859100266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2620032440 con 0x7f262415f420 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f2628f49640 1 -- 172.21.15.37:0/3859100266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620032810 con 0x7f262415f420 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f262c1af640 1 -- 172.21.15.37:0/3859100266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262415f420 msgr2=0x7f26240d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f262c1af640 1 --2- 172.21.15.37:0/3859100266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262415f420 0x7f26240d3760 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f26200097a0 tx=0x7f262002a230 comp rx=0 tx=0).stop 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f262c1af640 1 -- 172.21.15.37:0/3859100266 shutdown_connections 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f262c1af640 1 --2- 172.21.15.37:0/3859100266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262415f420 0x7f26240d3760 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f262c1af640 1 -- 172.21.15.37:0/3859100266 >> 172.21.15.37:0/3859100266 conn(0x7f262408eac0 msgr2=0x7f262409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f262c1af640 1 -- 172.21.15.37:0/3859100266 shutdown_connections 2024-05-10T08:45:37.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.478+0000 7f262c1af640 1 -- 172.21.15.37:0/3859100266 wait complete. 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 Processor -- start 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 -- start start 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26240d2080 0x7f26240b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240b97a0 0x7f26240b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2624151040 0x7f26241514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26240d53d0 con 0x7f2624151040 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f26240d2830 con 0x7f26240b97a0 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262c1af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f26240d5550 con 0x7f26240d2080 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.480+0000 7f262a74c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2624151040 0x7f26241514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2624151040 0x7f26241514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55730/0 (socket says 172.21.15.37:55730) 2024-05-10T08:45:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 -- 172.21.15.37:0/3451118902 learned_addr learned my addr 172.21.15.37:0/3451118902 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f2629f4b640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26240d2080 0x7f26240b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262974a640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240b97a0 0x7f26240b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 -- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26240d2080 msgr2=0x7f26240b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26240d2080 0x7f26240b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 -- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240b97a0 msgr2=0x7f26240b9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240b97a0 0x7f26240b9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 -- 172.21.15.37:0/3451118902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26241f8a50 con 0x7f2624151040 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262a74c640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2624151040 0x7f26241514c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c730 tx=0x7f261c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f26167fc640 1 -- 172.21.15.37:0/3451118902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c003b70 con 0x7f2624151040 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f26167fc640 1 -- 172.21.15.37:0/3451118902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c003d10 con 0x7f2624151040 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f26167fc640 1 -- 172.21.15.37:0/3451118902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c00aa90 con 0x7f2624151040 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26241f8cf0 con 0x7f2624151040 2024-05-10T08:45:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.481+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26241f92b0 con 0x7f2624151040 2024-05-10T08:45:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.482+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26240d5b40 con 0x7f2624151040 2024-05-10T08:45:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.483+0000 7f26167fc640 1 -- 172.21.15.37:0/3451118902 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f261c00ac30 con 0x7f2624151040 2024-05-10T08:45:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.483+0000 7f26167fc640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26080762d0 0x7f2608078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.484+0000 7f26167fc640 1 -- 172.21.15.37:0/3451118902 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f261c097650 con 0x7f2624151040 2024-05-10T08:45:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.484+0000 7f2629f4b640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26080762d0 0x7f2608078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.484+0000 7f2629f4b640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26080762d0 0x7f2608078790 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2620034000 tx=0x7f262002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:37.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.488+0000 7f26167fc640 1 -- 172.21.15.37:0/3451118902 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f261c060e20 con 0x7f2624151040 2024-05-10T08:45:37.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.717+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26240b4c50 con 0x7f2624151040 2024-05-10T08:45:37.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.718+0000 7f26167fc640 1 -- 172.21.15.37:0/3451118902 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5174 (secure 0 0 0) 0x7f261c060720 con 0x7f2624151040 2024-05-10T08:45:37.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:37.717 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:36.721805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/54798262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":54798262},{"type":"v1","addr":"172.21.15.37:6834","nonce":54798262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6687,"qdb_cluster":[6687]},"id":6}]} 2024-05-10T08:45:37.717 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 61 2024-05-10T08:45:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26080762d0 msgr2=0x7f2608078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26080762d0 0x7f2608078790 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2620034000 tx=0x7f262002e000 comp rx=0 tx=0).stop 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2624151040 msgr2=0x7f26241514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2624151040 0x7f26241514c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c730 tx=0x7f261c00cbf0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 shutdown_connections 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f26080762d0 0x7f2608078790 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2624151040 0x7f26241514c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240b97a0 0x7f26240b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 --2- 172.21.15.37:0/3451118902 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26240d2080 0x7f26240b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 >> 172.21.15.37:0/3451118902 conn(0x7f262408eac0 msgr2=0x7f26240d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 shutdown_connections 2024-05-10T08:45:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.720+0000 7f262c1af640 1 -- 172.21.15.37:0/3451118902 wait complete. 2024-05-10T08:45:37.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:45:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd645447640 1 Processor -- start 2024-05-10T08:45:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd645447640 1 -- start start 2024-05-10T08:45:37.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd645447640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6400d0ec0 0x7fd6400d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd645447640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6400d3b00 0x7fd6400b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd645447640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6400d1760 con 0x7fd64015f380 2024-05-10T08:45:37.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd645447640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd6400d30f0 con 0x7fd6400d3b00 2024-05-10T08:45:37.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd645447640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd6400d2370 con 0x7fd6400d0ec0 2024-05-10T08:45:37.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6400d3b00 0x7fd6400b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd64015f380 0x7fd6400d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41668/0 (socket says 172.21.15.37:41668) 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63effd640 1 -- 172.21.15.37:0/1516272410 learned_addr learned my addr 172.21.15.37:0/1516272410 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63e7fc640 1 --2- 172.21.15.37:0/1516272410 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6400d0ec0 0x7fd6400d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63f7fe640 1 -- 172.21.15.37:0/1516272410 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6400d0ec0 msgr2=0x7fd6400d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63f7fe640 1 --2- 172.21.15.37:0/1516272410 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6400d0ec0 0x7fd6400d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63dffb640 1 -- 172.21.15.37:0/1516272410 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1366071351 0 0) 0x7fd6400d1760 con 0x7fd64015f380 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63f7fe640 1 -- 172.21.15.37:0/1516272410 >> v1:172.21.15.37:6789/0 conn(0x7fd64015f380 legacy=0x7fd6400d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.836+0000 7fd63f7fe640 1 -- 172.21.15.37:0/1516272410 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6400d1a40 con 0x7fd6400d3b00 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.837+0000 7fd63f7fe640 1 --2- 172.21.15.37:0/1516272410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400b7e30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd638009d90 tx=0x7fd63802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3c7eb454566f0c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.837+0000 7fd63dffb640 1 -- 172.21.15.37:0/1516272410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638007740 con 0x7fd6400d3b00 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.837+0000 7fd63dffb640 1 -- 172.21.15.37:0/1516272410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6380078e0 con 0x7fd6400d3b00 2024-05-10T08:45:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.837+0000 7fd63dffb640 1 -- 172.21.15.37:0/1516272410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638007cb0 con 0x7fd6400d3b00 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 -- 172.21.15.37:0/1516272410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 msgr2=0x7fd6400b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 --2- 172.21.15.37:0/1516272410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400b7e30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd638009d90 tx=0x7fd63802a660 comp rx=0 tx=0).stop 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 -- 172.21.15.37:0/1516272410 shutdown_connections 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 --2- 172.21.15.37:0/1516272410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400b7e30 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 --2- 172.21.15.37:0/1516272410 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6400d0ec0 0x7fd6400d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 -- 172.21.15.37:0/1516272410 >> 172.21.15.37:0/1516272410 conn(0x7fd6400d4fe0 msgr2=0x7fd6400d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 -- 172.21.15.37:0/1516272410 shutdown_connections 2024-05-10T08:45:37.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.838+0000 7fd645447640 1 -- 172.21.15.37:0/1516272410 wait complete. 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.839+0000 7fd645447640 1 Processor -- start 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.839+0000 7fd645447640 1 -- start start 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd645447640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6400d0ec0 0x7fd6401513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd645447640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd645447640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd64015f380 0x7fd6400c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd645447640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd64015f760 con 0x7fd6400d3b00 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd645447640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400d2000 con 0x7fd6400d0ec0 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd645447640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd6400d2800 con 0x7fd64015f380 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400a26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49142/0 (socket says 172.21.15.37:49142) 2024-05-10T08:45:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 -- 172.21.15.37:0/2823973241 learned_addr learned my addr 172.21.15.37:0/2823973241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63f7fe640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd64015f380 0x7fd6400c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63effd640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6400d0ec0 0x7fd6401513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 -- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd64015f380 msgr2=0x7fd6400c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd64015f380 0x7fd6400c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 -- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6400d0ec0 msgr2=0x7fd6401513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6400d0ec0 0x7fd6401513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.840+0000 7fd63e7fc640 1 -- 172.21.15.37:0/2823973241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6400a1910 con 0x7fd6400d3b00 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.841+0000 7fd63e7fc640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400a26d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e980 tx=0x7fd63400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.841+0000 7fd6277fe640 1 -- 172.21.15.37:0/2823973241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634017070 con 0x7fd6400d3b00 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.841+0000 7fd6277fe640 1 -- 172.21.15.37:0/2823973241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd63400ca00 con 0x7fd6400d3b00 2024-05-10T08:45:37.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.841+0000 7fd6277fe640 1 -- 172.21.15.37:0/2823973241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63400cdd0 con 0x7fd6400d3b00 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.841+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6400a1bf0 con 0x7fd6400d3b00 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.841+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6401518f0 con 0x7fd6400d3b00 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.842+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6400693f0 con 0x7fd6400d3b00 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.843+0000 7fd6277fe640 1 -- 172.21.15.37:0/2823973241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd63401a070 con 0x7fd6400d3b00 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.843+0000 7fd6277fe640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd62c076300 0x7fd62c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.843+0000 7fd6277fe640 1 -- 172.21.15.37:0/2823973241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fd634097a90 con 0x7fd6400d3b00 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.843+0000 7fd63effd640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd62c076300 0x7fd62c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.844+0000 7fd63effd640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd62c076300 0x7fd62c0787c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd630000f60 tx=0x7fd630007c00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:37.848+0000 7fd6277fe640 1 -- 172.21.15.37:0/2823973241 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd6340612f0 con 0x7fd6400d3b00 2024-05-10T08:45:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.038+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd64015be80 con 0x7fd6400d3b00 2024-05-10T08:45:38.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.040+0000 7fd6277fe640 1 -- 172.21.15.37:0/2823973241 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16825 (secure 0 0 0) 0x7fd634060bf0 con 0x7fd6400d3b00 2024-05-10T08:45:38.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:38.038 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:45:35.325931+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:45:31.356272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T08:45:32.644920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:45:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd62c076300 msgr2=0x7fd62c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd62c076300 0x7fd62c0787c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd630000f60 tx=0x7fd630007c00 comp rx=0 tx=0).stop 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 msgr2=0x7fd6400a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400a26d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e980 tx=0x7fd63400ee40 comp rx=0 tx=0).stop 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 shutdown_connections 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd62c076300 0x7fd62c0787c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd64015f380 0x7fd6400c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400d3b00 0x7fd6400a26d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 --2- 172.21.15.37:0/2823973241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6400d0ec0 0x7fd6401513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 >> 172.21.15.37:0/2823973241 conn(0x7fd6400d4fe0 msgr2=0x7fd6400cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 shutdown_connections 2024-05-10T08:45:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.041+0000 7fd645447640 1 -- 172.21.15.37:0/2823973241 wait complete. 2024-05-10T08:45:38.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:45:38.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:45:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.156+0000 7f197a358640 1 Processor -- start 2024-05-10T08:45:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.157+0000 7f197a358640 1 -- start start 2024-05-10T08:45:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.157+0000 7f197a358640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197406ee00 0x7f1974073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.157+0000 7f197a358640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197415f810 con 0x7f197415f430 2024-05-10T08:45:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.157+0000 7f197a358640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1974072d80 con 0x7f19740b5f60 2024-05-10T08:45:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.157+0000 7f197a358640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1974073060 con 0x7f197406ee00 2024-05-10T08:45:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f1973fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f197415f430 0x7f1974072480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41684/0 (socket says 172.21.15.37:41684) 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f1973fff640 1 -- 172.21.15.37:0/3581264484 learned_addr learned my addr 172.21.15.37:0/3581264484 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19788f5640 1 --2- 172.21.15.37:0/3581264484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197406ee00 0x7f1974073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19737fe640 1 -- 172.21.15.37:0/3581264484 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776148174 0 0) 0x7f197415f810 con 0x7f197415f430 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19737fe640 1 -- 172.21.15.37:0/3581264484 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1960003520 con 0x7f197415f430 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19737fe640 1 -- 172.21.15.37:0/3581264484 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197827262 0 0) 0x7f1974072d80 con 0x7f19740b5f60 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19737fe640 1 -- 172.21.15.37:0/3581264484 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f197415f810 con 0x7f19740b5f60 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19788f5640 1 -- 172.21.15.37:0/3581264484 >> v1:172.21.15.82:6789/0 conn(0x7f19740b5f60 legacy=0x7f197406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19788f5640 1 -- 172.21.15.37:0/3581264484 >> v1:172.21.15.37:6789/0 conn(0x7f197415f430 legacy=0x7f1974072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.158+0000 7f19788f5640 1 -- 172.21.15.37:0/3581264484 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1974073340 con 0x7f197406ee00 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.159+0000 7f19788f5640 1 --2- 172.21.15.37:0/3581264484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197406ee00 0x7f1974073e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f196c009dc0 tx=0x7f196c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=476c880caeff08f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.159+0000 7f19737fe640 1 -- 172.21.15.37:0/3581264484 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c02ae60 con 0x7f197406ee00 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.159+0000 7f19737fe640 1 -- 172.21.15.37:0/3581264484 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c007740 con 0x7f197406ee00 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.159+0000 7f19737fe640 1 -- 172.21.15.37:0/3581264484 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c007af0 con 0x7f197406ee00 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.160+0000 7f197a358640 1 -- 172.21.15.37:0/3581264484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197406ee00 msgr2=0x7f1974073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.160+0000 7f197a358640 1 --2- 172.21.15.37:0/3581264484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197406ee00 0x7f1974073e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f196c009dc0 tx=0x7f196c02a640 comp rx=0 tx=0).stop 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.160+0000 7f197a358640 1 -- 172.21.15.37:0/3581264484 shutdown_connections 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.160+0000 7f197a358640 1 --2- 172.21.15.37:0/3581264484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197406ee00 0x7f1974073e20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.160+0000 7f197a358640 1 -- 172.21.15.37:0/3581264484 >> 172.21.15.37:0/3581264484 conn(0x7f19740b2cc0 msgr2=0x7f19740b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.160+0000 7f197a358640 1 -- 172.21.15.37:0/3581264484 shutdown_connections 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.160+0000 7f197a358640 1 -- 172.21.15.37:0/3581264484 wait complete. 2024-05-10T08:45:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.161+0000 7f197a358640 1 Processor -- start 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.161+0000 7f197a358640 1 -- start start 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f197a358640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f197406ee00 0x7f19741f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f197a358640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19740b5f60 0x7f197415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f197a358640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197415f430 0x7f1974160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f197a358640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19740cf150 con 0x7f19740b5f60 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f197a358640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19740cefd0 con 0x7f197406ee00 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f197a358640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f19740cf2d0 con 0x7f197415f430 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19740b5f60 0x7f197415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19740b5f60 0x7f197415bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49156/0 (socket says 172.21.15.37:49156) 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 -- 172.21.15.37:0/2595801501 learned_addr learned my addr 172.21.15.37:0/2595801501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f1973fff640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f197406ee00 0x7f19741f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f19788f5640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197415f430 0x7f1974160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 -- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197415f430 msgr2=0x7f1974160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197415f430 0x7f1974160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 -- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f197406ee00 msgr2=0x7f19741f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f197406ee00 0x7f19741f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 -- 172.21.15.37:0/2595801501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197415c610 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f1973fff640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f197406ee00 0x7f19741f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f196bfff640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19740b5f60 0x7f197415bf10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c430 tx=0x7f195c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.162+0000 7f19717fa640 1 -- 172.21.15.37:0/2595801501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c017070 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.163+0000 7f19717fa640 1 -- 172.21.15.37:0/2595801501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c0052d0 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.163+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197415fc50 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.163+0000 7f19717fa640 1 -- 172.21.15.37:0/2595801501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c003810 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.163+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1974160c70 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.164+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1974160f30 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.164+0000 7f19717fa640 1 -- 172.21.15.37:0/2595801501 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f195c01a070 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.165+0000 7f19717fa640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f19540762d0 0x7f1954078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.165+0000 7f19717fa640 1 -- 172.21.15.37:0/2595801501 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f195c096c50 con 0x7f19740b5f60 2024-05-10T08:45:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.165+0000 7f1973fff640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f19540762d0 0x7f1954078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.166+0000 7f1973fff640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f19540762d0 0x7f1954078790 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1964007fd0 tx=0x7f1964009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.169+0000 7f19717fa640 1 -- 172.21.15.37:0/2595801501 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1974160f30 con 0x7f19740b5f60 2024-05-10T08:45:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.356+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19740693f0 con 0x7f19540762d0 2024-05-10T08:45:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.364+0000 7f19717fa640 1 -- 172.21.15.37:0/2595801501 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7f19740693f0 con 0x7f19540762d0 2024-05-10T08:45:38.365 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:45:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f19540762d0 msgr2=0x7f1954078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f19540762d0 0x7f1954078790 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1964007fd0 tx=0x7f1964009040 comp rx=0 tx=0).stop 2024-05-10T08:45:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19740b5f60 msgr2=0x7f197415bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19740b5f60 0x7f197415bf10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c430 tx=0x7f195c00c8f0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 shutdown_connections 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f19540762d0 0x7f1954078790 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f197415f430 0x7f1974160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19740b5f60 0x7f197415bf10 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 --2- 172.21.15.37:0/2595801501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f197406ee00 0x7f19741f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 >> 172.21.15.37:0/2595801501 conn(0x7f19740b2cc0 msgr2=0x7f19740cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 shutdown_connections 2024-05-10T08:45:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.366+0000 7f197a358640 1 -- 172.21.15.37:0/2595801501 wait complete. 2024-05-10T08:45:38.377 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-05-10T08:45:37.402289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259008,"kb_used_data":9512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715712,"statfs":{"total":773094113280,"available":772828889088,"internally_reserved":0,"allocated":9740288,"data_stored":5060380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.100199"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.354538+0000","last_change":"2024-05-10T08:45:34.353223+0000","last_active":"2024-05-10T08:45:34.354538+0000","last_peered":"2024-05-10T08:45:34.354538+0000","last_clean":"2024-05-10T08:45:34.354538+0000","last_became_active":"2024-05-10T08:45:34.352945+0000","last_became_peered":"2024-05-10T08:45:34.352945+0000","last_unstale":"2024-05-10T08:45:34.354538+0000","last_undegraded":"2024-05-10T08:45:34.354538+0000","last_fullsized":"2024-05-10T08:45:34.354538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:53:11.132194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360853+0000","last_change":"2024-05-10T08:45:34.347847+0000","last_active":"2024-05-10T08:45:35.360853+0000","last_peered":"2024-05-10T08:45:35.360853+0000","last_clean":"2024-05-10T08:45:35.360853+0000","last_became_active":"2024-05-10T08:45:34.347581+0000","last_became_peered":"2024-05-10T08:45:34.347581+0000","last_unstale":"2024-05-10T08:45:35.360853+0000","last_undegraded":"2024-05-10T08:45:35.360853+0000","last_fullsized":"2024-05-10T08:45:35.360853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:27.870775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356426+0000","last_change":"2024-05-10T08:45:34.355199+0000","last_active":"2024-05-10T08:45:34.356426+0000","last_peered":"2024-05-10T08:45:34.356426+0000","last_clean":"2024-05-10T08:45:34.356426+0000","last_became_active":"2024-05-10T08:45:34.354842+0000","last_became_peered":"2024-05-10T08:45:34.354842+0000","last_unstale":"2024-05-10T08:45:34.356426+0000","last_undegraded":"2024-05-10T08:45:34.356426+0000","last_fullsized":"2024-05-10T08:45:34.356426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:03:15.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331248+0000","last_change":"2024-05-10T08:45:34.348904+0000","last_active":"2024-05-10T08:45:35.331248+0000","last_peered":"2024-05-10T08:45:35.331248+0000","last_clean":"2024-05-10T08:45:35.331248+0000","last_became_active":"2024-05-10T08:45:34.348647+0000","last_became_peered":"2024-05-10T08:45:34.348647+0000","last_unstale":"2024-05-10T08:45:35.331248+0000","last_undegraded":"2024-05-10T08:45:35.331248+0000","last_fullsized":"2024-05-10T08:45:35.331248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:04.306971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330276+0000","last_change":"2024-05-10T08:45:34.342334+0000","last_active":"2024-05-10T08:45:35.330276+0000","last_peered":"2024-05-10T08:45:35.330276+0000","last_clean":"2024-05-10T08:45:35.330276+0000","last_became_active":"2024-05-10T08:45:34.341562+0000","last_became_peered":"2024-05-10T08:45:34.341562+0000","last_unstale":"2024-05-10T08:45:35.330276+0000","last_undegraded":"2024-05-10T08:45:35.330276+0000","last_fullsized":"2024-05-10T08:45:35.330276+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:29.831005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.361837+0000","last_change":"2024-05-10T08:45:34.360281+0000","last_active":"2024-05-10T08:45:34.361837+0000","last_peered":"2024-05-10T08:45:34.361837+0000","last_clean":"2024-05-10T08:45:34.361837+0000","last_became_active":"2024-05-10T08:45:34.359788+0000","last_became_peered":"2024-05-10T08:45:34.359788+0000","last_unstale":"2024-05-10T08:45:34.361837+0000","last_undegraded":"2024-05-10T08:45:34.361837+0000","last_fullsized":"2024-05-10T08:45:34.361837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:33:35.297900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330388+0000","last_change":"2024-05-10T08:45:34.345356+0000","last_active":"2024-05-10T08:45:35.330388+0000","last_peered":"2024-05-10T08:45:35.330388+0000","last_clean":"2024-05-10T08:45:35.330388+0000","last_became_active":"2024-05-10T08:45:34.345104+0000","last_became_peered":"2024-05-10T08:45:34.345104+0000","last_unstale":"2024-05-10T08:45:35.330388+0000","last_undegraded":"2024-05-10T08:45:35.330388+0000","last_fullsized":"2024-05-10T08:45:35.330388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:59.413165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330964+0000","last_change":"2024-05-10T08:45:34.351377+0000","last_active":"2024-05-10T08:45:35.330964+0000","last_peered":"2024-05-10T08:45:35.330964+0000","last_clean":"2024-05-10T08:45:35.330964+0000","last_became_active":"2024-05-10T08:45:34.351116+0000","last_became_peered":"2024-05-10T08:45:34.351116+0000","last_unstale":"2024-05-10T08:45:35.330964+0000","last_undegraded":"2024-05-10T08:45:35.330964+0000","last_fullsized":"2024-05-10T08:45:35.330964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:23.210960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331448+0000","last_change":"2024-05-10T08:45:34.342136+0000","last_active":"2024-05-10T08:45:35.331448+0000","last_peered":"2024-05-10T08:45:35.331448+0000","last_clean":"2024-05-10T08:45:35.331448+0000","last_became_active":"2024-05-10T08:45:34.341598+0000","last_became_peered":"2024-05-10T08:45:34.341598+0000","last_unstale":"2024-05-10T08:45:35.331448+0000","last_undegraded":"2024-05-10T08:45:35.331448+0000","last_fullsized":"2024-05-10T08:45:35.331448+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:36.090231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.351597+0000","last_change":"2024-05-10T08:45:34.345253+0000","last_active":"2024-05-10T08:45:34.351597+0000","last_peered":"2024-05-10T08:45:34.351597+0000","last_clean":"2024-05-10T08:45:34.351597+0000","last_became_active":"2024-05-10T08:45:34.344944+0000","last_became_peered":"2024-05-10T08:45:34.344944+0000","last_unstale":"2024-05-10T08:45:34.351597+0000","last_undegraded":"2024-05-10T08:45:34.351597+0000","last_fullsized":"2024-05-10T08:45:34.351597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:57.337776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331440+0000","last_change":"2024-05-10T08:45:34.350603+0000","last_active":"2024-05-10T08:45:35.331440+0000","last_peered":"2024-05-10T08:45:35.331440+0000","last_clean":"2024-05-10T08:45:35.331440+0000","last_became_active":"2024-05-10T08:45:34.350355+0000","last_became_peered":"2024-05-10T08:45:34.350355+0000","last_unstale":"2024-05-10T08:45:35.331440+0000","last_undegraded":"2024-05-10T08:45:35.331440+0000","last_fullsized":"2024-05-10T08:45:35.331440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:47.617239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.351554+0000","last_change":"2024-05-10T08:45:34.345687+0000","last_active":"2024-05-10T08:45:34.351554+0000","last_peered":"2024-05-10T08:45:34.351554+0000","last_clean":"2024-05-10T08:45:34.351554+0000","last_became_active":"2024-05-10T08:45:34.345356+0000","last_became_peered":"2024-05-10T08:45:34.345356+0000","last_unstale":"2024-05-10T08:45:34.351554+0000","last_undegraded":"2024-05-10T08:45:34.351554+0000","last_fullsized":"2024-05-10T08:45:34.351554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:45:56.225957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331094+0000","last_change":"2024-05-10T08:45:34.353536+0000","last_active":"2024-05-10T08:45:35.331094+0000","last_peered":"2024-05-10T08:45:35.331094+0000","last_clean":"2024-05-10T08:45:35.331094+0000","last_became_active":"2024-05-10T08:45:34.351684+0000","last_became_peered":"2024-05-10T08:45:34.351684+0000","last_unstale":"2024-05-10T08:45:35.331094+0000","last_undegraded":"2024-05-10T08:45:35.331094+0000","last_fullsized":"2024-05-10T08:45:35.331094+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:08.343298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329956+0000","last_change":"2024-05-10T08:45:34.347294+0000","last_active":"2024-05-10T08:45:35.329956+0000","last_peered":"2024-05-10T08:45:35.329956+0000","last_clean":"2024-05-10T08:45:35.329956+0000","last_became_active":"2024-05-10T08:45:34.346966+0000","last_became_peered":"2024-05-10T08:45:34.346966+0000","last_unstale":"2024-05-10T08:45:35.329956+0000","last_undegraded":"2024-05-10T08:45:35.329956+0000","last_fullsized":"2024-05-10T08:45:35.329956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:18.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331029+0000","last_change":"2024-05-10T08:45:34.346411+0000","last_active":"2024-05-10T08:45:35.331029+0000","last_peered":"2024-05-10T08:45:35.331029+0000","last_clean":"2024-05-10T08:45:35.331029+0000","last_became_active":"2024-05-10T08:45:34.346037+0000","last_became_peered":"2024-05-10T08:45:34.346037+0000","last_unstale":"2024-05-10T08:45:35.331029+0000","last_undegraded":"2024-05-10T08:45:35.331029+0000","last_fullsized":"2024-05-10T08:45:35.331029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:47.617239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.363282+0000","last_change":"2024-05-10T08:45:34.362561+0000","last_active":"2024-05-10T08:45:34.363282+0000","last_peered":"2024-05-10T08:45:34.363282+0000","last_clean":"2024-05-10T08:45:34.363282+0000","last_became_active":"2024-05-10T08:45:34.362298+0000","last_became_peered":"2024-05-10T08:45:34.362298+0000","last_unstale":"2024-05-10T08:45:34.363282+0000","last_undegraded":"2024-05-10T08:45:34.363282+0000","last_fullsized":"2024-05-10T08:45:34.363282+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:52.719112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359332+0000","last_change":"2024-05-10T08:45:34.356950+0000","last_active":"2024-05-10T08:45:34.359332+0000","last_peered":"2024-05-10T08:45:34.359332+0000","last_clean":"2024-05-10T08:45:34.359332+0000","last_became_active":"2024-05-10T08:45:34.356401+0000","last_became_peered":"2024-05-10T08:45:34.356401+0000","last_unstale":"2024-05-10T08:45:34.359332+0000","last_undegraded":"2024-05-10T08:45:34.359332+0000","last_fullsized":"2024-05-10T08:45:34.359332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:47.617708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.347374+0000","last_change":"2024-05-10T08:45:34.345481+0000","last_active":"2024-05-10T08:45:34.347374+0000","last_peered":"2024-05-10T08:45:34.347374+0000","last_clean":"2024-05-10T08:45:34.347374+0000","last_became_active":"2024-05-10T08:45:34.345129+0000","last_became_peered":"2024-05-10T08:45:34.345129+0000","last_unstale":"2024-05-10T08:45:34.347374+0000","last_undegraded":"2024-05-10T08:45:34.347374+0000","last_fullsized":"2024-05-10T08:45:34.347374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:50.289888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331448+0000","last_change":"2024-05-10T08:45:34.345590+0000","last_active":"2024-05-10T08:45:35.331448+0000","last_peered":"2024-05-10T08:45:35.331448+0000","last_clean":"2024-05-10T08:45:35.331448+0000","last_became_active":"2024-05-10T08:45:34.345110+0000","last_became_peered":"2024-05-10T08:45:34.345110+0000","last_unstale":"2024-05-10T08:45:35.331448+0000","last_undegraded":"2024-05-10T08:45:35.331448+0000","last_fullsized":"2024-05-10T08:45:35.331448+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:08.343298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331351+0000","last_change":"2024-05-10T08:45:34.353445+0000","last_active":"2024-05-10T08:45:35.331351+0000","last_peered":"2024-05-10T08:45:35.331351+0000","last_clean":"2024-05-10T08:45:35.331351+0000","last_became_active":"2024-05-10T08:45:34.352969+0000","last_became_peered":"2024-05-10T08:45:34.352969+0000","last_unstale":"2024-05-10T08:45:35.331351+0000","last_undegraded":"2024-05-10T08:45:35.331351+0000","last_fullsized":"2024-05-10T08:45:35.331351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:27.870775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330414+0000","last_change":"2024-05-10T08:45:34.334118+0000","last_active":"2024-05-10T08:45:35.330414+0000","last_peered":"2024-05-10T08:45:35.330414+0000","last_clean":"2024-05-10T08:45:35.330414+0000","last_became_active":"2024-05-10T08:45:34.333815+0000","last_became_peered":"2024-05-10T08:45:34.333815+0000","last_unstale":"2024-05-10T08:45:35.330414+0000","last_undegraded":"2024-05-10T08:45:35.330414+0000","last_fullsized":"2024-05-10T08:45:35.330414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:21.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329946+0000","last_change":"2024-05-10T08:45:34.347340+0000","last_active":"2024-05-10T08:45:35.329946+0000","last_peered":"2024-05-10T08:45:35.329946+0000","last_clean":"2024-05-10T08:45:35.329946+0000","last_became_active":"2024-05-10T08:45:34.347044+0000","last_became_peered":"2024-05-10T08:45:34.347044+0000","last_unstale":"2024-05-10T08:45:35.329946+0000","last_undegraded":"2024-05-10T08:45:35.329946+0000","last_fullsized":"2024-05-10T08:45:35.329946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.298479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356621+0000","last_change":"2024-05-10T08:45:34.349024+0000","last_active":"2024-05-10T08:45:34.356621+0000","last_peered":"2024-05-10T08:45:34.356621+0000","last_clean":"2024-05-10T08:45:34.356621+0000","last_became_active":"2024-05-10T08:45:34.348762+0000","last_became_peered":"2024-05-10T08:45:34.348762+0000","last_unstale":"2024-05-10T08:45:34.356621+0000","last_undegraded":"2024-05-10T08:45:34.356621+0000","last_fullsized":"2024-05-10T08:45:34.356621+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:41:38.935586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.365816+0000","last_change":"2024-05-10T08:45:34.357609+0000","last_active":"2024-05-10T08:45:34.365816+0000","last_peered":"2024-05-10T08:45:34.365816+0000","last_clean":"2024-05-10T08:45:34.365816+0000","last_became_active":"2024-05-10T08:45:34.355851+0000","last_became_peered":"2024-05-10T08:45:34.355851+0000","last_unstale":"2024-05-10T08:45:34.365816+0000","last_undegraded":"2024-05-10T08:45:34.365816+0000","last_fullsized":"2024-05-10T08:45:34.365816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:38:19.772634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360846+0000","last_change":"2024-05-10T08:45:34.343708+0000","last_active":"2024-05-10T08:45:35.360846+0000","last_peered":"2024-05-10T08:45:35.360846+0000","last_clean":"2024-05-10T08:45:35.360846+0000","last_became_active":"2024-05-10T08:45:34.343368+0000","last_became_peered":"2024-05-10T08:45:34.343368+0000","last_unstale":"2024-05-10T08:45:35.360846+0000","last_undegraded":"2024-05-10T08:45:35.360846+0000","last_fullsized":"2024-05-10T08:45:35.360846+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:04.306971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331341+0000","last_change":"2024-05-10T08:45:34.345449+0000","last_active":"2024-05-10T08:45:35.331341+0000","last_peered":"2024-05-10T08:45:35.331341+0000","last_clean":"2024-05-10T08:45:35.331341+0000","last_became_active":"2024-05-10T08:45:34.345130+0000","last_became_peered":"2024-05-10T08:45:34.345130+0000","last_unstale":"2024-05-10T08:45:35.331341+0000","last_undegraded":"2024-05-10T08:45:35.331341+0000","last_fullsized":"2024-05-10T08:45:35.331341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:23.210960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.351505+0000","last_change":"2024-05-10T08:45:34.344857+0000","last_active":"2024-05-10T08:45:34.351505+0000","last_peered":"2024-05-10T08:45:34.351505+0000","last_clean":"2024-05-10T08:45:34.351505+0000","last_became_active":"2024-05-10T08:45:34.344518+0000","last_became_peered":"2024-05-10T08:45:34.344518+0000","last_unstale":"2024-05-10T08:45:34.351505+0000","last_undegraded":"2024-05-10T08:45:34.351505+0000","last_fullsized":"2024-05-10T08:45:34.351505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:29.635769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331353+0000","last_change":"2024-05-10T08:45:34.355518+0000","last_active":"2024-05-10T08:45:35.331353+0000","last_peered":"2024-05-10T08:45:35.331353+0000","last_clean":"2024-05-10T08:45:35.331353+0000","last_became_active":"2024-05-10T08:45:34.355246+0000","last_became_peered":"2024-05-10T08:45:34.355246+0000","last_unstale":"2024-05-10T08:45:35.331353+0000","last_undegraded":"2024-05-10T08:45:35.331353+0000","last_fullsized":"2024-05-10T08:45:35.331353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:33.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330615+0000","last_change":"2024-05-10T08:45:34.334860+0000","last_active":"2024-05-10T08:45:35.330615+0000","last_peered":"2024-05-10T08:45:35.330615+0000","last_clean":"2024-05-10T08:45:35.330615+0000","last_became_active":"2024-05-10T08:45:34.334548+0000","last_became_peered":"2024-05-10T08:45:34.334548+0000","last_unstale":"2024-05-10T08:45:35.330615+0000","last_undegraded":"2024-05-10T08:45:35.330615+0000","last_fullsized":"2024-05-10T08:45:35.330615+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:50.857830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330124+0000","last_change":"2024-05-10T08:45:34.341535+0000","last_active":"2024-05-10T08:45:35.330124+0000","last_peered":"2024-05-10T08:45:35.330124+0000","last_clean":"2024-05-10T08:45:35.330124+0000","last_became_active":"2024-05-10T08:45:34.340710+0000","last_became_peered":"2024-05-10T08:45:34.340710+0000","last_unstale":"2024-05-10T08:45:35.330124+0000","last_undegraded":"2024-05-10T08:45:35.330124+0000","last_fullsized":"2024-05-10T08:45:35.330124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:41:38.935586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360566+0000","last_change":"2024-05-10T08:45:34.346082+0000","last_active":"2024-05-10T08:45:35.360566+0000","last_peered":"2024-05-10T08:45:35.360566+0000","last_clean":"2024-05-10T08:45:35.360566+0000","last_became_active":"2024-05-10T08:45:34.345812+0000","last_became_peered":"2024-05-10T08:45:34.345812+0000","last_unstale":"2024-05-10T08:45:35.360566+0000","last_undegraded":"2024-05-10T08:45:35.360566+0000","last_fullsized":"2024-05-10T08:45:35.360566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.402626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360858+0000","last_change":"2024-05-10T08:45:34.358742+0000","last_active":"2024-05-10T08:45:34.360858+0000","last_peered":"2024-05-10T08:45:34.360858+0000","last_clean":"2024-05-10T08:45:34.360858+0000","last_became_active":"2024-05-10T08:45:34.358371+0000","last_became_peered":"2024-05-10T08:45:34.358371+0000","last_unstale":"2024-05-10T08:45:34.360858+0000","last_undegraded":"2024-05-10T08:45:34.360858+0000","last_fullsized":"2024-05-10T08:45:34.360858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:04.606532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360936+0000","last_change":"2024-05-10T08:45:34.358705+0000","last_active":"2024-05-10T08:45:34.360936+0000","last_peered":"2024-05-10T08:45:34.360936+0000","last_clean":"2024-05-10T08:45:34.360936+0000","last_became_active":"2024-05-10T08:45:34.358406+0000","last_became_peered":"2024-05-10T08:45:34.358406+0000","last_unstale":"2024-05-10T08:45:34.360936+0000","last_undegraded":"2024-05-10T08:45:34.360936+0000","last_fullsized":"2024-05-10T08:45:34.360936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:20:38.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.369727+0000","last_change":"2024-05-10T08:45:33.318754+0000","last_active":"2024-05-10T08:45:34.369727+0000","last_peered":"2024-05-10T08:45:34.369727+0000","last_clean":"2024-05-10T08:45:34.369727+0000","last_became_active":"2024-05-10T08:45:33.318478+0000","last_became_peered":"2024-05-10T08:45:33.318478+0000","last_unstale":"2024-05-10T08:45:34.369727+0000","last_undegraded":"2024-05-10T08:45:34.369727+0000","last_fullsized":"2024-05-10T08:45:34.369727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:05:04.446697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360920+0000","last_change":"2024-05-10T08:45:34.357356+0000","last_active":"2024-05-10T08:45:34.360920+0000","last_peered":"2024-05-10T08:45:34.360920+0000","last_clean":"2024-05-10T08:45:34.360920+0000","last_became_active":"2024-05-10T08:45:34.356857+0000","last_became_peered":"2024-05-10T08:45:34.356857+0000","last_unstale":"2024-05-10T08:45:34.360920+0000","last_undegraded":"2024-05-10T08:45:34.360920+0000","last_fullsized":"2024-05-10T08:45:34.360920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:28.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331485+0000","last_change":"2024-05-10T08:45:33.314573+0000","last_active":"2024-05-10T08:45:35.331485+0000","last_peered":"2024-05-10T08:45:35.331485+0000","last_clean":"2024-05-10T08:45:35.331485+0000","last_became_active":"2024-05-10T08:45:33.314292+0000","last_became_peered":"2024-05-10T08:45:33.314292+0000","last_unstale":"2024-05-10T08:45:35.331485+0000","last_undegraded":"2024-05-10T08:45:35.331485+0000","last_fullsized":"2024-05-10T08:45:35.331485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:36:11.458530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330330+0000","last_change":"2024-05-10T08:45:34.349377+0000","last_active":"2024-05-10T08:45:35.330330+0000","last_peered":"2024-05-10T08:45:35.330330+0000","last_clean":"2024-05-10T08:45:35.330330+0000","last_became_active":"2024-05-10T08:45:34.349088+0000","last_became_peered":"2024-05-10T08:45:34.349088+0000","last_unstale":"2024-05-10T08:45:35.330330+0000","last_undegraded":"2024-05-10T08:45:35.330330+0000","last_fullsized":"2024-05-10T08:45:35.330330+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:09:58.323076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330439+0000","last_change":"2024-05-10T08:45:33.318290+0000","last_active":"2024-05-10T08:45:35.330439+0000","last_peered":"2024-05-10T08:45:35.330439+0000","last_clean":"2024-05-10T08:45:35.330439+0000","last_became_active":"2024-05-10T08:45:33.317825+0000","last_became_peered":"2024-05-10T08:45:33.317825+0000","last_unstale":"2024-05-10T08:45:35.330439+0000","last_undegraded":"2024-05-10T08:45:35.330439+0000","last_fullsized":"2024-05-10T08:45:35.330439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:55.680335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356123+0000","last_change":"2024-05-10T08:45:34.355255+0000","last_active":"2024-05-10T08:45:34.356123+0000","last_peered":"2024-05-10T08:45:34.356123+0000","last_clean":"2024-05-10T08:45:34.356123+0000","last_became_active":"2024-05-10T08:45:34.354966+0000","last_became_peered":"2024-05-10T08:45:34.354966+0000","last_unstale":"2024-05-10T08:45:34.356123+0000","last_undegraded":"2024-05-10T08:45:34.356123+0000","last_fullsized":"2024-05-10T08:45:34.356123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:50.857830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.368600+0000","last_change":"2024-05-10T08:45:33.326272+0000","last_active":"2024-05-10T08:45:34.368600+0000","last_peered":"2024-05-10T08:45:34.368600+0000","last_clean":"2024-05-10T08:45:34.368600+0000","last_became_active":"2024-05-10T08:45:33.326019+0000","last_became_peered":"2024-05-10T08:45:33.326019+0000","last_unstale":"2024-05-10T08:45:34.368600+0000","last_undegraded":"2024-05-10T08:45:34.368600+0000","last_fullsized":"2024-05-10T08:45:34.368600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:29.548953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330858+0000","last_change":"2024-05-10T08:45:34.345814+0000","last_active":"2024-05-10T08:45:35.330858+0000","last_peered":"2024-05-10T08:45:35.330858+0000","last_clean":"2024-05-10T08:45:35.330858+0000","last_became_active":"2024-05-10T08:45:34.345539+0000","last_became_peered":"2024-05-10T08:45:34.345539+0000","last_unstale":"2024-05-10T08:45:35.330858+0000","last_undegraded":"2024-05-10T08:45:35.330858+0000","last_fullsized":"2024-05-10T08:45:35.330858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:21.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330515+0000","last_change":"2024-05-10T08:45:33.313586+0000","last_active":"2024-05-10T08:45:35.330515+0000","last_peered":"2024-05-10T08:45:35.330515+0000","last_clean":"2024-05-10T08:45:35.330515+0000","last_became_active":"2024-05-10T08:45:33.313262+0000","last_became_peered":"2024-05-10T08:45:33.313262+0000","last_unstale":"2024-05-10T08:45:35.330515+0000","last_undegraded":"2024-05-10T08:45:35.330515+0000","last_fullsized":"2024-05-10T08:45:35.330515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:57.565855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356703+0000","last_change":"2024-05-10T08:45:34.353158+0000","last_active":"2024-05-10T08:45:34.356703+0000","last_peered":"2024-05-10T08:45:34.356703+0000","last_clean":"2024-05-10T08:45:34.356703+0000","last_became_active":"2024-05-10T08:45:34.352891+0000","last_became_peered":"2024-05-10T08:45:34.352891+0000","last_unstale":"2024-05-10T08:45:34.356703+0000","last_undegraded":"2024-05-10T08:45:34.356703+0000","last_fullsized":"2024-05-10T08:45:34.356703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:21.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331508+0000","last_change":"2024-05-10T08:45:33.313010+0000","last_active":"2024-05-10T08:45:35.331508+0000","last_peered":"2024-05-10T08:45:35.331508+0000","last_clean":"2024-05-10T08:45:35.331508+0000","last_became_active":"2024-05-10T08:45:33.312733+0000","last_became_peered":"2024-05-10T08:45:33.312733+0000","last_unstale":"2024-05-10T08:45:35.331508+0000","last_undegraded":"2024-05-10T08:45:35.331508+0000","last_fullsized":"2024-05-10T08:45:35.331508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:46.753596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.361815+0000","last_change":"2024-05-10T08:45:34.360056+0000","last_active":"2024-05-10T08:45:34.361815+0000","last_peered":"2024-05-10T08:45:34.361815+0000","last_clean":"2024-05-10T08:45:34.361815+0000","last_became_active":"2024-05-10T08:45:34.359418+0000","last_became_peered":"2024-05-10T08:45:34.359418+0000","last_unstale":"2024-05-10T08:45:34.361815+0000","last_undegraded":"2024-05-10T08:45:34.361815+0000","last_fullsized":"2024-05-10T08:45:34.361815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:34.467761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338476+0000","last_change":"2024-05-10T08:45:33.311985+0000","last_active":"2024-05-10T08:45:34.338476+0000","last_peered":"2024-05-10T08:45:34.338476+0000","last_clean":"2024-05-10T08:45:34.338476+0000","last_became_active":"2024-05-10T08:45:33.311666+0000","last_became_peered":"2024-05-10T08:45:33.311666+0000","last_unstale":"2024-05-10T08:45:34.338476+0000","last_undegraded":"2024-05-10T08:45:34.338476+0000","last_fullsized":"2024-05-10T08:45:34.338476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:07.489966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331056+0000","last_change":"2024-05-10T08:45:34.348297+0000","last_active":"2024-05-10T08:45:35.331056+0000","last_peered":"2024-05-10T08:45:35.331056+0000","last_clean":"2024-05-10T08:45:35.331056+0000","last_became_active":"2024-05-10T08:45:34.348031+0000","last_became_peered":"2024-05-10T08:45:34.348031+0000","last_unstale":"2024-05-10T08:45:35.331056+0000","last_undegraded":"2024-05-10T08:45:35.331056+0000","last_fullsized":"2024-05-10T08:45:35.331056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:36.090231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329934+0000","last_change":"2024-05-10T08:45:33.319388+0000","last_active":"2024-05-10T08:45:35.329934+0000","last_peered":"2024-05-10T08:45:35.329934+0000","last_clean":"2024-05-10T08:45:35.329934+0000","last_became_active":"2024-05-10T08:45:33.318986+0000","last_became_peered":"2024-05-10T08:45:33.318986+0000","last_unstale":"2024-05-10T08:45:35.329934+0000","last_undegraded":"2024-05-10T08:45:35.329934+0000","last_fullsized":"2024-05-10T08:45:35.329934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:32.610453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331357+0000","last_change":"2024-05-10T08:45:34.346691+0000","last_active":"2024-05-10T08:45:35.331357+0000","last_peered":"2024-05-10T08:45:35.331357+0000","last_clean":"2024-05-10T08:45:35.331357+0000","last_became_active":"2024-05-10T08:45:34.346404+0000","last_became_peered":"2024-05-10T08:45:34.346404+0000","last_unstale":"2024-05-10T08:45:35.331357+0000","last_undegraded":"2024-05-10T08:45:35.331357+0000","last_fullsized":"2024-05-10T08:45:35.331357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.402626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360926+0000","last_change":"2024-05-10T08:45:33.315278+0000","last_active":"2024-05-10T08:45:35.360926+0000","last_peered":"2024-05-10T08:45:35.360926+0000","last_clean":"2024-05-10T08:45:35.360926+0000","last_became_active":"2024-05-10T08:45:33.315018+0000","last_became_peered":"2024-05-10T08:45:33.315018+0000","last_unstale":"2024-05-10T08:45:35.360926+0000","last_undegraded":"2024-05-10T08:45:35.360926+0000","last_fullsized":"2024-05-10T08:45:35.360926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:47:49.990411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330390+0000","last_change":"2024-05-10T08:45:34.334394+0000","last_active":"2024-05-10T08:45:35.330390+0000","last_peered":"2024-05-10T08:45:35.330390+0000","last_clean":"2024-05-10T08:45:35.330390+0000","last_became_active":"2024-05-10T08:45:34.334047+0000","last_became_peered":"2024-05-10T08:45:34.334047+0000","last_unstale":"2024-05-10T08:45:35.330390+0000","last_undegraded":"2024-05-10T08:45:35.330390+0000","last_fullsized":"2024-05-10T08:45:35.330390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:08.496895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338611+0000","last_change":"2024-05-10T08:45:33.318410+0000","last_active":"2024-05-10T08:45:34.338611+0000","last_peered":"2024-05-10T08:45:34.338611+0000","last_clean":"2024-05-10T08:45:34.338611+0000","last_became_active":"2024-05-10T08:45:33.317872+0000","last_became_peered":"2024-05-10T08:45:33.317872+0000","last_unstale":"2024-05-10T08:45:34.338611+0000","last_undegraded":"2024-05-10T08:45:34.338611+0000","last_fullsized":"2024-05-10T08:45:34.338611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:49.850901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.354015+0000","last_change":"2024-05-10T08:45:34.350252+0000","last_active":"2024-05-10T08:45:34.354015+0000","last_peered":"2024-05-10T08:45:34.354015+0000","last_clean":"2024-05-10T08:45:34.354015+0000","last_became_active":"2024-05-10T08:45:34.349973+0000","last_became_peered":"2024-05-10T08:45:34.349973+0000","last_unstale":"2024-05-10T08:45:34.354015+0000","last_undegraded":"2024-05-10T08:45:34.354015+0000","last_fullsized":"2024-05-10T08:45:34.354015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:47.617708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331569+0000","last_change":"2024-05-10T08:45:33.319440+0000","last_active":"2024-05-10T08:45:35.331569+0000","last_peered":"2024-05-10T08:45:35.331569+0000","last_clean":"2024-05-10T08:45:35.331569+0000","last_became_active":"2024-05-10T08:45:33.318902+0000","last_became_peered":"2024-05-10T08:45:33.318902+0000","last_unstale":"2024-05-10T08:45:35.331569+0000","last_undegraded":"2024-05-10T08:45:35.331569+0000","last_fullsized":"2024-05-10T08:45:35.331569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:24.672043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331354+0000","last_change":"2024-05-10T08:45:34.357535+0000","last_active":"2024-05-10T08:45:35.331354+0000","last_peered":"2024-05-10T08:45:35.331354+0000","last_clean":"2024-05-10T08:45:35.331354+0000","last_became_active":"2024-05-10T08:45:34.357255+0000","last_became_peered":"2024-05-10T08:45:34.357255+0000","last_unstale":"2024-05-10T08:45:35.331354+0000","last_undegraded":"2024-05-10T08:45:35.331354+0000","last_fullsized":"2024-05-10T08:45:35.331354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.687264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.375500+0000","last_change":"2024-05-10T08:45:33.321690+0000","last_active":"2024-05-10T08:45:34.375500+0000","last_peered":"2024-05-10T08:45:34.375500+0000","last_clean":"2024-05-10T08:45:34.375500+0000","last_became_active":"2024-05-10T08:45:33.321409+0000","last_became_peered":"2024-05-10T08:45:33.321409+0000","last_unstale":"2024-05-10T08:45:34.375500+0000","last_undegraded":"2024-05-10T08:45:34.375500+0000","last_fullsized":"2024-05-10T08:45:34.375500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:07.489966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331013+0000","last_change":"2024-05-10T08:45:34.350779+0000","last_active":"2024-05-10T08:45:35.331013+0000","last_peered":"2024-05-10T08:45:35.331013+0000","last_clean":"2024-05-10T08:45:35.331013+0000","last_became_active":"2024-05-10T08:45:34.350518+0000","last_became_peered":"2024-05-10T08:45:34.350518+0000","last_unstale":"2024-05-10T08:45:35.331013+0000","last_undegraded":"2024-05-10T08:45:35.331013+0000","last_fullsized":"2024-05-10T08:45:35.331013+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.402626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330728+0000","last_change":"2024-05-10T08:45:33.324741+0000","last_active":"2024-05-10T08:45:35.330728+0000","last_peered":"2024-05-10T08:45:35.330728+0000","last_clean":"2024-05-10T08:45:35.330728+0000","last_became_active":"2024-05-10T08:45:33.324444+0000","last_became_peered":"2024-05-10T08:45:33.324444+0000","last_unstale":"2024-05-10T08:45:35.330728+0000","last_undegraded":"2024-05-10T08:45:35.330728+0000","last_fullsized":"2024-05-10T08:45:35.330728+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:03.300041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329920+0000","last_change":"2024-05-10T08:45:34.341987+0000","last_active":"2024-05-10T08:45:35.329920+0000","last_peered":"2024-05-10T08:45:35.329920+0000","last_clean":"2024-05-10T08:45:35.329920+0000","last_became_active":"2024-05-10T08:45:34.341700+0000","last_became_peered":"2024-05-10T08:45:34.341700+0000","last_unstale":"2024-05-10T08:45:35.329920+0000","last_undegraded":"2024-05-10T08:45:35.329920+0000","last_fullsized":"2024-05-10T08:45:35.329920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:47:50.997341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.352356+0000","last_change":"2024-05-10T08:45:33.321087+0000","last_active":"2024-05-10T08:45:34.352356+0000","last_peered":"2024-05-10T08:45:34.352356+0000","last_clean":"2024-05-10T08:45:34.352356+0000","last_became_active":"2024-05-10T08:45:33.320791+0000","last_became_peered":"2024-05-10T08:45:33.320791+0000","last_unstale":"2024-05-10T08:45:34.352356+0000","last_undegraded":"2024-05-10T08:45:34.352356+0000","last_fullsized":"2024-05-10T08:45:34.352356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:09:57.316147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.353525+0000","last_change":"2024-05-10T08:45:34.346053+0000","last_active":"2024-05-10T08:45:34.353525+0000","last_peered":"2024-05-10T08:45:34.353525+0000","last_clean":"2024-05-10T08:45:34.353525+0000","last_became_active":"2024-05-10T08:45:34.345750+0000","last_became_peered":"2024-05-10T08:45:34.345750+0000","last_unstale":"2024-05-10T08:45:34.353525+0000","last_undegraded":"2024-05-10T08:45:34.353525+0000","last_fullsized":"2024-05-10T08:45:34.353525+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:01.902616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331096+0000","last_change":"2024-05-10T08:45:33.317151+0000","last_active":"2024-05-10T08:45:35.331096+0000","last_peered":"2024-05-10T08:45:35.331096+0000","last_clean":"2024-05-10T08:45:35.331096+0000","last_became_active":"2024-05-10T08:45:33.316864+0000","last_became_peered":"2024-05-10T08:45:33.316864+0000","last_unstale":"2024-05-10T08:45:35.331096+0000","last_undegraded":"2024-05-10T08:45:35.331096+0000","last_fullsized":"2024-05-10T08:45:35.331096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.826225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338052+0000","last_change":"2024-05-10T08:45:34.336560+0000","last_active":"2024-05-10T08:45:34.338052+0000","last_peered":"2024-05-10T08:45:34.338052+0000","last_clean":"2024-05-10T08:45:34.338052+0000","last_became_active":"2024-05-10T08:45:34.336259+0000","last_became_peered":"2024-05-10T08:45:34.336259+0000","last_unstale":"2024-05-10T08:45:34.338052+0000","last_undegraded":"2024-05-10T08:45:34.338052+0000","last_fullsized":"2024-05-10T08:45:34.338052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:23.898470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331143+0000","last_change":"2024-05-10T08:45:33.312218+0000","last_active":"2024-05-10T08:45:35.331143+0000","last_peered":"2024-05-10T08:45:35.331143+0000","last_clean":"2024-05-10T08:45:35.331143+0000","last_became_active":"2024-05-10T08:45:33.311812+0000","last_became_peered":"2024-05-10T08:45:33.311812+0000","last_unstale":"2024-05-10T08:45:35.331143+0000","last_undegraded":"2024-05-10T08:45:35.331143+0000","last_fullsized":"2024-05-10T08:45:35.331143+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:28.755465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359606+0000","last_change":"2024-05-10T08:45:34.357233+0000","last_active":"2024-05-10T08:45:34.359606+0000","last_peered":"2024-05-10T08:45:34.359606+0000","last_clean":"2024-05-10T08:45:34.359606+0000","last_became_active":"2024-05-10T08:45:34.356947+0000","last_became_peered":"2024-05-10T08:45:34.356947+0000","last_unstale":"2024-05-10T08:45:34.359606+0000","last_undegraded":"2024-05-10T08:45:34.359606+0000","last_fullsized":"2024-05-10T08:45:34.359606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:03:15.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.368347+0000","last_change":"2024-05-10T08:45:33.315956+0000","last_active":"2024-05-10T08:45:34.368347+0000","last_peered":"2024-05-10T08:45:34.368347+0000","last_clean":"2024-05-10T08:45:34.368347+0000","last_became_active":"2024-05-10T08:45:33.315643+0000","last_became_peered":"2024-05-10T08:45:33.315643+0000","last_unstale":"2024-05-10T08:45:34.368347+0000","last_undegraded":"2024-05-10T08:45:34.368347+0000","last_fullsized":"2024-05-10T08:45:34.368347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:47:49.990411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.346057+0000","last_change":"2024-05-10T08:45:34.341995+0000","last_active":"2024-05-10T08:45:34.346057+0000","last_peered":"2024-05-10T08:45:34.346057+0000","last_clean":"2024-05-10T08:45:34.346057+0000","last_became_active":"2024-05-10T08:45:34.341667+0000","last_became_peered":"2024-05-10T08:45:34.341667+0000","last_unstale":"2024-05-10T08:45:34.346057+0000","last_undegraded":"2024-05-10T08:45:34.346057+0000","last_fullsized":"2024-05-10T08:45:34.346057+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.298479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330440+0000","last_change":"2024-05-10T08:45:33.315585+0000","last_active":"2024-05-10T08:45:35.330440+0000","last_peered":"2024-05-10T08:45:35.330440+0000","last_clean":"2024-05-10T08:45:35.330440+0000","last_became_active":"2024-05-10T08:45:33.314835+0000","last_became_peered":"2024-05-10T08:45:33.314835+0000","last_unstale":"2024-05-10T08:45:35.330440+0000","last_undegraded":"2024-05-10T08:45:35.330440+0000","last_fullsized":"2024-05-10T08:45:35.330440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:07.336368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331519+0000","last_change":"2024-05-10T08:45:34.335545+0000","last_active":"2024-05-10T08:45:35.331519+0000","last_peered":"2024-05-10T08:45:35.331519+0000","last_clean":"2024-05-10T08:45:35.331519+0000","last_became_active":"2024-05-10T08:45:34.334731+0000","last_became_peered":"2024-05-10T08:45:34.334731+0000","last_unstale":"2024-05-10T08:45:35.331519+0000","last_undegraded":"2024-05-10T08:45:35.331519+0000","last_fullsized":"2024-05-10T08:45:35.331519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:04.306971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331639+0000","last_change":"2024-05-10T08:45:33.321253+0000","last_active":"2024-05-10T08:45:35.331639+0000","last_peered":"2024-05-10T08:45:35.331639+0000","last_clean":"2024-05-10T08:45:35.331639+0000","last_became_active":"2024-05-10T08:45:33.320989+0000","last_became_peered":"2024-05-10T08:45:33.320989+0000","last_unstale":"2024-05-10T08:45:35.331639+0000","last_undegraded":"2024-05-10T08:45:35.331639+0000","last_fullsized":"2024-05-10T08:45:35.331639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:23.361592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.368583+0000","last_change":"2024-05-10T08:45:34.364324+0000","last_active":"2024-05-10T08:45:34.368583+0000","last_peered":"2024-05-10T08:45:34.368583+0000","last_clean":"2024-05-10T08:45:34.368583+0000","last_became_active":"2024-05-10T08:45:34.363998+0000","last_became_peered":"2024-05-10T08:45:34.363998+0000","last_unstale":"2024-05-10T08:45:34.368583+0000","last_undegraded":"2024-05-10T08:45:34.368583+0000","last_fullsized":"2024-05-10T08:45:34.368583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:09:24.380041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360649+0000","last_change":"2024-05-10T08:45:33.319986+0000","last_active":"2024-05-10T08:45:35.360649+0000","last_peered":"2024-05-10T08:45:35.360649+0000","last_clean":"2024-05-10T08:45:35.360649+0000","last_became_active":"2024-05-10T08:45:33.319639+0000","last_became_peered":"2024-05-10T08:45:33.319639+0000","last_unstale":"2024-05-10T08:45:35.360649+0000","last_undegraded":"2024-05-10T08:45:35.360649+0000","last_fullsized":"2024-05-10T08:45:35.360649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:29.548953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360582+0000","last_change":"2024-05-10T08:45:34.346908+0000","last_active":"2024-05-10T08:45:35.360582+0000","last_peered":"2024-05-10T08:45:35.360582+0000","last_clean":"2024-05-10T08:45:35.360582+0000","last_became_active":"2024-05-10T08:45:34.346629+0000","last_became_peered":"2024-05-10T08:45:34.346629+0000","last_unstale":"2024-05-10T08:45:35.360582+0000","last_undegraded":"2024-05-10T08:45:35.360582+0000","last_fullsized":"2024-05-10T08:45:35.360582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:47.617239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.333325+0000","last_change":"2024-05-10T08:45:33.323051+0000","last_active":"2024-05-10T08:45:34.333325+0000","last_peered":"2024-05-10T08:45:34.333325+0000","last_clean":"2024-05-10T08:45:34.333325+0000","last_became_active":"2024-05-10T08:45:33.322627+0000","last_became_peered":"2024-05-10T08:45:33.322627+0000","last_unstale":"2024-05-10T08:45:34.333325+0000","last_undegraded":"2024-05-10T08:45:34.333325+0000","last_fullsized":"2024-05-10T08:45:34.333325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:08.300342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360612+0000","last_change":"2024-05-10T08:45:34.358677+0000","last_active":"2024-05-10T08:45:35.360612+0000","last_peered":"2024-05-10T08:45:35.360612+0000","last_clean":"2024-05-10T08:45:35.360612+0000","last_became_active":"2024-05-10T08:45:34.358424+0000","last_became_peered":"2024-05-10T08:45:34.358424+0000","last_unstale":"2024-05-10T08:45:35.360612+0000","last_undegraded":"2024-05-10T08:45:35.360612+0000","last_fullsized":"2024-05-10T08:45:35.360612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:36.090231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360713+0000","last_change":"2024-05-10T08:45:33.320526+0000","last_active":"2024-05-10T08:45:35.360713+0000","last_peered":"2024-05-10T08:45:35.360713+0000","last_clean":"2024-05-10T08:45:35.360713+0000","last_became_active":"2024-05-10T08:45:33.320272+0000","last_became_peered":"2024-05-10T08:45:33.320272+0000","last_unstale":"2024-05-10T08:45:35.360713+0000","last_undegraded":"2024-05-10T08:45:35.360713+0000","last_fullsized":"2024-05-10T08:45:35.360713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:57.767637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.358187+0000","last_change":"2024-05-10T08:45:34.355356+0000","last_active":"2024-05-10T08:45:34.358187+0000","last_peered":"2024-05-10T08:45:34.358187+0000","last_clean":"2024-05-10T08:45:34.358187+0000","last_became_active":"2024-05-10T08:45:34.355071+0000","last_became_peered":"2024-05-10T08:45:34.355071+0000","last_unstale":"2024-05-10T08:45:34.358187+0000","last_undegraded":"2024-05-10T08:45:34.358187+0000","last_fullsized":"2024-05-10T08:45:34.358187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:13.875011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.332659+0000","last_change":"2024-05-10T08:45:33.316161+0000","last_active":"2024-05-10T08:45:34.332659+0000","last_peered":"2024-05-10T08:45:34.332659+0000","last_clean":"2024-05-10T08:45:34.332659+0000","last_became_active":"2024-05-10T08:45:33.315869+0000","last_became_peered":"2024-05-10T08:45:33.315869+0000","last_unstale":"2024-05-10T08:45:34.332659+0000","last_undegraded":"2024-05-10T08:45:34.332659+0000","last_fullsized":"2024-05-10T08:45:34.332659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:59.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.348542+0000","last_change":"2024-05-10T08:45:34.344640+0000","last_active":"2024-05-10T08:45:34.348542+0000","last_peered":"2024-05-10T08:45:34.348542+0000","last_clean":"2024-05-10T08:45:34.348542+0000","last_became_active":"2024-05-10T08:45:34.344342+0000","last_became_peered":"2024-05-10T08:45:34.344342+0000","last_unstale":"2024-05-10T08:45:34.348542+0000","last_undegraded":"2024-05-10T08:45:34.348542+0000","last_fullsized":"2024-05-10T08:45:34.348542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:18.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330848+0000","last_change":"2024-05-10T08:45:33.313899+0000","last_active":"2024-05-10T08:45:35.330848+0000","last_peered":"2024-05-10T08:45:35.330848+0000","last_clean":"2024-05-10T08:45:35.330848+0000","last_became_active":"2024-05-10T08:45:33.313631+0000","last_became_peered":"2024-05-10T08:45:33.313631+0000","last_unstale":"2024-05-10T08:45:35.330848+0000","last_undegraded":"2024-05-10T08:45:35.330848+0000","last_fullsized":"2024-05-10T08:45:35.330848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:54:17.933687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360901+0000","last_change":"2024-05-10T08:45:34.357298+0000","last_active":"2024-05-10T08:45:34.360901+0000","last_peered":"2024-05-10T08:45:34.360901+0000","last_clean":"2024-05-10T08:45:34.360901+0000","last_became_active":"2024-05-10T08:45:34.356977+0000","last_became_peered":"2024-05-10T08:45:34.356977+0000","last_unstale":"2024-05-10T08:45:34.360901+0000","last_undegraded":"2024-05-10T08:45:34.360901+0000","last_fullsized":"2024-05-10T08:45:34.360901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:38:19.772634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"87'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360139+0000","last_change":"2024-05-10T08:45:33.316749+0000","last_active":"2024-05-10T08:45:35.360139+0000","last_peered":"2024-05-10T08:45:35.360139+0000","last_clean":"2024-05-10T08:45:35.360139+0000","last_became_active":"2024-05-10T08:45:33.316470+0000","last_became_peered":"2024-05-10T08:45:33.316470+0000","last_unstale":"2024-05-10T08:45:35.360139+0000","last_undegraded":"2024-05-10T08:45:35.360139+0000","last_fullsized":"2024-05-10T08:45:35.360139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.818144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359455+0000","last_change":"2024-05-10T08:45:34.357091+0000","last_active":"2024-05-10T08:45:34.359455+0000","last_peered":"2024-05-10T08:45:34.359455+0000","last_clean":"2024-05-10T08:45:34.359455+0000","last_became_active":"2024-05-10T08:45:34.356769+0000","last_became_peered":"2024-05-10T08:45:34.356769+0000","last_unstale":"2024-05-10T08:45:34.359455+0000","last_undegraded":"2024-05-10T08:45:34.359455+0000","last_fullsized":"2024-05-10T08:45:34.359455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:53:11.132194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331667+0000","last_change":"2024-05-10T08:45:33.319179+0000","last_active":"2024-05-10T08:45:35.331667+0000","last_peered":"2024-05-10T08:45:35.331667+0000","last_clean":"2024-05-10T08:45:35.331667+0000","last_became_active":"2024-05-10T08:45:33.318534+0000","last_became_peered":"2024-05-10T08:45:33.318534+0000","last_unstale":"2024-05-10T08:45:35.331667+0000","last_undegraded":"2024-05-10T08:45:35.331667+0000","last_fullsized":"2024-05-10T08:45:35.331667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:57:18.040729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360850+0000","last_change":"2024-05-10T08:45:34.350072+0000","last_active":"2024-05-10T08:45:35.360850+0000","last_peered":"2024-05-10T08:45:35.360850+0000","last_clean":"2024-05-10T08:45:35.360850+0000","last_became_active":"2024-05-10T08:45:34.349804+0000","last_became_peered":"2024-05-10T08:45:34.349804+0000","last_unstale":"2024-05-10T08:45:35.360850+0000","last_undegraded":"2024-05-10T08:45:35.360850+0000","last_fullsized":"2024-05-10T08:45:35.360850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:08.343298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.340035+0000","last_change":"2024-05-10T08:45:33.318225+0000","last_active":"2024-05-10T08:45:34.340035+0000","last_peered":"2024-05-10T08:45:34.340035+0000","last_clean":"2024-05-10T08:45:34.340035+0000","last_became_active":"2024-05-10T08:45:33.317956+0000","last_became_peered":"2024-05-10T08:45:33.317956+0000","last_unstale":"2024-05-10T08:45:34.340035+0000","last_undegraded":"2024-05-10T08:45:34.340035+0000","last_fullsized":"2024-05-10T08:45:34.340035+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:57.767637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.357555+0000","last_change":"2024-05-10T08:45:34.353365+0000","last_active":"2024-05-10T08:45:34.357555+0000","last_peered":"2024-05-10T08:45:34.357555+0000","last_clean":"2024-05-10T08:45:34.357555+0000","last_became_active":"2024-05-10T08:45:34.353044+0000","last_became_peered":"2024-05-10T08:45:34.353044+0000","last_unstale":"2024-05-10T08:45:34.357555+0000","last_undegraded":"2024-05-10T08:45:34.357555+0000","last_fullsized":"2024-05-10T08:45:34.357555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:16.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.352398+0000","last_change":"2024-05-10T08:45:33.323008+0000","last_active":"2024-05-10T08:45:34.352398+0000","last_peered":"2024-05-10T08:45:34.352398+0000","last_clean":"2024-05-10T08:45:34.352398+0000","last_became_active":"2024-05-10T08:45:33.322051+0000","last_became_peered":"2024-05-10T08:45:33.322051+0000","last_unstale":"2024-05-10T08:45:34.352398+0000","last_undegraded":"2024-05-10T08:45:34.352398+0000","last_fullsized":"2024-05-10T08:45:34.352398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:58.406236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.347411+0000","last_change":"2024-05-10T08:45:34.344246+0000","last_active":"2024-05-10T08:45:34.347411+0000","last_peered":"2024-05-10T08:45:34.347411+0000","last_clean":"2024-05-10T08:45:34.347411+0000","last_became_active":"2024-05-10T08:45:34.343946+0000","last_became_peered":"2024-05-10T08:45:34.343946+0000","last_unstale":"2024-05-10T08:45:34.347411+0000","last_undegraded":"2024-05-10T08:45:34.347411+0000","last_fullsized":"2024-05-10T08:45:34.347411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:13.875011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360654+0000","last_change":"2024-05-10T08:45:33.319852+0000","last_active":"2024-05-10T08:45:35.360654+0000","last_peered":"2024-05-10T08:45:35.360654+0000","last_clean":"2024-05-10T08:45:35.360654+0000","last_became_active":"2024-05-10T08:45:33.319548+0000","last_became_peered":"2024-05-10T08:45:33.319548+0000","last_unstale":"2024-05-10T08:45:35.360654+0000","last_undegraded":"2024-05-10T08:45:35.360654+0000","last_fullsized":"2024-05-10T08:45:35.360654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:05:04.446697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356678+0000","last_change":"2024-05-10T08:45:34.351684+0000","last_active":"2024-05-10T08:45:34.356678+0000","last_peered":"2024-05-10T08:45:34.356678+0000","last_clean":"2024-05-10T08:45:34.356678+0000","last_became_active":"2024-05-10T08:45:34.351368+0000","last_became_peered":"2024-05-10T08:45:34.351368+0000","last_unstale":"2024-05-10T08:45:34.356678+0000","last_undegraded":"2024-05-10T08:45:34.356678+0000","last_fullsized":"2024-05-10T08:45:34.356678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:29.831005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338392+0000","last_change":"2024-05-10T08:45:33.312942+0000","last_active":"2024-05-10T08:45:34.338392+0000","last_peered":"2024-05-10T08:45:34.338392+0000","last_clean":"2024-05-10T08:45:34.338392+0000","last_became_active":"2024-05-10T08:45:33.312665+0000","last_became_peered":"2024-05-10T08:45:33.312665+0000","last_unstale":"2024-05-10T08:45:34.338392+0000","last_undegraded":"2024-05-10T08:45:34.338392+0000","last_fullsized":"2024-05-10T08:45:34.338392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:29.051628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359521+0000","last_change":"2024-05-10T08:45:34.356720+0000","last_active":"2024-05-10T08:45:34.359521+0000","last_peered":"2024-05-10T08:45:34.359521+0000","last_clean":"2024-05-10T08:45:34.359521+0000","last_became_active":"2024-05-10T08:45:34.356441+0000","last_became_peered":"2024-05-10T08:45:34.356441+0000","last_unstale":"2024-05-10T08:45:34.359521+0000","last_undegraded":"2024-05-10T08:45:34.359521+0000","last_fullsized":"2024-05-10T08:45:34.359521+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:50.289888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330067+0000","last_change":"2024-05-10T08:45:33.317551+0000","last_active":"2024-05-10T08:45:35.330067+0000","last_peered":"2024-05-10T08:45:35.330067+0000","last_clean":"2024-05-10T08:45:35.330067+0000","last_became_active":"2024-05-10T08:45:33.317359+0000","last_became_peered":"2024-05-10T08:45:33.317359+0000","last_unstale":"2024-05-10T08:45:35.330067+0000","last_undegraded":"2024-05-10T08:45:35.330067+0000","last_fullsized":"2024-05-10T08:45:35.330067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:26.863845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330788+0000","last_change":"2024-05-10T08:45:34.346988+0000","last_active":"2024-05-10T08:45:35.330788+0000","last_peered":"2024-05-10T08:45:35.330788+0000","last_clean":"2024-05-10T08:45:35.330788+0000","last_became_active":"2024-05-10T08:45:34.346581+0000","last_became_peered":"2024-05-10T08:45:34.346581+0000","last_unstale":"2024-05-10T08:45:35.330788+0000","last_undegraded":"2024-05-10T08:45:35.330788+0000","last_fullsized":"2024-05-10T08:45:35.330788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:13.875011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331438+0000","last_change":"2024-05-10T08:45:33.322875+0000","last_active":"2024-05-10T08:45:35.331438+0000","last_peered":"2024-05-10T08:45:35.331438+0000","last_clean":"2024-05-10T08:45:35.331438+0000","last_became_active":"2024-05-10T08:45:33.322478+0000","last_became_peered":"2024-05-10T08:45:33.322478+0000","last_unstale":"2024-05-10T08:45:35.331438+0000","last_undegraded":"2024-05-10T08:45:35.331438+0000","last_fullsized":"2024-05-10T08:45:35.331438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:24.826504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":234,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330128+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:45:35.330128+0000","last_peered":"2024-05-10T08:45:35.330128+0000","last_clean":"2024-05-10T08:45:35.330128+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:45:35.330128+0000","last_undegraded":"2024-05-10T08:45:35.330128+0000","last_fullsized":"2024-05-10T08:45:35.330128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1662976,"data_stored":1074777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1081344,"data_stored":486569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":484353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":484513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":484353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":484353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":484423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1679360,"data_stored":1077039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:45:38.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:45:38.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.522+0000 7fee4bff9640 1 Processor -- start 2024-05-10T08:45:38.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.523+0000 7fee4bff9640 1 -- start start 2024-05-10T08:45:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.523+0000 7fee4bff9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 0x7fee440d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.523+0000 7fee4bff9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee441630b0 con 0x7fee4415f420 2024-05-10T08:45:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.523+0000 7fee4bff9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee440d3e70 con 0x7fee440d4cc0 2024-05-10T08:45:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.523+0000 7fee4bff9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fee440d2330 con 0x7fee440d1970 2024-05-10T08:45:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee49d95640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee4415f420 0x7fee440d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41696/0 (socket says 172.21.15.37:41696) 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee49d95640 1 -- 172.21.15.37:0/583148581 learned_addr learned my addr 172.21.15.37:0/583148581 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee49594640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 0x7fee440d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628606119 0 0) 0x7fee3c001110 con 0x7fee4415f420 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee2c003520 con 0x7fee4415f420 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517504477 0 0) 0x7fee440d3e70 con 0x7fee440d4cc0 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee3c001110 con 0x7fee440d4cc0 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4016418661 0 0) 0x7fee2c003520 con 0x7fee4415f420 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 msgr2=0x7fee440d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 0x7fee440d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 >> v1:172.21.15.82:6789/0 conn(0x7fee440d4cc0 legacy=0x7fee440d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee440d2550 con 0x7fee4415f420 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fee3c001840 con 0x7fee4415f420 2024-05-10T08:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee49594640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 0x7fee440d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 >> v1:172.21.15.37:6789/0 conn(0x7fee4415f420 legacy=0x7fee440d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c003b70 0x7fee2c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c004800 0x7fee2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 0x7fee2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee440d2330 con 0x7fee2c003b70 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c00ba70 con 0x7fee2c004800 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fee2c00bc40 con 0x7fee440d1970 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee49d95640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c003b70 0x7fee2c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee49594640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c004800 0x7fee2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.524+0000 7fee4a596640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 0x7fee2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.525+0000 7fee49d95640 1 -- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 msgr2=0x7fee2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.525+0000 7fee49d95640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440d1970 0x7fee2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.525+0000 7fee49d95640 1 -- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c004800 msgr2=0x7fee2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.525+0000 7fee49d95640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c004800 0x7fee2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.525+0000 7fee49d95640 1 -- 172.21.15.37:0/583148581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c003520 con 0x7fee2c003b70 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.525+0000 7fee49d95640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c003b70 0x7fee2c003f70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00c240 tx=0x7fee2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f511e2fffe586b84 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c007db0 con 0x7fee2c003b70 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3c005ad0 con 0x7fee2c003b70 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee48d93640 1 -- 172.21.15.37:0/583148581 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c007070 con 0x7fee2c003b70 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee4bff9640 1 -- 172.21.15.37:0/583148581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c003b70 msgr2=0x7fee2c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee4bff9640 1 --2- 172.21.15.37:0/583148581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c003b70 0x7fee2c003f70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00c240 tx=0x7fee2c005830 comp rx=0 tx=0).stop 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee4a596640 1 -- 172.21.15.37:0/583148581 reap_dead start 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee4bff9640 1 -- 172.21.15.37:0/583148581 shutdown_connections 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee4bff9640 1 -- 172.21.15.37:0/583148581 >> 172.21.15.37:0/583148581 conn(0x7fee4408eac0 msgr2=0x7fee4409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee4bff9640 1 -- 172.21.15.37:0/583148581 shutdown_connections 2024-05-10T08:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.526+0000 7fee4bff9640 1 -- 172.21.15.37:0/583148581 wait complete. 2024-05-10T08:45:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.527+0000 7fee4bff9640 1 Processor -- start 2024-05-10T08:45:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.527+0000 7fee4bff9640 1 -- start start 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee4bff9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c003b70 0x7fee441ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee4bff9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440caff0 0x7fee440cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee4bff9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440c8be0 0x7fee440c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee4bff9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee440d3240 con 0x7fee440caff0 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee4bff9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee440d2f60 con 0x7fee2c003b70 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee4bff9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fee440d2830 con 0x7fee440c8be0 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee49594640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440caff0 0x7fee440cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee49594640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440caff0 0x7fee440cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49180/0 (socket says 172.21.15.37:49180) 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee49594640 1 -- 172.21.15.37:0/3943553958 learned_addr learned my addr 172.21.15.37:0/3943553958 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee4a596640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440c8be0 0x7fee440c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.528+0000 7fee49d95640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c003b70 0x7fee441ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee49594640 1 -- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440c8be0 msgr2=0x7fee440c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee49594640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440c8be0 0x7fee440c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee49594640 1 -- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c003b70 msgr2=0x7fee441ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee49594640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c003b70 0x7fee441ea9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee49594640 1 -- 172.21.15.37:0/3943553958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee440cb990 con 0x7fee440caff0 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee4a596640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440c8be0 0x7fee440c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee49d95640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c003b70 0x7fee441ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee49594640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440caff0 0x7fee440cb450 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fee38011930 tx=0x7fee38011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee427fc640 1 -- 172.21.15.37:0/3943553958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3800faf0 con 0x7fee440caff0 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee427fc640 1 -- 172.21.15.37:0/3943553958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3800fc90 con 0x7fee440caff0 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee440c9950 con 0x7fee440caff0 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee427fc640 1 -- 172.21.15.37:0/3943553958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38004030 con 0x7fee440caff0 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.529+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee440c9f10 con 0x7fee440caff0 2024-05-10T08:45:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.530+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee440693f0 con 0x7fee440caff0 2024-05-10T08:45:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.530+0000 7fee427fc640 1 -- 172.21.15.37:0/3943553958 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee38012040 con 0x7fee440caff0 2024-05-10T08:45:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.531+0000 7fee427fc640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee300762d0 0x7fee30078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.531+0000 7fee427fc640 1 -- 172.21.15.37:0/3943553958 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fee38097b50 con 0x7fee440caff0 2024-05-10T08:45:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.531+0000 7fee49d95640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee300762d0 0x7fee30078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.532+0000 7fee49d95640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee300762d0 0x7fee30078790 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fee3c033000 tx=0x7fee3c009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.536+0000 7fee427fc640 1 -- 172.21.15.37:0/3943553958 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fee440cb990 con 0x7fee440caff0 2024-05-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.723+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee440b66b0 con 0x7fee300762d0 2024-05-10T08:45:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.729+0000 7fee427fc640 1 -- 172.21.15.37:0/3943553958 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7fee440b66b0 con 0x7fee300762d0 2024-05-10T08:45:38.730 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:45:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.732+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee300762d0 msgr2=0x7fee30078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.732+0000 7fee4bff9640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee300762d0 0x7fee30078790 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fee3c033000 tx=0x7fee3c009030 comp rx=0 tx=0).stop 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440caff0 msgr2=0x7fee440cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440caff0 0x7fee440cb450 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fee38011930 tx=0x7fee38011df0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 shutdown_connections 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fee300762d0 0x7fee30078790 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee440c8be0 0x7fee440c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440caff0 0x7fee440cb450 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 --2- 172.21.15.37:0/3943553958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2c003b70 0x7fee441ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 >> 172.21.15.37:0/3943553958 conn(0x7fee4408eac0 msgr2=0x7fee440d35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 shutdown_connections 2024-05-10T08:45:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.733+0000 7fee4bff9640 1 -- 172.21.15.37:0/3943553958 wait complete. 2024-05-10T08:45:38.742 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-05-10T08:45:37.402289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259008,"kb_used_data":9512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715712,"statfs":{"total":773094113280,"available":772828889088,"internally_reserved":0,"allocated":9740288,"data_stored":5060380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.100199"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.354538+0000","last_change":"2024-05-10T08:45:34.353223+0000","last_active":"2024-05-10T08:45:34.354538+0000","last_peered":"2024-05-10T08:45:34.354538+0000","last_clean":"2024-05-10T08:45:34.354538+0000","last_became_active":"2024-05-10T08:45:34.352945+0000","last_became_peered":"2024-05-10T08:45:34.352945+0000","last_unstale":"2024-05-10T08:45:34.354538+0000","last_undegraded":"2024-05-10T08:45:34.354538+0000","last_fullsized":"2024-05-10T08:45:34.354538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:53:11.132194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360853+0000","last_change":"2024-05-10T08:45:34.347847+0000","last_active":"2024-05-10T08:45:35.360853+0000","last_peered":"2024-05-10T08:45:35.360853+0000","last_clean":"2024-05-10T08:45:35.360853+0000","last_became_active":"2024-05-10T08:45:34.347581+0000","last_became_peered":"2024-05-10T08:45:34.347581+0000","last_unstale":"2024-05-10T08:45:35.360853+0000","last_undegraded":"2024-05-10T08:45:35.360853+0000","last_fullsized":"2024-05-10T08:45:35.360853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:27.870775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356426+0000","last_change":"2024-05-10T08:45:34.355199+0000","last_active":"2024-05-10T08:45:34.356426+0000","last_peered":"2024-05-10T08:45:34.356426+0000","last_clean":"2024-05-10T08:45:34.356426+0000","last_became_active":"2024-05-10T08:45:34.354842+0000","last_became_peered":"2024-05-10T08:45:34.354842+0000","last_unstale":"2024-05-10T08:45:34.356426+0000","last_undegraded":"2024-05-10T08:45:34.356426+0000","last_fullsized":"2024-05-10T08:45:34.356426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:03:15.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331248+0000","last_change":"2024-05-10T08:45:34.348904+0000","last_active":"2024-05-10T08:45:35.331248+0000","last_peered":"2024-05-10T08:45:35.331248+0000","last_clean":"2024-05-10T08:45:35.331248+0000","last_became_active":"2024-05-10T08:45:34.348647+0000","last_became_peered":"2024-05-10T08:45:34.348647+0000","last_unstale":"2024-05-10T08:45:35.331248+0000","last_undegraded":"2024-05-10T08:45:35.331248+0000","last_fullsized":"2024-05-10T08:45:35.331248+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:04.306971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330276+0000","last_change":"2024-05-10T08:45:34.342334+0000","last_active":"2024-05-10T08:45:35.330276+0000","last_peered":"2024-05-10T08:45:35.330276+0000","last_clean":"2024-05-10T08:45:35.330276+0000","last_became_active":"2024-05-10T08:45:34.341562+0000","last_became_peered":"2024-05-10T08:45:34.341562+0000","last_unstale":"2024-05-10T08:45:35.330276+0000","last_undegraded":"2024-05-10T08:45:35.330276+0000","last_fullsized":"2024-05-10T08:45:35.330276+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:29.831005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.361837+0000","last_change":"2024-05-10T08:45:34.360281+0000","last_active":"2024-05-10T08:45:34.361837+0000","last_peered":"2024-05-10T08:45:34.361837+0000","last_clean":"2024-05-10T08:45:34.361837+0000","last_became_active":"2024-05-10T08:45:34.359788+0000","last_became_peered":"2024-05-10T08:45:34.359788+0000","last_unstale":"2024-05-10T08:45:34.361837+0000","last_undegraded":"2024-05-10T08:45:34.361837+0000","last_fullsized":"2024-05-10T08:45:34.361837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:33:35.297900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330388+0000","last_change":"2024-05-10T08:45:34.345356+0000","last_active":"2024-05-10T08:45:35.330388+0000","last_peered":"2024-05-10T08:45:35.330388+0000","last_clean":"2024-05-10T08:45:35.330388+0000","last_became_active":"2024-05-10T08:45:34.345104+0000","last_became_peered":"2024-05-10T08:45:34.345104+0000","last_unstale":"2024-05-10T08:45:35.330388+0000","last_undegraded":"2024-05-10T08:45:35.330388+0000","last_fullsized":"2024-05-10T08:45:35.330388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:59.413165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330964+0000","last_change":"2024-05-10T08:45:34.351377+0000","last_active":"2024-05-10T08:45:35.330964+0000","last_peered":"2024-05-10T08:45:35.330964+0000","last_clean":"2024-05-10T08:45:35.330964+0000","last_became_active":"2024-05-10T08:45:34.351116+0000","last_became_peered":"2024-05-10T08:45:34.351116+0000","last_unstale":"2024-05-10T08:45:35.330964+0000","last_undegraded":"2024-05-10T08:45:35.330964+0000","last_fullsized":"2024-05-10T08:45:35.330964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:23.210960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331448+0000","last_change":"2024-05-10T08:45:34.342136+0000","last_active":"2024-05-10T08:45:35.331448+0000","last_peered":"2024-05-10T08:45:35.331448+0000","last_clean":"2024-05-10T08:45:35.331448+0000","last_became_active":"2024-05-10T08:45:34.341598+0000","last_became_peered":"2024-05-10T08:45:34.341598+0000","last_unstale":"2024-05-10T08:45:35.331448+0000","last_undegraded":"2024-05-10T08:45:35.331448+0000","last_fullsized":"2024-05-10T08:45:35.331448+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:36.090231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.351597+0000","last_change":"2024-05-10T08:45:34.345253+0000","last_active":"2024-05-10T08:45:34.351597+0000","last_peered":"2024-05-10T08:45:34.351597+0000","last_clean":"2024-05-10T08:45:34.351597+0000","last_became_active":"2024-05-10T08:45:34.344944+0000","last_became_peered":"2024-05-10T08:45:34.344944+0000","last_unstale":"2024-05-10T08:45:34.351597+0000","last_undegraded":"2024-05-10T08:45:34.351597+0000","last_fullsized":"2024-05-10T08:45:34.351597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:57.337776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331440+0000","last_change":"2024-05-10T08:45:34.350603+0000","last_active":"2024-05-10T08:45:35.331440+0000","last_peered":"2024-05-10T08:45:35.331440+0000","last_clean":"2024-05-10T08:45:35.331440+0000","last_became_active":"2024-05-10T08:45:34.350355+0000","last_became_peered":"2024-05-10T08:45:34.350355+0000","last_unstale":"2024-05-10T08:45:35.331440+0000","last_undegraded":"2024-05-10T08:45:35.331440+0000","last_fullsized":"2024-05-10T08:45:35.331440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:47.617239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.351554+0000","last_change":"2024-05-10T08:45:34.345687+0000","last_active":"2024-05-10T08:45:34.351554+0000","last_peered":"2024-05-10T08:45:34.351554+0000","last_clean":"2024-05-10T08:45:34.351554+0000","last_became_active":"2024-05-10T08:45:34.345356+0000","last_became_peered":"2024-05-10T08:45:34.345356+0000","last_unstale":"2024-05-10T08:45:34.351554+0000","last_undegraded":"2024-05-10T08:45:34.351554+0000","last_fullsized":"2024-05-10T08:45:34.351554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:45:56.225957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331094+0000","last_change":"2024-05-10T08:45:34.353536+0000","last_active":"2024-05-10T08:45:35.331094+0000","last_peered":"2024-05-10T08:45:35.331094+0000","last_clean":"2024-05-10T08:45:35.331094+0000","last_became_active":"2024-05-10T08:45:34.351684+0000","last_became_peered":"2024-05-10T08:45:34.351684+0000","last_unstale":"2024-05-10T08:45:35.331094+0000","last_undegraded":"2024-05-10T08:45:35.331094+0000","last_fullsized":"2024-05-10T08:45:35.331094+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:08.343298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329956+0000","last_change":"2024-05-10T08:45:34.347294+0000","last_active":"2024-05-10T08:45:35.329956+0000","last_peered":"2024-05-10T08:45:35.329956+0000","last_clean":"2024-05-10T08:45:35.329956+0000","last_became_active":"2024-05-10T08:45:34.346966+0000","last_became_peered":"2024-05-10T08:45:34.346966+0000","last_unstale":"2024-05-10T08:45:35.329956+0000","last_undegraded":"2024-05-10T08:45:35.329956+0000","last_fullsized":"2024-05-10T08:45:35.329956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:18.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331029+0000","last_change":"2024-05-10T08:45:34.346411+0000","last_active":"2024-05-10T08:45:35.331029+0000","last_peered":"2024-05-10T08:45:35.331029+0000","last_clean":"2024-05-10T08:45:35.331029+0000","last_became_active":"2024-05-10T08:45:34.346037+0000","last_became_peered":"2024-05-10T08:45:34.346037+0000","last_unstale":"2024-05-10T08:45:35.331029+0000","last_undegraded":"2024-05-10T08:45:35.331029+0000","last_fullsized":"2024-05-10T08:45:35.331029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:47.617239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.363282+0000","last_change":"2024-05-10T08:45:34.362561+0000","last_active":"2024-05-10T08:45:34.363282+0000","last_peered":"2024-05-10T08:45:34.363282+0000","last_clean":"2024-05-10T08:45:34.363282+0000","last_became_active":"2024-05-10T08:45:34.362298+0000","last_became_peered":"2024-05-10T08:45:34.362298+0000","last_unstale":"2024-05-10T08:45:34.363282+0000","last_undegraded":"2024-05-10T08:45:34.363282+0000","last_fullsized":"2024-05-10T08:45:34.363282+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:52:52.719112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359332+0000","last_change":"2024-05-10T08:45:34.356950+0000","last_active":"2024-05-10T08:45:34.359332+0000","last_peered":"2024-05-10T08:45:34.359332+0000","last_clean":"2024-05-10T08:45:34.359332+0000","last_became_active":"2024-05-10T08:45:34.356401+0000","last_became_peered":"2024-05-10T08:45:34.356401+0000","last_unstale":"2024-05-10T08:45:34.359332+0000","last_undegraded":"2024-05-10T08:45:34.359332+0000","last_fullsized":"2024-05-10T08:45:34.359332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:47.617708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.347374+0000","last_change":"2024-05-10T08:45:34.345481+0000","last_active":"2024-05-10T08:45:34.347374+0000","last_peered":"2024-05-10T08:45:34.347374+0000","last_clean":"2024-05-10T08:45:34.347374+0000","last_became_active":"2024-05-10T08:45:34.345129+0000","last_became_peered":"2024-05-10T08:45:34.345129+0000","last_unstale":"2024-05-10T08:45:34.347374+0000","last_undegraded":"2024-05-10T08:45:34.347374+0000","last_fullsized":"2024-05-10T08:45:34.347374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:50.289888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331448+0000","last_change":"2024-05-10T08:45:34.345590+0000","last_active":"2024-05-10T08:45:35.331448+0000","last_peered":"2024-05-10T08:45:35.331448+0000","last_clean":"2024-05-10T08:45:35.331448+0000","last_became_active":"2024-05-10T08:45:34.345110+0000","last_became_peered":"2024-05-10T08:45:34.345110+0000","last_unstale":"2024-05-10T08:45:35.331448+0000","last_undegraded":"2024-05-10T08:45:35.331448+0000","last_fullsized":"2024-05-10T08:45:35.331448+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:08.343298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331351+0000","last_change":"2024-05-10T08:45:34.353445+0000","last_active":"2024-05-10T08:45:35.331351+0000","last_peered":"2024-05-10T08:45:35.331351+0000","last_clean":"2024-05-10T08:45:35.331351+0000","last_became_active":"2024-05-10T08:45:34.352969+0000","last_became_peered":"2024-05-10T08:45:34.352969+0000","last_unstale":"2024-05-10T08:45:35.331351+0000","last_undegraded":"2024-05-10T08:45:35.331351+0000","last_fullsized":"2024-05-10T08:45:35.331351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:27.870775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330414+0000","last_change":"2024-05-10T08:45:34.334118+0000","last_active":"2024-05-10T08:45:35.330414+0000","last_peered":"2024-05-10T08:45:35.330414+0000","last_clean":"2024-05-10T08:45:35.330414+0000","last_became_active":"2024-05-10T08:45:34.333815+0000","last_became_peered":"2024-05-10T08:45:34.333815+0000","last_unstale":"2024-05-10T08:45:35.330414+0000","last_undegraded":"2024-05-10T08:45:35.330414+0000","last_fullsized":"2024-05-10T08:45:35.330414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:21.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329946+0000","last_change":"2024-05-10T08:45:34.347340+0000","last_active":"2024-05-10T08:45:35.329946+0000","last_peered":"2024-05-10T08:45:35.329946+0000","last_clean":"2024-05-10T08:45:35.329946+0000","last_became_active":"2024-05-10T08:45:34.347044+0000","last_became_peered":"2024-05-10T08:45:34.347044+0000","last_unstale":"2024-05-10T08:45:35.329946+0000","last_undegraded":"2024-05-10T08:45:35.329946+0000","last_fullsized":"2024-05-10T08:45:35.329946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.298479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356621+0000","last_change":"2024-05-10T08:45:34.349024+0000","last_active":"2024-05-10T08:45:34.356621+0000","last_peered":"2024-05-10T08:45:34.356621+0000","last_clean":"2024-05-10T08:45:34.356621+0000","last_became_active":"2024-05-10T08:45:34.348762+0000","last_became_peered":"2024-05-10T08:45:34.348762+0000","last_unstale":"2024-05-10T08:45:34.356621+0000","last_undegraded":"2024-05-10T08:45:34.356621+0000","last_fullsized":"2024-05-10T08:45:34.356621+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:41:38.935586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.365816+0000","last_change":"2024-05-10T08:45:34.357609+0000","last_active":"2024-05-10T08:45:34.365816+0000","last_peered":"2024-05-10T08:45:34.365816+0000","last_clean":"2024-05-10T08:45:34.365816+0000","last_became_active":"2024-05-10T08:45:34.355851+0000","last_became_peered":"2024-05-10T08:45:34.355851+0000","last_unstale":"2024-05-10T08:45:34.365816+0000","last_undegraded":"2024-05-10T08:45:34.365816+0000","last_fullsized":"2024-05-10T08:45:34.365816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:38:19.772634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360846+0000","last_change":"2024-05-10T08:45:34.343708+0000","last_active":"2024-05-10T08:45:35.360846+0000","last_peered":"2024-05-10T08:45:35.360846+0000","last_clean":"2024-05-10T08:45:35.360846+0000","last_became_active":"2024-05-10T08:45:34.343368+0000","last_became_peered":"2024-05-10T08:45:34.343368+0000","last_unstale":"2024-05-10T08:45:35.360846+0000","last_undegraded":"2024-05-10T08:45:35.360846+0000","last_fullsized":"2024-05-10T08:45:35.360846+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:04.306971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331341+0000","last_change":"2024-05-10T08:45:34.345449+0000","last_active":"2024-05-10T08:45:35.331341+0000","last_peered":"2024-05-10T08:45:35.331341+0000","last_clean":"2024-05-10T08:45:35.331341+0000","last_became_active":"2024-05-10T08:45:34.345130+0000","last_became_peered":"2024-05-10T08:45:34.345130+0000","last_unstale":"2024-05-10T08:45:35.331341+0000","last_undegraded":"2024-05-10T08:45:35.331341+0000","last_fullsized":"2024-05-10T08:45:35.331341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:23.210960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.351505+0000","last_change":"2024-05-10T08:45:34.344857+0000","last_active":"2024-05-10T08:45:34.351505+0000","last_peered":"2024-05-10T08:45:34.351505+0000","last_clean":"2024-05-10T08:45:34.351505+0000","last_became_active":"2024-05-10T08:45:34.344518+0000","last_became_peered":"2024-05-10T08:45:34.344518+0000","last_unstale":"2024-05-10T08:45:34.351505+0000","last_undegraded":"2024-05-10T08:45:34.351505+0000","last_fullsized":"2024-05-10T08:45:34.351505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:29.635769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331353+0000","last_change":"2024-05-10T08:45:34.355518+0000","last_active":"2024-05-10T08:45:35.331353+0000","last_peered":"2024-05-10T08:45:35.331353+0000","last_clean":"2024-05-10T08:45:35.331353+0000","last_became_active":"2024-05-10T08:45:34.355246+0000","last_became_peered":"2024-05-10T08:45:34.355246+0000","last_unstale":"2024-05-10T08:45:35.331353+0000","last_undegraded":"2024-05-10T08:45:35.331353+0000","last_fullsized":"2024-05-10T08:45:35.331353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:33.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330615+0000","last_change":"2024-05-10T08:45:34.334860+0000","last_active":"2024-05-10T08:45:35.330615+0000","last_peered":"2024-05-10T08:45:35.330615+0000","last_clean":"2024-05-10T08:45:35.330615+0000","last_became_active":"2024-05-10T08:45:34.334548+0000","last_became_peered":"2024-05-10T08:45:34.334548+0000","last_unstale":"2024-05-10T08:45:35.330615+0000","last_undegraded":"2024-05-10T08:45:35.330615+0000","last_fullsized":"2024-05-10T08:45:35.330615+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:50.857830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330124+0000","last_change":"2024-05-10T08:45:34.341535+0000","last_active":"2024-05-10T08:45:35.330124+0000","last_peered":"2024-05-10T08:45:35.330124+0000","last_clean":"2024-05-10T08:45:35.330124+0000","last_became_active":"2024-05-10T08:45:34.340710+0000","last_became_peered":"2024-05-10T08:45:34.340710+0000","last_unstale":"2024-05-10T08:45:35.330124+0000","last_undegraded":"2024-05-10T08:45:35.330124+0000","last_fullsized":"2024-05-10T08:45:35.330124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:41:38.935586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360566+0000","last_change":"2024-05-10T08:45:34.346082+0000","last_active":"2024-05-10T08:45:35.360566+0000","last_peered":"2024-05-10T08:45:35.360566+0000","last_clean":"2024-05-10T08:45:35.360566+0000","last_became_active":"2024-05-10T08:45:34.345812+0000","last_became_peered":"2024-05-10T08:45:34.345812+0000","last_unstale":"2024-05-10T08:45:35.360566+0000","last_undegraded":"2024-05-10T08:45:35.360566+0000","last_fullsized":"2024-05-10T08:45:35.360566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.402626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360858+0000","last_change":"2024-05-10T08:45:34.358742+0000","last_active":"2024-05-10T08:45:34.360858+0000","last_peered":"2024-05-10T08:45:34.360858+0000","last_clean":"2024-05-10T08:45:34.360858+0000","last_became_active":"2024-05-10T08:45:34.358371+0000","last_became_peered":"2024-05-10T08:45:34.358371+0000","last_unstale":"2024-05-10T08:45:34.360858+0000","last_undegraded":"2024-05-10T08:45:34.360858+0000","last_fullsized":"2024-05-10T08:45:34.360858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:04.606532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360936+0000","last_change":"2024-05-10T08:45:34.358705+0000","last_active":"2024-05-10T08:45:34.360936+0000","last_peered":"2024-05-10T08:45:34.360936+0000","last_clean":"2024-05-10T08:45:34.360936+0000","last_became_active":"2024-05-10T08:45:34.358406+0000","last_became_peered":"2024-05-10T08:45:34.358406+0000","last_unstale":"2024-05-10T08:45:34.360936+0000","last_undegraded":"2024-05-10T08:45:34.360936+0000","last_fullsized":"2024-05-10T08:45:34.360936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:20:38.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.369727+0000","last_change":"2024-05-10T08:45:33.318754+0000","last_active":"2024-05-10T08:45:34.369727+0000","last_peered":"2024-05-10T08:45:34.369727+0000","last_clean":"2024-05-10T08:45:34.369727+0000","last_became_active":"2024-05-10T08:45:33.318478+0000","last_became_peered":"2024-05-10T08:45:33.318478+0000","last_unstale":"2024-05-10T08:45:34.369727+0000","last_undegraded":"2024-05-10T08:45:34.369727+0000","last_fullsized":"2024-05-10T08:45:34.369727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:05:04.446697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360920+0000","last_change":"2024-05-10T08:45:34.357356+0000","last_active":"2024-05-10T08:45:34.360920+0000","last_peered":"2024-05-10T08:45:34.360920+0000","last_clean":"2024-05-10T08:45:34.360920+0000","last_became_active":"2024-05-10T08:45:34.356857+0000","last_became_peered":"2024-05-10T08:45:34.356857+0000","last_unstale":"2024-05-10T08:45:34.360920+0000","last_undegraded":"2024-05-10T08:45:34.360920+0000","last_fullsized":"2024-05-10T08:45:34.360920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:28.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331485+0000","last_change":"2024-05-10T08:45:33.314573+0000","last_active":"2024-05-10T08:45:35.331485+0000","last_peered":"2024-05-10T08:45:35.331485+0000","last_clean":"2024-05-10T08:45:35.331485+0000","last_became_active":"2024-05-10T08:45:33.314292+0000","last_became_peered":"2024-05-10T08:45:33.314292+0000","last_unstale":"2024-05-10T08:45:35.331485+0000","last_undegraded":"2024-05-10T08:45:35.331485+0000","last_fullsized":"2024-05-10T08:45:35.331485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:36:11.458530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330330+0000","last_change":"2024-05-10T08:45:34.349377+0000","last_active":"2024-05-10T08:45:35.330330+0000","last_peered":"2024-05-10T08:45:35.330330+0000","last_clean":"2024-05-10T08:45:35.330330+0000","last_became_active":"2024-05-10T08:45:34.349088+0000","last_became_peered":"2024-05-10T08:45:34.349088+0000","last_unstale":"2024-05-10T08:45:35.330330+0000","last_undegraded":"2024-05-10T08:45:35.330330+0000","last_fullsized":"2024-05-10T08:45:35.330330+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:09:58.323076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330439+0000","last_change":"2024-05-10T08:45:33.318290+0000","last_active":"2024-05-10T08:45:35.330439+0000","last_peered":"2024-05-10T08:45:35.330439+0000","last_clean":"2024-05-10T08:45:35.330439+0000","last_became_active":"2024-05-10T08:45:33.317825+0000","last_became_peered":"2024-05-10T08:45:33.317825+0000","last_unstale":"2024-05-10T08:45:35.330439+0000","last_undegraded":"2024-05-10T08:45:35.330439+0000","last_fullsized":"2024-05-10T08:45:35.330439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:55.680335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356123+0000","last_change":"2024-05-10T08:45:34.355255+0000","last_active":"2024-05-10T08:45:34.356123+0000","last_peered":"2024-05-10T08:45:34.356123+0000","last_clean":"2024-05-10T08:45:34.356123+0000","last_became_active":"2024-05-10T08:45:34.354966+0000","last_became_peered":"2024-05-10T08:45:34.354966+0000","last_unstale":"2024-05-10T08:45:34.356123+0000","last_undegraded":"2024-05-10T08:45:34.356123+0000","last_fullsized":"2024-05-10T08:45:34.356123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:50.857830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.368600+0000","last_change":"2024-05-10T08:45:33.326272+0000","last_active":"2024-05-10T08:45:34.368600+0000","last_peered":"2024-05-10T08:45:34.368600+0000","last_clean":"2024-05-10T08:45:34.368600+0000","last_became_active":"2024-05-10T08:45:33.326019+0000","last_became_peered":"2024-05-10T08:45:33.326019+0000","last_unstale":"2024-05-10T08:45:34.368600+0000","last_undegraded":"2024-05-10T08:45:34.368600+0000","last_fullsized":"2024-05-10T08:45:34.368600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:29.548953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330858+0000","last_change":"2024-05-10T08:45:34.345814+0000","last_active":"2024-05-10T08:45:35.330858+0000","last_peered":"2024-05-10T08:45:35.330858+0000","last_clean":"2024-05-10T08:45:35.330858+0000","last_became_active":"2024-05-10T08:45:34.345539+0000","last_became_peered":"2024-05-10T08:45:34.345539+0000","last_unstale":"2024-05-10T08:45:35.330858+0000","last_undegraded":"2024-05-10T08:45:35.330858+0000","last_fullsized":"2024-05-10T08:45:35.330858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:21.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330515+0000","last_change":"2024-05-10T08:45:33.313586+0000","last_active":"2024-05-10T08:45:35.330515+0000","last_peered":"2024-05-10T08:45:35.330515+0000","last_clean":"2024-05-10T08:45:35.330515+0000","last_became_active":"2024-05-10T08:45:33.313262+0000","last_became_peered":"2024-05-10T08:45:33.313262+0000","last_unstale":"2024-05-10T08:45:35.330515+0000","last_undegraded":"2024-05-10T08:45:35.330515+0000","last_fullsized":"2024-05-10T08:45:35.330515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:36:57.565855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356703+0000","last_change":"2024-05-10T08:45:34.353158+0000","last_active":"2024-05-10T08:45:34.356703+0000","last_peered":"2024-05-10T08:45:34.356703+0000","last_clean":"2024-05-10T08:45:34.356703+0000","last_became_active":"2024-05-10T08:45:34.352891+0000","last_became_peered":"2024-05-10T08:45:34.352891+0000","last_unstale":"2024-05-10T08:45:34.356703+0000","last_undegraded":"2024-05-10T08:45:34.356703+0000","last_fullsized":"2024-05-10T08:45:34.356703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:21.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331508+0000","last_change":"2024-05-10T08:45:33.313010+0000","last_active":"2024-05-10T08:45:35.331508+0000","last_peered":"2024-05-10T08:45:35.331508+0000","last_clean":"2024-05-10T08:45:35.331508+0000","last_became_active":"2024-05-10T08:45:33.312733+0000","last_became_peered":"2024-05-10T08:45:33.312733+0000","last_unstale":"2024-05-10T08:45:35.331508+0000","last_undegraded":"2024-05-10T08:45:35.331508+0000","last_fullsized":"2024-05-10T08:45:35.331508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:46.753596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.361815+0000","last_change":"2024-05-10T08:45:34.360056+0000","last_active":"2024-05-10T08:45:34.361815+0000","last_peered":"2024-05-10T08:45:34.361815+0000","last_clean":"2024-05-10T08:45:34.361815+0000","last_became_active":"2024-05-10T08:45:34.359418+0000","last_became_peered":"2024-05-10T08:45:34.359418+0000","last_unstale":"2024-05-10T08:45:34.361815+0000","last_undegraded":"2024-05-10T08:45:34.361815+0000","last_fullsized":"2024-05-10T08:45:34.361815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:34.467761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338476+0000","last_change":"2024-05-10T08:45:33.311985+0000","last_active":"2024-05-10T08:45:34.338476+0000","last_peered":"2024-05-10T08:45:34.338476+0000","last_clean":"2024-05-10T08:45:34.338476+0000","last_became_active":"2024-05-10T08:45:33.311666+0000","last_became_peered":"2024-05-10T08:45:33.311666+0000","last_unstale":"2024-05-10T08:45:34.338476+0000","last_undegraded":"2024-05-10T08:45:34.338476+0000","last_fullsized":"2024-05-10T08:45:34.338476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:07.489966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331056+0000","last_change":"2024-05-10T08:45:34.348297+0000","last_active":"2024-05-10T08:45:35.331056+0000","last_peered":"2024-05-10T08:45:35.331056+0000","last_clean":"2024-05-10T08:45:35.331056+0000","last_became_active":"2024-05-10T08:45:34.348031+0000","last_became_peered":"2024-05-10T08:45:34.348031+0000","last_unstale":"2024-05-10T08:45:35.331056+0000","last_undegraded":"2024-05-10T08:45:35.331056+0000","last_fullsized":"2024-05-10T08:45:35.331056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:36.090231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329934+0000","last_change":"2024-05-10T08:45:33.319388+0000","last_active":"2024-05-10T08:45:35.329934+0000","last_peered":"2024-05-10T08:45:35.329934+0000","last_clean":"2024-05-10T08:45:35.329934+0000","last_became_active":"2024-05-10T08:45:33.318986+0000","last_became_peered":"2024-05-10T08:45:33.318986+0000","last_unstale":"2024-05-10T08:45:35.329934+0000","last_undegraded":"2024-05-10T08:45:35.329934+0000","last_fullsized":"2024-05-10T08:45:35.329934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:46:32.610453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331357+0000","last_change":"2024-05-10T08:45:34.346691+0000","last_active":"2024-05-10T08:45:35.331357+0000","last_peered":"2024-05-10T08:45:35.331357+0000","last_clean":"2024-05-10T08:45:35.331357+0000","last_became_active":"2024-05-10T08:45:34.346404+0000","last_became_peered":"2024-05-10T08:45:34.346404+0000","last_unstale":"2024-05-10T08:45:35.331357+0000","last_undegraded":"2024-05-10T08:45:35.331357+0000","last_fullsized":"2024-05-10T08:45:35.331357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.402626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360926+0000","last_change":"2024-05-10T08:45:33.315278+0000","last_active":"2024-05-10T08:45:35.360926+0000","last_peered":"2024-05-10T08:45:35.360926+0000","last_clean":"2024-05-10T08:45:35.360926+0000","last_became_active":"2024-05-10T08:45:33.315018+0000","last_became_peered":"2024-05-10T08:45:33.315018+0000","last_unstale":"2024-05-10T08:45:35.360926+0000","last_undegraded":"2024-05-10T08:45:35.360926+0000","last_fullsized":"2024-05-10T08:45:35.360926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:47:49.990411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330390+0000","last_change":"2024-05-10T08:45:34.334394+0000","last_active":"2024-05-10T08:45:35.330390+0000","last_peered":"2024-05-10T08:45:35.330390+0000","last_clean":"2024-05-10T08:45:35.330390+0000","last_became_active":"2024-05-10T08:45:34.334047+0000","last_became_peered":"2024-05-10T08:45:34.334047+0000","last_unstale":"2024-05-10T08:45:35.330390+0000","last_undegraded":"2024-05-10T08:45:35.330390+0000","last_fullsized":"2024-05-10T08:45:35.330390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:08.496895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338611+0000","last_change":"2024-05-10T08:45:33.318410+0000","last_active":"2024-05-10T08:45:34.338611+0000","last_peered":"2024-05-10T08:45:34.338611+0000","last_clean":"2024-05-10T08:45:34.338611+0000","last_became_active":"2024-05-10T08:45:33.317872+0000","last_became_peered":"2024-05-10T08:45:33.317872+0000","last_unstale":"2024-05-10T08:45:34.338611+0000","last_undegraded":"2024-05-10T08:45:34.338611+0000","last_fullsized":"2024-05-10T08:45:34.338611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:59:49.850901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.354015+0000","last_change":"2024-05-10T08:45:34.350252+0000","last_active":"2024-05-10T08:45:34.354015+0000","last_peered":"2024-05-10T08:45:34.354015+0000","last_clean":"2024-05-10T08:45:34.354015+0000","last_became_active":"2024-05-10T08:45:34.349973+0000","last_became_peered":"2024-05-10T08:45:34.349973+0000","last_unstale":"2024-05-10T08:45:34.354015+0000","last_undegraded":"2024-05-10T08:45:34.354015+0000","last_fullsized":"2024-05-10T08:45:34.354015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:47.617708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331569+0000","last_change":"2024-05-10T08:45:33.319440+0000","last_active":"2024-05-10T08:45:35.331569+0000","last_peered":"2024-05-10T08:45:35.331569+0000","last_clean":"2024-05-10T08:45:35.331569+0000","last_became_active":"2024-05-10T08:45:33.318902+0000","last_became_peered":"2024-05-10T08:45:33.318902+0000","last_unstale":"2024-05-10T08:45:35.331569+0000","last_undegraded":"2024-05-10T08:45:35.331569+0000","last_fullsized":"2024-05-10T08:45:35.331569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:37:24.672043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331354+0000","last_change":"2024-05-10T08:45:34.357535+0000","last_active":"2024-05-10T08:45:35.331354+0000","last_peered":"2024-05-10T08:45:35.331354+0000","last_clean":"2024-05-10T08:45:35.331354+0000","last_became_active":"2024-05-10T08:45:34.357255+0000","last_became_peered":"2024-05-10T08:45:34.357255+0000","last_unstale":"2024-05-10T08:45:35.331354+0000","last_undegraded":"2024-05-10T08:45:35.331354+0000","last_fullsized":"2024-05-10T08:45:35.331354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.687264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.375500+0000","last_change":"2024-05-10T08:45:33.321690+0000","last_active":"2024-05-10T08:45:34.375500+0000","last_peered":"2024-05-10T08:45:34.375500+0000","last_clean":"2024-05-10T08:45:34.375500+0000","last_became_active":"2024-05-10T08:45:33.321409+0000","last_became_peered":"2024-05-10T08:45:33.321409+0000","last_unstale":"2024-05-10T08:45:34.375500+0000","last_undegraded":"2024-05-10T08:45:34.375500+0000","last_fullsized":"2024-05-10T08:45:34.375500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:07.489966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331013+0000","last_change":"2024-05-10T08:45:34.350779+0000","last_active":"2024-05-10T08:45:35.331013+0000","last_peered":"2024-05-10T08:45:35.331013+0000","last_clean":"2024-05-10T08:45:35.331013+0000","last_became_active":"2024-05-10T08:45:34.350518+0000","last_became_peered":"2024-05-10T08:45:34.350518+0000","last_unstale":"2024-05-10T08:45:35.331013+0000","last_undegraded":"2024-05-10T08:45:35.331013+0000","last_fullsized":"2024-05-10T08:45:35.331013+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.402626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330728+0000","last_change":"2024-05-10T08:45:33.324741+0000","last_active":"2024-05-10T08:45:35.330728+0000","last_peered":"2024-05-10T08:45:35.330728+0000","last_clean":"2024-05-10T08:45:35.330728+0000","last_became_active":"2024-05-10T08:45:33.324444+0000","last_became_peered":"2024-05-10T08:45:33.324444+0000","last_unstale":"2024-05-10T08:45:35.330728+0000","last_undegraded":"2024-05-10T08:45:35.330728+0000","last_fullsized":"2024-05-10T08:45:35.330728+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:03.300041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.329920+0000","last_change":"2024-05-10T08:45:34.341987+0000","last_active":"2024-05-10T08:45:35.329920+0000","last_peered":"2024-05-10T08:45:35.329920+0000","last_clean":"2024-05-10T08:45:35.329920+0000","last_became_active":"2024-05-10T08:45:34.341700+0000","last_became_peered":"2024-05-10T08:45:34.341700+0000","last_unstale":"2024-05-10T08:45:35.329920+0000","last_undegraded":"2024-05-10T08:45:35.329920+0000","last_fullsized":"2024-05-10T08:45:35.329920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:47:50.997341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.352356+0000","last_change":"2024-05-10T08:45:33.321087+0000","last_active":"2024-05-10T08:45:34.352356+0000","last_peered":"2024-05-10T08:45:34.352356+0000","last_clean":"2024-05-10T08:45:34.352356+0000","last_became_active":"2024-05-10T08:45:33.320791+0000","last_became_peered":"2024-05-10T08:45:33.320791+0000","last_unstale":"2024-05-10T08:45:34.352356+0000","last_undegraded":"2024-05-10T08:45:34.352356+0000","last_fullsized":"2024-05-10T08:45:34.352356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:09:57.316147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.353525+0000","last_change":"2024-05-10T08:45:34.346053+0000","last_active":"2024-05-10T08:45:34.353525+0000","last_peered":"2024-05-10T08:45:34.353525+0000","last_clean":"2024-05-10T08:45:34.353525+0000","last_became_active":"2024-05-10T08:45:34.345750+0000","last_became_peered":"2024-05-10T08:45:34.345750+0000","last_unstale":"2024-05-10T08:45:34.353525+0000","last_undegraded":"2024-05-10T08:45:34.353525+0000","last_fullsized":"2024-05-10T08:45:34.353525+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:01.902616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331096+0000","last_change":"2024-05-10T08:45:33.317151+0000","last_active":"2024-05-10T08:45:35.331096+0000","last_peered":"2024-05-10T08:45:35.331096+0000","last_clean":"2024-05-10T08:45:35.331096+0000","last_became_active":"2024-05-10T08:45:33.316864+0000","last_became_peered":"2024-05-10T08:45:33.316864+0000","last_unstale":"2024-05-10T08:45:35.331096+0000","last_undegraded":"2024-05-10T08:45:35.331096+0000","last_fullsized":"2024-05-10T08:45:35.331096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:05:48.826225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338052+0000","last_change":"2024-05-10T08:45:34.336560+0000","last_active":"2024-05-10T08:45:34.338052+0000","last_peered":"2024-05-10T08:45:34.338052+0000","last_clean":"2024-05-10T08:45:34.338052+0000","last_became_active":"2024-05-10T08:45:34.336259+0000","last_became_peered":"2024-05-10T08:45:34.336259+0000","last_unstale":"2024-05-10T08:45:34.338052+0000","last_undegraded":"2024-05-10T08:45:34.338052+0000","last_fullsized":"2024-05-10T08:45:34.338052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:05:23.898470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331143+0000","last_change":"2024-05-10T08:45:33.312218+0000","last_active":"2024-05-10T08:45:35.331143+0000","last_peered":"2024-05-10T08:45:35.331143+0000","last_clean":"2024-05-10T08:45:35.331143+0000","last_became_active":"2024-05-10T08:45:33.311812+0000","last_became_peered":"2024-05-10T08:45:33.311812+0000","last_unstale":"2024-05-10T08:45:35.331143+0000","last_undegraded":"2024-05-10T08:45:35.331143+0000","last_fullsized":"2024-05-10T08:45:35.331143+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:28.755465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359606+0000","last_change":"2024-05-10T08:45:34.357233+0000","last_active":"2024-05-10T08:45:34.359606+0000","last_peered":"2024-05-10T08:45:34.359606+0000","last_clean":"2024-05-10T08:45:34.359606+0000","last_became_active":"2024-05-10T08:45:34.356947+0000","last_became_peered":"2024-05-10T08:45:34.356947+0000","last_unstale":"2024-05-10T08:45:34.359606+0000","last_undegraded":"2024-05-10T08:45:34.359606+0000","last_fullsized":"2024-05-10T08:45:34.359606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:03:15.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.368347+0000","last_change":"2024-05-10T08:45:33.315956+0000","last_active":"2024-05-10T08:45:34.368347+0000","last_peered":"2024-05-10T08:45:34.368347+0000","last_clean":"2024-05-10T08:45:34.368347+0000","last_became_active":"2024-05-10T08:45:33.315643+0000","last_became_peered":"2024-05-10T08:45:33.315643+0000","last_unstale":"2024-05-10T08:45:34.368347+0000","last_undegraded":"2024-05-10T08:45:34.368347+0000","last_fullsized":"2024-05-10T08:45:34.368347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:47:49.990411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.346057+0000","last_change":"2024-05-10T08:45:34.341995+0000","last_active":"2024-05-10T08:45:34.346057+0000","last_peered":"2024-05-10T08:45:34.346057+0000","last_clean":"2024-05-10T08:45:34.346057+0000","last_became_active":"2024-05-10T08:45:34.341667+0000","last_became_peered":"2024-05-10T08:45:34.341667+0000","last_unstale":"2024-05-10T08:45:34.346057+0000","last_undegraded":"2024-05-10T08:45:34.346057+0000","last_fullsized":"2024-05-10T08:45:34.346057+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.298479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330440+0000","last_change":"2024-05-10T08:45:33.315585+0000","last_active":"2024-05-10T08:45:35.330440+0000","last_peered":"2024-05-10T08:45:35.330440+0000","last_clean":"2024-05-10T08:45:35.330440+0000","last_became_active":"2024-05-10T08:45:33.314835+0000","last_became_peered":"2024-05-10T08:45:33.314835+0000","last_unstale":"2024-05-10T08:45:35.330440+0000","last_undegraded":"2024-05-10T08:45:35.330440+0000","last_fullsized":"2024-05-10T08:45:35.330440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:07.336368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331519+0000","last_change":"2024-05-10T08:45:34.335545+0000","last_active":"2024-05-10T08:45:35.331519+0000","last_peered":"2024-05-10T08:45:35.331519+0000","last_clean":"2024-05-10T08:45:35.331519+0000","last_became_active":"2024-05-10T08:45:34.334731+0000","last_became_peered":"2024-05-10T08:45:34.334731+0000","last_unstale":"2024-05-10T08:45:35.331519+0000","last_undegraded":"2024-05-10T08:45:35.331519+0000","last_fullsized":"2024-05-10T08:45:35.331519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:04.306971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331639+0000","last_change":"2024-05-10T08:45:33.321253+0000","last_active":"2024-05-10T08:45:35.331639+0000","last_peered":"2024-05-10T08:45:35.331639+0000","last_clean":"2024-05-10T08:45:35.331639+0000","last_became_active":"2024-05-10T08:45:33.320989+0000","last_became_peered":"2024-05-10T08:45:33.320989+0000","last_unstale":"2024-05-10T08:45:35.331639+0000","last_undegraded":"2024-05-10T08:45:35.331639+0000","last_fullsized":"2024-05-10T08:45:35.331639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:23.361592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.368583+0000","last_change":"2024-05-10T08:45:34.364324+0000","last_active":"2024-05-10T08:45:34.368583+0000","last_peered":"2024-05-10T08:45:34.368583+0000","last_clean":"2024-05-10T08:45:34.368583+0000","last_became_active":"2024-05-10T08:45:34.363998+0000","last_became_peered":"2024-05-10T08:45:34.363998+0000","last_unstale":"2024-05-10T08:45:34.368583+0000","last_undegraded":"2024-05-10T08:45:34.368583+0000","last_fullsized":"2024-05-10T08:45:34.368583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:09:24.380041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360649+0000","last_change":"2024-05-10T08:45:33.319986+0000","last_active":"2024-05-10T08:45:35.360649+0000","last_peered":"2024-05-10T08:45:35.360649+0000","last_clean":"2024-05-10T08:45:35.360649+0000","last_became_active":"2024-05-10T08:45:33.319639+0000","last_became_peered":"2024-05-10T08:45:33.319639+0000","last_unstale":"2024-05-10T08:45:35.360649+0000","last_undegraded":"2024-05-10T08:45:35.360649+0000","last_fullsized":"2024-05-10T08:45:35.360649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:29.548953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360582+0000","last_change":"2024-05-10T08:45:34.346908+0000","last_active":"2024-05-10T08:45:35.360582+0000","last_peered":"2024-05-10T08:45:35.360582+0000","last_clean":"2024-05-10T08:45:35.360582+0000","last_became_active":"2024-05-10T08:45:34.346629+0000","last_became_peered":"2024-05-10T08:45:34.346629+0000","last_unstale":"2024-05-10T08:45:35.360582+0000","last_undegraded":"2024-05-10T08:45:35.360582+0000","last_fullsized":"2024-05-10T08:45:35.360582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:47.617239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.333325+0000","last_change":"2024-05-10T08:45:33.323051+0000","last_active":"2024-05-10T08:45:34.333325+0000","last_peered":"2024-05-10T08:45:34.333325+0000","last_clean":"2024-05-10T08:45:34.333325+0000","last_became_active":"2024-05-10T08:45:33.322627+0000","last_became_peered":"2024-05-10T08:45:33.322627+0000","last_unstale":"2024-05-10T08:45:34.333325+0000","last_undegraded":"2024-05-10T08:45:34.333325+0000","last_fullsized":"2024-05-10T08:45:34.333325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:46:08.300342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360612+0000","last_change":"2024-05-10T08:45:34.358677+0000","last_active":"2024-05-10T08:45:35.360612+0000","last_peered":"2024-05-10T08:45:35.360612+0000","last_clean":"2024-05-10T08:45:35.360612+0000","last_became_active":"2024-05-10T08:45:34.358424+0000","last_became_peered":"2024-05-10T08:45:34.358424+0000","last_unstale":"2024-05-10T08:45:35.360612+0000","last_undegraded":"2024-05-10T08:45:35.360612+0000","last_fullsized":"2024-05-10T08:45:35.360612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:36.090231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360713+0000","last_change":"2024-05-10T08:45:33.320526+0000","last_active":"2024-05-10T08:45:35.360713+0000","last_peered":"2024-05-10T08:45:35.360713+0000","last_clean":"2024-05-10T08:45:35.360713+0000","last_became_active":"2024-05-10T08:45:33.320272+0000","last_became_peered":"2024-05-10T08:45:33.320272+0000","last_unstale":"2024-05-10T08:45:35.360713+0000","last_undegraded":"2024-05-10T08:45:35.360713+0000","last_fullsized":"2024-05-10T08:45:35.360713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:57.767637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.358187+0000","last_change":"2024-05-10T08:45:34.355356+0000","last_active":"2024-05-10T08:45:34.358187+0000","last_peered":"2024-05-10T08:45:34.358187+0000","last_clean":"2024-05-10T08:45:34.358187+0000","last_became_active":"2024-05-10T08:45:34.355071+0000","last_became_peered":"2024-05-10T08:45:34.355071+0000","last_unstale":"2024-05-10T08:45:34.358187+0000","last_undegraded":"2024-05-10T08:45:34.358187+0000","last_fullsized":"2024-05-10T08:45:34.358187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:13.875011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.332659+0000","last_change":"2024-05-10T08:45:33.316161+0000","last_active":"2024-05-10T08:45:34.332659+0000","last_peered":"2024-05-10T08:45:34.332659+0000","last_clean":"2024-05-10T08:45:34.332659+0000","last_became_active":"2024-05-10T08:45:33.315869+0000","last_became_peered":"2024-05-10T08:45:33.315869+0000","last_unstale":"2024-05-10T08:45:34.332659+0000","last_undegraded":"2024-05-10T08:45:34.332659+0000","last_fullsized":"2024-05-10T08:45:34.332659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:59.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.348542+0000","last_change":"2024-05-10T08:45:34.344640+0000","last_active":"2024-05-10T08:45:34.348542+0000","last_peered":"2024-05-10T08:45:34.348542+0000","last_clean":"2024-05-10T08:45:34.348542+0000","last_became_active":"2024-05-10T08:45:34.344342+0000","last_became_peered":"2024-05-10T08:45:34.344342+0000","last_unstale":"2024-05-10T08:45:34.348542+0000","last_undegraded":"2024-05-10T08:45:34.348542+0000","last_fullsized":"2024-05-10T08:45:34.348542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:18.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330848+0000","last_change":"2024-05-10T08:45:33.313899+0000","last_active":"2024-05-10T08:45:35.330848+0000","last_peered":"2024-05-10T08:45:35.330848+0000","last_clean":"2024-05-10T08:45:35.330848+0000","last_became_active":"2024-05-10T08:45:33.313631+0000","last_became_peered":"2024-05-10T08:45:33.313631+0000","last_unstale":"2024-05-10T08:45:35.330848+0000","last_undegraded":"2024-05-10T08:45:35.330848+0000","last_fullsized":"2024-05-10T08:45:35.330848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:54:17.933687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.360901+0000","last_change":"2024-05-10T08:45:34.357298+0000","last_active":"2024-05-10T08:45:34.360901+0000","last_peered":"2024-05-10T08:45:34.360901+0000","last_clean":"2024-05-10T08:45:34.360901+0000","last_became_active":"2024-05-10T08:45:34.356977+0000","last_became_peered":"2024-05-10T08:45:34.356977+0000","last_unstale":"2024-05-10T08:45:34.360901+0000","last_undegraded":"2024-05-10T08:45:34.360901+0000","last_fullsized":"2024-05-10T08:45:34.360901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:38:19.772634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"87'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360139+0000","last_change":"2024-05-10T08:45:33.316749+0000","last_active":"2024-05-10T08:45:35.360139+0000","last_peered":"2024-05-10T08:45:35.360139+0000","last_clean":"2024-05-10T08:45:35.360139+0000","last_became_active":"2024-05-10T08:45:33.316470+0000","last_became_peered":"2024-05-10T08:45:33.316470+0000","last_unstale":"2024-05-10T08:45:35.360139+0000","last_undegraded":"2024-05-10T08:45:35.360139+0000","last_fullsized":"2024-05-10T08:45:35.360139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.818144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359455+0000","last_change":"2024-05-10T08:45:34.357091+0000","last_active":"2024-05-10T08:45:34.359455+0000","last_peered":"2024-05-10T08:45:34.359455+0000","last_clean":"2024-05-10T08:45:34.359455+0000","last_became_active":"2024-05-10T08:45:34.356769+0000","last_became_peered":"2024-05-10T08:45:34.356769+0000","last_unstale":"2024-05-10T08:45:34.359455+0000","last_undegraded":"2024-05-10T08:45:34.359455+0000","last_fullsized":"2024-05-10T08:45:34.359455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:53:11.132194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331667+0000","last_change":"2024-05-10T08:45:33.319179+0000","last_active":"2024-05-10T08:45:35.331667+0000","last_peered":"2024-05-10T08:45:35.331667+0000","last_clean":"2024-05-10T08:45:35.331667+0000","last_became_active":"2024-05-10T08:45:33.318534+0000","last_became_peered":"2024-05-10T08:45:33.318534+0000","last_unstale":"2024-05-10T08:45:35.331667+0000","last_undegraded":"2024-05-10T08:45:35.331667+0000","last_fullsized":"2024-05-10T08:45:35.331667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:57:18.040729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360850+0000","last_change":"2024-05-10T08:45:34.350072+0000","last_active":"2024-05-10T08:45:35.360850+0000","last_peered":"2024-05-10T08:45:35.360850+0000","last_clean":"2024-05-10T08:45:35.360850+0000","last_became_active":"2024-05-10T08:45:34.349804+0000","last_became_peered":"2024-05-10T08:45:34.349804+0000","last_unstale":"2024-05-10T08:45:35.360850+0000","last_undegraded":"2024-05-10T08:45:35.360850+0000","last_fullsized":"2024-05-10T08:45:35.360850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:55:08.343298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.340035+0000","last_change":"2024-05-10T08:45:33.318225+0000","last_active":"2024-05-10T08:45:34.340035+0000","last_peered":"2024-05-10T08:45:34.340035+0000","last_clean":"2024-05-10T08:45:34.340035+0000","last_became_active":"2024-05-10T08:45:33.317956+0000","last_became_peered":"2024-05-10T08:45:33.317956+0000","last_unstale":"2024-05-10T08:45:34.340035+0000","last_undegraded":"2024-05-10T08:45:34.340035+0000","last_fullsized":"2024-05-10T08:45:34.340035+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:57.767637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.357555+0000","last_change":"2024-05-10T08:45:34.353365+0000","last_active":"2024-05-10T08:45:34.357555+0000","last_peered":"2024-05-10T08:45:34.357555+0000","last_clean":"2024-05-10T08:45:34.357555+0000","last_became_active":"2024-05-10T08:45:34.353044+0000","last_became_peered":"2024-05-10T08:45:34.353044+0000","last_unstale":"2024-05-10T08:45:34.357555+0000","last_undegraded":"2024-05-10T08:45:34.357555+0000","last_fullsized":"2024-05-10T08:45:34.357555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:16.667749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.352398+0000","last_change":"2024-05-10T08:45:33.323008+0000","last_active":"2024-05-10T08:45:34.352398+0000","last_peered":"2024-05-10T08:45:34.352398+0000","last_clean":"2024-05-10T08:45:34.352398+0000","last_became_active":"2024-05-10T08:45:33.322051+0000","last_became_peered":"2024-05-10T08:45:33.322051+0000","last_unstale":"2024-05-10T08:45:34.352398+0000","last_undegraded":"2024-05-10T08:45:34.352398+0000","last_fullsized":"2024-05-10T08:45:34.352398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:58.406236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.347411+0000","last_change":"2024-05-10T08:45:34.344246+0000","last_active":"2024-05-10T08:45:34.347411+0000","last_peered":"2024-05-10T08:45:34.347411+0000","last_clean":"2024-05-10T08:45:34.347411+0000","last_became_active":"2024-05-10T08:45:34.343946+0000","last_became_peered":"2024-05-10T08:45:34.343946+0000","last_unstale":"2024-05-10T08:45:34.347411+0000","last_undegraded":"2024-05-10T08:45:34.347411+0000","last_fullsized":"2024-05-10T08:45:34.347411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:13.875011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.360654+0000","last_change":"2024-05-10T08:45:33.319852+0000","last_active":"2024-05-10T08:45:35.360654+0000","last_peered":"2024-05-10T08:45:35.360654+0000","last_clean":"2024-05-10T08:45:35.360654+0000","last_became_active":"2024-05-10T08:45:33.319548+0000","last_became_peered":"2024-05-10T08:45:33.319548+0000","last_unstale":"2024-05-10T08:45:35.360654+0000","last_undegraded":"2024-05-10T08:45:35.360654+0000","last_fullsized":"2024-05-10T08:45:35.360654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:05:04.446697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.356678+0000","last_change":"2024-05-10T08:45:34.351684+0000","last_active":"2024-05-10T08:45:34.356678+0000","last_peered":"2024-05-10T08:45:34.356678+0000","last_clean":"2024-05-10T08:45:34.356678+0000","last_became_active":"2024-05-10T08:45:34.351368+0000","last_became_peered":"2024-05-10T08:45:34.351368+0000","last_unstale":"2024-05-10T08:45:34.356678+0000","last_undegraded":"2024-05-10T08:45:34.356678+0000","last_fullsized":"2024-05-10T08:45:34.356678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:29.831005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.338392+0000","last_change":"2024-05-10T08:45:33.312942+0000","last_active":"2024-05-10T08:45:34.338392+0000","last_peered":"2024-05-10T08:45:34.338392+0000","last_clean":"2024-05-10T08:45:34.338392+0000","last_became_active":"2024-05-10T08:45:33.312665+0000","last_became_peered":"2024-05-10T08:45:33.312665+0000","last_unstale":"2024-05-10T08:45:34.338392+0000","last_undegraded":"2024-05-10T08:45:34.338392+0000","last_fullsized":"2024-05-10T08:45:34.338392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:04:29.051628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T08:45:34.359521+0000","last_change":"2024-05-10T08:45:34.356720+0000","last_active":"2024-05-10T08:45:34.359521+0000","last_peered":"2024-05-10T08:45:34.359521+0000","last_clean":"2024-05-10T08:45:34.359521+0000","last_became_active":"2024-05-10T08:45:34.356441+0000","last_became_peered":"2024-05-10T08:45:34.356441+0000","last_unstale":"2024-05-10T08:45:34.359521+0000","last_undegraded":"2024-05-10T08:45:34.359521+0000","last_fullsized":"2024-05-10T08:45:34.359521+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:50.289888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330067+0000","last_change":"2024-05-10T08:45:33.317551+0000","last_active":"2024-05-10T08:45:35.330067+0000","last_peered":"2024-05-10T08:45:35.330067+0000","last_clean":"2024-05-10T08:45:35.330067+0000","last_became_active":"2024-05-10T08:45:33.317359+0000","last_became_peered":"2024-05-10T08:45:33.317359+0000","last_unstale":"2024-05-10T08:45:35.330067+0000","last_undegraded":"2024-05-10T08:45:35.330067+0000","last_fullsized":"2024-05-10T08:45:35.330067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:04:26.863845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330788+0000","last_change":"2024-05-10T08:45:34.346988+0000","last_active":"2024-05-10T08:45:35.330788+0000","last_peered":"2024-05-10T08:45:35.330788+0000","last_clean":"2024-05-10T08:45:35.330788+0000","last_became_active":"2024-05-10T08:45:34.346581+0000","last_became_peered":"2024-05-10T08:45:34.346581+0000","last_unstale":"2024-05-10T08:45:35.330788+0000","last_undegraded":"2024-05-10T08:45:35.330788+0000","last_fullsized":"2024-05-10T08:45:35.330788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:33.298679+0000","last_clean_scrub_stamp":"2024-05-10T08:45:33.298679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:13.875011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.331438+0000","last_change":"2024-05-10T08:45:33.322875+0000","last_active":"2024-05-10T08:45:35.331438+0000","last_peered":"2024-05-10T08:45:35.331438+0000","last_clean":"2024-05-10T08:45:35.331438+0000","last_became_active":"2024-05-10T08:45:33.322478+0000","last_became_peered":"2024-05-10T08:45:33.322478+0000","last_unstale":"2024-05-10T08:45:35.331438+0000","last_undegraded":"2024-05-10T08:45:35.331438+0000","last_fullsized":"2024-05-10T08:45:35.331438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:45:32.291750+0000","last_clean_scrub_stamp":"2024-05-10T08:45:32.291750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:24.826504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":234,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T08:45:35.330128+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:45:35.330128+0000","last_peered":"2024-05-10T08:45:35.330128+0000","last_clean":"2024-05-10T08:45:35.330128+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:45:35.330128+0000","last_undegraded":"2024-05-10T08:45:35.330128+0000","last_fullsized":"2024-05-10T08:45:35.330128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1662976,"data_stored":1074777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1081344,"data_stored":486569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":484353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":484513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":484353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":484353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":484423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1679360,"data_stored":1077039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:45:38.745 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:45:38.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T08:45:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.894+0000 7fd450f14640 1 Processor -- start 2024-05-10T08:45:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.894+0000 7fd450f14640 1 -- start start 2024-05-10T08:45:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd450f14640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd44c15f380 0x7fd44c0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd450f14640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44c0b1c90 con 0x7fd44c0d2600 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd450f14640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44c0d0a50 con 0x7fd44c0b3f30 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd450f14640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd44c0d2a00 con 0x7fd44c15f380 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd44a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd44c15f380 0x7fd44c0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd44a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd44c15f380 0x7fd44c0d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49194/0 (socket says 172.21.15.37:49194) 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd44a59c640 1 -- 172.21.15.37:0/1515196301 learned_addr learned my addr 172.21.15.37:0/1515196301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd44a59c640 1 -- 172.21.15.37:0/1515196301 >> v1:172.21.15.82:6789/0 conn(0x7fd44c0b3f30 legacy=0x7fd44c0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd44a59c640 1 -- 172.21.15.37:0/1515196301 >> v1:172.21.15.37:6789/0 conn(0x7fd44c0d2600 legacy=0x7fd44c0b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd44959a640 1 -- 172.21.15.37:0/1515196301 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537437996 0 0) 0x7fd44c0b1c90 con 0x7fd44c0d2600 2024-05-10T08:45:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.895+0000 7fd44a59c640 1 -- 172.21.15.37:0/1515196301 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c0d0d30 con 0x7fd44c15f380 2024-05-10T08:45:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.896+0000 7fd44a59c640 1 --2- 172.21.15.37:0/1515196301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c15f380 0x7fd44c0d35c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009870 tx=0x7fd43c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501eb0575d1d1893 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.896+0000 7fd44959a640 1 -- 172.21.15.37:0/1515196301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c037070 con 0x7fd44c15f380 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.896+0000 7fd44959a640 1 -- 172.21.15.37:0/1515196301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c032440 con 0x7fd44c15f380 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.896+0000 7fd44959a640 1 -- 172.21.15.37:0/1515196301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c032810 con 0x7fd44c15f380 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.897+0000 7fd450f14640 1 -- 172.21.15.37:0/1515196301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c15f380 msgr2=0x7fd44c0d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.897+0000 7fd450f14640 1 --2- 172.21.15.37:0/1515196301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c15f380 0x7fd44c0d35c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009870 tx=0x7fd43c02a2a0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.897+0000 7fd450f14640 1 -- 172.21.15.37:0/1515196301 shutdown_connections 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.897+0000 7fd450f14640 1 --2- 172.21.15.37:0/1515196301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c15f380 0x7fd44c0d35c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.897+0000 7fd450f14640 1 -- 172.21.15.37:0/1515196301 >> 172.21.15.37:0/1515196301 conn(0x7fd44c0d4fe0 msgr2=0x7fd44c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.897+0000 7fd450f14640 1 -- 172.21.15.37:0/1515196301 shutdown_connections 2024-05-10T08:45:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.897+0000 7fd450f14640 1 -- 172.21.15.37:0/1515196301 wait complete. 2024-05-10T08:45:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.898+0000 7fd450f14640 1 Processor -- start 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.898+0000 7fd450f14640 1 -- start start 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd450f14640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44c0b3f30 0x7fd44c15fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd450f14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c0d2600 0x7fd44c15ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd450f14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd44c15f380 0x7fd44c1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd450f14640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c0d1010 con 0x7fd44c0d2600 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd450f14640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c15f760 con 0x7fd44c15f380 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd450f14640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c0d06e0 con 0x7fd44c0b3f30 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd449d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c0d2600 0x7fd44c15ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd449d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c0d2600 0x7fd44c15ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49200/0 (socket says 172.21.15.37:49200) 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd449d9b640 1 -- 172.21.15.37:0/4067696961 learned_addr learned my addr 172.21.15.37:0/4067696961 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd44a59c640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44c0b3f30 0x7fd44c15fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd449d9b640 1 -- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44c0b3f30 msgr2=0x7fd44c15fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd449d9b640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44c0b3f30 0x7fd44c15fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd44ad9d640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd44c15f380 0x7fd44c1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.899+0000 7fd449d9b640 1 -- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd44c15f380 msgr2=0x7fd44c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd449d9b640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd44c15f380 0x7fd44c1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd449d9b640 1 -- 172.21.15.37:0/4067696961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c152370 con 0x7fd44c0d2600 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd44a59c640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44c0b3f30 0x7fd44c15fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd44ad9d640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd44c15f380 0x7fd44c1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd449d9b640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c0d2600 0x7fd44c15ff60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c430 tx=0x7fd44000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd43affd640 1 -- 172.21.15.37:0/4067696961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440011790 con 0x7fd44c0d2600 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd43affd640 1 -- 172.21.15.37:0/4067696961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd440017070 con 0x7fd44c0d2600 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c0b9650 con 0x7fd44c0d2600 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd43affd640 1 -- 172.21.15.37:0/4067696961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440011b70 con 0x7fd44c0d2600 2024-05-10T08:45:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.900+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c0b9c10 con 0x7fd44c0d2600 2024-05-10T08:45:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.901+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44c0693f0 con 0x7fd44c0d2600 2024-05-10T08:45:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.902+0000 7fd43affd640 1 -- 172.21.15.37:0/4067696961 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd440011d10 con 0x7fd44c0d2600 2024-05-10T08:45:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.902+0000 7fd43affd640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd42c0762d0 0x7fd42c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.902+0000 7fd43affd640 1 -- 172.21.15.37:0/4067696961 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fd440097570 con 0x7fd44c0d2600 2024-05-10T08:45:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.902+0000 7fd44a59c640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd42c0762d0 0x7fd42c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.903+0000 7fd44a59c640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd42c0762d0 0x7fd42c078790 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd43c034000 tx=0x7fd43c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:38.907+0000 7fd43affd640 1 -- 172.21.15.37:0/4067696961 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd440060dd0 con 0x7fd44c0d2600 2024-05-10T08:45:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.171+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd44c0b2ed0 con 0x7fd44c0d2600 2024-05-10T08:45:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.173+0000 7fd43affd640 1 -- 172.21.15.37:0/4067696961 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fd4400606d0 con 0x7fd44c0d2600 2024-05-10T08:45:39.171 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:45:39.171 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:45:39.172 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-10T08:45:39.172 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-10T08:45:39.172 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T08:45:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd42c0762d0 msgr2=0x7fd42c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd42c0762d0 0x7fd42c078790 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd43c034000 tx=0x7fd43c02e000 comp rx=0 tx=0).stop 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c0d2600 msgr2=0x7fd44c15ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c0d2600 0x7fd44c15ff60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c430 tx=0x7fd44000c8f0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 shutdown_connections 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd42c0762d0 0x7fd42c078790 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd44c15f380 0x7fd44c1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd44c0d2600 0x7fd44c15ff60 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 --2- 172.21.15.37:0/4067696961 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd44c0b3f30 0x7fd44c15fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 >> 172.21.15.37:0/4067696961 conn(0x7fd44c0d4fe0 msgr2=0x7fd44c0b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 shutdown_connections 2024-05-10T08:45:39.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.175+0000 7fd450f14640 1 -- 172.21.15.37:0/4067696961 wait complete. 2024-05-10T08:45:39.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:39.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.290+0000 7f137d519640 1 Processor -- start 2024-05-10T08:45:39.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.290+0000 7f137d519640 1 -- start start 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f137d519640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13781469e0 0x7f1378071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f137d519640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f137815d710 0x7f137806f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f137d519640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13780af2f0 con 0x7f13780aed80 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f137d519640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f13780af5d0 con 0x7f13781469e0 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f137d519640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f13780af8b0 con 0x7f137815d710 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f1376ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13781469e0 0x7f1378071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f1376ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13781469e0 0x7f1378071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49206/0 (socket says 172.21.15.37:49206) 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.291+0000 7f1376ffd640 1 -- 172.21.15.37:0/354950376 learned_addr learned my addr 172.21.15.37:0/354950376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.292+0000 7f13767fc640 1 --2- 172.21.15.37:0/354950376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f137815d710 0x7f137806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.292+0000 7f1376ffd640 1 -- 172.21.15.37:0/354950376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f137815d710 msgr2=0x7f137806f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.292+0000 7f1376ffd640 1 --2- 172.21.15.37:0/354950376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f137815d710 0x7f137806f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.292+0000 7f1376ffd640 1 -- 172.21.15.37:0/354950376 >> v1:172.21.15.82:6789/0 conn(0x7f13780aed80 legacy=0x7f13780731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.292+0000 7f1376ffd640 1 -- 172.21.15.37:0/354950376 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13780afb90 con 0x7f13781469e0 2024-05-10T08:45:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.292+0000 7f13767fc640 1 --2- 172.21.15.37:0/354950376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f137815d710 0x7f137806f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:39.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.292+0000 7f1376ffd640 1 --2- 172.21.15.37:0/354950376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13781469e0 0x7f1378071520 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1370009e50 tx=0x7f137002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befd66d6e0e2903f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:39.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f1375ffb640 1 -- 172.21.15.37:0/354950376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1370036070 con 0x7f13781469e0 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f1375ffb640 1 -- 172.21.15.37:0/354950376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1370031600 con 0x7f13781469e0 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f1375ffb640 1 -- 172.21.15.37:0/354950376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700319d0 con 0x7f13781469e0 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 -- 172.21.15.37:0/354950376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13781469e0 msgr2=0x7f1378071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 --2- 172.21.15.37:0/354950376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13781469e0 0x7f1378071520 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1370009e50 tx=0x7f137002a630 comp rx=0 tx=0).stop 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 -- 172.21.15.37:0/354950376 shutdown_connections 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 --2- 172.21.15.37:0/354950376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f137815d710 0x7f137806f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 --2- 172.21.15.37:0/354950376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13781469e0 0x7f1378071520 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 -- 172.21.15.37:0/354950376 >> 172.21.15.37:0/354950376 conn(0x7f13780b39a0 msgr2=0x7f13780b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 -- 172.21.15.37:0/354950376 shutdown_connections 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.293+0000 7f137d519640 1 -- 172.21.15.37:0/354950376 wait complete. 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.295+0000 7f137d519640 1 Processor -- start 2024-05-10T08:45:39.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.295+0000 7f137d519640 1 -- start start 2024-05-10T08:45:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.295+0000 7f137d519640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13780aed80 0x7f1378144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:39.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.295+0000 7f137d519640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13781469e0 0x7f13781f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.295+0000 7f137d519640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f137815d710 0x7f1378156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.295+0000 7f137d519640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f137806f6b0 con 0x7f137815d710 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f137d519640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1378071a60 con 0x7f13780aed80 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f137d519640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f137806f830 con 0x7f13781469e0 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f137815d710 0x7f1378156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f137815d710 0x7f1378156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49214/0 (socket says 172.21.15.37:49214) 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 -- 172.21.15.37:0/902545056 learned_addr learned my addr 172.21.15.37:0/902545056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f1376ffd640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13780aed80 0x7f1378144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13767fc640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13781469e0 0x7f13781f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 -- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13781469e0 msgr2=0x7f13781f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13781469e0 0x7f13781f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 -- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13780aed80 msgr2=0x7f1378144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:39.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13780aed80 0x7f1378144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 -- 172.21.15.37:0/902545056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1378142b40 con 0x7f137815d710 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f13777fe640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f137815d710 0x7f1378156810 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f136800c440 tx=0x7f136800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f136f7fe640 1 -- 172.21.15.37:0/902545056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368011790 con 0x7f137815d710 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f136f7fe640 1 -- 172.21.15.37:0/902545056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368017070 con 0x7f137815d710 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1378142e20 con 0x7f137815d710 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f136f7fe640 1 -- 172.21.15.37:0/902545056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368011b70 con 0x7f137815d710 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.296+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13781433e0 con 0x7f137815d710 2024-05-10T08:45:39.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.297+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1378069b00 con 0x7f137815d710 2024-05-10T08:45:39.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.298+0000 7f136f7fe640 1 -- 172.21.15.37:0/902545056 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1368011d10 con 0x7f137815d710 2024-05-10T08:45:39.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.299+0000 7f136f7fe640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13580762d0 0x7f1358078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:39.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.299+0000 7f136f7fe640 1 -- 172.21.15.37:0/902545056 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f1368097550 con 0x7f137815d710 2024-05-10T08:45:39.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.299+0000 7f1376ffd640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13580762d0 0x7f1358078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:39.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.299+0000 7f1376ffd640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13580762d0 0x7f1358078790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1370033000 tx=0x7f1370009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.303+0000 7f136f7fe640 1 -- 172.21.15.37:0/902545056 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1368060db0 con 0x7f137815d710 2024-05-10T08:45:39.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.531+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1378156d50 con 0x7f137815d710 2024-05-10T08:45:39.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.531+0000 7f136f7fe640 1 -- 172.21.15.37:0/902545056 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5174 (secure 0 0 0) 0x7f13680606b0 con 0x7f137815d710 2024-05-10T08:45:39.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:39.530 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:36.721805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/54798262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":54798262},{"type":"v1","addr":"172.21.15.37:6834","nonce":54798262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6687,"qdb_cluster":[6687]},"id":6}]} 2024-05-10T08:45:39.530 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 61 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13580762d0 msgr2=0x7f1358078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13580762d0 0x7f1358078790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1370033000 tx=0x7f1370009000 comp rx=0 tx=0).stop 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f137815d710 msgr2=0x7f1378156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f137815d710 0x7f1378156810 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f136800c440 tx=0x7f136800c900 comp rx=0 tx=0).stop 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 shutdown_connections 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13580762d0 0x7f1358078790 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f137815d710 0x7f1378156810 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13781469e0 0x7f13781f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 --2- 172.21.15.37:0/902545056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13780aed80 0x7f1378144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 >> 172.21.15.37:0/902545056 conn(0x7f13780b39a0 msgr2=0x7f137813d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 shutdown_connections 2024-05-10T08:45:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:39.534+0000 7f137d519640 1 -- 172.21.15.37:0/902545056 wait complete. 2024-05-10T08:45:39.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:45:33.691603+0000', 'modified': '2024-05-10T08:45:36.721805+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6687}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6687': {'gid': 6687, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6834/54798262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 54798262}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 54798262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6687, 'qdb_cluster': [6687]} 2024-05-10T08:45:39.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:45:39.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:45:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.058+0000 7f6225d9e640 1 Processor -- start 2024-05-10T08:45:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.058+0000 7f6225d9e640 1 -- start start 2024-05-10T08:45:40.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6225d9e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f622015f480 0x7f62200d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6225d9e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f62200c8a90 0x7f62200c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6225d9e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62200b6330 con 0x7f62200d5a60 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6225d9e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f62200d0c40 con 0x7f622015f480 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6225d9e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f62200b6610 con 0x7f62200c8a90 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6224d9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f622015f480 0x7f62200d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6224d9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f622015f480 0x7f62200d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49224/0 (socket says 172.21.15.37:49224) 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f6224d9c640 1 -- 172.21.15.37:0/2072327576 learned_addr learned my addr 172.21.15.37:0/2072327576 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.059+0000 7f621ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f62200d5a60 0x7f62200d1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41722/0 (socket says 172.21.15.37:41722) 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f622559d640 1 --2- 172.21.15.37:0/2072327576 >> v2:172.21.15.82:3300/0 conn(0x7f62200c8a90 0x7f62200c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f6224d9c640 1 -- 172.21.15.37:0/2072327576 >> v2:172.21.15.82:3300/0 conn(0x7f62200c8a90 msgr2=0x7f62200c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f6224d9c640 1 --2- 172.21.15.37:0/2072327576 >> v2:172.21.15.82:3300/0 conn(0x7f62200c8a90 0x7f62200c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f6224d9c640 1 -- 172.21.15.37:0/2072327576 >> v1:172.21.15.37:6789/0 conn(0x7f62200d5a60 legacy=0x7f62200d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f6224d9c640 1 -- 172.21.15.37:0/2072327576 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62200d05f0 con 0x7f622015f480 2024-05-10T08:45:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f621f7fe640 1 -- 172.21.15.37:0/2072327576 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851667734 0 0) 0x7f62200b6330 con 0x7f62200d5a60 2024-05-10T08:45:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f622559d640 1 --2- 172.21.15.37:0/2072327576 >> v2:172.21.15.82:3300/0 conn(0x7f62200c8a90 0x7f62200c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.060+0000 7f6224d9c640 1 --2- 172.21.15.37:0/2072327576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f622015f480 0x7f62200d1570 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6210009870 tx=0x7f621002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dc329ba18d8f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f621f7fe640 1 -- 172.21.15.37:0/2072327576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210037070 con 0x7f622015f480 2024-05-10T08:45:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f621f7fe640 1 -- 172.21.15.37:0/2072327576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210032640 con 0x7f622015f480 2024-05-10T08:45:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f621f7fe640 1 -- 172.21.15.37:0/2072327576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210032a10 con 0x7f622015f480 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 -- 172.21.15.37:0/2072327576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f622015f480 msgr2=0x7f62200d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 --2- 172.21.15.37:0/2072327576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f622015f480 0x7f62200d1570 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6210009870 tx=0x7f621002a330 comp rx=0 tx=0).stop 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 -- 172.21.15.37:0/2072327576 shutdown_connections 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 --2- 172.21.15.37:0/2072327576 >> v2:172.21.15.82:3300/0 conn(0x7f62200c8a90 0x7f62200c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 --2- 172.21.15.37:0/2072327576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f622015f480 0x7f62200d1570 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 -- 172.21.15.37:0/2072327576 >> 172.21.15.37:0/2072327576 conn(0x7f62200d4f40 msgr2=0x7f62200d5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 -- 172.21.15.37:0/2072327576 shutdown_connections 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.061+0000 7f6225d9e640 1 -- 172.21.15.37:0/2072327576 wait complete. 2024-05-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.063+0000 7f6225d9e640 1 Processor -- start 2024-05-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.063+0000 7f6225d9e640 1 -- start start 2024-05-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6225d9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62200c8a90 0x7f62200ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6225d9e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62200d5a60 0x7f62200cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6225d9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f622015f480 0x7f62201f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6225d9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62200d21c0 con 0x7f62200c8a90 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6225d9e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62200b6000 con 0x7f622015f480 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6225d9e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f62200d2340 con 0x7f62200d5a60 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62200c8a90 0x7f62200ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62200c8a90 0x7f62200ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49238/0 (socket says 172.21.15.37:49238) 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 -- 172.21.15.37:0/3152280416 learned_addr learned my addr 172.21.15.37:0/3152280416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f622559d640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f622015f480 0x7f62201f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f621ffff640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62200d5a60 0x7f62200cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 -- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62200d5a60 msgr2=0x7f62200cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62200d5a60 0x7f62200cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 -- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f622015f480 msgr2=0x7f62201f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f622015f480 0x7f62201f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 -- 172.21.15.37:0/3152280416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62200b9660 con 0x7f62200c8a90 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f621ffff640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62200d5a60 0x7f62200cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6224d9c640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62200c8a90 0x7f62200ceee0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f6210009870 tx=0x7f62100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f621d7fa640 1 -- 172.21.15.37:0/3152280416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210037040 con 0x7f62200c8a90 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f621d7fa640 1 -- 172.21.15.37:0/3152280416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210004250 con 0x7f62200c8a90 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62200b9940 con 0x7f62200c8a90 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.064+0000 7f621d7fa640 1 -- 172.21.15.37:0/3152280416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621003c730 con 0x7f62200c8a90 2024-05-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.065+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62200b9f00 con 0x7f62200c8a90 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.066+0000 7f621d7fa640 1 -- 172.21.15.37:0/3152280416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f621003a070 con 0x7f62200c8a90 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.067+0000 7f621d7fa640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f62000762d0 0x7f6200078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.067+0000 7f621d7fa640 1 -- 172.21.15.37:0/3152280416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f62100b8230 con 0x7f62200c8a90 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.067+0000 7f621ffff640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f62000762d0 0x7f6200078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f6229df1740 1 Processor -- start 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f6229df1740 1 -- start start 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f621ffff640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f62000762d0 0x7f6200078790 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f62200c89f0 tx=0x7f6208009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f160 0x5599dbe61970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f6229df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe61eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe31dc0 0x5599dbe355d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f6229df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5599dbd9b8d0 con 0x5599dbe5f540 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.068+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599dbd54c10 con 0x5599dbe31dc0 2024-05-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5599dbd97890 con 0x5599dbe5f160 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe61eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe61eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49254/0 (socket says 172.21.15.37:49254) 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 -- 172.21.15.37:0/3484768971 learned_addr learned my addr 172.21.15.37:0/3484768971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f6224d9c640 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f160 0x5599dbe61970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f622559d640 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe31dc0 0x5599dbe355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 -- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f160 msgr2=0x5599dbe61970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f160 0x5599dbe61970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 -- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe31dc0 msgr2=0x5599dbe355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe31dc0 0x5599dbe355d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 -- 172.21.15.37:0/3484768971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dbd5c5d0 con 0x5599dbe5f540 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f621ffff640 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe61eb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6208000f60 tx=0x7f6208010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd4ee509580b6ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f62167fc640 1 -- 172.21.15.37:0/3484768971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620800d9a0 con 0x5599dbe5f540 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f62167fc640 1 -- 172.21.15.37:0/3484768971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620800db40 con 0x5599dbe5f540 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.069+0000 7f62167fc640 1 -- 172.21.15.37:0/3484768971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208020450 con 0x5599dbe5f540 2024-05-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 -- 172.21.15.37:0/3484768971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 msgr2=0x5599dbe61eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe61eb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6208000f60 tx=0x7f6208010000 comp rx=0 tx=0).stop 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 -- 172.21.15.37:0/3484768971 shutdown_connections 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe31dc0 0x5599dbe355d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe61eb0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 --2- 172.21.15.37:0/3484768971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f160 0x5599dbe61970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 -- 172.21.15.37:0/3484768971 >> 172.21.15.37:0/3484768971 conn(0x5599dbe34030 msgr2=0x5599dbe7c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 -- 172.21.15.37:0/3484768971 shutdown_connections 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.070+0000 7f6229df1740 1 -- 172.21.15.37:0/3484768971 wait complete. 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.071+0000 7f6229df1740 1 -- start start 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.071+0000 7f6229df1740 1 Processor -- start 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.071+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe8d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f540 0x5599dbe64c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6229df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5c450 0x5599dbe7eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6229df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5599dbe371e0 con 0x5599dbe5c450 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599dbd58760 con 0x5599dbe5f160 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5599dbe374c0 con 0x5599dbe5f540 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6229df1740 10 client.0 _ll_register_callbacks cb 0x5599dbd91cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5c450 0x5599dbe7eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5c450 0x5599dbe7eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49256/0 (socket says 172.21.15.37:49256) 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 -- 172.21.15.37:0/3953288553 learned_addr learned my addr 172.21.15.37:0/3953288553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f621ffff640 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f540 0x5599dbe64c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6224d9c640 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe8d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 -- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f540 msgr2=0x5599dbe64c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f540 0x5599dbe64c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 -- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 msgr2=0x5599dbe8d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe8d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 -- 172.21.15.37:0/3953288553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dbaad2d0 con 0x5599dbe5c450 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f622559d640 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5c450 0x5599dbe7eba0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f621800ded0 tx=0x7f621800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fade163d2997b9be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f61ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f61ff7fe640 1 -- 172.21.15.37:0/3953288553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218018640 con 0x5599dbe5c450 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f61ff7fe640 1 -- 172.21.15.37:0/3953288553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f62180187e0 con 0x5599dbe5c450 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.072+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f620800db40 con 0x5599dbe5c450 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f61ff7fe640 1 -- 172.21.15.37:0/3953288553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f6218024050 con 0x5599dbe5c450 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 10 client.6828 fetch_fsmap learned FSMap version 61 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5599dbb776b0 con 0x5599dbe5c450 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f61ff7fe640 1 -- 172.21.15.37:0/3953288553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620800db40 con 0x5599dbe5c450 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f61ff7fe640 1 -- 172.21.15.37:0/3953288553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f6218027020 con 0x5599dbe5c450 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 10 client.6828 fetch_fsmap finished waiting for FSMap version 61 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 10 client.6828 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 20 client.6828 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbe99290 0x5599dbe9b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 4 client.6828 mds_command: new command op to 6687 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 --> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599dbd1f760 con 0x5599dbe99290 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6224d9c640 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbe99290 0x5599dbe9b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f61ff7fe640 10 client.6828 ms_handle_connect on v2:172.21.15.37:6832/54798262 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.073+0000 7f6224d9c640 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbe99290 0x5599dbe9b680 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=694daec130e2fb0c server_cookie=53e9097d013911cd in_seq=0 out_seq=0 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f61ff7fe640 1 -- 172.21.15.37:0/3953288553 <== mds.0 v2:172.21.15.37:6832/54798262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5599dbd1f760 con 0x5599dbe99290 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f61ff7fe640 10 client.6828 handle_command_reply: tid=0 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 client.6828 shutdown 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5c450 msgr2=0x5599dbe7eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5c450 0x5599dbe7eba0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f621800ded0 tx=0x7f621800c790 comp rx=0 tx=0).stop 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 shutdown_connections 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbe99290 0x5599dbe9b680 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5c450 0x5599dbe7eba0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5f540 0x5599dbe64c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 --2- 172.21.15.37:0/3953288553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe8d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f61ff7fe640 0 client.6828 ms_handle_reset on v2:172.21.15.37:6832/54798262 2024-05-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 >> 172.21.15.37:0/3953288553 conn(0x5599dbe31dc0 msgr2=0x5599dbe30c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 shutdown_connections 2024-05-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 1 -- 172.21.15.37:0/3953288553 wait complete. 2024-05-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.074+0000 7f6229df1740 20 client.6828 trim_cache size 0 max 16384 2024-05-10T08:45:40.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.093+0000 7f6229df1740 1 Processor -- start 2024-05-10T08:45:40.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.093+0000 7f6229df1740 1 -- start start 2024-05-10T08:45:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbe31070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f6229df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f160 0x5599dbe32550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f540 0x5599dbe32a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f6229df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6220200a10 con 0x5599dbe5f160 2024-05-10T08:45:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62201ffd80 con 0x5599dbe5f540 2024-05-10T08:45:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f62202003a0 con 0x5599dbe5c450 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f160 0x5599dbe32550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f160 0x5599dbe32550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49260/0 (socket says 172.21.15.37:49260) 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 -- 172.21.15.37:0/1663567779 learned_addr learned my addr 172.21.15.37:0/1663567779 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f622559d640 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f540 0x5599dbe32a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f6224d9c640 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbe31070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 -- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 msgr2=0x5599dbe31070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbe31070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 -- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f540 msgr2=0x5599dbe32a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f540 0x5599dbe32a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 -- 172.21.15.37:0/1663567779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dbd3c570 con 0x5599dbe5f160 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f622559d640 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f540 0x5599dbe32a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.094+0000 7f621ffff640 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f160 0x5599dbe32550 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f6208001040 tx=0x7f6208007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749995f1cc21edcd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6215ffb640 1 -- 172.21.15.37:0/1663567779 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620800da60 con 0x5599dbe5f160 2024-05-10T08:45:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6215ffb640 1 -- 172.21.15.37:0/1663567779 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620800dc00 con 0x5599dbe5f160 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6215ffb640 1 -- 172.21.15.37:0/1663567779 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208020450 con 0x5599dbe5f160 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 -- 172.21.15.37:0/1663567779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f160 msgr2=0x5599dbe32550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f160 0x5599dbe32550 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f6208001040 tx=0x7f6208007000 comp rx=0 tx=0).stop 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 -- 172.21.15.37:0/1663567779 shutdown_connections 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f540 0x5599dbe32a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f160 0x5599dbe32550 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 --2- 172.21.15.37:0/1663567779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbe31070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 -- 172.21.15.37:0/1663567779 >> 172.21.15.37:0/1663567779 conn(0x5599dbe31dc0 msgr2=0x5599dbe64a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 -- 172.21.15.37:0/1663567779 shutdown_connections 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.095+0000 7f6229df1740 1 -- 172.21.15.37:0/1663567779 wait complete. 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.096+0000 7f6229df1740 1 -- start start 2024-05-10T08:45:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.096+0000 7f6229df1740 1 Processor -- start 2024-05-10T08:45:40.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbefaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6229df1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe7ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6229df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6229df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5599dbe639c0 con 0x5599dbe5f540 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599dbe7e680 con 0x5599dbe5f160 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6229df1740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5599dbe5b8a0 con 0x5599dbe5c450 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6229df1740 10 client.0 _ll_register_callbacks cb 0x7f6218007ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe7d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49264/0 (socket says 172.21.15.37:49264) 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 -- 172.21.15.37:0/286388820 learned_addr learned my addr 172.21.15.37:0/286388820 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f6224d9c640 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbefaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f621ffff640 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe7ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 -- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 msgr2=0x5599dbefaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbefaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 -- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 msgr2=0x5599dbe7ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe7ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 -- 172.21.15.37:0/286388820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dbe63c90 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f622559d640 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe7d3a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x5599dbe7ad90 tx=0x7f6218004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5f8d5342f3b624 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.097+0000 7f61ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f61ff7fe640 1 -- 172.21.15.37:0/286388820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218018640 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f61ff7fe640 1 -- 172.21.15.37:0/286388820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f62180187e0 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f620800dc00 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f61ff7fe640 1 -- 172.21.15.37:0/286388820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f6218038050 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 10 client.6834 fetch_fsmap learned FSMap version 61 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5599dbe32650 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f61ff7fe640 1 -- 172.21.15.37:0/286388820 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620800dc00 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f61ff7fe640 1 -- 172.21.15.37:0/286388820 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f621803b020 con 0x5599dbe5f540 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 10 client.6834 fetch_fsmap finished waiting for FSMap version 61 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 10 client.6834 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 20 client.6834 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbefbb70 0x5599dbe5dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 4 client.6834 mds_command: new command op to 6687 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 --> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] -- command(tid 0: {"prefix": "status"}) -- 0x5599dbda94e0 con 0x5599dbefbb70 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6224d9c640 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbefbb70 0x5599dbe5dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f61ff7fe640 10 client.6834 ms_handle_connect on v2:172.21.15.37:6832/54798262 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.098+0000 7f6224d9c640 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbefbb70 0x5599dbe5dc80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41965c0b6691860d server_cookie=6c240008ae6e1320 in_seq=0 out_seq=0 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f61ff7fe640 1 -- 172.21.15.37:0/286388820 <== mds.0 v2:172.21.15.37:6832/54798262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5599dbda94e0 con 0x5599dbefbb70 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f61ff7fe640 10 client.6834 handle_command_reply: tid=0 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 client.6834 shutdown 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 msgr2=0x5599dbe7d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe7d3a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x5599dbe7ad90 tx=0x7f6218004a40 comp rx=0 tx=0).stop 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 shutdown_connections 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:6832/54798262,v1:172.21.15.37:6834/54798262] conn(0x5599dbefbb70 0x5599dbe5dc80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599dbe5f540 0x5599dbe7d3a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599dbe5f160 0x5599dbe7ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f61ff7fe640 0 client.6834 ms_handle_reset on v2:172.21.15.37:6832/54798262 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 --2- 172.21.15.37:0/286388820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5599dbe5c450 0x5599dbefaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 >> 172.21.15.37:0/286388820 conn(0x5599dbe31dc0 msgr2=0x5599dbe37df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 shutdown_connections 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 1 -- 172.21.15.37:0/286388820 wait complete. 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.099+0000 7f6229df1740 20 client.6834 trim_cache size 0 max 16384 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6687, 2024-05-10T08:45:40.106 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.7577997620000003, 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 61, 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 87, 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 87, 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 10.770555132 2024-05-10T08:45:40.107 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f62000762d0 msgr2=0x7f6200078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f62000762d0 0x7f6200078790 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f62200c89f0 tx=0x7f6208009040 comp rx=0 tx=0).stop 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62200c8a90 msgr2=0x7f62200ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62200c8a90 0x7f62200ceee0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f6210009870 tx=0x7f62100046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 shutdown_connections 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f62000762d0 0x7f6200078790 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f622015f480 0x7f62201f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62200d5a60 0x7f62200cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 --2- 172.21.15.37:0/3152280416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62200c8a90 0x7f62200ceee0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 >> 172.21.15.37:0/3152280416 conn(0x7f62200d4f40 msgr2=0x7f622015e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 shutdown_connections 2024-05-10T08:45:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.100+0000 7f6225d9e640 1 -- 172.21.15.37:0/3152280416 wait complete. 2024-05-10T08:45:40.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:45:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.213+0000 7fc5e7045640 1 Processor -- start 2024-05-10T08:45:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.213+0000 7fc5e7045640 1 -- start start 2024-05-10T08:45:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e7045640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5e01629a0 0x7fc5e00d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e7045640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00d2dc0 0x7fc5e00d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e7045640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5e00c8ed0 0x7fc5e00c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e7045640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e00d3330 con 0x7fc5e01629a0 2024-05-10T08:45:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e7045640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e00d2170 con 0x7fc5e00c8ed0 2024-05-10T08:45:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e7045640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e00d2450 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5e01629a0 0x7fc5e00d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5e01629a0 0x7fc5e00d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49274/0 (socket says 172.21.15.37:49274) 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 -- 172.21.15.37:0/1347242538 learned_addr learned my addr 172.21.15.37:0/1347242538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e55e2640 1 --2- 172.21.15.37:0/1347242538 >> v2:172.21.15.82:3300/0 conn(0x7fc5e00c8ed0 0x7fc5e00c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 -- 172.21.15.37:0/1347242538 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00d2dc0 msgr2=0x7fc5e00d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 --2- 172.21.15.37:0/1347242538 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00d2dc0 0x7fc5e00d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 -- 172.21.15.37:0/1347242538 >> v2:172.21.15.82:3300/0 conn(0x7fc5e00c8ed0 msgr2=0x7fc5e00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 --2- 172.21.15.37:0/1347242538 >> v2:172.21.15.82:3300/0 conn(0x7fc5e00c8ed0 0x7fc5e00c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.214+0000 7fc5e4de1640 1 -- 172.21.15.37:0/1347242538 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e00d2730 con 0x7fc5e01629a0 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.215+0000 7fc5e4de1640 1 --2- 172.21.15.37:0/1347242538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e01629a0 0x7fc5e00d35c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc5e008e4c0 tx=0x7fc5d002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285ea14e17e63741 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.215+0000 7fc5df7fe640 1 -- 172.21.15.37:0/1347242538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0037070 con 0x7fc5e01629a0 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.215+0000 7fc5df7fe640 1 -- 172.21.15.37:0/1347242538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d002ae00 con 0x7fc5e01629a0 2024-05-10T08:45:40.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.215+0000 7fc5df7fe640 1 -- 172.21.15.37:0/1347242538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0032660 con 0x7fc5e01629a0 2024-05-10T08:45:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 -- 172.21.15.37:0/1347242538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e01629a0 msgr2=0x7fc5e00d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1347242538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e01629a0 0x7fc5e00d35c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc5e008e4c0 tx=0x7fc5d002a0b0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 -- 172.21.15.37:0/1347242538 shutdown_connections 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1347242538 >> v2:172.21.15.82:3300/0 conn(0x7fc5e00c8ed0 0x7fc5e00c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1347242538 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00d2dc0 0x7fc5e00d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1347242538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e01629a0 0x7fc5e00d35c0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 -- 172.21.15.37:0/1347242538 >> 172.21.15.37:0/1347242538 conn(0x7fc5e00d4fe0 msgr2=0x7fc5e00d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 -- 172.21.15.37:0/1347242538 shutdown_connections 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.216+0000 7fc5e7045640 1 -- 172.21.15.37:0/1347242538 wait complete. 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.217+0000 7fc5e7045640 1 Processor -- start 2024-05-10T08:45:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.217+0000 7fc5e7045640 1 -- start start 2024-05-10T08:45:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e7045640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00c8ed0 0x7fc5e015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e7045640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e00d2dc0 0x7fc5e006d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e7045640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e01629a0 0x7fc5e006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e7045640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e00cf440 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e7045640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e00cf2c0 con 0x7fc5e01629a0 2024-05-10T08:45:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e7045640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e00c98a0 con 0x7fc5e00c8ed0 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e00d2dc0 0x7fc5e006d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e00d2dc0 0x7fc5e006d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49290/0 (socket says 172.21.15.37:49290) 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5dffff640 1 -- 172.21.15.37:0/1050406532 learned_addr learned my addr 172.21.15.37:0/1050406532 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e55e2640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e01629a0 0x7fc5e006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.218+0000 7fc5e4de1640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00c8ed0 0x7fc5e015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dffff640 1 -- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00c8ed0 msgr2=0x7fc5e015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dffff640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00c8ed0 0x7fc5e015e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dffff640 1 -- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e01629a0 msgr2=0x7fc5e006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dffff640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e01629a0 0x7fc5e006d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dffff640 1 -- 172.21.15.37:0/1050406532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e015e690 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dffff640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e00d2dc0 0x7fc5e006d4a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400b4d0 tx=0x7fc5d400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dd7fa640 1 -- 172.21.15.37:0/1050406532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4014070 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dd7fa640 1 -- 172.21.15.37:0/1050406532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d4010870 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e00b9c90 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5dd7fa640 1 -- 172.21.15.37:0/1050406532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4010c60 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.219+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e00ba250 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.220+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e00693f0 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.221+0000 7fc5dd7fa640 1 -- 172.21.15.37:0/1050406532 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc5d4017070 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.221+0000 7fc5dd7fa640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5cc076300 0x7fc5cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.221+0000 7fc5dd7fa640 1 -- 172.21.15.37:0/1050406532 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fc5d40974d0 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.221+0000 7fc5e4de1640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5cc076300 0x7fc5cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.222+0000 7fc5e4de1640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5cc076300 0x7fc5cc0787c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0034000 tx=0x7fc5d002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.226+0000 7fc5dd7fa640 1 -- 172.21.15.37:0/1050406532 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc5d4060ca0 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.292 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:45:40.293+0000 7f6f958ff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:45:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.455+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc5e00d1320 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.455+0000 7fc5dd7fa640 1 -- 172.21.15.37:0/1050406532 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7fc5d40605a0 con 0x7fc5e00d2dc0 2024-05-10T08:45:40.455 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:45:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5cc076300 msgr2=0x7fc5cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5cc076300 0x7fc5cc0787c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0034000 tx=0x7fc5d002e000 comp rx=0 tx=0).stop 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e00d2dc0 msgr2=0x7fc5e006d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e00d2dc0 0x7fc5e006d4a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400b4d0 tx=0x7fc5d400b990 comp rx=0 tx=0).stop 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 shutdown_connections 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5cc076300 0x7fc5cc0787c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e01629a0 0x7fc5e006d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e00d2dc0 0x7fc5e006d4a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 --2- 172.21.15.37:0/1050406532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5e00c8ed0 0x7fc5e015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 >> 172.21.15.37:0/1050406532 conn(0x7fc5e00d4fe0 msgr2=0x7fc5e006e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 shutdown_connections 2024-05-10T08:45:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40.457+0000 7fc5e7045640 1 -- 172.21.15.37:0/1050406532 wait complete. 2024-05-10T08:45:40.467 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:45:40.467 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:45:40.467 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:45:40.467 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:45:40.468 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:40.468 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:45:40.468 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:45:40.468 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:45:40.468 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:40.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:40.468 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:45:40.484 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:40.485 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42421sec preferred_lft 42421sec 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:40.486 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:45:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:40.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:40.488 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:45:40.549 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:45:40.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:40.551 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:45:40.607 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:45:40.607 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:45:40.607 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:45:40.607 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:45:40.608 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:45:40.608 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:45:40.608 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:45:40.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:45:40.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:45:40.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:45:40.608 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:45:40.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:45:40.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:45:40.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:40.741 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:45:40.758 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:45:40.758 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:45:40.758 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:40.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:40.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:45:40.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:45:40.825 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:40.882 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:40.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:45:40.883 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:40.938 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:45:40.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:40.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:41.026 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:41.027 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:41.027 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:41.032 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:41.032 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:41.032 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:41.032 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:45:41.033 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:45:41.037 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:45:41.038 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:45:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:45:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:45:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:45:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:45:41.040 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:45:41.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:41.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:41.066 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:45:41.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:45:41.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:45:41.170 INFO:teuthology.orchestra.run.smithi037.stdout:client6843 2024-05-10T08:45:41.170 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:41.170 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:41.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:41.187 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-05-10T08:45:41.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:41.251 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-05-10T08:45:41.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:41.308 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-05-10T08:45:41.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:41.367 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-05-10T08:45:41.427 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:45:41.427 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:45:41.428 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:45:41.428 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:45:41.428 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-05-10T08:45:41.428 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:45:41.536 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2024-05-10T08:45:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:45:41.544 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:41.545 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:41.602 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:41.602 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:41.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:45:41.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.803+0000 7fabb1712640 1 Processor -- start 2024-05-10T08:45:41.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.803+0000 7fabb1712640 1 -- start start 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabb1712640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabac06e0f0 0x7fabac15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabb1712640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabac072840 0x7fabac0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabb1712640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabac0d14b0 con 0x7fabac06e4d0 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabb1712640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fabac15c920 con 0x7fabac06e0f0 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabb1712640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fabac15cc00 con 0x7fabac072840 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabaaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabac06e0f0 0x7fabac15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabaaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabac06e0f0 0x7fabac15c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49302/0 (socket says 172.21.15.37:49302) 2024-05-10T08:45:41.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.804+0000 7fabaaffd640 1 -- 172.21.15.37:0/1883327273 learned_addr learned my addr 172.21.15.37:0/1883327273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:41.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7faba3fff640 1 --2- 172.21.15.37:0/1883327273 >> v2:172.21.15.82:3300/0 conn(0x7fabac072840 0x7fabac0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:41.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7fabaaffd640 1 -- 172.21.15.37:0/1883327273 >> v2:172.21.15.82:3300/0 conn(0x7fabac072840 msgr2=0x7fabac0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:41.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7fabaaffd640 1 --2- 172.21.15.37:0/1883327273 >> v2:172.21.15.82:3300/0 conn(0x7fabac072840 0x7fabac0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:41.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7fabaaffd640 1 -- 172.21.15.37:0/1883327273 >> v1:172.21.15.82:6789/0 conn(0x7fabac06e4d0 legacy=0x7fabac0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:41.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7fabaaffd640 1 -- 172.21.15.37:0/1883327273 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac15cee0 con 0x7fabac06e0f0 2024-05-10T08:45:41.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7faba3fff640 1 --2- 172.21.15.37:0/1883327273 >> v2:172.21.15.82:3300/0 conn(0x7fabac072840 0x7fabac0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:41.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7fabaaffd640 1 --2- 172.21.15.37:0/1883327273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e0f0 0x7fabac15c340 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fabac0727d0 tx=0x7fab9c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631f047e8645b5fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:41.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.805+0000 7fabaa7fc640 1 -- 172.21.15.37:0/1883327273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c037070 con 0x7fabac06e0f0 2024-05-10T08:45:41.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabaa7fc640 1 -- 172.21.15.37:0/1883327273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c032440 con 0x7fabac06e0f0 2024-05-10T08:45:41.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabaa7fc640 1 -- 172.21.15.37:0/1883327273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c032810 con 0x7fabac06e0f0 2024-05-10T08:45:41.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 -- 172.21.15.37:0/1883327273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e0f0 msgr2=0x7fabac15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 --2- 172.21.15.37:0/1883327273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e0f0 0x7fabac15c340 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fabac0727d0 tx=0x7fab9c02a230 comp rx=0 tx=0).stop 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 -- 172.21.15.37:0/1883327273 shutdown_connections 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 --2- 172.21.15.37:0/1883327273 >> v2:172.21.15.82:3300/0 conn(0x7fabac072840 0x7fabac0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 --2- 172.21.15.37:0/1883327273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e0f0 0x7fabac15c340 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 -- 172.21.15.37:0/1883327273 >> 172.21.15.37:0/1883327273 conn(0x7fabac06c3a0 msgr2=0x7fabac06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 -- 172.21.15.37:0/1883327273 shutdown_connections 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.806+0000 7fabb1712640 1 -- 172.21.15.37:0/1883327273 wait complete. 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.807+0000 7fabb1712640 1 Processor -- start 2024-05-10T08:45:41.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.807+0000 7fabb1712640 1 -- start start 2024-05-10T08:45:41.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7fabb1712640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabac06e0f0 0x7fabac0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:41.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7fabb1712640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e4d0 0x7fabac0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:41.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7fabb1712640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabac072840 0x7fabac1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7fabb1712640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabac0ae650 con 0x7fabac06e4d0 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7fabb1712640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fabac06e960 con 0x7fabac06e0f0 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7fabb1712640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fabac0ae7d0 con 0x7fabac072840 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7faba3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e4d0 0x7fabac0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7faba3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e4d0 0x7fabac0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49310/0 (socket says 172.21.15.37:49310) 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.808+0000 7faba3fff640 1 -- 172.21.15.37:0/768380568 learned_addr learned my addr 172.21.15.37:0/768380568 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba3fff640 1 -- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabac072840 msgr2=0x7fabac1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7fabab7fe640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabac072840 0x7fabac1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7fabaaffd640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabac06e0f0 0x7fabac0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba3fff640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabac072840 0x7fabac1501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba3fff640 1 -- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabac06e0f0 msgr2=0x7fabac0cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba3fff640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabac06e0f0 0x7fabac0cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:41.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba3fff640 1 -- 172.21.15.37:0/768380568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac0d0500 con 0x7fabac06e4d0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7fabaaffd640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabac06e0f0 0x7fabac0cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba3fff640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e4d0 0x7fabac0b4ca0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c7c0 tx=0x7fab9400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba37fe640 1 -- 172.21.15.37:0/768380568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94015070 con 0x7fabac06e4d0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba37fe640 1 -- 172.21.15.37:0/768380568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab94007820 con 0x7fabac06e4d0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac156aa0 con 0x7fabac06e4d0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7faba37fe640 1 -- 172.21.15.37:0/768380568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94007bf0 con 0x7fabac06e4d0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.809+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac157060 con 0x7fabac06e4d0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.810+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabac0693f0 con 0x7fabac06e4d0 2024-05-10T08:45:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.811+0000 7faba37fe640 1 -- 172.21.15.37:0/768380568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab94018070 con 0x7fabac06e4d0 2024-05-10T08:45:41.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.811+0000 7faba37fe640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab8c0762d0 0x7fab8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:41.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.811+0000 7faba37fe640 1 -- 172.21.15.37:0/768380568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fab94097610 con 0x7fabac06e4d0 2024-05-10T08:45:41.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.811+0000 7fabaaffd640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab8c0762d0 0x7fab8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:41.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.812+0000 7fabaaffd640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab8c0762d0 0x7fab8c078790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fab9c034000 tx=0x7fab9c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:41.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:41.815+0000 7faba37fe640 1 -- 172.21.15.37:0/768380568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fab94060de0 con 0x7fabac06e4d0 2024-05-10T08:45:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.020+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fabac159cf0 con 0x7fabac06e4d0 2024-05-10T08:45:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.020+0000 7faba37fe640 1 -- 172.21.15.37:0/768380568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) ==== 80+0+0 (secure 0 0 0) 0x7fab940606e0 con 0x7fabac06e4d0 2024-05-10T08:45:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:45:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab8c0762d0 msgr2=0x7fab8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab8c0762d0 0x7fab8c078790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fab9c034000 tx=0x7fab9c02e000 comp rx=0 tx=0).stop 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e4d0 msgr2=0x7fabac0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e4d0 0x7fabac0b4ca0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c7c0 tx=0x7fab9400cc80 comp rx=0 tx=0).stop 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 shutdown_connections 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab8c0762d0 0x7fab8c078790 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fabac072840 0x7fabac1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabac06e4d0 0x7fabac0b4ca0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 --2- 172.21.15.37:0/768380568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabac06e0f0 0x7fabac0cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 >> 172.21.15.37:0/768380568 conn(0x7fabac06c3a0 msgr2=0x7fabac06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 shutdown_connections 2024-05-10T08:45:42.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.022+0000 7fabb1712640 1 -- 172.21.15.37:0/768380568 wait complete. 2024-05-10T08:45:42.032 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:45:42.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:42.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:42.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:45:42.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:42.086 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:45:42.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:42.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.259+0000 7fb5efdaf640 1 Processor -- start 2024-05-10T08:45:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.259+0000 7fb5efdaf640 1 -- start start 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5efdaf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb5e80d1970 0x7fb5e80d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5efdaf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5e80d4cc0 0x7fb5e80d50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5efdaf640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e81630b0 con 0x7fb5e815f420 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5efdaf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e80d3e70 con 0x7fb5e80d1970 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5efdaf640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e80d2550 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5ed34a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb5e80d1970 0x7fb5e80d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5edb4b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb5e815f420 0x7fb5e80d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41736/0 (socket says 172.21.15.37:41736) 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.260+0000 7fb5edb4b640 1 -- 172.21.15.37:0/1032087188 learned_addr learned my addr 172.21.15.37:0/1032087188 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.261+0000 7fb5ed34a640 1 -- 172.21.15.37:0/1032087188 >> v2:172.21.15.82:3300/0 conn(0x7fb5e80d4cc0 msgr2=0x7fb5e80d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.261+0000 7fb5ee34c640 1 --2- 172.21.15.37:0/1032087188 >> v2:172.21.15.82:3300/0 conn(0x7fb5e80d4cc0 0x7fb5e80d50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.261+0000 7fb5ed34a640 1 --2- 172.21.15.37:0/1032087188 >> v2:172.21.15.82:3300/0 conn(0x7fb5e80d4cc0 0x7fb5e80d50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.261+0000 7fb5ed34a640 1 -- 172.21.15.37:0/1032087188 >> v1:172.21.15.37:6789/0 conn(0x7fb5e815f420 legacy=0x7fb5e80d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.261+0000 7fb5ecb49640 1 -- 172.21.15.37:0/1032087188 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848196370 0 0) 0x7fb5e0001110 con 0x7fb5e815f420 2024-05-10T08:45:42.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.261+0000 7fb5ed34a640 1 -- 172.21.15.37:0/1032087188 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e80d2c80 con 0x7fb5e80d1970 2024-05-10T08:45:42.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.261+0000 7fb5ee34c640 1 --2- 172.21.15.37:0/1032087188 >> v2:172.21.15.82:3300/0 conn(0x7fb5e80d4cc0 0x7fb5e80d50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:42.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5ed34a640 1 --2- 172.21.15.37:0/1032087188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d1970 0x7fb5e80d1e20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80d17a0 tx=0x7fb5dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff75d5df24ad8dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:42.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5ecb49640 1 -- 172.21.15.37:0/1032087188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc037070 con 0x7fb5e80d1970 2024-05-10T08:45:42.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5ecb49640 1 -- 172.21.15.37:0/1032087188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc032440 con 0x7fb5e80d1970 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5ecb49640 1 -- 172.21.15.37:0/1032087188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc032810 con 0x7fb5e80d1970 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 -- 172.21.15.37:0/1032087188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d1970 msgr2=0x7fb5e80d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/1032087188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d1970 0x7fb5e80d1e20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80d17a0 tx=0x7fb5dc02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 -- 172.21.15.37:0/1032087188 shutdown_connections 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/1032087188 >> v2:172.21.15.82:3300/0 conn(0x7fb5e80d4cc0 0x7fb5e80d50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/1032087188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d1970 0x7fb5e80d1e20 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 -- 172.21.15.37:0/1032087188 >> 172.21.15.37:0/1032087188 conn(0x7fb5e808eac0 msgr2=0x7fb5e809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 -- 172.21.15.37:0/1032087188 shutdown_connections 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.262+0000 7fb5efdaf640 1 -- 172.21.15.37:0/1032087188 wait complete. 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.263+0000 7fb5efdaf640 1 Processor -- start 2024-05-10T08:45:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.263+0000 7fb5efdaf640 1 -- start start 2024-05-10T08:45:42.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5efdaf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5e80d1970 0x7fb5e81f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5efdaf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d4cc0 0x7fb5e80cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5efdaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e80ce400 0x7fb5e80c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5efdaf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80d2830 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5efdaf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80d3240 con 0x7fb5e80ce400 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5efdaf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e80d5620 con 0x7fb5e80d1970 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5ed34a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d4cc0 0x7fb5e80cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5ed34a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d4cc0 0x7fb5e80cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49338/0 (socket says 172.21.15.37:49338) 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5ed34a640 1 -- 172.21.15.37:0/905503525 learned_addr learned my addr 172.21.15.37:0/905503525 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5ee34c640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e80ce400 0x7fb5e80c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.264+0000 7fb5edb4b640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5e80d1970 0x7fb5e81f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5ed34a640 1 -- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5e80d1970 msgr2=0x7fb5e81f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5ed34a640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5e80d1970 0x7fb5e81f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5ed34a640 1 -- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e80ce400 msgr2=0x7fb5e80c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5ed34a640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e80ce400 0x7fb5e80c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5ed34a640 1 -- 172.21.15.37:0/905503525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e80cefb0 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5edb4b640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5e80d1970 0x7fb5e81f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5ed34a640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d4cc0 0x7fb5e80cdec0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000c00 tx=0x7fb5dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5e67fc640 1 -- 172.21.15.37:0/905503525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc037040 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5e67fc640 1 -- 172.21.15.37:0/905503525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc042070 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e80b9e50 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5e67fc640 1 -- 172.21.15.37:0/905503525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc030a50 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.265+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e80ba0f0 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.266+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e80d1210 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.267+0000 7fb5e67fc640 1 -- 172.21.15.37:0/905503525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb5dc030bf0 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.267+0000 7fb5e67fc640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb5d40762d0 0x7fb5d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.267+0000 7fb5e67fc640 1 -- 172.21.15.37:0/905503525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb5dc0b8180 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.268+0000 7fb5edb4b640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb5d40762d0 0x7fb5d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.268+0000 7fb5edb4b640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb5d40762d0 0x7fb5d4078790 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000f60 tx=0x7fb5e0007ca0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.272+0000 7fb5e67fc640 1 -- 172.21.15.37:0/905503525 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb5e80d1210 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.506+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5e80693f0 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.507+0000 7fb5e67fc640 1 -- 172.21.15.37:0/905503525 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5174 (secure 0 0 0) 0x7fb5dc081940 con 0x7fb5e80d4cc0 2024-05-10T08:45:42.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:42.506 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:36.721805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6687},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6687":{"gid":6687,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/54798262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":54798262},{"type":"v1","addr":"172.21.15.37:6834","nonce":54798262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6687,"qdb_cluster":[6687]},"id":6}]} 2024-05-10T08:45:42.507 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 61 2024-05-10T08:45:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb5d40762d0 msgr2=0x7fb5d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb5d40762d0 0x7fb5d4078790 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000f60 tx=0x7fb5e0007ca0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d4cc0 msgr2=0x7fb5e80cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d4cc0 0x7fb5e80cdec0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000c00 tx=0x7fb5dc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 shutdown_connections 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb5d40762d0 0x7fb5d4078790 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e80ce400 0x7fb5e80c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e80d4cc0 0x7fb5e80cdec0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 --2- 172.21.15.37:0/905503525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5e80d1970 0x7fb5e81f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 >> 172.21.15.37:0/905503525 conn(0x7fb5e808eac0 msgr2=0x7fb5e806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 shutdown_connections 2024-05-10T08:45:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.509+0000 7fb5efdaf640 1 -- 172.21.15.37:0/905503525 wait complete. 2024-05-10T08:45:42.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T08:45:42.650 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2024-05-10T08:45:42.650 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:45:42.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:45:42.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.756+0000 7f75da7a4640 1 Processor -- start 2024-05-10T08:45:42.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.756+0000 7f75da7a4640 1 -- start start 2024-05-10T08:45:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75da7a4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75d406c3a0 0x7f75d40b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75da7a4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 0x7f75d40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75da7a4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d409ff30 con 0x7f75d415d180 2024-05-10T08:45:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75da7a4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f75d415e360 con 0x7f75d406c3a0 2024-05-10T08:45:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75da7a4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f75d415d750 con 0x7f75d40aedf0 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75d406c3a0 0x7f75d40b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d8d41640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f75d415d180 0x7f75d406c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41752/0 (socket says 172.21.15.37:41752) 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d8d41640 1 -- 172.21.15.37:0/419584416 learned_addr learned my addr 172.21.15.37:0/419584416 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75d406c3a0 0x7f75d40b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49344/0 (socket says 172.21.15.37:49344) 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d3fff640 1 -- 172.21.15.37:0/419584416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 msgr2=0x7f75d40b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d3fff640 1 --2- 172.21.15.37:0/419584416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 0x7f75d40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d3fff640 1 -- 172.21.15.37:0/419584416 >> v1:172.21.15.37:6789/0 conn(0x7f75d415d180 legacy=0x7f75d406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.758+0000 7f75d3fff640 1 -- 172.21.15.37:0/419584416 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d415da30 con 0x7f75d406c3a0 2024-05-10T08:45:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.757+0000 7f75d37fe640 1 -- 172.21.15.37:0/419584416 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607968599 0 0) 0x7f75d409ff30 con 0x7f75d415d180 2024-05-10T08:45:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.758+0000 7f75d3fff640 1 --2- 172.21.15.37:0/419584416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d40b13f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097a0 tx=0x7f75c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b38aad6dff666 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.758+0000 7f75d37fe640 1 -- 172.21.15.37:0/419584416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4037070 con 0x7f75d406c3a0 2024-05-10T08:45:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.758+0000 7f75d37fe640 1 -- 172.21.15.37:0/419584416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c4032440 con 0x7f75d406c3a0 2024-05-10T08:45:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.758+0000 7f75d37fe640 1 -- 172.21.15.37:0/419584416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4032810 con 0x7f75d406c3a0 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 -- 172.21.15.37:0/419584416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 msgr2=0x7f75d40b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 --2- 172.21.15.37:0/419584416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d40b13f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097a0 tx=0x7f75c402a180 comp rx=0 tx=0).stop 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 -- 172.21.15.37:0/419584416 shutdown_connections 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 --2- 172.21.15.37:0/419584416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 0x7f75d40b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 --2- 172.21.15.37:0/419584416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d40b13f0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 -- 172.21.15.37:0/419584416 >> 172.21.15.37:0/419584416 conn(0x7f75d40b3b10 msgr2=0x7f75d40b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 -- 172.21.15.37:0/419584416 shutdown_connections 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.759+0000 7f75da7a4640 1 -- 172.21.15.37:0/419584416 wait complete. 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.760+0000 7f75da7a4640 1 Processor -- start 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.760+0000 7f75da7a4640 1 -- start start 2024-05-10T08:45:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75da7a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d4156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75da7a4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 0x7f75d4146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75da7a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d415d180 0x7f75d4147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75da7a4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40b4fc0 con 0x7f75d406c3a0 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75da7a4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75d415dff0 con 0x7f75d415d180 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75da7a4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f75d40b5140 con 0x7f75d40aedf0 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d4156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d4156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49352/0 (socket says 172.21.15.37:49352) 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 -- 172.21.15.37:0/705414473 learned_addr learned my addr 172.21.15.37:0/705414473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 -- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 msgr2=0x7f75d4146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 0x7f75d4146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 -- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d415d180 msgr2=0x7f75d4147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d415d180 0x7f75d4147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.761+0000 7f75d3fff640 1 -- 172.21.15.37:0/705414473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d409f400 con 0x7f75d406c3a0 2024-05-10T08:45:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.762+0000 7f75d3fff640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d4156e10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097a0 tx=0x7f75c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.762+0000 7f75d17fa640 1 -- 172.21.15.37:0/705414473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4037040 con 0x7f75d406c3a0 2024-05-10T08:45:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.762+0000 7f75d17fa640 1 -- 172.21.15.37:0/705414473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c4004250 con 0x7f75d406c3a0 2024-05-10T08:45:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.762+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d409f6e0 con 0x7f75d406c3a0 2024-05-10T08:45:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.762+0000 7f75d17fa640 1 -- 172.21.15.37:0/705414473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4032e20 con 0x7f75d406c3a0 2024-05-10T08:45:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.762+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d4148280 con 0x7f75d406c3a0 2024-05-10T08:45:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.763+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d406a8f0 con 0x7f75d406c3a0 2024-05-10T08:45:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.763+0000 7f75d17fa640 1 -- 172.21.15.37:0/705414473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75c4030770 con 0x7f75d406c3a0 2024-05-10T08:45:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.764+0000 7f75d17fa640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f75b40762d0 0x7f75b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.764+0000 7f75d17fa640 1 -- 172.21.15.37:0/705414473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f75c40b8a00 con 0x7f75d406c3a0 2024-05-10T08:45:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.764+0000 7f75cbfff640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f75b40762d0 0x7f75b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.765+0000 7f75cbfff640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f75b40762d0 0x7f75b4078790 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75d406cd90 tx=0x7f75bc006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:42.768+0000 7f75d17fa640 1 -- 172.21.15.37:0/705414473 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f75c4082260 con 0x7f75d406c3a0 2024-05-10T08:45:43.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.001+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f75d4075f20 con 0x7f75d406c3a0 2024-05-10T08:45:43.000 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:45:43.001+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:45:43.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.003+0000 7f75d17fa640 1 -- 172.21.15.37:0/705414473 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) ==== 161+0+0 (secure 0 0 0) 0x7f75c4081b60 con 0x7f75d406c3a0 2024-05-10T08:45:43.001 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:45:43.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f75b40762d0 msgr2=0x7f75b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f75b40762d0 0x7f75b4078790 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75d406cd90 tx=0x7f75bc006c90 comp rx=0 tx=0).stop 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 msgr2=0x7f75d4156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d4156e10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097a0 tx=0x7f75c40046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 shutdown_connections 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f75b40762d0 0x7f75b4078790 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d415d180 0x7f75d4147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f75d40aedf0 0x7f75d4146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 --2- 172.21.15.37:0/705414473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d406c3a0 0x7f75d4156e10 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 >> 172.21.15.37:0/705414473 conn(0x7f75d40b3b10 msgr2=0x7f75d40b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 shutdown_connections 2024-05-10T08:45:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.006+0000 7f75da7a4640 1 -- 172.21.15.37:0/705414473 wait complete. 2024-05-10T08:45:43.008 INFO:tasks.ceph.mds.c.smithi037.stderr: -4801> 2024-05-10T08:45:40.293+0000 7f6f958ff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:45:43.020 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-05-10T08:45:43.043 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:45:43.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.066+0000 7f3068caff40 1 Processor -- start 2024-05-10T08:45:43.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.066+0000 7f3068caff40 1 -- start start 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3068caff40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e8895b10 0x5640e87fac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3068caff40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e87fb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3068caff40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e889e420 0x5640e889e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3068caff40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5640e87ceff0 con 0x5640e889e420 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3068caff40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5640e8773f50 con 0x5640e88140a0 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3068caff40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5640e87cfde0 con 0x5640e8895b10 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e889e420 0x5640e889e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e889e420 0x5640e889e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49366/0 (socket says 172.21.15.37:49366) 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 -- 172.21.15.37:0/1141541545 learned_addr learned my addr 172.21.15.37:0/1141541545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f305ffff640 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e87fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f30667a9640 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e8895b10 0x5640e87fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 -- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e8895b10 msgr2=0x5640e87fac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e8895b10 0x5640e87fac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 -- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 msgr2=0x5640e87fb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e87fb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 -- 172.21.15.37:0/1141541545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640e8813b90 con 0x5640e889e420 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f305ffff640 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e87fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f3066faa640 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e889e420 0x5640e889e8a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3060026100 tx=0x7f306004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb0b7546ee599fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f30657a7640 1 -- 172.21.15.37:0/1141541545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30600019b0 con 0x5640e889e420 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f30657a7640 1 -- 172.21.15.37:0/1141541545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3060006070 con 0x5640e889e420 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.067+0000 7f30657a7640 1 -- 172.21.15.37:0/1141541545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306004d990 con 0x5640e889e420 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 -- 172.21.15.37:0/1141541545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e889e420 msgr2=0x5640e889e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e889e420 0x5640e889e8a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3060026100 tx=0x7f306004f000 comp rx=0 tx=0).stop 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 -- 172.21.15.37:0/1141541545 shutdown_connections 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e889e420 0x5640e889e8a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e87fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 --2- 172.21.15.37:0/1141541545 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e8895b10 0x5640e87fac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 -- 172.21.15.37:0/1141541545 >> 172.21.15.37:0/1141541545 conn(0x5640e87f9b40 msgr2=0x5640e87ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 -- 172.21.15.37:0/1141541545 shutdown_connections 2024-05-10T08:45:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.068+0000 7f3068caff40 1 -- 172.21.15.37:0/1141541545 wait complete. 2024-05-10T08:45:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 Processor -- start 2024-05-10T08:45:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 -- start start 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e88845c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e8895b10 0x5640e8898780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e889e420 0x5640e8898cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5640e88a47a0 con 0x5640e8895b10 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5640e88a44c0 con 0x5640e88140a0 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f3068caff40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5640e88a4a80 con 0x5640e889e420 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f305ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e8895b10 0x5640e8898780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f305ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e8895b10 0x5640e8898780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49368/0 (socket says 172.21.15.37:49368) 2024-05-10T08:45:43.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f305ffff640 1 -- 172.21.15.37:0/805540639 learned_addr learned my addr 172.21.15.37:0/805540639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.069+0000 7f30667a9640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e88845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f3066faa640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e889e420 0x5640e8898cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305ffff640 1 -- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e889e420 msgr2=0x5640e8898cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305ffff640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5640e889e420 0x5640e8898cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305ffff640 1 -- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 msgr2=0x5640e88845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305ffff640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640e88140a0 0x5640e88845c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305ffff640 1 -- 172.21.15.37:0/805540639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640e8893b60 con 0x5640e8895b10 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305ffff640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e8895b10 0x5640e8898780 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3050009f30 tx=0x7f30500084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305f7fe640 1 -- 172.21.15.37:0/805540639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305001a020 con 0x5640e8895b10 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305f7fe640 1 -- 172.21.15.37:0/805540639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3050016650 con 0x5640e8895b10 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640e8893e40 con 0x5640e8895b10 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f305f7fe640 1 -- 172.21.15.37:0/805540639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3050016a40 con 0x5640e8895b10 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.070+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640e8894400 con 0x5640e8895b10 2024-05-10T08:45:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.072+0000 7f305f7fe640 1 -- 172.21.15.37:0/805540639 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f305001d020 con 0x5640e8895b10 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.072+0000 7f305f7fe640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3048074cb0 0x7f3048077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.072+0000 7f305f7fe640 1 -- 172.21.15.37:0/805540639 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f3050096cc0 con 0x5640e8895b10 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.072+0000 7f30667a9640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3048074cb0 0x7f3048077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.072+0000 7f3068caff40 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5640e8894c00 0x5640e889b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.072+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e88) -- 0x5640e88a00a0 con 0x5640e8894c00 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.073+0000 7f3066faa640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5640e8894c00 0x5640e889b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.073+0000 7f30667a9640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3048074cb0 0x7f3048077170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3058005400 tx=0x7f305800c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.073+0000 7f3066faa640 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5640e8894c00 0x5640e889b8e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3066faa640 1 -- 172.21.15.37:0/805540639 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v88'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f30600017b0 con 0x5640e8894c00 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5640e8894c00 msgr2=0x5640e889b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5640e8894c00 0x5640e889b8e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3048074cb0 msgr2=0x7f3048077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3048074cb0 0x7f3048077170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3058005400 tx=0x7f305800c040 comp rx=0 tx=0).stop 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e8895b10 msgr2=0x5640e8898780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 --2- 172.21.15.37:0/805540639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640e8895b10 0x5640e8898780 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3050009f30 tx=0x7f30500084c0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3066faa640 1 -- 172.21.15.37:0/805540639 reap_dead start 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 shutdown_connections 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 >> 172.21.15.37:0/805540639 conn(0x5640e87f9b40 msgr2=0x5640e87c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 shutdown_connections 2024-05-10T08:45:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.076+0000 7f3068caff40 1 -- 172.21.15.37:0/805540639 wait complete. 2024-05-10T08:45:43.079 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-05-10T08:45:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.161+0000 7f05f96d0280 1 -- start start 2024-05-10T08:45:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.161+0000 7f05f96d0280 1 Processor -- start 2024-05-10T08:45:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047d876c00 0x56047e652000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047d877800 0x56047e652580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047d877c00 0x56047e652b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f96d0280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56047e614180 con 0x56047d876c00 2024-05-10T08:45:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56047e614300 con 0x56047d877c00 2024-05-10T08:45:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56047e614480 con 0x56047d877800 2024-05-10T08:45:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047d876c00 0x56047e652000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047d876c00 0x56047e652000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49378/0 (socket says 172.21.15.37:49378) 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2214430738 learned_addr learned my addr 172.21.15.37:0/2214430738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f867d640 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047d877c00 0x56047e652b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f767b640 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047d877800 0x56047e652580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047d877800 msgr2=0x56047e652580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047d877800 0x56047e652580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047d877c00 msgr2=0x56047e652b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047d877c00 0x56047e652b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2214430738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047d8ac780 con 0x56047d876c00 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.162+0000 7f05f767b640 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047d877800 0x56047e652580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047d876c00 0x56047e652000 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x56047e6a1800 tx=0x56047e618b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5449073dbc09931 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f5677640 1 -- 172.21.15.37:0/2214430738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047d89c680 con 0x56047d876c00 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f5677640 1 -- 172.21.15.37:0/2214430738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56047d8a2a80 con 0x56047d876c00 2024-05-10T08:45:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f5677640 1 -- 172.21.15.37:0/2214430738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047d89cb60 con 0x56047d876c00 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f96d0280 1 -- 172.21.15.37:0/2214430738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047d8ac3c0 con 0x56047d876c00 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f96d0280 1 -- 172.21.15.37:0/2214430738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56047d8ad680 con 0x56047d876c00 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f96d0280 4 waiting for MDS map... 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f5677640 1 -- 172.21.15.37:0/2214430738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x56047e75ea00 con 0x56047d876c00 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f5677640 1 -- 172.21.15.37:0/2214430738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 62) ==== 2885+0+0 (secure 0 0 0) 0x56047d8d1180 con 0x56047d876c00 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f96d0280 4 Got MDS map 62 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f96d0280 10 main: JournalTool::main 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.163+0000 7f05f96d0280 4 main: JournalTool: connecting to RADOS... 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 Processor -- start 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 -- start start 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56047e614600 con 0x56047e67f800 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56047e614780 con 0x56047e67f400 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56047e614900 con 0x56047e67fc00 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49388/0 (socket says 172.21.15.37:49388) 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3670096772 learned_addr learned my addr 172.21.15.37:0/3670096772 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.164+0000 7f05f867d640 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f767b640 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 msgr2=0x56047e653b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 msgr2=0x56047e653080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3670096772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047d8ad4a0 con 0x56047e67f800 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x56047e74a690 tx=0x56047e616720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fce8a9f42db669 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f3673640 1 -- 172.21.15.37:0/3670096772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047d89c820 con 0x56047e67f800 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f3673640 1 -- 172.21.15.37:0/3670096772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56047d8a2fc0 con 0x56047e67f800 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f3673640 1 -- 172.21.15.37:0/3670096772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047d89c680 con 0x56047e67f800 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 -- 172.21.15.37:0/3670096772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 msgr2=0x56047e653600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x56047e74a690 tx=0x56047e616720 comp rx=0 tx=0).stop 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 -- 172.21.15.37:0/3670096772 shutdown_connections 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3670096772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 -- 172.21.15.37:0/3670096772 >> 172.21.15.37:0/3670096772 conn(0x56047e67f000 msgr2=0x56047d971000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 -- 172.21.15.37:0/3670096772 shutdown_connections 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.165+0000 7f05f96d0280 1 -- 172.21.15.37:0/3670096772 wait complete. 2024-05-10T08:45:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.166+0000 7f05f96d0280 1 Processor -- start 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.166+0000 7f05f96d0280 1 -- start start 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56047e615b00 con 0x56047e67f800 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56047e615980 con 0x56047e67f400 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56047e615800 con 0x56047e67fc00 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49396/0 (socket says 172.21.15.37:49396) 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2969542023 learned_addr learned my addr 172.21.15.37:0/2969542023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f767b640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f867d640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 msgr2=0x56047e653b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 msgr2=0x56047e653080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 -- 172.21.15.37:0/2969542023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047d8ac780 con 0x56047e67f800 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f767b640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x56047e74b950 tx=0x56047e687800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f1e70640 1 -- 172.21.15.37:0/2969542023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047d89cb60 con 0x56047e67f800 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f1e70640 1 -- 172.21.15.37:0/2969542023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56047d8a2e00 con 0x56047e67f800 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56047d8ac3c0 con 0x56047e67f800 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f1e70640 1 -- 172.21.15.37:0/2969542023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047d89c4e0 con 0x56047e67f800 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047d8ad680 con 0x56047e67f800 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.167+0000 7f05f96d0280 4 main: JournalTool: resolving pool 13 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.169+0000 7f05f1e70640 1 -- 172.21.15.37:0/2969542023 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x56047e7c0c00 con 0x56047e67f800 2024-05-10T08:45:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.169+0000 7f05f1e70640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56047e7bb000 0x56047e654100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.169+0000 7f05f1e70640 1 -- 172.21.15.37:0/2969542023 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x56047e7ce600 con 0x56047e67f800 2024-05-10T08:45:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.169+0000 7f05f96d0280 4 main: JournalTool: creating IoCtx.. 2024-05-10T08:45:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.169+0000 7f05f96d0280 4 main: Executing for rank 0 2024-05-10T08:45:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.169+0000 7f05f867d640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56047e7bb000 0x56047e654100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.170+0000 7f05f867d640 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56047e7bb000 0x56047e654100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x56047d8affb0 tx=0x56047e617f20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.170+0000 7f05f96d0280 1 -- start start 2024-05-10T08:45:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.170+0000 7f05f96d0280 1 Processor -- start 2024-05-10T08:45:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.170+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e7bb800 0x56047e654680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.170+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e7bbc00 0x56047e654c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f96d0280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047dc6e000 0x56047e655180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f96d0280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56047e614780 con 0x56047e7bbc00 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56047e614900 con 0x56047dc6e000 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f96d0280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56047e615500 con 0x56047e7bb800 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e7bbc00 0x56047e654c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e7bbc00 0x56047e654c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49410/0 (socket says 172.21.15.37:49410) 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3231002003 learned_addr learned my addr 172.21.15.37:0/3231002003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f867d640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e7bb800 0x56047e654680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f767b640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047dc6e000 0x56047e655180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e7bb800 msgr2=0x56047e654680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e7bb800 0x56047e654680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047dc6e000 msgr2=0x56047e655180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047dc6e000 0x56047e655180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047d8ac000 con 0x56047e7bbc00 2024-05-10T08:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e7bbc00 0x56047e654c00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x56047dbaf620 tx=0x56047dc700c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91db66536ecaafcb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05eee6a640 1 -- 172.21.15.37:0/3231002003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047db97860 con 0x56047e7bbc00 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05eee6a640 1 -- 172.21.15.37:0/3231002003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56047d8a2c40 con 0x56047e7bbc00 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047d8ad4a0 con 0x56047e7bbc00 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56047d8ac780 con 0x56047e7bbc00 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05f96d0280 4 waiting for MDS map... 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.171+0000 7f05eee6a640 1 -- 172.21.15.37:0/3231002003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56047db97a00 con 0x56047e7bbc00 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.172+0000 7f05eee6a640 1 -- 172.21.15.37:0/3231002003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x56047dc76400 con 0x56047e7bbc00 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.172+0000 7f05eee6a640 1 -- 172.21.15.37:0/3231002003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 62) ==== 2885+0+0 (secure 0 0 0) 0x56047d8d1500 con 0x56047e7bbc00 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.172+0000 7f05f96d0280 4 Got MDS map 62 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.172+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56047dc6e400 0x56047e655700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.172+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x56047dc6e800 con 0x56047dc6e400 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.172+0000 7f05f867d640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56047dc6e400 0x56047e655700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.172+0000 7f05f867d640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56047dc6e400 0x56047e655700 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=21b8666b9bb74376 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.175+0000 7f05f867d640 1 -- 172.21.15.37:0/3231002003 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x56047d984000 con 0x56047dc6e400 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.175+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56047dc6ec00 0x56047dc94000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.175+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:2 13.14 13:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x56047dc6f000 con 0x56047dc6ec00 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.175+0000 7f05f767b640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56047dc6ec00 0x56047dc94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.175+0000 7f05f767b640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56047dc6ec00 0x56047dc94000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=813d25cd2607245e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.178+0000 7f05f767b640 1 -- 172.21.15.37:0/3231002003 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x56047d984500 con 0x56047dc6ec00 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.178+0000 7f05ed667640 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:3 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e88) -- 0x56047dc7e800 con 0x56047dc6ec00 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.178+0000 7f05ed667640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56047dc7ec00 0x56047dc95b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.178+0000 7f05ed667640 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:4 13.1b 13:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e88) -- 0x56047dc7f000 con 0x56047dc7ec00 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.178+0000 7f05f767b640 1 -- 172.21.15.37:0/3231002003 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x56047d984500 con 0x56047dc6ec00 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.178+0000 7f05f867d640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56047dc7ec00 0x56047dc95b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.178+0000 7f05f867d640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56047dc7ec00 0x56047dc95b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=fb29e7ee0bcfa890 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.179+0000 7f05f867d640 1 -- 172.21.15.37:0/3231002003 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56047d984000 con 0x56047dc7ec00 2024-05-10T08:45:43.183 INFO:teuthology.orchestra.run.smithi037.stdout:old journal was 4212139~2605 2024-05-10T08:45:43.183 INFO:teuthology.orchestra.run.smithi037.stdout:new journal start will be 8388608 (4173864 bytes past old end) 2024-05-10T08:45:43.183 INFO:teuthology.orchestra.run.smithi037.stdout:writing journal head 2024-05-10T08:45:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.179+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:5 13.14 13:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047dc6f400 con 0x56047dc6ec00 2024-05-10T08:45:43.183 INFO:teuthology.orchestra.run.smithi037.stdout:writing EResetJournal entry 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f767b640 1 -- 172.21.15.37:0/3231002003 <== osd.0 v2:172.21.15.37:6811/38998236 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v88'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56047d984500 con 0x56047dc6ec00 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:6 13.1b 13:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047dc7e800 con 0x56047dc7ec00 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56047dc7f400 0x56047dc94580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:7 13.b 13:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047dc7f800 con 0x56047dc7f400 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:8 13.1f 13:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047dc7fc00 con 0x56047dc6e400 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56047dc6f000 0x56047dc94b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:9 13.1a 13:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047dc7f000 con 0x56047dc6f000 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:10 13.1e 13:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047dc7e800 con 0x56047dc7ec00 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56047dc6e800 0x56047dc95080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:11 13.1d 13:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047e667400 con 0x56047dc6e800 2024-05-10T08:45:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f767b640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56047dc6f000 0x56047dc94b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56047dc7f400 0x56047dc94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.180+0000 7f05f867d640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56047dc6e800 0x56047dc95080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.181+0000 7f05f767b640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56047dc6f000 0x56047dc94b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=3ad86e27c2ef0f39 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.181+0000 7f05f7e7c640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56047dc7f400 0x56047dc94580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=42230d210ddaf8fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.181+0000 7f05f867d640 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56047dc6e800 0x56047dc95080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=eb358e6be560329f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.182+0000 7f05f867d640 1 -- 172.21.15.37:0/3231002003 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== osd_op_reply(6 200.00000002 [delete] v88'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56047d984000 con 0x56047dc7ec00 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.182+0000 7f05f867d640 1 -- 172.21.15.37:0/3231002003 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(8 200.00000004 [delete] v88'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56047d984000 con 0x56047dc6e400 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.184+0000 7f05f867d640 1 -- 172.21.15.37:0/3231002003 <== osd.4 v2:172.21.15.82:6808/3594167095 3 ==== osd_op_reply(10 200.00000006 [delete] v88'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56047d984000 con 0x56047dc7ec00 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.184+0000 7f05f767b640 1 -- 172.21.15.37:0/3231002003 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(9 200.00000005 [delete] v88'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56047d984500 con 0x56047dc6f000 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.186+0000 7f05f7e7c640 1 -- 172.21.15.37:0/3231002003 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(7 200.00000003 [delete] v88'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56047d984780 con 0x56047dc7f400 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.186+0000 7f05ed667640 1 -- 172.21.15.37:0/3231002003 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:12 13.1b 13:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x56047dcaa000 con 0x56047dc7ec00 2024-05-10T08:45:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.187+0000 7f05f867d640 1 -- 172.21.15.37:0/3231002003 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(11 200.00000007 [delete] v88'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56047d984000 con 0x56047dc6e800 2024-05-10T08:45:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f867d640 1 -- 172.21.15.37:0/3231002003 <== osd.4 v2:172.21.15.82:6808/3594167095 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v88'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56047d984000 con 0x56047dc7ec00 2024-05-10T08:45:43.189 INFO:teuthology.orchestra.run.smithi037.stdout:done 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56047dc6ec00 msgr2=0x56047dc94000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56047dc6ec00 0x56047dc94000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56047dc6f000 msgr2=0x56047dc94b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56047dc6f000 0x56047dc94b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56047dc7ec00 msgr2=0x56047dc95b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56047dc7ec00 0x56047dc95b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56047dc7f400 msgr2=0x56047dc94580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56047dc7f400 0x56047dc94580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56047dc6e400 msgr2=0x56047e655700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56047dc6e400 0x56047e655700 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56047dc6e800 msgr2=0x56047dc95080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56047dc6e800 0x56047dc95080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f767b640 1 -- 172.21.15.37:0/3231002003 reap_dead start 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f767b640 1 -- 172.21.15.37:0/3231002003 reap_dead start 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e7bbc00 msgr2=0x56047e654c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e7bbc00 0x56047e654c00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x56047dbaf620 tx=0x56047dc700c0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 shutdown_connections 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/3231002003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e7bbc00 0x56047e654c00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 >> 172.21.15.37:0/3231002003 conn(0x56047e7bb400 msgr2=0x56047d971800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 shutdown_connections 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/3231002003 wait complete. 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56047e7bb000 msgr2=0x56047e654100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56047e7bb000 0x56047e654100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x56047d8affb0 tx=0x56047e617f20 comp rx=0 tx=0).stop 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 msgr2=0x56047e653600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x56047e74b950 tx=0x56047e687800 comp rx=0 tx=0).stop 2024-05-10T08:45:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 shutdown_connections 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56047e7bb000 0x56047e654100 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047e67fc00 0x56047e653b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047e67f800 0x56047e653600 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.190+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2969542023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047e67f400 0x56047e653080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 >> 172.21.15.37:0/2969542023 conn(0x56047e67f000 msgr2=0x56047d971000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 shutdown_connections 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2969542023 wait complete. 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2214430738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047d876c00 msgr2=0x56047e652000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047d876c00 0x56047e652000 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x56047e6a1800 tx=0x56047e618b40 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2214430738 shutdown_connections 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56047d877c00 0x56047e652b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56047d877800 0x56047e652580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 --2- 172.21.15.37:0/2214430738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56047d876c00 0x56047e652000 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2214430738 >> 172.21.15.37:0/2214430738 conn(0x56047d877000 msgr2=0x56047d970800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2214430738 shutdown_connections 2024-05-10T08:45:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.191+0000 7f05f96d0280 1 -- 172.21.15.37:0/2214430738 wait complete. 2024-05-10T08:45:43.195 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.116870, result: old journal was 4212139~2605 new journal start will be 8388608 (4173864 bytes past old end) writing journal head writing EResetJournal entry done 2024-05-10T08:45:43.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T08:45:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.343+0000 7f6e9c16a640 1 Processor -- start 2024-05-10T08:45:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.343+0000 7f6e9c16a640 1 -- start start 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e9c16a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6e940b6590 0x7f6e940d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e9c16a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e940d2bb0 0x7f6e94162d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e9c16a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e940d3320 con 0x7f6e94163290 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e9c16a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6e940d3600 con 0x7f6e940d2bb0 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e9c16a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6e940d38e0 con 0x7f6e940b6590 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99705640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e940d2bb0 0x7f6e94162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99705640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e940d2bb0 0x7f6e94162d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49422/0 (socket says 172.21.15.37:49422) 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99705640 1 -- 172.21.15.37:0/1678289665 learned_addr learned my addr 172.21.15.37:0/1678289665 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99f06640 1 --2- 172.21.15.37:0/1678289665 >> v2:172.21.15.82:3300/0 conn(0x7f6e940b6590 0x7f6e940d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99705640 1 -- 172.21.15.37:0/1678289665 >> v2:172.21.15.82:3300/0 conn(0x7f6e940b6590 msgr2=0x7f6e940d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99705640 1 --2- 172.21.15.37:0/1678289665 >> v2:172.21.15.82:3300/0 conn(0x7f6e940b6590 0x7f6e940d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99705640 1 -- 172.21.15.37:0/1678289665 >> v1:172.21.15.82:6789/0 conn(0x7f6e94163290 legacy=0x7f6e9415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.344+0000 7f6e99705640 1 -- 172.21.15.37:0/1678289665 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e940d3bc0 con 0x7f6e940d2bb0 2024-05-10T08:45:43.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.345+0000 7f6e99705640 1 --2- 172.21.15.37:0/1678289665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e940d2bb0 0x7f6e94162d50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6e940d4f40 tx=0x7f6e8802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac952623b5a3eefa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.345+0000 7f6e98f04640 1 -- 172.21.15.37:0/1678289665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88037070 con 0x7f6e940d2bb0 2024-05-10T08:45:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.345+0000 7f6e98f04640 1 -- 172.21.15.37:0/1678289665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88032440 con 0x7f6e940d2bb0 2024-05-10T08:45:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.345+0000 7f6e98f04640 1 -- 172.21.15.37:0/1678289665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88032810 con 0x7f6e940d2bb0 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 -- 172.21.15.37:0/1678289665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e940d2bb0 msgr2=0x7f6e94162d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/1678289665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e940d2bb0 0x7f6e94162d50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6e940d4f40 tx=0x7f6e8802a230 comp rx=0 tx=0).stop 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 -- 172.21.15.37:0/1678289665 shutdown_connections 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/1678289665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e940d2bb0 0x7f6e94162d50 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/1678289665 >> v2:172.21.15.82:3300/0 conn(0x7f6e940b6590 0x7f6e940d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 -- 172.21.15.37:0/1678289665 >> 172.21.15.37:0/1678289665 conn(0x7f6e940d4fe0 msgr2=0x7f6e940d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 -- 172.21.15.37:0/1678289665 shutdown_connections 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.346+0000 7f6e9c16a640 1 -- 172.21.15.37:0/1678289665 wait complete. 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.347+0000 7f6e9c16a640 1 Processor -- start 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.347+0000 7f6e9c16a640 1 -- start start 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9c16a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e940b6590 0x7f6e9415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9c16a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e940d2bb0 0x7f6e940c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9c16a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e94163290 0x7f6e940ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9c16a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9415f340 con 0x7f6e94163290 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9c16a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e940d3010 con 0x7f6e940b6590 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9c16a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9415f4c0 con 0x7f6e940d2bb0 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e94163290 0x7f6e940ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e94163290 0x7f6e940ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49430/0 (socket says 172.21.15.37:49430) 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 -- 172.21.15.37:0/3848512781 learned_addr learned my addr 172.21.15.37:0/3848512781 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e99f06640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e940b6590 0x7f6e9415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e99705640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e940d2bb0 0x7f6e940c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 -- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e940d2bb0 msgr2=0x7f6e940c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e940d2bb0 0x7f6e940c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 -- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e940b6590 msgr2=0x7f6e9415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e940b6590 0x7f6e9415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 -- 172.21.15.37:0/3848512781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e941f52b0 con 0x7f6e94163290 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e99705640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e940d2bb0 0x7f6e940c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.348+0000 7f6e9a707640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e94163290 0x7f6e940ca3d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400b970 tx=0x7f6e8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.349+0000 7f6e927fc640 1 -- 172.21.15.37:0/3848512781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84019070 con 0x7f6e94163290 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.349+0000 7f6e927fc640 1 -- 172.21.15.37:0/3848512781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8400cb40 con 0x7f6e94163290 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.349+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e94160150 con 0x7f6e94163290 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.349+0000 7f6e927fc640 1 -- 172.21.15.37:0/3848512781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84014440 con 0x7f6e94163290 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.349+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e94160710 con 0x7f6e94163290 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.350+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e940693f0 con 0x7f6e94163290 2024-05-10T08:45:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.350+0000 7f6e927fc640 1 -- 172.21.15.37:0/3848512781 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e8401c070 con 0x7f6e94163290 2024-05-10T08:45:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.351+0000 7f6e927fc640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e80076300 0x7f6e800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.351+0000 7f6e927fc640 1 -- 172.21.15.37:0/3848512781 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f6e84097430 con 0x7f6e94163290 2024-05-10T08:45:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.351+0000 7f6e99f06640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e80076300 0x7f6e800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.352+0000 7f6e99f06640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e80076300 0x7f6e800787c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c006fd0 tx=0x7f6e8c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.355+0000 7f6e927fc640 1 -- 172.21.15.37:0/3848512781 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6e84060560 con 0x7f6e94163290 2024-05-10T08:45:43.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.586+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f6e941f5480 con 0x7f6e94163290 2024-05-10T08:45:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.733+0000 7f6e927fc640 1 -- 172.21.15.37:0/3848512781 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v63) ==== 162+0+0 (secure 0 0 0) 0x7f6e84064860 con 0x7f6e94163290 2024-05-10T08:45:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e80076300 msgr2=0x7f6e800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e80076300 0x7f6e800787c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c006fd0 tx=0x7f6e8c008040 comp rx=0 tx=0).stop 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e94163290 msgr2=0x7f6e940ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e94163290 0x7f6e940ca3d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400b970 tx=0x7f6e8400be30 comp rx=0 tx=0).stop 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 shutdown_connections 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6e80076300 0x7f6e800787c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e94163290 0x7f6e940ca3d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e940d2bb0 0x7f6e940c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 --2- 172.21.15.37:0/3848512781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e940b6590 0x7f6e9415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 >> 172.21.15.37:0/3848512781 conn(0x7f6e940d4fe0 msgr2=0x7f6e940b8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 shutdown_connections 2024-05-10T08:45:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.736+0000 7f6e9c16a640 1 -- 172.21.15.37:0/3848512781 wait complete. 2024-05-10T08:45:43.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.852+0000 7effbc79e640 1 Processor -- start 2024-05-10T08:45:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.852+0000 7effbc79e640 1 -- start start 2024-05-10T08:45:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effbc79e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7effb4070d30 0x7effb40d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effbc79e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effbc79e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40d1300 con 0x7effb4163920 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effbc79e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7effb40d10d0 con 0x7effb4070d30 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effbc79e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7effb4163db0 con 0x7effb4071110 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effba53a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7effb4070d30 0x7effb40d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effb9d39640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7effb4163920 0x7effb40703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41784/0 (socket says 172.21.15.37:41784) 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effba53a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7effb4070d30 0x7effb40d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49438/0 (socket says 172.21.15.37:49438) 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effb9d39640 1 -- 172.21.15.37:0/1886971973 learned_addr learned my addr 172.21.15.37:0/1886971973 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effbad3b640 1 --2- 172.21.15.37:0/1886971973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effba53a640 1 -- 172.21.15.37:0/1886971973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 msgr2=0x7effb406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effba53a640 1 --2- 172.21.15.37:0/1886971973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effba53a640 1 -- 172.21.15.37:0/1886971973 >> v1:172.21.15.37:6789/0 conn(0x7effb4163920 legacy=0x7effb40703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effba53a640 1 -- 172.21.15.37:0/1886971973 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40d15e0 con 0x7effb4070d30 2024-05-10T08:45:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.853+0000 7effb9538640 1 -- 172.21.15.37:0/1886971973 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635769937 0 0) 0x7effb40d1300 con 0x7effb4163920 2024-05-10T08:45:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.854+0000 7effbad3b640 1 --2- 172.21.15.37:0/1886971973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.854+0000 7effba53a640 1 --2- 172.21.15.37:0/1886971973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4070d30 0x7effb40d20c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7effac0097a0 tx=0x7effac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5613504ac3eb048 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.854+0000 7effb9538640 1 -- 172.21.15.37:0/1886971973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac037070 con 0x7effb4070d30 2024-05-10T08:45:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.854+0000 7effb9538640 1 -- 172.21.15.37:0/1886971973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac032440 con 0x7effb4070d30 2024-05-10T08:45:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.854+0000 7effb9538640 1 -- 172.21.15.37:0/1886971973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac032810 con 0x7effb4070d30 2024-05-10T08:45:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 -- 172.21.15.37:0/1886971973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4070d30 msgr2=0x7effb40d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 --2- 172.21.15.37:0/1886971973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4070d30 0x7effb40d20c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7effac0097a0 tx=0x7effac02a180 comp rx=0 tx=0).stop 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 -- 172.21.15.37:0/1886971973 shutdown_connections 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 --2- 172.21.15.37:0/1886971973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 --2- 172.21.15.37:0/1886971973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4070d30 0x7effb40d20c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 -- 172.21.15.37:0/1886971973 >> 172.21.15.37:0/1886971973 conn(0x7effb40d2e90 msgr2=0x7effb40d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 -- 172.21.15.37:0/1886971973 shutdown_connections 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.855+0000 7effbc79e640 1 -- 172.21.15.37:0/1886971973 wait complete. 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.856+0000 7effbc79e640 1 Processor -- start 2024-05-10T08:45:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.856+0000 7effbc79e640 1 -- start start 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbc79e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb4070d30 0x7effb41f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbc79e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb40b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbc79e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4163920 0x7effb40b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbc79e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effb40d1c30 con 0x7effb4163920 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbc79e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7effb4070b80 con 0x7effb4070d30 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbc79e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7effb40715a0 con 0x7effb4071110 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4163920 0x7effb40b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4163920 0x7effb40b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49454/0 (socket says 172.21.15.37:49454) 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 -- 172.21.15.37:0/2284634615 learned_addr learned my addr 172.21.15.37:0/2284634615 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effb9d39640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb40b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effba53a640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb4070d30 0x7effb41f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 -- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 msgr2=0x7effb40b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb40b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 -- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb4070d30 msgr2=0x7effb41f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb4070d30 0x7effb41f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 -- 172.21.15.37:0/2284634615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40b7650 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effba53a640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb4070d30 0x7effb41f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.857+0000 7effbad3b640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4163920 0x7effb40b2d30 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7effa400cd80 tx=0x7effa400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.858+0000 7effb2ffd640 1 -- 172.21.15.37:0/2284634615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa400f680 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.858+0000 7effb2ffd640 1 -- 172.21.15.37:0/2284634615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa400f840 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.858+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb40b7930 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.858+0000 7effb2ffd640 1 -- 172.21.15.37:0/2284634615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa400fc30 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.858+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb40b7ef0 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.859+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb40722a0 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.859+0000 7effb2ffd640 1 -- 172.21.15.37:0/2284634615 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7effa40213f0 con 0x7effb4163920 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.860+0000 7effb2ffd640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa00762d0 0x7effa0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.860+0000 7effb2ffd640 1 -- 172.21.15.37:0/2284634615 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7effa4098510 con 0x7effb4163920 2024-05-10T08:45:43.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.860+0000 7effba53a640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa00762d0 0x7effa0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:43.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.861+0000 7effba53a640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa00762d0 0x7effa0078790 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7effac034000 tx=0x7effac02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:43.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:43.864+0000 7effb2ffd640 1 -- 172.21.15.37:0/2284634615 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7effb40722a0 con 0x7effb4163920 2024-05-10T08:45:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.093+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effb40d3520 con 0x7effb4163920 2024-05-10T08:45:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.094+0000 7effb2ffd640 1 -- 172.21.15.37:0/2284634615 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5171 (secure 0 0 0) 0x7effa4014030 con 0x7effb4163920 2024-05-10T08:45:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:44.094 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:43.731750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6834/375241165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":375241165},{"type":"v1","addr":"172.21.15.37:6834","nonce":375241165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T08:45:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 63 2024-05-10T08:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa00762d0 msgr2=0x7effa0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa00762d0 0x7effa0078790 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7effac034000 tx=0x7effac02e000 comp rx=0 tx=0).stop 2024-05-10T08:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4163920 msgr2=0x7effb40b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4163920 0x7effb40b2d30 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7effa400cd80 tx=0x7effa400a650 comp rx=0 tx=0).stop 2024-05-10T08:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 shutdown_connections 2024-05-10T08:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa00762d0 0x7effa0078790 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb4163920 0x7effb40b2d30 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4071110 0x7effb40b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 --2- 172.21.15.37:0/2284634615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb4070d30 0x7effb41f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 >> 172.21.15.37:0/2284634615 conn(0x7effb40d2e90 msgr2=0x7effb406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 shutdown_connections 2024-05-10T08:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:44.096+0000 7effbc79e640 1 -- 172.21.15.37:0/2284634615 wait complete. 2024-05-10T08:45:44.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:45:33.691603+0000', 'modified': '2024-05-10T08:45:43.731750+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6870': {'gid': 6870, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6834/375241165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 375241165}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 375241165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:45:44.509 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6870:up:replay 2024-05-10T08:45:45.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.628+0000 7fc96a5f7640 1 Processor -- start 2024-05-10T08:45:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.628+0000 7fc96a5f7640 1 -- start start 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc96a5f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc96406f060 0x7fc96406e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc96a5f7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc96406fe30 0x7fc9640cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc96a5f7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96415d2a0 con 0x7fc9640d0360 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc96a5f7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc9640d07c0 con 0x7fc96406f060 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc96a5f7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc96406f440 con 0x7fc96406fe30 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc963fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc96406f060 0x7fc96406e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc963fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc96406f060 0x7fc96406e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49460/0 (socket says 172.21.15.37:49460) 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc968b94640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc9640d0360 0x7fc9640b3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41788/0 (socket says 172.21.15.37:41788) 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc963fff640 1 -- 172.21.15.37:0/2428705690 learned_addr learned my addr 172.21.15.37:0/2428705690 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.629+0000 7fc9637fe640 1 --2- 172.21.15.37:0/2428705690 >> v2:172.21.15.82:3300/0 conn(0x7fc96406fe30 0x7fc9640cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.630+0000 7fc963fff640 1 -- 172.21.15.37:0/2428705690 >> v2:172.21.15.82:3300/0 conn(0x7fc96406fe30 msgr2=0x7fc9640cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.630+0000 7fc963fff640 1 --2- 172.21.15.37:0/2428705690 >> v2:172.21.15.82:3300/0 conn(0x7fc96406fe30 0x7fc9640cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.630+0000 7fc963fff640 1 -- 172.21.15.37:0/2428705690 >> v1:172.21.15.37:6789/0 conn(0x7fc9640d0360 legacy=0x7fc9640b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.630+0000 7fc962ffd640 1 -- 172.21.15.37:0/2428705690 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487198118 0 0) 0x7fc96415d2a0 con 0x7fc9640d0360 2024-05-10T08:45:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.630+0000 7fc963fff640 1 -- 172.21.15.37:0/2428705690 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9641609b0 con 0x7fc96406f060 2024-05-10T08:45:45.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.630+0000 7fc963fff640 1 --2- 172.21.15.37:0/2428705690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc96406e0f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc96406d220 tx=0x7fc95402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df303ab83223fa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:45.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.630+0000 7fc962ffd640 1 -- 172.21.15.37:0/2428705690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954037070 con 0x7fc96406f060 2024-05-10T08:45:45.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc962ffd640 1 -- 172.21.15.37:0/2428705690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc954032440 con 0x7fc96406f060 2024-05-10T08:45:45.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc962ffd640 1 -- 172.21.15.37:0/2428705690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954032810 con 0x7fc96406f060 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 -- 172.21.15.37:0/2428705690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 msgr2=0x7fc96406e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/2428705690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc96406e0f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc96406d220 tx=0x7fc95402a270 comp rx=0 tx=0).stop 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 -- 172.21.15.37:0/2428705690 shutdown_connections 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/2428705690 >> v2:172.21.15.82:3300/0 conn(0x7fc96406fe30 0x7fc9640cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/2428705690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc96406e0f0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 -- 172.21.15.37:0/2428705690 >> 172.21.15.37:0/2428705690 conn(0x7fc96406c3a0 msgr2=0x7fc96406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 -- 172.21.15.37:0/2428705690 shutdown_connections 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.631+0000 7fc96a5f7640 1 -- 172.21.15.37:0/2428705690 wait complete. 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.632+0000 7fc96a5f7640 1 Processor -- start 2024-05-10T08:45:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc96a5f7640 1 -- start start 2024-05-10T08:45:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc96a5f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc9640ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc96a5f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc96406fe30 0x7fc96414b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc96a5f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9640d0360 0x7fc9640b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc96a5f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc964161250 con 0x7fc96406f060 2024-05-10T08:45:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc96a5f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc964160f70 con 0x7fc9640d0360 2024-05-10T08:45:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc96a5f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc964161530 con 0x7fc96406fe30 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc963fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc9640ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc963fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc9640ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49474/0 (socket says 172.21.15.37:49474) 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.633+0000 7fc963fff640 1 -- 172.21.15.37:0/1333252097 learned_addr learned my addr 172.21.15.37:0/1333252097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc968b94640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9640d0360 0x7fc9640b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc9637fe640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc96406fe30 0x7fc96414b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc963fff640 1 -- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc96406fe30 msgr2=0x7fc96414b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc963fff640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc96406fe30 0x7fc96414b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc963fff640 1 -- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9640d0360 msgr2=0x7fc9640b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc963fff640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9640d0360 0x7fc9640b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc963fff640 1 -- 172.21.15.37:0/1333252097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9640cea60 con 0x7fc96406f060 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc963fff640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc9640ce3d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc95402a2b0 tx=0x7fc9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc960ff9640 1 -- 172.21.15.37:0/1333252097 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954041020 con 0x7fc96406f060 2024-05-10T08:45:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc960ff9640 1 -- 172.21.15.37:0/1333252097 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9540306c0 con 0x7fc96406f060 2024-05-10T08:45:45.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9641e8020 con 0x7fc96406f060 2024-05-10T08:45:45.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc960ff9640 1 -- 172.21.15.37:0/1333252097 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954037040 con 0x7fc96406f060 2024-05-10T08:45:45.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.634+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9641e85e0 con 0x7fc96406f060 2024-05-10T08:45:45.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.635+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9640693f0 con 0x7fc96406f060 2024-05-10T08:45:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.636+0000 7fc960ff9640 1 -- 172.21.15.37:0/1333252097 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc954044020 con 0x7fc96406f060 2024-05-10T08:45:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.636+0000 7fc960ff9640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9500762d0 0x7fc950078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.636+0000 7fc960ff9640 1 -- 172.21.15.37:0/1333252097 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fc9540b7de0 con 0x7fc96406f060 2024-05-10T08:45:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.637+0000 7fc9637fe640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9500762d0 0x7fc950078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.637+0000 7fc9637fe640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9500762d0 0x7fc950078790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc964158760 tx=0x7fc958008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:45.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.641+0000 7fc960ff9640 1 -- 172.21.15.37:0/1333252097 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc95404b030 con 0x7fc96406f060 2024-05-10T08:45:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.874+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc96406fac0 con 0x7fc96406f060 2024-05-10T08:45:45.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.874+0000 7fc960ff9640 1 -- 172.21.15.37:0/1333252097 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5171 (secure 0 0 0) 0x7fc954080fa0 con 0x7fc96406f060 2024-05-10T08:45:45.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:45.873 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:44.738484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":63,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.37:6834/375241165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":375241165},{"type":"v1","addr":"172.21.15.37:6834","nonce":375241165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T08:45:45.874 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 65 2024-05-10T08:45:45.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9500762d0 msgr2=0x7fc950078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:45.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9500762d0 0x7fc950078790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc964158760 tx=0x7fc958008040 comp rx=0 tx=0).stop 2024-05-10T08:45:45.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 msgr2=0x7fc9640ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:45.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc9640ce3d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc95402a2b0 tx=0x7fc9540046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 shutdown_connections 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc9500762d0 0x7fc950078790 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9640d0360 0x7fc9640b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc96406fe30 0x7fc96414b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 --2- 172.21.15.37:0/1333252097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc96406f060 0x7fc9640ce3d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 >> 172.21.15.37:0/1333252097 conn(0x7fc96406c3a0 msgr2=0x7fc96406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 shutdown_connections 2024-05-10T08:45:45.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:45.876+0000 7fc96a5f7640 1 -- 172.21.15.37:0/1333252097 wait complete. 2024-05-10T08:45:46.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:45:33.691603+0000', 'modified': '2024-05-10T08:45:44.738484+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6870': {'gid': 6870, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.37:6834/375241165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 375241165}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 375241165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:45:46.290 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6870:up:rejoin 2024-05-10T08:45:47.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:45:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.408+0000 7f2262151640 1 Processor -- start 2024-05-10T08:45:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.408+0000 7f2262151640 1 -- start start 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f2262151640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f225c06f060 0x7f225c06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f2262151640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f225c06fe30 0x7f225c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f2262151640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225c15d2a0 con 0x7f225c0d0360 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f2262151640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f225c0d07c0 con 0x7f225c06f060 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f2262151640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f225c06f440 con 0x7f225c06fe30 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f225b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f225c06f060 0x7f225c06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f225bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f225c0d0360 0x7f225c0b3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41800/0 (socket says 172.21.15.37:41800) 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.409+0000 7f225bfff640 1 -- 172.21.15.37:0/1822375549 learned_addr learned my addr 172.21.15.37:0/1822375549 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.410+0000 7f225affd640 1 --2- 172.21.15.37:0/1822375549 >> v2:172.21.15.82:3300/0 conn(0x7f225c06fe30 0x7f225c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.410+0000 7f225b7fe640 1 -- 172.21.15.37:0/1822375549 >> v2:172.21.15.82:3300/0 conn(0x7f225c06fe30 msgr2=0x7f225c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.410+0000 7f225b7fe640 1 --2- 172.21.15.37:0/1822375549 >> v2:172.21.15.82:3300/0 conn(0x7f225c06fe30 0x7f225c0cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.410+0000 7f225b7fe640 1 -- 172.21.15.37:0/1822375549 >> v1:172.21.15.37:6789/0 conn(0x7f225c0d0360 legacy=0x7f225c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:47.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.410+0000 7f225b7fe640 1 -- 172.21.15.37:0/1822375549 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c1609b0 con 0x7f225c06f060 2024-05-10T08:45:47.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.410+0000 7f225a7fc640 1 -- 172.21.15.37:0/1822375549 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716136161 0 0) 0x7f225c15d2a0 con 0x7f225c0d0360 2024-05-10T08:45:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.410+0000 7f225b7fe640 1 --2- 172.21.15.37:0/1822375549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c06e0f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f225c06d220 tx=0x7f224c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7b66f981613554 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f225a7fc640 1 -- 172.21.15.37:0/1822375549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037070 con 0x7f225c06f060 2024-05-10T08:45:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f225a7fc640 1 -- 172.21.15.37:0/1822375549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c032440 con 0x7f225c06f060 2024-05-10T08:45:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f225a7fc640 1 -- 172.21.15.37:0/1822375549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c032810 con 0x7f225c06f060 2024-05-10T08:45:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 -- 172.21.15.37:0/1822375549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 msgr2=0x7f225c06e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 --2- 172.21.15.37:0/1822375549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c06e0f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f225c06d220 tx=0x7f224c02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 -- 172.21.15.37:0/1822375549 shutdown_connections 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 --2- 172.21.15.37:0/1822375549 >> v2:172.21.15.82:3300/0 conn(0x7f225c06fe30 0x7f225c0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 --2- 172.21.15.37:0/1822375549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c06e0f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 -- 172.21.15.37:0/1822375549 >> 172.21.15.37:0/1822375549 conn(0x7f225c06c3a0 msgr2=0x7f225c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 -- 172.21.15.37:0/1822375549 shutdown_connections 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.411+0000 7f2262151640 1 -- 172.21.15.37:0/1822375549 wait complete. 2024-05-10T08:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.413+0000 7f2262151640 1 Processor -- start 2024-05-10T08:45:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.413+0000 7f2262151640 1 -- start start 2024-05-10T08:45:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2262151640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2262151640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f225c06fe30 0x7f225c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2262151640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d0360 0x7f225c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2262151640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f225c161250 con 0x7f225c06f060 2024-05-10T08:45:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2262151640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f225c160f70 con 0x7f225c0d0360 2024-05-10T08:45:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2262151640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f225c161530 con 0x7f225c06fe30 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49500/0 (socket says 172.21.15.37:49500) 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 -- 172.21.15.37:0/1508995425 learned_addr learned my addr 172.21.15.37:0/1508995425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225affd640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f225c06fe30 0x7f225c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225bfff640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d0360 0x7f225c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 -- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f225c06fe30 msgr2=0x7f225c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f225c06fe30 0x7f225c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 -- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d0360 msgr2=0x7f225c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d0360 0x7f225c0b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 -- 172.21.15.37:0/1508995425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c0cea60 con 0x7f225c06f060 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f225b7fe640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c0ce3d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f224c000c00 tx=0x7f224c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2243fff640 1 -- 172.21.15.37:0/1508995425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037040 con 0x7f225c06f060 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2243fff640 1 -- 172.21.15.37:0/1508995425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c042070 con 0x7f225c06f060 2024-05-10T08:45:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.414+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225c1e8020 con 0x7f225c06f060 2024-05-10T08:45:47.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.415+0000 7f2243fff640 1 -- 172.21.15.37:0/1508995425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c030a50 con 0x7f225c06f060 2024-05-10T08:45:47.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.415+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225c1e85e0 con 0x7f225c06f060 2024-05-10T08:45:47.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.416+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225c0693f0 con 0x7f225c06f060 2024-05-10T08:45:47.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.416+0000 7f2243fff640 1 -- 172.21.15.37:0/1508995425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f224c030bf0 con 0x7f225c06f060 2024-05-10T08:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.417+0000 7f2243fff640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22480762d0 0x7f2248078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.417+0000 7f2243fff640 1 -- 172.21.15.37:0/1508995425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f224c0b8280 con 0x7f225c06f060 2024-05-10T08:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.417+0000 7f225affd640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22480762d0 0x7f2248078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.417+0000 7f225affd640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22480762d0 0x7f2248078790 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f225c158760 tx=0x7f2250008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.421+0000 7f2243fff640 1 -- 172.21.15.37:0/1508995425 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f224c0819f0 con 0x7f225c06f060 2024-05-10T08:45:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.651+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f225c06fac0 con 0x7f225c06f060 2024-05-10T08:45:47.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.652+0000 7f2243fff640 1 -- 172.21.15.37:0/1508995425 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5178 (secure 0 0 0) 0x7f224c0812f0 con 0x7f225c06f060 2024-05-10T08:45:47.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:45:47.651 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:46.744144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/375241165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":375241165},{"type":"v1","addr":"172.21.15.37:6834","nonce":375241165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6870,"qdb_cluster":[6870]},"id":6}]} 2024-05-10T08:45:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 66 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22480762d0 msgr2=0x7f2248078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22480762d0 0x7f2248078790 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f225c158760 tx=0x7f2250008040 comp rx=0 tx=0).stop 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 msgr2=0x7f225c0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c0ce3d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f224c000c00 tx=0x7f224c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 shutdown_connections 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f22480762d0 0x7f2248078790 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d0360 0x7f225c0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f225c06fe30 0x7f225c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 --2- 172.21.15.37:0/1508995425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c06f060 0x7f225c0ce3d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:47.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.654+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 >> 172.21.15.37:0/1508995425 conn(0x7f225c06c3a0 msgr2=0x7f225c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.655+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 shutdown_connections 2024-05-10T08:45:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:47.655+0000 7f2262151640 1 -- 172.21.15.37:0/1508995425 wait complete. 2024-05-10T08:45:48.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:45:33.691603+0000', 'modified': '2024-05-10T08:45:46.744144+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6870': {'gid': 6870, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6834/375241165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 375241165}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 375241165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6870, 'qdb_cluster': [6870]} 2024-05-10T08:45:48.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:45:48.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:45:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.179+0000 7fa27dc6d640 1 Processor -- start 2024-05-10T08:45:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.179+0000 7fa27dc6d640 1 -- start start 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.179+0000 7fa27dc6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa27815f420 0x7fa2780d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.179+0000 7fa27dc6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2780d3ca0 0x7fa2780d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.179+0000 7fa27dc6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2781630b0 con 0x7fa2780d1eb0 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.179+0000 7fa27dc6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa2780d2550 con 0x7fa27815f420 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.179+0000 7fa27dc6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa2780d2c80 con 0x7fa2780d3ca0 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa2777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa27815f420 0x7fa2780d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa277fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa2780d1eb0 0x7fa2780d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48460/0 (socket says 172.21.15.37:48460) 2024-05-10T08:45:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa2777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa27815f420 0x7fa2780d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50576/0 (socket says 172.21.15.37:50576) 2024-05-10T08:45:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa277fff640 1 -- 172.21.15.37:0/3156417117 learned_addr learned my addr 172.21.15.37:0/3156417117 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa276ffd640 1 --2- 172.21.15.37:0/3156417117 >> v2:172.21.15.82:3300/0 conn(0x7fa2780d3ca0 0x7fa2780d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa2777fe640 1 -- 172.21.15.37:0/3156417117 >> v2:172.21.15.82:3300/0 conn(0x7fa2780d3ca0 msgr2=0x7fa2780d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa2777fe640 1 --2- 172.21.15.37:0/3156417117 >> v2:172.21.15.82:3300/0 conn(0x7fa2780d3ca0 0x7fa2780d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa2777fe640 1 -- 172.21.15.37:0/3156417117 >> v1:172.21.15.37:6789/0 conn(0x7fa2780d1eb0 legacy=0x7fa2780d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.180+0000 7fa2777fe640 1 -- 172.21.15.37:0/3156417117 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2780d2f60 con 0x7fa27815f420 2024-05-10T08:45:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa2777fe640 1 --2- 172.21.15.37:0/3156417117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27815f420 0x7fa2780d3760 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fa27808f380 tx=0x7fa26802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efe29ffc4f6e7ea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa2767fc640 1 -- 172.21.15.37:0/3156417117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268037070 con 0x7fa27815f420 2024-05-10T08:45:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa2767fc640 1 -- 172.21.15.37:0/3156417117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa268032440 con 0x7fa27815f420 2024-05-10T08:45:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa2767fc640 1 -- 172.21.15.37:0/3156417117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268032810 con 0x7fa27815f420 2024-05-10T08:45:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 -- 172.21.15.37:0/3156417117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27815f420 msgr2=0x7fa2780d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/3156417117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27815f420 0x7fa2780d3760 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fa27808f380 tx=0x7fa26802a1a0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 -- 172.21.15.37:0/3156417117 shutdown_connections 2024-05-10T08:45:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/3156417117 >> v2:172.21.15.82:3300/0 conn(0x7fa2780d3ca0 0x7fa2780d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/3156417117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27815f420 0x7fa2780d3760 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 -- 172.21.15.37:0/3156417117 >> 172.21.15.37:0/3156417117 conn(0x7fa27808eac0 msgr2=0x7fa27809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 -- 172.21.15.37:0/3156417117 shutdown_connections 2024-05-10T08:45:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.181+0000 7fa27dc6d640 1 -- 172.21.15.37:0/3156417117 wait complete. 2024-05-10T08:45:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.183+0000 7fa27dc6d640 1 Processor -- start 2024-05-10T08:45:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.183+0000 7fa27dc6d640 1 -- start start 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2780d1eb0 0x7fa27815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa27815e2f0 0x7fa27815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2781f8550 0x7fa2781f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2780d53d0 con 0x7fa2781f8550 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2780d2830 con 0x7fa27815e2f0 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa2780d5550 con 0x7fa2780d1eb0 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2781f8550 0x7fa2781f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2781f8550 0x7fa2781f8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50578/0 (socket says 172.21.15.37:50578) 2024-05-10T08:45:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 -- 172.21.15.37:0/2874671128 learned_addr learned my addr 172.21.15.37:0/2874671128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa276ffd640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa27815e2f0 0x7fa27815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa2777fe640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2780d1eb0 0x7fa27815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 -- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2780d1eb0 msgr2=0x7fa27815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2780d1eb0 0x7fa27815dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 -- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa27815e2f0 msgr2=0x7fa27815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa27815e2f0 0x7fa27815d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 -- 172.21.15.37:0/2874671128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2781f9460 con 0x7fa2781f8550 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa277fff640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2781f8550 0x7fa2781f8a00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa27000cab0 tx=0x7fa27000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa25ffff640 1 -- 172.21.15.37:0/2874671128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270017070 con 0x7fa2781f8550 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa25ffff640 1 -- 172.21.15.37:0/2874671128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27000ac30 con 0x7fa2781f8550 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa278162560 con 0x7fa2781f8550 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa25ffff640 1 -- 172.21.15.37:0/2874671128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270012400 con 0x7fa2781f8550 2024-05-10T08:45:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.184+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2781e8b80 con 0x7fa2781f8550 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.186+0000 7fa25ffff640 1 -- 172.21.15.37:0/2874671128 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa27001a070 con 0x7fa2781f8550 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.187+0000 7fa25ffff640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa2640762d0 0x7fa264078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.187+0000 7fa25ffff640 1 -- 172.21.15.37:0/2874671128 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fa2700973c0 con 0x7fa2781f8550 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.187+0000 7fa2777fe640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa2640762d0 0x7fa264078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.187+0000 7fa280984740 1 Processor -- start 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.187+0000 7fa280984740 1 -- start start 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.187+0000 7fa2777fe640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa2640762d0 0x7fa264078790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa268034000 tx=0x7fa26802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa280984740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f0f50 0x55ccf71f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf71f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71c3bb0 0x55ccf71c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa280984740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ccf712d8d0 con 0x55ccf71f0f50 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ccf70e6c10 con 0x55ccf71f1330 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ccf7129890 con 0x55ccf71c3bb0 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa2777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f0f50 0x55ccf71f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa2777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f0f50 0x55ccf71f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50590/0 (socket says 172.21.15.37:50590) 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.188+0000 7fa2777fe640 1 -- 172.21.15.37:0/143613875 learned_addr learned my addr 172.21.15.37:0/143613875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa276ffd640 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf71f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa277fff640 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71c3bb0 0x55ccf71c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa2777fe640 1 -- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71c3bb0 msgr2=0x55ccf71c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa2777fe640 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71c3bb0 0x55ccf71c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa2777fe640 1 -- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 msgr2=0x55ccf71f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa2777fe640 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf71f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa2777fe640 1 -- 172.21.15.37:0/143613875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccf70ee5d0 con 0x55ccf71f0f50 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa276ffd640 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf71f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa2777fe640 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f0f50 0x55ccf71f3760 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa26802a790 tx=0x7fa26802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c26a38948dcbbe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa25d7fa640 1 -- 172.21.15.37:0/143613875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26804e070 con 0x55ccf71f0f50 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa25d7fa640 1 -- 172.21.15.37:0/143613875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa268032d90 con 0x55ccf71f0f50 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.189+0000 7fa25d7fa640 1 -- 172.21.15.37:0/143613875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268037040 con 0x55ccf71f0f50 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 -- 172.21.15.37:0/143613875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f0f50 msgr2=0x55ccf71f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f0f50 0x55ccf71f3760 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa26802a790 tx=0x7fa26802c000 comp rx=0 tx=0).stop 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 -- 172.21.15.37:0/143613875 shutdown_connections 2024-05-10T08:45:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71c3bb0 0x55ccf71c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf71f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 --2- 172.21.15.37:0/143613875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f0f50 0x55ccf71f3760 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 -- 172.21.15.37:0/143613875 >> 172.21.15.37:0/143613875 conn(0x55ccf71c5e20 msgr2=0x55ccf720e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 -- 172.21.15.37:0/143613875 shutdown_connections 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 -- 172.21.15.37:0/143613875 wait complete. 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.190+0000 7fa280984740 1 -- start start 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 1 Processor -- start 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf720ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71ef470 0x55ccf720b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ccf71c8fd0 con 0x55ccf71ef470 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ccf70ea760 con 0x55ccf71f1330 2024-05-10T08:45:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ccf71c92b0 con 0x55ccf71f0f50 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71ef470 0x55ccf720b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.191+0000 7fa280984740 10 client.0 _ll_register_callbacks cb 0x55ccf7123cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71ef470 0x55ccf720b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50602/0 (socket says 172.21.15.37:50602) 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 -- 172.21.15.37:0/1149863480 learned_addr learned my addr 172.21.15.37:0/1149863480 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa276ffd640 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf720ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa2777fe640 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 -- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 msgr2=0x55ccf71f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 -- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 msgr2=0x55ccf720ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf720ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 -- 172.21.15.37:0/1149863480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccf6e3f2d0 con 0x55ccf71ef470 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa277fff640 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71ef470 0x55ccf720b080 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa27000a4f0 tx=0x7fa2700600b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbab8b4187fdf01 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa2567fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa2567fc640 1 -- 172.21.15.37:0/1149863480 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270069200 con 0x55ccf71ef470 2024-05-10T08:45:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa2567fc640 1 -- 172.21.15.37:0/1149863480 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fa270004b60 con 0x55ccf71ef470 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa268032d90 con 0x55ccf71ef470 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa2567fc640 1 -- 172.21.15.37:0/1149863480 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fa270095050 con 0x55ccf71ef470 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa280984740 10 client.6945 fetch_fsmap learned FSMap version 66 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55ccf6f096b0 con 0x55ccf71ef470 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.192+0000 7fa2567fc640 1 -- 172.21.15.37:0/1149863480 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa268032d90 con 0x55ccf71ef470 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa2567fc640 1 -- 172.21.15.37:0/1149863480 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7fa2700951f0 con 0x55ccf71ef470 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa280984740 10 client.6945 fetch_fsmap finished waiting for FSMap version 66 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa280984740 10 client.6945 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa280984740 20 client.6945 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa280984740 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf720ffa0 0x55ccf722d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa280984740 4 client.6945 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccf70b1760 con 0x55ccf720ffa0 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa2777fe640 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf720ffa0 0x55ccf722d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa2567fc640 10 client.6945 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.193+0000 7fa2777fe640 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf720ffa0 0x55ccf722d480 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8e973d509c4d925 server_cookie=3940b837aafaa637 in_seq=0 out_seq=0 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa2567fc640 1 -- 172.21.15.37:0/1149863480 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ccf70b1760 con 0x55ccf720ffa0 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa2567fc640 10 client.6945 handle_command_reply: tid=0 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 client.6945 shutdown 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71ef470 msgr2=0x55ccf720b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71ef470 0x55ccf720b080 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa27000a4f0 tx=0x7fa2700600b0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 shutdown_connections 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf720ffa0 0x55ccf722d480 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71ef470 0x55ccf720b080 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f1330 0x55ccf720ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa2567fc640 0 client.6945 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 --2- 172.21.15.37:0/1149863480 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 >> 172.21.15.37:0/1149863480 conn(0x55ccf71c3bb0 msgr2=0x55ccf71c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 shutdown_connections 2024-05-10T08:45:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 1 -- 172.21.15.37:0/1149863480 wait complete. 2024-05-10T08:45:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.194+0000 7fa280984740 20 client.6945 trim_cache size 0 max 16384 2024-05-10T08:45:48.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.213+0000 7fa280984740 1 Processor -- start 2024-05-10T08:45:48.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.213+0000 7fa280984740 1 -- start start 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71ef470 0x55ccf720a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa280984740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf71f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa280984740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa278200fb0 con 0x55ccf71f1330 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2781ea280 con 0x55ccf71ef470 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa278200960 con 0x55ccf71f0f50 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf71f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf71f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50612/0 (socket says 172.21.15.37:50612) 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 -- 172.21.15.37:0/4104641054 learned_addr learned my addr 172.21.15.37:0/4104641054 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa276ffd640 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa2777fe640 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71ef470 0x55ccf720a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 -- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 msgr2=0x55ccf71f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 -- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71ef470 msgr2=0x55ccf720a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71ef470 0x55ccf720a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 -- 172.21.15.37:0/4104641054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccf71f0d60 con 0x55ccf71f1330 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa276ffd640 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa2777fe640 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71ef470 0x55ccf720a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.214+0000 7fa277fff640 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf71f4b70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa2700012e0 tx=0x7fa270062000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f21d2acaebcfa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa25cff9640 1 -- 172.21.15.37:0/4104641054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700951f0 con 0x55ccf71f1330 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa25cff9640 1 -- 172.21.15.37:0/4104641054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa270079b90 con 0x55ccf71f1330 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa25cff9640 1 -- 172.21.15.37:0/4104641054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27005f790 con 0x55ccf71f1330 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 -- 172.21.15.37:0/4104641054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 msgr2=0x55ccf71f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf71f4b70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa2700012e0 tx=0x7fa270062000 comp rx=0 tx=0).stop 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 -- 172.21.15.37:0/4104641054 shutdown_connections 2024-05-10T08:45:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf71f4b70 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71f0f50 0x55ccf71f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 --2- 172.21.15.37:0/4104641054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71ef470 0x55ccf720a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 -- 172.21.15.37:0/4104641054 >> 172.21.15.37:0/4104641054 conn(0x55ccf71c3bb0 msgr2=0x55ccf720aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 -- 172.21.15.37:0/4104641054 shutdown_connections 2024-05-10T08:45:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.215+0000 7fa280984740 1 -- 172.21.15.37:0/4104641054 wait complete. 2024-05-10T08:45:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.216+0000 7fa280984740 1 -- start start 2024-05-10T08:45:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.216+0000 7fa280984740 1 Processor -- start 2024-05-10T08:45:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71ef470 0x55ccf71c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f0f50 0x55ccf7211990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf721b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ccf72115a0 con 0x55ccf71f1330 2024-05-10T08:45:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ccf71f5e30 con 0x55ccf71f0f50 2024-05-10T08:45:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55ccf71f0780 con 0x55ccf71ef470 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 10 client.0 _ll_register_callbacks cb 0x7fa27005cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf721b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf721b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50618/0 (socket says 172.21.15.37:50618) 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 -- 172.21.15.37:0/75949880 learned_addr learned my addr 172.21.15.37:0/75949880 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa2777fe640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71ef470 0x55ccf71c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa276ffd640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f0f50 0x55ccf7211990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 -- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71ef470 msgr2=0x55ccf71c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71ef470 0x55ccf71c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 -- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f0f50 msgr2=0x55ccf7211990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f0f50 0x55ccf7211990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 -- 172.21.15.37:0/75949880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccf71c5130 con 0x55ccf71f1330 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa2777fe640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71ef470 0x55ccf71c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa276ffd640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f0f50 0x55ccf7211990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa277fff640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf721b0a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa270060470 tx=0x7fa2700955d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced41ec7d514a275 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa2567fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa2567fc640 1 -- 172.21.15.37:0/75949880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27005fc50 con 0x55ccf71f1330 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa2567fc640 1 -- 172.21.15.37:0/75949880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fa270079d40 con 0x55ccf71f1330 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.217+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa270079b90 con 0x55ccf71f1330 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2567fc640 1 -- 172.21.15.37:0/75949880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fa270004b60 con 0x55ccf71f1330 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 10 client.6951 fetch_fsmap learned FSMap version 66 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55ccf720f350 con 0x55ccf71f1330 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2567fc640 1 -- 172.21.15.37:0/75949880 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa270079b90 con 0x55ccf71f1330 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2567fc640 1 -- 172.21.15.37:0/75949880 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7fa270080070 con 0x55ccf71f1330 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 10 client.6951 fetch_fsmap finished waiting for FSMap version 66 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 10 client.6951 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 20 client.6951 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf721b5e0 0x55ccf7208d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 4 client.6951 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "status"}) -- 0x55ccf71ed960 con 0x55ccf721b5e0 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2777fe640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf721b5e0 0x55ccf7208d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2567fc640 10 client.6951 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2777fe640 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf721b5e0 0x55ccf7208d90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=905f0fbbe08a1ffa server_cookie=ffa4264be50fce54 in_seq=0 out_seq=0 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2567fc640 1 -- 172.21.15.37:0/75949880 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55ccf71ed960 con 0x55ccf721b5e0 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa2567fc640 10 client.6951 handle_command_reply: tid=0 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.218+0000 7fa280984740 1 client.6951 shutdown 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 msgr2=0x55ccf721b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf721b0a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa270060470 tx=0x7fa2700955d0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 shutdown_connections 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55ccf721b5e0 0x55ccf7208d90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ccf71f1330 0x55ccf721b0a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ccf71f0f50 0x55ccf7211990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 --2- 172.21.15.37:0/75949880 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55ccf71ef470 0x55ccf71c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa2567fc640 0 client.6951 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 >> 172.21.15.37:0/75949880 conn(0x55ccf71c3bb0 msgr2=0x55ccf720aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 shutdown_connections 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 1 -- 172.21.15.37:0/75949880 wait complete. 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa280984740 20 client.6951 trim_cache size 0 max 16384 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6870, 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:45:48.225 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:45:48.226 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:45:48.226 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.4844915409999997, 2024-05-10T08:45:48.226 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 66, 2024-05-10T08:45:48.226 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-05-10T08:45:48.226 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-05-10T08:45:48.226 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 5.172181567 2024-05-10T08:45:48.226 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa2640762d0 msgr2=0x7fa264078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa2640762d0 0x7fa264078790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa268034000 tx=0x7fa26802e000 comp rx=0 tx=0).stop 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2781f8550 msgr2=0x7fa2781f8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2781f8550 0x7fa2781f8a00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa27000cab0 tx=0x7fa27000cf70 comp rx=0 tx=0).stop 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 shutdown_connections 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa2640762d0 0x7fa264078790 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2781f8550 0x7fa2781f8a00 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa27815e2f0 0x7fa27815d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 --2- 172.21.15.37:0/2874671128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa2780d1eb0 0x7fa27815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.219+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 >> 172.21.15.37:0/2874671128 conn(0x7fa27808eac0 msgr2=0x7fa2780cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.220+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 shutdown_connections 2024-05-10T08:45:48.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.220+0000 7fa27dc6d640 1 -- 172.21.15.37:0/2874671128 wait complete. 2024-05-10T08:45:48.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:45:48.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.333+0000 7fb9e79c8640 1 Processor -- start 2024-05-10T08:45:48.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.334+0000 7fb9e79c8640 1 -- start start 2024-05-10T08:45:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.334+0000 7fb9e79c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e015f420 0x7fb9e00d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.334+0000 7fb9e79c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9e00d3ca0 0x7fb9e00d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.334+0000 7fb9e79c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e01630b0 con 0x7fb9e00d1eb0 2024-05-10T08:45:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.334+0000 7fb9e79c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e00d22f0 con 0x7fb9e00d3ca0 2024-05-10T08:45:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.334+0000 7fb9e79c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00d2550 con 0x7fb9e015f420 2024-05-10T08:45:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9e5f65640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9e00d1eb0 0x7fb9e00d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48476/0 (socket says 172.21.15.37:48476) 2024-05-10T08:45:48.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9e5f65640 1 -- 172.21.15.37:0/4221761853 learned_addr learned my addr 172.21.15.37:0/4221761853 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9e5764640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e015f420 0x7fb9e00d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9e4f63640 1 --2- 172.21.15.37:0/4221761853 >> v2:172.21.15.82:3300/0 conn(0x7fb9e00d3ca0 0x7fb9e00d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897052918 0 0) 0x7fb9d8001490 con 0x7fb9e00d1eb0 2024-05-10T08:45:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9cc003520 con 0x7fb9e00d1eb0 2024-05-10T08:45:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 7389890 0 0) 0x7fb9cc003520 con 0x7fb9e00d1eb0 2024-05-10T08:45:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e015f420 msgr2=0x7fb9e00d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e015f420 0x7fb9e00d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 >> v2:172.21.15.82:3300/0 conn(0x7fb9e00d3ca0 msgr2=0x7fb9e00d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 --2- 172.21.15.37:0/4221761853 >> v2:172.21.15.82:3300/0 conn(0x7fb9e00d3ca0 0x7fb9e00d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e00d2c80 con 0x7fb9e00d1eb0 2024-05-10T08:45:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fb9d8001bc0 con 0x7fb9e00d1eb0 2024-05-10T08:45:48.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 >> v1:172.21.15.37:6789/0 conn(0x7fb9e00d1eb0 legacy=0x7fb9e00d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc0039b0 0x7fb9cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9cc004310 0x7fb9cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc004e50 0x7fb9cc0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d22f0 con 0x7fb9cc004310 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d2550 con 0x7fb9cc004e50 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc00bd40 con 0x7fb9cc0039b0 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9e4f63640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9cc004310 0x7fb9cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9e5764640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc0039b0 0x7fb9cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.335+0000 7fb9e5f65640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc004e50 0x7fb9cc0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.336+0000 7fb9e4f63640 1 -- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc0039b0 msgr2=0x7fb9cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.336+0000 7fb9e4f63640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc0039b0 0x7fb9cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.336+0000 7fb9e4f63640 1 -- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc004e50 msgr2=0x7fb9cc0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.336+0000 7fb9e4f63640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9cc004e50 0x7fb9cc0052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.336+0000 7fb9e4f63640 1 -- 172.21.15.37:0/4221761853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc003520 con 0x7fb9cc004310 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.336+0000 7fb9e4f63640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9cc004310 0x7fb9cc004800 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009ac0 tx=0x7fb9cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e30511f337c5b4a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0036070 con 0x7fb9cc004310 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0031400 con 0x7fb9cc004310 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9d7fff640 1 -- 172.21.15.37:0/4221761853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0009690 con 0x7fb9cc004310 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9e79c8640 1 -- 172.21.15.37:0/4221761853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9cc004310 msgr2=0x7fb9cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9e79c8640 1 --2- 172.21.15.37:0/4221761853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9cc004310 0x7fb9cc004800 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009ac0 tx=0x7fb9cc005830 comp rx=0 tx=0).stop 2024-05-10T08:45:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9e5f65640 1 -- 172.21.15.37:0/4221761853 reap_dead start 2024-05-10T08:45:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9e79c8640 1 -- 172.21.15.37:0/4221761853 shutdown_connections 2024-05-10T08:45:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9e79c8640 1 -- 172.21.15.37:0/4221761853 >> 172.21.15.37:0/4221761853 conn(0x7fb9e008eac0 msgr2=0x7fb9e009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9e79c8640 1 -- 172.21.15.37:0/4221761853 shutdown_connections 2024-05-10T08:45:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.337+0000 7fb9e79c8640 1 -- 172.21.15.37:0/4221761853 wait complete. 2024-05-10T08:45:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.338+0000 7fb9e79c8640 1 Processor -- start 2024-05-10T08:45:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e79c8640 1 -- start start 2024-05-10T08:45:48.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e79c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc004310 0x7fb9e01f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e79c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e0161e70 0x7fb9e00b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e79c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e00b6200 0x7fb9e00ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e79c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d2830 con 0x7fb9e00b6200 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e79c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d3240 con 0x7fb9e0161e70 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e79c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00d53d0 con 0x7fb9cc004310 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e5f65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e00b6200 0x7fb9e00ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e5f65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e00b6200 0x7fb9e00ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50646/0 (socket says 172.21.15.37:50646) 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.339+0000 7fb9e5f65640 1 -- 172.21.15.37:0/1884477579 learned_addr learned my addr 172.21.15.37:0/1884477579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e5f65640 1 -- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc004310 msgr2=0x7fb9e01f8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e5f65640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc004310 0x7fb9e01f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e5f65640 1 -- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e0161e70 msgr2=0x7fb9e00b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e5f65640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e0161e70 0x7fb9e00b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e5f65640 1 -- 172.21.15.37:0/1884477579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e01f8300 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e5f65640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e00b6200 0x7fb9e00ce850 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0163dc0 tx=0x7fb9d800af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9d5ffb640 1 -- 172.21.15.37:0/1884477579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8007920 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9d5ffb640 1 -- 172.21.15.37:0/1884477579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8018070 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e00caf90 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9d5ffb640 1 -- 172.21.15.37:0/1884477579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8013630 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.340+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01628e0 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.341+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e00b6680 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.342+0000 7fb9d5ffb640 1 -- 172.21.15.37:0/1884477579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb9d80137d0 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.342+0000 7fb9d5ffb640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb9c40762d0 0x7fb9c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.342+0000 7fb9d5ffb640 1 -- 172.21.15.37:0/1884477579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fb9d8097e20 con 0x7fb9e00b6200 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.342+0000 7fb9e5764640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb9c40762d0 0x7fb9c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.343+0000 7fb9e5764640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb9c40762d0 0x7fb9c4078790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009960 tx=0x7fb9dc009d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:48.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.346+0000 7fb9d5ffb640 1 -- 172.21.15.37:0/1884477579 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb9e01630b0 con 0x7fb9e00b6200 2024-05-10T08:45:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.578+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb9e00b4c50 con 0x7fb9e00b6200 2024-05-10T08:45:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.578+0000 7fb9d5ffb640 1 -- 172.21.15.37:0/1884477579 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7fb9d80615a0 con 0x7fb9e00b6200 2024-05-10T08:45:48.577 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:45:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb9c40762d0 msgr2=0x7fb9c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb9c40762d0 0x7fb9c4078790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009960 tx=0x7fb9dc009d60 comp rx=0 tx=0).stop 2024-05-10T08:45:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e00b6200 msgr2=0x7fb9e00ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e00b6200 0x7fb9e00ce850 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0163dc0 tx=0x7fb9d800af60 comp rx=0 tx=0).stop 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 shutdown_connections 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb9c40762d0 0x7fb9c4078790 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e00b6200 0x7fb9e00ce850 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e0161e70 0x7fb9e00b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 --2- 172.21.15.37:0/1884477579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9cc004310 0x7fb9e01f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 >> 172.21.15.37:0/1884477579 conn(0x7fb9e008eac0 msgr2=0x7fb9e006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 shutdown_connections 2024-05-10T08:45:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48.580+0000 7fb9e79c8640 1 -- 172.21.15.37:0/1884477579 wait complete. 2024-05-10T08:45:48.590 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:45:48.591 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:45:48.591 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:45:48.591 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:45:48.591 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:48.591 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:45:48.591 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:45:48.591 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:45:48.592 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:48.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:48.592 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:45:48.609 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:45:48.609 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:45:48.610 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42413sec preferred_lft 42413sec 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:45:48.611 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:45:48.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:48.613 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:45:48.674 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:45:48.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:48.676 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:45:48.732 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:45:48.733 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:45:48.733 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:45:48.733 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:45:48.733 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:45:48.733 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:45:48.733 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:45:48.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:45:48.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:45:48.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:45:48.733 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:45:48.739 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:45:48.740+0000 7f90ab587640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:45:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:45:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:45:48.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:48.828 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:45:48.845 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:45:48.845 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:45:48.845 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:48.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:48.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:45:48.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:45:48.911 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:48.968 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:45:48.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:45:48.969 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:49.025 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:45:49.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:49.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:49.111 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:49.111 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:49.111 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:49.120 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:49.120 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:49.120 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:49.120 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:45:49.120 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:45:49.126 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:45:49.127 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:45:49.127 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:45:49.127 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:45:49.127 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:45:49.127 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:45:49.129 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:45:49.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:49.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:45:49.154 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:45:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:45:49.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:45:49.253 INFO:teuthology.orchestra.run.smithi037.stdout:client5903 2024-05-10T08:45:49.253 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:45:49.254 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:45:49.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:49.270 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-05-10T08:45:49.328 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:45:49.329+0000 7f90a757f640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-05-10T08:45:49.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:45:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-05-10T08:45:49.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:49.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-05-10T08:45:49.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.478+0000 7fdf27f24640 1 Processor -- start 2024-05-10T08:45:49.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.479+0000 7fdf27f24640 1 -- start start 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.479+0000 7fdf27f24640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf2015d2c0 0x7fdf2015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.479+0000 7fdf27f24640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf200af740 0x7fdf200afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.479+0000 7fdf27f24640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf2015dec0 con 0x7fdf2006ff10 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.479+0000 7fdf27f24640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdf2015dc90 con 0x7fdf2015d2c0 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.479+0000 7fdf27f24640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2015e1a0 con 0x7fdf200af740 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf254bf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf2015d2c0 0x7fdf2015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf200af740 0x7fdf200afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf254bf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf2015d2c0 0x7fdf2015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:48528/0 (socket says 172.21.15.37:48528) 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf254bf640 1 -- 172.21.15.37:0/2672258235 learned_addr learned my addr 172.21.15.37:0/2672258235 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf200af740 0x7fdf200afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:35962/0 (socket says 172.21.15.37:35962) 2024-05-10T08:45:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf25cc0640 1 --1- 172.21.15.37:0/2672258235 >> v1:172.21.15.82:6789/0 conn(0x7fdf2006ff10 0x7fdf200b4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:54518/0 (socket says 172.21.15.37:54518) 2024-05-10T08:45:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf264c1640 1 -- 172.21.15.37:0/2672258235 >> v2:172.21.15.82:3300/0 conn(0x7fdf2015d2c0 msgr2=0x7fdf2015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf264c1640 1 --2- 172.21.15.37:0/2672258235 >> v2:172.21.15.82:3300/0 conn(0x7fdf2015d2c0 0x7fdf2015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf264c1640 1 -- 172.21.15.37:0/2672258235 >> v1:172.21.15.82:6789/0 conn(0x7fdf2006ff10 legacy=0x7fdf200b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf264c1640 1 -- 172.21.15.37:0/2672258235 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf200b3e30 con 0x7fdf200af740 2024-05-10T08:45:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.480+0000 7fdf254bf640 1 --2- 172.21.15.37:0/2672258235 >> v2:172.21.15.82:3300/0 conn(0x7fdf2015d2c0 0x7fdf2015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:45:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.481+0000 7fdf264c1640 1 --2- 172.21.15.37:0/2672258235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf200af740 0x7fdf200afbb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009d90 tx=0x7fdf1802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679a16e4cc433e10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.481+0000 7fdf24cbe640 1 -- 172.21.15.37:0/2672258235 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18007740 con 0x7fdf200af740 2024-05-10T08:45:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.481+0000 7fdf24cbe640 1 -- 172.21.15.37:0/2672258235 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf180078e0 con 0x7fdf200af740 2024-05-10T08:45:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.481+0000 7fdf24cbe640 1 -- 172.21.15.37:0/2672258235 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18007cb0 con 0x7fdf200af740 2024-05-10T08:45:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 -- 172.21.15.37:0/2672258235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf200af740 msgr2=0x7fdf200afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 --2- 172.21.15.37:0/2672258235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf200af740 0x7fdf200afbb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009d90 tx=0x7fdf1802a660 comp rx=0 tx=0).stop 2024-05-10T08:45:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 -- 172.21.15.37:0/2672258235 shutdown_connections 2024-05-10T08:45:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 --2- 172.21.15.37:0/2672258235 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf200af740 0x7fdf200afbb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 --2- 172.21.15.37:0/2672258235 >> v2:172.21.15.82:3300/0 conn(0x7fdf2015d2c0 0x7fdf2015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 -- 172.21.15.37:0/2672258235 >> 172.21.15.37:0/2672258235 conn(0x7fdf2006c3a0 msgr2=0x7fdf2006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 -- 172.21.15.37:0/2672258235 shutdown_connections 2024-05-10T08:45:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.482+0000 7fdf27f24640 1 -- 172.21.15.37:0/2672258235 wait complete. 2024-05-10T08:45:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.483+0000 7fdf27f24640 1 Processor -- start 2024-05-10T08:45:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.483+0000 7fdf27f24640 1 -- start start 2024-05-10T08:45:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf27f24640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf2006ff10 0x7fdf201f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf27f24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf200af740 0x7fdf201ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf27f24640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf2015d2c0 0x7fdf201553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf27f24640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf200702f0 con 0x7fdf2015d2c0 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf27f24640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf200b00f0 con 0x7fdf200af740 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf27f24640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdf20070470 con 0x7fdf2006ff10 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf2015d2c0 0x7fdf201553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf2015d2c0 0x7fdf201553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50648/0 (socket says 172.21.15.37:50648) 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 -- 172.21.15.37:0/288396697 learned_addr learned my addr 172.21.15.37:0/288396697 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf2006ff10 0x7fdf201f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf254bf640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf200af740 0x7fdf201ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 -- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf2006ff10 msgr2=0x7fdf201f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf2006ff10 0x7fdf201f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 -- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf200af740 msgr2=0x7fdf201ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf200af740 0x7fdf201ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 -- 172.21.15.37:0/288396697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf20153a40 con 0x7fdf2015d2c0 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.484+0000 7fdf264c1640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf2015d2c0 0x7fdf201553d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009eb0 tx=0x7fdf18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.485+0000 7fdf167fc640 1 -- 172.21.15.37:0/288396697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18040070 con 0x7fdf2015d2c0 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.485+0000 7fdf167fc640 1 -- 172.21.15.37:0/288396697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf18031bc0 con 0x7fdf2015d2c0 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.485+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf20153d20 con 0x7fdf2015d2c0 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.485+0000 7fdf167fc640 1 -- 172.21.15.37:0/288396697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18009450 con 0x7fdf2015d2c0 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.485+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201542e0 con 0x7fdf2015d2c0 2024-05-10T08:45:49.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.486+0000 7fdf167fc640 1 -- 172.21.15.37:0/288396697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf18039040 con 0x7fdf2015d2c0 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.487+0000 7fdf167fc640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf040762d0 0x7fdf04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.487+0000 7fdf167fc640 1 -- 172.21.15.37:0/288396697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fdf180b8f50 con 0x7fdf2015d2c0 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.488+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf040762d0 0x7fdf04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.488+0000 7fdf2ac42740 1 Processor -- start 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.488+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf040762d0 0x7fdf04078790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdf2015c810 tx=0x7fdf1c007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.488+0000 7fdf2ac42740 1 -- start start 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c56f290 0x55818c56f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c53f4f0 0x55818c545520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58b1f0 0x55818c58b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55818c4a8bc0 con 0x55818c58b1f0 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55818c461d30 con 0x55818c56f290 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55818c4a4b80 con 0x55818c53f4f0 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58b1f0 0x55818c58b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58b1f0 0x55818c58b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50654/0 (socket says 172.21.15.37:50654) 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 -- 172.21.15.37:0/3732850187 learned_addr learned my addr 172.21.15.37:0/3732850187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c56f290 0x55818c56f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf254bf640 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c53f4f0 0x55818c545520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 -- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c53f4f0 msgr2=0x55818c545520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c53f4f0 0x55818c545520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 -- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c56f290 msgr2=0x55818c56f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c56f290 0x55818c56f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 -- 172.21.15.37:0/3732850187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55818c446100 con 0x55818c58b1f0 2024-05-10T08:45:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf264c1640 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58b1f0 0x55818c58b670 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fdf180b7210 tx=0x7fdf18007fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be2b43ef1c6b23e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf037fe640 1 -- 172.21.15.37:0/3732850187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1804a040 con 0x55818c58b1f0 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.489+0000 7fdf037fe640 1 -- 172.21.15.37:0/3732850187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf18082000 con 0x55818c58b1f0 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf037fe640 1 -- 172.21.15.37:0/3732850187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18086300 con 0x55818c58b1f0 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3732850187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58b1f0 msgr2=0x55818c58b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58b1f0 0x55818c58b670 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fdf180b7210 tx=0x7fdf18007fc0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3732850187 shutdown_connections 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58b1f0 0x55818c58b670 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c53f4f0 0x55818c545520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3732850187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c56f290 0x55818c56f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3732850187 >> 172.21.15.37:0/3732850187 conn(0x55818c541760 msgr2=0x55818c58a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3732850187 shutdown_connections 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.490+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3732850187 wait complete. 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.491+0000 7fdf2ac42740 1 -- start start 2024-05-10T08:45:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.491+0000 7fdf2ac42740 1 Processor -- start 2024-05-10T08:45:49.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c59e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58b1f0 0x55818c59f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58c8e0 0x55818c58cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55818c4a8bc0 con 0x55818c56f290 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55818c465870 con 0x55818c58c8e0 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55818c545a60 con 0x55818c58b1f0 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf2ac42740 10 client.0 _ll_register_callbacks cb 0x55818c4b5b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c59e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c59e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50660/0 (socket says 172.21.15.37:50660) 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 -- 172.21.15.37:0/1450518952 learned_addr learned my addr 172.21.15.37:0/1450518952 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf264c1640 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58c8e0 0x55818c58cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf254bf640 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58b1f0 0x55818c59f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 -- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58b1f0 msgr2=0x55818c59f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58b1f0 0x55818c59f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 -- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58c8e0 msgr2=0x55818c58cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58c8e0 0x55818c58cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.492+0000 7fdf25cc0640 1 -- 172.21.15.37:0/1450518952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55818c2867b0 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c59e1f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c013680 tx=0x7fdf1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db437e1f6b100501 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf00ff9640 1 -- 172.21.15.37:0/1450518952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c020580 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf00ff9640 1 -- 172.21.15.37:0/1450518952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fdf1c020720 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf18082000 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf00ff9640 1 -- 172.21.15.37:0/1450518952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fdf1c02e050 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 10 client.6966 fetch_fsmap learned FSMap version 66 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55818c2e6f40 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf00ff9640 1 -- 172.21.15.37:0/1450518952 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf18082000 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf00ff9640 1 -- 172.21.15.37:0/1450518952 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7fdf1c031020 con 0x55818c56f290 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 10 client.6966 fetch_fsmap finished waiting for FSMap version 66 2024-05-10T08:45:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 10 client.6966 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 20 client.6966 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c5a1370 0x55818c5a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 4 client.6966 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55818c4b67d0 con 0x55818c5a1370 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.493+0000 7fdf254bf640 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c5a1370 0x55818c5a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.494+0000 7fdf00ff9640 10 client.6966 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.494+0000 7fdf254bf640 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c5a1370 0x55818c5a1770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9208d880bd83bfc server_cookie=ae4c2fa55e6a3651 in_seq=0 out_seq=0 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.494+0000 7fdf00ff9640 1 -- 172.21.15.37:0/1450518952 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55818c4b67d0 con 0x55818c5a1370 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.494+0000 7fdf00ff9640 10 client.6966 handle_command_reply: tid=0 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.494+0000 7fdf2ac42740 1 client.6966 shutdown 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.494+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 msgr2=0x55818c59e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.494+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c59e1f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c013680 tx=0x7fdf1c000bc0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 shutdown_connections 2024-05-10T08:45:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c5a1370 0x55818c5a1770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58c8e0 0x55818c58cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58b1f0 0x55818c59f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf00ff9640 0 client.6966 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/1450518952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c59e1f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 >> 172.21.15.37:0/1450518952 conn(0x55818c53f4f0 msgr2=0x55818c56b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 shutdown_connections 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 1 -- 172.21.15.37:0/1450518952 wait complete. 2024-05-10T08:45:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.495+0000 7fdf2ac42740 20 client.6966 trim_cache size 0 max 16384 2024-05-10T08:45:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.513+0000 7fdf2ac42740 1 Processor -- start 2024-05-10T08:45:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.513+0000 7fdf2ac42740 1 -- start start 2024-05-10T08:45:49.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c542e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c6036f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58c8e0 0x55818c544140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201fd960 con 0x55818c56f290 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf200739e0 con 0x55818c58b1f0 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdf200b1220 con 0x55818c58c8e0 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c542e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c542e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50670/0 (socket says 172.21.15.37:50670) 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 -- 172.21.15.37:0/3877282628 learned_addr learned my addr 172.21.15.37:0/3877282628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 -- 172.21.15.37:0/3877282628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58c8e0 msgr2=0x55818c544140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/3877282628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58c8e0 0x55818c544140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 -- 172.21.15.37:0/3877282628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 msgr2=0x55818c6036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/3877282628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c6036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 -- 172.21.15.37:0/3877282628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55818c58d0d0 con 0x55818c56f290 2024-05-10T08:45:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/3877282628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c542e40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c020ca0 tx=0x7fdf1c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a903230675d72def server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.514+0000 7fdf02ffd640 1 -- 172.21.15.37:0/3877282628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c020de0 con 0x55818c56f290 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf02ffd640 1 -- 172.21.15.37:0/3877282628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1c026070 con 0x55818c56f290 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf02ffd640 1 -- 172.21.15.37:0/3877282628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c020780 con 0x55818c56f290 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3877282628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 msgr2=0x55818c542e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3877282628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c542e40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c020ca0 tx=0x7fdf1c021000 comp rx=0 tx=0).stop 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3877282628 shutdown_connections 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3877282628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c58c8e0 0x55818c544140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3877282628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c6036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/3877282628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c56f290 0x55818c542e40 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3877282628 >> 172.21.15.37:0/3877282628 conn(0x55818c53f4f0 msgr2=0x55818c5465e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3877282628 shutdown_connections 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.515+0000 7fdf2ac42740 1 -- 172.21.15.37:0/3877282628 wait complete. 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.516+0000 7fdf2ac42740 1 -- start start 2024-05-10T08:45:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.516+0000 7fdf2ac42740 1 Processor -- start 2024-05-10T08:45:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c56f290 0x55818c56b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c544140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58c8e0 0x55818c544680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55818c581120 con 0x55818c58c8e0 2024-05-10T08:45:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20073390 con 0x55818c58b1f0 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55818c545330 con 0x55818c56f290 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 10 client.0 _ll_register_callbacks cb 0x7fdf1c0048c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58c8e0 0x55818c544680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58c8e0 0x55818c544680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50678/0 (socket says 172.21.15.37:50678) 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 -- 172.21.15.37:0/2131481774 learned_addr learned my addr 172.21.15.37:0/2131481774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c56f290 0x55818c56b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf254bf640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c544140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 -- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c56f290 msgr2=0x55818c56b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c56f290 0x55818c56b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 -- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 msgr2=0x55818c544140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c544140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 -- 172.21.15.37:0/2131481774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55818c581ec0 con 0x55818c58c8e0 2024-05-10T08:45:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c56f290 0x55818c56b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf254bf640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c544140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf264c1640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58c8e0 0x55818c544680 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdf18081f90 tx=0x7fdf180b7170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177efe3746cc3c4c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf00ff9640 1 -- 172.21.15.37:0/2131481774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1804a040 con 0x55818c58c8e0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf00ff9640 1 -- 172.21.15.37:0/2131481774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7fdf18082460 con 0x55818c58c8e0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf1c026070 con 0x55818c58c8e0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf00ff9640 1 -- 172.21.15.37:0/2131481774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fdf1808ad20 con 0x55818c58c8e0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 10 client.6972 fetch_fsmap learned FSMap version 66 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.517+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55818c17a0a0 con 0x55818c58c8e0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf00ff9640 1 -- 172.21.15.37:0/2131481774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1c026070 con 0x55818c58c8e0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf00ff9640 1 -- 172.21.15.37:0/2131481774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7fdf1808a890 con 0x55818c58c8e0 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf2ac42740 10 client.6972 fetch_fsmap finished waiting for FSMap version 66 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf2ac42740 10 client.6972 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:45:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf2ac42740 20 client.6972 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c59ad50 0x55818c59cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf2ac42740 4 client.6972 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) -- 0x55818c4b0640 con 0x55818c59ad50 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c59ad50 0x55818c59cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf00ff9640 10 client.6972 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.518+0000 7fdf25cc0640 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c59ad50 0x55818c59cd70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6a22e13c89e4a5 server_cookie=947808b2d7288094 in_seq=0 out_seq=0 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf00ff9640 1 -- 172.21.15.37:0/2131481774 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55818c4b0640 con 0x55818c59ad50 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf00ff9640 10 client.6972 handle_command_reply: tid=0 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 client.6972 shutdown 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58c8e0 msgr2=0x55818c544680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58c8e0 0x55818c544680 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdf18081f90 tx=0x7fdf180b7170 comp rx=0 tx=0).stop 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 shutdown_connections 2024-05-10T08:45:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55818c59ad50 0x55818c59cd70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55818c58c8e0 0x55818c544680 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55818c58b1f0 0x55818c544140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 --2- 172.21.15.37:0/2131481774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55818c56f290 0x55818c56b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf00ff9640 0 client.6972 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 >> 172.21.15.37:0/2131481774 conn(0x55818c53f4f0 msgr2=0x55818c53a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.524 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:45:49.519+0000 7f90a757f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0) n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5592b8fefb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-05-10T08:45:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 shutdown_connections 2024-05-10T08:45:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 1 -- 172.21.15.37:0/2131481774 wait complete. 2024-05-10T08:45:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.519+0000 7fdf2ac42740 20 client.6972 trim_cache size 0 max 16384 2024-05-10T08:45:49.525 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:45:49.525 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:45:49.525 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "10a42bb0-6ce3-4c8a-b4e4-701d9becbfe5", 2024-05-10T08:45:49.525 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:45:49.526 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:45:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf040762d0 msgr2=0x7fdf04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf040762d0 0x7fdf04078790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdf2015c810 tx=0x7fdf1c007e80 comp rx=0 tx=0).stop 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf2015d2c0 msgr2=0x7fdf201553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf2015d2c0 0x7fdf201553d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009eb0 tx=0x7fdf18004a40 comp rx=0 tx=0).stop 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 shutdown_connections 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdf040762d0 0x7fdf04078790 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf2015d2c0 0x7fdf201553d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf200af740 0x7fdf201ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 --2- 172.21.15.37:0/288396697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf2006ff10 0x7fdf201f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 >> 172.21.15.37:0/288396697 conn(0x7fdf2006c3a0 msgr2=0x7fdf2009bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 shutdown_connections 2024-05-10T08:45:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.520+0000 7fdf27f24640 1 -- 172.21.15.37:0/288396697 wait complete. 2024-05-10T08:45:49.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:45:49.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T08:45:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.637+0000 7f3961f1b640 1 Processor -- start 2024-05-10T08:45:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.637+0000 7f3961f1b640 1 -- start start 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f3961f1b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f395c06c3a0 0x7f395c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f3961f1b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 0x7f395c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f3961f1b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395c09ff30 con 0x7f395c0aedf0 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f3961f1b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f395c15e360 con 0x7f395c06c3a0 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f3961f1b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f395c15d750 con 0x7f395c15d180 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f395affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f395c0aedf0 0x7f395c06c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48490/0 (socket says 172.21.15.37:48490) 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f395affd640 1 -- 172.21.15.37:0/1255802164 learned_addr learned my addr 172.21.15.37:0/1255802164 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:45:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f395bfff640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 0x7f395c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f395b7fe640 1 --2- 172.21.15.37:0/1255802164 >> v2:172.21.15.82:3300/0 conn(0x7f395c06c3a0 0x7f395c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493149223 0 0) 0x7f395c09ff30 con 0x7f395c0aedf0 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.638+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3944003520 con 0x7f395c0aedf0 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3692027715 0 0) 0x7f3944003520 con 0x7f395c0aedf0 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 msgr2=0x7f395c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 0x7f395c0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 >> v2:172.21.15.82:3300/0 conn(0x7f395c06c3a0 msgr2=0x7f395c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 --2- 172.21.15.37:0/1255802164 >> v2:172.21.15.82:3300/0 conn(0x7f395c06c3a0 0x7f395c0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c15da30 con 0x7f395c0aedf0 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f3950001670 con 0x7f395c0aedf0 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 >> v1:172.21.15.37:6789/0 conn(0x7f395c0aedf0 legacy=0x7f395c06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39440039b0 0x7f3944003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 0x7f3944004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3944004d40 0x7f39440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f395c15e360 con 0x7f3944004d40 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f395c15d750 con 0x7f39440039b0 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f394400b9c0 con 0x7f395c15d180 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395bfff640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3944004d40 0x7f39440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395b7fe640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39440039b0 0x7f3944003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395affd640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 0x7f3944004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395bfff640 1 -- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 msgr2=0x7f3944004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395bfff640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c15d180 0x7f3944004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395bfff640 1 -- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39440039b0 msgr2=0x7f3944003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395bfff640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39440039b0 0x7f3944003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.639+0000 7f395bfff640 1 -- 172.21.15.37:0/1255802164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3944003520 con 0x7f3944004d40 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.640+0000 7f395bfff640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3944004d40 0x7f39440051c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f395400e170 tx=0x7f3944005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5463e46402c08e11 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.640+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954034020 con 0x7f3944004d40 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.640+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540305f0 con 0x7f3944004d40 2024-05-10T08:45:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.640+0000 7f395a7fc640 1 -- 172.21.15.37:0/1255802164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954009c10 con 0x7f3944004d40 2024-05-10T08:45:49.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.641+0000 7f3961f1b640 1 -- 172.21.15.37:0/1255802164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3944004d40 msgr2=0x7f39440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.641+0000 7f3961f1b640 1 --2- 172.21.15.37:0/1255802164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3944004d40 0x7f39440051c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f395400e170 tx=0x7f3944005830 comp rx=0 tx=0).stop 2024-05-10T08:45:49.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.641+0000 7f395bfff640 1 -- 172.21.15.37:0/1255802164 reap_dead start 2024-05-10T08:45:49.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.641+0000 7f3961f1b640 1 -- 172.21.15.37:0/1255802164 shutdown_connections 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.641+0000 7f3961f1b640 1 -- 172.21.15.37:0/1255802164 >> 172.21.15.37:0/1255802164 conn(0x7f395c0b3b10 msgr2=0x7f395c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.641+0000 7f3961f1b640 1 -- 172.21.15.37:0/1255802164 shutdown_connections 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.641+0000 7f3961f1b640 1 -- 172.21.15.37:0/1255802164 wait complete. 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.642+0000 7f3961f1b640 1 Processor -- start 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.642+0000 7f3961f1b640 1 -- start start 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f3961f1b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c1560d0 0x7f395c09ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f3961f1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f395c1564b0 0x7f395c15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f3961f1b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395c156e60 0x7f395c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f3961f1b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0b6130 con 0x7f395c1564b0 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f3961f1b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f395c15dff0 con 0x7f395c156e60 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f3961f1b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f395c0b62b0 con 0x7f395c1560d0 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f395c1564b0 0x7f395c15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f395c1564b0 0x7f395c15af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50698/0 (socket says 172.21.15.37:50698) 2024-05-10T08:45:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 -- 172.21.15.37:0/496561178 learned_addr learned my addr 172.21.15.37:0/496561178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395b7fe640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c1560d0 0x7f395c09ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395bfff640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395c156e60 0x7f395c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 -- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c1560d0 msgr2=0x7f395c09ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c1560d0 0x7f395c09ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 -- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395c156e60 msgr2=0x7f395c15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395c156e60 0x7f395c15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.643+0000 7f395affd640 1 -- 172.21.15.37:0/496561178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c09bf80 con 0x7f395c1564b0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.644+0000 7f395affd640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f395c1564b0 0x7f395c15af30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f39500072c0 tx=0x7f3950007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.644+0000 7f3943fff640 1 -- 172.21.15.37:0/496561178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395000fa80 con 0x7f395c1564b0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.644+0000 7f3943fff640 1 -- 172.21.15.37:0/496561178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3950018070 con 0x7f395c1564b0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.644+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c0706b0 con 0x7f395c1564b0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.644+0000 7f3943fff640 1 -- 172.21.15.37:0/496561178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395000fe80 con 0x7f395c1564b0 2024-05-10T08:45:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.644+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c070c70 con 0x7f395c1564b0 2024-05-10T08:45:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.646+0000 7f3943fff640 1 -- 172.21.15.37:0/496561178 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f395001d460 con 0x7f395c1564b0 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.646+0000 7f3943fff640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3948076300 0x7f39480787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.646+0000 7f3943fff640 1 -- 172.21.15.37:0/496561178 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f3950097a20 con 0x7f395c1564b0 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.647+0000 7f395b7fe640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3948076300 0x7f39480787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.647+0000 7f395b7fe640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3948076300 0x7f39480787c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f394c009b00 tx=0x7f394c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.647+0000 7f3964c32740 1 Processor -- start 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.647+0000 7f3964c32740 1 -- start start 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea875160 0x5570ea827af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea857600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f3964c32740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea857b40 0x5570ea82c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f3964c32740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570ea7f4690 con 0x5570ea857b40 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5570ea791f30 con 0x5570ea875160 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5570ea74ab20 con 0x5570ea858280 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea857b40 0x5570ea82c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea857b40 0x5570ea82c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50714/0 (socket says 172.21.15.37:50714) 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 -- 172.21.15.37:0/1548765703 learned_addr learned my addr 172.21.15.37:0/1548765703 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395b7fe640 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea875160 0x5570ea827af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395affd640 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea857600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 -- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 msgr2=0x5570ea857600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea857600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 -- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea875160 msgr2=0x5570ea827af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea875160 0x5570ea827af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.648+0000 7f395bfff640 1 -- 172.21.15.37:0/1548765703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ea742e60 con 0x5570ea857b40 2024-05-10T08:45:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.649+0000 7f395bfff640 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea857b40 0x5570ea82c950 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f395402af30 tx=0x7f395402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f02828affbb2c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.649+0000 7f39417fa640 1 -- 172.21.15.37:0/1548765703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954034070 con 0x5570ea857b40 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.649+0000 7f39417fa640 1 -- 172.21.15.37:0/1548765703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954003990 con 0x5570ea857b40 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.649+0000 7f39417fa640 1 -- 172.21.15.37:0/1548765703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954003d80 con 0x5570ea857b40 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.649+0000 7f3964c32740 1 -- 172.21.15.37:0/1548765703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea857b40 msgr2=0x5570ea82c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.649+0000 7f3964c32740 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea857b40 0x5570ea82c950 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f395402af30 tx=0x7f395402d000 comp rx=0 tx=0).stop 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 -- 172.21.15.37:0/1548765703 shutdown_connections 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea857b40 0x5570ea82c950 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea857600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 --2- 172.21.15.37:0/1548765703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea875160 0x5570ea827af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 -- 172.21.15.37:0/1548765703 >> 172.21.15.37:0/1548765703 conn(0x5570ea829d60 msgr2=0x5570ea872600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 -- 172.21.15.37:0/1548765703 shutdown_connections 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 -- 172.21.15.37:0/1548765703 wait complete. 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 -- start start 2024-05-10T08:45:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.650+0000 7f3964c32740 1 Processor -- start 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea8596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f3964c32740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea8557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea855ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f3964c32740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570ea74e5e0 con 0x5570ea875160 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5570ea78def0 con 0x5570ea845130 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5570ea82bf10 con 0x5570ea858280 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f3964c32740 10 client.0 _ll_register_callbacks cb 0x5570ea749320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f395affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea8557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f395affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea8557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50720/0 (socket says 172.21.15.37:50720) 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f395affd640 1 -- 172.21.15.37:0/3191805390 learned_addr learned my addr 172.21.15.37:0/3191805390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f395bfff640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea855ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea8596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.651+0000 7f395affd640 1 -- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 msgr2=0x5570ea8596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f395affd640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea8596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f395affd640 1 -- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 msgr2=0x5570ea855ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f395affd640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea855ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f395affd640 1 -- 172.21.15.37:0/3191805390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ea56d7d0 con 0x5570ea875160 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea8596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f395affd640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea8557a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f395005d1e0 tx=0x7f39500605f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9566200ff1efd96a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f393a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f393a7fc640 1 -- 172.21.15.37:0/3191805390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39500672d0 con 0x5570ea875160 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f393a7fc640 1 -- 172.21.15.37:0/3191805390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f3950080b40 con 0x5570ea875160 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3954003990 con 0x5570ea875160 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f393a7fc640 1 -- 172.21.15.37:0/3191805390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f3950064dd0 con 0x5570ea875160 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 10 client.6984 fetch_fsmap learned FSMap version 66 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x5570ea4a33f0 con 0x5570ea875160 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f393a7fc640 1 -- 172.21.15.37:0/3191805390 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954003990 con 0x5570ea875160 2024-05-10T08:45:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f393a7fc640 1 -- 172.21.15.37:0/3191805390 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f395007e030 con 0x5570ea875160 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 10 client.6984 fetch_fsmap finished waiting for FSMap version 66 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 10 client.6984 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 20 client.6984 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea85a060 0x5570ea85a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 4 client.6984 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570ea79fb40 con 0x5570ea85a060 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.652+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea85a060 0x5570ea85a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea85a060 0x5570ea85a480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1135cd0381786e1 server_cookie=2736d19b631b9353 in_seq=0 out_seq=0 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f393a7fc640 10 client.6984 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f393a7fc640 1 -- 172.21.15.37:0/3191805390 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5570ea79fb40 con 0x5570ea85a060 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f393a7fc640 10 client.6984 handle_command_reply: tid=0 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 client.6984 shutdown 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 msgr2=0x5570ea8557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea8557a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f395005d1e0 tx=0x7f39500605f0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 shutdown_connections 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea85a060 0x5570ea85a480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea855ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea8557a0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f3964c32740 1 --2- 172.21.15.37:0/3191805390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea8596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.654+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 >> 172.21.15.37:0/3191805390 conn(0x5570ea857b40 msgr2=0x5570ea82b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.653+0000 7f393a7fc640 0 client.6984 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.654+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 shutdown_connections 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.654+0000 7f3964c32740 1 -- 172.21.15.37:0/3191805390 wait complete. 2024-05-10T08:45:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.654+0000 7f3964c32740 20 client.6984 trim_cache size 0 max 16384 2024-05-10T08:45:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 Processor -- start 2024-05-10T08:45:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 -- start start 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea845130 0x5570ea852900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea858280 0x5570ea852e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea875160 0x5570ea894db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f395c2028d0 con 0x5570ea845130 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f395c2018f0 con 0x5570ea858280 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.672+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f395c1f9900 con 0x5570ea875160 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea845130 0x5570ea852900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea845130 0x5570ea852900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50722/0 (socket says 172.21.15.37:50722) 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 -- 172.21.15.37:0/3925552271 learned_addr learned my addr 172.21.15.37:0/3925552271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395affd640 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea858280 0x5570ea852e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395bfff640 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea875160 0x5570ea894db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 -- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea875160 msgr2=0x5570ea894db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea875160 0x5570ea894db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 -- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea858280 msgr2=0x5570ea852e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea858280 0x5570ea852e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 -- 172.21.15.37:0/3925552271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ea4630f0 con 0x5570ea845130 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea845130 0x5570ea852900 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x5570ea845ea0 tx=0x7f394c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f495aeff4bd6ab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f3940ff9640 1 -- 172.21.15.37:0/3925552271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c003c40 con 0x5570ea845130 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f3940ff9640 1 -- 172.21.15.37:0/3925552271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c003de0 con 0x5570ea845130 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.673+0000 7f3940ff9640 1 -- 172.21.15.37:0/3925552271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c02e2d0 con 0x5570ea845130 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 -- 172.21.15.37:0/3925552271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea845130 msgr2=0x5570ea852900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea845130 0x5570ea852900 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x5570ea845ea0 tx=0x7f394c017000 comp rx=0 tx=0).stop 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 -- 172.21.15.37:0/3925552271 shutdown_connections 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea875160 0x5570ea894db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea858280 0x5570ea852e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 --2- 172.21.15.37:0/3925552271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea845130 0x5570ea852900 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 -- 172.21.15.37:0/3925552271 >> 172.21.15.37:0/3925552271 conn(0x5570ea857b40 msgr2=0x5570ea875ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 -- 172.21.15.37:0/3925552271 shutdown_connections 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 -- 172.21.15.37:0/3925552271 wait complete. 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 -- start start 2024-05-10T08:45:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.674+0000 7f3964c32740 1 Processor -- start 2024-05-10T08:45:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea867f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f3964c32740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea895af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f3964c32740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea852900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f3964c32740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570ea855780 con 0x5570ea875160 2024-05-10T08:45:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f395c2012a0 con 0x5570ea845130 2024-05-10T08:45:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f3964c32740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5570ea855aa0 con 0x5570ea858280 2024-05-10T08:45:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f3964c32740 10 client.0 _ll_register_callbacks cb 0x7f395005c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f395bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea852900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f395bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea852900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50738/0 (socket says 172.21.15.37:50738) 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f395bfff640 1 -- 172.21.15.37:0/3124879752 learned_addr learned my addr 172.21.15.37:0/3124879752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea867f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.675+0000 7f395affd640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea895af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f395bfff640 1 -- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 msgr2=0x5570ea895af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f395bfff640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea895af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f395bfff640 1 -- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 msgr2=0x5570ea867f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f395bfff640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea867f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f395bfff640 1 -- 172.21.15.37:0/3124879752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ea88c460 con 0x5570ea875160 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea867f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f395bfff640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea852900 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f395400e260 tx=0x7f3954004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3c952407d63257 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f393a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:45:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f393a7fc640 1 -- 172.21.15.37:0/3124879752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954034040 con 0x5570ea875160 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f393a7fc640 1 -- 172.21.15.37:0/3124879752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f3954004250 con 0x5570ea875160 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f394c003de0 con 0x5570ea875160 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f393a7fc640 1 -- 172.21.15.37:0/3124879752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f3954053050 con 0x5570ea875160 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f3964c32740 10 client.6990 fetch_fsmap learned FSMap version 66 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x5570ea8684d0 con 0x5570ea875160 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f393a7fc640 1 -- 172.21.15.37:0/3124879752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c003de0 con 0x5570ea875160 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f393a7fc640 1 -- 172.21.15.37:0/3124879752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f3954056020 con 0x5570ea875160 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.676+0000 7f3964c32740 10 client.6990 fetch_fsmap finished waiting for FSMap version 66 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 10 client.6990 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 20 client.6990 populate_metadata read hostname 'smithi037' 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea875f70 0x5570ea852e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 4 client.6990 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5570ea7999b0 con 0x5570ea875f70 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea875f70 0x5570ea852e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:45:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f393a7fc640 10 client.6990 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f395b7fe640 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea875f70 0x5570ea852e40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bbbb65892929ed4 server_cookie=4671dfc2a26c8494 in_seq=0 out_seq=0 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f393a7fc640 1 -- 172.21.15.37:0/3124879752 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+256 (crc 0 0 0) 0x5570ea7999b0 con 0x5570ea875f70 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f393a7fc640 10 client.6990 handle_command_reply: tid=0 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 client.6990 shutdown 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 msgr2=0x5570ea852900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea852900 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f395400e260 tx=0x7f3954004ab0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 shutdown_connections 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5570ea875f70 0x5570ea852e40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570ea875160 0x5570ea852900 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570ea858280 0x5570ea895af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f393a7fc640 0 client.6990 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 --2- 172.21.15.37:0/3124879752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570ea845130 0x5570ea867f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 >> 172.21.15.37:0/3124879752 conn(0x5570ea857b40 msgr2=0x5570ea82d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 shutdown_connections 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.677+0000 7f3964c32740 1 -- 172.21.15.37:0/3124879752 wait complete. 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3964c32740 20 client.6990 trim_cache size 0 max 16384 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout: "10a42bb0-6ce3-4c8a-b4e4-701d9becbfe5": { 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/dir", 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "10a42bb0-6ce3-4c8a-b4e4-701d9becbfe5", 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive" 2024-05-10T08:45:49.683 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:49.684 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:45:49.684 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3948076300 msgr2=0x7f39480787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3948076300 0x7f39480787c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f394c009b00 tx=0x7f394c008040 comp rx=0 tx=0).stop 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f395c1564b0 msgr2=0x7f395c15af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f395c1564b0 0x7f395c15af30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f39500072c0 tx=0x7f3950007780 comp rx=0 tx=0).stop 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 shutdown_connections 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3948076300 0x7f39480787c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395c156e60 0x7f395c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f395c1564b0 0x7f395c15af30 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 --2- 172.21.15.37:0/496561178 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f395c1560d0 0x7f395c09ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 >> 172.21.15.37:0/496561178 conn(0x7f395c0b3b10 msgr2=0x7f395c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 shutdown_connections 2024-05-10T08:45:49.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:45:49.678+0000 7f3961f1b640 1 -- 172.21.15.37:0/496561178 wait complete. 2024-05-10T08:45:49.688 INFO:tasks.cephfs.filesystem:scrub status for tag:10a42bb0-6ce3-4c8a-b4e4-701d9becbfe5 - {'path': '/dir', 'tag': '10a42bb0-6ce3-4c8a-b4e4-701d9becbfe5', 'options': 'recursive'} 2024-05-10T08:45:53.756 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:45:53.757+0000 7fdeb3164640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T08:45:53.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:45:53.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:46:19.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:19.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T08:46:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.809+0000 7f8944064640 1 Processor -- start 2024-05-10T08:46:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.810+0000 7f8944064640 1 -- start start 2024-05-10T08:46:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.810+0000 7f8944064640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c1524f0 0x7f893c0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.810+0000 7f8944064640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f893c15bc80 0x7f893c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8944064640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893c0b4590 con 0x7f893c06e8d0 2024-05-10T08:46:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8944064640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f893c0b51a0 con 0x7f893c15bc80 2024-05-10T08:46:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8944064640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f893c073450 con 0x7f893c1524f0 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f89415ff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f893c15bc80 0x7f893c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8941e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c1524f0 0x7f893c0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f89415ff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f893c15bc80 0x7f893c06e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:60030/0 (socket says 172.21.15.37:60030) 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8941e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c1524f0 0x7f893c0b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:46790/0 (socket says 172.21.15.37:46790) 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f89415ff640 1 -- 172.21.15.37:0/3437848435 learned_addr learned my addr 172.21.15.37:0/3437848435 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8941e00640 1 -- 172.21.15.37:0/3437848435 >> v2:172.21.15.82:3300/0 conn(0x7f893c15bc80 msgr2=0x7f893c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8941e00640 1 --2- 172.21.15.37:0/3437848435 >> v2:172.21.15.82:3300/0 conn(0x7f893c15bc80 0x7f893c06e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8941e00640 1 -- 172.21.15.37:0/3437848435 >> v1:172.21.15.82:6789/0 conn(0x7f893c06e8d0 legacy=0x7f893c073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f8941e00640 1 -- 172.21.15.37:0/3437848435 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c0b4870 con 0x7f893c1524f0 2024-05-10T08:46:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.811+0000 7f89415ff640 1 --2- 172.21.15.37:0/3437848435 >> v2:172.21.15.82:3300/0 conn(0x7f893c15bc80 0x7f893c06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.812+0000 7f8941e00640 1 --2- 172.21.15.37:0/3437848435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c1524f0 0x7f893c0b3c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8938009d90 tx=0x7f893802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23b66bfcabfe146b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.812+0000 7f8940dfe640 1 -- 172.21.15.37:0/3437848435 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938037070 con 0x7f893c1524f0 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.812+0000 7f8940dfe640 1 -- 172.21.15.37:0/3437848435 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8938007740 con 0x7f893c1524f0 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.812+0000 7f8940dfe640 1 -- 172.21.15.37:0/3437848435 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938007b10 con 0x7f893c1524f0 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 -- 172.21.15.37:0/3437848435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c1524f0 msgr2=0x7f893c0b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 --2- 172.21.15.37:0/3437848435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c1524f0 0x7f893c0b3c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8938009d90 tx=0x7f893802b770 comp rx=0 tx=0).stop 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 -- 172.21.15.37:0/3437848435 shutdown_connections 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 --2- 172.21.15.37:0/3437848435 >> v2:172.21.15.82:3300/0 conn(0x7f893c15bc80 0x7f893c06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 --2- 172.21.15.37:0/3437848435 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c1524f0 0x7f893c0b3c20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 -- 172.21.15.37:0/3437848435 >> 172.21.15.37:0/3437848435 conn(0x7f893c06c3a0 msgr2=0x7f893c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 -- 172.21.15.37:0/3437848435 shutdown_connections 2024-05-10T08:46:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.813+0000 7f8944064640 1 -- 172.21.15.37:0/3437848435 wait complete. 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.814+0000 7f8944064640 1 Processor -- start 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.814+0000 7f8944064640 1 -- start start 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8944064640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c06e8d0 0x7f893c147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8944064640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f893c1524f0 0x7f893c14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8944064640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c15bc80 0x7f893c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8944064640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1528d0 con 0x7f893c15bc80 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8944064640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f893c0b4e30 con 0x7f893c1524f0 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8944064640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f893c0b5630 con 0x7f893c06e8d0 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8942601640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c15bc80 0x7f893c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8942601640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c15bc80 0x7f893c150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38806/0 (socket says 172.21.15.37:38806) 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.815+0000 7f8942601640 1 -- 172.21.15.37:0/1830158181 learned_addr learned my addr 172.21.15.37:0/1830158181 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8941e00640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c06e8d0 0x7f893c147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f89415ff640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f893c1524f0 0x7f893c14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8942601640 1 -- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c06e8d0 msgr2=0x7f893c147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8942601640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c06e8d0 0x7f893c147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8942601640 1 -- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f893c1524f0 msgr2=0x7f893c14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8942601640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f893c1524f0 0x7f893c14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8942601640 1 -- 172.21.15.37:0/1830158181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c09d2a0 con 0x7f893c15bc80 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8942601640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c15bc80 0x7f893c150420 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8934001eb0 tx=0x7f893400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f892e7fc640 1 -- 172.21.15.37:0/1830158181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934017070 con 0x7f893c15bc80 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f892e7fc640 1 -- 172.21.15.37:0/1830158181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89340052d0 con 0x7f893c15bc80 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893c09d580 con 0x7f893c15bc80 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f892e7fc640 1 -- 172.21.15.37:0/1830158181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934003810 con 0x7f893c15bc80 2024-05-10T08:46:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.816+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893c09db40 con 0x7f893c15bc80 2024-05-10T08:46:19.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.818+0000 7f892e7fc640 1 -- 172.21.15.37:0/1830158181 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f893401a070 con 0x7f893c15bc80 2024-05-10T08:46:19.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.818+0000 7f892e7fc640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89200762d0 0x7f8920078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.819+0000 7f892e7fc640 1 -- 172.21.15.37:0/1830158181 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f8934096c80 con 0x7f893c15bc80 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.819+0000 7f8941e00640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89200762d0 0x7f8920078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.819+0000 7f8941e00640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89200762d0 0x7f8920078790 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8938034000 tx=0x7f893802f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 Processor -- start 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 -- start start 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846c450 0x55b938470250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b938444160 0x55b93846c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93846f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b93840c690 con 0x55b93846c450 2024-05-10T08:46:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b9383a9f30 con 0x55b93846cd70 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b938362b20 con 0x55b938444160 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8941e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846c450 0x55b938470250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8941e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846c450 0x55b938470250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38816/0 (socket says 172.21.15.37:38816) 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.820+0000 7f8941e00640 1 -- 172.21.15.37:0/802836736 learned_addr learned my addr 172.21.15.37:0/802836736 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8942601640 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93846f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f89415ff640 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b938444160 0x55b93846c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8941e00640 1 -- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b938444160 msgr2=0x55b93846c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8941e00640 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b938444160 0x55b93846c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8941e00640 1 -- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 msgr2=0x55b93846f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8941e00640 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93846f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8941e00640 1 -- 172.21.15.37:0/802836736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93835ae60 con 0x55b93846c450 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8942601640 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93846f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f8941e00640 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846c450 0x55b938470250 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8938035040 tx=0x7f893802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883d0e3e9ff270db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f891f7fe640 1 -- 172.21.15.37:0/802836736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938037040 con 0x55b93846c450 2024-05-10T08:46:19.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f891f7fe640 1 -- 172.21.15.37:0/802836736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893803d470 con 0x55b93846c450 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.821+0000 7f891f7fe640 1 -- 172.21.15.37:0/802836736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893803d820 con 0x55b93846c450 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 -- 172.21.15.37:0/802836736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846c450 msgr2=0x55b938470250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846c450 0x55b938470250 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8938035040 tx=0x7f893802d000 comp rx=0 tx=0).stop 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 -- 172.21.15.37:0/802836736 shutdown_connections 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93846f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b938444160 0x55b93846c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 --2- 172.21.15.37:0/802836736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846c450 0x55b938470250 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 -- 172.21.15.37:0/802836736 >> 172.21.15.37:0/802836736 conn(0x55b938441d60 msgr2=0x55b93848a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 -- 172.21.15.37:0/802836736 shutdown_connections 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 -- 172.21.15.37:0/802836736 wait complete. 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.822+0000 7f8946d7c740 1 -- start start 2024-05-10T08:46:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.823+0000 7f8946d7c740 1 Processor -- start 2024-05-10T08:46:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.823+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846cd70 0x55b93848af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b938466bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8946d7c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b9383665e0 con 0x55b93846e7a0 2024-05-10T08:46:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b9383a5ef0 con 0x55b93846c450 2024-05-10T08:46:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b9384400b0 con 0x55b93846cd70 2024-05-10T08:46:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8946d7c740 10 client.0 _ll_register_callbacks cb 0x55b938361320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b938466bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b938466bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38832/0 (socket says 172.21.15.37:38832) 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 -- 172.21.15.37:0/2220329483 learned_addr learned my addr 172.21.15.37:0/2220329483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8941e00640 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f89415ff640 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846cd70 0x55b93848af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 -- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846cd70 msgr2=0x55b93848af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846cd70 0x55b93848af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 -- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 msgr2=0x55b93846f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 -- 172.21.15.37:0/2220329483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9381857d0 con 0x55b93846e7a0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8942601640 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b938466bd0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f893405fb80 tx=0x7f89340055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd0328bfe0cf1bc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f891cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f891cff9640 1 -- 172.21.15.37:0/2220329483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934063fa0 con 0x55b93846e7a0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f891cff9640 1 -- 172.21.15.37:0/2220329483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f89340661a0 con 0x55b93846e7a0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f893803d470 con 0x55b93846e7a0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.824+0000 7f891cff9640 1 -- 172.21.15.37:0/2220329483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f89340689c0 con 0x55b93846e7a0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 10 client.6999 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55b9380bb3f0 con 0x55b93846e7a0 2024-05-10T08:46:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f891cff9640 1 -- 172.21.15.37:0/2220329483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893803d470 con 0x55b93846e7a0 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f891cff9640 1 -- 172.21.15.37:0/2220329483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f893405b560 con 0x55b93846e7a0 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 10 client.6999 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 10 client.6999 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 20 client.6999 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 4 client.6999 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9383b7b40 con 0x55b9384719f0 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8941e00640 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f891cff9640 10 client.6999 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.825+0000 7f8941e00640 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848bbb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe35a7e2f06f8782 server_cookie=18ed74beb761d76f in_seq=0 out_seq=0 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f891cff9640 1 -- 172.21.15.37:0/2220329483 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b9383b7b40 con 0x55b9384719f0 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f891cff9640 10 client.6999 handle_command_reply: tid=0 2024-05-10T08:46:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 client.6999 shutdown 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 msgr2=0x55b938466bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b938466bd0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f893405fb80 tx=0x7f89340055c0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 shutdown_connections 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848bbb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b938466bd0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f891cff9640 0 client.6999 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846cd70 0x55b93848af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 --2- 172.21.15.37:0/2220329483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 >> 172.21.15.37:0/2220329483 conn(0x55b938444160 msgr2=0x55b93846b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 shutdown_connections 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 1 -- 172.21.15.37:0/2220329483 wait complete. 2024-05-10T08:46:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.826+0000 7f8946d7c740 20 client.6999 trim_cache size 0 max 16384 2024-05-10T08:46:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.845+0000 7f8946d7c740 1 Processor -- start 2024-05-10T08:46:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.845+0000 7f8946d7c740 1 -- start start 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846cd70 0x55b938472240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846e7a0 0x55b93848b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8946d7c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1fdc20 con 0x55b93846cd70 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f893c1fcc40 con 0x55b93846c450 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f893c09ca10 con 0x55b93846e7a0 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846cd70 0x55b938472240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846cd70 0x55b938472240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38846/0 (socket says 172.21.15.37:38846) 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 -- 172.21.15.37:0/4016086288 learned_addr learned my addr 172.21.15.37:0/4016086288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8941e00640 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 -- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846e7a0 msgr2=0x55b93848b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8942601640 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846e7a0 0x55b93848b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846e7a0 0x55b93848b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 -- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 msgr2=0x55b93846d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 -- 172.21.15.37:0/4016086288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93807b0f0 con 0x55b93846cd70 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f8941e00640 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.846+0000 7f89415ff640 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846cd70 0x55b938472240 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8930009ba0 tx=0x7f8930009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323cd077a4421fdf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f891effd640 1 -- 172.21.15.37:0/4016086288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930004030 con 0x55b93846cd70 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f891effd640 1 -- 172.21.15.37:0/4016086288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89300041d0 con 0x55b93846cd70 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f891effd640 1 -- 172.21.15.37:0/4016086288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930003610 con 0x55b93846cd70 2024-05-10T08:46:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 -- 172.21.15.37:0/4016086288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846cd70 msgr2=0x55b938472240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846cd70 0x55b938472240 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8930009ba0 tx=0x7f8930009240 comp rx=0 tx=0).stop 2024-05-10T08:46:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 -- 172.21.15.37:0/4016086288 shutdown_connections 2024-05-10T08:46:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846e7a0 0x55b93848b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846cd70 0x55b938472240 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 --2- 172.21.15.37:0/4016086288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846c450 0x55b93846d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 -- 172.21.15.37:0/4016086288 >> 172.21.15.37:0/4016086288 conn(0x55b938444160 msgr2=0x55b938470410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:19.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 -- 172.21.15.37:0/4016086288 shutdown_connections 2024-05-10T08:46:19.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.847+0000 7f8946d7c740 1 -- 172.21.15.37:0/4016086288 wait complete. 2024-05-10T08:46:19.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.848+0000 7f8946d7c740 1 -- start start 2024-05-10T08:46:19.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.848+0000 7f8946d7c740 1 Processor -- start 2024-05-10T08:46:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846c450 0x55b938468eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93850bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8946d7c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b93850c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8946d7c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b93846fec0 con 0x55b93846e7a0 2024-05-10T08:46:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f893c09d060 con 0x55b93846cd70 2024-05-10T08:46:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8946d7c740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b93843f4d0 con 0x55b93846c450 2024-05-10T08:46:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8946d7c740 10 client.0 _ll_register_callbacks cb 0x7f893405f360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b93850c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b93850c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38862/0 (socket says 172.21.15.37:38862) 2024-05-10T08:46:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 -- 172.21.15.37:0/3164202412 learned_addr learned my addr 172.21.15.37:0/3164202412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8941e00640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846c450 0x55b938468eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f89415ff640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93850bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 -- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846c450 msgr2=0x55b938468eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846c450 0x55b938468eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 -- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 msgr2=0x55b93850bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93850bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 -- 172.21.15.37:0/3164202412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b938468470 con 0x55b93846e7a0 2024-05-10T08:46:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8941e00640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846c450 0x55b938468eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f8942601640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b93850c050 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f893400a040 tx=0x7f8934062040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce62ed364818bff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.849+0000 7f891cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f891cff9640 1 -- 172.21.15.37:0/3164202412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934063fa0 con 0x55b93846e7a0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f891cff9640 1 -- 172.21.15.37:0/3164202412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f89340663b0 con 0x55b93846e7a0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89300041d0 con 0x55b93846e7a0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f891cff9640 1 -- 172.21.15.37:0/3164202412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f893405e8c0 con 0x55b93846e7a0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 10 client.7005 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55b938468770 con 0x55b93846e7a0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f891cff9640 1 -- 172.21.15.37:0/3164202412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89300041d0 con 0x55b93846e7a0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f891cff9640 1 -- 172.21.15.37:0/3164202412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f893405ea60 con 0x55b93846e7a0 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 10 client.7005 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 10 client.7005 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 20 client.7005 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 4 client.7005 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b93848cf20 con 0x55b9384719f0 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8941e00640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f891cff9640 10 client.7005 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.850+0000 7f8941e00640 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848b710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b131d63bb9846f server_cookie=4372fd0756b904ce in_seq=0 out_seq=0 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f891cff9640 1 -- 172.21.15.37:0/3164202412 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b93848cf20 con 0x55b9384719f0 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f891cff9640 10 client.7005 handle_command_reply: tid=0 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 client.7005 shutdown 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 msgr2=0x55b93850c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b93850c050 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f893400a040 tx=0x7f8934062040 comp rx=0 tx=0).stop 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 shutdown_connections 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b9384719f0 0x55b93848b710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b93846e7a0 0x55b93850c050 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b93846cd70 0x55b93850bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f891cff9640 0 client.7005 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 --2- 172.21.15.37:0/3164202412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b93846c450 0x55b938468eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 >> 172.21.15.37:0/3164202412 conn(0x55b938444160 msgr2=0x55b93843afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 shutdown_connections 2024-05-10T08:46:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 1 -- 172.21.15.37:0/3164202412 wait complete. 2024-05-10T08:46:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8946d7c740 20 client.7005 trim_cache size 0 max 16384 2024-05-10T08:46:19.864 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:46:19.864 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:46:19.865 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:46:19.865 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89200762d0 msgr2=0x7f8920078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8944064640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89200762d0 0x7f8920078790 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8938034000 tx=0x7f893802f000 comp rx=0 tx=0).stop 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c15bc80 msgr2=0x7f893c150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.851+0000 7f8944064640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c15bc80 0x7f893c150420 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8934001eb0 tx=0x7f893400c890 comp rx=0 tx=0).stop 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 shutdown_connections 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f89200762d0 0x7f8920078790 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c15bc80 0x7f893c150420 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f893c1524f0 0x7f893c14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 --2- 172.21.15.37:0/1830158181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f893c06e8d0 0x7f893c147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 >> 172.21.15.37:0/1830158181 conn(0x7f893c06c3a0 msgr2=0x7f893c15cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:19.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 shutdown_connections 2024-05-10T08:46:19.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.852+0000 7f8944064640 1 -- 172.21.15.37:0/1830158181 wait complete. 2024-05-10T08:46:19.868 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:46:19.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:46:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.975+0000 7f1309b33640 1 Processor -- start 2024-05-10T08:46:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.975+0000 7f1309b33640 1 -- start start 2024-05-10T08:46:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1309b33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f130415f420 0x7f13040d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1309b33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13040d2080 0x7f13040d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1309b33640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13041630b0 con 0x7f13040d3ca0 2024-05-10T08:46:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1309b33640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f13040d2550 con 0x7f13040d2080 2024-05-10T08:46:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1309b33640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f13040d2c80 con 0x7f130415f420 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f13037fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f130415f420 0x7f13040d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1303fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13040d2080 0x7f13040d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f13037fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f130415f420 0x7f13040d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:46838/0 (socket says 172.21.15.37:46838) 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1303fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13040d2080 0x7f13040d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:60090/0 (socket says 172.21.15.37:60090) 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f13037fe640 1 -- 172.21.15.37:0/434040221 learned_addr learned my addr 172.21.15.37:0/434040221 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f1302ffd640 1 --1- 172.21.15.37:0/434040221 >> v1:172.21.15.82:6789/0 conn(0x7f13040d3ca0 0x7f13040d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:55228/0 (socket says 172.21.15.37:55228) 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f13037fe640 1 -- 172.21.15.37:0/434040221 >> v2:172.21.15.82:3300/0 conn(0x7f13040d2080 msgr2=0x7f13040d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f13037fe640 1 --2- 172.21.15.37:0/434040221 >> v2:172.21.15.82:3300/0 conn(0x7f13040d2080 0x7f13040d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f13037fe640 1 -- 172.21.15.37:0/434040221 >> v1:172.21.15.82:6789/0 conn(0x7f13040d3ca0 legacy=0x7f13040d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.976+0000 7f13037fe640 1 -- 172.21.15.37:0/434040221 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13040d2f60 con 0x7f130415f420 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.977+0000 7f13037fe640 1 --2- 172.21.15.37:0/434040221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f130415f420 0x7f13040d3760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009870 tx=0x7f12f402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d043a1eccf76bd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.977+0000 7f13027fc640 1 -- 172.21.15.37:0/434040221 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4037070 con 0x7f130415f420 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.977+0000 7f13027fc640 1 -- 172.21.15.37:0/434040221 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f4032440 con 0x7f130415f420 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.977+0000 7f13027fc640 1 -- 172.21.15.37:0/434040221 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4032810 con 0x7f130415f420 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 -- 172.21.15.37:0/434040221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f130415f420 msgr2=0x7f13040d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 --2- 172.21.15.37:0/434040221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f130415f420 0x7f13040d3760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009870 tx=0x7f12f402a270 comp rx=0 tx=0).stop 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 -- 172.21.15.37:0/434040221 shutdown_connections 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 --2- 172.21.15.37:0/434040221 >> v2:172.21.15.82:3300/0 conn(0x7f13040d2080 0x7f13040d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 --2- 172.21.15.37:0/434040221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f130415f420 0x7f13040d3760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 -- 172.21.15.37:0/434040221 >> 172.21.15.37:0/434040221 conn(0x7f130408eac0 msgr2=0x7f130409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 -- 172.21.15.37:0/434040221 shutdown_connections 2024-05-10T08:46:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.978+0000 7f1309b33640 1 -- 172.21.15.37:0/434040221 wait complete. 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.979+0000 7f1309b33640 1 Processor -- start 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.979+0000 7f1309b33640 1 -- start start 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1309b33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13040d2080 0x7f130415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1309b33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040ca860 0x7f130406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1309b33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13040c8b00 0x7f130406e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1309b33640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13040d5200 con 0x7f13040ca860 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1309b33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f13040d2830 con 0x7f13040d2080 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1309b33640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f13040d5380 con 0x7f13040c8b00 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1302ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040ca860 0x7f130406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1302ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040ca860 0x7f130406dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38878/0 (socket says 172.21.15.37:38878) 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1302ffd640 1 -- 172.21.15.37:0/582685271 learned_addr learned my addr 172.21.15.37:0/582685271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f13037fe640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13040d2080 0x7f130415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.980+0000 7f1303fff640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13040c8b00 0x7f130406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1302ffd640 1 -- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13040c8b00 msgr2=0x7f130406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1302ffd640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13040c8b00 0x7f130406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1302ffd640 1 -- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13040d2080 msgr2=0x7f130415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1302ffd640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13040d2080 0x7f130415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1302ffd640 1 -- 172.21.15.37:0/582685271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13040c90c0 con 0x7f13040ca860 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1302ffd640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040ca860 0x7f130406dfd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c460 tx=0x7f12f800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f12ebfff640 1 -- 172.21.15.37:0/582685271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f80074e0 con 0x7f13040ca860 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f12ebfff640 1 -- 172.21.15.37:0/582685271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f8007680 con 0x7f13040ca860 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13040c93a0 con 0x7f13040ca860 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f12ebfff640 1 -- 172.21.15.37:0/582685271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8004a00 con 0x7f13040ca860 2024-05-10T08:46:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.981+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13040c9960 con 0x7f13040ca860 2024-05-10T08:46:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.982+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13040693f0 con 0x7f13040ca860 2024-05-10T08:46:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.983+0000 7f12ebfff640 1 -- 172.21.15.37:0/582685271 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f12f801a020 con 0x7f13040ca860 2024-05-10T08:46:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.983+0000 7f12ebfff640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12f00762d0 0x7f12f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.983+0000 7f12ebfff640 1 -- 172.21.15.37:0/582685271 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f12f8096e50 con 0x7f13040ca860 2024-05-10T08:46:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.984+0000 7f13037fe640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12f00762d0 0x7f12f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.984+0000 7f13037fe640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12f00762d0 0x7f12f0078790 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f12f4034000 tx=0x7f12f402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:19.988+0000 7f12ebfff640 1 -- 172.21.15.37:0/582685271 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f13041630b0 con 0x7f13040ca860 2024-05-10T08:46:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.216+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13040b4c50 con 0x7f13040ca860 2024-05-10T08:46:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.216+0000 7f12ebfff640 1 -- 172.21.15.37:0/582685271 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5178 (secure 0 0 0) 0x7f12f805ffa0 con 0x7f13040ca860 2024-05-10T08:46:20.215 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:20.215 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:53.743846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":6,"addr":"172.21.15.37:6834/375241165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":375241165},{"type":"v1","addr":"172.21.15.37:6834","nonce":375241165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6870,"qdb_cluster":[6870]},"id":6}]} 2024-05-10T08:46:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 67 2024-05-10T08:46:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12f00762d0 msgr2=0x7f12f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12f00762d0 0x7f12f0078790 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f12f4034000 tx=0x7f12f402e000 comp rx=0 tx=0).stop 2024-05-10T08:46:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040ca860 msgr2=0x7f130406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040ca860 0x7f130406dfd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c460 tx=0x7f12f800c920 comp rx=0 tx=0).stop 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 shutdown_connections 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12f00762d0 0x7f12f0078790 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13040c8b00 0x7f130406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040ca860 0x7f130406dfd0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 --2- 172.21.15.37:0/582685271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13040d2080 0x7f130415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 >> 172.21.15.37:0/582685271 conn(0x7f130408eac0 msgr2=0x7f13040b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 shutdown_connections 2024-05-10T08:46:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.218+0000 7f1309b33640 1 -- 172.21.15.37:0/582685271 wait complete. 2024-05-10T08:46:20.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-05-10T08:46:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.335+0000 7f4f993a5640 1 Processor -- start 2024-05-10T08:46:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.335+0000 7f4f993a5640 1 -- start start 2024-05-10T08:46:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f993a5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406d620 0x7f4f94073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f993a5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f9406da00 0x7f4f940af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f993a5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f940b5ee0 0x7f4f9406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f993a5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4f940afaa0 con 0x7f4f940b5ee0 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f993a5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4f940b5a50 con 0x7f4f9406da00 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f993a5640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4f940af800 con 0x7f4f9406d620 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f940b5ee0 0x7f4f9406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f940b5ee0 0x7f4f9406e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38892/0 (socket says 172.21.15.37:38892) 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 -- 172.21.15.37:0/3194325385 learned_addr learned my addr 172.21.15.37:0/3194325385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f927fc640 1 --2- 172.21.15.37:0/3194325385 >> v2:172.21.15.82:3300/0 conn(0x7f4f9406da00 0x7f4f940af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/3194325385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406d620 0x7f4f94073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 -- 172.21.15.37:0/3194325385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406d620 msgr2=0x7f4f94073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 --2- 172.21.15.37:0/3194325385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406d620 0x7f4f94073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 -- 172.21.15.37:0/3194325385 >> v2:172.21.15.82:3300/0 conn(0x7f4f9406da00 msgr2=0x7f4f940af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 --2- 172.21.15.37:0/3194325385 >> v2:172.21.15.82:3300/0 conn(0x7f4f9406da00 0x7f4f940af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.336+0000 7f4f937fe640 1 -- 172.21.15.37:0/3194325385 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f940b5120 con 0x7f4f940b5ee0 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.337+0000 7f4f937fe640 1 --2- 172.21.15.37:0/3194325385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f940b5ee0 0x7f4f9406e920 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4f9406e730 tx=0x7f4f8c02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8164eed20ddc0e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.337+0000 7f4f91ffb640 1 -- 172.21.15.37:0/3194325385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c036070 con 0x7f4f940b5ee0 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.337+0000 7f4f91ffb640 1 -- 172.21.15.37:0/3194325385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c031600 con 0x7f4f940b5ee0 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.337+0000 7f4f91ffb640 1 -- 172.21.15.37:0/3194325385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0319d0 con 0x7f4f940b5ee0 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 -- 172.21.15.37:0/3194325385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f940b5ee0 msgr2=0x7f4f9406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 --2- 172.21.15.37:0/3194325385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f940b5ee0 0x7f4f9406e920 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4f9406e730 tx=0x7f4f8c02a570 comp rx=0 tx=0).stop 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 -- 172.21.15.37:0/3194325385 shutdown_connections 2024-05-10T08:46:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 --2- 172.21.15.37:0/3194325385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f940b5ee0 0x7f4f9406e920 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 --2- 172.21.15.37:0/3194325385 >> v2:172.21.15.82:3300/0 conn(0x7f4f9406da00 0x7f4f940af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 --2- 172.21.15.37:0/3194325385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406d620 0x7f4f94073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 -- 172.21.15.37:0/3194325385 >> 172.21.15.37:0/3194325385 conn(0x7f4f940728c0 msgr2=0x7f4f94072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 -- 172.21.15.37:0/3194325385 shutdown_connections 2024-05-10T08:46:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.338+0000 7f4f993a5640 1 -- 172.21.15.37:0/3194325385 wait complete. 2024-05-10T08:46:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.339+0000 7f4f993a5640 1 Processor -- start 2024-05-10T08:46:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.339+0000 7f4f993a5640 1 -- start start 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f993a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9406d620 0x7f4f941509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f993a5640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406da00 0x7f4f941e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f993a5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f940b5ee0 0x7f4f94157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f993a5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940b6370 con 0x7f4f9406d620 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f993a5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940b56e0 con 0x7f4f940b5ee0 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f993a5640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4f940b64f0 con 0x7f4f9406da00 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9406d620 0x7f4f941509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9406d620 0x7f4f941509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38900/0 (socket says 172.21.15.37:38900) 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f92ffd640 1 -- 172.21.15.37:0/1073475438 learned_addr learned my addr 172.21.15.37:0/1073475438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f937fe640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f940b5ee0 0x7f4f94157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.340+0000 7f4f927fc640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406da00 0x7f4f941e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f92ffd640 1 -- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406da00 msgr2=0x7f4f941e7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406da00 0x7f4f941e7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f92ffd640 1 -- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f940b5ee0 msgr2=0x7f4f94157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f940b5ee0 0x7f4f94157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f92ffd640 1 -- 172.21.15.37:0/1073475438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f941e7cd0 con 0x7f4f9406d620 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9406d620 0x7f4f941509f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400d830 tx=0x7f4f8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f8b7fe640 1 -- 172.21.15.37:0/1073475438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84018030 con 0x7f4f9406d620 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f8b7fe640 1 -- 172.21.15.37:0/1073475438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8400be10 con 0x7f4f9406d620 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f941e7fb0 con 0x7f4f9406d620 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f8b7fe640 1 -- 172.21.15.37:0/1073475438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84009850 con 0x7f4f9406d620 2024-05-10T08:46:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.341+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f941e8570 con 0x7f4f9406d620 2024-05-10T08:46:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.343+0000 7f4f8b7fe640 1 -- 172.21.15.37:0/1073475438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f8401b070 con 0x7f4f9406d620 2024-05-10T08:46:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.343+0000 7f4f8b7fe640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f740762d0 0x7f4f74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.343+0000 7f4f8b7fe640 1 -- 172.21.15.37:0/1073475438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f4f84097870 con 0x7f4f9406d620 2024-05-10T08:46:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.343+0000 7f4f927fc640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f740762d0 0x7f4f74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.344+0000 7f4f927fc640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f740762d0 0x7f4f74078790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009aa0 tx=0x7f4f7c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.344+0000 7f4f9c195740 1 Processor -- start 2024-05-10T08:46:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.344+0000 7f4f9c195740 1 -- start start 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f190502f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f1907fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190800b0 0x559f19054ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f9c195740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559f18f40920 con 0x559f190800b0 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f18fb5dd0 con 0x559f190807f0 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x559f18f663e0 con 0x559f1909d6d0 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190800b0 0x559f19054ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190800b0 0x559f19054ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38910/0 (socket says 172.21.15.37:38910) 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 -- 172.21.15.37:0/85234553 learned_addr learned my addr 172.21.15.37:0/85234553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f927fc640 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f1907fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f190502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 -- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 msgr2=0x559f190502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f190502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 -- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 msgr2=0x559f1907fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f1907fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f937fe640 1 -- 172.21.15.37:0/85234553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f18d977c0 con 0x559f190800b0 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.345+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f190502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f937fe640 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190800b0 0x559f19054ec0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c02ab60 tx=0x7f4f8c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ec3a9f964af902 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f88ff9640 1 -- 172.21.15.37:0/85234553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c036040 con 0x559f190800b0 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f88ff9640 1 -- 172.21.15.37:0/85234553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c037040 con 0x559f190800b0 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f88ff9640 1 -- 172.21.15.37:0/85234553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c031800 con 0x559f190800b0 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f9c195740 1 -- 172.21.15.37:0/85234553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190800b0 msgr2=0x559f19054ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f9c195740 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190800b0 0x559f19054ec0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c02ab60 tx=0x7f4f8c02e000 comp rx=0 tx=0).stop 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f9c195740 1 -- 172.21.15.37:0/85234553 shutdown_connections 2024-05-10T08:46:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f9c195740 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190800b0 0x559f19054ec0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f9c195740 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f1907fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f9c195740 1 --2- 172.21.15.37:0/85234553 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f190502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.346+0000 7f4f9c195740 1 -- 172.21.15.37:0/85234553 >> 172.21.15.37:0/85234553 conn(0x559f19052560 msgr2=0x559f1909ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.347+0000 7f4f9c195740 1 -- 172.21.15.37:0/85234553 shutdown_connections 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.347+0000 7f4f9c195740 1 -- 172.21.15.37:0/85234553 wait complete. 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.347+0000 7f4f9c195740 1 -- start start 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.347+0000 7f4f9c195740 1 Processor -- start 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f190974d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1909d6d0 0x559f19053a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19053fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f9c195740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559f18fbe440 con 0x559f190807f0 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f18fb9120 con 0x559f1909d6d0 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x559f18fc7210 con 0x559f1907b810 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f9c195740 10 client.0 _ll_register_callbacks cb 0x559f18f5e690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f190974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f190974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38918/0 (socket says 172.21.15.37:38918) 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 -- 172.21.15.37:0/2943134920 learned_addr learned my addr 172.21.15.37:0/2943134920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f927fc640 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1909d6d0 0x559f19053a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f937fe640 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19053fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 -- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 msgr2=0x559f19053fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19053fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 -- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1909d6d0 msgr2=0x559f19053a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1909d6d0 0x559f19053a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.348+0000 7f4f92ffd640 1 -- 172.21.15.37:0/2943134920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f18df7f50 con 0x559f190807f0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f190974d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f4f8405cf30 tx=0x7f4f840600b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527a7bba04b94cf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f71ffb640 1 -- 172.21.15.37:0/2943134920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84061dc0 con 0x559f190807f0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f71ffb640 1 -- 172.21.15.37:0/2943134920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f4f8405fba0 con 0x559f190807f0 2024-05-10T08:46:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f8c037040 con 0x559f190807f0 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f71ffb640 1 -- 172.21.15.37:0/2943134920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f4f84064c40 con 0x559f190807f0 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 10 client.7020 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x559f18c8b0b0 con 0x559f190807f0 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f71ffb640 1 -- 172.21.15.37:0/2943134920 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c037040 con 0x559f190807f0 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f71ffb640 1 -- 172.21.15.37:0/2943134920 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f4f84025060 con 0x559f190807f0 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 10 client.7020 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 10 client.7020 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 20 client.7020 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190ab220 0x559f190ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 4 client.7020 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f18fc7a20 con 0x559f190ab220 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.349+0000 7f4f927fc640 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190ab220 0x559f190ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f927fc640 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190ab220 0x559f190ab600 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb7dce239314340 server_cookie=e2e08fdb7e8aa2ce in_seq=0 out_seq=0 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f71ffb640 10 client.7020 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f71ffb640 1 -- 172.21.15.37:0/2943134920 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559f18fc7a20 con 0x559f190ab220 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f71ffb640 10 client.7020 handle_command_reply: tid=0 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 client.7020 shutdown 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 msgr2=0x559f190974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f190974d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f4f8405cf30 tx=0x7f4f840600b0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 shutdown_connections 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190ab220 0x559f190ab600 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19053fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1909d6d0 0x559f19053a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 --2- 172.21.15.37:0/2943134920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f190974d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f71ffb640 0 client.7020 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 >> 172.21.15.37:0/2943134920 conn(0x559f190800b0 msgr2=0x559f1904fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 shutdown_connections 2024-05-10T08:46:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.350+0000 7f4f9c195740 1 -- 172.21.15.37:0/2943134920 wait complete. 2024-05-10T08:46:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.351+0000 7f4f9c195740 20 client.7020 trim_cache size 0 max 16384 2024-05-10T08:46:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.364+0000 7f4f9c195740 1 Processor -- start 2024-05-10T08:46:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.364+0000 7f4f9c195740 1 -- start start 2024-05-10T08:46:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1907b810 0x559f19053e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f1909aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f1909af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f9c195740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f94201060 con 0x559f190807f0 2024-05-10T08:46:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9415ac00 con 0x559f1907b810 2024-05-10T08:46:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9415b250 con 0x559f1909d6d0 2024-05-10T08:46:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f1909aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f1909aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38932/0 (socket says 172.21.15.37:38932) 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 -- 172.21.15.37:0/4153233641 learned_addr learned my addr 172.21.15.37:0/4153233641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 -- 172.21.15.37:0/4153233641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 msgr2=0x559f1909af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 --2- 172.21.15.37:0/4153233641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f1909af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 -- 172.21.15.37:0/4153233641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1907b810 msgr2=0x559f19053e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 --2- 172.21.15.37:0/4153233641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1907b810 0x559f19053e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 -- 172.21.15.37:0/4153233641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f19083c90 con 0x559f190807f0 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.365+0000 7f4f927fc640 1 --2- 172.21.15.37:0/4153233641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f1909aa10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x559f19082b10 tx=0x7f4f7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accb8fad9d600f16 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f73fff640 1 -- 172.21.15.37:0/4153233641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c032070 con 0x559f190807f0 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f73fff640 1 -- 172.21.15.37:0/4153233641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c011d90 con 0x559f190807f0 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f73fff640 1 -- 172.21.15.37:0/4153233641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c003c60 con 0x559f190807f0 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 -- 172.21.15.37:0/4153233641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 msgr2=0x559f1909aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 --2- 172.21.15.37:0/4153233641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f1909aa10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x559f19082b10 tx=0x7f4f7c018000 comp rx=0 tx=0).stop 2024-05-10T08:46:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 -- 172.21.15.37:0/4153233641 shutdown_connections 2024-05-10T08:46:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 --2- 172.21.15.37:0/4153233641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1909d6d0 0x559f1909af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 --2- 172.21.15.37:0/4153233641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f190807f0 0x559f1909aa10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 --2- 172.21.15.37:0/4153233641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f1907b810 0x559f19053e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 -- 172.21.15.37:0/4153233641 >> 172.21.15.37:0/4153233641 conn(0x559f190800b0 msgr2=0x559f19099c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 -- 172.21.15.37:0/4153233641 shutdown_connections 2024-05-10T08:46:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.366+0000 7f4f9c195740 1 -- 172.21.15.37:0/4153233641 wait complete. 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 -- start start 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 Processor -- start 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19118a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f19082b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f1909d6d0 0x559f19083080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559f19097b00 con 0x559f1909d6d0 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f18f6fa20 con 0x559f190807f0 2024-05-10T08:46:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.367+0000 7f4f9c195740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x559f19081620 con 0x559f1907b810 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f9c195740 10 client.0 _ll_register_callbacks cb 0x7f4f84004700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f1909d6d0 0x559f19083080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f1909d6d0 0x559f19083080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38942/0 (socket says 172.21.15.37:38942) 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 -- 172.21.15.37:0/821230780 learned_addr learned my addr 172.21.15.37:0/821230780 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19118a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f927fc640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f19082b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 -- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 msgr2=0x559f19118a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19118a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 -- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 msgr2=0x559f19082b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f19082b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 -- 172.21.15.37:0/821230780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f1907e990 con 0x559f1909d6d0 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f927fc640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f19082b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f937fe640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f1909d6d0 0x559f19083080 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009f40 tx=0x7f4f8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73185f7cbe16aca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f71ffb640 1 -- 172.21.15.37:0/821230780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c036040 con 0x559f1909d6d0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f71ffb640 1 -- 172.21.15.37:0/821230780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f4f8c004040 con 0x559f1909d6d0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f7c011d90 con 0x559f1909d6d0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f71ffb640 1 -- 172.21.15.37:0/821230780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f4f8c056050 con 0x559f1909d6d0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f9c195740 10 client.7026 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.368+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x559f19118fb0 con 0x559f1909d6d0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f71ffb640 1 -- 172.21.15.37:0/821230780 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c011d90 con 0x559f1909d6d0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f71ffb640 1 -- 172.21.15.37:0/821230780 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f4f8c059020 con 0x559f1909d6d0 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 10 client.7026 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 10 client.7026 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 20 client.7026 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190bdc10 0x559f1909df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 4 client.7026 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T08:46:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x559f18fc1890 con 0x559f190bdc10 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190bdc10 0x559f1909df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f92ffd640 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190bdc10 0x559f1909df90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ab69a1e49ce555 server_cookie=d64a1d085e4b2a41 in_seq=0 out_seq=0 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f71ffb640 10 client.7026 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f71ffb640 1 -- 172.21.15.37:0/821230780 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+418 (crc 0 0 0) 0x559f18fc1890 con 0x559f190bdc10 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f71ffb640 10 client.7026 handle_command_reply: tid=0 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 1 client.7026 shutdown 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f1909d6d0 msgr2=0x559f19083080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.369+0000 7f4f9c195740 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f1909d6d0 0x559f19083080 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009f40 tx=0x7f4f8c004a40 comp rx=0 tx=0).stop 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 shutdown_connections 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559f190bdc10 0x559f1909df90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f1909d6d0 0x559f19083080 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f190807f0 0x559f19082b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f71ffb640 0 client.7026 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 --2- 172.21.15.37:0/821230780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559f1907b810 0x559f19118a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 >> 172.21.15.37:0/821230780 conn(0x559f190800b0 msgr2=0x559f19055020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 shutdown_connections 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 1 -- 172.21.15.37:0/821230780 wait complete. 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f9c195740 20 client.7026 trim_cache size 0 max 16384 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stdout: "damage_type": "backtrace", 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 269259822, 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627776, 2024-05-10T08:46:20.375 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/dir" 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "damage_type": "dir_frag", 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 792440353, 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627776, 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "frag": "*", 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/dir" 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "damage_type": "backtrace", 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 1940390747, 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/testdir/hardlink" 2024-05-10T08:46:20.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:46:20.377 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:46:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f740762d0 msgr2=0x7f4f74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f740762d0 0x7f4f74078790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009aa0 tx=0x7f4f7c009190 comp rx=0 tx=0).stop 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9406d620 msgr2=0x7f4f941509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9406d620 0x7f4f941509f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400d830 tx=0x7f4f8400dcf0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 shutdown_connections 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4f740762d0 0x7f4f74078790 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f940b5ee0 0x7f4f94157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4f9406da00 0x7f4f941e7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 --2- 172.21.15.37:0/1073475438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9406d620 0x7f4f941509f0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 >> 172.21.15.37:0/1073475438 conn(0x7f4f940728c0 msgr2=0x7f4f94070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 shutdown_connections 2024-05-10T08:46:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.370+0000 7f4f993a5640 1 -- 172.21.15.37:0/1073475438 wait complete. 2024-05-10T08:46:20.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T08:46:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.483+0000 7f7c7f0cf640 1 Processor -- start 2024-05-10T08:46:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.484+0000 7f7c7f0cf640 1 -- start start 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.484+0000 7f7c7f0cf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c7815f420 0x7f7c780d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.484+0000 7f7c7f0cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c780d3ca0 0x7f7c780d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.484+0000 7f7c7f0cf640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c781630b0 con 0x7f7c780d1eb0 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.484+0000 7f7c7f0cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7c780d2550 con 0x7f7c780d3ca0 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.484+0000 7f7c7f0cf640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7c780d2c80 con 0x7f7c7815f420 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.484+0000 7f7c77fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c780d3ca0 0x7f7c780d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.485+0000 7f7c77fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c780d3ca0 0x7f7c780d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38950/0 (socket says 172.21.15.37:38950) 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.485+0000 7f7c77fff640 1 -- 172.21.15.37:0/1164939275 learned_addr learned my addr 172.21.15.37:0/1164939275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.485+0000 7f7c7ce6b640 1 --2- 172.21.15.37:0/1164939275 >> v2:172.21.15.82:3300/0 conn(0x7f7c7815f420 0x7f7c780d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.485+0000 7f7c77fff640 1 -- 172.21.15.37:0/1164939275 >> v2:172.21.15.82:3300/0 conn(0x7f7c7815f420 msgr2=0x7f7c780d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.485+0000 7f7c77fff640 1 --2- 172.21.15.37:0/1164939275 >> v2:172.21.15.82:3300/0 conn(0x7f7c7815f420 0x7f7c780d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.485+0000 7f7c77fff640 1 -- 172.21.15.37:0/1164939275 >> v1:172.21.15.82:6789/0 conn(0x7f7c780d1eb0 legacy=0x7f7c780d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.485+0000 7f7c77fff640 1 -- 172.21.15.37:0/1164939275 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c780d2f60 con 0x7f7c780d3ca0 2024-05-10T08:46:20.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c77fff640 1 --2- 172.21.15.37:0/1164939275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d3ca0 0x7f7c780d1970 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7c780d5ec0 tx=0x7f7c6002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748670dafa9e7013 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c777fe640 1 -- 172.21.15.37:0/1164939275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60037070 con 0x7f7c780d3ca0 2024-05-10T08:46:20.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c777fe640 1 -- 172.21.15.37:0/1164939275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c60032440 con 0x7f7c780d3ca0 2024-05-10T08:46:20.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c777fe640 1 -- 172.21.15.37:0/1164939275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60032810 con 0x7f7c780d3ca0 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/1164939275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d3ca0 msgr2=0x7f7c780d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/1164939275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d3ca0 0x7f7c780d1970 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7c780d5ec0 tx=0x7f7c6002a230 comp rx=0 tx=0).stop 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/1164939275 shutdown_connections 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/1164939275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d3ca0 0x7f7c780d1970 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/1164939275 >> v2:172.21.15.82:3300/0 conn(0x7f7c7815f420 0x7f7c780d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/1164939275 >> 172.21.15.37:0/1164939275 conn(0x7f7c7808eac0 msgr2=0x7f7c7809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/1164939275 shutdown_connections 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.486+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/1164939275 wait complete. 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 Processor -- start 2024-05-10T08:46:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 -- start start 2024-05-10T08:46:20.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d1eb0 0x7f7c78162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c781eae60 0x7f7c781eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7815df60 0x7f7c7815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c780d53d0 con 0x7f7c780d1eb0 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c780d2830 con 0x7f7c781eae60 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.488+0000 7f7c7f0cf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7c780d5550 con 0x7f7c7815df60 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d1eb0 0x7f7c78162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d1eb0 0x7f7c78162290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38956/0 (socket says 172.21.15.37:38956) 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 -- 172.21.15.37:0/3581938719 learned_addr learned my addr 172.21.15.37:0/3581938719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c77fff640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c781eae60 0x7f7c781eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7d66c640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7815df60 0x7f7c7815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 -- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7815df60 msgr2=0x7f7c7815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7815df60 0x7f7c7815e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 -- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c781eae60 msgr2=0x7f7c781eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c781eae60 0x7f7c781eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 -- 172.21.15.37:0/3581938719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c78160240 con 0x7f7c780d1eb0 2024-05-10T08:46:20.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7d66c640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7815df60 0x7f7c7815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:20.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7ce6b640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d1eb0 0x7f7c78162290 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800d800 tx=0x7f7c6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c757fa640 1 -- 172.21.15.37:0/3581938719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800b6c0 con 0x7f7c780d1eb0 2024-05-10T08:46:20.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c757fa640 1 -- 172.21.15.37:0/3581938719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c68019070 con 0x7f7c780d1eb0 2024-05-10T08:46:20.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c781604c0 con 0x7f7c780d1eb0 2024-05-10T08:46:20.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c757fa640 1 -- 172.21.15.37:0/3581938719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800ba80 con 0x7f7c780d1eb0 2024-05-10T08:46:20.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.489+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c78160a80 con 0x7f7c780d1eb0 2024-05-10T08:46:20.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.490+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c780693f0 con 0x7f7c780d1eb0 2024-05-10T08:46:20.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.491+0000 7f7c757fa640 1 -- 172.21.15.37:0/3581938719 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7c6800bc20 con 0x7f7c780d1eb0 2024-05-10T08:46:20.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.491+0000 7f7c757fa640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7c58076300 0x7f7c580787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.492+0000 7f7c757fa640 1 -- 172.21.15.37:0/3581938719 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f7c68097c10 con 0x7f7c780d1eb0 2024-05-10T08:46:20.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.492+0000 7f7c77fff640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7c58076300 0x7f7c580787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.492+0000 7f7c77fff640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7c58076300 0x7f7c580787c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034000 tx=0x7f7c6002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.496+0000 7f7c757fa640 1 -- 172.21.15.37:0/3581938719 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7c78160240 con 0x7f7c780d1eb0 2024-05-10T08:46:20.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.729+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7c780d1590 con 0x7f7c780d1eb0 2024-05-10T08:46:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.730+0000 7f7c757fa640 1 -- 172.21.15.37:0/3581938719 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f7c68061310 con 0x7f7c780d1eb0 2024-05-10T08:46:20.729 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:20.729 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7c58076300 msgr2=0x7f7c580787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7c58076300 0x7f7c580787c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034000 tx=0x7f7c6002e000 comp rx=0 tx=0).stop 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d1eb0 msgr2=0x7f7c78162290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d1eb0 0x7f7c78162290 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800d800 tx=0x7f7c6800dcc0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 shutdown_connections 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7c58076300 0x7f7c580787c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7c7815df60 0x7f7c7815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c781eae60 0x7f7c781eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 --2- 172.21.15.37:0/3581938719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c780d1eb0 0x7f7c78162290 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 >> 172.21.15.37:0/3581938719 conn(0x7f7c7808eac0 msgr2=0x7f7c780d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 shutdown_connections 2024-05-10T08:46:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.732+0000 7f7c7f0cf640 1 -- 172.21.15.37:0/3581938719 wait complete. 2024-05-10T08:46:20.742 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T08:46:20.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:20.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-05-10T08:46:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.851+0000 7f1b83d2b640 1 Processor -- start 2024-05-10T08:46:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.851+0000 7f1b83d2b640 1 -- start start 2024-05-10T08:46:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b83d2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b7c0d3620 0x7f1b7c0d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b83d2b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b7c15f680 0x7f1b7c0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b83d2b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c0d5cc0 con 0x7f1b7c0d5750 2024-05-10T08:46:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b83d2b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c0d0620 con 0x7f1b7c0d3620 2024-05-10T08:46:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b83d2b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c0cfcf0 con 0x7f1b7c15f680 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b81ac7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b7c0d3620 0x7f1b7c0d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b81ac7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b7c0d3620 0x7f1b7c0d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38958/0 (socket says 172.21.15.37:38958) 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2886111342 learned_addr learned my addr 172.21.15.37:0/2886111342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b812c6640 1 --2- 172.21.15.37:0/2886111342 >> v2:172.21.15.82:3300/0 conn(0x7f1b7c15f680 0x7f1b7c0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2886111342 >> v2:172.21.15.82:3300/0 conn(0x7f1b7c15f680 msgr2=0x7f1b7c0d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/2886111342 >> v2:172.21.15.82:3300/0 conn(0x7f1b7c15f680 0x7f1b7c0d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2886111342 >> v1:172.21.15.82:6789/0 conn(0x7f1b7c0d5750 legacy=0x7f1b7c0d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2886111342 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c0cffd0 con 0x7f1b7c0d3620 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.852+0000 7f1b812c6640 1 --2- 172.21.15.37:0/2886111342 >> v2:172.21.15.82:3300/0 conn(0x7f1b7c15f680 0x7f1b7c0d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.853+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/2886111342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0d2080 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0b6b00 tx=0x7f1b7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b0a85c553b1ae3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.853+0000 7f1b80ac5640 1 -- 172.21.15.37:0/2886111342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78037070 con 0x7f1b7c0d3620 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.853+0000 7f1b80ac5640 1 -- 172.21.15.37:0/2886111342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b78032440 con 0x7f1b7c0d3620 2024-05-10T08:46:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.853+0000 7f1b80ac5640 1 -- 172.21.15.37:0/2886111342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78032810 con 0x7f1b7c0d3620 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2886111342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 msgr2=0x7f1b7c0d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2886111342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0d2080 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0b6b00 tx=0x7f1b7802a270 comp rx=0 tx=0).stop 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2886111342 shutdown_connections 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2886111342 >> v2:172.21.15.82:3300/0 conn(0x7f1b7c15f680 0x7f1b7c0d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2886111342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0d2080 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2886111342 >> 172.21.15.37:0/2886111342 conn(0x7f1b7c09e380 msgr2=0x7f1b7c0d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2886111342 shutdown_connections 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.854+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2886111342 wait complete. 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.855+0000 7f1b83d2b640 1 Processor -- start 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.855+0000 7f1b83d2b640 1 -- start start 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b83d2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b83d2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b7c0d5750 0x7f1b7c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b83d2b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b7c15f680 0x7f1b7c14af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b83d2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0b1c70 con 0x7f1b7c0d3620 2024-05-10T08:46:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b83d2b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0d3040 con 0x7f1b7c15f680 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b83d2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c0b1df0 con 0x7f1b7c0d5750 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38968/0 (socket says 172.21.15.37:38968) 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2568033469 learned_addr learned my addr 172.21.15.37:0/2568033469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b7c0d5750 msgr2=0x7f1b7c14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b7c0d5750 0x7f1b7c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b7c15f680 msgr2=0x7f1b7c14af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b7c15f680 0x7f1b7c14af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 -- 172.21.15.37:0/2568033469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c14a780 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.856+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0b5ed0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f1b7802a2b0 tx=0x7f1b780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.857+0000 7f1b6e7fc640 1 -- 172.21.15.37:0/2568033469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78041020 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.857+0000 7f1b6e7fc640 1 -- 172.21.15.37:0/2568033469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b780306c0 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.857+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c0b4e30 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.857+0000 7f1b6e7fc640 1 -- 172.21.15.37:0/2568033469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78037040 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.857+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c0b53f0 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.858+0000 7f1b6e7fc640 1 -- 172.21.15.37:0/2568033469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b78044020 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.859+0000 7f1b6e7fc640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b600762d0 0x7f1b60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.859+0000 7f1b6e7fc640 1 -- 172.21.15.37:0/2568033469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f1b780b8080 con 0x7f1b7c0d3620 2024-05-10T08:46:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.859+0000 7f1b812c6640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b600762d0 0x7f1b60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 Processor -- start 2024-05-10T08:46:20.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b812c6640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b600762d0 0x7f1b60078790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1b70006fd0 tx=0x7f1b70008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 -- start start 2024-05-10T08:46:20.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70ae7abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aeaa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeaac00 0x55b70ae7fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b70ade3cf0 con 0x55b70aec8220 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b70ad9ce10 con 0x55b70aeab340 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.860+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b70addfcb0 con 0x55b70aeaac00 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70ae7abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70ae7abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38978/0 (socket says 172.21.15.37:38978) 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 -- 172.21.15.37:0/3657732 learned_addr learned my addr 172.21.15.37:0/3657732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b812c6640 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aeaa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b822c8640 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeaac00 0x55b70ae7fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 -- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeaac00 msgr2=0x55b70ae7fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeaac00 0x55b70ae7fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 -- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 msgr2=0x55b70aeaa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aeaa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 -- 172.21.15.37:0/3657732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70abbd7e0 con 0x55b70aec8220 2024-05-10T08:46:20.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.861+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70ae7abb0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b62d0 tx=0x7f1b7807d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecaab9f7c699206 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.862+0000 7f1b5f7fe640 1 -- 172.21.15.37:0/3657732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78081790 con 0x55b70aec8220 2024-05-10T08:46:20.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.862+0000 7f1b5f7fe640 1 -- 172.21.15.37:0/3657732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b78081090 con 0x55b70aec8220 2024-05-10T08:46:20.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.862+0000 7f1b5f7fe640 1 -- 172.21.15.37:0/3657732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78085440 con 0x55b70aec8220 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.862+0000 7f1b86a49740 1 -- 172.21.15.37:0/3657732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 msgr2=0x55b70ae7abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.862+0000 7f1b86a49740 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70ae7abb0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b62d0 tx=0x7f1b7807d810 comp rx=0 tx=0).stop 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 -- 172.21.15.37:0/3657732 shutdown_connections 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeaac00 0x55b70ae7fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aeaa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 --2- 172.21.15.37:0/3657732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70ae7abb0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 -- 172.21.15.37:0/3657732 >> 172.21.15.37:0/3657732 conn(0x55b70ae7ce20 msgr2=0x55b70aec56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 -- 172.21.15.37:0/3657732 shutdown_connections 2024-05-10T08:46:20.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 -- 172.21.15.37:0/3657732 wait complete. 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 -- start start 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.863+0000 7f1b86a49740 1 Processor -- start 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aec5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aec8220 0x55b70aead640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeadb80 0x55b70ae97aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b86a49740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b70ade3cf0 con 0x55b70aeadb80 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b70ada0940 con 0x55b70aeab340 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b70ae7efd0 con 0x55b70aec8220 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b86a49740 10 client.0 _ll_register_callbacks cb 0x55b70ada3440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b822c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeadb80 0x55b70ae97aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b822c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeadb80 0x55b70ae97aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38988/0 (socket says 172.21.15.37:38988) 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b822c8640 1 -- 172.21.15.37:0/23102121 learned_addr learned my addr 172.21.15.37:0/23102121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aec5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.864+0000 7f1b812c6640 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aec8220 0x55b70aead640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b822c8640 1 -- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aec8220 msgr2=0x55b70aead640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b822c8640 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aec8220 0x55b70aead640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b822c8640 1 -- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 msgr2=0x55b70aec5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b822c8640 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aec5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b822c8640 1 -- 172.21.15.37:0/23102121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70ac1df70 con 0x55b70aeadb80 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b822c8640 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeadb80 0x55b70ae97aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400f440 tx=0x7f1b7400f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425cdca5b3c1c302 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b5cff9640 1 -- 172.21.15.37:0/23102121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74003b80 con 0x55b70aeadb80 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b5cff9640 1 -- 172.21.15.37:0/23102121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f1b74003d20 con 0x55b70aeadb80 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b78081090 con 0x55b70aeadb80 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b5cff9640 1 -- 172.21.15.37:0/23102121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f1b74020050 con 0x55b70aeadb80 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b86a49740 10 client.7044 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55b70aab5170 con 0x55b70aeadb80 2024-05-10T08:46:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b5cff9640 1 -- 172.21.15.37:0/23102121 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b78081090 con 0x55b70aeadb80 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b5cff9640 1 -- 172.21.15.37:0/23102121 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f1b74023020 con 0x55b70aeadb80 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b86a49740 10 client.7044 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b86a49740 10 client.7044 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.865+0000 7f1b86a49740 20 client.7044 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.866+0000 7f1b86a49740 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aeab880 0x55b70aeabca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.866+0000 7f1b86a49740 4 client.7044 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.866+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b70adf1900 con 0x55b70aeab880 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.866+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aeab880 0x55b70aeabca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.866+0000 7f1b5cff9640 10 client.7044 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.866+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aeab880 0x55b70aeabca0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65872ae08404f6c8 server_cookie=26e947901f0e0ad6 in_seq=0 out_seq=0 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b5cff9640 1 -- 172.21.15.37:0/23102121 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b70adf1900 con 0x55b70aeab880 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b5cff9640 10 client.7044 handle_command_reply: tid=0 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 client.7044 shutdown 2024-05-10T08:46:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeadb80 msgr2=0x55b70ae97aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeadb80 0x55b70ae97aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400f440 tx=0x7f1b7400f900 comp rx=0 tx=0).stop 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 shutdown_connections 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aeab880 0x55b70aeabca0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeadb80 0x55b70ae97aa0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aec8220 0x55b70aead640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b5cff9640 0 client.7044 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 --2- 172.21.15.37:0/23102121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeab340 0x55b70aec5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 >> 172.21.15.37:0/23102121 conn(0x55b70aeaac00 msgr2=0x55b70ae7a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 shutdown_connections 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 1 -- 172.21.15.37:0/23102121 wait complete. 2024-05-10T08:46:20.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.867+0000 7f1b86a49740 20 client.7044 trim_cache size 0 max 16384 2024-05-10T08:46:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.885+0000 7f1b86a49740 1 Processor -- start 2024-05-10T08:46:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.885+0000 7f1b86a49740 1 -- start start 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeab340 0x55b70aebb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeadb80 0x55b70aebb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70aed5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b86a49740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c2020b0 con 0x55b70aec8220 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c201090 con 0x55b70aeadb80 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c14d8d0 con 0x55b70aeab340 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70aed5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70aed5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38990/0 (socket says 172.21.15.37:38990) 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 -- 172.21.15.37:0/1725647068 learned_addr learned my addr 172.21.15.37:0/1725647068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b812c6640 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeadb80 0x55b70aebb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeab340 0x55b70aebb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 -- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeab340 msgr2=0x55b70aebb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeab340 0x55b70aebb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 -- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeadb80 msgr2=0x55b70aebb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeadb80 0x55b70aebb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b822c8640 1 -- 172.21.15.37:0/1725647068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70ae7b690 con 0x55b70aec8220 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.886+0000 7f1b812c6640 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeadb80 0x55b70aebb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b822c8640 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70aed5830 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1b74007ea0 tx=0x7f1b7400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc7754160a91dbe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b5effd640 1 -- 172.21.15.37:0/1725647068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7401b350 con 0x55b70aec8220 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b5effd640 1 -- 172.21.15.37:0/1725647068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b74018070 con 0x55b70aec8220 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b5effd640 1 -- 172.21.15.37:0/1725647068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7401b740 con 0x55b70aec8220 2024-05-10T08:46:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 -- 172.21.15.37:0/1725647068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 msgr2=0x55b70aed5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70aed5830 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1b74007ea0 tx=0x7f1b7400a000 comp rx=0 tx=0).stop 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 -- 172.21.15.37:0/1725647068 shutdown_connections 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aec8220 0x55b70aed5830 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aeadb80 0x55b70aebb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1725647068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeab340 0x55b70aebb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 -- 172.21.15.37:0/1725647068 >> 172.21.15.37:0/1725647068 conn(0x55b70aeaac00 msgr2=0x55b70aeac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 -- 172.21.15.37:0/1725647068 shutdown_connections 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.887+0000 7f1b86a49740 1 -- 172.21.15.37:0/1725647068 wait complete. 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.888+0000 7f1b86a49740 1 -- start start 2024-05-10T08:46:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.888+0000 7f1b86a49740 1 Processor -- start 2024-05-10T08:46:20.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeab340 0x55b70af44500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeadb80 0x55b70af3a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b86a49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aec8220 0x55b70aec4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b86a49740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b70aea6860 con 0x55b70aeab340 2024-05-10T08:46:20.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c200a30 con 0x55b70aec8220 2024-05-10T08:46:20.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b86a49740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b70aebbea0 con 0x55b70aeadb80 2024-05-10T08:46:20.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b86a49740 10 client.0 _ll_register_callbacks cb 0x7f1b74001870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:20.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeab340 0x55b70af44500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeab340 0x55b70af44500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38994/0 (socket says 172.21.15.37:38994) 2024-05-10T08:46:20.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 -- 172.21.15.37:0/1120593827 learned_addr learned my addr 172.21.15.37:0/1120593827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:20.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b822c8640 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aec8220 0x55b70aec4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b812c6640 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeadb80 0x55b70af3a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 -- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeadb80 msgr2=0x55b70af3a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeadb80 0x55b70af3a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 -- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aec8220 msgr2=0x55b70aec4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:20.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aec8220 0x55b70aec4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.889+0000 7f1b81ac7640 1 -- 172.21.15.37:0/1120593827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70aeac230 con 0x55b70aeab340 2024-05-10T08:46:20.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b81ac7640 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeab340 0x55b70af44500 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b63b0 tx=0x7f1b7803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97abd093c3686de7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:20.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:20.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b5cff9640 1 -- 172.21.15.37:0/1120593827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78089e60 con 0x55b70aeab340 2024-05-10T08:46:20.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b5cff9640 1 -- 172.21.15.37:0/1120593827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f1b780899d0 con 0x55b70aeab340 2024-05-10T08:46:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b74018070 con 0x55b70aeab340 2024-05-10T08:46:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b5cff9640 1 -- 172.21.15.37:0/1120593827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f1b780a2050 con 0x55b70aeab340 2024-05-10T08:46:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 10 client.7050 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55b70af476b0 con 0x55b70aeab340 2024-05-10T08:46:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b5cff9640 1 -- 172.21.15.37:0/1120593827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b74018070 con 0x55b70aeab340 2024-05-10T08:46:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b5cff9640 1 -- 172.21.15.37:0/1120593827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f1b7803a030 con 0x55b70aeab340 2024-05-10T08:46:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 10 client.7050 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 10 client.7050 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 20 client.7050 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aebb050 0x55b70aebb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 4 client.7050 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-05-10T08:46:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x55b70adeb770 con 0x55b70aebb050 2024-05-10T08:46:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.890+0000 7f1b812c6640 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aebb050 0x55b70aebb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b5cff9640 10 client.7050 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b812c6640 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aebb050 0x55b70aebb450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d00dbd672c0078f server_cookie=9de0e1a0b6790907 in_seq=0 out_seq=0 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b5cff9640 1 -- 172.21.15.37:0/1120593827 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b70adeb770 con 0x55b70aebb050 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b5cff9640 10 client.7050 handle_command_reply: tid=0 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 client.7050 shutdown 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeab340 msgr2=0x55b70af44500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeab340 0x55b70af44500 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b63b0 tx=0x7f1b7803b000 comp rx=0 tx=0).stop 2024-05-10T08:46:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 shutdown_connections 2024-05-10T08:46:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55b70aebb050 0x55b70aebb450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70aec8220 0x55b70aec4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b70aeadb80 0x55b70af3a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 --2- 172.21.15.37:0/1120593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b70aeab340 0x55b70af44500 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 >> 172.21.15.37:0/1120593827 conn(0x55b70aeaac00 msgr2=0x55b70aea5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b5cff9640 0 client.7050 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 shutdown_connections 2024-05-10T08:46:20.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.891+0000 7f1b86a49740 1 -- 172.21.15.37:0/1120593827 wait complete. 2024-05-10T08:46:20.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b86a49740 20 client.7050 trim_cache size 0 max 16384 2024-05-10T08:46:20.905 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:46:20.906 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:46:20.906 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "ce4799c9-da13-4c73-987f-bee3a2502899", 2024-05-10T08:46:20.906 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:46:20.906 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:46:20.907 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f90a757f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0)->f(v1 m2024-05-10T08:45:41.308980+0000) n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1)->n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5592b8fefb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-05-10T08:46:20.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b600762d0 msgr2=0x7f1b60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b600762d0 0x7f1b60078790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1b70006fd0 tx=0x7f1b70008040 comp rx=0 tx=0).stop 2024-05-10T08:46:20.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 msgr2=0x7f1b7c0b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:20.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0b5ed0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f1b7802a2b0 tx=0x7f1b780046c0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 shutdown_connections 2024-05-10T08:46:20.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b600762d0 0x7f1b60078790 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b7c15f680 0x7f1b7c14af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b7c0d5750 0x7f1b7c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 --2- 172.21.15.37:0/2568033469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7c0d3620 0x7f1b7c0b5ed0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 >> 172.21.15.37:0/2568033469 conn(0x7f1b7c09e380 msgr2=0x7f1b7c0d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 shutdown_connections 2024-05-10T08:46:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:20.892+0000 7f1b83d2b640 1 -- 172.21.15.37:0/2568033469 wait complete. 2024-05-10T08:46:20.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:20.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T08:46:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.018+0000 7f916fbc8640 1 Processor -- start 2024-05-10T08:46:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.018+0000 7f916fbc8640 1 -- start start 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916fbc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f916815f420 0x7f91680d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916fbc8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f91680d3ca0 0x7f91680d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916fbc8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91681630b0 con 0x7f91680d1eb0 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916fbc8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f91680d2550 con 0x7f916815f420 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916fbc8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f91680d2c80 con 0x7f91680d3ca0 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d964640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f916815f420 0x7f91680d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d964640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f916815f420 0x7f91680d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39006/0 (socket says 172.21.15.37:39006) 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d964640 1 -- 172.21.15.37:0/647058162 learned_addr learned my addr 172.21.15.37:0/647058162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916e165640 1 --1- 172.21.15.37:0/647058162 >> v1:172.21.15.37:6789/0 conn(0x7f91680d1eb0 0x7f91680d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34616/0 (socket says 172.21.15.37:34616) 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d163640 1 --2- 172.21.15.37:0/647058162 >> v2:172.21.15.82:3300/0 conn(0x7f91680d3ca0 0x7f91680d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d964640 1 -- 172.21.15.37:0/647058162 >> v2:172.21.15.82:3300/0 conn(0x7f91680d3ca0 msgr2=0x7f91680d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d964640 1 --2- 172.21.15.37:0/647058162 >> v2:172.21.15.82:3300/0 conn(0x7f91680d3ca0 0x7f91680d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d964640 1 -- 172.21.15.37:0/647058162 >> v1:172.21.15.37:6789/0 conn(0x7f91680d1eb0 legacy=0x7f91680d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916c962640 1 -- 172.21.15.37:0/647058162 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723999923 0 0) 0x7f9160001490 con 0x7f91680d1eb0 2024-05-10T08:46:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.019+0000 7f916d964640 1 -- 172.21.15.37:0/647058162 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91680d2f60 con 0x7f916815f420 2024-05-10T08:46:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.020+0000 7f916d964640 1 --2- 172.21.15.37:0/647058162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916815f420 0x7f91680d3760 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f916808f380 tx=0x7f916402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beadcae60d136ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.020+0000 7f916c962640 1 -- 172.21.15.37:0/647058162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164037070 con 0x7f916815f420 2024-05-10T08:46:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.020+0000 7f916c962640 1 -- 172.21.15.37:0/647058162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164032440 con 0x7f916815f420 2024-05-10T08:46:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.020+0000 7f916c962640 1 -- 172.21.15.37:0/647058162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164032810 con 0x7f916815f420 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 -- 172.21.15.37:0/647058162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916815f420 msgr2=0x7f91680d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 --2- 172.21.15.37:0/647058162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916815f420 0x7f91680d3760 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f916808f380 tx=0x7f916402a270 comp rx=0 tx=0).stop 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 -- 172.21.15.37:0/647058162 shutdown_connections 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 --2- 172.21.15.37:0/647058162 >> v2:172.21.15.82:3300/0 conn(0x7f91680d3ca0 0x7f91680d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 --2- 172.21.15.37:0/647058162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916815f420 0x7f91680d3760 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 -- 172.21.15.37:0/647058162 >> 172.21.15.37:0/647058162 conn(0x7f916808eac0 msgr2=0x7f916809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 -- 172.21.15.37:0/647058162 shutdown_connections 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.021+0000 7f916fbc8640 1 -- 172.21.15.37:0/647058162 wait complete. 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.022+0000 7f916fbc8640 1 Processor -- start 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.022+0000 7f916fbc8640 1 -- start start 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916fbc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91680d1eb0 0x7f9168150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916fbc8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91680b89b0 0x7f91681606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916fbc8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9168160c00 0x7f91680b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916fbc8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91680d53d0 con 0x7f91680d1eb0 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916fbc8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91680d2830 con 0x7f91680b89b0 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916fbc8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f91680d5550 con 0x7f9168160c00 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91680d1eb0 0x7f9168150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91680d1eb0 0x7f9168150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39020/0 (socket says 172.21.15.37:39020) 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 -- 172.21.15.37:0/3051322550 learned_addr learned my addr 172.21.15.37:0/3051322550 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916e165640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9168160c00 0x7f91680b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d163640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91680b89b0 0x7f91681606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 -- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9168160c00 msgr2=0x7f91680b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9168160c00 0x7f91680b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 -- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91680b89b0 msgr2=0x7f91681606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91680b89b0 0x7f91681606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 -- 172.21.15.37:0/3051322550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91680b7c60 con 0x7f91680d1eb0 2024-05-10T08:46:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f916d964640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91680d1eb0 0x7f9168150460 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f916402a2b0 tx=0x7f91640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.023+0000 7f915e7fc640 1 -- 172.21.15.37:0/3051322550 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164037040 con 0x7f91680d1eb0 2024-05-10T08:46:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.024+0000 7f915e7fc640 1 -- 172.21.15.37:0/3051322550 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164042070 con 0x7f91680d1eb0 2024-05-10T08:46:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.024+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91681509a0 con 0x7f91680d1eb0 2024-05-10T08:46:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.024+0000 7f915e7fc640 1 -- 172.21.15.37:0/3051322550 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164030880 con 0x7f91680d1eb0 2024-05-10T08:46:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.024+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91680b7ed0 con 0x7f91680d1eb0 2024-05-10T08:46:21.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.025+0000 7f915e7fc640 1 -- 172.21.15.37:0/3051322550 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9164030a20 con 0x7f91680d1eb0 2024-05-10T08:46:21.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.026+0000 7f915e7fc640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f914c0762d0 0x7f914c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.026+0000 7f915e7fc640 1 -- 172.21.15.37:0/3051322550 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f91640b7f30 con 0x7f91680d1eb0 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.026+0000 7f916d163640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f914c0762d0 0x7f914c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.026+0000 7f916d163640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f914c0762d0 0x7f914c078790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91681540d0 tx=0x7f9158009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.026+0000 7f91729c2740 1 Processor -- start 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f91729c2740 1 -- start start 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f93712af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93742600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f91729c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93742b40 0x564f93717950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f91729c2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f936df690 con 0x564f93742b40 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564f9367cf30 con 0x564f93760160 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x564f93635b20 con 0x564f93743280 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f916e165640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93742b40 0x564f93717950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f916e165640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93742b40 0x564f93717950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39022/0 (socket says 172.21.15.37:39022) 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f916e165640 1 -- 172.21.15.37:0/3933883853 learned_addr learned my addr 172.21.15.37:0/3933883853 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f916d163640 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93742600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.027+0000 7f916d964640 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f93712af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f916e165640 1 -- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 msgr2=0x564f93742600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f916e165640 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93742600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f916e165640 1 -- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 msgr2=0x564f93712af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f916e165640 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f93712af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f916e165640 1 -- 172.21.15.37:0/3933883853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f9362de60 con 0x564f93742b40 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f916d964640 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f93712af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f916e165640 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93742b40 0x564f93717950 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9160001c20 tx=0x7f91600020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281b62561b3d1b4c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f914b7fe640 1 -- 172.21.15.37:0/3933883853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916001a070 con 0x564f93742b40 2024-05-10T08:46:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f914b7fe640 1 -- 172.21.15.37:0/3933883853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9160007640 con 0x564f93742b40 2024-05-10T08:46:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.028+0000 7f914b7fe640 1 -- 172.21.15.37:0/3933883853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91600079f0 con 0x564f93742b40 2024-05-10T08:46:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 -- 172.21.15.37:0/3933883853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93742b40 msgr2=0x564f93717950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93742b40 0x564f93717950 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9160001c20 tx=0x7f91600020e0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 -- 172.21.15.37:0/3933883853 shutdown_connections 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93742b40 0x564f93717950 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93742600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 --2- 172.21.15.37:0/3933883853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f93712af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 -- 172.21.15.37:0/3933883853 >> 172.21.15.37:0/3933883853 conn(0x564f93714d60 msgr2=0x564f9375d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 -- 172.21.15.37:0/3933883853 shutdown_connections 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 -- 172.21.15.37:0/3933883853 wait complete. 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 -- start start 2024-05-10T08:46:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.029+0000 7f91729c2740 1 Processor -- start 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93743280 0x564f93770770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f91729c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f93717b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 0x564f93718070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f91729c2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f936395e0 con 0x564f93760160 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564f93678ef0 con 0x564f93743280 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x564f93716f10 con 0x564f93755640 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f91729c2740 10 client.0 _ll_register_callbacks cb 0x564f93634320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f916d163640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f93717b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f916d163640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f93717b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39034/0 (socket says 172.21.15.37:39034) 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f916d163640 1 -- 172.21.15.37:0/1142635366 learned_addr learned my addr 172.21.15.37:0/1142635366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.030+0000 7f916d964640 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93743280 0x564f93770770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f916e165640 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 0x564f93718070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f916d163640 1 -- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 msgr2=0x564f93718070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f916d163640 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 0x564f93718070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f916d163640 1 -- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93743280 msgr2=0x564f93770770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f916d163640 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93743280 0x564f93770770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f916d163640 1 -- 172.21.15.37:0/1142635366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f934587d0 con 0x564f93760160 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f916d163640 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f93717b30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f916815e350 tx=0x7f91580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608a0f868ddbfba6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f9148ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f9148ff9640 1 -- 172.21.15.37:0/1142635366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158027030 con 0x564f93760160 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f9148ff9640 1 -- 172.21.15.37:0/1142635366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f915800f040 con 0x564f93760160 2024-05-10T08:46:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9160007640 con 0x564f93760160 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f9148ff9640 1 -- 172.21.15.37:0/1142635366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f9158004020 con 0x564f93760160 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f91729c2740 10 client.7065 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x564f9338e3f0 con 0x564f93760160 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f9148ff9640 1 -- 172.21.15.37:0/1142635366 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9160007640 con 0x564f93760160 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.031+0000 7f9148ff9640 1 -- 172.21.15.37:0/1142635366 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f9158020050 con 0x564f93760160 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f91729c2740 10 client.7065 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f91729c2740 10 client.7065 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f91729c2740 20 client.7065 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f91729c2740 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f93744180 0x564f93744600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f91729c2740 4 client.7065 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f9368ab40 con 0x564f93744180 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f916d964640 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f93744180 0x564f93744600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f9148ff9640 10 client.7065 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.032+0000 7f916d964640 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f93744180 0x564f93744600 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ce404b9a854fb77 server_cookie=5f1c805e13eedefa in_seq=0 out_seq=0 2024-05-10T08:46:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f9148ff9640 1 -- 172.21.15.37:0/1142635366 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f9368ab40 con 0x564f93744180 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f9148ff9640 10 client.7065 handle_command_reply: tid=0 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 client.7065 shutdown 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 msgr2=0x564f93717b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f93717b30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f916815e350 tx=0x7f91580046c0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 shutdown_connections 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f93744180 0x564f93744600 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 0x564f93718070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f93717b30 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f9148ff9640 0 client.7065 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 --2- 172.21.15.37:0/1142635366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93743280 0x564f93770770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 >> 172.21.15.37:0/1142635366 conn(0x564f93742b40 msgr2=0x564f93716610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 shutdown_connections 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 1 -- 172.21.15.37:0/1142635366 wait complete. 2024-05-10T08:46:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.033+0000 7f91729c2740 20 client.7065 trim_cache size 0 max 16384 2024-05-10T08:46:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.051+0000 7f91729c2740 1 Processor -- start 2024-05-10T08:46:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.051+0000 7f91729c2740 1 -- start start 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f91729c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93743280 0x564f9373fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 0x564f9376ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f937127c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f91729c2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9168202360 con 0x564f93743280 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9168201340 con 0x564f93760160 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f91680ba980 con 0x564f93755640 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93743280 0x564f9373fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93743280 0x564f9373fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39038/0 (socket says 172.21.15.37:39038) 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 -- 172.21.15.37:0/739245020 learned_addr learned my addr 172.21.15.37:0/739245020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 -- 172.21.15.37:0/739245020 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 msgr2=0x564f9376ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 --2- 172.21.15.37:0/739245020 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 0x564f9376ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 -- 172.21.15.37:0/739245020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 msgr2=0x564f937127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 --2- 172.21.15.37:0/739245020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f937127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.052+0000 7f916d964640 1 -- 172.21.15.37:0/739245020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f9334e0f0 con 0x564f93743280 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f916d964640 1 --2- 172.21.15.37:0/739245020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93743280 0x564f9373fd40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f91640b6170 tx=0x7f91640b6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5dcb24fe11fa93 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f914affd640 1 -- 172.21.15.37:0/739245020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164080a60 con 0x564f93743280 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f914affd640 1 -- 172.21.15.37:0/739245020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164080f50 con 0x564f93743280 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f914affd640 1 -- 172.21.15.37:0/739245020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164085250 con 0x564f93743280 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 -- 172.21.15.37:0/739245020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93743280 msgr2=0x564f9373fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 --2- 172.21.15.37:0/739245020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93743280 0x564f9373fd40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f91640b6170 tx=0x7f91640b6040 comp rx=0 tx=0).stop 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 -- 172.21.15.37:0/739245020 shutdown_connections 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 --2- 172.21.15.37:0/739245020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93760160 0x564f937127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 --2- 172.21.15.37:0/739245020 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93755640 0x564f9376ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 --2- 172.21.15.37:0/739245020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93743280 0x564f9373fd40 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 -- 172.21.15.37:0/739245020 >> 172.21.15.37:0/739245020 conn(0x564f93742b40 msgr2=0x564f93741a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 -- 172.21.15.37:0/739245020 shutdown_connections 2024-05-10T08:46:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.053+0000 7f91729c2740 1 -- 172.21.15.37:0/739245020 wait complete. 2024-05-10T08:46:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.054+0000 7f91729c2740 1 -- start start 2024-05-10T08:46:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.054+0000 7f91729c2740 1 Processor -- start 2024-05-10T08:46:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93729050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f91729c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93755640 0x564f9377fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f91729c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f9372ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f91729c2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f93770880 con 0x564f93760160 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9168200d20 con 0x564f93755640 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f91729c2740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x564f93742170 con 0x564f93743280 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f91729c2740 10 client.0 _ll_register_callbacks cb 0x7f9158014670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f9372ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f9372ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39054/0 (socket says 172.21.15.37:39054) 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 -- 172.21.15.37:0/1493155250 learned_addr learned my addr 172.21.15.37:0/1493155250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916d163640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93755640 0x564f9377fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916d964640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93729050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 -- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 msgr2=0x564f93729050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93729050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 -- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93755640 msgr2=0x564f9377fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93755640 0x564f9377fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 -- 172.21.15.37:0/1493155250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f93780800 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916d964640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93729050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916d163640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93755640 0x564f9377fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f916e165640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f9372ef30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9160002230 tx=0x7f91600015c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0055a041ed678a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.055+0000 7f9148ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f9148ff9640 1 -- 172.21.15.37:0/1493155250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160025070 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f9148ff9640 1 -- 172.21.15.37:0/1493155250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f9160014860 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9164080f50 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f9148ff9640 1 -- 172.21.15.37:0/1493155250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f916001a030 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 10 client.7071 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x564f937288b0 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f9148ff9640 1 -- 172.21.15.37:0/1493155250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164080f50 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f9148ff9640 1 -- 172.21.15.37:0/1493155250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f9160020040 con 0x564f93760160 2024-05-10T08:46:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 10 client.7071 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 10 client.7071 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 20 client.7071 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f937da640 0x564f9372f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 4 client.7071 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f936849b0 con 0x564f937da640 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.056+0000 7f916d964640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f937da640 0x564f9372f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f9148ff9640 10 client.7071 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f916d964640 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f937da640 0x564f9372f470 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f1176ee6ae9d48e server_cookie=82430340720b01a8 in_seq=0 out_seq=0 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f9148ff9640 1 -- 172.21.15.37:0/1493155250 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x564f936849b0 con 0x564f937da640 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f9148ff9640 10 client.7071 handle_command_reply: tid=0 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 client.7071 shutdown 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 msgr2=0x564f9372ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f9372ef30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9160002230 tx=0x7f91600015c0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 shutdown_connections 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x564f937da640 0x564f9372f470 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f93760160 0x564f9372ef30 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f93755640 0x564f9377fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f9148ff9640 0 client.7071 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 --2- 172.21.15.37:0/1493155250 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x564f93743280 0x564f93729050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 >> 172.21.15.37:0/1493155250 conn(0x564f93742b40 msgr2=0x564f93716300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 shutdown_connections 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 1 -- 172.21.15.37:0/1493155250 wait complete. 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.057+0000 7f91729c2740 20 client.7071 trim_cache size 0 max 16384 2024-05-10T08:46:21.062 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: "ce4799c9-da13-4c73-987f-bee3a2502899": { 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/dir", 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "ce4799c9-da13-4c73-987f-bee3a2502899", 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:46:21.063 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:46:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f914c0762d0 msgr2=0x7f914c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f914c0762d0 0x7f914c078790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91681540d0 tx=0x7f9158009190 comp rx=0 tx=0).stop 2024-05-10T08:46:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91680d1eb0 msgr2=0x7f9168150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91680d1eb0 0x7f9168150460 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f916402a2b0 tx=0x7f91640046c0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 shutdown_connections 2024-05-10T08:46:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f914c0762d0 0x7f914c078790 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9168160c00 0x7f91680b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91680b89b0 0x7f91681606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 --2- 172.21.15.37:0/3051322550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91680d1eb0 0x7f9168150460 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 >> 172.21.15.37:0/3051322550 conn(0x7f916808eac0 msgr2=0x7f916806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 shutdown_connections 2024-05-10T08:46:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:21.058+0000 7f916fbc8640 1 -- 172.21.15.37:0/3051322550 wait complete. 2024-05-10T08:46:21.067 INFO:tasks.cephfs.filesystem:scrub status for tag:ce4799c9-da13-4c73-987f-bee3a2502899 - {'path': '/dir', 'tag': 'ce4799c9-da13-4c73-987f-bee3a2502899', 'options': 'recursive,repair'} 2024-05-10T08:46:23.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:46:23.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:46:51.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:51.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T08:46:51.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.188+0000 7f4741c6b640 1 Processor -- start 2024-05-10T08:46:51.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.188+0000 7f4741c6b640 1 -- start start 2024-05-10T08:46:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.189+0000 7f4741c6b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f473c070d30 0x7f473c0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.189+0000 7f4741c6b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c0d1300 con 0x7f473c163920 2024-05-10T08:46:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.189+0000 7f4741c6b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c0d15e0 con 0x7f473c071110 2024-05-10T08:46:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.189+0000 7f4741c6b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f473c0d10d0 con 0x7f473c070d30 2024-05-10T08:46:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.189+0000 7f473b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f473c070d30 0x7f473c0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.189+0000 7f473b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f473c070d30 0x7f473c0d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49910/0 (socket says 172.21.15.37:49910) 2024-05-10T08:46:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.189+0000 7f473b7fe640 1 -- 172.21.15.37:0/1715867374 learned_addr learned my addr 172.21.15.37:0/1715867374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.190+0000 7f473b7fe640 1 -- 172.21.15.37:0/1715867374 >> v1:172.21.15.82:6789/0 conn(0x7f473c071110 legacy=0x7f473c06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.190+0000 7f473b7fe640 1 -- 172.21.15.37:0/1715867374 >> v1:172.21.15.37:6789/0 conn(0x7f473c163920 legacy=0x7f473c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.190+0000 7f473a7fc640 1 -- 172.21.15.37:0/1715867374 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984548512 0 0) 0x7f473c0d1300 con 0x7f473c163920 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.190+0000 7f473b7fe640 1 -- 172.21.15.37:0/1715867374 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0d18c0 con 0x7f473c070d30 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f473b7fe640 1 --2- 172.21.15.37:0/1715867374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0d20c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f472c009870 tx=0x7f472c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88c739b17c57c7a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f473a7fc640 1 -- 172.21.15.37:0/1715867374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c037070 con 0x7f473c070d30 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f473a7fc640 1 -- 172.21.15.37:0/1715867374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c032440 con 0x7f473c070d30 2024-05-10T08:46:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f473a7fc640 1 -- 172.21.15.37:0/1715867374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c032810 con 0x7f473c070d30 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f4741c6b640 1 -- 172.21.15.37:0/1715867374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 msgr2=0x7f473c0d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f4741c6b640 1 --2- 172.21.15.37:0/1715867374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0d20c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f472c009870 tx=0x7f472c02a2a0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f4741c6b640 1 -- 172.21.15.37:0/1715867374 shutdown_connections 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f4741c6b640 1 --2- 172.21.15.37:0/1715867374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0d20c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f4741c6b640 1 -- 172.21.15.37:0/1715867374 >> 172.21.15.37:0/1715867374 conn(0x7f473c0d2e90 msgr2=0x7f473c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f4741c6b640 1 -- 172.21.15.37:0/1715867374 shutdown_connections 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.192+0000 7f4741c6b640 1 -- 172.21.15.37:0/1715867374 wait complete. 2024-05-10T08:46:51.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.193+0000 7f4741c6b640 1 Processor -- start 2024-05-10T08:46:51.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.193+0000 7f4741c6b640 1 -- start start 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f4741c6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f4741c6b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f473c071110 0x7f473c0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f4741c6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f473c163920 0x7f473c0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f4741c6b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f473c070b80 con 0x7f473c070d30 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f4741c6b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f473c163db0 con 0x7f473c163920 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f4741c6b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f473c0d1c30 con 0x7f473c071110 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49924/0 (socket says 172.21.15.37:49924) 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 -- 172.21.15.37:0/3143926664 learned_addr learned my addr 172.21.15.37:0/3143926664 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473affd640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f473c071110 0x7f473c0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473bfff640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f473c163920 0x7f473c0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 -- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f473c071110 msgr2=0x7f473c0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f473c071110 0x7f473c0b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 -- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f473c163920 msgr2=0x7f473c0b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f473c163920 0x7f473c0b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 -- 172.21.15.37:0/3143926664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0c9870 con 0x7f473c070d30 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f473b7fe640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0c9330 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f472c009870 tx=0x7f472c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.194+0000 7f4723fff640 1 -- 172.21.15.37:0/3143926664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c041020 con 0x7f473c070d30 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.195+0000 7f4723fff640 1 -- 172.21.15.37:0/3143926664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c030970 con 0x7f473c070d30 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.195+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c0c75d0 con 0x7f473c070d30 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.195+0000 7f4723fff640 1 -- 172.21.15.37:0/3143926664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c037040 con 0x7f473c070d30 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.195+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c1f9450 con 0x7f473c070d30 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.196+0000 7f4723fff640 1 -- 172.21.15.37:0/3143926664 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f472c044020 con 0x7f473c070d30 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.197+0000 7f4723fff640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47280762d0 0x7f4728078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.197+0000 7f4723fff640 1 -- 172.21.15.37:0/3143926664 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f472c0b82d0 con 0x7f473c070d30 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.197+0000 7f473affd640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47280762d0 0x7f4728078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.198+0000 7f4744988740 1 Processor -- start 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.198+0000 7f473affd640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47280762d0 0x7f4728078790 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f473c159710 tx=0x7f4730009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.198+0000 7f4744988740 1 -- start start 2024-05-10T08:46:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x5595915f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591628280 0x559591627600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f4744988740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591627b40 0x5595915fc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f4744988740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5595915c4690 con 0x559591627b40 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559591561f30 con 0x559591628280 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55959151ab20 con 0x559591645160 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591627b40 0x5595915fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591627b40 0x5595915fc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49932/0 (socket says 172.21.15.37:49932) 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 -- 172.21.15.37:0/95201308 learned_addr learned my addr 172.21.15.37:0/95201308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473affd640 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591628280 0x559591627600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473b7fe640 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x5595915f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 -- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 msgr2=0x5595915f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x5595915f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 -- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591628280 msgr2=0x559591627600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591628280 0x559591627600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 -- 172.21.15.37:0/95201308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559591512e60 con 0x559591627b40 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f473bfff640 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591627b40 0x5595915fc950 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4734007df0 tx=0x7f473400c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83f25b4f28f3f17 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f47217fa640 1 -- 172.21.15.37:0/95201308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734015020 con 0x559591627b40 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f47217fa640 1 -- 172.21.15.37:0/95201308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473400ce70 con 0x559591627b40 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.199+0000 7f47217fa640 1 -- 172.21.15.37:0/95201308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473400d040 con 0x559591627b40 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 -- 172.21.15.37:0/95201308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591627b40 msgr2=0x5595915fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591627b40 0x5595915fc950 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4734007df0 tx=0x7f473400c540 comp rx=0 tx=0).stop 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 -- 172.21.15.37:0/95201308 shutdown_connections 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591627b40 0x5595915fc950 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591628280 0x559591627600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 --2- 172.21.15.37:0/95201308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x5595915f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 -- 172.21.15.37:0/95201308 >> 172.21.15.37:0/95201308 conn(0x5595915f9d60 msgr2=0x559591642600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 -- 172.21.15.37:0/95201308 shutdown_connections 2024-05-10T08:46:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.200+0000 7f4744988740 1 -- 172.21.15.37:0/95201308 wait complete. 2024-05-10T08:46:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.201+0000 7f4744988740 1 -- start start 2024-05-10T08:46:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.201+0000 7f4744988740 1 Processor -- start 2024-05-10T08:46:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591629ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x559591643b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55959151e5e0 con 0x559591628280 2024-05-10T08:46:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55959155def0 con 0x55959162b0a0 2024-05-10T08:46:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5595915fbf10 con 0x559591645160 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 10 client.0 _ll_register_callbacks cb 0x559591519320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591629ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591629ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49940/0 (socket says 172.21.15.37:49940) 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 -- 172.21.15.37:0/963523034 learned_addr learned my addr 172.21.15.37:0/963523034 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473bfff640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473affd640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x559591643b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 -- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 msgr2=0x559591643b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x559591643b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 -- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 msgr2=0x5595916440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 -- 172.21.15.37:0/963523034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959133d7d0 con 0x559591628280 2024-05-10T08:46:51.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473bfff640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473affd640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x559591643b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f473b7fe640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591629ee0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f472c080f40 tx=0x7f472c030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a88aca17bdc2d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f471a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f471a7fc640 1 -- 172.21.15.37:0/963523034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c080d50 con 0x559591628280 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f471a7fc640 1 -- 172.21.15.37:0/963523034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f472c085170 con 0x559591628280 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.202+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f473400ce70 con 0x559591628280 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f471a7fc640 1 -- 172.21.15.37:0/963523034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f472c081940 con 0x559591628280 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 10 client.7086 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x5595912733f0 con 0x559591628280 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f471a7fc640 1 -- 172.21.15.37:0/963523034 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473400ce70 con 0x559591628280 2024-05-10T08:46:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f471a7fc640 1 -- 172.21.15.37:0/963523034 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f472c03a030 con 0x559591628280 2024-05-10T08:46:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 10 client.7086 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 10 client.7086 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 20 client.7086 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559591652890 0x559591652cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 4 client.7086 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55959156fb40 con 0x559591652890 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f473affd640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559591652890 0x559591652cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f473affd640 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559591652890 0x559591652cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10b887f742eb46d9 server_cookie=78accc5cce886de9 in_seq=0 out_seq=0 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.203+0000 7f471a7fc640 10 client.7086 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f471a7fc640 1 -- 172.21.15.37:0/963523034 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55959156fb40 con 0x559591652890 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f471a7fc640 10 client.7086 handle_command_reply: tid=0 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 client.7086 shutdown 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 msgr2=0x559591629ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591629ee0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f472c080f40 tx=0x7f472c030f90 comp rx=0 tx=0).stop 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 shutdown_connections 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x559591652890 0x559591652cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591645160 0x559591643b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 --2- 172.21.15.37:0/963523034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591629ee0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f471a7fc640 0 client.7086 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 >> 172.21.15.37:0/963523034 conn(0x559591627b40 msgr2=0x5595915f7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 shutdown_connections 2024-05-10T08:46:51.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 1 -- 172.21.15.37:0/963523034 wait complete. 2024-05-10T08:46:51.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.204+0000 7f4744988740 20 client.7086 trim_cache size 0 max 16384 2024-05-10T08:46:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 Processor -- start 2024-05-10T08:46:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 -- start start 2024-05-10T08:46:51.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591652e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55959162b0a0 0x559591623c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591645160 0x559591624150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f473c202380 con 0x559591628280 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f473c2013f0 con 0x559591645160 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.223+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f473c0b8050 con 0x55959162b0a0 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591652e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591652e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49954/0 (socket says 172.21.15.37:49954) 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 -- 172.21.15.37:0/2603322411 learned_addr learned my addr 172.21.15.37:0/2603322411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 -- 172.21.15.37:0/2603322411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55959162b0a0 msgr2=0x559591623c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 --2- 172.21.15.37:0/2603322411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55959162b0a0 0x559591623c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 -- 172.21.15.37:0/2603322411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591645160 msgr2=0x559591624150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 --2- 172.21.15.37:0/2603322411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591645160 0x559591624150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 -- 172.21.15.37:0/2603322411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595915f8ba0 con 0x559591628280 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f473b7fe640 1 --2- 172.21.15.37:0/2603322411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591652e60 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f472c035040 tx=0x7f472c048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd68e68aee4e94a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f4720ff9640 1 -- 172.21.15.37:0/2603322411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c07d890 con 0x559591628280 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f4720ff9640 1 -- 172.21.15.37:0/2603322411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c080d50 con 0x559591628280 2024-05-10T08:46:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.224+0000 7f4720ff9640 1 -- 172.21.15.37:0/2603322411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c085370 con 0x559591628280 2024-05-10T08:46:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 -- 172.21.15.37:0/2603322411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 msgr2=0x559591652e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 --2- 172.21.15.37:0/2603322411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591652e60 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f472c035040 tx=0x7f472c048000 comp rx=0 tx=0).stop 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 -- 172.21.15.37:0/2603322411 shutdown_connections 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 --2- 172.21.15.37:0/2603322411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559591645160 0x559591624150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 --2- 172.21.15.37:0/2603322411 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55959162b0a0 0x559591623c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 --2- 172.21.15.37:0/2603322411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591628280 0x559591652e60 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 -- 172.21.15.37:0/2603322411 >> 172.21.15.37:0/2603322411 conn(0x559591627b40 msgr2=0x55959163a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 -- 172.21.15.37:0/2603322411 shutdown_connections 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.225+0000 7f4744988740 1 -- 172.21.15.37:0/2603322411 wait complete. 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 -- start start 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 Processor -- start 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591628280 0x559591666640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591645160 0x5595916381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55959162bb30 con 0x559591645160 2024-05-10T08:46:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b67c0 con 0x55959162b0a0 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.226+0000 7f4744988740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5595915f8ba0 con 0x559591628280 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f4744988740 10 client.0 _ll_register_callbacks cb 0x7f472c080b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591645160 0x5595916381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591645160 0x5595916381b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49960/0 (socket says 172.21.15.37:49960) 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 -- 172.21.15.37:0/3355939706 learned_addr learned my addr 172.21.15.37:0/3355939706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473affd640 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473b7fe640 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591628280 0x559591666640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 -- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591628280 msgr2=0x559591666640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591628280 0x559591666640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 -- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 msgr2=0x5595916b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 -- 172.21.15.37:0/3355939706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595915faea0 con 0x559591645160 2024-05-10T08:46:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f473bfff640 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591645160 0x5595916381b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4734007d90 tx=0x7f4734004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa1d54f42f016ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f471a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f471a7fc640 1 -- 172.21.15.37:0/3355939706 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734015070 con 0x559591645160 2024-05-10T08:46:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f471a7fc640 1 -- 172.21.15.37:0/3355939706 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f4734004240 con 0x559591645160 2024-05-10T08:46:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472c080d50 con 0x559591645160 2024-05-10T08:46:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f471a7fc640 1 -- 172.21.15.37:0/3355939706 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f473402b050 con 0x559591645160 2024-05-10T08:46:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f4744988740 10 client.7092 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.227+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x5595912330f0 con 0x559591645160 2024-05-10T08:46:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f471a7fc640 1 -- 172.21.15.37:0/3355939706 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c080d50 con 0x559591645160 2024-05-10T08:46:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f471a7fc640 1 -- 172.21.15.37:0/3355939706 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f473402e020 con 0x559591645160 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 10 client.7092 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 10 client.7092 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 20 client.7092 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5595916b6e90 0x5595916386f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 4 client.7092 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595915699b0 con 0x5595916b6e90 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f473b7fe640 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5595916b6e90 0x5595916386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f473b7fe640 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5595916b6e90 0x5595916386f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31cfccabbc00aa9 server_cookie=a73caa37e2a65346 in_seq=0 out_seq=0 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f471a7fc640 10 client.7092 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f471a7fc640 1 -- 172.21.15.37:0/3355939706 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5595915699b0 con 0x5595916b6e90 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f471a7fc640 10 client.7092 handle_command_reply: tid=0 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 1 client.7092 shutdown 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591645160 msgr2=0x5595916381b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591645160 0x5595916381b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4734007d90 tx=0x7f4734004a70 comp rx=0 tx=0).stop 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 shutdown_connections 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.228+0000 7f4744988740 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x5595916b6e90 0x5595916386f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4744988740 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559591645160 0x5595916381b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4744988740 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55959162b0a0 0x5595916b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f471a7fc640 0 client.7092 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4744988740 1 --2- 172.21.15.37:0/3355939706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559591628280 0x559591666640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 >> 172.21.15.37:0/3355939706 conn(0x559591627b40 msgr2=0x559591629a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 shutdown_connections 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4744988740 1 -- 172.21.15.37:0/3355939706 wait complete. 2024-05-10T08:46:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4744988740 20 client.7092 trim_cache size 0 max 16384 2024-05-10T08:46:51.236 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:46:51.236 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:46:51.236 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:46:51.236 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:46:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47280762d0 msgr2=0x7f4728078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47280762d0 0x7f4728078790 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f473c159710 tx=0x7f4730009040 comp rx=0 tx=0).stop 2024-05-10T08:46:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 msgr2=0x7f473c0c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0c9330 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f472c009870 tx=0x7f472c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 shutdown_connections 2024-05-10T08:46:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47280762d0 0x7f4728078790 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f473c163920 0x7f473c0b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f473c071110 0x7f473c0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 --2- 172.21.15.37:0/3143926664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473c070d30 0x7f473c0c9330 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 >> 172.21.15.37:0/3143926664 conn(0x7f473c0d2e90 msgr2=0x7f473c160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 shutdown_connections 2024-05-10T08:46:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.229+0000 7f4741c6b640 1 -- 172.21.15.37:0/3143926664 wait complete. 2024-05-10T08:46:51.239 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:46:51.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:46:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd0a1db6640 1 Processor -- start 2024-05-10T08:46:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd0a1db6640 1 -- start start 2024-05-10T08:46:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd0a1db6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd09c06f060 0x7fd09c06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd0a1db6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd09c06fe30 0x7fd09c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd0a1db6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd09c15d2a0 con 0x7fd09c0d0360 2024-05-10T08:46:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd0a1db6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd09c0d07c0 con 0x7fd09c06f060 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd0a1db6640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd09c06f440 con 0x7fd09c06fe30 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd09c06f060 0x7fd09c06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd09c06f060 0x7fd09c06e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49964/0 (socket says 172.21.15.37:49964) 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09b7fe640 1 -- 172.21.15.37:0/2290125035 learned_addr learned my addr 172.21.15.37:0/2290125035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09affd640 1 --2- 172.21.15.37:0/2290125035 >> v2:172.21.15.82:3300/0 conn(0x7fd09c06fe30 0x7fd09c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09b7fe640 1 -- 172.21.15.37:0/2290125035 >> v2:172.21.15.82:3300/0 conn(0x7fd09c06fe30 msgr2=0x7fd09c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09b7fe640 1 --2- 172.21.15.37:0/2290125035 >> v2:172.21.15.82:3300/0 conn(0x7fd09c06fe30 0x7fd09c0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09b7fe640 1 -- 172.21.15.37:0/2290125035 >> v1:172.21.15.82:6789/0 conn(0x7fd09c0d0360 legacy=0x7fd09c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.346+0000 7fd09b7fe640 1 -- 172.21.15.37:0/2290125035 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c1609b0 con 0x7fd09c06f060 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.347+0000 7fd09b7fe640 1 --2- 172.21.15.37:0/2290125035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c06f060 0x7fd09c06e0f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd09c06d220 tx=0x7fd08c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a95afbd48505e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.347+0000 7fd09a7fc640 1 -- 172.21.15.37:0/2290125035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c037070 con 0x7fd09c06f060 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.347+0000 7fd09a7fc640 1 -- 172.21.15.37:0/2290125035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08c032440 con 0x7fd09c06f060 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.347+0000 7fd09a7fc640 1 -- 172.21.15.37:0/2290125035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c032810 con 0x7fd09c06f060 2024-05-10T08:46:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 -- 172.21.15.37:0/2290125035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c06f060 msgr2=0x7fd09c06e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/2290125035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c06f060 0x7fd09c06e0f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd09c06d220 tx=0x7fd08c02a270 comp rx=0 tx=0).stop 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 -- 172.21.15.37:0/2290125035 shutdown_connections 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/2290125035 >> v2:172.21.15.82:3300/0 conn(0x7fd09c06fe30 0x7fd09c0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/2290125035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c06f060 0x7fd09c06e0f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 -- 172.21.15.37:0/2290125035 >> 172.21.15.37:0/2290125035 conn(0x7fd09c06c3a0 msgr2=0x7fd09c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 -- 172.21.15.37:0/2290125035 shutdown_connections 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.348+0000 7fd0a1db6640 1 -- 172.21.15.37:0/2290125035 wait complete. 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.349+0000 7fd0a1db6640 1 Processor -- start 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.349+0000 7fd0a1db6640 1 -- start start 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd0a1db6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c06f060 0x7fd09c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd0a1db6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c06fe30 0x7fd09c1486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd0a1db6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0d0360 0x7fd09c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd0a1db6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c161250 con 0x7fd09c0d0360 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd0a1db6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c160f70 con 0x7fd09c06fe30 2024-05-10T08:46:51.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd0a1db6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c161530 con 0x7fd09c06f060 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0d0360 0x7fd09c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0d0360 0x7fd09c148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49980/0 (socket says 172.21.15.37:49980) 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 -- 172.21.15.37:0/868560110 learned_addr learned my addr 172.21.15.37:0/868560110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09b7fe640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c06f060 0x7fd09c159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09affd640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c06fe30 0x7fd09c1486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 -- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c06f060 msgr2=0x7fd09c159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c06f060 0x7fd09c159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 -- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c06fe30 msgr2=0x7fd09c1486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c06fe30 0x7fd09c1486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.350+0000 7fd09bfff640 1 -- 172.21.15.37:0/868560110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c09dbe0 con 0x7fd09c0d0360 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.351+0000 7fd09bfff640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0d0360 0x7fd09c148ea0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fd09400c6b0 tx=0x7fd09400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.351+0000 7fd083fff640 1 -- 172.21.15.37:0/868560110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094003b70 con 0x7fd09c0d0360 2024-05-10T08:46:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.351+0000 7fd083fff640 1 -- 172.21.15.37:0/868560110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd094003d30 con 0x7fd09c0d0360 2024-05-10T08:46:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.351+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c1e7810 con 0x7fd09c0d0360 2024-05-10T08:46:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.351+0000 7fd083fff640 1 -- 172.21.15.37:0/868560110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094005310 con 0x7fd09c0d0360 2024-05-10T08:46:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.351+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c09e180 con 0x7fd09c0d0360 2024-05-10T08:46:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.352+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09c0693f0 con 0x7fd09c0d0360 2024-05-10T08:46:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.354+0000 7fd083fff640 1 -- 172.21.15.37:0/868560110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd0940054b0 con 0x7fd09c0d0360 2024-05-10T08:46:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.354+0000 7fd083fff640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0880762d0 0x7fd088078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.354+0000 7fd083fff640 1 -- 172.21.15.37:0/868560110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7fd0940974a0 con 0x7fd09c0d0360 2024-05-10T08:46:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.354+0000 7fd09b7fe640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0880762d0 0x7fd088078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.354+0000 7fd09b7fe640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0880762d0 0x7fd088078790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd08c034000 tx=0x7fd08c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.358+0000 7fd083fff640 1 -- 172.21.15.37:0/868560110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd0940605f0 con 0x7fd09c0d0360 2024-05-10T08:46:51.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.587+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd09c0cf400 con 0x7fd09c0d0360 2024-05-10T08:46:51.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.588+0000 7fd083fff640 1 -- 172.21.15.37:0/868560110 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5178 (secure 0 0 0) 0x7fd0940648f0 con 0x7fd09c0d0360 2024-05-10T08:46:51.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:51.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:53.743846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":6,"addr":"172.21.15.37:6834/375241165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":375241165},{"type":"v1","addr":"172.21.15.37:6834","nonce":375241165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6870,"qdb_cluster":[6870]},"id":6}]} 2024-05-10T08:46:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 67 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0880762d0 msgr2=0x7fd088078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0880762d0 0x7fd088078790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd08c034000 tx=0x7fd08c02e000 comp rx=0 tx=0).stop 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0d0360 msgr2=0x7fd09c148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0d0360 0x7fd09c148ea0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fd09400c6b0 tx=0x7fd09400cb70 comp rx=0 tx=0).stop 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 shutdown_connections 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd0880762d0 0x7fd088078790 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0d0360 0x7fd09c148ea0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c06fe30 0x7fd09c1486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.589+0000 7fd0a1db6640 1 --2- 172.21.15.37:0/868560110 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c06f060 0x7fd09c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.590+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 >> 172.21.15.37:0/868560110 conn(0x7fd09c06c3a0 msgr2=0x7fd09c15ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.590+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 shutdown_connections 2024-05-10T08:46:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.590+0000 7fd0a1db6640 1 -- 172.21.15.37:0/868560110 wait complete. 2024-05-10T08:46:51.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-05-10T08:46:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.705+0000 7fa00afc8640 1 Processor -- start 2024-05-10T08:46:51.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.706+0000 7fa00afc8640 1 -- start start 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.706+0000 7fa00afc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa004161630 0x7fa00406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.706+0000 7fa00afc8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa00406c3a0 0x7fa00406c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.706+0000 7fa00afc8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040715b0 con 0x7fa00415ce30 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.706+0000 7fa00afc8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa0040d0840 con 0x7fa004161630 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.706+0000 7fa00afc8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa0040cf030 con 0x7fa00406c3a0 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa003fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa004161630 0x7fa00406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa008d64640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa00415ce30 0x7fa0040ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50422/0 (socket says 172.21.15.37:50422) 2024-05-10T08:46:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa008d64640 1 -- 172.21.15.37:0/4136525860 learned_addr learned my addr 172.21.15.37:0/4136525860 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:46:51.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa009565640 1 --2- 172.21.15.37:0/4136525860 >> v2:172.21.15.82:3300/0 conn(0x7fa00406c3a0 0x7fa00406c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa003fff640 1 -- 172.21.15.37:0/4136525860 >> v2:172.21.15.82:3300/0 conn(0x7fa00406c3a0 msgr2=0x7fa00406c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa003fff640 1 --2- 172.21.15.37:0/4136525860 >> v2:172.21.15.82:3300/0 conn(0x7fa00406c3a0 0x7fa00406c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa003fff640 1 -- 172.21.15.37:0/4136525860 >> v1:172.21.15.37:6789/0 conn(0x7fa00415ce30 legacy=0x7fa0040ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa003fff640 1 -- 172.21.15.37:0/4136525860 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa004071890 con 0x7fa004161630 2024-05-10T08:46:51.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.707+0000 7fa0037fe640 1 -- 172.21.15.37:0/4136525860 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971630531 0 0) 0x7fa0040715b0 con 0x7fa00415ce30 2024-05-10T08:46:51.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa003fff640 1 --2- 172.21.15.37:0/4136525860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa00406f5d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa004071e50 tx=0x7f9fec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfd6f7dfb516d7d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa0037fe640 1 -- 172.21.15.37:0/4136525860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec037070 con 0x7fa004161630 2024-05-10T08:46:51.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa0037fe640 1 -- 172.21.15.37:0/4136525860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec032440 con 0x7fa004161630 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa0037fe640 1 -- 172.21.15.37:0/4136525860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec032810 con 0x7fa004161630 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 -- 172.21.15.37:0/4136525860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 msgr2=0x7fa00406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 --2- 172.21.15.37:0/4136525860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa00406f5d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa004071e50 tx=0x7f9fec02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 -- 172.21.15.37:0/4136525860 shutdown_connections 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 --2- 172.21.15.37:0/4136525860 >> v2:172.21.15.82:3300/0 conn(0x7fa00406c3a0 0x7fa00406c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 --2- 172.21.15.37:0/4136525860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa00406f5d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 -- 172.21.15.37:0/4136525860 >> 172.21.15.37:0/4136525860 conn(0x7fa0040b3c40 msgr2=0x7fa0040b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 -- 172.21.15.37:0/4136525860 shutdown_connections 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.708+0000 7fa00afc8640 1 -- 172.21.15.37:0/4136525860 wait complete. 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 Processor -- start 2024-05-10T08:46:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 -- start start 2024-05-10T08:46:51.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa00406c3a0 0x7fa00415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00415ce30 0x7fa004070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa004070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040d0460 con 0x7fa004161630 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa00415d210 con 0x7fa00415ce30 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.710+0000 7fa00afc8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040d0cd0 con 0x7fa00406c3a0 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa004070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa004070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49998/0 (socket says 172.21.15.37:49998) 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 -- 172.21.15.37:0/313796847 learned_addr learned my addr 172.21.15.37:0/313796847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa003fff640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00415ce30 0x7fa004070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa008d64640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa00406c3a0 0x7fa00415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 -- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa00406c3a0 msgr2=0x7fa00415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa00406c3a0 0x7fa00415fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 -- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00415ce30 msgr2=0x7fa004070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00415ce30 0x7fa004070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 -- 172.21.15.37:0/313796847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0041f5db0 con 0x7fa004161630 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa009565640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa004070c90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4007e40 tx=0x7f9ff400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa0017fa640 1 -- 172.21.15.37:0/313796847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4014620 con 0x7fa004161630 2024-05-10T08:46:51.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa0017fa640 1 -- 172.21.15.37:0/313796847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4019070 con 0x7fa004161630 2024-05-10T08:46:51.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa004155f70 con 0x7fa004161630 2024-05-10T08:46:51.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa0017fa640 1 -- 172.21.15.37:0/313796847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4014a20 con 0x7fa004161630 2024-05-10T08:46:51.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.711+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa004156530 con 0x7fa004161630 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.713+0000 7fa0017fa640 1 -- 172.21.15.37:0/313796847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ff4014bc0 con 0x7fa004161630 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.713+0000 7fa0017fa640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9fe40762d0 0x7f9fe4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.714+0000 7fa0017fa640 1 -- 172.21.15.37:0/313796847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f9ff40980a0 con 0x7fa004161630 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.714+0000 7fa008d64640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9fe40762d0 0x7f9fe4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.714+0000 7fa00ddc4740 1 Processor -- start 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.714+0000 7fa008d64640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9fe40762d0 0x7f9fe4078790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000f60 tx=0x7f9ffc007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.714+0000 7fa00ddc4740 1 -- start start 2024-05-10T08:46:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a0ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 0x55fe7a11db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e0b0 0x55fe7a0f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe79fde920 con 0x55fe7a11e0b0 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a053dd0 con 0x55fe7a11e7f0 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fe7a0043e0 con 0x55fe7a13b6d0 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e0b0 0x55fe7a0f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e0b0 0x55fe7a0f2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50000/0 (socket says 172.21.15.37:50000) 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 -- 172.21.15.37:0/1358842965 learned_addr learned my addr 172.21.15.37:0/1358842965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa003fff640 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 0x55fe7a11db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa008d64640 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a0ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 -- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 msgr2=0x55fe7a0ee2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a0ee2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 -- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 msgr2=0x55fe7a11db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 0x55fe7a11db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa009565640 1 -- 172.21.15.37:0/1358842965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe79e357c0 con 0x55fe7a11e0b0 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.715+0000 7fa008d64640 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a0ee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa009565640 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e0b0 0x55fe7a0f2ec0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c040 tx=0x7f9ff4060830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a6aca06a85696d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7f9ffa7fc640 1 -- 172.21.15.37:0/1358842965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40653c0 con 0x55fe7a11e0b0 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7f9ffa7fc640 1 -- 172.21.15.37:0/1358842965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4069de0 con 0x55fe7a11e0b0 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7f9ffa7fc640 1 -- 172.21.15.37:0/1358842965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4060520 con 0x55fe7a11e0b0 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 -- 172.21.15.37:0/1358842965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e0b0 msgr2=0x55fe7a0f2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e0b0 0x55fe7a0f2ec0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c040 tx=0x7f9ff4060830 comp rx=0 tx=0).stop 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 -- 172.21.15.37:0/1358842965 shutdown_connections 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e0b0 0x55fe7a0f2ec0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 0x55fe7a11db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/1358842965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a0ee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 -- 172.21.15.37:0/1358842965 >> 172.21.15.37:0/1358842965 conn(0x55fe7a0f0560 msgr2=0x55fe7a138b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 -- 172.21.15.37:0/1358842965 shutdown_connections 2024-05-10T08:46:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.716+0000 7fa00ddc4740 1 -- 172.21.15.37:0/1358842965 wait complete. 2024-05-10T08:46:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.717+0000 7fa00ddc4740 1 -- start start 2024-05-10T08:46:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.717+0000 7fa00ddc4740 1 Processor -- start 2024-05-10T08:46:51.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a1204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a11cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a05c440 con 0x55fe7a11e7f0 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a057120 con 0x55fe7a1209e0 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fe7a065210 con 0x55fe7a13b6d0 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa00ddc4740 10 client.0 _ll_register_callbacks cb 0x55fe79ffc690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50010/0 (socket says 172.21.15.37:50010) 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 -- 172.21.15.37:0/4015941771 learned_addr learned my addr 172.21.15.37:0/4015941771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa009565640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a11cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa003fff640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a1204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 -- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 msgr2=0x55fe7a1204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a1204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 -- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 msgr2=0x55fe7a11cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a11cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa008d64640 1 -- 172.21.15.37:0/4015941771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe79e95f50 con 0x55fe7a11e7f0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.718+0000 7fa003fff640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a1204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa008d64640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e410 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc013720 tx=0x7f9ffc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7899c6e7911c9b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7f9fe37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7f9fe37fe640 1 -- 172.21.15.37:0/4015941771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc027060 con 0x55fe7a11e7f0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7f9fe37fe640 1 -- 172.21.15.37:0/4015941771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f9ffc022d00 con 0x55fe7a11e7f0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff4069de0 con 0x55fe7a11e7f0 2024-05-10T08:46:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7f9fe37fe640 1 -- 172.21.15.37:0/4015941771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f9ffc0126e0 con 0x55fe7a11e7f0 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 10 client.7113 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55fe79d290b0 con 0x55fe7a11e7f0 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7f9fe37fe640 1 -- 172.21.15.37:0/4015941771 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4069de0 con 0x55fe7a11e7f0 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7f9fe37fe640 1 -- 172.21.15.37:0/4015941771 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f9ffc012880 con 0x55fe7a11e7f0 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 10 client.7113 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 10 client.7113 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 20 client.7113 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a148970 0x55fe7a148d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 4 client.7113 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe7a065a20 con 0x55fe7a148970 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.719+0000 7fa003fff640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a148970 0x55fe7a148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa003fff640 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a148970 0x55fe7a148d50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a067efa50daf666c server_cookie=3b240ad489f7e73 in_seq=0 out_seq=0 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7f9fe37fe640 10 client.7113 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7f9fe37fe640 1 -- 172.21.15.37:0/4015941771 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fe7a065a20 con 0x55fe7a148970 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7f9fe37fe640 10 client.7113 handle_command_reply: tid=0 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 client.7113 shutdown 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e7f0 msgr2=0x55fe7a10e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e410 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc013720 tx=0x7f9ffc000ed0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 shutdown_connections 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a148970 0x55fe7a148d50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a11cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a13b6d0 0x55fe7a1204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7f9fe37fe640 0 client.7113 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/4015941771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e410 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.720+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 >> 172.21.15.37:0/4015941771 conn(0x55fe7a11e0b0 msgr2=0x55fe7a0eda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.721+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 shutdown_connections 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.721+0000 7fa00ddc4740 1 -- 172.21.15.37:0/4015941771 wait complete. 2024-05-10T08:46:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.721+0000 7fa00ddc4740 20 client.7113 trim_cache size 0 max 16384 2024-05-10T08:46:51.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 Processor -- start 2024-05-10T08:46:51.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 -- start start 2024-05-10T08:46:51.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a1209e0 0x55fe7a11ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa004200d80 con 0x55fe7a13b6d0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa0041f94e0 con 0x55fe7a11e7f0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa00415f170 con 0x55fe7a1209e0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50016/0 (socket says 172.21.15.37:50016) 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 -- 172.21.15.37:0/3277342196 learned_addr learned my addr 172.21.15.37:0/3277342196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 -- 172.21.15.37:0/3277342196 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a1209e0 msgr2=0x55fe7a11ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 --2- 172.21.15.37:0/3277342196 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a1209e0 0x55fe7a11ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 -- 172.21.15.37:0/3277342196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 msgr2=0x55fe7a10e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 --2- 172.21.15.37:0/3277342196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 -- 172.21.15.37:0/3277342196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7a1300b0 con 0x55fe7a13b6d0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.735+0000 7fa009565640 1 --2- 172.21.15.37:0/3277342196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400e9b0 tx=0x7f9ff4063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfcd2bf80f0bf7e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7f9ff9ffb640 1 -- 172.21.15.37:0/3277342196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4081070 con 0x55fe7a13b6d0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7f9ff9ffb640 1 -- 172.21.15.37:0/3277342196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4069de0 con 0x55fe7a13b6d0 2024-05-10T08:46:51.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7f9ff9ffb640 1 -- 172.21.15.37:0/3277342196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4094040 con 0x55fe7a13b6d0 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3277342196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 msgr2=0x55fe7a14ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3277342196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400e9b0 tx=0x7f9ff4063000 comp rx=0 tx=0).stop 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3277342196 shutdown_connections 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3277342196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3277342196 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a1209e0 0x55fe7a11ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3277342196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a11e7f0 0x55fe7a10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3277342196 >> 172.21.15.37:0/3277342196 conn(0x55fe7a11e0b0 msgr2=0x55fe7a1392c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3277342196 shutdown_connections 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.736+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3277342196 wait complete. 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.737+0000 7fa00ddc4740 1 -- start start 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.737+0000 7fa00ddc4740 1 Processor -- start 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a11e7f0 0x55fe7a1b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a13a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a14cb10 con 0x55fe7a13b6d0 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a00da20 con 0x55fe7a1209e0 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55fe7a11ef50 con 0x55fe7a11e7f0 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 10 client.0 _ll_register_callbacks cb 0x7f9ffc0073c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50020/0 (socket says 172.21.15.37:50020) 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 -- 172.21.15.37:0/3999199932 learned_addr learned my addr 172.21.15.37:0/3999199932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa003fff640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a13a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa008d64640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a11e7f0 0x55fe7a1b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 -- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a11e7f0 msgr2=0x55fe7a1b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a11e7f0 0x55fe7a1b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 -- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 msgr2=0x55fe7a13a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a13a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 -- 172.21.15.37:0/3999199932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7a0e8d40 con 0x55fe7a13b6d0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa008d64640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a11e7f0 0x55fe7a1b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa009565640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9ff401d000 tx=0x7f9ff4016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50346425fe8cb87 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7f9fe37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7f9fe37fe640 1 -- 172.21.15.37:0/3999199932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4081070 con 0x55fe7a13b6d0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7f9fe37fe640 1 -- 172.21.15.37:0/3999199932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f9ff4060320 con 0x55fe7a13b6d0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.738+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff4069de0 con 0x55fe7a13b6d0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7f9fe37fe640 1 -- 172.21.15.37:0/3999199932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f9ff4075050 con 0x55fe7a13b6d0 2024-05-10T08:46:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 10 client.7119 fetch_fsmap learned FSMap version 67 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55fe7a15cc50 con 0x55fe7a13b6d0 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7f9fe37fe640 1 -- 172.21.15.37:0/3999199932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4069de0 con 0x55fe7a13b6d0 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7f9fe37fe640 1 -- 172.21.15.37:0/3999199932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 67) ==== 3494+0+0 (secure 0 0 0) 0x7f9ff405ca30 con 0x55fe7a13b6d0 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 10 client.7119 fetch_fsmap finished waiting for FSMap version 67 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 10 client.7119 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 20 client.7119 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a0ef030 0x55fe7a14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 4 client.7119 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 --> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55fe7a05f890 con 0x55fe7a0ef030 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa008d64640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a0ef030 0x55fe7a14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7f9fe37fe640 10 client.7119 ms_handle_connect on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa008d64640 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a0ef030 0x55fe7a14b2a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc291b31ecd088f server_cookie=345ee36831cceeba in_seq=0 out_seq=0 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7f9fe37fe640 1 -- 172.21.15.37:0/3999199932 <== mds.0 v2:172.21.15.37:6832/375241165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+144 (crc 0 0 0) 0x55fe7a05f890 con 0x55fe7a0ef030 2024-05-10T08:46:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7f9fe37fe640 10 client.7119 handle_command_reply: tid=0 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.739+0000 7fa00ddc4740 1 client.7119 shutdown 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 msgr2=0x55fe7a14ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9ff401d000 tx=0x7f9ff4016070 comp rx=0 tx=0).stop 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 shutdown_connections 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:6832/375241165,v1:172.21.15.37:6834/375241165] conn(0x55fe7a0ef030 0x55fe7a14b2a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7a13b6d0 0x55fe7a14ad60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe7a1209e0 0x55fe7a13a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7f9fe37fe640 0 client.7119 ms_handle_reset on v2:172.21.15.37:6832/375241165 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 --2- 172.21.15.37:0/3999199932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55fe7a11e7f0 0x55fe7a1b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 >> 172.21.15.37:0/3999199932 conn(0x55fe7a11e0b0 msgr2=0x55fe7a10d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 shutdown_connections 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 1 -- 172.21.15.37:0/3999199932 wait complete. 2024-05-10T08:46:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00ddc4740 20 client.7119 trim_cache size 0 max 16384 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout: "damage_type": "backtrace", 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 1940390747, 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/testdir/hardlink" 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:46:51.745 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:46:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9fe40762d0 msgr2=0x7f9fe4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00afc8640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9fe40762d0 0x7f9fe4078790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000f60 tx=0x7f9ffc007d50 comp rx=0 tx=0).stop 2024-05-10T08:46:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 msgr2=0x7fa004070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.740+0000 7fa00afc8640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa004070c90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4007e40 tx=0x7f9ff400e4b0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 shutdown_connections 2024-05-10T08:46:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9fe40762d0 0x7f9fe4078790 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa004161630 0x7fa004070c90 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00415ce30 0x7fa004070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 --2- 172.21.15.37:0/313796847 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa00406c3a0 0x7fa00415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 >> 172.21.15.37:0/313796847 conn(0x7fa0040b3c40 msgr2=0x7fa004160700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 shutdown_connections 2024-05-10T08:46:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.741+0000 7fa00afc8640 1 -- 172.21.15.37:0/313796847 wait complete. 2024-05-10T08:46:51.750 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:46:51.750 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:46:51.767 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:46:51.767 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:46:51.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.971+0000 7f8d49209640 1 Processor -- start 2024-05-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.971+0000 7f8d49209640 1 -- start start 2024-05-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.971+0000 7f8d49209640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d440d39b0 0x7f8d4415e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.971+0000 7f8d49209640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440cd9a0 0x7f8d440cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.971+0000 7f8d49209640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d44160d10 con 0x7f8d440cf8a0 2024-05-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.971+0000 7f8d49209640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8d4415d5f0 con 0x7f8d440d39b0 2024-05-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.971+0000 7f8d49209640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d44161920 con 0x7f8d440cd9a0 2024-05-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d440d39b0 0x7f8d4415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d440d39b0 0x7f8d4415e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50032/0 (socket says 172.21.15.37:50032) 2024-05-10T08:46:51.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2163160124 learned_addr learned my addr 172.21.15.37:0/2163160124 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2163160124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440cd9a0 msgr2=0x7f8d440cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 --2- 172.21.15.37:0/2163160124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440cd9a0 0x7f8d440cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2163160124 >> v1:172.21.15.82:6789/0 conn(0x7f8d440cf8a0 legacy=0x7f8d440cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:51.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2163160124 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d44160ff0 con 0x7f8d440d39b0 2024-05-10T08:46:51.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.972+0000 7f8d3bfff640 1 --2- 172.21.15.37:0/2163160124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440d39b0 0x7f8d4415e180 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009870 tx=0x7f8d2c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc2f243dc554106 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d4259c640 1 -- 172.21.15.37:0/2163160124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c037070 con 0x7f8d440d39b0 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d4259c640 1 -- 172.21.15.37:0/2163160124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c032440 con 0x7f8d440d39b0 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d4259c640 1 -- 172.21.15.37:0/2163160124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c032810 con 0x7f8d440d39b0 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 -- 172.21.15.37:0/2163160124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440d39b0 msgr2=0x7f8d4415e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 --2- 172.21.15.37:0/2163160124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440d39b0 0x7f8d4415e180 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009870 tx=0x7f8d2c02a210 comp rx=0 tx=0).stop 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 -- 172.21.15.37:0/2163160124 shutdown_connections 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 --2- 172.21.15.37:0/2163160124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440cd9a0 0x7f8d440cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 --2- 172.21.15.37:0/2163160124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440d39b0 0x7f8d4415e180 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 -- 172.21.15.37:0/2163160124 >> 172.21.15.37:0/2163160124 conn(0x7f8d440d2e90 msgr2=0x7f8d440d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 -- 172.21.15.37:0/2163160124 shutdown_connections 2024-05-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.973+0000 7f8d49209640 1 -- 172.21.15.37:0/2163160124 wait complete. 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 Processor -- start 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 -- start start 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d440cd9a0 0x7f8d440b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440cf8a0 0x7f8d440b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440d39b0 0x7f8d440b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441615b0 con 0x7f8d440cf8a0 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440d0700 con 0x7f8d440cd9a0 2024-05-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.975+0000 7f8d49209640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8d440ce370 con 0x7f8d440d39b0 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440cf8a0 0x7f8d440b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440cf8a0 0x7f8d440b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50034/0 (socket says 172.21.15.37:50034) 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2025629808 learned_addr learned my addr 172.21.15.37:0/2025629808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d42d9d640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d440cd9a0 0x7f8d440b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d4359e640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440d39b0 0x7f8d440b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440d39b0 msgr2=0x7f8d440b7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440d39b0 0x7f8d440b7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d440cd9a0 msgr2=0x7f8d440b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d440cd9a0 0x7f8d440b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 -- 172.21.15.37:0/2025629808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d440b31d0 con 0x7f8d440cf8a0 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d4359e640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440d39b0 0x7f8d440b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d42d9d640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d440cd9a0 0x7f8d440b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3bfff640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440cf8a0 0x7f8d440b4fe0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0090b0 tx=0x7f8d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3b7fe640 1 -- 172.21.15.37:0/2025629808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c041020 con 0x7f8d440cf8a0 2024-05-10T08:46:51.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3b7fe640 1 -- 172.21.15.37:0/2025629808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c030990 con 0x7f8d440cf8a0 2024-05-10T08:46:51.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d3b7fe640 1 -- 172.21.15.37:0/2025629808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c037040 con 0x7f8d440cf8a0 2024-05-10T08:46:51.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d440b34b0 con 0x7f8d440cf8a0 2024-05-10T08:46:51.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.976+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d440b3a70 con 0x7f8d440cf8a0 2024-05-10T08:46:51.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.977+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d4415fe00 con 0x7f8d440cf8a0 2024-05-10T08:46:51.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.978+0000 7f8d3b7fe640 1 -- 172.21.15.37:0/2025629808 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d2c044020 con 0x7f8d440cf8a0 2024-05-10T08:46:51.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.978+0000 7f8d3b7fe640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d240762d0 0x7f8d24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:51.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.979+0000 7f8d3b7fe640 1 -- 172.21.15.37:0/2025629808 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f8d2c0b8350 con 0x7f8d440cf8a0 2024-05-10T08:46:51.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.979+0000 7f8d42d9d640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d240762d0 0x7f8d24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:51.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.979+0000 7f8d42d9d640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d240762d0 0x7f8d24078790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001750 tx=0x7f8d34009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:51.984+0000 7f8d3b7fe640 1 -- 172.21.15.37:0/2025629808 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8d4415fe00 con 0x7f8d440cf8a0 2024-05-10T08:46:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.190+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8d440cf680 con 0x7f8d440cf8a0 2024-05-10T08:46:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.190+0000 7f8d3b7fe640 1 -- 172.21.15.37:0/2025629808 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) ==== 80+0+118 (secure 0 0 0) 0x7f8d2c04b030 con 0x7f8d440cf8a0 2024-05-10T08:46:52.189 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6834/54798262 2024-05-11T08:45:43.002523+0000 2024-05-10T08:46:52.190 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6832/54798262 2024-05-11T08:45:43.002523+0000 2024-05-10T08:46:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:listed 2 entries 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d240762d0 msgr2=0x7f8d24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d240762d0 0x7f8d24078790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001750 tx=0x7f8d34009040 comp rx=0 tx=0).stop 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440cf8a0 msgr2=0x7f8d440b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440cf8a0 0x7f8d440b4fe0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0090b0 tx=0x7f8d2c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 shutdown_connections 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8d240762d0 0x7f8d24078790 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8d440d39b0 0x7f8d440b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d440cf8a0 0x7f8d440b4fe0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 --2- 172.21.15.37:0/2025629808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d440cd9a0 0x7f8d440b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 >> 172.21.15.37:0/2025629808 conn(0x7f8d440d2e90 msgr2=0x7f8d440afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 shutdown_connections 2024-05-10T08:46:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.193+0000 7f8d49209640 1 -- 172.21.15.37:0/2025629808 wait complete. 2024-05-10T08:46:52.202 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:46:52.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:52.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:46:52.232 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:46:52.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:52.232 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:46:52.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:46:52.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.435+0000 7f9a724f8640 1 Processor -- start 2024-05-10T08:46:52.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.435+0000 7f9a724f8640 1 -- start start 2024-05-10T08:46:52.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a724f8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a6c0cf8a0 0x7f9a6c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a724f8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a724f8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c0d01c0 con 0x7f9a6c0d0f10 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a724f8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6c15d5f0 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a724f8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6c161920 con 0x7f9a6c0d39b0 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a6bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a6c0cf8a0 0x7f9a6c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a6b7fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a6bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a6c0cf8a0 0x7f9a6c15e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55014/0 (socket says 172.21.15.37:55014) 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a70a95640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9a6c0d0f10 0x7f9a6c0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:50874/0 (socket says 172.21.15.37:50874) 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a6b7fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:60126/0 (socket says 172.21.15.37:60126) 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.436+0000 7f9a6bfff640 1 -- 172.21.15.37:0/1662206848 learned_addr learned my addr 172.21.15.37:0/1662206848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.437+0000 7f9a6bfff640 1 -- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 msgr2=0x7f9a6c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:52.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.437+0000 7f9a6bfff640 1 --2- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.437+0000 7f9a6bfff640 1 -- 172.21.15.37:0/1662206848 >> v1:172.21.15.82:6789/0 conn(0x7f9a6c0d0f10 legacy=0x7f9a6c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.437+0000 7f9a6bfff640 1 -- 172.21.15.37:0/1662206848 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c160d10 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.437+0000 7f9a6b7fe640 1 --2- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a6bfff640 1 --2- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c15e180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0098a0 tx=0x7f9a5c02a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f0ee5bd99dfc97 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a6affd640 1 -- 172.21.15.37:0/1662206848 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c037070 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a6affd640 1 -- 172.21.15.37:0/1662206848 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c032440 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a6affd640 1 -- 172.21.15.37:0/1662206848 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c032810 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 -- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf8a0 msgr2=0x7f9a6c15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 --2- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c15e180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0098a0 tx=0x7f9a5c02a290 comp rx=0 tx=0).stop 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 -- 172.21.15.37:0/1662206848 shutdown_connections 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 --2- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 --2- 172.21.15.37:0/1662206848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c15e180 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 -- 172.21.15.37:0/1662206848 >> 172.21.15.37:0/1662206848 conn(0x7f9a6c0d2e90 msgr2=0x7f9a6c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 -- 172.21.15.37:0/1662206848 shutdown_connections 2024-05-10T08:46:52.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.438+0000 7f9a724f8640 1 -- 172.21.15.37:0/1662206848 wait complete. 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.439+0000 7f9a724f8640 1 Processor -- start 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.440+0000 7f9a724f8640 1 -- start start 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.440+0000 7f9a724f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.440+0000 7f9a724f8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0f10 0x7f9a6c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.440+0000 7f9a724f8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a724f8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c1612d0 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a724f8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c0d0700 con 0x7f9a6c0d0f10 2024-05-10T08:46:52.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a724f8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6c1615b0 con 0x7f9a6c0d39b0 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50042/0 (socket says 172.21.15.37:50042) 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 -- 172.21.15.37:0/246877812 learned_addr learned my addr 172.21.15.37:0/246877812 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6b7fe640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0f10 0x7f9a6c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a70a95640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 -- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 msgr2=0x7f9a6c0b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 -- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0f10 msgr2=0x7f9a6c0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0f10 0x7f9a6c0ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 -- 172.21.15.37:0/246877812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c0cb850 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6b7fe640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0f10 0x7f9a6c0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a6bfff640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c153550 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c000c00 tx=0x7f9a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a68ff9640 1 -- 172.21.15.37:0/246877812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c041070 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a68ff9640 1 -- 172.21.15.37:0/246877812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c03c870 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a68ff9640 1 -- 172.21.15.37:0/246877812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c037040 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.441+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6c0cad10 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.442+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6c0cb290 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.442+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6c0693f0 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.443+0000 7f9a68ff9640 1 -- 172.21.15.37:0/246877812 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a5c044070 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.443+0000 7f9a68ff9640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9a58076300 0x7f9a580787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.444+0000 7f9a68ff9640 1 -- 172.21.15.37:0/246877812 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f9a5c0b8030 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.444+0000 7f9a6b7fe640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9a58076300 0x7f9a580787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.444+0000 7f9a6b7fe640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9a58076300 0x7f9a580787c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0ca780 tx=0x7f9a60009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:52.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.448+0000 7f9a68ff9640 1 -- 172.21.15.37:0/246877812 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9a5c081180 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.676+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a6c069d00 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.676+0000 7f9a68ff9640 1 -- 172.21.15.37:0/246877812 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5178 (secure 0 0 0) 0x7f9a5c085480 con 0x7f9a6c0cf8a0 2024-05-10T08:46:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:52.675 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:45:53.743846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":6,"addr":"172.21.15.37:6834/375241165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":375241165},{"type":"v1","addr":"172.21.15.37:6834","nonce":375241165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6870,"qdb_cluster":[6870]},"id":6}]} 2024-05-10T08:46:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 67 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9a58076300 msgr2=0x7f9a580787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9a58076300 0x7f9a580787c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0ca780 tx=0x7f9a60009190 comp rx=0 tx=0).stop 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a6c0cf8a0 msgr2=0x7f9a6c153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c153550 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c000c00 tx=0x7f9a5c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 shutdown_connections 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9a58076300 0x7f9a580787c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a6c0d39b0 0x7f9a6c0b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0f10 0x7f9a6c0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.678+0000 7f9a724f8640 1 --2- 172.21.15.37:0/246877812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a6c0cf8a0 0x7f9a6c153550 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.679+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 >> 172.21.15.37:0/246877812 conn(0x7f9a6c0d2e90 msgr2=0x7f9a6c15dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.679+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 shutdown_connections 2024-05-10T08:46:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.679+0000 7f9a724f8640 1 -- 172.21.15.37:0/246877812 wait complete. 2024-05-10T08:46:52.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T08:46:52.823 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2024-05-10T08:46:52.823 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:46:52.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:46:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.931+0000 7ff85c52b640 1 Processor -- start 2024-05-10T08:46:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.931+0000 7ff85c52b640 1 -- start start 2024-05-10T08:46:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.932+0000 7ff85c52b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8540d20c0 0x7ff854163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.932+0000 7ff85c52b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.932+0000 7ff85c52b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8540d1300 con 0x7ff854070d30 2024-05-10T08:46:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.932+0000 7ff85c52b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff8540d10d0 con 0x7ff8540d20c0 2024-05-10T08:46:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.932+0000 7ff85c52b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff854070b80 con 0x7ff854071110 2024-05-10T08:46:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.932+0000 7ff85aac8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff859ac6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8540d20c0 0x7ff854163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff85a2c7640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff854070d30 0x7ff8540703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:50880/0 (socket says 172.21.15.37:50880) 2024-05-10T08:46:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff85a2c7640 1 -- 172.21.15.37:0/1447804344 learned_addr learned my addr 172.21.15.37:0/1447804344 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:46:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff859ac6640 1 -- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 msgr2=0x7ff85406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff859ac6640 1 --2- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff859ac6640 1 -- 172.21.15.37:0/1447804344 >> v1:172.21.15.82:6789/0 conn(0x7ff854070d30 legacy=0x7ff8540703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff859ac6640 1 -- 172.21.15.37:0/1447804344 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8540d15e0 con 0x7ff8540d20c0 2024-05-10T08:46:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff8592c5640 1 -- 172.21.15.37:0/1447804344 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542059489 0 0) 0x7ff8540d1300 con 0x7ff854070d30 2024-05-10T08:46:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.933+0000 7ff85aac8640 1 --2- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff859ac6640 1 --2- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 0x7ff854163920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff84802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ad9a517226729ad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff8592c5640 1 -- 172.21.15.37:0/1447804344 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848037070 con 0x7ff8540d20c0 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff8592c5640 1 -- 172.21.15.37:0/1447804344 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff848032440 con 0x7ff8540d20c0 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff8592c5640 1 -- 172.21.15.37:0/1447804344 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848032810 con 0x7ff8540d20c0 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff85c52b640 1 -- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 msgr2=0x7ff854163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff85c52b640 1 --2- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 0x7ff854163920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff84802a180 comp rx=0 tx=0).stop 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff85c52b640 1 -- 172.21.15.37:0/1447804344 shutdown_connections 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff85c52b640 1 --2- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff85c52b640 1 --2- 172.21.15.37:0/1447804344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 0x7ff854163920 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.934+0000 7ff85c52b640 1 -- 172.21.15.37:0/1447804344 >> 172.21.15.37:0/1447804344 conn(0x7ff8540d2e90 msgr2=0x7ff8540d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.935+0000 7ff85c52b640 1 -- 172.21.15.37:0/1447804344 shutdown_connections 2024-05-10T08:46:52.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.935+0000 7ff85c52b640 1 -- 172.21.15.37:0/1447804344 wait complete. 2024-05-10T08:46:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 Processor -- start 2024-05-10T08:46:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 -- start start 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854070d30 0x7ff8540cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 0x7ff85415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff854071560 con 0x7ff854070d30 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540d1c30 con 0x7ff8540d20c0 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.936+0000 7ff85c52b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff8540716e0 con 0x7ff854071110 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854070d30 0x7ff8540cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854070d30 0x7ff8540cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50046/0 (socket says 172.21.15.37:50046) 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 -- 172.21.15.37:0/3596410964 learned_addr learned my addr 172.21.15.37:0/3596410964 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff859ac6640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85aac8640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 0x7ff85415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 -- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 msgr2=0x7ff85415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 -- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 msgr2=0x7ff85415a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 0x7ff85415a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 -- 172.21.15.37:0/3596410964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8540ca280 con 0x7ff854070d30 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85a2c7640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854070d30 0x7ff8540cc9b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c430 tx=0x7ff84c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff852ffd640 1 -- 172.21.15.37:0/3596410964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0074e0 con 0x7ff854070d30 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff852ffd640 1 -- 172.21.15.37:0/3596410964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c0047e0 con 0x7ff854070d30 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8540c7500 con 0x7ff854070d30 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff852ffd640 1 -- 172.21.15.37:0/3596410964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c004bd0 con 0x7ff854070d30 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.937+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8540c7ac0 con 0x7ff854070d30 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.938+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff854157d50 con 0x7ff854070d30 2024-05-10T08:46:52.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.939+0000 7ff852ffd640 1 -- 172.21.15.37:0/3596410964 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff84c011070 con 0x7ff854070d30 2024-05-10T08:46:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.939+0000 7ff852ffd640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff8400762d0 0x7ff840078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.940+0000 7ff852ffd640 1 -- 172.21.15.37:0/3596410964 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7ff84c097480 con 0x7ff854070d30 2024-05-10T08:46:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.940+0000 7ff859ac6640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff8400762d0 0x7ff840078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.940+0000 7ff859ac6640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff8400762d0 0x7ff840078790 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff848034000 tx=0x7ff84802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:52.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:52.944+0000 7ff852ffd640 1 -- 172.21.15.37:0/3596410964 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff854157d50 con 0x7ff854070d30 2024-05-10T08:46:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.173+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff8540693f0 con 0x7ff854070d30 2024-05-10T08:46:53.171 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:46:53.174+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:46:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.175+0000 7ff852ffd640 1 -- 172.21.15.37:0/3596410964 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) ==== 161+0+0 (secure 0 0 0) 0x7ff84c060b90 con 0x7ff854070d30 2024-05-10T08:46:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:46:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff8400762d0 msgr2=0x7ff840078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff8400762d0 0x7ff840078790 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff848034000 tx=0x7ff84802e000 comp rx=0 tx=0).stop 2024-05-10T08:46:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854070d30 msgr2=0x7ff8540cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854070d30 0x7ff8540cc9b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c430 tx=0x7ff84c00c8f0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 shutdown_connections 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff8400762d0 0x7ff840078790 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8540d20c0 0x7ff85415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff854071110 0x7ff85415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 --2- 172.21.15.37:0/3596410964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854070d30 0x7ff8540cc9b0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 >> 172.21.15.37:0/3596410964 conn(0x7ff8540d2e90 msgr2=0x7ff854157640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 shutdown_connections 2024-05-10T08:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.177+0000 7ff85c52b640 1 -- 172.21.15.37:0/3596410964 wait complete. 2024-05-10T08:46:53.178 INFO:tasks.ceph.mds.c.smithi037.stderr: -4577> 2024-05-10T08:45:48.740+0000 7f90ab587640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:46:53.179 INFO:tasks.ceph.mds.c.smithi037.stderr: -4190> 2024-05-10T08:45:49.329+0000 7f90a757f640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-05-10T08:46:53.179 INFO:tasks.ceph.mds.c.smithi037.stderr: -4024> 2024-05-10T08:45:49.519+0000 7f90a757f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0) n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5592b8fefb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-05-10T08:46:53.181 INFO:tasks.ceph.mds.c.smithi037.stderr: -2162> 2024-05-10T08:46:20.892+0000 7f90a757f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0)->f(v1 m2024-05-10T08:45:41.308980+0000) n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1)->n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5592b8fefb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-05-10T08:45:41.308980+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T08:45:41.426979+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-05-10T08:46:53.190 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-05-10T08:46:53.210 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:46:53.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.234+0000 7f90c4927740 1 -- start start 2024-05-10T08:46:53.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.234+0000 7f90c4927740 1 Processor -- start 2024-05-10T08:46:53.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c4927740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd6336ec00 0x55bd6414c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c4927740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd6336f800 0x55bd6414c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c4927740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd6336fc00 0x55bd6414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c4927740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bd64164600 con 0x55bd6336fc00 2024-05-10T08:46:53.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c4927740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd64164480 con 0x55bd6336ec00 2024-05-10T08:46:53.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c4927740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55bd64164300 con 0x55bd6336f800 2024-05-10T08:46:53.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c2fbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd6336fc00 0x55bd6414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c2fbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd6336fc00 0x55bd6414cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50052/0 (socket says 172.21.15.37:50052) 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c2fbb640 1 -- 172.21.15.37:0/619268697 learned_addr learned my addr 172.21.15.37:0/619268697 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd6336f800 0x55bd6414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c27ba640 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd6336ec00 0x55bd6414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.235+0000 7f90c2fbb640 1 -- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd6336f800 msgr2=0x55bd6414c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd6336f800 0x55bd6414c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c2fbb640 1 -- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd6336ec00 msgr2=0x55bd6414c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd6336ec00 0x55bd6414c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c2fbb640 1 -- 172.21.15.37:0/619268697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd6339b680 con 0x55bd6336fc00 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd6336fc00 0x55bd6414cb00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x55bd641a3c80 tx=0x55bd6343ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f20f9d93f77ddc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90bffb5640 1 -- 172.21.15.37:0/619268697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bd63394680 con 0x55bd6336fc00 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90bffb5640 1 -- 172.21.15.37:0/619268697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55bd633b6c40 con 0x55bd6336fc00 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90bffb5640 1 -- 172.21.15.37:0/619268697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bd633949c0 con 0x55bd6336fc00 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c4927740 1 -- 172.21.15.37:0/619268697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd6339b4a0 con 0x55bd6336fc00 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c4927740 1 -- 172.21.15.37:0/619268697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55bd6339a3c0 con 0x55bd6336fc00 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c4927740 4 waiting for MDS map... 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90bffb5640 1 -- 172.21.15.37:0/619268697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x55bd6424ea00 con 0x55bd6336fc00 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90bffb5640 1 -- 172.21.15.37:0/619268697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 68) ==== 2885+0+0 (secure 0 0 0) 0x55bd633c7180 con 0x55bd6336fc00 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c4927740 4 Got MDS map 68 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c4927740 4 datascan.main: Using metadata pool output 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.236+0000 7f90c4927740 4 datascan.main: connecting to RADOS... 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 Processor -- start 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 -- start start 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 0x55bd6414db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bd64164180 con 0x55bd64251800 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd633ce480 con 0x55bd64251400 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.237+0000 7f90c4927740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55bd633ce900 con 0x55bd64251c00 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50068/0 (socket says 172.21.15.37:50068) 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 -- 172.21.15.37:0/1071839632 learned_addr learned my addr 172.21.15.37:0/1071839632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 0x55bd6414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 -- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 msgr2=0x55bd6414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 0x55bd6414db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 -- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251400 msgr2=0x55bd6414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 -- 172.21.15.37:0/1071839632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd6339ba40 con 0x55bd64251800 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90c27ba640 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251800 0x55bd6414d600 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x55bd6426ef00 tx=0x55bd642738c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f600d321885be78 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90bdfb1640 1 -- 172.21.15.37:0/1071839632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bd63394680 con 0x55bd64251800 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90bdfb1640 1 -- 172.21.15.37:0/1071839632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55bd633b6a80 con 0x55bd64251800 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.238+0000 7f90bdfb1640 1 -- 172.21.15.37:0/1071839632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bd633949c0 con 0x55bd64251800 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 -- 172.21.15.37:0/1071839632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251800 msgr2=0x55bd6414d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251800 0x55bd6414d600 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x55bd6426ef00 tx=0x55bd642738c0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 -- 172.21.15.37:0/1071839632 shutdown_connections 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 0x55bd6414db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 --2- 172.21.15.37:0/1071839632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 -- 172.21.15.37:0/1071839632 >> 172.21.15.37:0/1071839632 conn(0x55bd64251000 msgr2=0x55bd640ea800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 -- 172.21.15.37:0/1071839632 shutdown_connections 2024-05-10T08:46:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 -- 172.21.15.37:0/1071839632 wait complete. 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 Processor -- start 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.239+0000 7f90c4927740 1 -- start start 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c4927740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c4927740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c4927740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 0x55bd6414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c4927740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bd64165380 con 0x55bd64251400 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c4927740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd64164180 con 0x55bd64251800 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c4927740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55bd64165500 con 0x55bd64251c00 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251400 0x55bd6414d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50084/0 (socket says 172.21.15.37:50084) 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 learned_addr learned my addr 172.21.15.37:0/2506343848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 0x55bd6414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 msgr2=0x55bd6414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd64251c00 0x55bd6414db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251800 msgr2=0x55bd6414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd6339b680 con 0x55bd64251400 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd64251800 0x55bd6414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251400 0x55bd6414d080 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x55bd6426fc50 tx=0x55bd64114660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90bc7ae640 1 -- 172.21.15.37:0/2506343848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bd63394680 con 0x55bd64251400 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.240+0000 7f90bc7ae640 1 -- 172.21.15.37:0/2506343848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55bd633b7500 con 0x55bd64251400 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.241+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd6339b4a0 con 0x55bd64251400 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.241+0000 7f90bc7ae640 1 -- 172.21.15.37:0/2506343848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bd633949c0 con 0x55bd64251400 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.241+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd6339a3c0 con 0x55bd64251400 2024-05-10T08:46:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.241+0000 7f90c4927740 4 datascan.init: resolving metadata pool 13 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90bc7ae640 1 -- 172.21.15.37:0/2506343848 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55bd642d6c00 con 0x55bd64251400 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90bc7ae640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55bd642d2c00 0x55bd6414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90bc7ae640 1 -- 172.21.15.37:0/2506343848 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x55bd642d4a00 con 0x55bd64251400 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90c4927740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90c4927740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90c4927740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55bd642d3000 0x55bd6414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55bd642d2c00 0x55bd6414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.242+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3400 con 0x55bd642d3000 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.243+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55bd642d3000 0x55bd6414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.243+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55bd642d3000 0x55bd6414e680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.243+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55bd642d2c00 0x55bd6414e100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55bd6426ef00 tx=0x55bd64273800 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.243+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd642d3000 2024-05-10T08:46:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.243+0000 7f90bd7b0640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55bd63726000 0x55bd6372c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.243+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:2 14.20 14:04000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63726400 con 0x55bd63726000 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.243+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55bd63726000 0x55bd6372c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.244+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55bd63726000 0x55bd6372c000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.246+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.246+0000 7f90bdfb1640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55bd63726c00 0x55bd6372c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.246+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:3 14.10 14:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727000 con 0x55bd63726c00 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.246+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55bd63726c00 0x55bd6372c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.246+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55bd63726c00 0x55bd6372c580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.248+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.248+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:4 14.30 14:0c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63726800 con 0x55bd63726000 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.249+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.249+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:5 14.8 14:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727400 con 0x55bd63726000 2024-05-10T08:46:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.249+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 3 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.249+0000 7f90bd7b0640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55bd63727800 0x55bd6372cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.249+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:6 14.28 14:14000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727c00 con 0x55bd63727800 2024-05-10T08:46:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.249+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55bd63727800 0x55bd6372cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.249+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55bd63727800 0x55bd6372cb00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.251+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== osd_op_reply(6 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd63727800 2024-05-10T08:46:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.252+0000 7f90bdfb1640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55bd6373c000 0x55bd6372d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.252+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:7 14.18 14:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373c400 con 0x55bd6373c000 2024-05-10T08:46:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.252+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55bd6373c000 0x55bd6372d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.252+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55bd6373c000 0x55bd6372d600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.253+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373c000 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.253+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:8 14.38 14:1c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63726400 con 0x55bd63726c00 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.253+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== osd_op_reply(8 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.253+0000 7f90bdfb1640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55bd6373c800 0x55bd6372db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.253+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:9 14.4 14:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373c400 con 0x55bd6373c800 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.253+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55bd6373c800 0x55bd6372db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.254+0000 7f90c27ba640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55bd6373c800 0x55bd6372db80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.256+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd6373c800 2024-05-10T08:46:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.256+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:10 14.24 14:24000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63726800 con 0x55bd63726c00 2024-05-10T08:46:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.257+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 3 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.257+0000 7f90bdfb1640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55bd6373cc00 0x55bd6372e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.257+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:11 14.14 14:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373d000 con 0x55bd6373cc00 2024-05-10T08:46:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.257+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55bd6373cc00 0x55bd6372e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.257+0000 7f90c1fb9640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55bd6373cc00 0x55bd6372e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.258+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(11 [pgnls start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.258+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:12 14.34 14:2c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727400 con 0x55bd642d3000 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.258+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd642d3000 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.258+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:13 14.c 14:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373d400 con 0x55bd63726000 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.258+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 4 ==== osd_op_reply(13 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.258+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:14 14.2c 14:34000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd64250800 con 0x55bd63726c00 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.259+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 4 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.259+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:15 14.1c 14:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727c00 con 0x55bd63726000 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.259+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 5 ==== osd_op_reply(15 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.259+0000 7f90bd7b0640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55bd6373d000 0x55bd6372d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.259+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:16 14.3c 14:3c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373c400 con 0x55bd6373d000 2024-05-10T08:46:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.259+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55bd6373d000 0x55bd6372d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.259+0000 7f90c2fbb640 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55bd6373d000 0x55bd6372d080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.262+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.262+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:17 14.2 14:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727400 con 0x55bd6373c800 2024-05-10T08:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.262+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd6373c800 2024-05-10T08:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.262+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:18 14.22 14:44000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373d800 con 0x55bd6373cc00 2024-05-10T08:46:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.263+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.263+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:19 14.12 14:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3400 con 0x55bd642d3000 2024-05-10T08:46:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.263+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.2 v2:172.21.15.37:6808/2438867251 3 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd642d3000 2024-05-10T08:46:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.263+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:20 14.32 14:4c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727000 con 0x55bd6373cc00 2024-05-10T08:46:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.263+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 3 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.263+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:21 14.a 14:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d2800 con 0x55bd6373d000 2024-05-10T08:46:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.264+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.264+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:22 14.2a 14:54000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63726400 con 0x55bd6373cc00 2024-05-10T08:46:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.264+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 4 ==== osd_op_reply(22 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.264+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:23 14.1a 14:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd64167400 con 0x55bd63726000 2024-05-10T08:46:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.264+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 6 ==== osd_op_reply(23 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.264+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:24 14.3a 14:5c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373dc00 con 0x55bd63726000 2024-05-10T08:46:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.265+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 7 ==== osd_op_reply(24 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.265+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:25 14.6 14:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373d400 con 0x55bd63726000 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.265+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 8 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.265+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:26 14.26 14:64000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754000 con 0x55bd6373cc00 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.265+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 5 ==== osd_op_reply(26 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.265+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:27 14.16 14:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373c400 con 0x55bd63727800 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.266+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== osd_op_reply(27 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd63727800 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.266+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:28 14.36 14:6c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754400 con 0x55bd642d3000 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.266+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.2 v2:172.21.15.37:6808/2438867251 4 ==== osd_op_reply(28 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd642d3000 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.266+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:29 14.e 14:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373dc00 con 0x55bd6373cc00 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.266+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 6 ==== osd_op_reply(29 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.266+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:30 14.2e 14:74000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754800 con 0x55bd63727800 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.267+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.3 v2:172.21.15.37:6824/1264356154 3 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd63727800 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.267+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:31 14.1e 14:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd64167400 con 0x55bd6373c000 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.267+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== osd_op_reply(31 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373c000 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.267+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:32 14.3e 14:7c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754c00 con 0x55bd6373d000 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.267+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 3 ==== osd_op_reply(32 [pgnls start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.267+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:33 14.1 14:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d2800 con 0x55bd63727800 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.268+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.3 v2:172.21.15.37:6824/1264356154 4 ==== osd_op_reply(33 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd63727800 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.268+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:34 14.21 14:84000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755000 con 0x55bd6373d000 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.268+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 4 ==== osd_op_reply(34 [pgnls start_epoch 91 out=49b] v87'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.268+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:35 14.11 14:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727c00 con 0x55bd6373cc00 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.268+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 7 ==== osd_op_reply(35 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.268+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:36 14.31 14:8c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755400 con 0x55bd63726c00 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.269+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 5 ==== osd_op_reply(36 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.269+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:37 14.9 14:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754000 con 0x55bd6373d000 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.269+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 5 ==== osd_op_reply(37 [pgnls start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.269+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:38 14.29 14:94000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755800 con 0x55bd6373c800 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.270+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(38 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd6373c800 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.270+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:39 14.19 14:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755c00 con 0x55bd6373c800 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.270+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.6 v2:172.21.15.82:6824/3522580642 4 ==== osd_op_reply(39 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd6373c800 2024-05-10T08:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.270+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:40 14.39 14:9c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755400 con 0x55bd6373c000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.270+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.7 v2:172.21.15.82:6816/1827186019 3 ==== osd_op_reply(40 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373c000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.270+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:41 14.5 14:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373d800 con 0x55bd63726000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.271+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 9 ==== osd_op_reply(41 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.271+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:42 14.25 14:a4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755800 con 0x55bd642d3000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.271+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.2 v2:172.21.15.37:6808/2438867251 5 ==== osd_op_reply(42 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd642d3000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.271+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:43 14.15 14:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373c400 con 0x55bd6373c000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.271+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.7 v2:172.21.15.82:6816/1827186019 4 ==== osd_op_reply(43 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373c000 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.271+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:44 14.35 14:ac000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63726800 con 0x55bd6373cc00 2024-05-10T08:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.272+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 8 ==== osd_op_reply(44 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.272+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:45 14.d 14:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727000 con 0x55bd6373c800 2024-05-10T08:46:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.272+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.6 v2:172.21.15.82:6824/3522580642 5 ==== osd_op_reply(45 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd6373c800 2024-05-10T08:46:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.272+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:46 14.2d 14:b4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727400 con 0x55bd6373cc00 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.272+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 9 ==== osd_op_reply(46 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.273+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:47 14.1d 14:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63726400 con 0x55bd63726000 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.273+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 10 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.273+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:48 14.3d 14:bc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd64250800 con 0x55bd63727800 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.273+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.3 v2:172.21.15.37:6824/1264356154 5 ==== osd_op_reply(48 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd63727800 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.273+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:49 14.3 14:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3400 con 0x55bd63726000 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.273+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 11 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.273+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:50 14.23 14:c4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754400 con 0x55bd6373c000 2024-05-10T08:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.274+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.7 v2:172.21.15.82:6816/1827186019 5 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373c000 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.274+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:51 14.13 14:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373dc00 con 0x55bd642d3000 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.274+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.2 v2:172.21.15.37:6808/2438867251 6 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd642d3000 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.274+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:52 14.33 14:cc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754800 con 0x55bd63726c00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.274+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 6 ==== osd_op_reply(52 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.274+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:53 14.b 14:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373d400 con 0x55bd63726000 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.275+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 12 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.275+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:54 14.2b 14:d4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755800 con 0x55bd6373cc00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.275+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 10 ==== osd_op_reply(54 [pgnls start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.275+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:55 14.1b 14:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd6373d800 con 0x55bd63726c00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.275+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 7 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.275+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:56 14.3b 14:dc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754c00 con 0x55bd6373cc00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.276+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 11 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.276+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:57 14.7 14:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63754000 con 0x55bd6373d000 2024-05-10T08:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.276+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 6 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v87'6 uv6 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.276+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:58 14.7 14:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3800 con 0x55bd6373d000 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.276+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 7 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.276+0000 7f90c4927740 10 datascan.operator(): handling object 1099511627777.0 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.276+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:59 14.7 14:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3c00 con 0x55bd6373d000 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.278+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 8 ==== osd_op_reply(59 10000000001.00000000 [call] v91'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.278+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:60 14.27 14:e4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3400 con 0x55bd6373d000 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.278+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.5 v2:172.21.15.82:6800/3184821053 9 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373d000 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.278+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:61 14.17 14:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755400 con 0x55bd63726c00 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.279+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 <== osd.1 v2:172.21.15.37:6800/1334168884 8 ==== osd_op_reply(61 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100780 con 0x55bd63726c00 2024-05-10T08:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.279+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:62 14.37 14:ec000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63755000 con 0x55bd6373cc00 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.279+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.4 v2:172.21.15.82:6808/3594167095 12 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd6373cc00 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.279+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:63 14.f 14:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3800 con 0x55bd6373c000 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.7 v2:172.21.15.82:6816/1827186019 6 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd6373c000 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:64 14.2f 14:f4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd64167400 con 0x55bd63726000 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 13 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90bdfb1640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:65 14.1f 14:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd642d3c00 con 0x55bd63726000 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c2fbb640 1 -- 172.21.15.37:0/2506343848 <== osd.0 v2:172.21.15.37:6811/38998236 14 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100500 con 0x55bd63726000 2024-05-10T08:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90bd7b0640 1 -- 172.21.15.37:0/2506343848 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:66 14.3f 14:fc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55bd63727c00 con 0x55bd63727800 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c1fb9640 1 -- 172.21.15.37:0/2506343848 <== osd.3 v2:172.21.15.37:6824/1264356154 6 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55bd64100000 con 0x55bd63727800 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55bd63726000 msgr2=0x55bd6372c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55bd63726000 0x55bd6372c000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55bd63726c00 msgr2=0x55bd6372c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55bd63726c00 0x55bd6372c580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55bd642d3000 msgr2=0x55bd6414e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55bd642d3000 0x55bd6414e680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55bd63727800 msgr2=0x55bd6372cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55bd63727800 0x55bd6372cb00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55bd6373cc00 msgr2=0x55bd6372e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55bd6373cc00 0x55bd6372e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55bd6373d000 msgr2=0x55bd6372d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55bd6373d000 0x55bd6372d080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55bd6373c800 msgr2=0x55bd6372db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55bd6373c800 0x55bd6372db80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55bd6373c000 msgr2=0x55bd6372d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.280+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55bd6373c000 0x55bd6372d600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55bd642d2c00 msgr2=0x55bd6414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55bd642d2c00 0x55bd6414e100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55bd6426ef00 tx=0x55bd64273800 comp rx=0 tx=0).stop 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251400 msgr2=0x55bd6414d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 --2- 172.21.15.37:0/2506343848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd64251400 0x55bd6414d080 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x55bd6426fc50 tx=0x55bd64114660 comp rx=0 tx=0).stop 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 reap_dead start 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 reap_dead start 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 reap_dead start 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 reap_dead start 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 shutdown_connections 2024-05-10T08:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 >> 172.21.15.37:0/2506343848 conn(0x55bd64251000 msgr2=0x55bd640ea800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c27ba640 1 -- 172.21.15.37:0/2506343848 reap_dead start 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 shutdown_connections 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/2506343848 wait complete. 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/619268697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd6336fc00 msgr2=0x55bd6414cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd6336fc00 0x55bd6414cb00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x55bd641a3c80 tx=0x55bd6343ea80 comp rx=0 tx=0).stop 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/619268697 shutdown_connections 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd6336fc00 0x55bd6414cb00 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55bd6336f800 0x55bd6414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 --2- 172.21.15.37:0/619268697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd6336ec00 0x55bd6414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/619268697 >> 172.21.15.37:0/619268697 conn(0x55bd6336f000 msgr2=0x55bd640eb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/619268697 shutdown_connections 2024-05-10T08:46:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.281+0000 7f90c4927740 1 -- 172.21.15.37:0/619268697 wait complete. 2024-05-10T08:46:53.284 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.094979, result: 2024-05-10T08:46:53.285 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-05-10T08:46:53.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.364+0000 7fc3feb20740 1 -- start start 2024-05-10T08:46:53.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.364+0000 7fc3feb20740 1 Processor -- start 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a6530c00 0x55d4a730a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a6531800 0x55d4a730a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a6531c00 0x55d4a730ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3feb20740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4a732a180 con 0x55d4a6530c00 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3feb20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d4a6590900 con 0x55d4a6531c00 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3feb20740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d4a6590480 con 0x55d4a6531800 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a6530c00 0x55d4a730a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a6530c00 0x55d4a730a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50092/0 (socket says 172.21.15.37:50092) 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 -- 172.21.15.37:0/575435702 learned_addr learned my addr 172.21.15.37:0/575435702 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a6531c00 0x55d4a730ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a6531800 0x55d4a730a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 -- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a6531800 msgr2=0x55d4a730a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a6531800 0x55d4a730a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 -- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a6531c00 msgr2=0x55d4a730ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a6531c00 0x55d4a730ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fca7c640 1 -- 172.21.15.37:0/575435702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a655d680 con 0x55d4a6530c00 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.365+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a6531800 0x55d4a730a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a6530c00 0x55d4a730a000 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x55d4a7369410 tx=0x55d4a72d6a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7988ce102329524 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3fa277640 1 -- 172.21.15.37:0/575435702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4a65569c0 con 0x55d4a6530c00 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3fa277640 1 -- 172.21.15.37:0/575435702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d4a65781c0 con 0x55d4a6530c00 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3fa277640 1 -- 172.21.15.37:0/575435702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4a6556680 con 0x55d4a6530c00 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3feb20740 1 -- 172.21.15.37:0/575435702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a655d860 con 0x55d4a6530c00 2024-05-10T08:46:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3feb20740 1 -- 172.21.15.37:0/575435702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d4a655d2c0 con 0x55d4a6530c00 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3feb20740 4 waiting for MDS map... 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3fa277640 1 -- 172.21.15.37:0/575435702 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x55d4a741c600 con 0x55d4a6530c00 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3fa277640 1 -- 172.21.15.37:0/575435702 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 68) ==== 2885+0+0 (secure 0 0 0) 0x55d4a6589180 con 0x55d4a6530c00 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3feb20740 4 Got MDS map 68 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3feb20740 4 datascan.main: Using metadata pool output 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.366+0000 7fc3feb20740 4 datascan.main: connecting to RADOS... 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 Processor -- start 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 -- start start 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 0x55d4a730b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4a6590180 con 0x55d4a746a800 2024-05-10T08:46:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d4a732ad80 con 0x55d4a746a000 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3feb20740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d4a732af00 con 0x55d4a746a400 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3fc27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3fc27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50096/0 (socket says 172.21.15.37:50096) 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3fc27b640 1 -- 172.21.15.37:0/979643188 learned_addr learned my addr 172.21.15.37:0/979643188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.367+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 0x55d4a730b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3fc27b640 1 -- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 msgr2=0x55d4a730b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 0x55d4a730b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3fc27b640 1 -- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 msgr2=0x55d4a730b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3fc27b640 1 -- 172.21.15.37:0/979643188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a655d4a0 con 0x55d4a746a800 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x55d4a7325380 tx=0x55d4a732f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3880e9f84d3a48b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3f8273640 1 -- 172.21.15.37:0/979643188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4a65569c0 con 0x55d4a746a800 2024-05-10T08:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3f8273640 1 -- 172.21.15.37:0/979643188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d4a6578c40 con 0x55d4a746a800 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3f8273640 1 -- 172.21.15.37:0/979643188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4a6556680 con 0x55d4a746a800 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 -- 172.21.15.37:0/979643188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 msgr2=0x55d4a730bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x55d4a7325380 tx=0x55d4a732f800 comp rx=0 tx=0).stop 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 -- 172.21.15.37:0/979643188 shutdown_connections 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 0x55d4a730b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 --2- 172.21.15.37:0/979643188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 -- 172.21.15.37:0/979643188 >> 172.21.15.37:0/979643188 conn(0x55d4a7331c00 msgr2=0x55d4a72af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 -- 172.21.15.37:0/979643188 shutdown_connections 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.368+0000 7fc3feb20740 1 -- 172.21.15.37:0/979643188 wait complete. 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.369+0000 7fc3feb20740 1 Processor -- start 2024-05-10T08:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.369+0000 7fc3feb20740 1 -- start start 2024-05-10T08:46:53.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 0x55d4a730b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4a732b200 con 0x55d4a746a800 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d4a732b080 con 0x55d4a746a000 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d4a732b380 con 0x55d4a746a400 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50106/0 (socket says 172.21.15.37:50106) 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 learned_addr learned my addr 172.21.15.37:0/4089800169 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 0x55d4a730b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 msgr2=0x55d4a730b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a746a400 0x55d4a730b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 msgr2=0x55d4a730b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a655d0e0 con 0x55d4a746a800 2024-05-10T08:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a746a000 0x55d4a730b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x55d4a748e060 tx=0x55d4a72d6a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3f6a70640 1 -- 172.21.15.37:0/4089800169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4a65564e0 con 0x55d4a746a800 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3f6a70640 1 -- 172.21.15.37:0/4089800169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d4a6578540 con 0x55d4a746a800 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4a655da40 con 0x55d4a746a800 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3f6a70640 1 -- 172.21.15.37:0/4089800169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4a65569c0 con 0x55d4a746a800 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a655c3c0 con 0x55d4a746a800 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.370+0000 7fc3feb20740 4 datascan.init: resolving metadata pool 13 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3f6a70640 1 -- 172.21.15.37:0/4089800169 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55d4a748cc00 con 0x55d4a746a800 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3f6a70640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55d4a68d6000 0x55d4a730c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3f6a70640 1 -- 172.21.15.37:0/4089800169 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x55d4a7471400 con 0x55d4a746a800 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3feb20740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3feb20740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3feb20740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T08:46:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55d4a746ac00 0x55d4a730c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55d4a746b000 con 0x55d4a746ac00 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55d4a746ac00 0x55d4a730c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.372+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55d4a68d6000 0x55d4a730c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.373+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55d4a746ac00 0x55d4a730c680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.373+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55d4a68d6000 0x55d4a730c100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55d4a72d9080 tx=0x55d4a685cf60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.373+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.373+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55d4a68d7000 0x55d4a730cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.373+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:2 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7400 con 0x55d4a68d7000 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.373+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55d4a68d7000 0x55d4a730cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.373+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55d4a68d7000 0x55d4a730cc00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.374+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.374+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55d4a68d7800 0x55d4a730d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.374+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:3 14.0 14:00000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7c00 con 0x55d4a68d7800 2024-05-10T08:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.374+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55d4a68d7800 0x55d4a730d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.374+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55d4a68d7800 0x55d4a730d180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.374+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.374+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:4 14.20 14:04000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0000 con 0x55d4a746ac00 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.375+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.375+0000 7fc3f8273640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55d4a68f0400 0x55d4a68f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.375+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:5 14.10 14:08000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0800 con 0x55d4a68f0400 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.375+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55d4a68f0400 0x55d4a68f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.375+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55d4a68f0400 0x55d4a68f6000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.375+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.375+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:6 14.30 14:0c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1000 con 0x55d4a746ac00 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.376+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 3 ==== osd_op_reply(6 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.376+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:7 14.8 14:10000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0c00 con 0x55d4a746ac00 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.376+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 4 ==== osd_op_reply(7 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.376+0000 7fc3f7a72640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55d4a68f1400 0x55d4a68f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.376+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:8 14.28 14:14000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0000 con 0x55d4a68f1400 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.376+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55d4a68f1400 0x55d4a68f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.376+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55d4a68f1400 0x55d4a68f6580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.377+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.377+0000 7fc3f8273640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55d4a68f1000 0x55d4a68f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.377+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:9 14.18 14:18000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0c00 con 0x55d4a68f1000 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.377+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55d4a68f1000 0x55d4a68f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.377+0000 7fc3fca7c640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55d4a68f1000 0x55d4a68f6b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.377+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.377+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:10 14.38 14:1c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7c00 con 0x55d4a68f0400 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:11 14.4 14:20000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1800 con 0x55d4a68d7000 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:12 14.24 14:24000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a746b000 con 0x55d4a68f0400 2024-05-10T08:46:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3f8273640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55d4a68f0000 0x55d4a68f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:13 14.14 14:28000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1800 con 0x55d4a68f0000 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.378+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55d4a68f0000 0x55d4a68f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.379+0000 7fc3fc27b640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55d4a68f0000 0x55d4a68f7080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.379+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.379+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:14 14.34 14:2c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0800 con 0x55d4a68d7800 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.379+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.379+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:15 14.c 14:30000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d6c00 con 0x55d4a746ac00 2024-05-10T08:46:53.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 5 ==== osd_op_reply(15 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:16 14.2c 14:34000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1800 con 0x55d4a68f0400 2024-05-10T08:46:53.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 4 ==== osd_op_reply(16 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:17 14.1c 14:38000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7400 con 0x55d4a746ac00 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3f7a72640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55d4a746b000 0x55d4a68f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:18 14.3c 14:3c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7c00 con 0x55d4a746b000 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.380+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55d4a746b000 0x55d4a68f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.381+0000 7fc3fd27d640 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55d4a746b000 0x55d4a68f7600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.381+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.381+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:19 14.2 14:40000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1c00 con 0x55d4a68d7000 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.381+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.381+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:20 14.22 14:44000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912000 con 0x55d4a68f0000 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:21 14.12 14:48000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913400 con 0x55d4a68d7800 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:22 14.32 14:4c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912400 con 0x55d4a68f0000 2024-05-10T08:46:53.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:23 14.a 14:50000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913800 con 0x55d4a746b000 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== osd_op_reply(23 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.382+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:24 14.2a 14:54000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912800 con 0x55d4a68f0000 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:25 14.1a 14:58000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913c00 con 0x55d4a746ac00 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:26 14.3a 14:5c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912c00 con 0x55d4a746ac00 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 8 ==== osd_op_reply(26 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:27 14.6 14:60000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913400 con 0x55d4a746ac00 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 9 ==== osd_op_reply(27 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.383+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:28 14.26 14:64000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913000 con 0x55d4a68f0000 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.384+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.384+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:29 14.16 14:68000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913c00 con 0x55d4a68f1400 2024-05-10T08:46:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.384+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.384+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:30 14.36 14:6c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912000 con 0x55d4a68d7800 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.384+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 4 ==== osd_op_reply(30 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.384+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:31 14.e 14:70000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d6c00 con 0x55d4a68f0000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.385+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.385+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:32 14.2e 14:74000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912400 con 0x55d4a68f1400 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.385+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.385+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:33 14.1e 14:78000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7400 con 0x55d4a68f1000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.385+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== osd_op_reply(33 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.385+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:34 14.3e 14:7c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912800 con 0x55d4a746b000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.385+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.386+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:35 14.1 14:80000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0c00 con 0x55d4a68f1400 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.386+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.386+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:36 14.21 14:84000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913000 con 0x55d4a746b000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.386+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 91 out=49b] v87'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.386+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:37 14.11 14:88000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0800 con 0x55d4a68f0000 2024-05-10T08:46:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.386+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.386+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:38 14.31 14:8c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1800 con 0x55d4a68f0400 2024-05-10T08:46:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.387+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 5 ==== osd_op_reply(38 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.387+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:39 14.9 14:90000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913800 con 0x55d4a746b000 2024-05-10T08:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.387+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.387+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:40 14.29 14:94000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914000 con 0x55d4a68d7000 2024-05-10T08:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.387+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.387+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:41 14.19 14:98000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6913c00 con 0x55d4a68d7000 2024-05-10T08:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:42 14.39 14:9c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914400 con 0x55d4a68f1000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 3 ==== osd_op_reply(42 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:43 14.5 14:a0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6912400 con 0x55d4a746ac00 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 10 ==== osd_op_reply(43 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:44 14.25 14:a4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914800 con 0x55d4a68d7800 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.388+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:45 14.15 14:a8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1c00 con 0x55d4a68f1000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.389+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 4 ==== osd_op_reply(45 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.389+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:46 14.35 14:ac000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914c00 con 0x55d4a68f0000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.389+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.389+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:47 14.d 14:b0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7c00 con 0x55d4a68d7000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.390+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 6 ==== osd_op_reply(47 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.390+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:48 14.2d 14:b4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915000 con 0x55d4a68f0000 2024-05-10T08:46:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.390+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.390+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:49 14.1d 14:b8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914400 con 0x55d4a746ac00 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.390+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 11 ==== osd_op_reply(49 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.390+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:50 14.3d 14:bc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915400 con 0x55d4a68f1400 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:51 14.3 14:c0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914800 con 0x55d4a746ac00 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 12 ==== osd_op_reply(51 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:52 14.23 14:c4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915800 con 0x55d4a68f1000 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 5 ==== osd_op_reply(52 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:53 14.13 14:c8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914000 con 0x55d4a68d7800 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 6 ==== osd_op_reply(53 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.391+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:54 14.33 14:cc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916000 con 0x55d4a68f0400 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.392+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 6 ==== osd_op_reply(54 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.392+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:55 14.b 14:d0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915c00 con 0x55d4a746ac00 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.392+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 13 ==== osd_op_reply(55 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.392+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:56 14.2b 14:d4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916400 con 0x55d4a68f0000 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.392+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.392+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:57 14.1b 14:d8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0c00 con 0x55d4a68f0400 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.393+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 7 ==== osd_op_reply(57 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.393+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:58 14.3b 14:dc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916800 con 0x55d4a68f0000 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.393+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 11 ==== osd_op_reply(58 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.393+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:59 14.7 14:e0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7400 con 0x55d4a746b000 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.393+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 6 ==== osd_op_reply(59 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.393+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:60 14.0 14:00000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916000 con 0x55d4a68d7800 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 7 ==== osd_op_reply(60 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:61 14.20 14:04000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c000 con 0x55d4a746ac00 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 14 ==== osd_op_reply(61 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:62 14.10 14:08000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916c00 con 0x55d4a68f0400 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 8 ==== osd_op_reply(62 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:63 14.30 14:0c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c400 con 0x55d4a746ac00 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 15 ==== osd_op_reply(63 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.394+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:64 14.8 14:10000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917000 con 0x55d4a746ac00 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.395+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 16 ==== osd_op_reply(64 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.395+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:65 14.28 14:14000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c800 con 0x55d4a68f1400 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.395+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.395+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:66 14.18 14:18000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917400 con 0x55d4a68f1000 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.395+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 6 ==== osd_op_reply(66 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.395+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:67 14.38 14:1c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691cc00 con 0x55d4a68f0400 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.396+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 9 ==== osd_op_reply(67 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.396+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:68 14.4 14:20000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917800 con 0x55d4a68d7000 2024-05-10T08:46:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.396+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.396+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:69 14.24 14:24000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691d000 con 0x55d4a68f0400 2024-05-10T08:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.396+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 10 ==== osd_op_reply(69 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.396+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:70 14.14 14:28000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917c00 con 0x55d4a68f0000 2024-05-10T08:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 12 ==== osd_op_reply(70 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:71 14.34 14:2c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691d400 con 0x55d4a68d7800 2024-05-10T08:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 8 ==== osd_op_reply(71 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:72 14.c 14:30000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916400 con 0x55d4a746ac00 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 17 ==== osd_op_reply(72 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:73 14.2c 14:34000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691d800 con 0x55d4a68f0400 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 11 ==== osd_op_reply(73 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.397+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:74 14.1c 14:38000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916800 con 0x55d4a746ac00 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.398+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 18 ==== osd_op_reply(74 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.398+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:75 14.3c 14:3c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691dc00 con 0x55d4a746b000 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.398+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 7 ==== osd_op_reply(75 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.398+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:76 14.2 14:40000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914400 con 0x55d4a68d7000 2024-05-10T08:46:53.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.398+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.398+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:77 14.22 14:44000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c800 con 0x55d4a68f0000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.399+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 13 ==== osd_op_reply(77 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.399+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:78 14.12 14:48000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914800 con 0x55d4a68d7800 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.399+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 9 ==== osd_op_reply(78 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.399+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:79 14.32 14:4c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691dc00 con 0x55d4a68f0000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.399+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.399+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:80 14.a 14:50000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915800 con 0x55d4a746b000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 8 ==== osd_op_reply(80 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:81 14.2a 14:54000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691cc00 con 0x55d4a68f0000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:82 14.1a 14:58000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914000 con 0x55d4a746ac00 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 19 ==== osd_op_reply(82 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:83 14.3a 14:5c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917800 con 0x55d4a746ac00 2024-05-10T08:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 20 ==== osd_op_reply(83 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.400+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:84 14.6 14:60000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915c00 con 0x55d4a746ac00 2024-05-10T08:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.401+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 21 ==== osd_op_reply(84 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.401+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:85 14.26 14:64000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916c00 con 0x55d4a68f0000 2024-05-10T08:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.401+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 16 ==== osd_op_reply(85 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.401+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:86 14.16 14:68000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0c00 con 0x55d4a68f1400 2024-05-10T08:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.401+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 7 ==== osd_op_reply(86 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.401+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:87 14.36 14:6c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917c00 con 0x55d4a68d7800 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.402+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 10 ==== osd_op_reply(87 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.402+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:88 14.e 14:70000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1c00 con 0x55d4a68f0000 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.402+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 17 ==== osd_op_reply(88 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.402+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:89 14.2e 14:74000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916000 con 0x55d4a68f1400 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.402+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 8 ==== osd_op_reply(89 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.402+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:90 14.1e 14:78000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c400 con 0x55d4a68f1000 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.403+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 7 ==== osd_op_reply(90 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.403+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:91 14.3e 14:7c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915400 con 0x55d4a746b000 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.403+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 9 ==== osd_op_reply(91 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.403+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:92 14.1 14:80000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691d400 con 0x55d4a68f1400 2024-05-10T08:46:53.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.403+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 9 ==== osd_op_reply(92 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.403+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:93 14.21 14:84000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914400 con 0x55d4a746b000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 10 ==== osd_op_reply(93 [pgnls-filter start_epoch 91 out=49b] v87'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:94 14.11 14:88000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691d000 con 0x55d4a68f0000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 18 ==== osd_op_reply(94 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:95 14.31 14:8c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7c00 con 0x55d4a68f0400 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 12 ==== osd_op_reply(95 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:96 14.9 14:90000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917000 con 0x55d4a746b000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 11 ==== osd_op_reply(96 [pgnls-filter start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.404+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:97 14.29 14:94000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7400 con 0x55d4a68d7000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.405+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 9 ==== osd_op_reply(97 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.405+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:98 14.19 14:98000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917400 con 0x55d4a68d7000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.405+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 10 ==== osd_op_reply(98 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.405+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:99 14.39 14:9c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691d400 con 0x55d4a68f1000 2024-05-10T08:46:53.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.405+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 8 ==== osd_op_reply(99 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.405+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:100 14.5 14:a0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916400 con 0x55d4a746ac00 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.406+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 22 ==== osd_op_reply(100 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.406+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:101 14.25 14:a4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691d800 con 0x55d4a68d7800 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.406+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 11 ==== osd_op_reply(101 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.406+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:102 14.15 14:a8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916800 con 0x55d4a68f1000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.406+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 9 ==== osd_op_reply(102 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.406+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:103 14.35 14:ac000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7400 con 0x55d4a68f0000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.407+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.407+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:104 14.d 14:b0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917800 con 0x55d4a68d7000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.407+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 11 ==== osd_op_reply(104 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.407+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:105 14.2d 14:b4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d7c00 con 0x55d4a68f0000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.407+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 20 ==== osd_op_reply(105 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.407+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:106 14.1d 14:b8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914800 con 0x55d4a746ac00 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 23 ==== osd_op_reply(106 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:107 14.3d 14:bc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0c00 con 0x55d4a68f1400 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:108 14.3 14:c0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914000 con 0x55d4a746ac00 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 24 ==== osd_op_reply(108 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:109 14.23 14:c4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1c00 con 0x55d4a68f1000 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 10 ==== osd_op_reply(109 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.408+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:110 14.13 14:c8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1c00 con 0x55d4a68d7800 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.409+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.2 v2:172.21.15.37:6808/2438867251 12 ==== osd_op_reply(110 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68d7800 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.409+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:111 14.33 14:cc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916000 con 0x55d4a68f0400 2024-05-10T08:46:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.409+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 13 ==== osd_op_reply(111 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.409+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:112 14.b 14:d0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915c00 con 0x55d4a746ac00 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.409+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 25 ==== osd_op_reply(112 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.409+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:113 14.2b 14:d4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917000 con 0x55d4a68f0000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.409+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.410+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:114 14.1b 14:d8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914800 con 0x55d4a68f0400 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.410+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 14 ==== osd_op_reply(114 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.410+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:115 14.3b 14:dc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916c00 con 0x55d4a68f0000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.410+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 22 ==== osd_op_reply(115 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.410+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:116 14.7 14:e0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914000 con 0x55d4a746b000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 12 ==== osd_op_reply(116 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 10 datascan.operator(): handling object 10000000001.0 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:117 14.7 14:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915000 con 0x55d4a746b000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 13 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) ==== 416+0+157 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:118 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f0800 con 0x55d4a68f0400 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 15 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) ==== 164+0+59 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.411+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68f1800 con 0x55d4a68d7000 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.6 v2:172.21.15.82:6824/3522580642 12 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=581b] v0'0 uv9 ondisk = 0) ==== 154+0+581 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68d7000 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 20 datascan.get_frag_of: frag is * 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:120 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55d4a68d6c00 con 0x55d4a68f0400 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 16 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:121 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c000 con 0x55d4a68f0400 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 17 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 20 datascan.read_dentry: file_head not found in result 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.412+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:122 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c400 con 0x55d4a68f0400 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.413+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 18 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v91'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.413+0000 7fc3feb20740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.413+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:123 14.27 14:e4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a691c800 con 0x55d4a746b000 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.414+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.5 v2:172.21.15.82:6800/3184821053 14 ==== osd_op_reply(123 [pgnls-filter start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a746b000 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.414+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:124 14.17 14:e8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6917c00 con 0x55d4a68f0400 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.414+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.1 v2:172.21.15.37:6800/1334168884 19 ==== osd_op_reply(124 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0400 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.414+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:125 14.37 14:ec000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915800 con 0x55d4a68f0000 2024-05-10T08:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.414+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 <== osd.4 v2:172.21.15.82:6808/3594167095 23 ==== osd_op_reply(125 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2780 con 0x55d4a68f0000 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.414+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:126 14.f 14:f0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916400 con 0x55d4a68f1000 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.7 v2:172.21.15.82:6816/1827186019 11 ==== osd_op_reply(126 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a68f1000 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:127 14.2f 14:f4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6915400 con 0x55d4a746ac00 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 26 ==== osd_op_reply(127 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3f7a72640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:128 14.1f 14:f8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6916800 con 0x55d4a746ac00 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3fca7c640 1 -- 172.21.15.37:0/4089800169 <== osd.0 v2:172.21.15.37:6811/38998236 27 ==== osd_op_reply(128 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2000 con 0x55d4a746ac00 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3f8273640 1 -- 172.21.15.37:0/4089800169 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:129 14.3f 14:fc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55d4a6914400 con 0x55d4a68f1400 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3fd27d640 1 -- 172.21.15.37:0/4089800169 <== osd.3 v2:172.21.15.37:6824/1264356154 11 ==== osd_op_reply(129 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55d4a72c2500 con 0x55d4a68f1400 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55d4a746ac00 msgr2=0x55d4a730c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55d4a746ac00 0x55d4a730c680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55d4a68f0400 msgr2=0x55d4a68f6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55d4a68f0400 0x55d4a68f6000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55d4a68d7800 msgr2=0x55d4a730d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55d4a68d7800 0x55d4a730d180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55d4a68f1400 msgr2=0x55d4a68f6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x55d4a68f1400 0x55d4a68f6580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55d4a68f0000 msgr2=0x55d4a68f7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55d4a68f0000 0x55d4a68f7080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55d4a746b000 msgr2=0x55d4a68f7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x55d4a746b000 0x55d4a68f7600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55d4a68d7000 msgr2=0x55d4a730cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x55d4a68d7000 0x55d4a730cc00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55d4a68f1000 msgr2=0x55d4a68f6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 reap_dead start 2024-05-10T08:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.415+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x55d4a68f1000 0x55d4a68f6b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 reap_dead start 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 reap_dead start 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3fc27b640 1 -- 172.21.15.37:0/4089800169 reap_dead start 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55d4a68d6000 msgr2=0x55d4a730c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55d4a68d6000 0x55d4a730c100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55d4a72d9080 tx=0x55d4a685cf60 comp rx=0 tx=0).stop 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 msgr2=0x55d4a730bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x55d4a748e060 tx=0x55d4a72d6a80 comp rx=0 tx=0).stop 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 shutdown_connections 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55d4a68d6000 0x55d4a730c100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/4089800169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a746a800 0x55d4a730bb80 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 >> 172.21.15.37:0/4089800169 conn(0x55d4a7331c00 msgr2=0x55d4a72af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 shutdown_connections 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/4089800169 wait complete. 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/575435702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a6530c00 msgr2=0x55d4a730a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a6530c00 0x55d4a730a000 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x55d4a7369410 tx=0x55d4a72d6a20 comp rx=0 tx=0).stop 2024-05-10T08:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/575435702 shutdown_connections 2024-05-10T08:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a6531c00 0x55d4a730ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d4a6531800 0x55d4a730a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 --2- 172.21.15.37:0/575435702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4a6530c00 0x55d4a730a000 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/575435702 >> 172.21.15.37:0/575435702 conn(0x55d4a6531000 msgr2=0x55d4a72ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/575435702 shutdown_connections 2024-05-10T08:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.416+0000 7fc3feb20740 1 -- 172.21.15.37:0/575435702 wait complete. 2024-05-10T08:46:53.437 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.152459, result: 2024-05-10T08:46:53.437 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-05-10T08:46:53.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 -- start start 2024-05-10T08:46:53.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 Processor -- start 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558880596c00 0x558881366000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558880597800 0x558881366580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558880597c00 0x558881366b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558881392600 con 0x558880596c00 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558881392480 con 0x558880597800 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.501+0000 7f682ee19740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x558881392300 con 0x558880597c00 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558880596c00 0x558881366000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558880596c00 0x558881366000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50122/0 (socket says 172.21.15.37:50122) 2024-05-10T08:46:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 -- 172.21.15.37:0/3635792692 learned_addr learned my addr 172.21.15.37:0/3635792692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682c37b640 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558880597800 0x558881366580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682d37d640 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558880597c00 0x558881366b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 -- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558880597c00 msgr2=0x558881366b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558880597c00 0x558881366b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 -- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558880597800 msgr2=0x558881366580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558880597800 0x558881366580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 -- 172.21.15.37:0/3635792692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588805c3680 con 0x558880596c00 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682d37d640 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558880597c00 0x558881366b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682cb7c640 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558880596c00 0x558881366000 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x5588813c7c50 tx=0x558880666180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8d54717d1484d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682a377640 1 -- 172.21.15.37:0/3635792692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588805bc680 con 0x558880596c00 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682a377640 1 -- 172.21.15.37:0/3635792692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5588805de1c0 con 0x558880596c00 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682ee19740 1 -- 172.21.15.37:0/3635792692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588805c3a40 con 0x558880596c00 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682a377640 1 -- 172.21.15.37:0/3635792692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588805bc9c0 con 0x558880596c00 2024-05-10T08:46:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682ee19740 1 -- 172.21.15.37:0/3635792692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5588805c32c0 con 0x558880596c00 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.502+0000 7f682ee19740 4 waiting for MDS map... 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.503+0000 7f682a377640 1 -- 172.21.15.37:0/3635792692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x55888147c600 con 0x558880596c00 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.503+0000 7f682a377640 1 -- 172.21.15.37:0/3635792692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 68) ==== 2885+0+0 (secure 0 0 0) 0x5588805ef180 con 0x558880596c00 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.503+0000 7f682ee19740 4 Got MDS map 68 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.503+0000 7f682ee19740 4 datascan.main: Using metadata pool output 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.503+0000 7f682ee19740 4 datascan.main: connecting to RADOS... 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.503+0000 7f682ee19740 1 Processor -- start 2024-05-10T08:46:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.503+0000 7f682ee19740 1 -- start start 2024-05-10T08:46:53.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682ee19740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682ee19740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 0x558881367600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682ee19740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 0x558881367b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682ee19740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558881392180 con 0x558881389400 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682ee19740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558881392900 con 0x558881389c00 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682ee19740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5588805f6900 con 0x558881389800 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50130/0 (socket says 172.21.15.37:50130) 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 -- 172.21.15.37:0/394642965 learned_addr learned my addr 172.21.15.37:0/394642965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682c37b640 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 0x558881367b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682cb7c640 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 0x558881367600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 -- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 msgr2=0x558881367600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 0x558881367600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 -- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 msgr2=0x558881367b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 0x558881367b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.504+0000 7f682d37d640 1 -- 172.21.15.37:0/394642965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588805c34a0 con 0x558881389400 2024-05-10T08:46:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682d37d640 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x55888147ae70 tx=0x55888133c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58588eac5a9ce495 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f6828373640 1 -- 172.21.15.37:0/394642965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588805bc680 con 0x558881389400 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f6828373640 1 -- 172.21.15.37:0/394642965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5588805dee00 con 0x558881389400 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f6828373640 1 -- 172.21.15.37:0/394642965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588805bc9c0 con 0x558881389400 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 -- 172.21.15.37:0/394642965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 msgr2=0x558881367080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x55888147ae70 tx=0x55888133c9c0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 -- 172.21.15.37:0/394642965 shutdown_connections 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 0x558881367b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 0x558881367600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 --2- 172.21.15.37:0/394642965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 -- 172.21.15.37:0/394642965 >> 172.21.15.37:0/394642965 conn(0x558881389000 msgr2=0x558881315000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 -- 172.21.15.37:0/394642965 shutdown_connections 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.505+0000 7f682ee19740 1 -- 172.21.15.37:0/394642965 wait complete. 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 Processor -- start 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 -- start start 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 0x558881367600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 0x558881367b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558881392180 con 0x558881389400 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558881392900 con 0x558881389c00 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682ee19740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x558881393200 con 0x558881389800 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682d37d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682d37d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50146/0 (socket says 172.21.15.37:50146) 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 learned_addr learned my addr 172.21.15.37:0/2072800405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682cb7c640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 0x558881367600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.506+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 0x558881367b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 msgr2=0x558881367600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558881389800 0x558881367600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 msgr2=0x558881367b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558881389c00 0x558881367b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588805c3680 con 0x558881389400 2024-05-10T08:46:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x55888147bb30 tx=0x55888133df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f6826b70640 1 -- 172.21.15.37:0/2072800405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588805bc680 con 0x558881389400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f6826b70640 1 -- 172.21.15.37:0/2072800405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5588805dec40 con 0x558881389400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588805c3a40 con 0x558881389400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f6826b70640 1 -- 172.21.15.37:0/2072800405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588805bc9c0 con 0x558881389400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588805c30e0 con 0x558881389400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.507+0000 7f682ee19740 4 datascan.init: resolving metadata pool 13 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.508+0000 7f6826b70640 1 -- 172.21.15.37:0/2072800405 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x5588814e4c00 con 0x558881389400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f6826b70640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558880938000 0x558881368100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f6826b70640 1 -- 172.21.15.37:0/2072800405 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x55888138c200 con 0x558881389400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682ee19740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682ee19740 4 datascan.main: resolving metadata pool 13 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558880938400 0x558881368680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880938800 con 0x558880938400 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682cb7c640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558880938000 0x558881368100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558880938400 0x558881368680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682cb7c640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558880938000 0x558881368100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55888147a120 tx=0x55888133ca80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.509+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558880938400 0x558881368680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x558880938800 0x55888093e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880942000 con 0x558880938800 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x558880938800 0x55888093e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x558880938800 0x55888093e000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x558880942000 0x55888093e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.510+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880942400 con 0x558880942000 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.511+0000 7f682cb7c640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x558880942000 0x55888093e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.511+0000 7f682cb7c640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x558880942000 0x55888093e580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.511+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880942000 2024-05-10T08:46:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.511+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880942400 con 0x558880938400 2024-05-10T08:46:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.511+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.511+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558880942400 0x55888093eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.511+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943400 con 0x558880942400 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.512+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558880942400 0x55888093eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.512+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558880942400 0x55888093eb00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.512+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.512+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x558880943400 0x55888093f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.512+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943800 con 0x558880943400 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.512+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x558880943400 0x55888093f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.513+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x558880943400 0x55888093f080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.513+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(6 [pgnls start_epoch 91 out=149b] v90'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.513+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943800 con 0x558880938800 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.513+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.513+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943800 con 0x558880942400 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.514+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(8 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.514+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x558880943800 0x55888093f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.514+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943c00 con 0x558880943800 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.514+0000 7f682cb7c640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x558880943800 0x55888093f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.514+0000 7f682cb7c640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x558880943800 0x55888093f600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.514+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.514+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943c00 con 0x558880943400 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943c00 con 0x558880942000 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== osd_op_reply(11 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x558881328780 con 0x558880942000 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880943c00 con 0x558880938800 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 3 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x558880943c00 0x558880940680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880942800 con 0x558880943c00 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.515+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x558880943c00 0x558880940680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.516+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x558880943c00 0x558880940680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.516+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(13 [pgnls start_epoch 91 out=77b] v90'8 uv8 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.516+0000 7f682c37b640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x558880942800 0x55888093fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.516+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880942800 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.516+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x558880942800 0x55888093fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.516+0000 7f682d37d640 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x558880942800 0x55888093fb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880942800 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880938400 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 3 ==== osd_op_reply(15 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943c00 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880942400 2024-05-10T08:46:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.517+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880938800 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.518+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 4 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.518+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943800 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.518+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.518+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880942800 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.519+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880942800 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.519+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943c00 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.519+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 3 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.519+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943c00 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.519+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 4 ==== osd_op_reply(22 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.519+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943c00 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 5 ==== osd_op_reply(23 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880938400 2024-05-10T08:46:53.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 4 ==== osd_op_reply(24 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 3 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880938400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 5 ==== osd_op_reply(26 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.520+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943800 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.521+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 3 ==== osd_op_reply(27 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.521+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943c00 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.521+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 6 ==== osd_op_reply(28 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.521+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880938400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.521+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 6 ==== osd_op_reply(29 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.521+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880943800 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 4 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880942400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 4 ==== osd_op_reply(31 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880942400 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 5 ==== osd_op_reply(32 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880938c00 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.522+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:34 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880939000 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:35 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880939400 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682ee19740 20 datascan.scan_links: injected ino detected 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:36 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961000 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.523+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:37 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961400 con 0x558880938800 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:38 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961800 con 0x558880943400 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 4 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:39 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961c00 con 0x558880942400 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:40 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961000 con 0x558880942000 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.2 v2:172.21.15.37:6808/2438867251 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x558881328780 con 0x558880942000 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.524+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:41 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880938c00 con 0x558880938400 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 7 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:42 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880939000 con 0x558880943c00 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-05-10T08:46:53.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T08:46:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-05-10T08:46:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.525+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:43 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880939400 con 0x558880938400 2024-05-10T08:46:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 8 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-05-10T08:46:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T08:46:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-05-10T08:46:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:44 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880943000 con 0x558880938400 2024-05-10T08:46:53.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 9 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-05-10T08:46:53.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:45 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880942c00 con 0x558880938400 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.526+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 10 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682ee19740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:46 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880938c00 con 0x558880942400 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 7 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:47 13.0 13:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938400 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 11 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.527+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:48 13.10 13:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938800 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.528+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 10 ==== osd_op_reply(48 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.528+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:49 13.8 13:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942000 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.528+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.2 v2:172.21.15.37:6808/2438867251 4 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880942000 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.528+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:50 13.18 13:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.528+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 12 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.528+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:51 13.4 13:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.529+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 8 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.529+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:52 13.14 13:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.529+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 5 ==== osd_op_reply(52 [pgnls start_epoch 91 out=149b] v90'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.529+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:53 13.c 13:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938800 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.529+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 11 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.529+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:54 13.1c 13:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 9 ==== osd_op_reply(54 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:55 13.2 13:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943800 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 5 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:56 13.12 13:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943400 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 6 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:57 13.a 13:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942000 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.2 v2:172.21.15.37:6808/2438867251 5 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x558881328780 con 0x558880942000 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.530+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:58 13.1a 13:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938800 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.531+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 12 ==== osd_op_reply(58 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.531+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:59 13.6 13:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943c00 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.531+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 8 ==== osd_op_reply(59 [pgnls start_epoch 91 out=77b] v90'8 uv8 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.531+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:60 13.16 13:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942800 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.531+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.3 v2:172.21.15.37:6824/1264356154 3 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880942800 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.531+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:61 13.e 13:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938400 2024-05-10T08:46:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 13 ==== osd_op_reply(61 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:62 13.1e 13:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943c00 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 9 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:63 13.1 13:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942400 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 10 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:64 13.11 13:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938800 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 13 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.532+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:65 13.9 13:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943800 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 6 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:66 13.19 13:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942800 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.3 v2:172.21.15.37:6824/1264356154 4 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880942800 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:67 13.5 13:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943c00 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 10 ==== osd_op_reply(67 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:68 13.15 13:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943c00 2024-05-10T08:46:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 11 ==== osd_op_reply(68 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.533+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:69 13.d 13:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943c00 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.534+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 12 ==== osd_op_reply(69 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.534+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:70 13.1d 13:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.534+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 14 ==== osd_op_reply(70 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.534+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:71 13.3 13:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.534+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 7 ==== osd_op_reply(71 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.534+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:72 13.13 13:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 15 ==== osd_op_reply(72 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:73 13.b 13:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943800 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 7 ==== osd_op_reply(73 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:74 13.1b 13:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943c00 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 13 ==== osd_op_reply(74 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:75 13.7 13:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 16 ==== osd_op_reply(75 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.535+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:76 13.17 13:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880943800 2024-05-10T08:46:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.536+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.5 v2:172.21.15.82:6800/3184821053 8 ==== osd_op_reply(76 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558881328780 con 0x558880943800 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.536+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:77 13.f 13:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942400 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.536+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 11 ==== osd_op_reply(77 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.536+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:78 13.1f 13:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880942400 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.536+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 12 ==== osd_op_reply(78 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.536+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.536+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:79 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880960800 con 0x558880938800 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 14 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:80 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880960400 con 0x558880938800 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 15 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-05-10T08:46:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:81 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880960000 con 0x558880938800 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 16 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 20 datascan.scan_links: injected ino detected 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:82 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961c00 con 0x558880938800 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 17 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.537+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:83 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880970000 con 0x558880938800 2024-05-10T08:46:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 18 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:84 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880970400 con 0x558880943400 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.0 v2:172.21.15.37:6811/38998236 8 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328500 con 0x558880943400 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-05-10T08:46:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.538+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:85 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880970800 con 0x558880942400 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 13 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:86 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880970c00 con 0x558880942000 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682cb7c640 1 -- 172.21.15.37:0/2072800405 <== osd.2 v2:172.21.15.37:6808/2438867251 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x558881328780 con 0x558880942000 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:87 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880971000 con 0x558880938400 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 17 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.539+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:88 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880971400 con 0x558880943c00 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 14 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880971800 con 0x558880938400 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 18 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.540+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:90 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880971c00 con 0x558880938400 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 19 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T08:46:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:91 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880960c00 con 0x558880938400 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 20 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:92 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961400 con 0x558880942400 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.6 v2:172.21.15.82:6824/3522580642 14 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x558881328000 con 0x558880942400 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-05-10T08:46:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.541+0000 7f682ee19740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.542+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:93 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880961800 con 0x558880938800 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.542+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 19 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.542+0000 7f682ee19740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.542+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:94 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x558880960800 con 0x558880938800 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 20 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v91'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 10 datascan.scan_links: processing 1 injected_inos 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:95 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880960400 con 0x558880938800 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 21 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 20 datascan.scan_links: first is now 2 2024-05-10T08:46:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.543+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:96 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x558880939000 con 0x558880938800 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.545+0000 7f682d37d640 1 -- 172.21.15.37:0/2072800405 <== osd.1 v2:172.21.15.37:6800/1334168884 22 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v91'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x558881328500 con 0x558880938800 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.545+0000 7f682ee19740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.545+0000 7f682ee19740 10 datascan.scan_links: updating inotable 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.545+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880939400 con 0x558880938400 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.546+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 21 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.546+0000 7f682ee19740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.546+0000 7f682ee19740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.546+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x558880938c00 con 0x558880938400 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.547+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.7 v2:172.21.15.82:6816/1827186019 22 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v91'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x558881328000 con 0x558880938400 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.547+0000 7f682ee19740 10 datascan.scan_links: updating snaptable 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.547+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:99 13.d 13:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x558880943000 con 0x558880943c00 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 <== osd.4 v2:172.21.15.82:6808/3594167095 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x558881328000 con 0x558880943c00 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x558880943400 msgr2=0x55888093f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x558880943400 0x55888093f080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x558880938800 msgr2=0x55888093e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x558880938800 0x55888093e000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x558880942000 msgr2=0x55888093e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x558880942000 0x55888093e580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x558880942800 msgr2=0x55888093fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x558880942800 0x55888093fb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 reap_dead start 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x558880943c00 msgr2=0x558880940680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x558880943c00 0x558880940680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 reap_dead start 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x558880943800 msgr2=0x55888093f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x558880943800 0x55888093f600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558880942400 msgr2=0x55888093eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558880942400 0x55888093eb00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558880938400 msgr2=0x558881368680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558880938400 0x558881368680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558880938000 msgr2=0x558881368100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558880938000 0x558881368100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55888147a120 tx=0x55888133ca80 comp rx=0 tx=0).stop 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 msgr2=0x558881367080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/2072800405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558881389400 0x558881367080 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x55888147bb30 tx=0x55888133df80 comp rx=0 tx=0).stop 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682c37b640 1 -- 172.21.15.37:0/2072800405 reap_dead start 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 shutdown_connections 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 >> 172.21.15.37:0/2072800405 conn(0x558881389000 msgr2=0x558881315000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 shutdown_connections 2024-05-10T08:46:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/2072800405 wait complete. 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/3635792692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558880596c00 msgr2=0x558881366000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558880596c00 0x558881366000 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x5588813c7c50 tx=0x558880666180 comp rx=0 tx=0).stop 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 -- 172.21.15.37:0/3635792692 shutdown_connections 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.548+0000 7f682ee19740 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558880597c00 0x558881366b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.549+0000 7f682ee19740 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558880597800 0x558881366580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.549+0000 7f682ee19740 1 --2- 172.21.15.37:0/3635792692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558880596c00 0x558881366000 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.549+0000 7f682ee19740 1 -- 172.21.15.37:0/3635792692 >> 172.21.15.37:0/3635792692 conn(0x558880597000 msgr2=0x558881314800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.549+0000 7f682ee19740 1 -- 172.21.15.37:0/3635792692 shutdown_connections 2024-05-10T08:46:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.549+0000 7f682ee19740 1 -- 172.21.15.37:0/3635792692 wait complete. 2024-05-10T08:46:53.565 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.127256, result: 2024-05-10T08:46:53.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T08:46:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.712+0000 7fbb4cadc640 1 Processor -- start 2024-05-10T08:46:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.712+0000 7fbb4cadc640 1 -- start start 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb4cadc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb4815f380 0x7fbb480d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb4cadc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb480d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb4cadc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb480b1c90 con 0x7fbb480b2420 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb4cadc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbb480d0a50 con 0x7fbb4815f380 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb4cadc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb480d0d30 con 0x7fbb480b3f30 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb4659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb4815f380 0x7fbb480d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb46d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb480b2420 0x7fbb480b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50474/0 (socket says 172.21.15.37:50474) 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb46d9d640 1 -- 172.21.15.37:0/4043899662 learned_addr learned my addr 172.21.15.37:0/4043899662 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.713+0000 7fbb4659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb4815f380 0x7fbb480d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50160/0 (socket says 172.21.15.37:50160) 2024-05-10T08:46:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.714+0000 7fbb45d9b640 1 --2- 172.21.15.37:0/4043899662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb480d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.714+0000 7fbb4659c640 1 -- 172.21.15.37:0/4043899662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 msgr2=0x7fbb480d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.714+0000 7fbb4659c640 1 --2- 172.21.15.37:0/4043899662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb480d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.714+0000 7fbb4659c640 1 -- 172.21.15.37:0/4043899662 >> v1:172.21.15.37:6789/0 conn(0x7fbb480b2420 legacy=0x7fbb480b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.714+0000 7fbb4659c640 1 -- 172.21.15.37:0/4043899662 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb480b1f00 con 0x7fbb4815f380 2024-05-10T08:46:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.714+0000 7fbb4559a640 1 -- 172.21.15.37:0/4043899662 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872915863 0 0) 0x7fbb480b1c90 con 0x7fbb480b2420 2024-05-10T08:46:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.714+0000 7fbb4659c640 1 --2- 172.21.15.37:0/4043899662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480d35c0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009d90 tx=0x7fbb4002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7c18c71a8ea8b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4559a640 1 -- 172.21.15.37:0/4043899662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40007740 con 0x7fbb4815f380 2024-05-10T08:46:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4559a640 1 -- 172.21.15.37:0/4043899662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb400078e0 con 0x7fbb4815f380 2024-05-10T08:46:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4559a640 1 -- 172.21.15.37:0/4043899662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40007cb0 con 0x7fbb4815f380 2024-05-10T08:46:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4043899662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 msgr2=0x7fbb480d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4043899662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480d35c0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009d90 tx=0x7fbb4002a660 comp rx=0 tx=0).stop 2024-05-10T08:46:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4043899662 shutdown_connections 2024-05-10T08:46:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4043899662 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb480d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4043899662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480d35c0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4043899662 >> 172.21.15.37:0/4043899662 conn(0x7fbb480d4fe0 msgr2=0x7fbb480d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4043899662 shutdown_connections 2024-05-10T08:46:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.715+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4043899662 wait complete. 2024-05-10T08:46:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.717+0000 7fbb4cadc640 1 Processor -- start 2024-05-10T08:46:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.717+0000 7fbb4cadc640 1 -- start start 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4cadc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb480b2420 0x7fbb481608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4cadc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb4815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4cadc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4cadc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb480d06e0 con 0x7fbb4815f380 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4cadc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb480d1010 con 0x7fbb480b2420 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4cadc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb480d2600 con 0x7fbb480b3f30 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50164/0 (socket says 172.21.15.37:50164) 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 -- 172.21.15.37:0/4262869700 learned_addr learned my addr 172.21.15.37:0/4262869700 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4659c640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb480b2420 0x7fbb481608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb45d9b640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb4815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 -- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 msgr2=0x7fbb4815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb4815e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 -- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb480b2420 msgr2=0x7fbb481608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb480b2420 0x7fbb481608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 -- 172.21.15.37:0/4262869700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb480cc300 con 0x7fbb4815f380 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb46d9d640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480c9c20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c450 tx=0x7fbb3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb3effd640 1 -- 172.21.15.37:0/4262869700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38018070 con 0x7fbb4815f380 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb3effd640 1 -- 172.21.15.37:0/4262869700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb38007500 con 0x7fbb4815f380 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb480cc5e0 con 0x7fbb4815f380 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.718+0000 7fbb3effd640 1 -- 172.21.15.37:0/4262869700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004a20 con 0x7fbb4815f380 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.719+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb480ccba0 con 0x7fbb4815f380 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.720+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb480693f0 con 0x7fbb4815f380 2024-05-10T08:46:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.720+0000 7fbb3effd640 1 -- 172.21.15.37:0/4262869700 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb3801b070 con 0x7fbb4815f380 2024-05-10T08:46:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.721+0000 7fbb3effd640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb28076300 0x7fbb280787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.721+0000 7fbb3effd640 1 -- 172.21.15.37:0/4262869700 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fbb380969a0 con 0x7fbb4815f380 2024-05-10T08:46:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.721+0000 7fbb4659c640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb28076300 0x7fbb280787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.721+0000 7fbb4659c640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb28076300 0x7fbb280787c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:53.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.725+0000 7fbb3effd640 1 -- 172.21.15.37:0/4262869700 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbb3805fa90 con 0x7fbb4815f380 2024-05-10T08:46:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:53.957+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fbb48160e20 con 0x7fbb4815f380 2024-05-10T08:46:54.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:46:54.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:46:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.183+0000 7fbb3effd640 1 -- 172.21.15.37:0/4262869700 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v69) ==== 162+0+0 (secure 0 0 0) 0x7fbb38063d90 con 0x7fbb4815f380 2024-05-10T08:46:54.182 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T08:46:54.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb28076300 msgr2=0x7fbb280787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb28076300 0x7fbb280787c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002f000 comp rx=0 tx=0).stop 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 msgr2=0x7fbb480c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480c9c20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c450 tx=0x7fbb3800c910 comp rx=0 tx=0).stop 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 shutdown_connections 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb28076300 0x7fbb280787c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4815f380 0x7fbb480c9c20 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb480b3f30 0x7fbb4815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 --2- 172.21.15.37:0/4262869700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb480b2420 0x7fbb481608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 >> 172.21.15.37:0/4262869700 conn(0x7fbb480d4fe0 msgr2=0x7fbb480b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 shutdown_connections 2024-05-10T08:46:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.185+0000 7fbb4cadc640 1 -- 172.21.15.37:0/4262869700 wait complete. 2024-05-10T08:46:54.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:46:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.302+0000 7f79bd1af640 1 Processor -- start 2024-05-10T08:46:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.302+0000 7f79bd1af640 1 -- start start 2024-05-10T08:46:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79bd1af640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79b815f380 0x7f79b80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79bd1af640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79b80d3cd0 0x7f79b80b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79bd1af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b80d1760 con 0x7f79b80d0cf0 2024-05-10T08:46:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79bd1af640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f79b80d30f0 con 0x7f79b815f380 2024-05-10T08:46:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79bd1af640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f79b80d2370 con 0x7f79b80d3cd0 2024-05-10T08:46:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79b6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79b815f380 0x7f79b80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79b6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79b815f380 0x7f79b80d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50172/0 (socket says 172.21.15.37:50172) 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79b6d9d640 1 -- 172.21.15.37:0/665992461 learned_addr learned my addr 172.21.15.37:0/665992461 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79b659c640 1 --1- 172.21.15.37:0/665992461 >> v1:172.21.15.37:6789/0 conn(0x7f79b80d0cf0 0x7f79b80d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50478/0 (socket says 172.21.15.37:50478) 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.303+0000 7f79b759e640 1 --2- 172.21.15.37:0/665992461 >> v2:172.21.15.82:3300/0 conn(0x7f79b80d3cd0 0x7f79b80b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b6d9d640 1 -- 172.21.15.37:0/665992461 >> v2:172.21.15.82:3300/0 conn(0x7f79b80d3cd0 msgr2=0x7f79b80b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b6d9d640 1 --2- 172.21.15.37:0/665992461 >> v2:172.21.15.82:3300/0 conn(0x7f79b80d3cd0 0x7f79b80b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b6d9d640 1 -- 172.21.15.37:0/665992461 >> v1:172.21.15.37:6789/0 conn(0x7f79b80d0cf0 legacy=0x7f79b80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b6d9d640 1 -- 172.21.15.37:0/665992461 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b80d1a40 con 0x7f79b815f380 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b5d9b640 1 -- 172.21.15.37:0/665992461 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304967127 0 0) 0x7f79b80d1760 con 0x7f79b80d0cf0 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b759e640 1 --2- 172.21.15.37:0/665992461 >> v2:172.21.15.82:3300/0 conn(0x7f79b80d3cd0 0x7f79b80b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b6d9d640 1 --2- 172.21.15.37:0/665992461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b815f380 0x7f79b80d07b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f79b808f240 tx=0x7f79a802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a437b4f3f9b5e02b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b5d9b640 1 -- 172.21.15.37:0/665992461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8036070 con 0x7f79b815f380 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b5d9b640 1 -- 172.21.15.37:0/665992461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a8031600 con 0x7f79b815f380 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.304+0000 7f79b5d9b640 1 -- 172.21.15.37:0/665992461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a80319d0 con 0x7f79b815f380 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 -- 172.21.15.37:0/665992461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b815f380 msgr2=0x7f79b80d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 --2- 172.21.15.37:0/665992461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b815f380 0x7f79b80d07b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f79b808f240 tx=0x7f79a802a730 comp rx=0 tx=0).stop 2024-05-10T08:46:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 -- 172.21.15.37:0/665992461 shutdown_connections 2024-05-10T08:46:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 --2- 172.21.15.37:0/665992461 >> v2:172.21.15.82:3300/0 conn(0x7f79b80d3cd0 0x7f79b80b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 --2- 172.21.15.37:0/665992461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b815f380 0x7f79b80d07b0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 -- 172.21.15.37:0/665992461 >> 172.21.15.37:0/665992461 conn(0x7f79b80d4fe0 msgr2=0x7f79b80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 -- 172.21.15.37:0/665992461 shutdown_connections 2024-05-10T08:46:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.305+0000 7f79bd1af640 1 -- 172.21.15.37:0/665992461 wait complete. 2024-05-10T08:46:54.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.306+0000 7f79bd1af640 1 Processor -- start 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79bd1af640 1 -- start start 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79bd1af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b80d0cf0 0x7f79b80b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79bd1af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b80d3cd0 0x7f79b80b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79bd1af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b815f380 0x7f79b80ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79bd1af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79b815f760 con 0x7f79b80d0cf0 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79bd1af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79b80d2000 con 0x7f79b815f380 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79bd1af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f79b80d2800 con 0x7f79b80d3cd0 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79b6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b80d0cf0 0x7f79b80b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79b6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b80d0cf0 0x7f79b80b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50188/0 (socket says 172.21.15.37:50188) 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.307+0000 7f79b6d9d640 1 -- 172.21.15.37:0/2733575318 learned_addr learned my addr 172.21.15.37:0/2733575318 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b759e640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b815f380 0x7f79b80ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b6d9d640 1 -- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b80d3cd0 msgr2=0x7f79b80b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b659c640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b80d3cd0 0x7f79b80b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b6d9d640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b80d3cd0 0x7f79b80b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b6d9d640 1 -- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b815f380 msgr2=0x7f79b80ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b6d9d640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b815f380 0x7f79b80ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b6d9d640 1 -- 172.21.15.37:0/2733575318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b81f5540 con 0x7f79b80d0cf0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b759e640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b815f380 0x7f79b80ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79b6d9d640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b80d0cf0 0x7f79b80b2690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009f40 tx=0x7f79a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f799f7fe640 1 -- 172.21.15.37:0/2733575318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a803f020 con 0x7f79b80d0cf0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f799f7fe640 1 -- 172.21.15.37:0/2733575318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a8037040 con 0x7f79b80d0cf0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b81f5820 con 0x7f79b80d0cf0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f799f7fe640 1 -- 172.21.15.37:0/2733575318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8036070 con 0x7f79b80d0cf0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.308+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b80cd7d0 con 0x7f79b80d0cf0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.309+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b80cd9d0 con 0x7f79b80d0cf0 2024-05-10T08:46:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.310+0000 7f799f7fe640 1 -- 172.21.15.37:0/2733575318 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f79a8042020 con 0x7f79b80d0cf0 2024-05-10T08:46:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.310+0000 7f799f7fe640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79a40762d0 0x7f79a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.310+0000 7f799f7fe640 1 -- 172.21.15.37:0/2733575318 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f79a80b7d40 con 0x7f79b80d0cf0 2024-05-10T08:46:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.310+0000 7f79b659c640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79a40762d0 0x7f79a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.311+0000 7f79b659c640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79a40762d0 0x7f79a4078790 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f79b815e1b0 tx=0x7f79ac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:54.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.315+0000 7f799f7fe640 1 -- 172.21.15.37:0/2733575318 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f79b80cd9d0 con 0x7f79b80d0cf0 2024-05-10T08:46:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.547+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79b80693f0 con 0x7f79b80d0cf0 2024-05-10T08:46:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.547+0000 7f799f7fe640 1 -- 172.21.15.37:0/2733575318 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5171 (secure 0 0 0) 0x7f79a8049030 con 0x7f79b80d0cf0 2024-05-10T08:46:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:54.547 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:54.186053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T08:46:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 70 2024-05-10T08:46:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79a40762d0 msgr2=0x7f79a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79a40762d0 0x7f79a4078790 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f79b815e1b0 tx=0x7f79ac009040 comp rx=0 tx=0).stop 2024-05-10T08:46:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b80d0cf0 msgr2=0x7f79b80b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b80d0cf0 0x7f79b80b2690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009f40 tx=0x7f79a8004a40 comp rx=0 tx=0).stop 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 shutdown_connections 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79a40762d0 0x7f79a4078790 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b815f380 0x7f79b80ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b80d3cd0 0x7f79b80b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 --2- 172.21.15.37:0/2733575318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b80d0cf0 0x7f79b80b2690 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 >> 172.21.15.37:0/2733575318 conn(0x7f79b80d4fe0 msgr2=0x7f79b80ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.549+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 shutdown_connections 2024-05-10T08:46:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:54.550+0000 7f79bd1af640 1 -- 172.21.15.37:0/2733575318 wait complete. 2024-05-10T08:46:54.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:45:33.691603+0000', 'modified': '2024-05-10T08:46:54.186053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7137}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7137': {'gid': 7137, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6834/345427151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 345427151}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 345427151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:46:54.963 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7137:up:replay 2024-05-10T08:46:55.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:46:56.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 Processor -- start 2024-05-10T08:46:56.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 -- start start 2024-05-10T08:46:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3a015f420 0x7fb3a00d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3a00d3ca0 0x7fb3a00d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a01630b0 con 0x7fb3a00d3ca0 2024-05-10T08:46:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a00d2550 con 0x7fb3a015f420 2024-05-10T08:46:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.082+0000 7fb3a6075640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a00d2c80 con 0x7fb3a00d1eb0 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3a00d3ca0 0x7fb3a00d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3a00d3ca0 0x7fb3a00d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50194/0 (socket says 172.21.15.37:50194) 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 -- 172.21.15.37:0/685312075 learned_addr learned my addr 172.21.15.37:0/685312075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39ffff640 1 --2- 172.21.15.37:0/685312075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39f7fe640 1 --2- 172.21.15.37:0/685312075 >> v2:172.21.15.82:3300/0 conn(0x7fb3a015f420 0x7fb3a00d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 -- 172.21.15.37:0/685312075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 msgr2=0x7fb3a00d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 --2- 172.21.15.37:0/685312075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 -- 172.21.15.37:0/685312075 >> v2:172.21.15.82:3300/0 conn(0x7fb3a015f420 msgr2=0x7fb3a00d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 --2- 172.21.15.37:0/685312075 >> v2:172.21.15.82:3300/0 conn(0x7fb3a015f420 0x7fb3a00d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.083+0000 7fb39effd640 1 -- 172.21.15.37:0/685312075 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a00d2f60 con 0x7fb3a00d3ca0 2024-05-10T08:46:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.084+0000 7fb39effd640 1 --2- 172.21.15.37:0/685312075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d3ca0 0x7fb3a00d1970 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00d5ec0 tx=0x7fb39402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409bdb956e6c00f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.084+0000 7fb39e7fc640 1 -- 172.21.15.37:0/685312075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394037070 con 0x7fb3a00d3ca0 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.084+0000 7fb39e7fc640 1 -- 172.21.15.37:0/685312075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb394032440 con 0x7fb3a00d3ca0 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.084+0000 7fb39e7fc640 1 -- 172.21.15.37:0/685312075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394032810 con 0x7fb3a00d3ca0 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.084+0000 7fb3a6075640 1 -- 172.21.15.37:0/685312075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d3ca0 msgr2=0x7fb3a00d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.084+0000 7fb3a6075640 1 --2- 172.21.15.37:0/685312075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d3ca0 0x7fb3a00d1970 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00d5ec0 tx=0x7fb39402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.085+0000 7fb3a6075640 1 -- 172.21.15.37:0/685312075 shutdown_connections 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.085+0000 7fb3a6075640 1 --2- 172.21.15.37:0/685312075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.085+0000 7fb3a6075640 1 --2- 172.21.15.37:0/685312075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d3ca0 0x7fb3a00d1970 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.085+0000 7fb3a6075640 1 --2- 172.21.15.37:0/685312075 >> v2:172.21.15.82:3300/0 conn(0x7fb3a015f420 0x7fb3a00d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.085+0000 7fb3a6075640 1 -- 172.21.15.37:0/685312075 >> 172.21.15.37:0/685312075 conn(0x7fb3a008eac0 msgr2=0x7fb3a009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.085+0000 7fb3a6075640 1 -- 172.21.15.37:0/685312075 shutdown_connections 2024-05-10T08:46:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.085+0000 7fb3a6075640 1 -- 172.21.15.37:0/685312075 wait complete. 2024-05-10T08:46:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.086+0000 7fb3a6075640 1 Processor -- start 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.086+0000 7fb3a6075640 1 -- start start 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb3a6075640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb3a6075640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d0690 0x7fb3a00b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb3a6075640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a00b9190 0x7fb3a00b9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb3a6075640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a00d5200 con 0x7fb3a00d0690 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb3a6075640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a00d2830 con 0x7fb3a00b9190 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb3a6075640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a00d5380 con 0x7fb3a00d1eb0 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d0690 0x7fb3a00b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d0690 0x7fb3a00b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50206/0 (socket says 172.21.15.37:50206) 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 -- 172.21.15.37:0/1981833708 learned_addr learned my addr 172.21.15.37:0/1981833708 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39ffff640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a00b9190 0x7fb3a00b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39f7fe640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 -- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 msgr2=0x7fb3a00d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 -- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a00b9190 msgr2=0x7fb3a00b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a00b9190 0x7fb3a00b9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39effd640 1 -- 172.21.15.37:0/1981833708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01e8d00 con 0x7fb3a00d0690 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39f7fe640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.087+0000 7fb39ffff640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a00b9190 0x7fb3a00b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.088+0000 7fb39effd640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d0690 0x7fb3a00b8c50 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb394000c00 tx=0x7fb3940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.088+0000 7fb387fff640 1 -- 172.21.15.37:0/1981833708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394041020 con 0x7fb3a00d0690 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.088+0000 7fb387fff640 1 -- 172.21.15.37:0/1981833708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39403d620 con 0x7fb3a00d0690 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.088+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a01e8fe0 con 0x7fb3a00d0690 2024-05-10T08:46:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.088+0000 7fb387fff640 1 -- 172.21.15.37:0/1981833708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394037040 con 0x7fb3a00d0690 2024-05-10T08:46:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.088+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a01e95a0 con 0x7fb3a00d0690 2024-05-10T08:46:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.089+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a00693f0 con 0x7fb3a00d0690 2024-05-10T08:46:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.090+0000 7fb387fff640 1 -- 172.21.15.37:0/1981833708 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb394044020 con 0x7fb3a00d0690 2024-05-10T08:46:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.090+0000 7fb387fff640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb38c076300 0x7fb38c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.090+0000 7fb387fff640 1 -- 172.21.15.37:0/1981833708 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fb3940b7ed0 con 0x7fb3a00d0690 2024-05-10T08:46:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.090+0000 7fb39f7fe640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb38c076300 0x7fb38c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.091+0000 7fb39f7fe640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb38c076300 0x7fb38c0787c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00cf550 tx=0x7fb390008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.094+0000 7fb387fff640 1 -- 172.21.15.37:0/1981833708 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb39404b030 con 0x7fb3a00d0690 2024-05-10T08:46:56.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.325+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3a00b4c50 con 0x7fb3a00d0690 2024-05-10T08:46:56.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.326+0000 7fb387fff640 1 -- 172.21.15.37:0/1981833708 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5171 (secure 0 0 0) 0x7fb394081580 con 0x7fb3a00d0690 2024-05-10T08:46:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:56.325 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:55.194491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-05-10T08:46:56.325 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 72 2024-05-10T08:46:56.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb38c076300 msgr2=0x7fb38c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:56.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb38c076300 0x7fb38c0787c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00cf550 tx=0x7fb390008040 comp rx=0 tx=0).stop 2024-05-10T08:46:56.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d0690 msgr2=0x7fb3a00b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:56.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d0690 0x7fb3a00b8c50 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb394000c00 tx=0x7fb3940046c0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 shutdown_connections 2024-05-10T08:46:56.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb38c076300 0x7fb38c0787c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a00b9190 0x7fb3a00b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3a00d0690 0x7fb3a00b8c50 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 --2- 172.21.15.37:0/1981833708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a00d1eb0 0x7fb3a00d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:56.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 >> 172.21.15.37:0/1981833708 conn(0x7fb3a008eac0 msgr2=0x7fb3a00b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:56.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 shutdown_connections 2024-05-10T08:46:56.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:56.328+0000 7fb3a6075640 1 -- 172.21.15.37:0/1981833708 wait complete. 2024-05-10T08:46:56.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:45:33.691603+0000', 'modified': '2024-05-10T08:46:55.194491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7137}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7137': {'gid': 7137, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.37:6834/345427151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 345427151}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 345427151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:46:56.741 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7137:up:rejoin 2024-05-10T08:46:57.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:46:57.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.860+0000 7f69b77b6640 1 Processor -- start 2024-05-10T08:46:57.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.861+0000 7f69b77b6640 1 -- start start 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.861+0000 7f69b77b6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69b00d53d0 0x7f69b00d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.861+0000 7f69b77b6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b01630b0 con 0x7f69b015f420 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.861+0000 7f69b77b6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b00d3e70 con 0x7f69b00d1970 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.861+0000 7f69b77b6640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f69b00d2550 con 0x7f69b00d53d0 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69b5552640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f69b015f420 0x7f69b00d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41792/0 (socket says 172.21.15.37:41792) 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69b5552640 1 -- 172.21.15.37:0/4230003031 learned_addr learned my addr 172.21.15.37:0/4230003031 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69b5d53640 1 --2- 172.21.15.37:0/4230003031 >> v2:172.21.15.82:3300/0 conn(0x7f69b00d53d0 0x7f69b00d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363174459 0 0) 0x7f69ac001110 con 0x7f69b015f420 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f699c003520 con 0x7f69b015f420 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4235906825 0 0) 0x7f699c003520 con 0x7f69b015f420 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 >> v2:172.21.15.82:3300/0 conn(0x7f69b00d53d0 msgr2=0x7f69b00d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 --2- 172.21.15.37:0/4230003031 >> v2:172.21.15.82:3300/0 conn(0x7f69b00d53d0 0x7f69b00d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 >> v1:172.21.15.82:6789/0 conn(0x7f69b00d1970 legacy=0x7f69b00d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b00d2c80 con 0x7f69b015f420 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f69ac001840 con 0x7f69b015f420 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 >> v1:172.21.15.37:6789/0 conn(0x7f69b015f420 legacy=0x7f69b00d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c0039b0 0x7f699c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f699c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699c0051c0 0x7f699c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69b00d2550 con 0x7f699c004800 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f699c00c060 con 0x7f699c0039b0 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f699c00c260 con 0x7f699c0051c0 2024-05-10T08:46:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69b4d51640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f699c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69b5552640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c0039b0 0x7f699c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.862+0000 7f69b5d53640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699c0051c0 0x7f699c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.863+0000 7f69b4d51640 1 -- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699c0051c0 msgr2=0x7f699c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.863+0000 7f69b4d51640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f699c0051c0 0x7f699c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.863+0000 7f69b4d51640 1 -- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c0039b0 msgr2=0x7f699c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.863+0000 7f69b4d51640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c0039b0 0x7f699c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.863+0000 7f69b4d51640 1 -- 172.21.15.37:0/4230003031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c003520 con 0x7f699c004800 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.863+0000 7f69b5d53640 1 -- 172.21.15.37:0/4230003031 reap_dead start 2024-05-10T08:46:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.863+0000 7f69b4d51640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f699c004c80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f69a0001750 tx=0x7f699c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e851f3dd177e5552 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0001370 con 0x7f699c004800 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a00052d0 con 0x7f699c004800 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69a7fff640 1 -- 172.21.15.37:0/4230003031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a002abc0 con 0x7f699c004800 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69b77b6640 1 -- 172.21.15.37:0/4230003031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 msgr2=0x7f699c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69b77b6640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f699c004c80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f69a0001750 tx=0x7f699c005830 comp rx=0 tx=0).stop 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69b77b6640 1 -- 172.21.15.37:0/4230003031 shutdown_connections 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69b77b6640 1 --2- 172.21.15.37:0/4230003031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f699c004c80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69b77b6640 1 -- 172.21.15.37:0/4230003031 >> 172.21.15.37:0/4230003031 conn(0x7f69b008eac0 msgr2=0x7f69b009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69b77b6640 1 -- 172.21.15.37:0/4230003031 shutdown_connections 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.864+0000 7f69b77b6640 1 -- 172.21.15.37:0/4230003031 wait complete. 2024-05-10T08:46:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.865+0000 7f69b77b6640 1 Processor -- start 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b77b6640 1 -- start start 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b77b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f69b01f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b77b6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69b00ccc60 0x7f69b00b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b77b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69b00cd0e0 0x7f69b00ba460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b77b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69b00d2830 con 0x7f699c004800 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b77b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69b00d3240 con 0x7f69b00cd0e0 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b77b6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69b00d1e20 con 0x7f69b00ccc60 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b5552640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f69b01f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b5552640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f69b01f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59920/0 (socket says 172.21.15.37:59920) 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.866+0000 7f69b5552640 1 -- 172.21.15.37:0/3941673755 learned_addr learned my addr 172.21.15.37:0/3941673755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b4d51640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69b00ccc60 0x7f69b00b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b5d53640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69b00cd0e0 0x7f69b00ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b5552640 1 -- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69b00ccc60 msgr2=0x7f69b00b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b5552640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69b00ccc60 0x7f69b00b9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b5552640 1 -- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69b00cd0e0 msgr2=0x7f69b00ba460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b5552640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69b00cd0e0 0x7f69b00ba460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b5552640 1 -- 172.21.15.37:0/3941673755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b00b7cd0 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b5552640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f69b01f82a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f69ac007310 tx=0x7f69ac007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69a5ffb640 1 -- 172.21.15.37:0/3941673755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac001230 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69a5ffb640 1 -- 172.21.15.37:0/3941673755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ac018070 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b00b7fb0 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69a5ffb640 1 -- 172.21.15.37:0/3941673755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00fc00 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.867+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b00b8570 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.868+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b00693f0 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.869+0000 7f69a5ffb640 1 -- 172.21.15.37:0/3941673755 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69ac01d460 con 0x7f699c004800 2024-05-10T08:46:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.869+0000 7f69a5ffb640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6994076300 0x7f69940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.869+0000 7f69a5ffb640 1 -- 172.21.15.37:0/3941673755 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f69ac0976f0 con 0x7f699c004800 2024-05-10T08:46:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.870+0000 7f69b4d51640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6994076300 0x7f69940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.870+0000 7f69b4d51640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6994076300 0x7f69940787c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f69a0032000 tx=0x7f69a002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:57.874+0000 7f69a5ffb640 1 -- 172.21.15.37:0/3941673755 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f69b01630b0 con 0x7f699c004800 2024-05-10T08:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.102+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69b00b4c50 con 0x7f699c004800 2024-05-10T08:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.102+0000 7f69a5ffb640 1 -- 172.21.15.37:0/3941673755 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5178 (secure 0 0 0) 0x7f69ac060740 con 0x7f699c004800 2024-05-10T08:46:58.102 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:46:58.102 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:57.197376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":6}]} 2024-05-10T08:46:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 73 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6994076300 msgr2=0x7f69940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6994076300 0x7f69940787c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f69a0032000 tx=0x7f69a002e000 comp rx=0 tx=0).stop 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 msgr2=0x7f69b01f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f69b01f82a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f69ac007310 tx=0x7f69ac007710 comp rx=0 tx=0).stop 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 shutdown_connections 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6994076300 0x7f69940787c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69b00cd0e0 0x7f69b00ba460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69b00ccc60 0x7f69b00b9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 --2- 172.21.15.37:0/3941673755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f699c004800 0x7f69b01f82a0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 >> 172.21.15.37:0/3941673755 conn(0x7f69b008eac0 msgr2=0x7f69b00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 shutdown_connections 2024-05-10T08:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.104+0000 7f69b77b6640 1 -- 172.21.15.37:0/3941673755 wait complete. 2024-05-10T08:46:58.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:45:33.691603+0000', 'modified': '2024-05-10T08:46:57.197376+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7137}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7137': {'gid': 7137, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6834/345427151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 345427151}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 345427151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7137, 'qdb_cluster': [7137]} 2024-05-10T08:46:58.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:46:58.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:46:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.630+0000 7f6af4c20640 1 Processor -- start 2024-05-10T08:46:58.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.630+0000 7f6af4c20640 1 -- start start 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.631+0000 7f6af4c20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6af00b2490 0x7f6af0070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.631+0000 7f6af4c20640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6af0070d20 0x7f6af00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.631+0000 7f6af4c20640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af006e110 con 0x7f6af01629b0 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.631+0000 7f6af4c20640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6af006dec0 con 0x7f6af00b2490 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.631+0000 7f6af4c20640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6af006e3f0 con 0x7f6af0070d20 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aedd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6af00b2490 0x7f6af0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aedd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6af00b2490 0x7f6af0070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59926/0 (socket says 172.21.15.37:59926) 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2708280737 learned_addr learned my addr 172.21.15.37:0/2708280737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/2708280737 >> v2:172.21.15.82:3300/0 conn(0x7f6af0070d20 0x7f6af00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2708280737 >> v2:172.21.15.82:3300/0 conn(0x7f6af0070d20 msgr2=0x7f6af00711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/2708280737 >> v2:172.21.15.82:3300/0 conn(0x7f6af0070d20 0x7f6af00711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2708280737 >> v1:172.21.15.82:6789/0 conn(0x7f6af01629b0 legacy=0x7f6af006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2708280737 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af006e6d0 con 0x7f6af00b2490 2024-05-10T08:46:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.632+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/2708280737 >> v2:172.21.15.82:3300/0 conn(0x7f6af0070d20 0x7f6af00711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.633+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/2708280737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af00b2490 0x7f6af0070330 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6af0073f60 tx=0x7f6ae402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d107ab0158d910d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.633+0000 7f6aed59a640 1 -- 172.21.15.37:0/2708280737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4037070 con 0x7f6af00b2490 2024-05-10T08:46:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.633+0000 7f6aed59a640 1 -- 172.21.15.37:0/2708280737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae4032440 con 0x7f6af00b2490 2024-05-10T08:46:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.633+0000 7f6aed59a640 1 -- 172.21.15.37:0/2708280737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4032810 con 0x7f6af00b2490 2024-05-10T08:46:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.633+0000 7f6af4c20640 1 -- 172.21.15.37:0/2708280737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af00b2490 msgr2=0x7f6af0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.633+0000 7f6af4c20640 1 --2- 172.21.15.37:0/2708280737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af00b2490 0x7f6af0070330 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6af0073f60 tx=0x7f6ae402a270 comp rx=0 tx=0).stop 2024-05-10T08:46:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.634+0000 7f6af4c20640 1 -- 172.21.15.37:0/2708280737 shutdown_connections 2024-05-10T08:46:58.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.634+0000 7f6af4c20640 1 --2- 172.21.15.37:0/2708280737 >> v2:172.21.15.82:3300/0 conn(0x7f6af0070d20 0x7f6af00711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.634+0000 7f6af4c20640 1 --2- 172.21.15.37:0/2708280737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af00b2490 0x7f6af0070330 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.634+0000 7f6af4c20640 1 -- 172.21.15.37:0/2708280737 >> 172.21.15.37:0/2708280737 conn(0x7f6af00b49d0 msgr2=0x7f6af00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.634+0000 7f6af4c20640 1 -- 172.21.15.37:0/2708280737 shutdown_connections 2024-05-10T08:46:58.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.634+0000 7f6af4c20640 1 -- 172.21.15.37:0/2708280737 wait complete. 2024-05-10T08:46:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.635+0000 7f6af4c20640 1 Processor -- start 2024-05-10T08:46:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.635+0000 7f6af4c20640 1 -- start start 2024-05-10T08:46:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6af4c20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af0070d20 0x7f6af0160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6af4c20640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6af00b2490 0x7f6af00b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6af4c20640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af01629b0 0x7f6af00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6af4c20640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6af00709f0 con 0x7f6af0070d20 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6af4c20640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0070870 con 0x7f6af01629b0 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6af4c20640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6af00afcb0 con 0x7f6af00b2490 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af0070d20 0x7f6af0160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af0070d20 0x7f6af0160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59940/0 (socket says 172.21.15.37:59940) 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 -- 172.21.15.37:0/1162663143 learned_addr learned my addr 172.21.15.37:0/1162663143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6af00b2490 0x7f6af00b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af01629b0 0x7f6af00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 -- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6af00b2490 msgr2=0x7f6af00b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6af00b2490 0x7f6af00b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 -- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af01629b0 msgr2=0x7f6af00c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af01629b0 0x7f6af00c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 -- 172.21.15.37:0/1162663143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af00c9380 con 0x7f6af0070d20 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6aee59c640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af0070d20 0x7f6af0160cd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000c760 tx=0x7f6ae000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6adeffd640 1 -- 172.21.15.37:0/1162663143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0016020 con 0x7f6af0070d20 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.636+0000 7f6adeffd640 1 -- 172.21.15.37:0/1162663143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae0006d50 con 0x7f6af0070d20 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.637+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af00c9660 con 0x7f6af0070d20 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.637+0000 7f6adeffd640 1 -- 172.21.15.37:0/1162663143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0003bb0 con 0x7f6af0070d20 2024-05-10T08:46:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.637+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af00b6000 con 0x7f6af0070d20 2024-05-10T08:46:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.638+0000 7f6adeffd640 1 -- 172.21.15.37:0/1162663143 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ae000a850 con 0x7f6af0070d20 2024-05-10T08:46:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.639+0000 7f6adeffd640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6ad00762d0 0x7f6ad0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.639+0000 7f6adeffd640 1 -- 172.21.15.37:0/1162663143 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f6ae0097370 con 0x7f6af0070d20 2024-05-10T08:46:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.639+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6ad00762d0 0x7f6ad0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.639+0000 7f6af7a15740 1 Processor -- start 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.639+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6ad00762d0 0x7f6ad0078790 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4034000 tx=0x7f6ae402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.640+0000 7f6af7a15740 1 -- start start 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.640+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.640+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11deca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.640+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11aebb0 0x5570b11b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.640+0000 7f6af7a15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570b11188d0 con 0x5570b11aebb0 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.640+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5570b10d1c10 con 0x5570b11dbf50 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.640+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5570b1114890 con 0x5570b11dc330 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11aebb0 0x5570b11b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aedd9b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11aebb0 0x5570b11b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59952/0 (socket says 172.21.15.37:59952) 2024-05-10T08:46:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1544859031 learned_addr learned my addr 172.21.15.37:0/1544859031 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1544859031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 msgr2=0x5570b11deca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/1544859031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11deca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1544859031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 msgr2=0x5570b11de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/1544859031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1544859031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b10d95d0 con 0x5570b11aebb0 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/1544859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11aebb0 0x5570b11b23c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009960 tx=0x7f6ae8009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a85a1036c2fb05 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6acffff640 1 -- 172.21.15.37:0/1544859031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8019070 con 0x5570b11aebb0 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6acffff640 1 -- 172.21.15.37:0/1544859031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae8011aa0 con 0x5570b11aebb0 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.641+0000 7f6acffff640 1 -- 172.21.15.37:0/1544859031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae800f040 con 0x5570b11aebb0 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 -- 172.21.15.37:0/1544859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11aebb0 msgr2=0x5570b11b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1544859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11aebb0 0x5570b11b23c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009960 tx=0x7f6ae8009e20 comp rx=0 tx=0).stop 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 -- 172.21.15.37:0/1544859031 shutdown_connections 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1544859031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11aebb0 0x5570b11b23c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1544859031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1544859031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 -- 172.21.15.37:0/1544859031 >> 172.21.15.37:0/1544859031 conn(0x5570b11b0e20 msgr2=0x5570b11f9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 -- 172.21.15.37:0/1544859031 shutdown_connections 2024-05-10T08:46:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.642+0000 7f6af7a15740 1 -- 172.21.15.37:0/1544859031 wait complete. 2024-05-10T08:46:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.643+0000 7f6af7a15740 1 -- start start 2024-05-10T08:46:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.643+0000 7f6af7a15740 1 Processor -- start 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11d7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11fbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b11e1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570b11b3fd0 con 0x5570b11e13a0 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5570b10d5760 con 0x5570b11dbf50 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5570b11b42b0 con 0x5570b11dc330 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 10 client.0 _ll_register_callbacks cb 0x5570b110ecf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b11e1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b11e1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59956/0 (socket says 172.21.15.37:59956) 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 -- 172.21.15.37:0/3023098692 learned_addr learned my addr 172.21.15.37:0/3023098692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aee59c640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11d7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11fbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 -- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 msgr2=0x5570b11fbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11fbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 -- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 msgr2=0x5570b11d7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11d7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 -- 172.21.15.37:0/3023098692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b0e2a2d0 con 0x5570b11e13a0 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aee59c640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11d7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b11e1820 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8000c00 tx=0x7f6ae8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6054b525316cbd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6acd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6acd7fa640 1 -- 172.21.15.37:0/3023098692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8019070 con 0x5570b11e13a0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6acd7fa640 1 -- 172.21.15.37:0/3023098692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f6ae80118a0 con 0x5570b11e13a0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.644+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae8011aa0 con 0x5570b11e13a0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6acd7fa640 1 -- 172.21.15.37:0/3023098692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f6ae8004260 con 0x5570b11e13a0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 10 client.7215 fetch_fsmap learned FSMap version 73 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x5570b0ef46b0 con 0x5570b11e13a0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6acd7fa640 1 -- 172.21.15.37:0/3023098692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae8011aa0 con 0x5570b11e13a0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6acd7fa640 1 -- 172.21.15.37:0/3023098692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7f6ae8025020 con 0x5570b11e13a0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 10 client.7215 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 10 client.7215 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 20 client.7215 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11df790 0x5570b11dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 4 client.7215 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570b109c760 con 0x5570b11df790 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6aee59c640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11df790 0x5570b11dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6acd7fa640 10 client.7215 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.645+0000 7f6aee59c640 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11df790 0x5570b11dfb70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b107698c772a2ae4 server_cookie=ebdfcec93586652f in_seq=0 out_seq=0 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6acd7fa640 1 -- 172.21.15.37:0/3023098692 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5570b109c760 con 0x5570b11df790 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6acd7fa640 10 client.7215 handle_command_reply: tid=0 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 client.7215 shutdown 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 msgr2=0x5570b11e1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b11e1820 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8000c00 tx=0x7f6ae8004730 comp rx=0 tx=0).stop 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 shutdown_connections 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11df790 0x5570b11dfb70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b11e1820 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dc330 0x5570b11fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 --2- 172.21.15.37:0/3023098692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11d7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6acd7fa640 0 client.7215 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 >> 172.21.15.37:0/3023098692 conn(0x5570b11aebb0 msgr2=0x5570b11af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 shutdown_connections 2024-05-10T08:46:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.646+0000 7f6af7a15740 1 -- 172.21.15.37:0/3023098692 wait complete. 2024-05-10T08:46:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.647+0000 7f6af7a15740 20 client.7215 trim_cache size 0 max 16384 2024-05-10T08:46:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.665+0000 7f6af7a15740 1 Processor -- start 2024-05-10T08:46:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.665+0000 7f6af7a15740 1 -- start start 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dbf50 0x5570b11fc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dc330 0x5570b120da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b120df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6af7a15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0202360 con 0x5570b11e13a0 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0201340 con 0x5570b11dc330 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6af02006d0 con 0x5570b11dbf50 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b120df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b120df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59970/0 (socket says 172.21.15.37:59970) 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1995500977 learned_addr learned my addr 172.21.15.37:0/1995500977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aee59c640 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dbf50 0x5570b11fc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dc330 0x5570b120da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dbf50 msgr2=0x5570b11fc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dbf50 0x5570b11fc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dc330 msgr2=0x5570b120da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dc330 0x5570b120da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 -- 172.21.15.37:0/1995500977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b11d8360 con 0x5570b11e13a0 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aee59c640 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dbf50 0x5570b11fc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.666+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b120df40 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80044a0 tx=0x7f6ae8020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103a21fbf0321924 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6acf7fe640 1 -- 172.21.15.37:0/1995500977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8038070 con 0x5570b11e13a0 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6acf7fe640 1 -- 172.21.15.37:0/1995500977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae80157b0 con 0x5570b11e13a0 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6acf7fe640 1 -- 172.21.15.37:0/1995500977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8019040 con 0x5570b11e13a0 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 -- 172.21.15.37:0/1995500977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 msgr2=0x5570b120df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b120df40 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80044a0 tx=0x7f6ae8020040 comp rx=0 tx=0).stop 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 -- 172.21.15.37:0/1995500977 shutdown_connections 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11e13a0 0x5570b120df40 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dc330 0x5570b120da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 --2- 172.21.15.37:0/1995500977 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11dbf50 0x5570b11fc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 -- 172.21.15.37:0/1995500977 >> 172.21.15.37:0/1995500977 conn(0x5570b11aebb0 msgr2=0x5570b11db310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 -- 172.21.15.37:0/1995500977 shutdown_connections 2024-05-10T08:46:58.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.667+0000 7f6af7a15740 1 -- 172.21.15.37:0/1995500977 wait complete. 2024-05-10T08:46:58.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.668+0000 7f6af7a15740 1 -- start start 2024-05-10T08:46:58.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.668+0000 7f6af7a15740 1 Processor -- start 2024-05-10T08:46:58.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11dc330 0x5570b1276e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6af7a15740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11e13a0 0x5570b11d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6af7a15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570b11fd810 con 0x5570b11dc330 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0200d20 con 0x5570b11dbf50 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6af7a15740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5570b11d8530 con 0x5570b11e13a0 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6af7a15740 10 client.0 _ll_register_callbacks cb 0x7f6ae005cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11dc330 0x5570b1276e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11dc330 0x5570b1276e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59986/0 (socket says 172.21.15.37:59986) 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2433005906 learned_addr learned my addr 172.21.15.37:0/2433005906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aeed9d640 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11e13a0 0x5570b11d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aee59c640 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11e13a0 msgr2=0x5570b11d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11e13a0 0x5570b11d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 msgr2=0x5570b11b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 -- 172.21.15.37:0/2433005906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b11fcbe0 con 0x5570b11dc330 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6aedd9b640 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11dc330 0x5570b1276e30 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6ae402a860 tx=0x7f6ae402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e4939be99c3cc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.669+0000 7f6acd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6acd7fa640 1 -- 172.21.15.37:0/2433005906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4037040 con 0x5570b11dc330 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6acd7fa640 1 -- 172.21.15.37:0/2433005906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f6ae40479a0 con 0x5570b11dc330 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae80157b0 con 0x5570b11dc330 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6acd7fa640 1 -- 172.21.15.37:0/2433005906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f6ae4040020 con 0x5570b11dc330 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 10 client.7221 fetch_fsmap learned FSMap version 73 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x5570b1277370 con 0x5570b11dc330 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6acd7fa640 1 -- 172.21.15.37:0/2433005906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae80157b0 con 0x5570b11dc330 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6acd7fa640 1 -- 172.21.15.37:0/2433005906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7f6ae4047ba0 con 0x5570b11dc330 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 10 client.7221 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 10 client.7221 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 20 client.7221 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11d2c40 0x5570b121cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 4 client.7221 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:46:58.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "status"}) -- 0x5570b11264e0 con 0x5570b11d2c40 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6aee59c640 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11d2c40 0x5570b121cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.670+0000 7f6acd7fa640 10 client.7221 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6aee59c640 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11d2c40 0x5570b121cc60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6abe074a1c28e4 server_cookie=c780de9e9d2ed272 in_seq=0 out_seq=0 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6acd7fa640 1 -- 172.21.15.37:0/2433005906 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5570b11264e0 con 0x5570b11d2c40 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6acd7fa640 10 client.7221 handle_command_reply: tid=0 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 client.7221 shutdown 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11dc330 msgr2=0x5570b1276e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11dc330 0x5570b1276e30 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6ae402a860 tx=0x7f6ae402c070 comp rx=0 tx=0).stop 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 shutdown_connections 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5570b11d2c40 0x5570b121cc60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5570b11e13a0 0x5570b11d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570b11dc330 0x5570b1276e30 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6acd7fa640 0 client.7221 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:58.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 --2- 172.21.15.37:0/2433005906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570b11dbf50 0x5570b11b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 >> 172.21.15.37:0/2433005906 conn(0x5570b11aebb0 msgr2=0x5570b11ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 shutdown_connections 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 1 -- 172.21.15.37:0/2433005906 wait complete. 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.671+0000 7f6af7a15740 20 client.7221 trim_cache size 0 max 16384 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7137, 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:46:58.676 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:46:58.677 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.4821928560000002, 2024-05-10T08:46:58.677 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 73, 2024-05-10T08:46:58.677 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 91, 2024-05-10T08:46:58.677 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 91, 2024-05-10T08:46:58.677 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 5.4582259300000002 2024-05-10T08:46:58.677 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6ad00762d0 msgr2=0x7f6ad0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6ad00762d0 0x7f6ad0078790 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4034000 tx=0x7f6ae402e000 comp rx=0 tx=0).stop 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af0070d20 msgr2=0x7f6af0160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af0070d20 0x7f6af0160cd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000c760 tx=0x7f6ae000cc20 comp rx=0 tx=0).stop 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 shutdown_connections 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6ad00762d0 0x7f6ad0078790 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af01629b0 0x7f6af00c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6af00b2490 0x7f6af00b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 --2- 172.21.15.37:0/1162663143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af0070d20 0x7f6af0160cd0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 >> 172.21.15.37:0/1162663143 conn(0x7f6af00b49d0 msgr2=0x7f6af00b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 shutdown_connections 2024-05-10T08:46:58.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.672+0000 7f6af4c20640 1 -- 172.21.15.37:0/1162663143 wait complete. 2024-05-10T08:46:58.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.786+0000 7f080fd6a640 1 Processor -- start 2024-05-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.786+0000 7f080fd6a640 1 -- start start 2024-05-10T08:46:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080fd6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08081629a0 0x7f08080d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080fd6a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f08080d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080fd6a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08080d3330 con 0x7f08080d2dc0 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080fd6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f08080d2170 con 0x7f08081629a0 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080fd6a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f08080d2450 con 0x7f08080d0cb0 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080d305640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08080d2dc0 0x7f08080c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41800/0 (socket says 172.21.15.37:41800) 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080d305640 1 -- 172.21.15.37:0/3676001908 learned_addr learned my addr 172.21.15.37:0/3676001908 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080e307640 1 --2- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f08080d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080db06640 1 --2- 172.21.15.37:0/3676001908 >> v2:172.21.15.82:3300/0 conn(0x7f08081629a0 0x7f08080d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080cb04640 1 -- 172.21.15.37:0/3676001908 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839496053 0 0) 0x7f08080d3330 con 0x7f08080d2dc0 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080cb04640 1 -- 172.21.15.37:0/3676001908 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07f4003520 con 0x7f08080d2dc0 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080db06640 1 -- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 msgr2=0x7f08080d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080db06640 1 --2- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f08080d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080db06640 1 -- 172.21.15.37:0/3676001908 >> v1:172.21.15.37:6789/0 conn(0x7f08080d2dc0 legacy=0x7f08080c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.787+0000 7f080db06640 1 -- 172.21.15.37:0/3676001908 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08080d2730 con 0x7f08081629a0 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.788+0000 7f080db06640 1 --2- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081629a0 0x7f08080d35c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f08040097a0 tx=0x7f080402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564a568e7bc94fcd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.788+0000 7f080cb04640 1 -- 172.21.15.37:0/3676001908 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804037070 con 0x7f08081629a0 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.788+0000 7f080cb04640 1 -- 172.21.15.37:0/3676001908 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080402adb0 con 0x7f08081629a0 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.788+0000 7f080cb04640 1 -- 172.21.15.37:0/3676001908 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804032640 con 0x7f08081629a0 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 -- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081629a0 msgr2=0x7f08080d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 --2- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081629a0 0x7f08080d35c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f08040097a0 tx=0x7f080402a060 comp rx=0 tx=0).stop 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 -- 172.21.15.37:0/3676001908 shutdown_connections 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 --2- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f08080d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 --2- 172.21.15.37:0/3676001908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081629a0 0x7f08080d35c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 -- 172.21.15.37:0/3676001908 >> 172.21.15.37:0/3676001908 conn(0x7f08080d4fe0 msgr2=0x7f08080d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 -- 172.21.15.37:0/3676001908 shutdown_connections 2024-05-10T08:46:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.789+0000 7f080fd6a640 1 -- 172.21.15.37:0/3676001908 wait complete. 2024-05-10T08:46:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.790+0000 7f080fd6a640 1 Processor -- start 2024-05-10T08:46:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.790+0000 7f080fd6a640 1 -- start start 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080fd6a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f080815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080fd6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08080d2dc0 0x7f080809fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080fd6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08081629a0 0x7f08080a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080fd6a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08080cf440 con 0x7f08081629a0 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080fd6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08080cf2c0 con 0x7f08080d2dc0 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080fd6a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f08080c95e0 con 0x7f08080d0cb0 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08081629a0 0x7f08080a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08081629a0 0x7f08080a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60000/0 (socket says 172.21.15.37:60000) 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 -- 172.21.15.37:0/1610219878 learned_addr learned my addr 172.21.15.37:0/1610219878 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080d305640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08080d2dc0 0x7f080809fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080db06640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f080815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 -- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 msgr2=0x7f080815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f080815e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 -- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08080d2dc0 msgr2=0x7f080809fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08080d2dc0 0x7f080809fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 -- 172.21.15.37:0/1610219878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08081f5ef0 con 0x7f08081629a0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080db06640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f080815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080d305640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08080d2dc0 0x7f080809fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.791+0000 7f080e307640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08081629a0 0x7f08080a0160 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0800009dd0 tx=0x7f080000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.792+0000 7f07fe7fc640 1 -- 172.21.15.37:0/1610219878 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800018020 con 0x7f08081629a0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.792+0000 7f07fe7fc640 1 -- 172.21.15.37:0/1610219878 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0800014480 con 0x7f08081629a0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.792+0000 7f07fe7fc640 1 -- 172.21.15.37:0/1610219878 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800014870 con 0x7f08081629a0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.792+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08080a0790 con 0x7f08081629a0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.792+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081f6470 con 0x7f08081629a0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.792+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08080693f0 con 0x7f08081629a0 2024-05-10T08:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.793+0000 7f07fe7fc640 1 -- 172.21.15.37:0/1610219878 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0800005d10 con 0x7f08081629a0 2024-05-10T08:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.794+0000 7f07fe7fc640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07ec0762d0 0x7f07ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.794+0000 7f07fe7fc640 1 -- 172.21.15.37:0/1610219878 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f0800098300 con 0x7f08081629a0 2024-05-10T08:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.794+0000 7f080db06640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07ec0762d0 0x7f07ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.795+0000 7f080db06640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07ec0762d0 0x7f07ec078790 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0804034000 tx=0x7f080402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:58.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:58.798+0000 7f07fe7fc640 1 -- 172.21.15.37:0/1610219878 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0800022070 con 0x7f08081629a0 2024-05-10T08:46:59.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.032+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f08080caad0 con 0x7f08081629a0 2024-05-10T08:46:59.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.033+0000 7f07fe7fc640 1 -- 172.21.15.37:0/1610219878 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) ==== 53+0+73 (secure 0 0 0) 0x7f0800010040 con 0x7f08081629a0 2024-05-10T08:46:59.032 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:46:59.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07ec0762d0 msgr2=0x7f07ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07ec0762d0 0x7f07ec078790 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0804034000 tx=0x7f080402e000 comp rx=0 tx=0).stop 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08081629a0 msgr2=0x7f08080a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08081629a0 0x7f08080a0160 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0800009dd0 tx=0x7f080000c490 comp rx=0 tx=0).stop 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 shutdown_connections 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07ec0762d0 0x7f07ec078790 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08081629a0 0x7f08080a0160 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08080d2dc0 0x7f080809fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 --2- 172.21.15.37:0/1610219878 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08080d0cb0 0x7f080815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.034+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 >> 172.21.15.37:0/1610219878 conn(0x7f08080d4fe0 msgr2=0x7f080806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.035+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 shutdown_connections 2024-05-10T08:46:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.035+0000 7f080fd6a640 1 -- 172.21.15.37:0/1610219878 wait complete. 2024-05-10T08:46:59.044 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:46:59.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:46:59.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:46:59.044 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:46:59.045 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:46:59.045 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:46:59.045 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:46:59.045 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:46:59.045 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:46:59.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.045 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:46:59.062 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42343sec preferred_lft 42343sec 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:46:59.063 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:46:59.064 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:46:59.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.065 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:46:59.129 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:46:59.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.131 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:46:59.187 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:46:59.187 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:46:59.187 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:46:59.188 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:46:59.188 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:46:59.188 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:46:59.188 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:46:59.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:46:59.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:46:59.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:46:59.188 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:46:59.189 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:46:59.190+0000 7f8aec960640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:46:59.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:46:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:46:59.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.278 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:46:59.293 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:46:59.294 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:46:59.294 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:46:59.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:46:59.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:46:59.360 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:46:59.416 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:46:59.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:46:59.416 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:46:59.472 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:46:59.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:46:59.557 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:46:59.557 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:46:59.557 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:46:59.566 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:46:59.566 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:46:59.566 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:46:59.566 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:46:59.566 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:46:59.571 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:46:59.575 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:46:59.575 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:46:59.575 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:46:59.575 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:46:59.575 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:46:59.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:46:59.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:46:59.647 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:46:59.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:46:59.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:46:59.746 INFO:teuthology.orchestra.run.smithi037.stdout:client7230 2024-05-10T08:46:59.746 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:46:59.746 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:46:59.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-05-10T08:46:59.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.912+0000 7f4046807640 1 Processor -- start 2024-05-10T08:46:59.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.912+0000 7f4046807640 1 -- start start 2024-05-10T08:46:59.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f4046807640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40401629f0 0x7f40400d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f4046807640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d22a0 0x7f40400d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f4046807640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40400cde80 con 0x7f40400d1ba0 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f4046807640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f40400ce120 con 0x7f40401629f0 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f4046807640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f40400ce400 con 0x7f40400d22a0 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f403ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40401629f0 0x7f40400d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f403ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40401629f0 0x7f40400d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60012/0 (socket says 172.21.15.37:60012) 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f403ffff640 1 -- 172.21.15.37:0/1630210466 learned_addr learned my addr 172.21.15.37:0/1630210466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f4037fff640 1 --2- 172.21.15.37:0/1630210466 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d22a0 0x7f40400d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f403ffff640 1 -- 172.21.15.37:0/1630210466 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d22a0 msgr2=0x7f40400d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f403ffff640 1 --2- 172.21.15.37:0/1630210466 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d22a0 0x7f40400d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f403ffff640 1 -- 172.21.15.37:0/1630210466 >> v1:172.21.15.82:6789/0 conn(0x7f40400d1ba0 legacy=0x7f40400ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f403ffff640 1 -- 172.21.15.37:0/1630210466 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40400ce6e0 con 0x7f40401629f0 2024-05-10T08:46:59.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.913+0000 7f4037fff640 1 --2- 172.21.15.37:0/1630210466 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d22a0 0x7f40400d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.914+0000 7f403ffff640 1 --2- 172.21.15.37:0/1630210466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40401629f0 0x7f40400d1120 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4030009870 tx=0x7f403002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf5951cea4c46ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.914+0000 7f403f7fe640 1 -- 172.21.15.37:0/1630210466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030037070 con 0x7f40401629f0 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.914+0000 7f403f7fe640 1 -- 172.21.15.37:0/1630210466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4030032440 con 0x7f40401629f0 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.914+0000 7f403f7fe640 1 -- 172.21.15.37:0/1630210466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030032810 con 0x7f40401629f0 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 -- 172.21.15.37:0/1630210466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40401629f0 msgr2=0x7f40400d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 --2- 172.21.15.37:0/1630210466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40401629f0 0x7f40400d1120 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4030009870 tx=0x7f403002a270 comp rx=0 tx=0).stop 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 -- 172.21.15.37:0/1630210466 shutdown_connections 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 --2- 172.21.15.37:0/1630210466 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d22a0 0x7f40400d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 --2- 172.21.15.37:0/1630210466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40401629f0 0x7f40400d1120 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 -- 172.21.15.37:0/1630210466 >> 172.21.15.37:0/1630210466 conn(0x7f40400d2d80 msgr2=0x7f40400d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:59.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 -- 172.21.15.37:0/1630210466 shutdown_connections 2024-05-10T08:46:59.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.915+0000 7f4046807640 1 -- 172.21.15.37:0/1630210466 wait complete. 2024-05-10T08:46:59.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.916+0000 7f4046807640 1 Processor -- start 2024-05-10T08:46:59.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.916+0000 7f4046807640 1 -- start start 2024-05-10T08:46:59.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4046807640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d1ba0 0x7f40401592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4046807640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40400d22a0 0x7f40400b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4046807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40401629f0 0x7f40400b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4046807640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f404006e850 con 0x7f40400d22a0 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4046807640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f404006e6d0 con 0x7f40401629f0 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4046807640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f404006e9d0 con 0x7f40400d1ba0 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40400d22a0 0x7f40400b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40400d22a0 0x7f40400b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60022/0 (socket says 172.21.15.37:60022) 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 -- 172.21.15.37:0/1352095763 learned_addr learned my addr 172.21.15.37:0/1352095763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f403ffff640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d1ba0 0x7f40401592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 -- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d1ba0 msgr2=0x7f40401592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4044da4640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40401629f0 0x7f40400b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d1ba0 0x7f40401592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 -- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40401629f0 msgr2=0x7f40400b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40401629f0 0x7f40400b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 -- 172.21.15.37:0/1352095763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4040159830 con 0x7f40400d22a0 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4044da4640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40401629f0 0x7f40400b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.917+0000 7f4037fff640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40400d22a0 0x7f40400b2e30 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f402800e840 tx=0x7f402800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.918+0000 7f403d7fa640 1 -- 172.21.15.37:0/1352095763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402800f040 con 0x7f40400d22a0 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.918+0000 7f403d7fa640 1 -- 172.21.15.37:0/1352095763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4028004230 con 0x7f40400d22a0 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.918+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40400b0010 con 0x7f40400d22a0 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.918+0000 7f403d7fa640 1 -- 172.21.15.37:0/1352095763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402800c6d0 con 0x7f40400d22a0 2024-05-10T08:46:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.918+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40400b26c0 con 0x7f40400d22a0 2024-05-10T08:46:59.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.919+0000 7f403d7fa640 1 -- 172.21.15.37:0/1352095763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f402800c870 con 0x7f40400d22a0 2024-05-10T08:46:59.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.920+0000 7f403d7fa640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.920+0000 7f403d7fa640 1 -- 172.21.15.37:0/1352095763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f40280974b0 con 0x7f40400d22a0 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.920+0000 7f403ffff640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 Processor -- start 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 -- start start 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f403ffff640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4030034000 tx=0x7f403002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d8b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e7340 0x55dc9d8e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e6c00 0x55dc9d8bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d81fcf0 con 0x55dc9d8e7340 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d7d8e10 con 0x55dc9d8e6c00 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55dc9d81bcb0 con 0x55dc9d904220 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f4037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e7340 0x55dc9d8e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f4037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e7340 0x55dc9d8e66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60024/0 (socket says 172.21.15.37:60024) 2024-05-10T08:46:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.921+0000 7f4037fff640 1 -- 172.21.15.37:0/3967561634 learned_addr learned my addr 172.21.15.37:0/3967561634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f403ffff640 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d8b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4044da4640 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e6c00 0x55dc9d8bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4037fff640 1 -- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 msgr2=0x55dc9d8b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4037fff640 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d8b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4037fff640 1 -- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e6c00 msgr2=0x55dc9d8bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4037fff640 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e6c00 0x55dc9d8bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4037fff640 1 -- 172.21.15.37:0/3967561634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9d5f97e0 con 0x55dc9d8e7340 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4037fff640 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e7340 0x55dc9d8e66c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f402805c570 tx=0x7f402805fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d007f38633ed5c9c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4035ffb640 1 -- 172.21.15.37:0/3967561634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40280604f0 con 0x55dc9d8e7340 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4035ffb640 1 -- 172.21.15.37:0/3967561634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40280648a0 con 0x55dc9d8e7340 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.922+0000 7f4035ffb640 1 -- 172.21.15.37:0/3967561634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40280972e0 con 0x55dc9d8e7340 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 -- 172.21.15.37:0/3967561634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e7340 msgr2=0x55dc9d8e66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e7340 0x55dc9d8e66c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f402805c570 tx=0x7f402805fd20 comp rx=0 tx=0).stop 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 -- 172.21.15.37:0/3967561634 shutdown_connections 2024-05-10T08:46:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e6c00 0x55dc9d8bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e7340 0x55dc9d8e66c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 --2- 172.21.15.37:0/3967561634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d8b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 -- 172.21.15.37:0/3967561634 >> 172.21.15.37:0/3967561634 conn(0x55dc9d8b8e20 msgr2=0x55dc9d9016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 -- 172.21.15.37:0/3967561634 shutdown_connections 2024-05-10T08:46:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 -- 172.21.15.37:0/3967561634 wait complete. 2024-05-10T08:46:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.923+0000 7f40495f7740 1 -- start start 2024-05-10T08:46:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 1 Processor -- start 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e7340 0x55dc9d911e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d902de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d8e9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d8bafd0 con 0x55dc9d8e9180 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d7dc940 con 0x55dc9d8e7340 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55dc9d8ba3c0 con 0x55dc9d904220 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f40495f7740 10 client.0 _ll_register_callbacks cb 0x55dc9d7df440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f4044da4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d8e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f4044da4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d8e9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60034/0 (socket says 172.21.15.37:60034) 2024-05-10T08:46:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.924+0000 7f4044da4640 1 -- 172.21.15.37:0/1497950042 learned_addr learned my addr 172.21.15.37:0/1497950042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f4037fff640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d902de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f403ffff640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e7340 0x55dc9d911e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f4044da4640 1 -- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 msgr2=0x55dc9d902de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f4044da4640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d902de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f4044da4640 1 -- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e7340 msgr2=0x55dc9d911e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f4044da4640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e7340 0x55dc9d911e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f4044da4640 1 -- 172.21.15.37:0/1497950042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9d659f70 con 0x55dc9d8e9180 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f403ffff640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e7340 0x55dc9d911e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f4044da4640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d8e9600 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4038010810 tx=0x7f4038010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af2fdd00220219a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f401effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f401effd640 1 -- 172.21.15.37:0/1497950042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038003b70 con 0x55dc9d8e9180 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f401effd640 1 -- 172.21.15.37:0/1497950042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f4038003d10 con 0x55dc9d8e9180 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40280648a0 con 0x55dc9d8e9180 2024-05-10T08:46:59.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f401effd640 1 -- 172.21.15.37:0/1497950042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f4038021050 con 0x55dc9d8e9180 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f40495f7740 10 client.7242 fetch_fsmap learned FSMap version 73 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x55dc9d4f1170 con 0x55dc9d8e9180 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f401effd640 1 -- 172.21.15.37:0/1497950042 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40280648a0 con 0x55dc9d8e9180 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f401effd640 1 -- 172.21.15.37:0/1497950042 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7f4038024020 con 0x55dc9d8e9180 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f40495f7740 10 client.7242 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f40495f7740 10 client.7242 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f40495f7740 20 client.7242 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.925+0000 7f40495f7740 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d900080 0x55dc9d915840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.926+0000 7f40495f7740 4 client.7242 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.926+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc9d82d900 con 0x55dc9d900080 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.926+0000 7f403ffff640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d900080 0x55dc9d915840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.926+0000 7f403ffff640 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d900080 0x55dc9d915840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7b1a584413b6a2 server_cookie=1470dc92a97f1077 in_seq=0 out_seq=0 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.926+0000 7f401effd640 10 client.7242 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f401effd640 1 -- 172.21.15.37:0/1497950042 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dc9d82d900 con 0x55dc9d900080 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f401effd640 10 client.7242 handle_command_reply: tid=0 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 client.7242 shutdown 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 msgr2=0x55dc9d8e9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d8e9600 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4038010810 tx=0x7f4038010cd0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 shutdown_connections 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d900080 0x55dc9d915840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d8e9600 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d904220 0x55dc9d902de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 --2- 172.21.15.37:0/1497950042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e7340 0x55dc9d911e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f401effd640 0 client.7242 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 >> 172.21.15.37:0/1497950042 conn(0x55dc9d8e6c00 msgr2=0x55dc9d8b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 shutdown_connections 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 1 -- 172.21.15.37:0/1497950042 wait complete. 2024-05-10T08:46:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.927+0000 7f40495f7740 20 client.7242 trim_cache size 0 max 16384 2024-05-10T08:46:59.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.945+0000 7f40495f7740 1 Processor -- start 2024-05-10T08:46:59.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.945+0000 7f40495f7740 1 -- start start 2024-05-10T08:46:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d904ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e9180 0x55dc9d91b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f40495f7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d904220 0x55dc9d900470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f40495f7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40402021d0 con 0x55dc9d904220 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40402011f0 con 0x55dc9d8e9180 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4040200600 con 0x55dc9d8e7340 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d904220 0x55dc9d900470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d904220 0x55dc9d900470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60050/0 (socket says 172.21.15.37:60050) 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 -- 172.21.15.37:0/1253790350 learned_addr learned my addr 172.21.15.37:0/1253790350 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f403ffff640 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d904ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4037fff640 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e9180 0x55dc9d91b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 -- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 msgr2=0x55dc9d904ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d904ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 -- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e9180 msgr2=0x55dc9d91b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e9180 0x55dc9d91b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.946+0000 7f4044da4640 1 -- 172.21.15.37:0/1253790350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9d8b78f0 con 0x55dc9d904220 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f4044da4640 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d904220 0x55dc9d900470 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4038010500 tx=0x7f4038015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bf9771ffe4e91d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40357fa640 1 -- 172.21.15.37:0/1253790350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403800eb80 con 0x55dc9d904220 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40357fa640 1 -- 172.21.15.37:0/1253790350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403800ed40 con 0x55dc9d904220 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40357fa640 1 -- 172.21.15.37:0/1253790350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038003bb0 con 0x55dc9d904220 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 -- 172.21.15.37:0/1253790350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d904220 msgr2=0x55dc9d900470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d904220 0x55dc9d900470 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4038010500 tx=0x7f4038015000 comp rx=0 tx=0).stop 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 -- 172.21.15.37:0/1253790350 shutdown_connections 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d904220 0x55dc9d900470 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d8e9180 0x55dc9d91b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 --2- 172.21.15.37:0/1253790350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d904ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 -- 172.21.15.37:0/1253790350 >> 172.21.15.37:0/1253790350 conn(0x55dc9d8e6c00 msgr2=0x55dc9d9156a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 -- 172.21.15.37:0/1253790350 shutdown_connections 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.947+0000 7f40495f7740 1 -- 172.21.15.37:0/1253790350 wait complete. 2024-05-10T08:46:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.948+0000 7f40495f7740 1 -- start start 2024-05-10T08:46:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.948+0000 7f40495f7740 1 Processor -- start 2024-05-10T08:46:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d969090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f40495f7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d90e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f40495f7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d904220 0x55dc9d8bc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f40495f7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4040200bd0 con 0x55dc9d8e9180 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d8e8840 con 0x55dc9d904220 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f40495f7740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55dc9d8b5c70 con 0x55dc9d8e7340 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f40495f7740 10 client.0 _ll_register_callbacks cb 0x7f4038001a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d90e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d90e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60056/0 (socket says 172.21.15.37:60056) 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 -- 172.21.15.37:0/2239167567 learned_addr learned my addr 172.21.15.37:0/2239167567 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f403ffff640 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d969090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4044da4640 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d904220 0x55dc9d8bc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 -- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 msgr2=0x55dc9d969090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d969090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 -- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d904220 msgr2=0x55dc9d8bc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d904220 0x55dc9d8bc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 -- 172.21.15.37:0/2239167567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9d8b5a60 con 0x55dc9d8e9180 2024-05-10T08:46:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f4037fff640 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d90e7e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f4028095810 tx=0x7f4028000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226983cff0f3ef13 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.949+0000 7f401effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f401effd640 1 -- 172.21.15.37:0/2239167567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028093060 con 0x55dc9d8e9180 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f401effd640 1 -- 172.21.15.37:0/2239167567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f402800cb60 con 0x55dc9d8e9180 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f403800ed40 con 0x55dc9d8e9180 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f401effd640 1 -- 172.21.15.37:0/2239167567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f402807e050 con 0x55dc9d8e9180 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 10 client.7248 fetch_fsmap learned FSMap version 73 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x55dc9d8f9370 con 0x55dc9d8e9180 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f401effd640 1 -- 172.21.15.37:0/2239167567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403800ed40 con 0x55dc9d8e9180 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f401effd640 1 -- 172.21.15.37:0/2239167567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7f4028012050 con 0x55dc9d8e9180 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 10 client.7248 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 10 client.7248 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 20 client.7248 populate_metadata read hostname 'smithi037' 2024-05-10T08:46:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d8bcda0 0x55dc9d8e9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 4 client.7248 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x55dc9d827770 con 0x55dc9d8bcda0 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f403ffff640 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d8bcda0 0x55dc9d8e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f403ffff640 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d8bcda0 0x55dc9d8e9560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea5b3805ec0d0643 server_cookie=8464b6facec16741 in_seq=0 out_seq=0 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.950+0000 7f401effd640 10 client.7248 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f401effd640 1 -- 172.21.15.37:0/2239167567 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dc9d827770 con 0x55dc9d8bcda0 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f401effd640 10 client.7248 handle_command_reply: tid=0 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 client.7248 shutdown 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 msgr2=0x55dc9d90e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d90e7e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f4028095810 tx=0x7f4028000bc0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 shutdown_connections 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x55dc9d8bcda0 0x55dc9d8e9560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc9d904220 0x55dc9d8bc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc9d8e9180 0x55dc9d90e7e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f401effd640 0 client.7248 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 --2- 172.21.15.37:0/2239167567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55dc9d8e7340 0x55dc9d969090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 >> 172.21.15.37:0/2239167567 conn(0x55dc9d8e6c00 msgr2=0x55dc9d911a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 shutdown_connections 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 1 -- 172.21.15.37:0/2239167567 wait complete. 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.951+0000 7f40495f7740 20 client.7248 trim_cache size 0 max 16384 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "81c81856-734b-4e3c-b567-19bd9ee4f831", 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:46:59.956 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:46:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 msgr2=0x7f4020078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4030034000 tx=0x7f403002e000 comp rx=0 tx=0).stop 2024-05-10T08:46:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40400d22a0 msgr2=0x7f40400b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40400d22a0 0x7f40400b2e30 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f402800e840 tx=0x7f402800ed00 comp rx=0 tx=0).stop 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 shutdown_connections 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40200762d0 0x7f4020078790 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40401629f0 0x7f40400b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40400d22a0 0x7f40400b2e30 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 --2- 172.21.15.37:0/1352095763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40400d1ba0 0x7f40401592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 >> 172.21.15.37:0/1352095763 conn(0x7f40400d2d80 msgr2=0x7f4040071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 shutdown_connections 2024-05-10T08:46:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:46:59.952+0000 7f4046807640 1 -- 172.21.15.37:0/1352095763 wait complete. 2024-05-10T08:46:59.958 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:46:59.953+0000 7f8ae8958640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x55714541c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:46:59.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:46:59.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T08:47:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.068+0000 7ff84be59640 1 Processor -- start 2024-05-10T08:47:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.068+0000 7ff84be59640 1 -- start start 2024-05-10T08:47:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff84be59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff84415ce90 0x7ff844070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff84be59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8440733e0 0x7ff8440d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff84be59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 0x7ff84406d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff84be59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff84406dd60 con 0x7ff84415ce90 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff84be59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff844071280 con 0x7ff8440733e0 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff84be59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff8440cff00 con 0x7ff84406d3b0 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff84415ce90 0x7ff844070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff84415ce90 0x7ff844070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60058/0 (socket says 172.21.15.37:60058) 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 -- 172.21.15.37:0/2042760406 learned_addr learned my addr 172.21.15.37:0/2042760406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/2042760406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 0x7ff84406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff8493f4640 1 --2- 172.21.15.37:0/2042760406 >> v2:172.21.15.82:3300/0 conn(0x7ff8440733e0 0x7ff8440d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 -- 172.21.15.37:0/2042760406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 msgr2=0x7ff84406d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 --2- 172.21.15.37:0/2042760406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 0x7ff84406d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 -- 172.21.15.37:0/2042760406 >> v2:172.21.15.82:3300/0 conn(0x7ff8440733e0 msgr2=0x7ff8440d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 --2- 172.21.15.37:0/2042760406 >> v2:172.21.15.82:3300/0 conn(0x7ff8440733e0 0x7ff8440d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.069+0000 7ff849bf5640 1 -- 172.21.15.37:0/2042760406 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff844073950 con 0x7ff84415ce90 2024-05-10T08:47:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.070+0000 7ff849bf5640 1 --2- 172.21.15.37:0/2042760406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84415ce90 0x7ff844070d40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff8440cde40 tx=0x7ff83c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68e3887ec0dadf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.070+0000 7ff848bf3640 1 -- 172.21.15.37:0/2042760406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c037070 con 0x7ff84415ce90 2024-05-10T08:47:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.070+0000 7ff848bf3640 1 -- 172.21.15.37:0/2042760406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c032440 con 0x7ff84415ce90 2024-05-10T08:47:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.070+0000 7ff848bf3640 1 -- 172.21.15.37:0/2042760406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c032810 con 0x7ff84415ce90 2024-05-10T08:47:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 -- 172.21.15.37:0/2042760406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84415ce90 msgr2=0x7ff844070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 --2- 172.21.15.37:0/2042760406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84415ce90 0x7ff844070d40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff8440cde40 tx=0x7ff83c02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 -- 172.21.15.37:0/2042760406 shutdown_connections 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 --2- 172.21.15.37:0/2042760406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 0x7ff84406d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 --2- 172.21.15.37:0/2042760406 >> v2:172.21.15.82:3300/0 conn(0x7ff8440733e0 0x7ff8440d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 --2- 172.21.15.37:0/2042760406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84415ce90 0x7ff844070d40 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 -- 172.21.15.37:0/2042760406 >> 172.21.15.37:0/2042760406 conn(0x7ff8440728c0 msgr2=0x7ff844072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 -- 172.21.15.37:0/2042760406 shutdown_connections 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.071+0000 7ff84be59640 1 -- 172.21.15.37:0/2042760406 wait complete. 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.072+0000 7ff84be59640 1 Processor -- start 2024-05-10T08:47:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.072+0000 7ff84be59640 1 -- start start 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff84be59640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 0x7ff8440b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff84be59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8440733e0 0x7ff844142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff84be59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff84415ce90 0x7ff844143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff84be59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440d0760 con 0x7ff8440733e0 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff84be59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440d0480 con 0x7ff84415ce90 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff84be59640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff84415d270 con 0x7ff84406d3b0 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8440733e0 0x7ff844142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8440733e0 0x7ff844142f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60062/0 (socket says 172.21.15.37:60062) 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 -- 172.21.15.37:0/353072901 learned_addr learned my addr 172.21.15.37:0/353072901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff84415ce90 0x7ff844143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 -- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 msgr2=0x7ff8440b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 0x7ff8440b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 -- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff84415ce90 msgr2=0x7ff844143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff84415ce90 0x7ff844143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.073+0000 7ff8493f4640 1 -- 172.21.15.37:0/353072901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8440c6760 con 0x7ff8440733e0 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.074+0000 7ff8493f4640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8440733e0 0x7ff844142f00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff83800e9b0 tx=0x7ff83800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.074+0000 7ff8427fc640 1 -- 172.21.15.37:0/353072901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838017070 con 0x7ff8440733e0 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.074+0000 7ff8427fc640 1 -- 172.21.15.37:0/353072901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83800c9a0 con 0x7ff8440733e0 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.074+0000 7ff8427fc640 1 -- 172.21.15.37:0/353072901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83800cd90 con 0x7ff8440733e0 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.074+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8440c6a40 con 0x7ff8440733e0 2024-05-10T08:47:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.074+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8440c7000 con 0x7ff8440733e0 2024-05-10T08:47:00.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.075+0000 7ff8427fc640 1 -- 172.21.15.37:0/353072901 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff83801a070 con 0x7ff8440733e0 2024-05-10T08:47:00.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.076+0000 7ff8427fc640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff830076300 0x7ff8300787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.076+0000 7ff8427fc640 1 -- 172.21.15.37:0/353072901 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7ff838097c60 con 0x7ff8440733e0 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.076+0000 7ff849bf5640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff830076300 0x7ff8300787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff849bf5640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff830076300 0x7ff8300787c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff83c034000 tx=0x7ff83c02c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 Processor -- start 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 -- start start 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea985af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9b6280 0x5581ea9b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b5b40 0x5581ea98a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581ea952690 con 0x5581ea9b6280 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5581ea8eff30 con 0x5581ea9d3160 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.077+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5581ea8a8b20 con 0x5581ea9b5b40 2024-05-10T08:47:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9b6280 0x5581ea9b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9b6280 0x5581ea9b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60070/0 (socket says 172.21.15.37:60070) 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 -- 172.21.15.37:0/1059732227 learned_addr learned my addr 172.21.15.37:0/1059732227 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff849bf5640 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea985af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b5b40 0x5581ea98a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 -- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b5b40 msgr2=0x5581ea98a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b5b40 0x5581ea98a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 -- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 msgr2=0x5581ea985af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea985af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 -- 172.21.15.37:0/1059732227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581ea8a0e60 con 0x5581ea9b6280 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff8493f4640 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9b6280 0x5581ea9b5600 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff83805cbf0 tx=0x7ff8380603a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349ffbd8141f0db7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff82b7fe640 1 -- 172.21.15.37:0/1059732227 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83807a070 con 0x5581ea9b6280 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff82b7fe640 1 -- 172.21.15.37:0/1059732227 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff838069290 con 0x5581ea9b6280 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.078+0000 7ff82b7fe640 1 -- 172.21.15.37:0/1059732227 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838021040 con 0x5581ea9b6280 2024-05-10T08:47:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 -- 172.21.15.37:0/1059732227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9b6280 msgr2=0x5581ea9b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9b6280 0x5581ea9b5600 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff83805cbf0 tx=0x7ff8380603a0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 -- 172.21.15.37:0/1059732227 shutdown_connections 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b5b40 0x5581ea98a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9b6280 0x5581ea9b5600 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 --2- 172.21.15.37:0/1059732227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea985af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 -- 172.21.15.37:0/1059732227 >> 172.21.15.37:0/1059732227 conn(0x5581ea987d60 msgr2=0x5581ea9d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 -- 172.21.15.37:0/1059732227 shutdown_connections 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 -- 172.21.15.37:0/1059732227 wait complete. 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.079+0000 7ff84eb73740 1 -- start start 2024-05-10T08:47:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.080+0000 7ff84eb73740 1 Processor -- start 2024-05-10T08:47:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.080+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.080+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea9a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.080+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.080+0000 7ff84eb73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581ea8ac5e0 con 0x5581ea9e0520 2024-05-10T08:47:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.080+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5581ea8ebef0 con 0x5581ea9d3160 2024-05-10T08:47:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.080+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5581ea989f10 con 0x5581ea9b6280 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84eb73740 10 client.0 _ll_register_callbacks cb 0x5581ea8a7320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60078/0 (socket says 172.21.15.37:60078) 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 -- 172.21.15.37:0/669122508 learned_addr learned my addr 172.21.15.37:0/669122508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff849bf5640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff8493f4640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea9a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 -- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 msgr2=0x5581ea9d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 -- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 msgr2=0x5581ea9a2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea9a2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 -- 172.21.15.37:0/669122508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581ea6cb7d0 con 0x5581ea9e0520 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff849bf5640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9b6770 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff834004320 tx=0x7ff8340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4301be00c2bc78f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff828ff9640 1 -- 172.21.15.37:0/669122508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834019020 con 0x5581ea9e0520 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff828ff9640 1 -- 172.21.15.37:0/669122508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7ff834007b60 con 0x5581ea9e0520 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838069290 con 0x5581ea9e0520 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff828ff9640 1 -- 172.21.15.37:0/669122508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7ff834023050 con 0x5581ea9e0520 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84eb73740 10 client.7260 fetch_fsmap learned FSMap version 73 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.081+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x5581ea6013f0 con 0x5581ea9e0520 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff828ff9640 1 -- 172.21.15.37:0/669122508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff838069290 con 0x5581ea9e0520 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff828ff9640 1 -- 172.21.15.37:0/669122508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7ff834026020 con 0x5581ea9e0520 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff84eb73740 10 client.7260 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff84eb73740 10 client.7260 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff84eb73740 20 client.7260 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff84eb73740 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9e4770 0x5581ea9b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff84eb73740 4 client.7260 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581ea8fdb40 con 0x5581ea9e4770 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff849bf5640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9e4770 0x5581ea9b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff828ff9640 10 client.7260 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.082+0000 7ff849bf5640 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9e4770 0x5581ea9b4b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb1122a2d7b03931 server_cookie=97ed494dd71c81ee in_seq=0 out_seq=0 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff828ff9640 1 -- 172.21.15.37:0/669122508 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5581ea8fdb40 con 0x5581ea9e4770 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff828ff9640 10 client.7260 handle_command_reply: tid=0 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 client.7260 shutdown 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 msgr2=0x5581ea9b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9b6770 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff834004320 tx=0x7ff8340047e0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 shutdown_connections 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9e4770 0x5581ea9b4b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9b6770 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea9a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff828ff9640 0 client.7260 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 --2- 172.21.15.37:0/669122508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 >> 172.21.15.37:0/669122508 conn(0x5581ea9b5b40 msgr2=0x5581ea985230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 shutdown_connections 2024-05-10T08:47:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 1 -- 172.21.15.37:0/669122508 wait complete. 2024-05-10T08:47:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.083+0000 7ff84eb73740 20 client.7260 trim_cache size 0 max 16384 2024-05-10T08:47:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.101+0000 7ff84eb73740 1 Processor -- start 2024-05-10T08:47:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.101+0000 7ff84eb73740 1 -- start start 2024-05-10T08:47:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea9a1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84eb73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff844202180 con 0x5581ea9e0520 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff844201160 con 0x5581ea9d3160 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff8442004d0 con 0x5581ea9b6280 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9a19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60090/0 (socket says 172.21.15.37:60090) 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3675754914 learned_addr learned my addr 172.21.15.37:0/3675754914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3675754914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 msgr2=0x5581ea9d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/3675754914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3675754914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 msgr2=0x5581ea9a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/3675754914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea9a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.102+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3675754914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581ea5c10f0 con 0x5581ea9e0520 2024-05-10T08:47:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/3675754914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9a19b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff834003db0 tx=0x7ff83400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde58b1a1a8c3943 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff82affd640 1 -- 172.21.15.37:0/3675754914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834019020 con 0x5581ea9e0520 2024-05-10T08:47:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff82affd640 1 -- 172.21.15.37:0/3675754914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff834007b60 con 0x5581ea9e0520 2024-05-10T08:47:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff82affd640 1 -- 172.21.15.37:0/3675754914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83401e5d0 con 0x5581ea9e0520 2024-05-10T08:47:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 -- 172.21.15.37:0/3675754914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 msgr2=0x5581ea9a19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3675754914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9a19b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff834003db0 tx=0x7ff83400f000 comp rx=0 tx=0).stop 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 -- 172.21.15.37:0/3675754914 shutdown_connections 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3675754914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea9a19b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3675754914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9d3160 0x5581ea9a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3675754914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9b6280 0x5581ea9d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 -- 172.21.15.37:0/3675754914 >> 172.21.15.37:0/3675754914 conn(0x5581ea9b5b40 msgr2=0x5581ea9d3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 -- 172.21.15.37:0/3675754914 shutdown_connections 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.103+0000 7ff84eb73740 1 -- 172.21.15.37:0/3675754914 wait complete. 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.104+0000 7ff84eb73740 1 -- start start 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.104+0000 7ff84eb73740 1 Processor -- start 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9b6280 0x5581eaa4d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9d3160 0x5581ea9849a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84eb73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea984ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84eb73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581ea985ea0 con 0x5581ea9e0520 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff844200b20 con 0x5581ea9b6280 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84eb73740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5581ea9a1470 con 0x5581ea9d3160 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84eb73740 10 client.0 _ll_register_callbacks cb 0x7ff834009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea984ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea984ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60098/0 (socket says 172.21.15.37:60098) 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3418227055 learned_addr learned my addr 172.21.15.37:0/3418227055 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff8493f4640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9d3160 0x5581ea9849a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff849bf5640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9b6280 0x5581eaa4d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9d3160 msgr2=0x5581ea9849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9d3160 0x5581ea9849a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9b6280 msgr2=0x5581eaa4d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9b6280 0x5581eaa4d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 -- 172.21.15.37:0/3418227055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581ea989b10 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff849bf5640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9b6280 0x5581eaa4d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff8493f4640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9d3160 0x5581ea9849a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff84a3f6640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea984ee0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff834004320 tx=0x7ff834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a74ec37faad4cfa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.105+0000 7ff828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff828ff9640 1 -- 172.21.15.37:0/3418227055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834035060 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff828ff9640 1 -- 172.21.15.37:0/3418227055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7ff834002030 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff834007b60 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff828ff9640 1 -- 172.21.15.37:0/3418227055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7ff83403b050 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 10 client.7266 fetch_fsmap learned FSMap version 73 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x5581ea9a1720 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff828ff9640 1 -- 172.21.15.37:0/3418227055 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff834007b60 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff828ff9640 1 -- 172.21.15.37:0/3418227055 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7ff83403e020 con 0x5581ea9e0520 2024-05-10T08:47:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 10 client.7266 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 10 client.7266 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 20 client.7266 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9cd5e0 0x5581ea9b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 4 client.7266 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5581ea8f79b0 con 0x5581ea9cd5e0 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff849bf5640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9cd5e0 0x5581ea9b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.106+0000 7ff828ff9640 10 client.7266 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff849bf5640 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9cd5e0 0x5581ea9b2100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e019bcf073232561 server_cookie=85730f77f42f351e in_seq=0 out_seq=0 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff828ff9640 1 -- 172.21.15.37:0/3418227055 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x5581ea8f79b0 con 0x5581ea9cd5e0 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff828ff9640 10 client.7266 handle_command_reply: tid=0 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 client.7266 shutdown 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 msgr2=0x5581ea984ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea984ee0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff834004320 tx=0x7ff834004a40 comp rx=0 tx=0).stop 2024-05-10T08:47:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 shutdown_connections 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5581ea9cd5e0 0x5581ea9b2100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581ea9e0520 0x5581ea984ee0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5581ea9d3160 0x5581ea9849a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff828ff9640 0 client.7266 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 --2- 172.21.15.37:0/3418227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581ea9b6280 0x5581eaa4d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 >> 172.21.15.37:0/3418227055 conn(0x5581ea9b5b40 msgr2=0x5581ea9d4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 shutdown_connections 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 1 -- 172.21.15.37:0/3418227055 wait complete. 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.107+0000 7ff84eb73740 20 client.7266 trim_cache size 0 max 16384 2024-05-10T08:47:00.112 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: "81c81856-734b-4e3c-b567-19bd9ee4f831": { 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/dir", 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "81c81856-734b-4e3c-b567-19bd9ee4f831", 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:00.113 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:47:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff830076300 msgr2=0x7ff8300787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff830076300 0x7ff8300787c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff83c034000 tx=0x7ff83c02c000 comp rx=0 tx=0).stop 2024-05-10T08:47:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8440733e0 msgr2=0x7ff844142f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8440733e0 0x7ff844142f00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff83800e9b0 tx=0x7ff83800ee70 comp rx=0 tx=0).stop 2024-05-10T08:47:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 shutdown_connections 2024-05-10T08:47:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff830076300 0x7ff8300787c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff84415ce90 0x7ff844143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8440733e0 0x7ff844142f00 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 --2- 172.21.15.37:0/353072901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff84406d3b0 0x7ff8440b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 >> 172.21.15.37:0/353072901 conn(0x7ff8440728c0 msgr2=0x7ff8440b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 shutdown_connections 2024-05-10T08:47:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:00.108+0000 7ff84be59640 1 -- 172.21.15.37:0/353072901 wait complete. 2024-05-10T08:47:00.117 INFO:tasks.cephfs.filesystem:scrub status for tag:81c81856-734b-4e3c-b567-19bd9ee4f831 - {'path': '/dir', 'tag': '81c81856-734b-4e3c-b567-19bd9ee4f831', 'options': 'recursive,repair'} 2024-05-10T08:47:24.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:47:24.184 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:47:30.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:30.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-05-10T08:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.239+0000 7fa3ce522640 1 Processor -- start 2024-05-10T08:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.239+0000 7fa3ce522640 1 -- start start 2024-05-10T08:47:30.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.240+0000 7fa3ce522640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa3c806e0f0 0x7fa3c80cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.240+0000 7fa3ce522640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c815d2a0 con 0x7fa3c806f060 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.240+0000 7fa3ce522640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c81609b0 con 0x7fa3c80d0360 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.240+0000 7fa3ce522640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c80d07c0 con 0x7fa3c806e0f0 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa3c806f060 0x7fa3c806fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55918/0 (socket says 172.21.15.37:55918) 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1591432441 learned_addr learned my addr 172.21.15.37:0/1591432441 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/1591432441 >> v2:172.21.15.82:3300/0 conn(0x7fa3c806e0f0 0x7fa3c80cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178806245 0 0) 0x7fa3c815d2a0 con 0x7fa3c806f060 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b0003520 con 0x7fa3c806f060 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2399185629 0 0) 0x7fa3b0003520 con 0x7fa3c806f060 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 >> v2:172.21.15.82:3300/0 conn(0x7fa3c806e0f0 msgr2=0x7fa3c80cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 --2- 172.21.15.37:0/1591432441 >> v2:172.21.15.82:3300/0 conn(0x7fa3c806e0f0 0x7fa3c80cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 >> v1:172.21.15.82:6789/0 conn(0x7fa3c80d0360 legacy=0x7fa3c80b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c8160c90 con 0x7fa3c806f060 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fa3b8001670 con 0x7fa3c806f060 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 >> v1:172.21.15.37:6789/0 conn(0x7fa3c806f060 legacy=0x7fa3c806fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3b0004800 0x7fa3b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b00051c0 0x7fa3b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b000c030 con 0x7fa3b00051c0 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b000c1e0 con 0x7fa3b00039b0 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b000c3e0 con 0x7fa3b0004800 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.241+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3b0004800 0x7fa3b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b00051c0 0x7fa3b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3b0004800 msgr2=0x7fa3b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3b0004800 0x7fa3b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1591432441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b00051c0 msgr2=0x7fa3b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b00051c0 0x7fa3b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1591432441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b0003520 con 0x7fa3b00039b0 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b00051c0 0x7fa3b000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.242+0000 7fa3ccabf640 1 -- 172.21.15.37:0/1591432441 reap_dead start 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3b0003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c240 tx=0x7fa3b0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc3687eacf69a8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8007d10 con 0x7fa3b00039b0 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b8005ad0 con 0x7fa3b00039b0 2024-05-10T08:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3c6ffd640 1 -- 172.21.15.37:0/1591432441 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8007070 con 0x7fa3b00039b0 2024-05-10T08:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3ce522640 1 -- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 msgr2=0x7fa3b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3ce522640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3b0003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c240 tx=0x7fa3b0005830 comp rx=0 tx=0).stop 2024-05-10T08:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3ce522640 1 -- 172.21.15.37:0/1591432441 shutdown_connections 2024-05-10T08:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3ce522640 1 --2- 172.21.15.37:0/1591432441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3b0003dd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3ce522640 1 -- 172.21.15.37:0/1591432441 >> 172.21.15.37:0/1591432441 conn(0x7fa3c806c3a0 msgr2=0x7fa3c806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3ce522640 1 -- 172.21.15.37:0/1591432441 shutdown_connections 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.243+0000 7fa3ce522640 1 -- 172.21.15.37:0/1591432441 wait complete. 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.245+0000 7fa3ce522640 1 Processor -- start 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.245+0000 7fa3ce522640 1 -- start start 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ce522640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3c8073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ce522640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3c8157810 0x7fa3c809d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ce522640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c809dbd0 0x7fa3c80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ce522640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c8161250 con 0x7fa3c809dbd0 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ce522640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c806f440 con 0x7fa3b00039b0 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ce522640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c8161530 con 0x7fa3c8157810 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c809dbd0 0x7fa3c80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c809dbd0 0x7fa3c80b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48166/0 (socket says 172.21.15.37:48166) 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 -- 172.21.15.37:0/46760745 learned_addr learned my addr 172.21.15.37:0/46760745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3c8073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3c8157810 0x7fa3c809d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 -- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3c8157810 msgr2=0x7fa3c809d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3c8157810 0x7fa3c809d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 -- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 msgr2=0x7fa3c8073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3c8073d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 -- 172.21.15.37:0/46760745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c809c5f0 con 0x7fa3c809dbd0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.246+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c809dbd0 0x7fa3c80b10c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80d16f0 tx=0x7fa3c000feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.247+0000 7fa3c4ff9640 1 -- 172.21.15.37:0/46760745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c001a070 con 0x7fa3c809dbd0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.247+0000 7fa3c4ff9640 1 -- 172.21.15.37:0/46760745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c0006d60 con 0x7fa3c809dbd0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.247+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c809c8d0 con 0x7fa3c809dbd0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.247+0000 7fa3c4ff9640 1 -- 172.21.15.37:0/46760745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0001a70 con 0x7fa3c809dbd0 2024-05-10T08:47:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.247+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c809ce90 con 0x7fa3c809dbd0 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.249+0000 7fa3c4ff9640 1 -- 172.21.15.37:0/46760745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa3c001d070 con 0x7fa3c809dbd0 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.249+0000 7fa3c4ff9640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3b40762d0 0x7fa3b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.250+0000 7fa3c4ff9640 1 -- 172.21.15.37:0/46760745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fa3c0096e10 con 0x7fa3c809dbd0 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.250+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3b40762d0 0x7fa3b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.250+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3b40762d0 0x7fa3b4078790 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8033000 tx=0x7fa3b802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 Processor -- start 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 -- start start 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b436af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b466600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b466b40 0x56076b43b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56076b403690 con 0x56076b484160 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56076b3a0f30 con 0x56076b467280 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56076b359b20 con 0x56076b466b40 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.251+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b436af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b436af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48170/0 (socket says 172.21.15.37:48170) 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 -- 172.21.15.37:0/2078710956 learned_addr learned my addr 172.21.15.37:0/2078710956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b466600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b466b40 0x56076b43b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 -- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b466b40 msgr2=0x56076b43b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b466b40 0x56076b43b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 -- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 msgr2=0x56076b466600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b466600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 -- 172.21.15.37:0/2078710956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56076b351e60 con 0x56076b484160 2024-05-10T08:47:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b436af0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80017a0 tx=0x7fa3b8009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e25a5409a9dcf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3adffb640 1 -- 172.21.15.37:0/2078710956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8004e20 con 0x56076b484160 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3adffb640 1 -- 172.21.15.37:0/2078710956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b8051070 con 0x56076b484160 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.252+0000 7fa3adffb640 1 -- 172.21.15.37:0/2078710956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8007290 con 0x56076b484160 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 -- 172.21.15.37:0/2078710956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 msgr2=0x56076b436af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b436af0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80017a0 tx=0x7fa3b8009030 comp rx=0 tx=0).stop 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 -- 172.21.15.37:0/2078710956 shutdown_connections 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b466b40 0x56076b43b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b466600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2078710956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b436af0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 -- 172.21.15.37:0/2078710956 >> 172.21.15.37:0/2078710956 conn(0x56076b438d60 msgr2=0x56076b481600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 -- 172.21.15.37:0/2078710956 shutdown_connections 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.253+0000 7fa3d1234740 1 -- 172.21.15.37:0/2078710956 wait complete. 2024-05-10T08:47:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.254+0000 7fa3d1234740 1 -- start start 2024-05-10T08:47:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.254+0000 7fa3d1234740 1 Processor -- start 2024-05-10T08:47:30.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b468ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b456f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b4621d0 0x56076b482730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56076b35d5e0 con 0x56076b484160 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56076b39cef0 con 0x56076b467280 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56076b43af10 con 0x56076b4621d0 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b456f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 10 client.0 _ll_register_callbacks cb 0x56076b358320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b456f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48174/0 (socket says 172.21.15.37:48174) 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 -- 172.21.15.37:0/2319821422 learned_addr learned my addr 172.21.15.37:0/2319821422 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b468ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b4621d0 0x56076b482730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 -- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b4621d0 msgr2=0x56076b482730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b4621d0 0x56076b482730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 -- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 msgr2=0x56076b468ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b468ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 -- 172.21.15.37:0/2319821422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56076b17c7d0 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b456f60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc015a40 tx=0x7fa3bc015b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880cc4bddc5fab2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/2319821422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc004300 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/2319821422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fa3bc00f040 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.255+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b8051070 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/2319821422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fa3bc0044a0 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 10 client.7278 fetch_fsmap learned FSMap version 73 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x56076b0b23f0 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/2319821422 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b8051070 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/2319821422 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7fa3bc027050 con 0x56076b484160 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 10 client.7278 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 10 client.7278 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:47:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 20 client.7278 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b494c50 0x56076b495100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 4 client.7278 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56076b3aeb40 con 0x56076b494c50 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b494c50 0x56076b495100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b494c50 0x56076b495100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7009cd996746275 server_cookie=f30d63fa9c0be15b in_seq=0 out_seq=0 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.256+0000 7fa3a6ffd640 10 client.7278 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/2319821422 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56076b3aeb40 con 0x56076b494c50 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3a6ffd640 10 client.7278 handle_command_reply: tid=0 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 client.7278 shutdown 2024-05-10T08:47:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 msgr2=0x56076b456f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b456f60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc015a40 tx=0x7fa3bc015b30 comp rx=0 tx=0).stop 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 shutdown_connections 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b494c50 0x56076b495100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b4621d0 0x56076b482730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b456f60 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3a6ffd640 0 client.7278 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 --2- 172.21.15.37:0/2319821422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b467280 0x56076b468ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 >> 172.21.15.37:0/2319821422 conn(0x56076b466b40 msgr2=0x56076b43a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 shutdown_connections 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.257+0000 7fa3d1234740 1 -- 172.21.15.37:0/2319821422 wait complete. 2024-05-10T08:47:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.258+0000 7fa3d1234740 20 client.7278 trim_cache size 0 max 16384 2024-05-10T08:47:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 Processor -- start 2024-05-10T08:47:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 -- start start 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b4815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b480370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c8202640 con 0x56076b484160 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c8201620 con 0x56076b4621d0 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c8200970 con 0x56076b467280 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.276+0000 7fa3ccabf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48190/0 (socket says 172.21.15.37:48190) 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3160276041 learned_addr learned my addr 172.21.15.37:0/3160276041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b480370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 msgr2=0x56076b480370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b480370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 msgr2=0x56076b4815f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b4815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b4815f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3160276041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56076b0720f0 con 0x56076b484160 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b4815f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4808b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa3c005bea0 tx=0x7fa3c0001390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4241eca6e5c363 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ad7fa640 1 -- 172.21.15.37:0/3160276041 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0064170 con 0x56076b484160 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ad7fa640 1 -- 172.21.15.37:0/3160276041 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c0076070 con 0x56076b484160 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.277+0000 7fa3ad7fa640 1 -- 172.21.15.37:0/3160276041 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0003d90 con 0x56076b484160 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 -- 172.21.15.37:0/3160276041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 msgr2=0x56076b4808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4808b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa3c005bea0 tx=0x7fa3c0001390 comp rx=0 tx=0).stop 2024-05-10T08:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 -- 172.21.15.37:0/3160276041 shutdown_connections 2024-05-10T08:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4808b0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b480370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3160276041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b4815f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 -- 172.21.15.37:0/3160276041 >> 172.21.15.37:0/3160276041 conn(0x56076b466b40 msgr2=0x56076b460ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 -- 172.21.15.37:0/3160276041 shutdown_connections 2024-05-10T08:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 -- 172.21.15.37:0/3160276041 wait complete. 2024-05-10T08:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.278+0000 7fa3d1234740 1 -- start start 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 1 Processor -- start 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b502030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b48fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4363b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c8200fc0 con 0x56076b484160 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56076b461b20 con 0x56076b4621d0 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56076b4907a0 con 0x56076b467280 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3d1234740 10 client.0 _ll_register_callbacks cb 0x7fa3bc009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3ccabf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3ccabf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48192/0 (socket says 172.21.15.37:48192) 2024-05-10T08:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.279+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3594540579 learned_addr learned my addr 172.21.15.37:0/3594540579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b502030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3c77fe640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b48fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 msgr2=0x56076b48fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b48fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 msgr2=0x56076b502030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b502030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3ccabf640 1 -- 172.21.15.37:0/3594540579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56076b43c720 con 0x56076b484160 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b502030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3ccabf640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4363b0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa3c005fe00 tx=0x7fa3c00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8073fad6fae494ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/3594540579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0068b90 con 0x56076b484160 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/3594540579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fa3c0003d80 con 0x56076b484160 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c0076070 con 0x56076b484160 2024-05-10T08:47:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/3594540579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fa3c0064170 con 0x56076b484160 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3d1234740 10 client.7284 fetch_fsmap learned FSMap version 73 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x56076b4a4210 con 0x56076b484160 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/3594540579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c0076070 con 0x56076b484160 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/3594540579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7fa3c0081320 con 0x56076b484160 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3d1234740 10 client.7284 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3d1234740 10 client.7284 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3d1234740 20 client.7284 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.280+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b4631d0 0x56076b4635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 4 client.7284 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56076b3a89b0 con 0x56076b4631d0 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b4631d0 0x56076b4635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b4631d0 0x56076b4635e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2adfbd7ee2a572fd server_cookie=79309458e3f63148 in_seq=0 out_seq=0 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3a6ffd640 10 client.7284 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3a6ffd640 1 -- 172.21.15.37:0/3594540579 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56076b3a89b0 con 0x56076b4631d0 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3a6ffd640 10 client.7284 handle_command_reply: tid=0 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 client.7284 shutdown 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 msgr2=0x56076b4363b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4363b0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa3c005fe00 tx=0x7fa3c00014a0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 shutdown_connections 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x56076b4631d0 0x56076b4635e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56076b484160 0x56076b4363b0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56076b467280 0x56076b48fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3a6ffd640 0 client.7284 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 --2- 172.21.15.37:0/3594540579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56076b4621d0 0x56076b502030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 >> 172.21.15.37:0/3594540579 conn(0x56076b466b40 msgr2=0x56076b4815f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 shutdown_connections 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.281+0000 7fa3d1234740 1 -- 172.21.15.37:0/3594540579 wait complete. 2024-05-10T08:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3d1234740 20 client.7284 trim_cache size 0 max 16384 2024-05-10T08:47:30.288 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:47:30.288 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:47:30.288 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:47:30.288 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3b40762d0 msgr2=0x7fa3b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3b40762d0 0x7fa3b4078790 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8033000 tx=0x7fa3b802e000 comp rx=0 tx=0).stop 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c809dbd0 msgr2=0x7fa3c80b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c809dbd0 0x7fa3c80b10c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80d16f0 tx=0x7fa3c000feb0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 shutdown_connections 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa3b40762d0 0x7fa3b4078790 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c809dbd0 0x7fa3c80b10c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa3c8157810 0x7fa3c809d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 --2- 172.21.15.37:0/46760745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3b00039b0 0x7fa3c8073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 >> 172.21.15.37:0/46760745 conn(0x7fa3c806c3a0 msgr2=0x7fa3c806f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 shutdown_connections 2024-05-10T08:47:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.282+0000 7fa3ce522640 1 -- 172.21.15.37:0/46760745 wait complete. 2024-05-10T08:47:30.292 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:47:30.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.397+0000 7f55505dd640 1 Processor -- start 2024-05-10T08:47:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.397+0000 7f55505dd640 1 -- start start 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.398+0000 7f55505dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f554815d140 0x7f55480cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.398+0000 7f55505dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f55480b5c70 0x7f55480b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.398+0000 7f55505dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5548070a50 0x7f5548070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f55505dd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f55480b1120 con 0x7f5548070a50 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f55505dd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f55480b68f0 con 0x7f55480b5c70 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f55505dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f55480cf240 con 0x7f554815d140 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5548070a50 0x7f5548070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5548070a50 0x7f5548070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48202/0 (socket says 172.21.15.37:48202) 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 -- 172.21.15.37:0/1774677747 learned_addr learned my addr 172.21.15.37:0/1774677747 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554e379640 1 --2- 172.21.15.37:0/1774677747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f554815d140 0x7f55480cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554db78640 1 --2- 172.21.15.37:0/1774677747 >> v2:172.21.15.82:3300/0 conn(0x7f55480b5c70 0x7f55480b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 -- 172.21.15.37:0/1774677747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f554815d140 msgr2=0x7f55480cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 --2- 172.21.15.37:0/1774677747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f554815d140 0x7f55480cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 -- 172.21.15.37:0/1774677747 >> v2:172.21.15.82:3300/0 conn(0x7f55480b5c70 msgr2=0x7f55480b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 --2- 172.21.15.37:0/1774677747 >> v2:172.21.15.82:3300/0 conn(0x7f55480b5c70 0x7f55480b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.399+0000 7f554eb7a640 1 -- 172.21.15.37:0/1774677747 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55480b6330 con 0x7f5548070a50 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.400+0000 7f554eb7a640 1 --2- 172.21.15.37:0/1774677747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548070a50 0x7f5548070ee0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5548074270 tx=0x7f553802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239932872f2457d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.400+0000 7f554d377640 1 -- 172.21.15.37:0/1774677747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538036070 con 0x7f5548070a50 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.400+0000 7f554d377640 1 -- 172.21.15.37:0/1774677747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5538031600 con 0x7f5548070a50 2024-05-10T08:47:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.400+0000 7f554d377640 1 -- 172.21.15.37:0/1774677747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380319d0 con 0x7f5548070a50 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.400+0000 7f55505dd640 1 -- 172.21.15.37:0/1774677747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548070a50 msgr2=0x7f5548070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.400+0000 7f55505dd640 1 --2- 172.21.15.37:0/1774677747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548070a50 0x7f5548070ee0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5548074270 tx=0x7f553802a610 comp rx=0 tx=0).stop 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.401+0000 7f55505dd640 1 -- 172.21.15.37:0/1774677747 shutdown_connections 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.401+0000 7f55505dd640 1 --2- 172.21.15.37:0/1774677747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548070a50 0x7f5548070ee0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.401+0000 7f55505dd640 1 --2- 172.21.15.37:0/1774677747 >> v2:172.21.15.82:3300/0 conn(0x7f55480b5c70 0x7f55480b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.401+0000 7f55505dd640 1 --2- 172.21.15.37:0/1774677747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f554815d140 0x7f55480cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.401+0000 7f55505dd640 1 -- 172.21.15.37:0/1774677747 >> 172.21.15.37:0/1774677747 conn(0x7f55480738e0 msgr2=0x7f554806c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.401+0000 7f55505dd640 1 -- 172.21.15.37:0/1774677747 shutdown_connections 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.401+0000 7f55505dd640 1 -- 172.21.15.37:0/1774677747 wait complete. 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.402+0000 7f55505dd640 1 Processor -- start 2024-05-10T08:47:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.402+0000 7f55505dd640 1 -- start start 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f55505dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5548070a50 0x7f55480af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f55505dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55480b5c70 0x7f554814e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f55505dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554815d140 0x7f55480ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f55505dd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55480ceed0 con 0x7f554815d140 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f55505dd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55480b60d0 con 0x7f5548070a50 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f55505dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f55480b4650 con 0x7f55480b5c70 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554815d140 0x7f55480ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554815d140 0x7f55480ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48204/0 (socket says 172.21.15.37:48204) 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 -- 172.21.15.37:0/1175692967 learned_addr learned my addr 172.21.15.37:0/1175692967 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554e379640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5548070a50 0x7f55480af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554db78640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55480b5c70 0x7f554814e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 -- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55480b5c70 msgr2=0x7f554814e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55480b5c70 0x7f554814e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 -- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5548070a50 msgr2=0x7f55480af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5548070a50 0x7f55480af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 -- 172.21.15.37:0/1175692967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55480adfc0 con 0x7f554815d140 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f554eb7a640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554815d140 0x7f55480ad500 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5538034040 tx=0x7f5538004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f5546ffd640 1 -- 172.21.15.37:0/1175692967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538041020 con 0x7f554815d140 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f5546ffd640 1 -- 172.21.15.37:0/1175692967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55380077a0 con 0x7f554815d140 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f5546ffd640 1 -- 172.21.15.37:0/1175692967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538036040 con 0x7f554815d140 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.403+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55480ae2a0 con 0x7f554815d140 2024-05-10T08:47:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.404+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55480ae860 con 0x7f554815d140 2024-05-10T08:47:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.404+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5548069b00 con 0x7f554815d140 2024-05-10T08:47:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.405+0000 7f5546ffd640 1 -- 172.21.15.37:0/1175692967 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5538044020 con 0x7f554815d140 2024-05-10T08:47:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.405+0000 7f5546ffd640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55340762d0 0x7f5534078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.406+0000 7f5546ffd640 1 -- 172.21.15.37:0/1175692967 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f55380b8370 con 0x7f554815d140 2024-05-10T08:47:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.406+0000 7f554e379640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55340762d0 0x7f5534078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.406+0000 7f554e379640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55340762d0 0x7f5534078790 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5540009a20 tx=0x7f5540009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.410+0000 7f5546ffd640 1 -- 172.21.15.37:0/1175692967 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f553804b030 con 0x7f554815d140 2024-05-10T08:47:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.639+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5548068310 con 0x7f554815d140 2024-05-10T08:47:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.639+0000 7f5546ffd640 1 -- 172.21.15.37:0/1175692967 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5178 (secure 0 0 0) 0x7f5538081340 con 0x7f554815d140 2024-05-10T08:47:30.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:30.638 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:57.197376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":6}]} 2024-05-10T08:47:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 73 2024-05-10T08:47:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55340762d0 msgr2=0x7f5534078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55340762d0 0x7f5534078790 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5540009a20 tx=0x7f5540009190 comp rx=0 tx=0).stop 2024-05-10T08:47:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554815d140 msgr2=0x7f55480ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554815d140 0x7f55480ad500 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5538034040 tx=0x7f5538004a40 comp rx=0 tx=0).stop 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 shutdown_connections 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55340762d0 0x7f5534078790 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f554815d140 0x7f55480ad500 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55480b5c70 0x7f554814e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 --2- 172.21.15.37:0/1175692967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5548070a50 0x7f55480af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 >> 172.21.15.37:0/1175692967 conn(0x7f55480738e0 msgr2=0x7f55480b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 shutdown_connections 2024-05-10T08:47:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.641+0000 7f55505dd640 1 -- 172.21.15.37:0/1175692967 wait complete. 2024-05-10T08:47:30.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-05-10T08:47:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.757+0000 7f540f7b6640 1 Processor -- start 2024-05-10T08:47:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.757+0000 7f540f7b6640 1 -- start start 2024-05-10T08:47:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540f7b6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54081629a0 0x7f54080d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540f7b6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f54080d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540f7b6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54080d3330 con 0x7f54080d2dc0 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540f7b6640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f54080d2170 con 0x7f54081629a0 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540f7b6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f54080d2450 con 0x7f54080d0cb0 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540d552640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54081629a0 0x7f54080d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540dd53640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f54080d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540d552640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54081629a0 0x7f54080d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:60052/0 (socket says 172.21.15.37:60052) 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.758+0000 7f540d552640 1 -- 172.21.15.37:0/2494204899 learned_addr learned my addr 172.21.15.37:0/2494204899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.759+0000 7f540dd53640 1 -- 172.21.15.37:0/2494204899 >> v2:172.21.15.82:3300/0 conn(0x7f54081629a0 msgr2=0x7f54080d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.759+0000 7f540dd53640 1 --2- 172.21.15.37:0/2494204899 >> v2:172.21.15.82:3300/0 conn(0x7f54081629a0 0x7f54080d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.759+0000 7f540dd53640 1 -- 172.21.15.37:0/2494204899 >> v1:172.21.15.82:6789/0 conn(0x7f54080d2dc0 legacy=0x7f54080c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.759+0000 7f540dd53640 1 -- 172.21.15.37:0/2494204899 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54080d2730 con 0x7f54080d0cb0 2024-05-10T08:47:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.759+0000 7f540d552640 1 --2- 172.21.15.37:0/2494204899 >> v2:172.21.15.82:3300/0 conn(0x7f54081629a0 0x7f54080d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540dd53640 1 --2- 172.21.15.37:0/2494204899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f54080d3b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5400009d90 tx=0x7f540002a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e13bd65eba1aaa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f53fffff640 1 -- 172.21.15.37:0/2494204899 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400007740 con 0x7f54080d0cb0 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f53fffff640 1 -- 172.21.15.37:0/2494204899 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54000078e0 con 0x7f54080d0cb0 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f53fffff640 1 -- 172.21.15.37:0/2494204899 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400007cb0 con 0x7f54080d0cb0 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 -- 172.21.15.37:0/2494204899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 msgr2=0x7f54080d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2494204899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f54080d3b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5400009d90 tx=0x7f540002a530 comp rx=0 tx=0).stop 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 -- 172.21.15.37:0/2494204899 shutdown_connections 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2494204899 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f54080d3b00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2494204899 >> v2:172.21.15.82:3300/0 conn(0x7f54081629a0 0x7f54080d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 -- 172.21.15.37:0/2494204899 >> 172.21.15.37:0/2494204899 conn(0x7f54080d4fe0 msgr2=0x7f54080d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 -- 172.21.15.37:0/2494204899 shutdown_connections 2024-05-10T08:47:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.760+0000 7f540f7b6640 1 -- 172.21.15.37:0/2494204899 wait complete. 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 Processor -- start 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 -- start start 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f5408150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080d2dc0 0x7f540814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54081629a0 0x7f540814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54080cf440 con 0x7f54081629a0 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54080cf2c0 con 0x7f54080d2dc0 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.762+0000 7f540f7b6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f54080c95e0 con 0x7f54080d0cb0 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540dd53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54081629a0 0x7f540814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540dd53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54081629a0 0x7f540814ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48206/0 (socket says 172.21.15.37:48206) 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540d552640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f5408150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540dd53640 1 -- 172.21.15.37:0/2137273390 learned_addr learned my addr 172.21.15.37:0/2137273390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540cd51640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080d2dc0 0x7f540814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540d552640 1 -- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080d2dc0 msgr2=0x7f540814d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540d552640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080d2dc0 0x7f540814d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540d552640 1 -- 172.21.15.37:0/2137273390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54081629a0 msgr2=0x7f540814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540d552640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54081629a0 0x7f540814ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540d552640 1 -- 172.21.15.37:0/2137273390 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540814f260 con 0x7f54080d0cb0 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540cd51640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080d2dc0 0x7f540814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540dd53640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54081629a0 0x7f540814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540d552640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f5408150c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f540400e890 tx=0x7f540400ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f53fdffb640 1 -- 172.21.15.37:0/2137273390 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404004030 con 0x7f54080d0cb0 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f53fdffb640 1 -- 172.21.15.37:0/2137273390 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54040041d0 con 0x7f54080d0cb0 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f53fdffb640 1 -- 172.21.15.37:0/2137273390 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540400c940 con 0x7f54080d0cb0 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.763+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540814f540 con 0x7f54080d0cb0 2024-05-10T08:47:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.764+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f540814fb00 con 0x7f54080d0cb0 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.765+0000 7f53fdffb640 1 -- 172.21.15.37:0/2137273390 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f540400cae0 con 0x7f54080d0cb0 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.766+0000 7f53fdffb640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f53ec0762d0 0x7f53ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.766+0000 7f53fdffb640 1 -- 172.21.15.37:0/2137273390 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f5404097ac0 con 0x7f54080d0cb0 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.766+0000 7f540cd51640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f53ec0762d0 0x7f53ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.766+0000 7f540cd51640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f53ec0762d0 0x7f53ec078790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f53f8001b70 tx=0x7f53f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.766+0000 7f54125ab740 1 Processor -- start 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.766+0000 7f54125ab740 1 -- start start 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37ce6d0 0x5621f37812f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f54125ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37b17f0 0x5621f37b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b10b0 0x5621f3785ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f54125ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5621f3671920 con 0x5621f37b17f0 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5621f36e6dd0 con 0x5621f37ce6d0 2024-05-10T08:47:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5621f36973e0 con 0x5621f37b10b0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f540cd51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37b17f0 0x5621f37b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f540cd51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37b17f0 0x5621f37b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48218/0 (socket says 172.21.15.37:48218) 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f540cd51640 1 -- 172.21.15.37:0/756441794 learned_addr learned my addr 172.21.15.37:0/756441794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f540d552640 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37ce6d0 0x5621f37812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.767+0000 7f540dd53640 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b10b0 0x5621f3785ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f540cd51640 1 -- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b10b0 msgr2=0x5621f3785ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f540cd51640 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b10b0 0x5621f3785ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f540cd51640 1 -- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37ce6d0 msgr2=0x5621f37812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f540cd51640 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37ce6d0 0x5621f37812f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f540cd51640 1 -- 172.21.15.37:0/756441794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f34c87c0 con 0x5621f37b17f0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f540cd51640 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37b17f0 0x5621f37b0b70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f53f8001d00 tx=0x7f53f8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed15daecb776bea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f53eaffd640 1 -- 172.21.15.37:0/756441794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8025070 con 0x5621f37b17f0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f53eaffd640 1 -- 172.21.15.37:0/756441794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f801b050 con 0x5621f37b17f0 2024-05-10T08:47:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f53eaffd640 1 -- 172.21.15.37:0/756441794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f80137c0 con 0x5621f37b17f0 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f54125ab740 1 -- 172.21.15.37:0/756441794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37b17f0 msgr2=0x5621f37b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f54125ab740 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37b17f0 0x5621f37b0b70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f53f8001d00 tx=0x7f53f8012000 comp rx=0 tx=0).stop 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f54125ab740 1 -- 172.21.15.37:0/756441794 shutdown_connections 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f54125ab740 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b10b0 0x5621f3785ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f54125ab740 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37b17f0 0x5621f37b0b70 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f54125ab740 1 --2- 172.21.15.37:0/756441794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37ce6d0 0x5621f37812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.768+0000 7f54125ab740 1 -- 172.21.15.37:0/756441794 >> 172.21.15.37:0/756441794 conn(0x5621f3783560 msgr2=0x5621f37cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.769+0000 7f54125ab740 1 -- 172.21.15.37:0/756441794 shutdown_connections 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.769+0000 7f54125ab740 1 -- 172.21.15.37:0/756441794 wait complete. 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.769+0000 7f54125ab740 1 -- start start 2024-05-10T08:47:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.769+0000 7f54125ab740 1 Processor -- start 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b17f0 0x5621f37b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f54125ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f379aa60 0x5621f379aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f54125ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5621f36ef440 con 0x5621f37ce6d0 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5621f36ea120 con 0x5621f379aa60 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5621f36f8210 con 0x5621f37b17f0 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f54125ab740 10 client.0 _ll_register_callbacks cb 0x5621f368f690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540cd51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540cd51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48232/0 (socket says 172.21.15.37:48232) 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540cd51640 1 -- 172.21.15.37:0/451708136 learned_addr learned my addr 172.21.15.37:0/451708136 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540dd53640 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f379aa60 0x5621f379aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540d552640 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b17f0 0x5621f37b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540cd51640 1 -- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b17f0 msgr2=0x5621f37b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540cd51640 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b17f0 0x5621f37b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540cd51640 1 -- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f379aa60 msgr2=0x5621f379aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.770+0000 7f540cd51640 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f379aa60 0x5621f379aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f540cd51640 1 -- 172.21.15.37:0/451708136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f3528f50 con 0x5621f37ce6d0 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f540cd51640 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37cd540 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f53f800fa30 tx=0x7f53f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d547f0b776fce6ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f53e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f53e3fff640 1 -- 172.21.15.37:0/451708136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f802f020 con 0x5621f37ce6d0 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f53e3fff640 1 -- 172.21.15.37:0/451708136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f53f802b620 con 0x5621f37ce6d0 2024-05-10T08:47:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f801b050 con 0x5621f37ce6d0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f53e3fff640 1 -- 172.21.15.37:0/451708136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f53f8039050 con 0x5621f37ce6d0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 10 client.7299 fetch_fsmap learned FSMap version 73 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x5621f33bc0b0 con 0x5621f37ce6d0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f53e3fff640 1 -- 172.21.15.37:0/451708136 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f801b050 con 0x5621f37ce6d0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f53e3fff640 1 -- 172.21.15.37:0/451708136 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7f53f803c020 con 0x5621f37ce6d0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 10 client.7299 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 10 client.7299 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 20 client.7299 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f37b1ce0 0x5621f37b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 4 client.7299 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.771+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621f36f8a20 con 0x5621f37b1ce0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.772+0000 7f540d552640 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f37b1ce0 0x5621f37b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.772+0000 7f53e3fff640 10 client.7299 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.772+0000 7f540d552640 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f37b1ce0 0x5621f37b20c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77f77cf652b2d9b server_cookie=96d611eaa50ed532 in_seq=0 out_seq=0 2024-05-10T08:47:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.772+0000 7f53e3fff640 1 -- 172.21.15.37:0/451708136 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5621f36f8a20 con 0x5621f37b1ce0 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.772+0000 7f53e3fff640 10 client.7299 handle_command_reply: tid=0 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.772+0000 7f54125ab740 1 client.7299 shutdown 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 msgr2=0x5621f37cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37cd540 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f53f800fa30 tx=0x7f53f8000ed0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 shutdown_connections 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f37b1ce0 0x5621f37b20c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f379aa60 0x5621f379aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37cd540 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 --2- 172.21.15.37:0/451708136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37b17f0 0x5621f37b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f53e3fff640 0 client.7299 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 >> 172.21.15.37:0/451708136 conn(0x5621f37b10b0 msgr2=0x5621f3780a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 shutdown_connections 2024-05-10T08:47:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 1 -- 172.21.15.37:0/451708136 wait complete. 2024-05-10T08:47:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.773+0000 7f54125ab740 20 client.7299 trim_cache size 0 max 16384 2024-05-10T08:47:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.786+0000 7f54125ab740 1 Processor -- start 2024-05-10T08:47:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f54125ab740 1 -- start start 2024-05-10T08:47:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f54125ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f379aa60 0x5621f37cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37ce6d0 0x5621f37801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f54125ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54082012b0 con 0x5621f379aa60 2024-05-10T08:47:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5408200610 con 0x5621f37b17f0 2024-05-10T08:47:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5408200c60 con 0x5621f37ce6d0 2024-05-10T08:47:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f540d552640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f379aa60 0x5621f37cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f540d552640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f379aa60 0x5621f37cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48236/0 (socket says 172.21.15.37:48236) 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f540d552640 1 -- 172.21.15.37:0/2280463093 learned_addr learned my addr 172.21.15.37:0/2280463093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f540cd51640 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f540dd53640 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37ce6d0 0x5621f37801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.787+0000 7f540d552640 1 -- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37ce6d0 msgr2=0x5621f37801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f540d552640 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37ce6d0 0x5621f37801a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f540d552640 1 -- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 msgr2=0x5621f37cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f540d552640 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f540d552640 1 -- 172.21.15.37:0/2280463093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f37ae4a0 con 0x5621f379aa60 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f540cd51640 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f540dd53640 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37ce6d0 0x5621f37801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f540d552640 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f379aa60 0x5621f37cb970 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f5404004650 tx=0x7f5404095b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87347b75705b26b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f53ea7fc640 1 -- 172.21.15.37:0/2280463093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404020040 con 0x5621f379aa60 2024-05-10T08:47:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f53ea7fc640 1 -- 172.21.15.37:0/2280463093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540407c070 con 0x5621f379aa60 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f53ea7fc640 1 -- 172.21.15.37:0/2280463093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54040697a0 con 0x5621f379aa60 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 -- 172.21.15.37:0/2280463093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f379aa60 msgr2=0x5621f37cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f379aa60 0x5621f37cb970 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f5404004650 tx=0x7f5404095b70 comp rx=0 tx=0).stop 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 -- 172.21.15.37:0/2280463093 shutdown_connections 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f37ce6d0 0x5621f37801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 --2- 172.21.15.37:0/2280463093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f379aa60 0x5621f37cb970 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 -- 172.21.15.37:0/2280463093 >> 172.21.15.37:0/2280463093 conn(0x5621f37b10b0 msgr2=0x5621f37cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 -- 172.21.15.37:0/2280463093 shutdown_connections 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.788+0000 7f54125ab740 1 -- 172.21.15.37:0/2280463093 wait complete. 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.789+0000 7f54125ab740 1 -- start start 2024-05-10T08:47:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.789+0000 7f54125ab740 1 Processor -- start 2024-05-10T08:47:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f379aa60 0x5621f37ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f54125ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f54125ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f54125ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5621f37b45d0 con 0x5621f37ce6d0 2024-05-10T08:47:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5621f36a0a20 con 0x5621f37b17f0 2024-05-10T08:47:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f54125ab740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5621f37c37d0 con 0x5621f379aa60 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f54125ab740 10 client.0 _ll_register_callbacks cb 0x7f53f8023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37c2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48246/0 (socket says 172.21.15.37:48246) 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 -- 172.21.15.37:0/3974798465 learned_addr learned my addr 172.21.15.37:0/3974798465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540d552640 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f379aa60 0x5621f37ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540cd51640 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 -- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f379aa60 msgr2=0x5621f37ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f379aa60 0x5621f37ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 -- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 msgr2=0x5621f37c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.790+0000 7f540dd53640 1 -- 172.21.15.37:0/3974798465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f37b3d50 con 0x5621f37ce6d0 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f540dd53640 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37c2000 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5400007090 tx=0x7f540002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a84bc3416d0402 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f53e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f53e3fff640 1 -- 172.21.15.37:0/3974798465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540003cb60 con 0x5621f37ce6d0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f53e3fff640 1 -- 172.21.15.37:0/3974798465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f540003cd00 con 0x5621f37ce6d0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f540407c070 con 0x5621f37ce6d0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f53e3fff640 1 -- 172.21.15.37:0/3974798465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f5400052050 con 0x5621f37ce6d0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 10 client.7305 fetch_fsmap learned FSMap version 73 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x5621f3784220 con 0x5621f37ce6d0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f53e3fff640 1 -- 172.21.15.37:0/3974798465 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540407c070 con 0x5621f37ce6d0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f53e3fff640 1 -- 172.21.15.37:0/3974798465 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 73) ==== 3494+0+0 (secure 0 0 0) 0x7f5400055020 con 0x5621f37ce6d0 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 10 client.7305 fetch_fsmap finished waiting for FSMap version 73 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 10 client.7305 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 20 client.7305 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f384c6f0 0x5621f384cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 4 client.7305 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 --> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x5621f37c5690 con 0x5621f384c6f0 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.791+0000 7f540d552640 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f384c6f0 0x5621f384cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f540d552640 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f384c6f0 0x5621f384cad0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f833a5622c9306b4 server_cookie=38896854a81c64dd in_seq=0 out_seq=0 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f53e3fff640 10 client.7305 ms_handle_connect on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f53e3fff640 1 -- 172.21.15.37:0/3974798465 <== mds.0 v2:172.21.15.37:6832/345427151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621f37c5690 con 0x5621f384c6f0 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f53e3fff640 10 client.7305 handle_command_reply: tid=0 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 client.7305 shutdown 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 msgr2=0x5621f37c2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37c2000 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5400007090 tx=0x7f540002c000 comp rx=0 tx=0).stop 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 shutdown_connections 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:6832/345427151,v1:172.21.15.37:6834/345427151] conn(0x5621f384c6f0 0x5621f384cad0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621f37ce6d0 0x5621f37c2000 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621f37b17f0 0x5621f37c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f53e3fff640 0 client.7305 ms_handle_reset on v2:172.21.15.37:6832/345427151 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 --2- 172.21.15.37:0/3974798465 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5621f379aa60 0x5621f37ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 >> 172.21.15.37:0/3974798465 conn(0x5621f37b10b0 msgr2=0x5621f37c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 shutdown_connections 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 1 -- 172.21.15.37:0/3974798465 wait complete. 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.792+0000 7f54125ab740 20 client.7305 trim_cache size 0 max 16384 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-10T08:47:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f53ec0762d0 msgr2=0x7f53ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f53ec0762d0 0x7f53ec078790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f53f8001b70 tx=0x7f53f8009040 comp rx=0 tx=0).stop 2024-05-10T08:47:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 msgr2=0x7f5408150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f5408150c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f540400e890 tx=0x7f540400ed50 comp rx=0 tx=0).stop 2024-05-10T08:47:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 shutdown_connections 2024-05-10T08:47:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f53ec0762d0 0x7f53ec078790 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54081629a0 0x7f540814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080d2dc0 0x7f540814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 --2- 172.21.15.37:0/2137273390 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f54080d0cb0 0x7f5408150c60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 >> 172.21.15.37:0/2137273390 conn(0x7f54080d4fe0 msgr2=0x7f54081612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 shutdown_connections 2024-05-10T08:47:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.793+0000 7f540f7b6640 1 -- 172.21.15.37:0/2137273390 wait complete. 2024-05-10T08:47:30.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T08:47:30.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.906+0000 7f221499e640 1 Processor -- start 2024-05-10T08:47:30.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.906+0000 7f221499e640 1 -- start start 2024-05-10T08:47:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f221499e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22100d1a90 0x7f221015f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f221499e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d3770 0x7f22100c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f221499e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22100d3cf0 con 0x7f22100d5570 2024-05-10T08:47:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f221499e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f22100d3fb0 con 0x7f22100d1a90 2024-05-10T08:47:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f221499e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f22100c8b30 con 0x7f22100d3770 2024-05-10T08:47:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f220effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f22100d5570 0x7f221015f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55932/0 (socket says 172.21.15.37:55932) 2024-05-10T08:47:30.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f220effd640 1 -- 172.21.15.37:0/1301792054 learned_addr learned my addr 172.21.15.37:0/1301792054 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f220f7fe640 1 --2- 172.21.15.37:0/1301792054 >> v2:172.21.15.82:3300/0 conn(0x7f22100d1a90 0x7f221015f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f220ffff640 1 --2- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d3770 0x7f22100c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f220e7fc640 1 -- 172.21.15.37:0/1301792054 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536833772 0 0) 0x7f22100d3cf0 con 0x7f22100d5570 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.907+0000 7f220e7fc640 1 -- 172.21.15.37:0/1301792054 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21f8003520 con 0x7f22100d5570 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.908+0000 7f220f7fe640 1 -- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d3770 msgr2=0x7f22100c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.908+0000 7f220f7fe640 1 --2- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d3770 0x7f22100c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.908+0000 7f220f7fe640 1 -- 172.21.15.37:0/1301792054 >> v1:172.21.15.37:6789/0 conn(0x7f22100d5570 legacy=0x7f221015f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.908+0000 7f220e7fc640 1 -- 172.21.15.37:0/1301792054 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 509875886 0 0) 0x7f21f8003520 con 0x7f22100d5570 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.908+0000 7f220f7fe640 1 -- 172.21.15.37:0/1301792054 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22100c8df0 con 0x7f22100d1a90 2024-05-10T08:47:30.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f220f7fe640 1 --2- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d1a90 0x7f221015f000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f22000097a0 tx=0x7f220002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9724819f5f1e71c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f220e7fc640 1 -- 172.21.15.37:0/1301792054 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200037070 con 0x7f22100d1a90 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f220e7fc640 1 -- 172.21.15.37:0/1301792054 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220002aba0 con 0x7f22100d1a90 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f220e7fc640 1 -- 172.21.15.37:0/1301792054 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204001670 con 0x7f22100d1a90 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 -- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d1a90 msgr2=0x7f221015f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 --2- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d1a90 0x7f221015f000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f22000097a0 tx=0x7f220002a110 comp rx=0 tx=0).stop 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 -- 172.21.15.37:0/1301792054 shutdown_connections 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 --2- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d3770 0x7f22100c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 --2- 172.21.15.37:0/1301792054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d1a90 0x7f221015f000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 -- 172.21.15.37:0/1301792054 >> 172.21.15.37:0/1301792054 conn(0x7f221009e1b0 msgr2=0x7f22100d4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 -- 172.21.15.37:0/1301792054 shutdown_connections 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.909+0000 7f221499e640 1 -- 172.21.15.37:0/1301792054 wait complete. 2024-05-10T08:47:30.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.911+0000 7f221499e640 1 Processor -- start 2024-05-10T08:47:30.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.911+0000 7f221499e640 1 -- start start 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f221499e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d1a90 0x7f22100cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f221499e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d3770 0x7f221009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f221499e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22100d5570 0x7f2210156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f221499e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22100d1e70 con 0x7f22100d5570 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f221499e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22100cbc50 con 0x7f22100d3770 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f221499e640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f22100d1ff0 con 0x7f22100d1a90 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22100d5570 0x7f2210156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22100d5570 0x7f2210156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48252/0 (socket says 172.21.15.37:48252) 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 -- 172.21.15.37:0/1798626802 learned_addr learned my addr 172.21.15.37:0/1798626802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220f7fe640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d1a90 0x7f22100cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220effd640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d3770 0x7f221009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 -- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d1a90 msgr2=0x7f22100cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d1a90 0x7f22100cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 -- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d3770 msgr2=0x7f221009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d3770 0x7f221009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 -- 172.21.15.37:0/1798626802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221009f600 con 0x7f22100d5570 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220f7fe640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d1a90 0x7f22100cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f220ffff640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22100d5570 0x7f2210156c60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f220800efc0 tx=0x7f220800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f21f7fff640 1 -- 172.21.15.37:0/1798626802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208018020 con 0x7f22100d5570 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f21f7fff640 1 -- 172.21.15.37:0/1798626802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2208014480 con 0x7f22100d5570 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f21f7fff640 1 -- 172.21.15.37:0/1798626802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208014870 con 0x7f22100d5570 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.912+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221009f8e0 con 0x7f22100d5570 2024-05-10T08:47:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.913+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221009fea0 con 0x7f22100d5570 2024-05-10T08:47:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.913+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2210050740 con 0x7f22100d5570 2024-05-10T08:47:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.914+0000 7f21f7fff640 1 -- 172.21.15.37:0/1798626802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2208005d10 con 0x7f22100d5570 2024-05-10T08:47:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.915+0000 7f21f7fff640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21fc076300 0x7f21fc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.915+0000 7f21f7fff640 1 -- 172.21.15.37:0/1798626802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f22080983f0 con 0x7f22100d5570 2024-05-10T08:47:30.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.915+0000 7f220f7fe640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21fc076300 0x7f21fc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:30.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.915+0000 7f220f7fe640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21fc076300 0x7f21fc0787c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2200034000 tx=0x7f220002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:30.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:30.919+0000 7f21f7fff640 1 -- 172.21.15.37:0/1798626802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2208022070 con 0x7f22100d5570 2024-05-10T08:47:31.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.151+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f221006e9e0 con 0x7f22100d5570 2024-05-10T08:47:31.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.152+0000 7f21f7fff640 1 -- 172.21.15.37:0/1798626802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2208010040 con 0x7f22100d5570 2024-05-10T08:47:31.151 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:31.151 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21fc076300 msgr2=0x7f21fc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21fc076300 0x7f21fc0787c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2200034000 tx=0x7f220002e000 comp rx=0 tx=0).stop 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22100d5570 msgr2=0x7f2210156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22100d5570 0x7f2210156c60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f220800efc0 tx=0x7f220800c490 comp rx=0 tx=0).stop 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 shutdown_connections 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f21fc076300 0x7f21fc0787c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22100d5570 0x7f2210156c60 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22100d3770 0x7f221009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 --2- 172.21.15.37:0/1798626802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f22100d1a90 0x7f22100cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 >> 172.21.15.37:0/1798626802 conn(0x7f221009e1b0 msgr2=0x7f221015f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 shutdown_connections 2024-05-10T08:47:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.154+0000 7f221499e640 1 -- 172.21.15.37:0/1798626802 wait complete. 2024-05-10T08:47:31.164 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-10T08:47:31.164 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:47:31.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:47:31.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:47:31.246 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:47:31.247 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:47:31.247 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:31.247 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:31.263 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:31.263 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:31.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:47:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.467+0000 7fea6aa54640 1 Processor -- start 2024-05-10T08:47:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.467+0000 7fea6aa54640 1 -- start start 2024-05-10T08:47:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea6aa54640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea6415f380 0x7fea640d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea6aa54640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea640d1760 con 0x7fea640d0cf0 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea6aa54640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea640d1a40 con 0x7fea640d3cd0 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea6aa54640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fea640d30f0 con 0x7fea6415f380 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea63fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea6415f380 0x7fea640d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea63fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea6415f380 0x7fea640d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48268/0 (socket says 172.21.15.37:48268) 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea63fff640 1 -- 172.21.15.37:0/2936688406 learned_addr learned my addr 172.21.15.37:0/2936688406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea5bfff640 1 --1- 172.21.15.37:0/2936688406 >> v1:172.21.15.37:6789/0 conn(0x7fea640d0cf0 0x7fea640d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55948/0 (socket says 172.21.15.37:55948) 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea63fff640 1 -- 172.21.15.37:0/2936688406 >> v1:172.21.15.82:6789/0 conn(0x7fea640d3cd0 legacy=0x7fea640b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.468+0000 7fea63fff640 1 -- 172.21.15.37:0/2936688406 >> v1:172.21.15.37:6789/0 conn(0x7fea640d0cf0 legacy=0x7fea640d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.469+0000 7fea637fe640 1 -- 172.21.15.37:0/2936688406 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70021765 0 0) 0x7fea640d1760 con 0x7fea640d0cf0 2024-05-10T08:47:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.469+0000 7fea63fff640 1 -- 172.21.15.37:0/2936688406 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea640d1d20 con 0x7fea6415f380 2024-05-10T08:47:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.469+0000 7fea63fff640 1 --2- 172.21.15.37:0/2936688406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea640d07b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fea54009870 tx=0x7fea5402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914a2999f2bc3517 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.469+0000 7fea637fe640 1 -- 172.21.15.37:0/2936688406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54037070 con 0x7fea6415f380 2024-05-10T08:47:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.469+0000 7fea637fe640 1 -- 172.21.15.37:0/2936688406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5402ae50 con 0x7fea6415f380 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.469+0000 7fea637fe640 1 -- 172.21.15.37:0/2936688406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54032860 con 0x7fea6415f380 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.470+0000 7fea6aa54640 1 -- 172.21.15.37:0/2936688406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 msgr2=0x7fea640d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.470+0000 7fea6aa54640 1 --2- 172.21.15.37:0/2936688406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea640d07b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fea54009870 tx=0x7fea5402a300 comp rx=0 tx=0).stop 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.470+0000 7fea6aa54640 1 -- 172.21.15.37:0/2936688406 shutdown_connections 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.470+0000 7fea6aa54640 1 --2- 172.21.15.37:0/2936688406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea640d07b0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.470+0000 7fea6aa54640 1 -- 172.21.15.37:0/2936688406 >> 172.21.15.37:0/2936688406 conn(0x7fea640d4fe0 msgr2=0x7fea640d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.470+0000 7fea6aa54640 1 -- 172.21.15.37:0/2936688406 shutdown_connections 2024-05-10T08:47:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.470+0000 7fea6aa54640 1 -- 172.21.15.37:0/2936688406 wait complete. 2024-05-10T08:47:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.471+0000 7fea6aa54640 1 Processor -- start 2024-05-10T08:47:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.471+0000 7fea6aa54640 1 -- start start 2024-05-10T08:47:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea6aa54640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea640d0cf0 0x7fea64158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea6aa54640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea640d3cd0 0x7fea640cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea6aa54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea64159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea6aa54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea6415f760 con 0x7fea6415f380 2024-05-10T08:47:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea6aa54640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea640d2370 con 0x7fea640d0cf0 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea6aa54640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea640d2800 con 0x7fea640d3cd0 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea68ff1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea64159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea68ff1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea64159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48284/0 (socket says 172.21.15.37:48284) 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea68ff1640 1 -- 172.21.15.37:0/1912097989 learned_addr learned my addr 172.21.15.37:0/1912097989 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.472+0000 7fea63fff640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea640d0cf0 0x7fea64158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea5bfff640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea640d3cd0 0x7fea640cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea68ff1640 1 -- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea640d3cd0 msgr2=0x7fea640cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea68ff1640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea640d3cd0 0x7fea640cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea68ff1640 1 -- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea640d0cf0 msgr2=0x7fea64158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea68ff1640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea640d0cf0 0x7fea64158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea68ff1640 1 -- 172.21.15.37:0/1912097989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea640cc0b0 con 0x7fea6415f380 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea5bfff640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea640d3cd0 0x7fea640cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea68ff1640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea64159850 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c760 tx=0x7fea5c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea617fa640 1 -- 172.21.15.37:0/1912097989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c003b70 con 0x7fea6415f380 2024-05-10T08:47:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea617fa640 1 -- 172.21.15.37:0/1912097989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5c003d10 con 0x7fea6415f380 2024-05-10T08:47:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea617fa640 1 -- 172.21.15.37:0/1912097989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00aa90 con 0x7fea6415f380 2024-05-10T08:47:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea641f5300 con 0x7fea6415f380 2024-05-10T08:47:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.473+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641f58c0 con 0x7fea6415f380 2024-05-10T08:47:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.474+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea640d0b10 con 0x7fea6415f380 2024-05-10T08:47:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.475+0000 7fea617fa640 1 -- 172.21.15.37:0/1912097989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea5c00ac30 con 0x7fea6415f380 2024-05-10T08:47:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.475+0000 7fea617fa640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea440762d0 0x7fea44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.475+0000 7fea617fa640 1 -- 172.21.15.37:0/1912097989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fea5c097750 con 0x7fea6415f380 2024-05-10T08:47:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.476+0000 7fea63fff640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea440762d0 0x7fea44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.476+0000 7fea63fff640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea440762d0 0x7fea44078790 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fea54034000 tx=0x7fea5402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.480+0000 7fea617fa640 1 -- 172.21.15.37:0/1912097989 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fea640d0b10 con 0x7fea6415f380 2024-05-10T08:47:31.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.686+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea640693f0 con 0x7fea6415f380 2024-05-10T08:47:31.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.686+0000 7fea617fa640 1 -- 172.21.15.37:0/1912097989 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v91) ==== 80+0+238 (secure 0 0 0) 0x7fea5c060d60 con 0x7fea6415f380 2024-05-10T08:47:31.685 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6832/375241165 2024-05-11T08:46:53.173806+0000 2024-05-10T08:47:31.685 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6834/375241165 2024-05-11T08:46:53.173806+0000 2024-05-10T08:47:31.686 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6834/54798262 2024-05-11T08:45:43.002523+0000 2024-05-10T08:47:31.686 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6832/54798262 2024-05-11T08:45:43.002523+0000 2024-05-10T08:47:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:listed 4 entries 2024-05-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea440762d0 msgr2=0x7fea44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea440762d0 0x7fea44078790 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fea54034000 tx=0x7fea5402e000 comp rx=0 tx=0).stop 2024-05-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 msgr2=0x7fea64159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea64159850 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c760 tx=0x7fea5c00cc20 comp rx=0 tx=0).stop 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 shutdown_connections 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea440762d0 0x7fea44078790 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6415f380 0x7fea64159850 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea640d3cd0 0x7fea640cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 --2- 172.21.15.37:0/1912097989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea640d0cf0 0x7fea64158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 >> 172.21.15.37:0/1912097989 conn(0x7fea640d4fe0 msgr2=0x7fea640d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 shutdown_connections 2024-05-10T08:47:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.688+0000 7fea6aa54640 1 -- 172.21.15.37:0/1912097989 wait complete. 2024-05-10T08:47:31.698 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:47:31.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:31.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:47:31.727 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:47:31.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:31.728 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:47:31.784 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:47:31.784 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:47:31.784 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:31.804 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:47:31.804 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:47:31.804 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:31.804 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:31.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:47:31.841 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:47:31.841 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:47:31.841 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:31.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:47:31.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.985+0000 7fa7421da640 1 Processor -- start 2024-05-10T08:47:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.985+0000 7fa7421da640 1 -- start start 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa7421da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa73c0d1970 0x7fa73c0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa7421da640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa73c1630b0 con 0x7fa73c0d4cc0 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa7421da640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa73c0d3e70 con 0x7fa73c15f420 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa7421da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa73c0d2550 con 0x7fa73c0d1970 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa73c0d4cc0 0x7fa73c0d50e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55962/0 (socket says 172.21.15.37:55962) 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73bfff640 1 -- 172.21.15.37:0/474005153 learned_addr learned my addr 172.21.15.37:0/474005153 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73affd640 1 --2- 172.21.15.37:0/474005153 >> v2:172.21.15.82:3300/0 conn(0x7fa73c0d1970 0x7fa73c0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101382475 0 0) 0x7fa734001490 con 0x7fa73c0d4cc0 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa724003520 con 0x7fa73c0d4cc0 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3292948798 0 0) 0x7fa724003520 con 0x7fa73c0d4cc0 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 >> v2:172.21.15.82:3300/0 conn(0x7fa73c0d1970 msgr2=0x7fa73c0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 --2- 172.21.15.37:0/474005153 >> v2:172.21.15.82:3300/0 conn(0x7fa73c0d1970 0x7fa73c0d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 >> v1:172.21.15.82:6789/0 conn(0x7fa73c15f420 legacy=0x7fa73c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c0d2c80 con 0x7fa73c0d4cc0 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fa734001bc0 con 0x7fa73c0d4cc0 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.986+0000 7fa73affd640 1 --2- 172.21.15.37:0/474005153 >> v2:172.21.15.82:3300/0 conn(0x7fa73c0d1970 0x7fa73c0d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 >> v1:172.21.15.37:6789/0 conn(0x7fa73c0d4cc0 legacy=0x7fa73c0d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73a7fc640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7240039b0 0x7fa724003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73a7fc640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa724004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73a7fc640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7240051c0 0x7fa72400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c0d2550 con 0x7fa724004800 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa72400c060 con 0x7fa7240039b0 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa72400c260 con 0x7fa7240051c0 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73affd640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa724004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73b7fe640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7240039b0 0x7fa724003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73bfff640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7240051c0 0x7fa72400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73affd640 1 -- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7240051c0 msgr2=0x7fa72400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73affd640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7240051c0 0x7fa72400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73affd640 1 -- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7240039b0 msgr2=0x7fa724003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73affd640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7240039b0 0x7fa724003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73affd640 1 -- 172.21.15.37:0/474005153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa724003520 con 0x7fa724004800 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.987+0000 7fa73bfff640 1 -- 172.21.15.37:0/474005153 reap_dead start 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa73affd640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa724004c80 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa730009c90 tx=0x7fa724005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67b9a6edfc4edfe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730036070 con 0x7fa724004800 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa730031400 con 0x7fa724004800 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa73a7fc640 1 -- 172.21.15.37:0/474005153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730009860 con 0x7fa724004800 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa7421da640 1 -- 172.21.15.37:0/474005153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 msgr2=0x7fa724004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa7421da640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa724004c80 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa730009c90 tx=0x7fa724005830 comp rx=0 tx=0).stop 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa7421da640 1 -- 172.21.15.37:0/474005153 shutdown_connections 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa7421da640 1 --2- 172.21.15.37:0/474005153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa724004c80 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa7421da640 1 -- 172.21.15.37:0/474005153 >> 172.21.15.37:0/474005153 conn(0x7fa73c08eac0 msgr2=0x7fa73c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.988+0000 7fa7421da640 1 -- 172.21.15.37:0/474005153 shutdown_connections 2024-05-10T08:47:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.989+0000 7fa7421da640 1 -- 172.21.15.37:0/474005153 wait complete. 2024-05-10T08:47:31.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.990+0000 7fa7421da640 1 Processor -- start 2024-05-10T08:47:31.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.990+0000 7fa7421da640 1 -- start start 2024-05-10T08:47:31.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa73c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c15f880 0x7fa73c0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c15fd00 0x7fa73c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c0d2830 con 0x7fa724004800 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c0d3240 con 0x7fa73c15f880 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa73c0d1e20 con 0x7fa73c15fd00 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa73c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa73c15d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48304/0 (socket says 172.21.15.37:48304) 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 -- 172.21.15.37:0/48324795 learned_addr learned my addr 172.21.15.37:0/48324795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73bfff640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c15fd00 0x7fa73c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73affd640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c15f880 0x7fa73c0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 -- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c15fd00 msgr2=0x7fa73c0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c15fd00 0x7fa73c0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 -- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c15f880 msgr2=0x7fa73c0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c15f880 0x7fa73c0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 -- 172.21.15.37:0/48324795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c160240 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73affd640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c15f880 0x7fa73c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73bfff640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c15fd00 0x7fa73c0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa73b7fe640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa73c15d8e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00f850 tx=0x7fa72c00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa723fff640 1 -- 172.21.15.37:0/48324795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00fe40 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa723fff640 1 -- 172.21.15.37:0/48324795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c018070 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c160520 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa723fff640 1 -- 172.21.15.37:0/48324795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00d730 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.991+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c0c8ba0 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.992+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73c0693f0 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.993+0000 7fa723fff640 1 -- 172.21.15.37:0/48324795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa72c00d8d0 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.994+0000 7fa723fff640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7280762d0 0x7fa728078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.994+0000 7fa723fff640 1 -- 172.21.15.37:0/48324795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fa72c0976d0 con 0x7fa724004800 2024-05-10T08:47:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.994+0000 7fa73affd640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7280762d0 0x7fa728078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.994+0000 7fa73affd640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7280762d0 0x7fa728078790 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa730033000 tx=0x7fa730008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:31.998+0000 7fa723fff640 1 -- 172.21.15.37:0/48324795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa72c060d80 con 0x7fa724004800 2024-05-10T08:47:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.228+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa73c0b4100 con 0x7fa724004800 2024-05-10T08:47:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.228+0000 7fa723fff640 1 -- 172.21.15.37:0/48324795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5178 (secure 0 0 0) 0x7fa72c060680 con 0x7fa724004800 2024-05-10T08:47:32.227 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:32.227 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:57.197376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":6}]} 2024-05-10T08:47:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 73 2024-05-10T08:47:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7280762d0 msgr2=0x7fa728078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7280762d0 0x7fa728078790 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa730033000 tx=0x7fa730008030 comp rx=0 tx=0).stop 2024-05-10T08:47:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 msgr2=0x7fa73c15d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa73c15d8e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00f850 tx=0x7fa72c00fd10 comp rx=0 tx=0).stop 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 shutdown_connections 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7280762d0 0x7fa728078790 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa73c15fd00 0x7fa73c0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa73c15f880 0x7fa73c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 --2- 172.21.15.37:0/48324795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa724004800 0x7fa73c15d8e0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 >> 172.21.15.37:0/48324795 conn(0x7fa73c08eac0 msgr2=0x7fa73c0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 shutdown_connections 2024-05-10T08:47:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.230+0000 7fa7421da640 1 -- 172.21.15.37:0/48324795 wait complete. 2024-05-10T08:47:32.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.345+0000 7fc68ced1640 1 Processor -- start 2024-05-10T08:47:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.345+0000 7fc68ced1640 1 -- start start 2024-05-10T08:47:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.346+0000 7fc68ced1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc68806d3b0 0x7fc68806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.346+0000 7fc68ced1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6880d1390 con 0x7fc6880733e0 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.346+0000 7fc68ced1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6880cff00 con 0x7fc68815ce90 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.346+0000 7fc68ced1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc68806dd60 con 0x7fc68806d3b0 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.346+0000 7fc685d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6880733e0 0x7fc6880d0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55966/0 (socket says 172.21.15.37:55966) 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.346+0000 7fc685d9b640 1 -- 172.21.15.37:0/1453220720 learned_addr learned my addr 172.21.15.37:0/1453220720 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc686d9d640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc68806d3b0 0x7fc68806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614264841 0 0) 0x7fc670001110 con 0x7fc6880733e0 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc674003520 con 0x7fc6880733e0 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648078427 0 0) 0x7fc6880cff00 con 0x7fc68815ce90 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc670001110 con 0x7fc68815ce90 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2675648839 0 0) 0x7fc674003520 con 0x7fc6880733e0 2024-05-10T08:47:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc68806d3b0 msgr2=0x7fc68806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc68806d3b0 0x7fc68806d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 >> v1:172.21.15.82:6789/0 conn(0x7fc68815ce90 legacy=0x7fc688070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc688073950 con 0x7fc6880733e0 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fc670001840 con 0x7fc6880733e0 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 >> v1:172.21.15.37:6789/0 conn(0x7fc6880733e0 legacy=0x7fc6880d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc674003b70 0x7fc674003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc674004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6740051c0 0x7fc67400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc68806dd60 con 0x7fc674004800 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc67400bfb0 con 0x7fc6740051c0 2024-05-10T08:47:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc67400c1b0 con 0x7fc674003b70 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc686d9d640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc68806d3b0 0x7fc68806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc685d9b640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc674004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc68659c640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc674003b70 0x7fc674003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc686d9d640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6740051c0 0x7fc67400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc685d9b640 1 -- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc674003b70 msgr2=0x7fc674003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc685d9b640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc674003b70 0x7fc674003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc685d9b640 1 -- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6740051c0 msgr2=0x7fc67400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.347+0000 7fc685d9b640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6740051c0 0x7fc67400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.348+0000 7fc685d9b640 1 -- 172.21.15.37:0/1453220720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc674003520 con 0x7fc674004800 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.348+0000 7fc686d9d640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6740051c0 0x7fc67400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.348+0000 7fc685d9b640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc674004c80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc67000c4c0 tx=0x7fc674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc58f1127547386 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.348+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc670035070 con 0x7fc674004800 2024-05-10T08:47:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.348+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67002c040 con 0x7fc674004800 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.348+0000 7fc68559a640 1 -- 172.21.15.37:0/1453220720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67000c0e0 con 0x7fc674004800 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.349+0000 7fc68ced1640 1 -- 172.21.15.37:0/1453220720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 msgr2=0x7fc674004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.349+0000 7fc68ced1640 1 --2- 172.21.15.37:0/1453220720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc674004c80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc67000c4c0 tx=0x7fc674005830 comp rx=0 tx=0).stop 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.349+0000 7fc686d9d640 1 -- 172.21.15.37:0/1453220720 reap_dead start 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.349+0000 7fc68ced1640 1 -- 172.21.15.37:0/1453220720 shutdown_connections 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.349+0000 7fc68ced1640 1 -- 172.21.15.37:0/1453220720 >> 172.21.15.37:0/1453220720 conn(0x7fc6880728c0 msgr2=0x7fc688072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.349+0000 7fc68ced1640 1 -- 172.21.15.37:0/1453220720 shutdown_connections 2024-05-10T08:47:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.349+0000 7fc68ced1640 1 -- 172.21.15.37:0/1453220720 wait complete. 2024-05-10T08:47:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.350+0000 7fc68ced1640 1 Processor -- start 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.350+0000 7fc68ced1640 1 -- start start 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68ced1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc6880c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68ced1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc688151b50 0x7fc688151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68ced1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688144fa0 0x7fc6881453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68ced1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880d0760 con 0x7fc674004800 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68ced1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880d0480 con 0x7fc688144fa0 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68ced1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc68815d270 con 0x7fc688151b50 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc6880c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc6880c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48324/0 (socket says 172.21.15.37:48324) 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc68659c640 1 -- 172.21.15.37:0/3817417738 learned_addr learned my addr 172.21.15.37:0/3817417738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc686d9d640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688144fa0 0x7fc6881453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.351+0000 7fc685d9b640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc688151b50 0x7fc688151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68659c640 1 -- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc688151b50 msgr2=0x7fc688151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68659c640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc688151b50 0x7fc688151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68659c640 1 -- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688144fa0 msgr2=0x7fc6881453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68659c640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688144fa0 0x7fc6881453e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68659c640 1 -- 172.21.15.37:0/3817417738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc688145d00 con 0x7fc674004800 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc686d9d640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688144fa0 0x7fc6881453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc685d9b640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc688151b50 0x7fc688151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68659c640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc6880c6d80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc68000f820 tx=0x7fc68000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc67effd640 1 -- 172.21.15.37:0/3817417738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6800050d0 con 0x7fc674004800 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc67effd640 1 -- 172.21.15.37:0/3817417738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680018070 con 0x7fc674004800 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc688142e20 con 0x7fc674004800 2024-05-10T08:47:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc67effd640 1 -- 172.21.15.37:0/3817417738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68000d730 con 0x7fc674004800 2024-05-10T08:47:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.352+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6881433e0 con 0x7fc674004800 2024-05-10T08:47:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.353+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6880693f0 con 0x7fc674004800 2024-05-10T08:47:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.353+0000 7fc67effd640 1 -- 172.21.15.37:0/3817417738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc68000d8d0 con 0x7fc674004800 2024-05-10T08:47:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.354+0000 7fc67effd640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6680762d0 0x7fc668078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.354+0000 7fc67effd640 1 -- 172.21.15.37:0/3817417738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7fc6800977d0 con 0x7fc674004800 2024-05-10T08:47:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.354+0000 7fc685d9b640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6680762d0 0x7fc668078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.355+0000 7fc685d9b640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6680762d0 0x7fc668078790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc670032000 tx=0x7fc670009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:32.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.358+0000 7fc67effd640 1 -- 172.21.15.37:0/3817417738 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc680060e80 con 0x7fc674004800 2024-05-10T08:47:32.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.591+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc688073050 con 0x7fc674004800 2024-05-10T08:47:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.591+0000 7fc67effd640 1 -- 172.21.15.37:0/3817417738 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5178 (secure 0 0 0) 0x7fc680067e20 con 0x7fc674004800 2024-05-10T08:47:32.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:32.590 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:57.197376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":6}]} 2024-05-10T08:47:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 73 2024-05-10T08:47:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6680762d0 msgr2=0x7fc668078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6680762d0 0x7fc668078790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc670032000 tx=0x7fc670009030 comp rx=0 tx=0).stop 2024-05-10T08:47:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 msgr2=0x7fc6880c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc6880c6d80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc68000f820 tx=0x7fc68000fce0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 shutdown_connections 2024-05-10T08:47:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6680762d0 0x7fc668078790 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688144fa0 0x7fc6881453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc688151b50 0x7fc688151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 --2- 172.21.15.37:0/3817417738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc674004800 0x7fc6880c6d80 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 >> 172.21.15.37:0/3817417738 conn(0x7fc6880728c0 msgr2=0x7fc688070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 shutdown_connections 2024-05-10T08:47:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.593+0000 7fc68ced1640 1 -- 172.21.15.37:0/3817417738 wait complete. 2024-05-10T08:47:32.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:47:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.708+0000 7efd6aa2a640 1 Processor -- start 2024-05-10T08:47:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.708+0000 7efd6aa2a640 1 -- start start 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd6aa2a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd6406c3a0 0x7efd640b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd6aa2a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 0x7efd640b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd6aa2a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6409ff30 con 0x7efd6415d180 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd6aa2a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efd6415e360 con 0x7efd6406c3a0 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd6aa2a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efd6415d750 con 0x7efd640aedf0 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd68fc7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efd6415d180 0x7efd6406c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55976/0 (socket says 172.21.15.37:55976) 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd68fc7640 1 -- 172.21.15.37:0/3762013661 learned_addr learned my addr 172.21.15.37:0/3762013661 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3575282038 0 0) 0x7efd6409ff30 con 0x7efd6415d180 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd637fe640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 0x7efd640b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd63fff640 1 --2- 172.21.15.37:0/3762013661 >> v2:172.21.15.82:3300/0 conn(0x7efd6406c3a0 0x7efd640b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.709+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd4c003520 con 0x7efd6415d180 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2662423622 0 0) 0x7efd4c003520 con 0x7efd6415d180 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 msgr2=0x7efd640b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 0x7efd640b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 >> v2:172.21.15.82:3300/0 conn(0x7efd6406c3a0 msgr2=0x7efd640b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 --2- 172.21.15.37:0/3762013661 >> v2:172.21.15.82:3300/0 conn(0x7efd6406c3a0 0x7efd640b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6415da30 con 0x7efd6415d180 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7efd5c0019f0 con 0x7efd6415d180 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 >> v1:172.21.15.37:6789/0 conn(0x7efd6415d180 legacy=0x7efd6406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 0x7efd4c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4c003f30 0x7efd4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd6415e360 con 0x7efd4c004d40 2024-05-10T08:47:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd6415d750 con 0x7efd4c003f30 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efd4c00b9c0 con 0x7efd640aedf0 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd68fc7640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd63fff640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 0x7efd4c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd637fe640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4c003f30 0x7efd4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd68fc7640 1 -- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 msgr2=0x7efd4c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd68fc7640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640aedf0 0x7efd4c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd68fc7640 1 -- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4c003f30 msgr2=0x7efd4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd68fc7640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4c003f30 0x7efd4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.710+0000 7efd68fc7640 1 -- 172.21.15.37:0/3762013661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c003520 con 0x7efd4c004d40 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.711+0000 7efd68fc7640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00a8a0 tx=0x7efd4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcab6592be896ace server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.711+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00a4c0 con 0x7efd4c004d40 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.711+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5c02f070 con 0x7efd4c004d40 2024-05-10T08:47:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.711+0000 7efd62ffd640 1 -- 172.21.15.37:0/3762013661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c02bd50 con 0x7efd4c004d40 2024-05-10T08:47:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.712+0000 7efd6aa2a640 1 -- 172.21.15.37:0/3762013661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c004d40 msgr2=0x7efd4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.712+0000 7efd6aa2a640 1 --2- 172.21.15.37:0/3762013661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00a8a0 tx=0x7efd4c005830 comp rx=0 tx=0).stop 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.712+0000 7efd68fc7640 1 -- 172.21.15.37:0/3762013661 reap_dead start 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.712+0000 7efd6aa2a640 1 -- 172.21.15.37:0/3762013661 shutdown_connections 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.712+0000 7efd6aa2a640 1 -- 172.21.15.37:0/3762013661 >> 172.21.15.37:0/3762013661 conn(0x7efd640b3b10 msgr2=0x7efd640b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.712+0000 7efd6aa2a640 1 -- 172.21.15.37:0/3762013661 shutdown_connections 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.712+0000 7efd6aa2a640 1 -- 172.21.15.37:0/3762013661 wait complete. 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.713+0000 7efd6aa2a640 1 Processor -- start 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.713+0000 7efd6aa2a640 1 -- start start 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd6aa2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd64148710 0x7efd64153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd6aa2a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640b2920 0x7efd6415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd6aa2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6415c370 0x7efd640b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd6aa2a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd640b6130 con 0x7efd64148710 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd6aa2a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd6415dff0 con 0x7efd6415c370 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd6aa2a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efd640b62b0 con 0x7efd640b2920 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd64148710 0x7efd64153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd64148710 0x7efd64153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48342/0 (socket says 172.21.15.37:48342) 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 -- 172.21.15.37:0/2480785010 learned_addr learned my addr 172.21.15.37:0/2480785010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd637fe640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640b2920 0x7efd6415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd68fc7640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6415c370 0x7efd640b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 -- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640b2920 msgr2=0x7efd6415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640b2920 0x7efd6415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 -- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6415c370 msgr2=0x7efd640b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6415c370 0x7efd640b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 -- 172.21.15.37:0/2480785010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd64152e70 con 0x7efd64148710 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd68fc7640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6415c370 0x7efd640b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd63fff640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd64148710 0x7efd64153f10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7efd54011a70 tx=0x7efd54011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.714+0000 7efd60ff9640 1 -- 172.21.15.37:0/2480785010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5400fb50 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.715+0000 7efd60ff9640 1 -- 172.21.15.37:0/2480785010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5400fcf0 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.715+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd64153150 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.715+0000 7efd60ff9640 1 -- 172.21.15.37:0/2480785010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5400fea0 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.715+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd64153710 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.716+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd640693f0 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.716+0000 7efd60ff9640 1 -- 172.21.15.37:0/2480785010 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd54012040 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.717+0000 7efd60ff9640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd500762d0 0x7efd50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.717+0000 7efd60ff9640 1 -- 172.21.15.37:0/2480785010 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7efd54097f20 con 0x7efd64148710 2024-05-10T08:47:32.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.717+0000 7efd637fe640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd500762d0 0x7efd50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:32.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.718+0000 7efd637fe640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd500762d0 0x7efd50078790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efd64152030 tx=0x7efd58008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.721+0000 7efd60ff9640 1 -- 172.21.15.37:0/2480785010 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efd54019030 con 0x7efd64148710 2024-05-10T08:47:32.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.911+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd64157980 con 0x7efd64148710 2024-05-10T08:47:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.912+0000 7efd60ff9640 1 -- 172.21.15.37:0/2480785010 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+17271 (secure 0 0 0) 0x7efd54061660 con 0x7efd64148710 2024-05-10T08:47:32.911 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:32.912 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:46:53.173831+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:45:31.356272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T08:45:32.644920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6832/375241165":"2024-05-11T08:46:53.173806+0000","172.21.15.37:6834/375241165":"2024-05-11T08:46:53.173806+0000","172.21.15.37:6834/54798262":"2024-05-11T08:45:43.002523+0000","172.21.15.37:6832/54798262":"2024-05-11T08:45:43.002523+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:47:32.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd500762d0 msgr2=0x7efd50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd500762d0 0x7efd50078790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efd64152030 tx=0x7efd58008040 comp rx=0 tx=0).stop 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd64148710 msgr2=0x7efd64153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd64148710 0x7efd64153f10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7efd54011a70 tx=0x7efd54011f30 comp rx=0 tx=0).stop 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 shutdown_connections 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd500762d0 0x7efd50078790 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd6415c370 0x7efd640b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd640b2920 0x7efd6415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 --2- 172.21.15.37:0/2480785010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd64148710 0x7efd64153f10 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 >> 172.21.15.37:0/2480785010 conn(0x7efd640b3b10 msgr2=0x7efd640b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 shutdown_connections 2024-05-10T08:47:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:32.914+0000 7efd6aa2a640 1 -- 172.21.15.37:0/2480785010 wait complete. 2024-05-10T08:47:32.924 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:47:32.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.030+0000 7f0f0d2c4640 1 Processor -- start 2024-05-10T08:47:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.030+0000 7f0f0d2c4640 1 -- start start 2024-05-10T08:47:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f0d2c4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f080d20c0 0x7f0f08163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f0d2c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f08071110 0x7f0f0806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f0d2c4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f080d1300 con 0x7f0f08070d30 2024-05-10T08:47:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f0d2c4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0f080d10d0 con 0x7f0f08071110 2024-05-10T08:47:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f0d2c4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f08070b80 con 0x7f0f080d20c0 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f077fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f08071110 0x7f0f0806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0efffff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f080d20c0 0x7f0f08163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f06ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0f08070d30 0x7f0f080703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:54488/0 (socket says 172.21.15.37:54488) 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f06ffd640 1 -- 172.21.15.37:0/1989872198 learned_addr learned my addr 172.21.15.37:0/1989872198 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f077fe640 1 -- 172.21.15.37:0/1989872198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f080d20c0 msgr2=0x7f0f08163920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f077fe640 1 --2- 172.21.15.37:0/1989872198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f080d20c0 0x7f0f08163920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f077fe640 1 -- 172.21.15.37:0/1989872198 >> v1:172.21.15.82:6789/0 conn(0x7f0f08070d30 legacy=0x7f0f080703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.031+0000 7f0f077fe640 1 -- 172.21.15.37:0/1989872198 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f080d15e0 con 0x7f0f08071110 2024-05-10T08:47:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.032+0000 7f0f077fe640 1 --2- 172.21.15.37:0/1989872198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f08071110 0x7f0f0806d4b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009d90 tx=0x7f0f0002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fe01b52c4dcd28 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.032+0000 7f0f067fc640 1 -- 172.21.15.37:0/1989872198 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00007740 con 0x7f0f08071110 2024-05-10T08:47:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f067fc640 1 -- 172.21.15.37:0/1989872198 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f000078e0 con 0x7f0f08071110 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f067fc640 1 -- 172.21.15.37:0/1989872198 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00007cb0 con 0x7f0f08071110 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/1989872198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f08071110 msgr2=0x7f0f0806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/1989872198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f08071110 0x7f0f0806d4b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009d90 tx=0x7f0f0002a660 comp rx=0 tx=0).stop 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/1989872198 shutdown_connections 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/1989872198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f08071110 0x7f0f0806d4b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/1989872198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f080d20c0 0x7f0f08163920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/1989872198 >> 172.21.15.37:0/1989872198 conn(0x7f0f080d2e90 msgr2=0x7f0f080d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/1989872198 shutdown_connections 2024-05-10T08:47:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.033+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/1989872198 wait complete. 2024-05-10T08:47:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.034+0000 7f0f0d2c4640 1 Processor -- start 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.034+0000 7f0f0d2c4640 1 -- start start 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f0d2c4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f08070d30 0x7f0f0806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f0d2c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f08071110 0x7f0f081520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f0d2c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f080d20c0 0x7f0f081525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f0d2c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08071580 con 0x7f0f08071110 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f0d2c4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f080d1c30 con 0x7f0f080d20c0 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f0d2c4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f08071700 con 0x7f0f08070d30 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f08071110 0x7f0f081520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f08071110 0x7f0f081520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48358/0 (socket says 172.21.15.37:48358) 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 -- 172.21.15.37:0/510129415 learned_addr learned my addr 172.21.15.37:0/510129415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f077fe640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f080d20c0 0x7f0f081525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f06ffd640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f08070d30 0x7f0f0806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 -- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f08070d30 msgr2=0x7f0f0806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f08070d30 0x7f0f0806dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 -- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f080d20c0 msgr2=0x7f0f081525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f080d20c0 0x7f0f081525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0efffff640 1 -- 172.21.15.37:0/510129415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f080b5d80 con 0x7f0f08071110 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.035+0000 7f0f077fe640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f080d20c0 0x7f0f081525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.036+0000 7f0efffff640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f08071110 0x7f0f081520b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e9b0 tx=0x7f0ef000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.036+0000 7f0eff7fe640 1 -- 172.21.15.37:0/510129415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0017070 con 0x7f0f08071110 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.036+0000 7f0eff7fe640 1 -- 172.21.15.37:0/510129415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef000c9a0 con 0x7f0f08071110 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.036+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0815df30 con 0x7f0f08071110 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.036+0000 7f0eff7fe640 1 -- 172.21.15.37:0/510129415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000cd90 con 0x7f0f08071110 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.036+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0815e4f0 con 0x7f0f08071110 2024-05-10T08:47:33.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.037+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f080693f0 con 0x7f0f08071110 2024-05-10T08:47:33.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.037+0000 7f0eff7fe640 1 -- 172.21.15.37:0/510129415 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ef001a070 con 0x7f0f08071110 2024-05-10T08:47:33.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.038+0000 7f0eff7fe640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ee8076300 0x7f0ee80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.038+0000 7f0eff7fe640 1 -- 172.21.15.37:0/510129415 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f0ef0097810 con 0x7f0f08071110 2024-05-10T08:47:33.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.038+0000 7f0f06ffd640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ee8076300 0x7f0ee80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.039+0000 7f0f06ffd640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ee8076300 0x7f0ee80787c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8000f60 tx=0x7f0ef8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.042+0000 7f0eff7fe640 1 -- 172.21.15.37:0/510129415 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0ef0060f50 con 0x7f0f08071110 2024-05-10T08:47:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.270+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f080b8e10 con 0x7f0f08071110 2024-05-10T08:47:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.270+0000 7f0eff7fe640 1 -- 172.21.15.37:0/510129415 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5178 (secure 0 0 0) 0x7f0ef0060850 con 0x7f0f08071110 2024-05-10T08:47:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:57.197376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":6}]} 2024-05-10T08:47:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 73 2024-05-10T08:47:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ee8076300 msgr2=0x7f0ee80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ee8076300 0x7f0ee80787c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8000f60 tx=0x7f0ef8009040 comp rx=0 tx=0).stop 2024-05-10T08:47:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f08071110 msgr2=0x7f0f081520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f08071110 0x7f0f081520b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e9b0 tx=0x7f0ef000ee70 comp rx=0 tx=0).stop 2024-05-10T08:47:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 shutdown_connections 2024-05-10T08:47:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ee8076300 0x7f0ee80787c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f080d20c0 0x7f0f081525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f08071110 0x7f0f081520b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 --2- 172.21.15.37:0/510129415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f08070d30 0x7f0f0806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 >> 172.21.15.37:0/510129415 conn(0x7f0f080d2e90 msgr2=0x7f0f08154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 shutdown_connections 2024-05-10T08:47:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.272+0000 7f0f0d2c4640 1 -- 172.21.15.37:0/510129415 wait complete. 2024-05-10T08:47:33.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.388+0000 7f7f17fc9640 1 Processor -- start 2024-05-10T08:47:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.388+0000 7f7f17fc9640 1 -- start start 2024-05-10T08:47:33.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.389+0000 7f7f17fc9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f1015efe0 0x7f7f100b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.389+0000 7f7f17fc9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f101637f0 con 0x7f7f1006e540 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.389+0000 7f7f17fc9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1006ff30 con 0x7f7f100d0fc0 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.389+0000 7f7f17fc9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7f100b55a0 con 0x7f7f1015efe0 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.389+0000 7f7f15564640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f1006e540 0x7f7f100d08b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55988/0 (socket says 172.21.15.37:55988) 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.389+0000 7f7f15564640 1 -- 172.21.15.37:0/3591702594 learned_addr learned my addr 172.21.15.37:0/3591702594 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f15d65640 1 --2- 172.21.15.37:0/3591702594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f1015efe0 0x7f7f100b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012636021 0 0) 0x7f7f101637f0 con 0x7f7f1006e540 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7efc003520 con 0x7f7f1006e540 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087725170 0 0) 0x7f7f1006ff30 con 0x7f7f100d0fc0 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f101637f0 con 0x7f7f100d0fc0 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2607514017 0 0) 0x7f7efc003520 con 0x7f7f1006e540 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f15d65640 1 -- 172.21.15.37:0/3591702594 >> v1:172.21.15.82:6789/0 conn(0x7f7f100d0fc0 legacy=0x7f7f100b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f15d65640 1 -- 172.21.15.37:0/3591702594 >> v1:172.21.15.37:6789/0 conn(0x7f7f1006e540 legacy=0x7f7f100d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.390+0000 7f7f15d65640 1 -- 172.21.15.37:0/3591702594 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f10070210 con 0x7f7f1015efe0 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f15d65640 1 --2- 172.21.15.37:0/3591702594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f1015efe0 0x7f7f100b5060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0097d0 tx=0x7f7f0c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=249dc9fed3fa47ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c037070 con 0x7f7f1015efe0 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0c02ac30 con 0x7f7f1015efe0 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f14d63640 1 -- 172.21.15.37:0/3591702594 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000015f0 con 0x7f7f1015efe0 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3591702594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f1015efe0 msgr2=0x7f7f100b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3591702594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f1015efe0 0x7f7f100b5060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0097d0 tx=0x7f7f0c02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3591702594 shutdown_connections 2024-05-10T08:47:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3591702594 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f1015efe0 0x7f7f100b5060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3591702594 >> 172.21.15.37:0/3591702594 conn(0x7f7f1006c3a0 msgr2=0x7f7f1006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.391+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3591702594 shutdown_connections 2024-05-10T08:47:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.392+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3591702594 wait complete. 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 Processor -- start 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 -- start start 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1006e540 0x7f7f1014b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f100d0fc0 0x7f7f10162500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1015efe0 0x7f7f1009ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1015f540 con 0x7f7f1006e540 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1015f3c0 con 0x7f7f1015efe0 2024-05-10T08:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f17fc9640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7f100b5740 con 0x7f7f100d0fc0 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.393+0000 7f7f15d65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1006e540 0x7f7f1014b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1006e540 0x7f7f1014b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48368/0 (socket says 172.21.15.37:48368) 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 -- 172.21.15.37:0/3652531994 learned_addr learned my addr 172.21.15.37:0/3652531994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15564640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f100d0fc0 0x7f7f10162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f16566640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1015efe0 0x7f7f1009ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 -- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f100d0fc0 msgr2=0x7f7f10162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f100d0fc0 0x7f7f10162500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 -- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1015efe0 msgr2=0x7f7f1009ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1015efe0 0x7f7f1009ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 -- 172.21.15.37:0/3652531994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1009c140 con 0x7f7f1006e540 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f15d65640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1006e540 0x7f7f1014b840 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0097d0 tx=0x7f7f0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f067fc640 1 -- 172.21.15.37:0/3652531994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c042020 con 0x7f7f1006e540 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f067fc640 1 -- 172.21.15.37:0/3652531994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0c03d670 con 0x7f7f1006e540 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1009c420 con 0x7f7f1006e540 2024-05-10T08:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f067fc640 1 -- 172.21.15.37:0/3652531994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c037040 con 0x7f7f1006e540 2024-05-10T08:47:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.394+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1009c9e0 con 0x7f7f1006e540 2024-05-10T08:47:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.395+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f100693f0 con 0x7f7f1006e540 2024-05-10T08:47:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.396+0000 7f7f067fc640 1 -- 172.21.15.37:0/3652531994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f0c045020 con 0x7f7f1006e540 2024-05-10T08:47:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.396+0000 7f7f067fc640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ef40762d0 0x7f7ef4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.396+0000 7f7f067fc640 1 -- 172.21.15.37:0/3652531994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f7f0c0b7f80 con 0x7f7f1006e540 2024-05-10T08:47:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.397+0000 7f7f15564640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ef40762d0 0x7f7ef4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.397+0000 7f7f15564640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ef40762d0 0x7f7ef4078790 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7f100d0260 tx=0x7f7f00001610 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.401+0000 7f7f067fc640 1 -- 172.21.15.37:0/3652531994 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7f0c04c030 con 0x7f7f1006e540 2024-05-10T08:47:33.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.633+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f1006cc70 con 0x7f7f1006e540 2024-05-10T08:47:33.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.634+0000 7f7f067fc640 1 -- 172.21.15.37:0/3652531994 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5178 (secure 0 0 0) 0x7f7f0c081070 con 0x7f7f1006e540 2024-05-10T08:47:33.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:33.633 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:45:33.691603+0000","modified":"2024-05-10T08:46:57.197376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/345427151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":345427151},{"type":"v1","addr":"172.21.15.37:6834","nonce":345427151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7137,"qdb_cluster":[7137]},"id":6}]} 2024-05-10T08:47:33.633 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 73 2024-05-10T08:47:33.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ef40762d0 msgr2=0x7f7ef4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ef40762d0 0x7f7ef4078790 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7f100d0260 tx=0x7f7f00001610 comp rx=0 tx=0).stop 2024-05-10T08:47:33.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1006e540 msgr2=0x7f7f1014b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1006e540 0x7f7f1014b840 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0097d0 tx=0x7f7f0c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 shutdown_connections 2024-05-10T08:47:33.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ef40762d0 0x7f7ef4078790 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1015efe0 0x7f7f1009ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7f100d0fc0 0x7f7f10162500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 --2- 172.21.15.37:0/3652531994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1006e540 0x7f7f1014b840 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 >> 172.21.15.37:0/3652531994 conn(0x7f7f1006c3a0 msgr2=0x7f7f1015e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:33.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 shutdown_connections 2024-05-10T08:47:33.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.636+0000 7f7f17fc9640 1 -- 172.21.15.37:0/3652531994 wait complete. 2024-05-10T08:47:33.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:47:33.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.750+0000 7f29bd664640 1 Processor -- start 2024-05-10T08:47:33.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.750+0000 7f29bd664640 1 -- start start 2024-05-10T08:47:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29bd664640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29b806f060 0x7f29b806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29bd664640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 0x7f29b80cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29bd664640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29b80d0360 0x7f29b80b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29bd664640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f29b80d07c0 con 0x7f29b806f060 2024-05-10T08:47:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29bd664640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f29b806f440 con 0x7f29b80d0360 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29bd664640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29b815d2a0 con 0x7f29b806fe30 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29b6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29b806f060 0x7f29b806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29b6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29b806f060 0x7f29b806e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48380/0 (socket says 172.21.15.37:48380) 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.751+0000 7f29b6ffd640 1 -- 172.21.15.37:0/757350202 learned_addr learned my addr 172.21.15.37:0/757350202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.752+0000 7f29b6ffd640 1 -- 172.21.15.37:0/757350202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 msgr2=0x7f29b80cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.752+0000 7f29b6ffd640 1 --2- 172.21.15.37:0/757350202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 0x7f29b80cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.752+0000 7f29b6ffd640 1 -- 172.21.15.37:0/757350202 >> v2:172.21.15.82:3300/0 conn(0x7f29b80d0360 msgr2=0x7f29b80b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.752+0000 7f29b6ffd640 1 --2- 172.21.15.37:0/757350202 >> v2:172.21.15.82:3300/0 conn(0x7f29b80d0360 0x7f29b80b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.752+0000 7f29b6ffd640 1 -- 172.21.15.37:0/757350202 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b81609b0 con 0x7f29b806f060 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.752+0000 7f29b6ffd640 1 --2- 172.21.15.37:0/757350202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b806f060 0x7f29b806e0f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f29b81608e0 tx=0x7f29a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b81d0716131b9c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29b5ffb640 1 -- 172.21.15.37:0/757350202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8037070 con 0x7f29b806f060 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29b5ffb640 1 -- 172.21.15.37:0/757350202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8032440 con 0x7f29b806f060 2024-05-10T08:47:33.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29b5ffb640 1 -- 172.21.15.37:0/757350202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8032810 con 0x7f29b806f060 2024-05-10T08:47:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 -- 172.21.15.37:0/757350202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b806f060 msgr2=0x7f29b806e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 --2- 172.21.15.37:0/757350202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b806f060 0x7f29b806e0f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f29b81608e0 tx=0x7f29a802a1e0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 -- 172.21.15.37:0/757350202 shutdown_connections 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 --2- 172.21.15.37:0/757350202 >> v2:172.21.15.82:3300/0 conn(0x7f29b80d0360 0x7f29b80b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 --2- 172.21.15.37:0/757350202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 0x7f29b80cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 --2- 172.21.15.37:0/757350202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b806f060 0x7f29b806e0f0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 -- 172.21.15.37:0/757350202 >> 172.21.15.37:0/757350202 conn(0x7f29b806c3a0 msgr2=0x7f29b806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 -- 172.21.15.37:0/757350202 shutdown_connections 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.753+0000 7f29bd664640 1 -- 172.21.15.37:0/757350202 wait complete. 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 Processor -- start 2024-05-10T08:47:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 -- start start 2024-05-10T08:47:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b806f060 0x7f29b8151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 0x7f29b8157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b80d0360 0x7f29b8150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8161250 con 0x7f29b80d0360 2024-05-10T08:47:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8160f70 con 0x7f29b806f060 2024-05-10T08:47:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29bd664640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29b8161530 con 0x7f29b806fe30 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.755+0000 7f29b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b80d0360 0x7f29b8150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b80d0360 0x7f29b8150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48388/0 (socket says 172.21.15.37:48388) 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 -- 172.21.15.37:0/3476039199 learned_addr learned my addr 172.21.15.37:0/3476039199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b6ffd640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b806f060 0x7f29b8151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b67fc640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 0x7f29b8157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 -- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 msgr2=0x7f29b8157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 0x7f29b8157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 -- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b806f060 msgr2=0x7f29b8151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b806f060 0x7f29b8151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 -- 172.21.15.37:0/3476039199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b8156b60 con 0x7f29b80d0360 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b6ffd640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b806f060 0x7f29b8151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29b77fe640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b80d0360 0x7f29b8150bc0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f29b000b970 tx=0x7f29b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f299f7fe640 1 -- 172.21.15.37:0/3476039199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0019070 con 0x7f29b80d0360 2024-05-10T08:47:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f299f7fe640 1 -- 172.21.15.37:0/3476039199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b000cb60 con 0x7f29b80d0360 2024-05-10T08:47:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f299f7fe640 1 -- 172.21.15.37:0/3476039199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0014440 con 0x7f29b80d0360 2024-05-10T08:47:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b8156e40 con 0x7f29b80d0360 2024-05-10T08:47:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.756+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b8157400 con 0x7f29b80d0360 2024-05-10T08:47:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.757+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b80693f0 con 0x7f29b80d0360 2024-05-10T08:47:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.758+0000 7f299f7fe640 1 -- 172.21.15.37:0/3476039199 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29b001c070 con 0x7f29b80d0360 2024-05-10T08:47:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.758+0000 7f299f7fe640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29a40762d0 0x7f29a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.758+0000 7f299f7fe640 1 -- 172.21.15.37:0/3476039199 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f29b0097610 con 0x7f29b80d0360 2024-05-10T08:47:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.758+0000 7f29b6ffd640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29a40762d0 0x7f29a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.759+0000 7f29b6ffd640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29a40762d0 0x7f29a4078790 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.763+0000 7f299f7fe640 1 -- 172.21.15.37:0/3476039199 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f29b0060cd0 con 0x7f29b80d0360 2024-05-10T08:47:33.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.953+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29b8157640 con 0x7f29b80d0360 2024-05-10T08:47:33.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.955+0000 7f299f7fe640 1 -- 172.21.15.37:0/3476039199 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+17271 (secure 0 0 0) 0x7f29b00605d0 con 0x7f29b80d0360 2024-05-10T08:47:33.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:33.954 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:46:53.173831+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:45:31.356272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-10T08:45:32.644920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6832/375241165":"2024-05-11T08:46:53.173806+0000","172.21.15.37:6834/375241165":"2024-05-11T08:46:53.173806+0000","172.21.15.37:6834/54798262":"2024-05-11T08:45:43.002523+0000","172.21.15.37:6832/54798262":"2024-05-11T08:45:43.002523+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:47:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29a40762d0 msgr2=0x7f29a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29a40762d0 0x7f29a4078790 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).stop 2024-05-10T08:47:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b80d0360 msgr2=0x7f29b8150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b80d0360 0x7f29b8150bc0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f29b000b970 tx=0x7f29b000be30 comp rx=0 tx=0).stop 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 shutdown_connections 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29a40762d0 0x7f29a4078790 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29b80d0360 0x7f29b8150bc0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29b806fe30 0x7f29b8157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 --2- 172.21.15.37:0/3476039199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b806f060 0x7f29b8151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 >> 172.21.15.37:0/3476039199 conn(0x7f29b806c3a0 msgr2=0x7f29b815dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 shutdown_connections 2024-05-10T08:47:33.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:33.957+0000 7f29bd664640 1 -- 172.21.15.37:0/3476039199 wait complete. 2024-05-10T08:47:33.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:47:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.073+0000 7f9642264640 1 Processor -- start 2024-05-10T08:47:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.073+0000 7f9642264640 1 -- start start 2024-05-10T08:47:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9642264640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f963c06f060 0x7f963c06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9642264640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f963c06fe30 0x7f963c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9642264640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f963c15d2a0 con 0x7f963c0d0360 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9642264640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f963c0d07c0 con 0x7f963c06fe30 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9642264640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f963c06f440 con 0x7f963c06f060 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9633fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f963c06fe30 0x7f963c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9633fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f963c06fe30 0x7f963c0cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48402/0 (socket says 172.21.15.37:48402) 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f9633fff640 1 -- 172.21.15.37:0/2474783723 learned_addr learned my addr 172.21.15.37:0/2474783723 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.074+0000 7f963bfff640 1 --2- 172.21.15.37:0/2474783723 >> v2:172.21.15.82:3300/0 conn(0x7f963c06f060 0x7f963c06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.075+0000 7f9633fff640 1 -- 172.21.15.37:0/2474783723 >> v2:172.21.15.82:3300/0 conn(0x7f963c06f060 msgr2=0x7f963c06e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.075+0000 7f9633fff640 1 --2- 172.21.15.37:0/2474783723 >> v2:172.21.15.82:3300/0 conn(0x7f963c06f060 0x7f963c06e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.075+0000 7f9633fff640 1 -- 172.21.15.37:0/2474783723 >> v1:172.21.15.37:6789/0 conn(0x7f963c0d0360 legacy=0x7f963c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.075+0000 7f9633fff640 1 -- 172.21.15.37:0/2474783723 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c1609b0 con 0x7f963c06fe30 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.075+0000 7f9633fff640 1 --2- 172.21.15.37:0/2474783723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06fe30 0x7f963c0cfe20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f963c0b5470 tx=0x7f962402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b9aca46907e651 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.075+0000 7f963b7fe640 1 -- 172.21.15.37:0/2474783723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9624037070 con 0x7f963c06fe30 2024-05-10T08:47:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f963b7fe640 1 -- 172.21.15.37:0/2474783723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9624032440 con 0x7f963c06fe30 2024-05-10T08:47:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f963b7fe640 1 -- 172.21.15.37:0/2474783723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9624032810 con 0x7f963c06fe30 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 -- 172.21.15.37:0/2474783723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06fe30 msgr2=0x7f963c0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 --2- 172.21.15.37:0/2474783723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06fe30 0x7f963c0cfe20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f963c0b5470 tx=0x7f962402a270 comp rx=0 tx=0).stop 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 -- 172.21.15.37:0/2474783723 shutdown_connections 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 --2- 172.21.15.37:0/2474783723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06fe30 0x7f963c0cfe20 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 --2- 172.21.15.37:0/2474783723 >> v2:172.21.15.82:3300/0 conn(0x7f963c06f060 0x7f963c06e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 -- 172.21.15.37:0/2474783723 >> 172.21.15.37:0/2474783723 conn(0x7f963c06c3a0 msgr2=0x7f963c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 -- 172.21.15.37:0/2474783723 shutdown_connections 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.076+0000 7f9642264640 1 -- 172.21.15.37:0/2474783723 wait complete. 2024-05-10T08:47:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.077+0000 7f9642264640 1 Processor -- start 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f9642264640 1 -- start start 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f9642264640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06f060 0x7f963c152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f9642264640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c06fe30 0x7f963c073a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f9642264640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f963c0d0360 0x7f963c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f9642264640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f963c161250 con 0x7f963c06f060 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f9642264640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f963c160f70 con 0x7f963c06fe30 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f9642264640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f963c161530 con 0x7f963c0d0360 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f963bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06f060 0x7f963c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f963bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06f060 0x7f963c152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48408/0 (socket says 172.21.15.37:48408) 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.078+0000 7f963bfff640 1 -- 172.21.15.37:0/720687547 learned_addr learned my addr 172.21.15.37:0/720687547 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f9633fff640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c06fe30 0x7f963c073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f9640801640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f963c0d0360 0x7f963c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f963bfff640 1 -- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f963c0d0360 msgr2=0x7f963c157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f963bfff640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f963c0d0360 0x7f963c157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f963bfff640 1 -- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c06fe30 msgr2=0x7f963c073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f963bfff640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c06fe30 0x7f963c073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f963bfff640 1 -- 172.21.15.37:0/720687547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c1f8430 con 0x7f963c06f060 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f9640801640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f963c0d0360 0x7f963c157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f963bfff640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06f060 0x7f963c152080 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f962c00d800 tx=0x7f962c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f96397fa640 1 -- 172.21.15.37:0/720687547 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c00b6c0 con 0x7f963c06f060 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f96397fa640 1 -- 172.21.15.37:0/720687547 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c019070 con 0x7f963c06f060 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c1f8710 con 0x7f963c06f060 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f96397fa640 1 -- 172.21.15.37:0/720687547 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c00ba80 con 0x7f963c06f060 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.079+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c1f8fb0 con 0x7f963c06f060 2024-05-10T08:47:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.080+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c1f88e0 con 0x7f963c06f060 2024-05-10T08:47:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.081+0000 7f96397fa640 1 -- 172.21.15.37:0/720687547 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f962c00bc20 con 0x7f963c06f060 2024-05-10T08:47:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.081+0000 7f96397fa640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f961c0762d0 0x7f961c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.081+0000 7f96397fa640 1 -- 172.21.15.37:0/720687547 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6389+0+0 (secure 0 0 0) 0x7f962c097ce0 con 0x7f963c06f060 2024-05-10T08:47:34.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.081+0000 7f9633fff640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f961c0762d0 0x7f961c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.082+0000 7f9633fff640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f961c0762d0 0x7f961c078790 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9624034000 tx=0x7f962402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:34.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.085+0000 7f96397fa640 1 -- 172.21.15.37:0/720687547 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f962c061390 con 0x7f963c06f060 2024-05-10T08:47:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.315+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f963c0693f0 con 0x7f963c06f060 2024-05-10T08:47:34.314 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:47:34.316+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:47:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.319+0000 7f96397fa640 1 -- 172.21.15.37:0/720687547 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) ==== 161+0+0 (secure 0 0 0) 0x7f962c060c90 con 0x7f963c06f060 2024-05-10T08:47:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:47:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f961c0762d0 msgr2=0x7f961c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f961c0762d0 0x7f961c078790 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9624034000 tx=0x7f962402e000 comp rx=0 tx=0).stop 2024-05-10T08:47:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06f060 msgr2=0x7f963c152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06f060 0x7f963c152080 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f962c00d800 tx=0x7f962c00dcc0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 shutdown_connections 2024-05-10T08:47:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f961c0762d0 0x7f961c078790 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f963c0d0360 0x7f963c157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c06fe30 0x7f963c073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 --2- 172.21.15.37:0/720687547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c06f060 0x7f963c152080 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 >> 172.21.15.37:0/720687547 conn(0x7f963c06c3a0 msgr2=0x7f963c15f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 shutdown_connections 2024-05-10T08:47:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.321+0000 7f9642264640 1 -- 172.21.15.37:0/720687547 wait complete. 2024-05-10T08:47:34.322 INFO:tasks.ceph.mds.c.smithi037.stderr: -2299> 2024-05-10T08:46:59.190+0000 7f8aec960640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:47:34.323 INFO:tasks.ceph.mds.c.smithi037.stderr: -1844> 2024-05-10T08:46:59.953+0000 7f8ae8958640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x55714541c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T08:47:34.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:47:34.352 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:47:34.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.444+0000 7f40b93dd640 1 Processor -- start 2024-05-10T08:47:34.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.444+0000 7f40b93dd640 1 -- start start 2024-05-10T08:47:34.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b93dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b93dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40b406e4d0 0x7f40b40aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b93dd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b415c920 con 0x7f40b406e0f0 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b93dd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f40b415cc00 con 0x7f40b406e4d0 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b93dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f40b415cee0 con 0x7f40b4072840 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f40b406e0f0 0x7f40b40d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56016/0 (socket says 172.21.15.37:56016) 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b2ffd640 1 -- 172.21.15.37:0/3561592166 learned_addr learned my addr 172.21.15.37:0/3561592166 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b37fe640 1 --2- 172.21.15.37:0/3561592166 >> v2:172.21.15.82:3300/0 conn(0x7f40b406e4d0 0x7f40b40aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b27fc640 1 --2- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b1ffb640 1 -- 172.21.15.37:0/3561592166 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159854130 0 0) 0x7f40b415c920 con 0x7f40b406e0f0 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b1ffb640 1 -- 172.21.15.37:0/3561592166 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f409c005730 con 0x7f40b406e0f0 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b37fe640 1 -- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 msgr2=0x7f40b415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:34.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b37fe640 1 --2- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b37fe640 1 -- 172.21.15.37:0/3561592166 >> v1:172.21.15.37:6789/0 conn(0x7f40b406e0f0 legacy=0x7f40b40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b37fe640 1 -- 172.21.15.37:0/3561592166 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b415d1c0 con 0x7f40b406e4d0 2024-05-10T08:47:34.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.445+0000 7f40b27fc640 1 --2- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.446+0000 7f40b37fe640 1 --2- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e4d0 0x7f40b40aec30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0097a0 tx=0x7f40ac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeef19faeb6cbac7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b1ffb640 1 -- 172.21.15.37:0/3561592166 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac037070 con 0x7f40b406e4d0 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b1ffb640 1 -- 172.21.15.37:0/3561592166 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ac032440 con 0x7f40b406e4d0 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b1ffb640 1 -- 172.21.15.37:0/3561592166 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac032810 con 0x7f40b406e4d0 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b93dd640 1 -- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e4d0 msgr2=0x7f40b40aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b93dd640 1 --2- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e4d0 0x7f40b40aec30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0097a0 tx=0x7f40ac02a180 comp rx=0 tx=0).stop 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b93dd640 1 -- 172.21.15.37:0/3561592166 shutdown_connections 2024-05-10T08:47:34.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b93dd640 1 --2- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e4d0 0x7f40b40aec30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b93dd640 1 --2- 172.21.15.37:0/3561592166 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b93dd640 1 -- 172.21.15.37:0/3561592166 >> 172.21.15.37:0/3561592166 conn(0x7f40b406c3a0 msgr2=0x7f40b406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:34.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.447+0000 7f40b93dd640 1 -- 172.21.15.37:0/3561592166 shutdown_connections 2024-05-10T08:47:34.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.448+0000 7f40b93dd640 1 -- 172.21.15.37:0/3561592166 wait complete. 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.449+0000 7f40b93dd640 1 Processor -- start 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.449+0000 7f40b93dd640 1 -- start start 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b93dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e0f0 0x7f40b414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b93dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40b406e4d0 0x7f40b4157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b93dd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b41f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b93dd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40ae7d0 con 0x7f40b406e4d0 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b93dd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40ae650 con 0x7f40b406e0f0 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b93dd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f40b41530b0 con 0x7f40b4072840 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40b406e4d0 0x7f40b4157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40b406e4d0 0x7f40b4157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48426/0 (socket says 172.21.15.37:48426) 2024-05-10T08:47:34.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 -- 172.21.15.37:0/1731038733 learned_addr learned my addr 172.21.15.37:0/1731038733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b37fe640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b41f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b2ffd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e0f0 0x7f40b414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 -- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 msgr2=0x7f40b41f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b41f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 -- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e0f0 msgr2=0x7f40b414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e0f0 0x7f40b414e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 -- 172.21.15.37:0/1731038733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b41f1040 con 0x7f40b406e4d0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b27fc640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40b406e4d0 0x7f40b4157e50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f40a800efc0 tx=0x7f40a8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f409b7fe640 1 -- 172.21.15.37:0/1731038733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8018020 con 0x7f40b406e4d0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f409b7fe640 1 -- 172.21.15.37:0/1731038733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a8014680 con 0x7f40b406e4d0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f409b7fe640 1 -- 172.21.15.37:0/1731038733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a800ce60 con 0x7f40b406e4d0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.450+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b41f1320 con 0x7f40b406e4d0 2024-05-10T08:47:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.451+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b41f18e0 con 0x7f40b406e4d0 2024-05-10T08:47:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.452+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b415f670 con 0x7f40b406e4d0 2024-05-10T08:47:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.452+0000 7f409b7fe640 1 -- 172.21.15.37:0/1731038733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f40a8005d10 con 0x7f40b406e4d0 2024-05-10T08:47:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.453+0000 7f409b7fe640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40a00762d0 0x7f40a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.453+0000 7f409b7fe640 1 -- 172.21.15.37:0/1731038733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6475+0+0 (secure 0 0 0) 0x7f40a8098330 con 0x7f40b406e4d0 2024-05-10T08:47:34.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.453+0000 7f40b2ffd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40a00762d0 0x7f40a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:34.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.454+0000 7f40b2ffd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40a00762d0 0x7f40a0078790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005880 tx=0x7f40a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.457+0000 7f409b7fe640 1 -- 172.21.15.37:0/1731038733 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f40b415f670 con 0x7f40b406e4d0 2024-05-10T08:47:34.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:34.687+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f40b40693f0 con 0x7f40b406e4d0 2024-05-10T08:47:35.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.320+0000 7f409b7fe640 1 -- 172.21.15.37:0/1731038733 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v75) ==== 104+0+0 (secure 0 0 0) 0x7f40a8022070 con 0x7f40b406e4d0 2024-05-10T08:47:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40a00762d0 msgr2=0x7f40a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40a00762d0 0x7f40a0078790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005880 tx=0x7f40a4009040 comp rx=0 tx=0).stop 2024-05-10T08:47:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40b406e4d0 msgr2=0x7f40b4157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40b406e4d0 0x7f40b4157e50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f40a800efc0 tx=0x7f40a8009f90 comp rx=0 tx=0).stop 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 shutdown_connections 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f40a00762d0 0x7f40a0078790 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40b4072840 0x7f40b41f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40b406e4d0 0x7f40b4157e50 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 --2- 172.21.15.37:0/1731038733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b406e0f0 0x7f40b414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 >> 172.21.15.37:0/1731038733 conn(0x7f40b406c3a0 msgr2=0x7f40b406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 shutdown_connections 2024-05-10T08:47:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.323+0000 7f40b93dd640 1 -- 172.21.15.37:0/1731038733 wait complete. 2024-05-10T08:47:35.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:47:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.495+0000 7f2c31493640 1 Processor -- start 2024-05-10T08:47:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.495+0000 7f2c31493640 1 -- start start 2024-05-10T08:47:35.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c31493640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c2c06ff10 0x7f2c2c0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:35.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c31493640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2c2c0afe50 0x7f2c2c15d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:35.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c31493640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2c0b4b70 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c31493640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2c15dec0 con 0x7f2c2c06ff10 2024-05-10T08:47:35.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c31493640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2c15e1a0 con 0x7f2c2c0afe50 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c2affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c2c06ff10 0x7f2c2c0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c2a7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c2c15d2c0 0x7f2c2c0af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56020/0 (socket says 172.21.15.37:56020) 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c2a7fc640 1 -- 172.21.15.37:0/1951843195 learned_addr learned my addr 172.21.15.37:0/1951843195 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c2affd640 1 --2- 172.21.15.37:0/1951843195 >> v2:172.21.15.37:3300/0 conn(0x7f2c2c06ff10 0x7f2c2c0b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48434/0 (socket says 172.21.15.37:48434) 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.496+0000 7f2c2b7fe640 1 --2- 172.21.15.37:0/1951843195 >> v2:172.21.15.82:3300/0 conn(0x7f2c2c0afe50 0x7f2c2c15d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.497+0000 7f2c2affd640 1 -- 172.21.15.37:0/1951843195 >> v2:172.21.15.82:3300/0 conn(0x7f2c2c0afe50 msgr2=0x7f2c2c15d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.497+0000 7f2c2affd640 1 --2- 172.21.15.37:0/1951843195 >> v2:172.21.15.82:3300/0 conn(0x7f2c2c0afe50 0x7f2c2c15d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.497+0000 7f2c2affd640 1 -- 172.21.15.37:0/1951843195 >> v1:172.21.15.37:6789/0 conn(0x7f2c2c15d2c0 legacy=0x7f2c2c0af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.497+0000 7f2c2affd640 1 -- 172.21.15.37:0/1951843195 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c0b3e30 con 0x7f2c2c06ff10 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.497+0000 7f2c29ffb640 1 -- 172.21.15.37:0/1951843195 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572256698 0 0) 0x7f2c2c0b4b70 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.497+0000 7f2c2affd640 1 --2- 172.21.15.37:0/1951843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c06ff10 0x7f2c2c0b4630 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0aefd0 tx=0x7f2c1c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85730a267174f70f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:35.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.497+0000 7f2c29ffb640 1 -- 172.21.15.37:0/1951843195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c037070 con 0x7f2c2c06ff10 2024-05-10T08:47:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c29ffb640 1 -- 172.21.15.37:0/1951843195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1c032440 con 0x7f2c2c06ff10 2024-05-10T08:47:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c29ffb640 1 -- 172.21.15.37:0/1951843195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c032810 con 0x7f2c2c06ff10 2024-05-10T08:47:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 -- 172.21.15.37:0/1951843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c06ff10 msgr2=0x7f2c2c0b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 --2- 172.21.15.37:0/1951843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c06ff10 0x7f2c2c0b4630 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0aefd0 tx=0x7f2c1c02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 -- 172.21.15.37:0/1951843195 shutdown_connections 2024-05-10T08:47:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 --2- 172.21.15.37:0/1951843195 >> v2:172.21.15.82:3300/0 conn(0x7f2c2c0afe50 0x7f2c2c15d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 --2- 172.21.15.37:0/1951843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c06ff10 0x7f2c2c0b4630 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 -- 172.21.15.37:0/1951843195 >> 172.21.15.37:0/1951843195 conn(0x7f2c2c06c3a0 msgr2=0x7f2c2c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 -- 172.21.15.37:0/1951843195 shutdown_connections 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.498+0000 7f2c31493640 1 -- 172.21.15.37:0/1951843195 wait complete. 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.499+0000 7f2c31493640 1 Processor -- start 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.499+0000 7f2c31493640 1 -- start start 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c31493640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ff10 0x7f2c2c158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c31493640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c0afe50 0x7f2c2c0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c31493640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c15d2c0 0x7f2c2c14a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c31493640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c070470 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c31493640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c0702f0 con 0x7f2c2c06ff10 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c31493640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2c0b0550 con 0x7f2c2c0afe50 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c15d2c0 0x7f2c2c14a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c15d2c0 0x7f2c2c14a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48444/0 (socket says 172.21.15.37:48444) 2024-05-10T08:47:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.500+0000 7f2c2b7fe640 1 -- 172.21.15.37:0/284587212 learned_addr learned my addr 172.21.15.37:0/284587212 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2a7fc640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c0afe50 0x7f2c2c0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2affd640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ff10 0x7f2c2c158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2b7fe640 1 -- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c0afe50 msgr2=0x7f2c2c0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2b7fe640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c0afe50 0x7f2c2c0b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2b7fe640 1 -- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ff10 msgr2=0x7f2c2c158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2b7fe640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ff10 0x7f2c2c158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2b7fe640 1 -- 172.21.15.37:0/284587212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c14acc0 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c2b7fe640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c15d2c0 0x7f2c2c14a780 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2c24007e70 tx=0x7f2c2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c137fe640 1 -- 172.21.15.37:0/284587212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014620 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c137fe640 1 -- 172.21.15.37:0/284587212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c24019070 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2c0b25f0 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c137fe640 1 -- 172.21.15.37:0/284587212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014a20 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.501+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2c0b2bb0 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.502+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2c0693f0 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.503+0000 7f2c137fe640 1 -- 172.21.15.37:0/284587212 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c24014bc0 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.503+0000 7f2c137fe640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c180762d0 0x7f2c18078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.503+0000 7f2c137fe640 1 -- 172.21.15.37:0/284587212 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6475+0+0 (secure 0 0 0) 0x7f2c24098170 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.503+0000 7f2c2affd640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c180762d0 0x7f2c18078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.504+0000 7f2c2affd640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c180762d0 0x7f2c18078790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c034000 tx=0x7f2c1c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.507+0000 7f2c137fe640 1 -- 172.21.15.37:0/284587212 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2c24061860 con 0x7f2c2c15d2c0 2024-05-10T08:47:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:35.699+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2c2c15e6b0 con 0x7f2c2c15d2c0 2024-05-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.542+0000 7f2c137fe640 1 -- 172.21.15.37:0/284587212 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f2c24061160 con 0x7f2c2c15d2c0 2024-05-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.548+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c180762d0 msgr2=0x7f2c18078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.548+0000 7f2c31493640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c180762d0 0x7f2c18078790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c034000 tx=0x7f2c1c02e000 comp rx=0 tx=0).stop 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.548+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c15d2c0 msgr2=0x7f2c2c14a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.548+0000 7f2c31493640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c15d2c0 0x7f2c2c14a780 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2c24007e70 tx=0x7f2c2400e4b0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 shutdown_connections 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2c180762d0 0x7f2c18078790 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2c15d2c0 0x7f2c2c14a780 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2c2c0afe50 0x7f2c2c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 --2- 172.21.15.37:0/284587212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c06ff10 0x7f2c2c158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 >> 172.21.15.37:0/284587212 conn(0x7f2c2c06c3a0 msgr2=0x7f2c2c06ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 shutdown_connections 2024-05-10T08:47:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.549+0000 7f2c31493640 1 -- 172.21.15.37:0/284587212 wait complete. 2024-05-10T08:47:36.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:47:36.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.678+0000 7f047a714640 1 Processor -- start 2024-05-10T08:47:36.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.678+0000 7f047a714640 1 -- start start 2024-05-10T08:47:36.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f047a714640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 0x7f04740b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f047a714640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04740cfc00 con 0x7f04740d3a50 2024-05-10T08:47:36.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f047a714640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04740cfea0 con 0x7f04740d1050 2024-05-10T08:47:36.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f047a714640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f04740d2a10 con 0x7f04740d3670 2024-05-10T08:47:36.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f04737fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f04740d3a50 0x7f04740d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56024/0 (socket says 172.21.15.37:56024) 2024-05-10T08:47:36.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f04737fe640 1 -- 172.21.15.37:0/3472804264 learned_addr learned my addr 172.21.15.37:0/3472804264 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0473fff640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 0x7f04740b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863838078 0 0) 0x7f04740cfc00 con 0x7f04740d3a50 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f045c003520 con 0x7f04740d3a50 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1055292986 0 0) 0x7f045c003520 con 0x7f04740d3a50 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 msgr2=0x7f04740b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 0x7f04740b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 >> v1:172.21.15.82:6789/0 conn(0x7f04740d1050 legacy=0x7f0474162920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04740d2730 con 0x7f04740d3a50 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f0468001670 con 0x7f04740d3a50 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 >> v1:172.21.15.37:6789/0 conn(0x7f04740d3a50 legacy=0x7f04740d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f045c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 0x7f045c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c004d40 0x7f045c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04740d2a10 con 0x7f045c0039e0 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f045c00b9c0 con 0x7f045c004d40 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.679+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f045c00bbc0 con 0x7f04740d3670 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f0473fff640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f045c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f04737fe640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 0x7f045c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f0478cb1640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c004d40 0x7f045c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f0473fff640 1 -- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 msgr2=0x7f045c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f0473fff640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740d3670 0x7f045c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f0473fff640 1 -- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c004d40 msgr2=0x7f045c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:36.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f0473fff640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f045c004d40 0x7f045c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.680+0000 7f0473fff640 1 -- 172.21.15.37:0/3472804264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c003520 con 0x7f045c0039e0 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f0473fff640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f045c003dc0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0464009ac0 tx=0x7f045c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbb5de04f36c95c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464036070 con 0x7f045c0039e0 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0464031400 con 0x7f045c0039e0 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f0472ffd640 1 -- 172.21.15.37:0/3472804264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464009690 con 0x7f045c0039e0 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f047a714640 1 -- 172.21.15.37:0/3472804264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 msgr2=0x7f045c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f047a714640 1 --2- 172.21.15.37:0/3472804264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f045c003dc0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0464009ac0 tx=0x7f045c005830 comp rx=0 tx=0).stop 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f0478cb1640 1 -- 172.21.15.37:0/3472804264 reap_dead start 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f047a714640 1 -- 172.21.15.37:0/3472804264 shutdown_connections 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f047a714640 1 -- 172.21.15.37:0/3472804264 >> 172.21.15.37:0/3472804264 conn(0x7f047409e390 msgr2=0x7f04740d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f047a714640 1 -- 172.21.15.37:0/3472804264 shutdown_connections 2024-05-10T08:47:36.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.681+0000 7f047a714640 1 -- 172.21.15.37:0/3472804264 wait complete. 2024-05-10T08:47:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.683+0000 7f047a714640 1 Processor -- start 2024-05-10T08:47:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.683+0000 7f047a714640 1 -- start start 2024-05-10T08:47:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f047a714640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f04741512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f047a714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04740b8850 0x7f047414f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f047a714640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740b6bc0 0x7f04740b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f047a714640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04740b49c0 con 0x7f045c0039e0 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f047a714640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f04740d04b0 con 0x7f04740b8850 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f047a714640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f04740b4b40 con 0x7f04740b6bc0 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f04741512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f04741512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48460/0 (socket says 172.21.15.37:48460) 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 -- 172.21.15.37:0/1712798487 learned_addr learned my addr 172.21.15.37:0/1712798487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0478cb1640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740b6bc0 0x7f04740b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f04737fe640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04740b8850 0x7f047414f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 -- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740b6bc0 msgr2=0x7f04740b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740b6bc0 0x7f04740b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 -- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04740b8850 msgr2=0x7f047414f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04740b8850 0x7f047414f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 -- 172.21.15.37:0/1712798487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04740b8cf0 con 0x7f045c0039e0 2024-05-10T08:47:36.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f04737fe640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04740b8850 0x7f047414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0473fff640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f04741512f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0464034040 tx=0x7f0464004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0470ff9640 1 -- 172.21.15.37:0/1712798487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464040020 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0470ff9640 1 -- 172.21.15.37:0/1712798487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0464003940 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f0470ff9640 1 -- 172.21.15.37:0/1712798487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464036040 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.684+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04740b8fd0 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.685+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04740b9590 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.685+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04740693f0 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.686+0000 7f0470ff9640 1 -- 172.21.15.37:0/1712798487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0464043020 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.687+0000 7f0470ff9640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f04600762d0 0x7f0460078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.687+0000 7f0470ff9640 1 -- 172.21.15.37:0/1712798487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6037+0+0 (secure 0 0 0) 0x7f04640b78b0 con 0x7f045c0039e0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.687+0000 7f04737fe640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f04600762d0 0x7f0460078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:36.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.688+0000 7f04737fe640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f04600762d0 0x7f0460078790 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04740ced50 tx=0x7f0468009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:36.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.691+0000 7f0470ff9640 1 -- 172.21.15.37:0/1712798487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f046404a070 con 0x7f045c0039e0 2024-05-10T08:47:36.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:36.880+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04740b5c80 con 0x7f045c0039e0 2024-05-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.547+0000 7f0470ff9640 1 -- 172.21.15.37:0/1712798487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7f0464080b00 con 0x7f045c0039e0 2024-05-10T08:47:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.551+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f04600762d0 msgr2=0x7f0460078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.551+0000 7f047a714640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f04600762d0 0x7f0460078790 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04740ced50 tx=0x7f0468009040 comp rx=0 tx=0).stop 2024-05-10T08:47:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 msgr2=0x7f04741512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f04741512f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0464034040 tx=0x7f0464004730 comp rx=0 tx=0).stop 2024-05-10T08:47:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 shutdown_connections 2024-05-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f04600762d0 0x7f0460078790 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f04740b6bc0 0x7f04740b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04740b8850 0x7f047414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 --2- 172.21.15.37:0/1712798487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045c0039e0 0x7f04741512f0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 >> 172.21.15.37:0/1712798487 conn(0x7f047409e390 msgr2=0x7f047406d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 shutdown_connections 2024-05-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.552+0000 7f047a714640 1 -- 172.21.15.37:0/1712798487 wait complete. 2024-05-10T08:47:37.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T08:47:37.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.683+0000 7f124863f640 1 Processor -- start 2024-05-10T08:47:37.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.683+0000 7f124863f640 1 -- start start 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f124863f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f124863f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12400d0cb0 0x7f12400d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f124863f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12400d3330 con 0x7f12400d2dc0 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f124863f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f12400d2170 con 0x7f12400d0cb0 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f124863f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f12400d2450 con 0x7f12401629a0 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f1246bdc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12400d0cb0 0x7f12400d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f1246bdc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12400d0cb0 0x7f12400d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48472/0 (socket says 172.21.15.37:48472) 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.684+0000 7f1246bdc640 1 -- 172.21.15.37:0/3224456395 learned_addr learned my addr 172.21.15.37:0/3224456395 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.685+0000 7f12463db640 1 --2- 172.21.15.37:0/3224456395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.685+0000 7f1246bdc640 1 -- 172.21.15.37:0/3224456395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12401629a0 msgr2=0x7f12400d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.685+0000 7f1246bdc640 1 --2- 172.21.15.37:0/3224456395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.685+0000 7f1246bdc640 1 -- 172.21.15.37:0/3224456395 >> v1:172.21.15.82:6789/0 conn(0x7f12400d2dc0 legacy=0x7f12400c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.685+0000 7f1246bdc640 1 -- 172.21.15.37:0/3224456395 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12400d2730 con 0x7f12400d0cb0 2024-05-10T08:47:37.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.685+0000 7f12463db640 1 --2- 172.21.15.37:0/3224456395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:37.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.685+0000 7f1246bdc640 1 --2- 172.21.15.37:0/3224456395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400d3b00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1238009e50 tx=0x7f123802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c6f8451a90c6aa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f12453d9640 1 -- 172.21.15.37:0/3224456395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238036070 con 0x7f12400d0cb0 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f12453d9640 1 -- 172.21.15.37:0/3224456395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1238031600 con 0x7f12400d0cb0 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f12453d9640 1 -- 172.21.15.37:0/3224456395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380319d0 con 0x7f12400d0cb0 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 -- 172.21.15.37:0/3224456395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 msgr2=0x7f12400d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 --2- 172.21.15.37:0/3224456395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400d3b00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1238009e50 tx=0x7f123802a5f0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 -- 172.21.15.37:0/3224456395 shutdown_connections 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 --2- 172.21.15.37:0/3224456395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400d3b00 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 --2- 172.21.15.37:0/3224456395 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12401629a0 0x7f12400d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 -- 172.21.15.37:0/3224456395 >> 172.21.15.37:0/3224456395 conn(0x7f12400d4fe0 msgr2=0x7f12400d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 -- 172.21.15.37:0/3224456395 shutdown_connections 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.686+0000 7f124863f640 1 -- 172.21.15.37:0/3224456395 wait complete. 2024-05-10T08:47:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 Processor -- start 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 -- start start 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f124009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12401629a0 0x7f12400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12400cf440 con 0x7f12400d0cb0 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12400cf2c0 con 0x7f12401629a0 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f124863f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f12400c95e0 con 0x7f12400d2dc0 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.688+0000 7f12463db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57848/0 (socket says 172.21.15.37:57848) 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 -- 172.21.15.37:0/3729319433 learned_addr learned my addr 172.21.15.37:0/3729319433 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f1246bdc640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12401629a0 0x7f12400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f1245bda640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f124009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 -- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 msgr2=0x7f124009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f124009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 -- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12401629a0 msgr2=0x7f12400b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12401629a0 0x7f12400b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 -- 172.21.15.37:0/3729319433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124009f240 con 0x7f12400d0cb0 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f12463db640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400b8250 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f123c00d7d0 tx=0x7f123c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f1236ffd640 1 -- 172.21.15.37:0/3729319433 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c004030 con 0x7f12400d0cb0 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f1236ffd640 1 -- 172.21.15.37:0/3729319433 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123c0041d0 con 0x7f12400d0cb0 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f1236ffd640 1 -- 172.21.15.37:0/3729319433 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c0096a0 con 0x7f12400d0cb0 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12400b97a0 con 0x7f12400d0cb0 2024-05-10T08:47:37.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.689+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12400a0c10 con 0x7f12400d0cb0 2024-05-10T08:47:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.690+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12400693f0 con 0x7f12400d0cb0 2024-05-10T08:47:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.691+0000 7f1236ffd640 1 -- 172.21.15.37:0/3729319433 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f123c009840 con 0x7f12400d0cb0 2024-05-10T08:47:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.691+0000 7f1236ffd640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12240762d0 0x7f1224078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.692+0000 7f1236ffd640 1 -- 172.21.15.37:0/3729319433 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f123c097640 con 0x7f12400d0cb0 2024-05-10T08:47:37.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.692+0000 7f1245bda640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12240762d0 0x7f1224078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:37.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.692+0000 7f1245bda640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12240762d0 0x7f1224078790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f12401f83b0 tx=0x7f1230009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:37.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.696+0000 7f1236ffd640 1 -- 172.21.15.37:0/3729319433 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f124009f240 con 0x7f12400d0cb0 2024-05-10T08:47:37.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.886+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f1240160e20 con 0x7f12400d0cb0 2024-05-10T08:47:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.890+0000 7f1236ffd640 1 -- 172.21.15.37:0/3729319433 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f123c060a10 con 0x7f12400d0cb0 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12240762d0 msgr2=0x7f1224078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12240762d0 0x7f1224078790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f12401f83b0 tx=0x7f1230009040 comp rx=0 tx=0).stop 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 msgr2=0x7f12400b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400b8250 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f123c00d7d0 tx=0x7f123c00dc90 comp rx=0 tx=0).stop 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 shutdown_connections 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f12240762d0 0x7f1224078790 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12401629a0 0x7f12400b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12400d2dc0 0x7f124009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 --2- 172.21.15.37:0/3729319433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12400d0cb0 0x7f12400b8250 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:37.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 >> 172.21.15.37:0/3729319433 conn(0x7f12400d4fe0 msgr2=0x7f12400ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:37.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 shutdown_connections 2024-05-10T08:47:37.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:37.892+0000 7f124863f640 1 -- 172.21.15.37:0/3729319433 wait complete. 2024-05-10T08:47:37.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-05-10T08:47:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.010+0000 7fd0b8fdd640 1 Processor -- start 2024-05-10T08:47:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.010+0000 7fd0b8fdd640 1 -- start start 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b8fdd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd0b4072840 0x7fd0b415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b8fdd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b415c920 con 0x7fd0b406e4d0 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b8fdd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b415cc00 con 0x7fd0b406e0f0 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b8fdd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b415cee0 con 0x7fd0b4072840 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b2d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0b406e4d0 0x7fd0b40aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34360/0 (socket says 172.21.15.37:34360) 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b2d9d640 1 -- 172.21.15.37:0/1067815032 learned_addr learned my addr 172.21.15.37:0/1067815032 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b1d9b640 1 --2- 172.21.15.37:0/1067815032 >> v2:172.21.15.82:3300/0 conn(0x7fd0b4072840 0x7fd0b415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598524349 0 0) 0x7fd0b415c920 con 0x7fd0b406e4d0 2024-05-10T08:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.011+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd09c003520 con 0x7fd0b406e4d0 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4239198586 0 0) 0x7fd09c003520 con 0x7fd0b406e4d0 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 >> v2:172.21.15.82:3300/0 conn(0x7fd0b4072840 msgr2=0x7fd0b415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 --2- 172.21.15.37:0/1067815032 >> v2:172.21.15.82:3300/0 conn(0x7fd0b4072840 0x7fd0b415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 >> v1:172.21.15.82:6789/0 conn(0x7fd0b406e0f0 legacy=0x7fd0b40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b415d1c0 con 0x7fd0b406e4d0 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fd0ac0019f0 con 0x7fd0b406e4d0 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 >> v1:172.21.15.37:6789/0 conn(0x7fd0b406e4d0 legacy=0x7fd0b40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c0039b0 0x7fd09c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c004800 0x7fd09c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd09c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b415cee0 con 0x7fd09c0051c0 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c00e270 con 0x7fd09c004800 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c00e470 con 0x7fd09c0039b0 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b2d9d640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd09c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b1d9b640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c004800 0x7fd09c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b259c640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c0039b0 0x7fd09c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b2d9d640 1 -- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c0039b0 msgr2=0x7fd09c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b2d9d640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c0039b0 0x7fd09c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b2d9d640 1 -- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c004800 msgr2=0x7fd09c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b2d9d640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd09c004800 0x7fd09c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b2d9d640 1 -- 172.21.15.37:0/1067815032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c003520 con 0x7fd09c0051c0 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.012+0000 7fd0b259c640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd09c0039b0 0x7fd09c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.013+0000 7fd0b2d9d640 1 -- 172.21.15.37:0/1067815032 reap_dead start 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.013+0000 7fd0b2d9d640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd09c00dbd0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00a860 tx=0x7fd09c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f2c6c315e488a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.013+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00a480 con 0x7fd09c0051c0 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.013+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ac02f070 con 0x7fd09c0051c0 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.013+0000 7fd0b159a640 1 -- 172.21.15.37:0/1067815032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac02bca0 con 0x7fd09c0051c0 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.014+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1067815032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 msgr2=0x7fd09c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.014+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd09c00dbd0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00a860 tx=0x7fd09c005830 comp rx=0 tx=0).stop 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.014+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1067815032 shutdown_connections 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.014+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1067815032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd09c00dbd0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.014+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1067815032 >> 172.21.15.37:0/1067815032 conn(0x7fd0b406c3a0 msgr2=0x7fd0b406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.014+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1067815032 shutdown_connections 2024-05-10T08:47:38.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.014+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1067815032 wait complete. 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.015+0000 7fd0b8fdd640 1 Processor -- start 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.015+0000 7fd0b8fdd640 1 -- start start 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b8fdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd0b4155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b8fdd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0b4155a40 0x7fd0b41401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b8fdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b4155ea0 0x7fd0b4140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b8fdd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b40ae7d0 con 0x7fd09c0051c0 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b8fdd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b40ae650 con 0x7fd0b4155ea0 2024-05-10T08:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b8fdd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b41530b0 con 0x7fd0b4155a40 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd0b4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd0b4155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57872/0 (socket says 172.21.15.37:57872) 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 -- 172.21.15.37:0/1595594297 learned_addr learned my addr 172.21.15.37:0/1595594297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b2d9d640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b4155ea0 0x7fd0b4140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b1d9b640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0b4155a40 0x7fd0b41401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 -- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0b4155a40 msgr2=0x7fd0b41401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0b4155a40 0x7fd0b41401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 -- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b4155ea0 msgr2=0x7fd0b4140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b4155ea0 0x7fd0b4140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 -- 172.21.15.37:0/1595594297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b4154080 con 0x7fd09c0051c0 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b2d9d640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b4155ea0 0x7fd0b4140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b1d9b640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0b4155a40 0x7fd0b41401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.016+0000 7fd0b259c640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd0b4155120 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4000c00 tx=0x7fd0a400e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.017+0000 7fd0a2ffd640 1 -- 172.21.15.37:0/1595594297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4019070 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.017+0000 7fd0a2ffd640 1 -- 172.21.15.37:0/1595594297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a40052e0 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.017+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b4154360 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.017+0000 7fd0a2ffd640 1 -- 172.21.15.37:0/1595594297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4003830 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.017+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b4154920 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.018+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b40693f0 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.018+0000 7fd0a2ffd640 1 -- 172.21.15.37:0/1595594297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd0a401c070 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.019+0000 7fd0a2ffd640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd094076300 0x7fd0940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.019+0000 7fd0a2ffd640 1 -- 172.21.15.37:0/1595594297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7fd0a4096b00 con 0x7fd09c0051c0 2024-05-10T08:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.019+0000 7fd0b1d9b640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd094076300 0x7fd0940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.020+0000 7fd0b1d9b640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd094076300 0x7fd0940787c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80093d0 tx=0x7fd0a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.023+0000 7fd0a2ffd640 1 -- 172.21.15.37:0/1595594297 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd0a405fe40 con 0x7fd09c0051c0 2024-05-10T08:47:38.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.288+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7fd0b40765b0 con 0x7fd09c0051c0 2024-05-10T08:47:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.549+0000 7fd0a2ffd640 1 -- 172.21.15.37:0/1595594297 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v344) ==== 167+0+0 (secure 0 0 0) 0x7fd0a4064140 con 0x7fd09c0051c0 2024-05-10T08:47:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd094076300 msgr2=0x7fd0940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd094076300 0x7fd0940787c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80093d0 tx=0x7fd0a8008040 comp rx=0 tx=0).stop 2024-05-10T08:47:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 msgr2=0x7fd0b4155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd0b4155120 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4000c00 tx=0x7fd0a400e8f0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 shutdown_connections 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd094076300 0x7fd0940787c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b4155ea0 0x7fd0b4140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd0b4155a40 0x7fd0b41401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 --2- 172.21.15.37:0/1595594297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c0051c0 0x7fd0b4155120 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 >> 172.21.15.37:0/1595594297 conn(0x7fd0b406c3a0 msgr2=0x7fd0b406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 shutdown_connections 2024-05-10T08:47:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.551+0000 7fd0b8fdd640 1 -- 172.21.15.37:0/1595594297 wait complete. 2024-05-10T08:47:38.562 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-05-10T08:47:38.562 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T08:47:38.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:47:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.669+0000 7fa74ae83640 1 Processor -- start 2024-05-10T08:47:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.669+0000 7fa74ae83640 1 -- start start 2024-05-10T08:47:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa74ae83640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74406c3a0 0x7fa7440b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa74ae83640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa74415d180 0x7fa7440b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa74ae83640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74409ff30 con 0x7fa7440aedf0 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa74ae83640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa74415e360 con 0x7fa74415d180 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa74ae83640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa74415d750 con 0x7fa74406c3a0 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa748c1f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74406c3a0 0x7fa7440b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa749420640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa74415d180 0x7fa7440b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa73bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa7440aedf0 0x7fa74406c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:50388/0 (socket says 172.21.15.37:50388) 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.670+0000 7fa73bfff640 1 -- 172.21.15.37:0/1538838402 learned_addr learned my addr 172.21.15.37:0/1538838402 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa73b7fe640 1 -- 172.21.15.37:0/1538838402 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119029172 0 0) 0x7fa74409ff30 con 0x7fa7440aedf0 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa73b7fe640 1 -- 172.21.15.37:0/1538838402 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa72c003520 con 0x7fa7440aedf0 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa749420640 1 -- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74406c3a0 msgr2=0x7fa7440b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa749420640 1 --2- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74406c3a0 0x7fa7440b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa749420640 1 -- 172.21.15.37:0/1538838402 >> v1:172.21.15.82:6789/0 conn(0x7fa7440aedf0 legacy=0x7fa74406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa749420640 1 -- 172.21.15.37:0/1538838402 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74415da30 con 0x7fa74415d180 2024-05-10T08:47:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa748c1f640 1 --2- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74406c3a0 0x7fa7440b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.671+0000 7fa749420640 1 --2- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74415d180 0x7fa7440b6130 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009d90 tx=0x7fa73c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7107e919b8c77a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa73b7fe640 1 -- 172.21.15.37:0/1538838402 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c007740 con 0x7fa74415d180 2024-05-10T08:47:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa73b7fe640 1 -- 172.21.15.37:0/1538838402 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c0078e0 con 0x7fa74415d180 2024-05-10T08:47:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa73b7fe640 1 -- 172.21.15.37:0/1538838402 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c007cb0 con 0x7fa74415d180 2024-05-10T08:47:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 -- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74415d180 msgr2=0x7fa7440b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 --2- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74415d180 0x7fa7440b6130 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009d90 tx=0x7fa73c02a660 comp rx=0 tx=0).stop 2024-05-10T08:47:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 -- 172.21.15.37:0/1538838402 shutdown_connections 2024-05-10T08:47:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 --2- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74415d180 0x7fa7440b6130 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 --2- 172.21.15.37:0/1538838402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74406c3a0 0x7fa7440b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 -- 172.21.15.37:0/1538838402 >> 172.21.15.37:0/1538838402 conn(0x7fa7440b3b10 msgr2=0x7fa7440b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 -- 172.21.15.37:0/1538838402 shutdown_connections 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.672+0000 7fa74ae83640 1 -- 172.21.15.37:0/1538838402 wait complete. 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.673+0000 7fa74ae83640 1 Processor -- start 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.674+0000 7fa74ae83640 1 -- start start 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.674+0000 7fa74ae83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74406c3a0 0x7fa744158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.674+0000 7fa74ae83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7440aedf0 0x7fa744159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.674+0000 7fa74ae83640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74415d180 0x7fa74409e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.674+0000 7fa74ae83640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7440b4fc0 con 0x7fa7440aedf0 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.674+0000 7fa74ae83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa74415dff0 con 0x7fa74406c3a0 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.674+0000 7fa74ae83640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7440b5140 con 0x7fa74415d180 2024-05-10T08:47:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7440aedf0 0x7fa744159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7440aedf0 0x7fa744159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57878/0 (socket says 172.21.15.37:57878) 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 -- 172.21.15.37:0/2229280062 learned_addr learned my addr 172.21.15.37:0/2229280062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa748c1f640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74406c3a0 0x7fa744158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa749420640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74415d180 0x7fa74409e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 -- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74415d180 msgr2=0x7fa74409e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74415d180 0x7fa74409e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 -- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74406c3a0 msgr2=0x7fa744158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74406c3a0 0x7fa744158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 -- 172.21.15.37:0/2229280062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74415aa30 con 0x7fa7440aedf0 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa73bfff640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7440aedf0 0x7fa744159fe0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c430 tx=0x7fa73400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa7397fa640 1 -- 172.21.15.37:0/2229280062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734017070 con 0x7fa7440aedf0 2024-05-10T08:47:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa7397fa640 1 -- 172.21.15.37:0/2229280062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa734005ce0 con 0x7fa7440aedf0 2024-05-10T08:47:38.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74415ad10 con 0x7fa7440aedf0 2024-05-10T08:47:38.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa7397fa640 1 -- 172.21.15.37:0/2229280062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7340072f0 con 0x7fa7440aedf0 2024-05-10T08:47:38.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.675+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74415b2d0 con 0x7fa7440aedf0 2024-05-10T08:47:38.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.676+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74406a8f0 con 0x7fa7440aedf0 2024-05-10T08:47:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.677+0000 7fa7397fa640 1 -- 172.21.15.37:0/2229280062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa73401a070 con 0x7fa7440aedf0 2024-05-10T08:47:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.677+0000 7fa7397fa640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7300762d0 0x7fa730078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.677+0000 7fa7397fa640 1 -- 172.21.15.37:0/2229280062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7fa734096910 con 0x7fa7440aedf0 2024-05-10T08:47:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.678+0000 7fa748c1f640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7300762d0 0x7fa730078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.678+0000 7fa748c1f640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7300762d0 0x7fa730078790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa7441f2540 tx=0x7fa740009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.682+0000 7fa7397fa640 1 -- 172.21.15.37:0/2229280062 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa73405fcd0 con 0x7fa7440aedf0 2024-05-10T08:47:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.872+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7440b5840 con 0x7fa7440aedf0 2024-05-10T08:47:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.873+0000 7fa7397fa640 1 -- 172.21.15.37:0/2229280062 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+13486 (secure 0 0 0) 0x7fa734063fd0 con 0x7fa7440aedf0 2024-05-10T08:47:38.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:38.872 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":94,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:47:37.544049+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/345427151":"2024-05-11T08:47:34.316757+0000","172.21.15.37:6832/345427151":"2024-05-11T08:47:34.316757+0000","172.21.15.37:6832/375241165":"2024-05-11T08:46:53.173806+0000","172.21.15.37:6834/375241165":"2024-05-11T08:46:53.173806+0000","172.21.15.37:6834/54798262":"2024-05-11T08:45:43.002523+0000","172.21.15.37:6832/54798262":"2024-05-11T08:45:43.002523+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:47:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7300762d0 msgr2=0x7fa730078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7300762d0 0x7fa730078790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa7441f2540 tx=0x7fa740009190 comp rx=0 tx=0).stop 2024-05-10T08:47:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7440aedf0 msgr2=0x7fa744159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7440aedf0 0x7fa744159fe0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c430 tx=0x7fa73400c8f0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 shutdown_connections 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa7300762d0 0x7fa730078790 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa74415d180 0x7fa74409e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7440aedf0 0x7fa744159fe0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 --2- 172.21.15.37:0/2229280062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa74406c3a0 0x7fa744158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 >> 172.21.15.37:0/2229280062 conn(0x7fa7440b3b10 msgr2=0x7fa7440b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 shutdown_connections 2024-05-10T08:47:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.875+0000 7fa74ae83640 1 -- 172.21.15.37:0/2229280062 wait complete. 2024-05-10T08:47:38.885 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T08:40:11.341540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T08:47:38.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T08:47:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.994+0000 7f07d2b58640 1 Processor -- start 2024-05-10T08:47:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.994+0000 7f07d2b58640 1 -- start start 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d2b58640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07cc1629b0 0x7f07cc06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d2b58640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07cc0b2490 0x7f07cc070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d2b58640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc06e110 con 0x7f07cc070d20 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d2b58640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f07cc06dec0 con 0x7f07cc1629b0 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d2b58640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f07cc06e3f0 con 0x7f07cc0b2490 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d08f4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07cc1629b0 0x7f07cc06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d08f4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07cc1629b0 0x7f07cc06eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57888/0 (socket says 172.21.15.37:57888) 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d10f5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07cc070d20 0x7f07cc0afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34370/0 (socket says 172.21.15.37:34370) 2024-05-10T08:47:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d08f4640 1 -- 172.21.15.37:0/2734132075 learned_addr learned my addr 172.21.15.37:0/2734132075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07cbfff640 1 --2- 172.21.15.37:0/2734132075 >> v2:172.21.15.82:3300/0 conn(0x7f07cc0b2490 0x7f07cc070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d08f4640 1 -- 172.21.15.37:0/2734132075 >> v2:172.21.15.82:3300/0 conn(0x7f07cc0b2490 msgr2=0x7f07cc070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d08f4640 1 --2- 172.21.15.37:0/2734132075 >> v2:172.21.15.82:3300/0 conn(0x7f07cc0b2490 0x7f07cc070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d08f4640 1 -- 172.21.15.37:0/2734132075 >> v1:172.21.15.37:6789/0 conn(0x7f07cc070d20 legacy=0x7f07cc0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07d08f4640 1 -- 172.21.15.37:0/2734132075 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc06e6d0 con 0x7f07cc1629b0 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.995+0000 7f07cb7fe640 1 -- 172.21.15.37:0/2734132075 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419841220 0 0) 0x7f07cc06e110 con 0x7f07cc070d20 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.996+0000 7f07d08f4640 1 --2- 172.21.15.37:0/2734132075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc1629b0 0x7f07cc06eed0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0b8fb0 tx=0x7f07c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e840cec74c8f5ae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.996+0000 7f07cb7fe640 1 -- 172.21.15.37:0/2734132075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0037070 con 0x7f07cc1629b0 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.996+0000 7f07cb7fe640 1 -- 172.21.15.37:0/2734132075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c0032440 con 0x7f07cc1629b0 2024-05-10T08:47:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.996+0000 7f07cb7fe640 1 -- 172.21.15.37:0/2734132075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0032810 con 0x7f07cc1629b0 2024-05-10T08:47:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 -- 172.21.15.37:0/2734132075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc1629b0 msgr2=0x7f07cc06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 --2- 172.21.15.37:0/2734132075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc1629b0 0x7f07cc06eed0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0b8fb0 tx=0x7f07c002a270 comp rx=0 tx=0).stop 2024-05-10T08:47:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 -- 172.21.15.37:0/2734132075 shutdown_connections 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 --2- 172.21.15.37:0/2734132075 >> v2:172.21.15.82:3300/0 conn(0x7f07cc0b2490 0x7f07cc070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 --2- 172.21.15.37:0/2734132075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc1629b0 0x7f07cc06eed0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 -- 172.21.15.37:0/2734132075 >> 172.21.15.37:0/2734132075 conn(0x7f07cc0b49d0 msgr2=0x7f07cc0b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 -- 172.21.15.37:0/2734132075 shutdown_connections 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.997+0000 7f07d2b58640 1 -- 172.21.15.37:0/2734132075 wait complete. 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.998+0000 7f07d2b58640 1 Processor -- start 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.998+0000 7f07d2b58640 1 -- start start 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d2b58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc070d20 0x7f07cc1f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d2b58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0b2490 0x7f07cc15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d2b58640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07cc1629b0 0x7f07cc0b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d2b58640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc070870 con 0x7f07cc070d20 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d2b58640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc06f410 con 0x7f07cc0b2490 2024-05-10T08:47:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d2b58640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07cc0709f0 con 0x7f07cc1629b0 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc070d20 0x7f07cc1f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc070d20 0x7f07cc1f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57900/0 (socket says 172.21.15.37:57900) 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 -- 172.21.15.37:0/257848198 learned_addr learned my addr 172.21.15.37:0/257848198 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07cbfff640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0b2490 0x7f07cc15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d10f5640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07cc1629b0 0x7f07cc0b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 -- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07cc1629b0 msgr2=0x7f07cc0b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07cc1629b0 0x7f07cc0b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 -- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0b2490 msgr2=0x7f07cc15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0b2490 0x7f07cc15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d08f4640 1 -- 172.21.15.37:0/257848198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc15cf50 con 0x7f07cc070d20 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:38.999+0000 7f07d10f5640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07cc1629b0 0x7f07cc0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.000+0000 7f07d08f4640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc070d20 0x7f07cc1f7d30 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f07c0000c00 tx=0x7f07c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.000+0000 7f07c97fa640 1 -- 172.21.15.37:0/257848198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0041070 con 0x7f07cc070d20 2024-05-10T08:47:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.000+0000 7f07c97fa640 1 -- 172.21.15.37:0/257848198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c003c870 con 0x7f07cc070d20 2024-05-10T08:47:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.000+0000 7f07c97fa640 1 -- 172.21.15.37:0/257848198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0037040 con 0x7f07cc070d20 2024-05-10T08:47:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.000+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc15d230 con 0x7f07cc070d20 2024-05-10T08:47:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.000+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc15d7f0 con 0x7f07cc070d20 2024-05-10T08:47:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.001+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc0693f0 con 0x7f07cc070d20 2024-05-10T08:47:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.001+0000 7f07c97fa640 1 -- 172.21.15.37:0/257848198 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07c0044070 con 0x7f07cc070d20 2024-05-10T08:47:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.002+0000 7f07c97fa640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07b00762d0 0x7f07b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.002+0000 7f07c97fa640 1 -- 172.21.15.37:0/257848198 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f07c00b7fc0 con 0x7f07cc070d20 2024-05-10T08:47:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.003+0000 7f07cbfff640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07b00762d0 0x7f07b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.003+0000 7f07cbfff640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07b00762d0 0x7f07b0078790 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f07cc15f700 tx=0x7f07b8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:39.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.007+0000 7f07c97fa640 1 -- 172.21.15.37:0/257848198 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f07c00819d0 con 0x7f07cc070d20 2024-05-10T08:47:39.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.202+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f07cc15dbd0 con 0x7f07cc070d20 2024-05-10T08:47:39.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.202+0000 7f07c97fa640 1 -- 172.21.15.37:0/257848198 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f07c00812d0 con 0x7f07cc070d20 2024-05-10T08:47:39.201 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-10T08:47:39.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07b00762d0 msgr2=0x7f07b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:39.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07b00762d0 0x7f07b0078790 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f07cc15f700 tx=0x7f07b8008040 comp rx=0 tx=0).stop 2024-05-10T08:47:39.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc070d20 msgr2=0x7f07cc1f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc070d20 0x7f07cc1f7d30 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f07c0000c00 tx=0x7f07c00046c0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 shutdown_connections 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f07b00762d0 0x7f07b0078790 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07cc1629b0 0x7f07cc0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0b2490 0x7f07cc15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 --2- 172.21.15.37:0/257848198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07cc070d20 0x7f07cc1f7d30 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 >> 172.21.15.37:0/257848198 conn(0x7f07cc0b49d0 msgr2=0x7f07cc0b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 shutdown_connections 2024-05-10T08:47:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.204+0000 7f07d2b58640 1 -- 172.21.15.37:0/257848198 wait complete. 2024-05-10T08:47:39.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-05-10T08:47:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.320+0000 7fb1dd989640 1 Processor -- start 2024-05-10T08:47:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.320+0000 7fb1dd989640 1 -- start start 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1dd989640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1d80d20c0 0x7fb1d8163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1dd989640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb1d8071110 0x7fb1d806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1dd989640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d80d1300 con 0x7fb1d8070d30 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1dd989640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d80d10d0 con 0x7fb1d80d20c0 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1dd989640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d8070b80 con 0x7fb1d8071110 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d67fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1d80d20c0 0x7fb1d8163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d67fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1d80d20c0 0x7fb1d8163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57908/0 (socket says 172.21.15.37:57908) 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d67fc640 1 -- 172.21.15.37:0/1528606078 learned_addr learned my addr 172.21.15.37:0/1528606078 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d77fe640 1 --2- 172.21.15.37:0/1528606078 >> v2:172.21.15.82:3300/0 conn(0x7fb1d8071110 0x7fb1d806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d67fc640 1 -- 172.21.15.37:0/1528606078 >> v2:172.21.15.82:3300/0 conn(0x7fb1d8071110 msgr2=0x7fb1d806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d67fc640 1 --2- 172.21.15.37:0/1528606078 >> v2:172.21.15.82:3300/0 conn(0x7fb1d8071110 0x7fb1d806d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d67fc640 1 -- 172.21.15.37:0/1528606078 >> v1:172.21.15.82:6789/0 conn(0x7fb1d8070d30 legacy=0x7fb1d80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d67fc640 1 -- 172.21.15.37:0/1528606078 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d80d15e0 con 0x7fb1d80d20c0 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.321+0000 7fb1d77fe640 1 --2- 172.21.15.37:0/1528606078 >> v2:172.21.15.82:3300/0 conn(0x7fb1d8071110 0x7fb1d806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.322+0000 7fb1d67fc640 1 --2- 172.21.15.37:0/1528606078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80d20c0 0x7fb1d8163920 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80d2e40 tx=0x7fb1cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587e93adda2a1bab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.322+0000 7fb1d5ffb640 1 -- 172.21.15.37:0/1528606078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc037070 con 0x7fb1d80d20c0 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.322+0000 7fb1d5ffb640 1 -- 172.21.15.37:0/1528606078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc032440 con 0x7fb1d80d20c0 2024-05-10T08:47:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.322+0000 7fb1d5ffb640 1 -- 172.21.15.37:0/1528606078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc032810 con 0x7fb1d80d20c0 2024-05-10T08:47:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 -- 172.21.15.37:0/1528606078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80d20c0 msgr2=0x7fb1d8163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 --2- 172.21.15.37:0/1528606078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80d20c0 0x7fb1d8163920 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80d2e40 tx=0x7fb1cc02a230 comp rx=0 tx=0).stop 2024-05-10T08:47:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 -- 172.21.15.37:0/1528606078 shutdown_connections 2024-05-10T08:47:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 --2- 172.21.15.37:0/1528606078 >> v2:172.21.15.82:3300/0 conn(0x7fb1d8071110 0x7fb1d806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 --2- 172.21.15.37:0/1528606078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80d20c0 0x7fb1d8163920 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 -- 172.21.15.37:0/1528606078 >> 172.21.15.37:0/1528606078 conn(0x7fb1d80d2e90 msgr2=0x7fb1d80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 -- 172.21.15.37:0/1528606078 shutdown_connections 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.323+0000 7fb1dd989640 1 -- 172.21.15.37:0/1528606078 wait complete. 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.324+0000 7fb1dd989640 1 Processor -- start 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.324+0000 7fb1dd989640 1 -- start start 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1dd989640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d8070d30 0x7fb1d80b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1dd989640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d8071110 0x7fb1d8152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1dd989640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1d80d20c0 0x7fb1d8162a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1dd989640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8071520 con 0x7fb1d8071110 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1dd989640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80d1c30 con 0x7fb1d8070d30 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1dd989640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d80716a0 con 0x7fb1d80d20c0 2024-05-10T08:47:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d8071110 0x7fb1d8152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d8071110 0x7fb1d8152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57924/0 (socket says 172.21.15.37:57924) 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 -- 172.21.15.37:0/3789916840 learned_addr learned my addr 172.21.15.37:0/3789916840 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d8070d30 0x7fb1d80b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 -- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1d80d20c0 msgr2=0x7fb1d8162a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d77fe640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1d80d20c0 0x7fb1d8162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1d80d20c0 0x7fb1d8162a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 -- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d8070d30 msgr2=0x7fb1d80b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d8070d30 0x7fb1d80b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 -- 172.21.15.37:0/3789916840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d8152b80 con 0x7fb1d8071110 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d8070d30 0x7fb1d80b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1d67fc640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d8071110 0x7fb1d8152640 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc02a270 tx=0x7fb1cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.325+0000 7fb1bffff640 1 -- 172.21.15.37:0/3789916840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc037040 con 0x7fb1d8071110 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.326+0000 7fb1bffff640 1 -- 172.21.15.37:0/3789916840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc042070 con 0x7fb1d8071110 2024-05-10T08:47:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.326+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d81f9740 con 0x7fb1d8071110 2024-05-10T08:47:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.326+0000 7fb1bffff640 1 -- 172.21.15.37:0/3789916840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc030bb0 con 0x7fb1d8071110 2024-05-10T08:47:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.326+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d81f9d00 con 0x7fb1d8071110 2024-05-10T08:47:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.327+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d80693f0 con 0x7fb1d8071110 2024-05-10T08:47:39.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.327+0000 7fb1bffff640 1 -- 172.21.15.37:0/3789916840 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb1cc047460 con 0x7fb1d8071110 2024-05-10T08:47:39.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.328+0000 7fb1bffff640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1c4076300 0x7fb1c40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:39.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.328+0000 7fb1bffff640 1 -- 172.21.15.37:0/3789916840 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7fb1cc0b8190 con 0x7fb1d8071110 2024-05-10T08:47:39.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.328+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1c4076300 0x7fb1c40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:39.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.329+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1c4076300 0x7fb1c40787c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800a830 tx=0x7fb1c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:39.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.332+0000 7fb1bffff640 1 -- 172.21.15.37:0/3789916840 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb1cc081bb0 con 0x7fb1d8071110 2024-05-10T08:47:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:39.605+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7fb1d80d3d70 con 0x7fb1d8071110 2024-05-10T08:47:40.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.555+0000 7fb1bffff640 1 -- 172.21.15.37:0/3789916840 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v346) ==== 149+0+0 (secure 0 0 0) 0x7fb1cc0814b0 con 0x7fb1d8071110 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.557+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1c4076300 msgr2=0x7fb1c40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.557+0000 7fb1dd989640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1c4076300 0x7fb1c40787c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800a830 tx=0x7fb1c8008040 comp rx=0 tx=0).stop 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.557+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d8071110 msgr2=0x7fb1d8152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.557+0000 7fb1dd989640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d8071110 0x7fb1d8152640 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc02a270 tx=0x7fb1cc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 shutdown_connections 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1c4076300 0x7fb1c40787c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1d80d20c0 0x7fb1d8162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d8071110 0x7fb1d8152640 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 --2- 172.21.15.37:0/3789916840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d8070d30 0x7fb1d80b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 >> 172.21.15.37:0/3789916840 conn(0x7fb1d80d2e90 msgr2=0x7fb1d806d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 shutdown_connections 2024-05-10T08:47:40.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.558+0000 7fb1dd989640 1 -- 172.21.15.37:0/3789916840 wait complete. 2024-05-10T08:47:40.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T08:47:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.685+0000 7f7bd690a640 1 Processor -- start 2024-05-10T08:47:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.685+0000 7f7bd690a640 1 -- start start 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bd690a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7bd0160d00 0x7f7bd01610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bd690a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bd00d00c0 0x7f7bd015d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bd690a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd0161620 con 0x7f7bd00d0550 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bd690a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00ce9e0 con 0x7f7bd00d00c0 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bd690a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00cddd0 con 0x7f7bd0160d00 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bcf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bd00d00c0 0x7f7bd015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bcf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bd00d00c0 0x7f7bd015d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57936/0 (socket says 172.21.15.37:57936) 2024-05-10T08:47:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bcf7fe640 1 -- 172.21.15.37:0/2104109923 learned_addr learned my addr 172.21.15.37:0/2104109923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bcffff640 1 --2- 172.21.15.37:0/2104109923 >> v2:172.21.15.82:3300/0 conn(0x7f7bd0160d00 0x7f7bd01610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bcf7fe640 1 -- 172.21.15.37:0/2104109923 >> v2:172.21.15.82:3300/0 conn(0x7f7bd0160d00 msgr2=0x7f7bd01610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bcf7fe640 1 --2- 172.21.15.37:0/2104109923 >> v2:172.21.15.82:3300/0 conn(0x7f7bd0160d00 0x7f7bd01610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.686+0000 7f7bcf7fe640 1 -- 172.21.15.37:0/2104109923 >> v1:172.21.15.82:6789/0 conn(0x7f7bd00d0550 legacy=0x7f7bd015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.687+0000 7f7bcf7fe640 1 -- 172.21.15.37:0/2104109923 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00ce0b0 con 0x7f7bd00d00c0 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.687+0000 7f7bcffff640 1 --2- 172.21.15.37:0/2104109923 >> v2:172.21.15.82:3300/0 conn(0x7f7bd0160d00 0x7f7bd01610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.687+0000 7f7bcf7fe640 1 --2- 172.21.15.37:0/2104109923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd015d440 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009870 tx=0x7f7bb802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eafc04bce34db19 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.687+0000 7f7bceffd640 1 -- 172.21.15.37:0/2104109923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8037070 con 0x7f7bd00d00c0 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.687+0000 7f7bceffd640 1 -- 172.21.15.37:0/2104109923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb8032640 con 0x7f7bd00d00c0 2024-05-10T08:47:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.687+0000 7f7bceffd640 1 -- 172.21.15.37:0/2104109923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8032a10 con 0x7f7bd00d00c0 2024-05-10T08:47:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 -- 172.21.15.37:0/2104109923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 msgr2=0x7f7bd015d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2104109923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd015d440 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009870 tx=0x7f7bb802a300 comp rx=0 tx=0).stop 2024-05-10T08:47:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 -- 172.21.15.37:0/2104109923 shutdown_connections 2024-05-10T08:47:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2104109923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd015d440 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2104109923 >> v2:172.21.15.82:3300/0 conn(0x7f7bd0160d00 0x7f7bd01610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 -- 172.21.15.37:0/2104109923 >> 172.21.15.37:0/2104109923 conn(0x7f7bd00d2e90 msgr2=0x7f7bd00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:40.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 -- 172.21.15.37:0/2104109923 shutdown_connections 2024-05-10T08:47:40.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.688+0000 7f7bd690a640 1 -- 172.21.15.37:0/2104109923 wait complete. 2024-05-10T08:47:40.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.689+0000 7f7bd690a640 1 Processor -- start 2024-05-10T08:47:40.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.689+0000 7f7bd690a640 1 -- start start 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bd690a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd0158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bd690a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bd00d0550 0x7f7bd01f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bd690a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bd0160d00 0x7f7bd00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bd690a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00cda60 con 0x7f7bd00d00c0 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bd690a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00ce670 con 0x7f7bd0160d00 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bd690a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd00d1a70 con 0x7f7bd00d0550 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bcffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd0158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bcffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd0158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57938/0 (socket says 172.21.15.37:57938) 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.690+0000 7f7bcffff640 1 -- 172.21.15.37:0/2078982623 learned_addr learned my addr 172.21.15.37:0/2078982623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bd4ea7640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bd0160d00 0x7f7bd00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bcf7fe640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bd00d0550 0x7f7bd01f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bcffff640 1 -- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bd00d0550 msgr2=0x7f7bd01f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bcffff640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bd00d0550 0x7f7bd01f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bcffff640 1 -- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bd0160d00 msgr2=0x7f7bd00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bcffff640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bd0160d00 0x7f7bd00cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bcffff640 1 -- 172.21.15.37:0/2078982623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00cb800 con 0x7f7bd00d00c0 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bd4ea7640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bd0160d00 0x7f7bd00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bcffff640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd0158580 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c7f0 tx=0x7f7bc000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bccff9640 1 -- 172.21.15.37:0/2078982623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0015070 con 0x7f7bd00d00c0 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bccff9640 1 -- 172.21.15.37:0/2078982623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc0007820 con 0x7f7bd00d00c0 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd00c8430 con 0x7f7bd00d00c0 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bccff9640 1 -- 172.21.15.37:0/2078982623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0007bd0 con 0x7f7bd00d00c0 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.691+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd00cbd80 con 0x7f7bd00d00c0 2024-05-10T08:47:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.692+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd00693f0 con 0x7f7bd00d00c0 2024-05-10T08:47:40.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.693+0000 7f7bccff9640 1 -- 172.21.15.37:0/2078982623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7bc0018070 con 0x7f7bd00d00c0 2024-05-10T08:47:40.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.693+0000 7f7bccff9640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7bb0076320 0x7f7bb00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:40.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.694+0000 7f7bccff9640 1 -- 172.21.15.37:0/2078982623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f7bc00974a0 con 0x7f7bd00d00c0 2024-05-10T08:47:40.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.694+0000 7f7bcf7fe640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7bb0076320 0x7f7bb00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:40.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.694+0000 7f7bcf7fe640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7bb0076320 0x7f7bb00787e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8034000 tx=0x7f7bb802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:40.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.698+0000 7f7bccff9640 1 -- 172.21.15.37:0/2078982623 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7bc0061030 con 0x7f7bd00d00c0 2024-05-10T08:47:40.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.888+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7bd006d140 con 0x7f7bd00d00c0 2024-05-10T08:47:40.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.893+0000 7f7bccff9640 1 -- 172.21.15.37:0/2078982623 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f7bc0060930 con 0x7f7bd00d00c0 2024-05-10T08:47:40.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7bb0076320 msgr2=0x7f7bb00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7bb0076320 0x7f7bb00787e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8034000 tx=0x7f7bb802e000 comp rx=0 tx=0).stop 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 msgr2=0x7f7bd0158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd0158580 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c7f0 tx=0x7f7bc000ccb0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 shutdown_connections 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7bb0076320 0x7f7bb00787e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bd0160d00 0x7f7bd00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7bd00d0550 0x7f7bd01f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 --2- 172.21.15.37:0/2078982623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00d00c0 0x7f7bd0158580 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 >> 172.21.15.37:0/2078982623 conn(0x7f7bd00d2e90 msgr2=0x7f7bd00b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.895+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 shutdown_connections 2024-05-10T08:47:40.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:40.896+0000 7f7bd690a640 1 -- 172.21.15.37:0/2078982623 wait complete. 2024-05-10T08:47:40.905 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:47:40.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:47:40.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:47:40.986 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:47:40.986 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:40.986 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:41.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:47:41.003 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:47:41.003 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:41.044 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:47:41.044 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:41.044 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:41.060 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:47:41.060 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:47:41.061 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:41.102 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:47:41.102 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T08:47:41.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.207+0000 7f1daa7af640 1 Processor -- start 2024-05-10T08:47:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.207+0000 7f1daa7af640 1 -- start start 2024-05-10T08:47:41.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1daa7af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1daa7af640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1da406e4d0 0x7f1da40aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1daa7af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da415c920 con 0x7f1da4072840 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1daa7af640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1da415cc00 con 0x7f1da406e4d0 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1daa7af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1da415cee0 con 0x7f1da406e0f0 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1da8d4c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1da406e4d0 0x7f1da40aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1da8d4c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1da406e4d0 0x7f1da40aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57940/0 (socket says 172.21.15.37:57940) 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1310330010 learned_addr learned my addr 172.21.15.37:0/1310330010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.208+0000 7f1da3fff640 1 --2- 172.21.15.37:0/1310330010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1310330010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 msgr2=0x7f1da415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da8d4c640 1 --2- 172.21.15.37:0/1310330010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1310330010 >> v1:172.21.15.82:6789/0 conn(0x7f1da4072840 legacy=0x7f1da40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1310330010 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da415d1c0 con 0x7f1da406e4d0 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da8d4c640 1 --2- 172.21.15.37:0/1310330010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da406e4d0 0x7f1da40aec30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009e50 tx=0x7f1d9c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65978f5dec54f49 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da2ffd640 1 -- 172.21.15.37:0/1310330010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c036070 con 0x7f1da406e4d0 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da2ffd640 1 -- 172.21.15.37:0/1310330010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c031600 con 0x7f1da406e4d0 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.209+0000 7f1da2ffd640 1 -- 172.21.15.37:0/1310330010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0319d0 con 0x7f1da406e4d0 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 -- 172.21.15.37:0/1310330010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da406e4d0 msgr2=0x7f1da40aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1310330010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da406e4d0 0x7f1da40aec30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009e50 tx=0x7f1d9c02a710 comp rx=0 tx=0).stop 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 -- 172.21.15.37:0/1310330010 shutdown_connections 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1310330010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da406e4d0 0x7f1da40aec30 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1310330010 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 -- 172.21.15.37:0/1310330010 >> 172.21.15.37:0/1310330010 conn(0x7f1da406c3a0 msgr2=0x7f1da406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:41.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 -- 172.21.15.37:0/1310330010 shutdown_connections 2024-05-10T08:47:41.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.210+0000 7f1daa7af640 1 -- 172.21.15.37:0/1310330010 wait complete. 2024-05-10T08:47:41.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.211+0000 7f1daa7af640 1 Processor -- start 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1daa7af640 1 -- start start 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1daa7af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da413fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1daa7af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da406e4d0 0x7f1da40cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1daa7af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da4072840 0x7f1da40b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1daa7af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40ae7d0 con 0x7f1da4072840 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1daa7af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40ae650 con 0x7f1da406e4d0 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1daa7af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1da41530b0 con 0x7f1da406e0f0 2024-05-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1da8d4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da4072840 0x7f1da40b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1da8d4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da4072840 0x7f1da40b3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57954/0 (socket says 172.21.15.37:57954) 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.212+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1569928515 learned_addr learned my addr 172.21.15.37:0/1569928515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da37fe640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da406e4d0 0x7f1da40cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da3fff640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da413fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 msgr2=0x7f1da413fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da8d4c640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da413fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da406e4d0 msgr2=0x7f1da40cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da8d4c640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da406e4d0 0x7f1da40cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da8d4c640 1 -- 172.21.15.37:0/1569928515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40ceb50 con 0x7f1da4072840 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da8d4c640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da4072840 0x7f1da40b3210 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c034040 tx=0x7f1d9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da0ff9640 1 -- 172.21.15.37:0/1569928515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c036050 con 0x7f1da4072840 2024-05-10T08:47:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da0ff9640 1 -- 172.21.15.37:0/1569928515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c042070 con 0x7f1da4072840 2024-05-10T08:47:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da40ce010 con 0x7f1da4072840 2024-05-10T08:47:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1da0ff9640 1 -- 172.21.15.37:0/1569928515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c009510 con 0x7f1da4072840 2024-05-10T08:47:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.213+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da40ce2b0 con 0x7f1da4072840 2024-05-10T08:47:41.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.214+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da40693f0 con 0x7f1da4072840 2024-05-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.215+0000 7f1da0ff9640 1 -- 172.21.15.37:0/1569928515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d9c007bd0 con 0x7f1da4072840 2024-05-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.215+0000 7f1da0ff9640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1d900762d0 0x7f1d90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.215+0000 7f1da0ff9640 1 -- 172.21.15.37:0/1569928515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f1d9c0b8330 con 0x7f1da4072840 2024-05-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.215+0000 7f1da3fff640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1d900762d0 0x7f1d90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.216+0000 7f1da3fff640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1d900762d0 0x7f1d90078790 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1d94006fd0 tx=0x7f1d94008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.219+0000 7f1da0ff9640 1 -- 172.21.15.37:0/1569928515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1d9c081de0 con 0x7f1da4072840 2024-05-10T08:47:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.451+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1da40af700 con 0x7f1da4072840 2024-05-10T08:47:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.451+0000 7f1da0ff9640 1 -- 172.21.15.37:0/1569928515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+3866 (secure 0 0 0) 0x7f1d9c0816e0 con 0x7f1da4072840 2024-05-10T08:47:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:41.451 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1091578274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1091578274},{"type":"v1","addr":"172.21.15.82:6836","nonce":1091578274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":5774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3005544808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3005544808},{"type":"v1","addr":"172.21.15.82:6837","nonce":3005544808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6684,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/169038841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":169038841},{"type":"v1","addr":"172.21.15.37:6835","nonce":169038841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2682074719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2682074719},{"type":"v1","addr":"172.21.15.37:6834","nonce":2682074719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[]} 2024-05-10T08:47:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 75 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.453+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1d900762d0 msgr2=0x7f1d90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.453+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1d900762d0 0x7f1d90078790 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1d94006fd0 tx=0x7f1d94008040 comp rx=0 tx=0).stop 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.453+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da4072840 msgr2=0x7f1da40b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.453+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da4072840 0x7f1da40b3210 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c034040 tx=0x7f1d9c004a40 comp rx=0 tx=0).stop 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 shutdown_connections 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1d900762d0 0x7f1d90078790 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1da4072840 0x7f1da40b3210 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da406e4d0 0x7f1da40cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 --2- 172.21.15.37:0/1569928515 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1da406e0f0 0x7f1da413fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 >> 172.21.15.37:0/1569928515 conn(0x7f1da406c3a0 msgr2=0x7f1da415d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 shutdown_connections 2024-05-10T08:47:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.454+0000 7f1daa7af640 1 -- 172.21.15.37:0/1569928515 wait complete. 2024-05-10T08:47:41.464 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:47:41.464 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T08:47:41.464 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:47:41.464 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:47:41.465 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:47:41.465 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T08:47:41.465 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:47:41.465 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:47:41.465 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:47:41.465 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T08:47:41.465 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:47:41.466 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:47:41.466 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:47:41.466 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T08:47:41.466 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:47:41.466 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:47:41.476 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:47:41.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:47:41.477 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:47:41.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:47:41.478 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:47:41.478 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:47:41.479 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:47:41.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:47:41.519 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:47:41.519 DEBUG:teuthology.parallel:result is None 2024-05-10T08:47:41.521 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:47:41.521 DEBUG:teuthology.parallel:result is None 2024-05-10T08:47:41.522 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:47:41.522 DEBUG:teuthology.parallel:result is None 2024-05-10T08:47:41.523 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:47:41.523 DEBUG:teuthology.parallel:result is None 2024-05-10T08:47:41.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T08:47:41.598 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:47:41.599 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:47:41.607 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:47:41.607 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:47:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.634+0000 7f817b5f0640 1 Processor -- start 2024-05-10T08:47:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.635+0000 7f817b5f0640 1 -- start start 2024-05-10T08:47:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.635+0000 7f817b5f0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f817415f420 0x7f81740d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.635+0000 7f817b5f0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81740d3ca0 0x7f81740d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.635+0000 7f817b5f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81740d1eb0 0x7f81740d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.635+0000 7f817b5f0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f81740d22f0 con 0x7f81740d1eb0 2024-05-10T08:47:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.635+0000 7f817b5f0640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f81741630b0 con 0x7f81740d3ca0 2024-05-10T08:47:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.635+0000 7f817b5f0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f81740d2550 con 0x7f817415f420 2024-05-10T08:47:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81740d1eb0 0x7f81740d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81740d1eb0 0x7f81740d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58008/0 (socket says 172.21.15.37:58008) 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 -- 172.21.15.37:0/3205861201 learned_addr learned my addr 172.21.15.37:0/3205861201 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8178b8b640 1 --2- 172.21.15.37:0/3205861201 >> v2:172.21.15.82:3300/0 conn(0x7f81740d3ca0 0x7f81740d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f817938c640 1 --2- 172.21.15.37:0/3205861201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f817415f420 0x7f81740d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 -- 172.21.15.37:0/3205861201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f817415f420 msgr2=0x7f81740d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 --2- 172.21.15.37:0/3205861201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f817415f420 0x7f81740d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 -- 172.21.15.37:0/3205861201 >> v2:172.21.15.82:3300/0 conn(0x7f81740d3ca0 msgr2=0x7f81740d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 --2- 172.21.15.37:0/3205861201 >> v2:172.21.15.82:3300/0 conn(0x7f81740d3ca0 0x7f81740d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f8179b8d640 1 -- 172.21.15.37:0/3205861201 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81740d2c80 con 0x7f81740d1eb0 2024-05-10T08:47:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.636+0000 7f817938c640 1 --2- 172.21.15.37:0/3205861201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f817415f420 0x7f81740d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f8179b8d640 1 --2- 172.21.15.37:0/3205861201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740d1eb0 0x7f81740d4cc0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f81740b7b90 tx=0x7f816c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5057f84abd7d3e0b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f8167fff640 1 -- 172.21.15.37:0/3205861201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c036070 con 0x7f81740d1eb0 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f8167fff640 1 -- 172.21.15.37:0/3205861201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f816c031600 con 0x7f81740d1eb0 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f8167fff640 1 -- 172.21.15.37:0/3205861201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c0319d0 con 0x7f81740d1eb0 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f817b5f0640 1 -- 172.21.15.37:0/3205861201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740d1eb0 msgr2=0x7f81740d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3205861201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740d1eb0 0x7f81740d4cc0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f81740b7b90 tx=0x7f816c02a6a0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f817b5f0640 1 -- 172.21.15.37:0/3205861201 shutdown_connections 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3205861201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740d1eb0 0x7f81740d4cc0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3205861201 >> v2:172.21.15.82:3300/0 conn(0x7f81740d3ca0 0x7f81740d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3205861201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f817415f420 0x7f81740d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.637+0000 7f817b5f0640 1 -- 172.21.15.37:0/3205861201 >> 172.21.15.37:0/3205861201 conn(0x7f817408eac0 msgr2=0x7f817409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.638+0000 7f817b5f0640 1 -- 172.21.15.37:0/3205861201 shutdown_connections 2024-05-10T08:47:41.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.638+0000 7f817b5f0640 1 -- 172.21.15.37:0/3205861201 wait complete. 2024-05-10T08:47:41.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.639+0000 7f817b5f0640 1 Processor -- start 2024-05-10T08:47:41.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.639+0000 7f817b5f0640 1 -- start start 2024-05-10T08:47:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817b5f0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81740d1eb0 0x7f817415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817b5f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740c9ba0 0x7f81740ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817b5f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81740b2e50 0x7f81740b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817b5f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81740d2830 con 0x7f81740c9ba0 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817b5f0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f81740d3240 con 0x7f81740b2e50 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740c9ba0 0x7f81740ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817b5f0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f81740d5200 con 0x7f81740d1eb0 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740c9ba0 0x7f81740ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58024/0 (socket says 172.21.15.37:58024) 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 -- 172.21.15.37:0/3065200507 learned_addr learned my addr 172.21.15.37:0/3065200507 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817938c640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81740d1eb0 0x7f817415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8179b8d640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81740b2e50 0x7f81740b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 -- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81740d1eb0 msgr2=0x7f817415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81740d1eb0 0x7f817415a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 -- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81740b2e50 msgr2=0x7f81740b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81740b2e50 0x7f81740b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 -- 172.21.15.37:0/3065200507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81740cc280 con 0x7f81740c9ba0 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8178b8b640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740c9ba0 0x7f81740ca000 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f817000e8c0 tx=0x7f817000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8165ffb640 1 -- 172.21.15.37:0/3065200507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170017070 con 0x7f81740c9ba0 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8165ffb640 1 -- 172.21.15.37:0/3065200507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817000c940 con 0x7f81740c9ba0 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f8165ffb640 1 -- 172.21.15.37:0/3065200507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817000cd10 con 0x7f81740c9ba0 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.640+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81740cc520 con 0x7f81740c9ba0 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.641+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81740ccae0 con 0x7f81740c9ba0 2024-05-10T08:47:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.642+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81740685d0 con 0x7f81740c9ba0 2024-05-10T08:47:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.642+0000 7f8165ffb640 1 -- 172.21.15.37:0/3065200507 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f817001a070 con 0x7f81740c9ba0 2024-05-10T08:47:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.643+0000 7f8165ffb640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81580762d0 0x7f8158078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.643+0000 7f8165ffb640 1 -- 172.21.15.37:0/3065200507 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f81700974c0 con 0x7f81740c9ba0 2024-05-10T08:47:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.643+0000 7f817938c640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81580762d0 0x7f8158078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.643+0000 7f817938c640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81580762d0 0x7f8158078790 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8168006fd0 tx=0x7f8168008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.647+0000 7f8165ffb640 1 -- 172.21.15.37:0/3065200507 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f81740685d0 con 0x7f81740c9ba0 2024-05-10T08:47:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:41.850+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f81740baee0 con 0x7f81740c9ba0 2024-05-10T08:47:42.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.917+0000 7f8165ffb640 1 -- 172.21.15.37:0/3065200507 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) ==== 97+0+0 (secure 0 0 0) 0x7f81740baee0 con 0x7f81740c9ba0 2024-05-10T08:47:42.916 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81580762d0 msgr2=0x7f8158078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81580762d0 0x7f8158078790 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8168006fd0 tx=0x7f8168008040 comp rx=0 tx=0).stop 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740c9ba0 msgr2=0x7f81740ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740c9ba0 0x7f81740ca000 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f817000e8c0 tx=0x7f817000ed80 comp rx=0 tx=0).stop 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 shutdown_connections 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f81580762d0 0x7f8158078790 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81740b2e50 0x7f81740b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81740c9ba0 0x7f81740ca000 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 --2- 172.21.15.37:0/3065200507 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f81740d1eb0 0x7f817415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 >> 172.21.15.37:0/3065200507 conn(0x7f817408eac0 msgr2=0x7f817415db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 shutdown_connections 2024-05-10T08:47:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:42.920+0000 7f817b5f0640 1 -- 172.21.15.37:0/3065200507 wait complete. 2024-05-10T08:47:42.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T08:47:43.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.044+0000 7f46c9538640 1 Processor -- start 2024-05-10T08:47:43.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.044+0000 7f46c9538640 1 -- start start 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c9538640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c415c340 0x7f46c4166970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c9538640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c415c920 con 0x7f46c4072840 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c9538640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c415cc00 con 0x7f46c406e0f0 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c9538640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f46c415cee0 con 0x7f46c415c340 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c27fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f46c4072840 0x7f46c406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34384/0 (socket says 172.21.15.37:34384) 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c27fc640 1 -- 172.21.15.37:0/1602854864 learned_addr learned my addr 172.21.15.37:0/1602854864 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c37fe640 1 --2- 172.21.15.37:0/1602854864 >> v2:172.21.15.82:3300/0 conn(0x7f46c415c340 0x7f46c4166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253935790 0 0) 0x7f46c415c920 con 0x7f46c4072840 2024-05-10T08:47:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.045+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46ac003520 con 0x7f46c4072840 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3552151968 0 0) 0x7f46ac003520 con 0x7f46c4072840 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 >> v2:172.21.15.82:3300/0 conn(0x7f46c415c340 msgr2=0x7f46c4166970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 --2- 172.21.15.37:0/1602854864 >> v2:172.21.15.82:3300/0 conn(0x7f46c415c340 0x7f46c4166970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 >> v1:172.21.15.82:6789/0 conn(0x7f46c406e0f0 legacy=0x7f46c40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c415d1c0 con 0x7f46c4072840 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f46b8001670 con 0x7f46c4072840 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 >> v1:172.21.15.37:6789/0 conn(0x7f46c4072840 legacy=0x7f46c406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac0039b0 0x7f46ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac0043b0 0x7f46ac004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac005120 0x7f46ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46c415cee0 con 0x7f46ac005120 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac00c060 con 0x7f46ac0039b0 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46ac00c260 con 0x7f46ac0043b0 2024-05-10T08:47:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c37fe640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac005120 0x7f46ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c2ffd640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac0039b0 0x7f46ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c27fc640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac0043b0 0x7f46ac004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c37fe640 1 -- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac0043b0 msgr2=0x7f46ac004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c37fe640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac0043b0 0x7f46ac004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c37fe640 1 -- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac0039b0 msgr2=0x7f46ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c37fe640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac0039b0 0x7f46ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.046+0000 7f46c37fe640 1 -- 172.21.15.37:0/1602854864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac003520 con 0x7f46ac005120 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.047+0000 7f46c37fe640 1 -- 172.21.15.37:0/1602854864 reap_dead start 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.047+0000 7f46c37fe640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac005120 0x7f46ac00b9c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009fc0 tx=0x7f46ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a489a1227d3ff170 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.047+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc035020 con 0x7f46ac005120 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.047+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46bc003b90 con 0x7f46ac005120 2024-05-10T08:47:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.047+0000 7f46c1ffb640 1 -- 172.21.15.37:0/1602854864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc009c10 con 0x7f46ac005120 2024-05-10T08:47:43.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.048+0000 7f46c9538640 1 -- 172.21.15.37:0/1602854864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac005120 msgr2=0x7f46ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.048+0000 7f46c9538640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac005120 0x7f46ac00b9c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009fc0 tx=0x7f46ac005830 comp rx=0 tx=0).stop 2024-05-10T08:47:43.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.048+0000 7f46c9538640 1 -- 172.21.15.37:0/1602854864 shutdown_connections 2024-05-10T08:47:43.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.048+0000 7f46c9538640 1 --2- 172.21.15.37:0/1602854864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac005120 0x7f46ac00b9c0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.048+0000 7f46c9538640 1 -- 172.21.15.37:0/1602854864 >> 172.21.15.37:0/1602854864 conn(0x7f46c406c3a0 msgr2=0x7f46c406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:43.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.048+0000 7f46c9538640 1 -- 172.21.15.37:0/1602854864 shutdown_connections 2024-05-10T08:47:43.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.048+0000 7f46c9538640 1 -- 172.21.15.37:0/1602854864 wait complete. 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.049+0000 7f46c9538640 1 Processor -- start 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.049+0000 7f46c9538640 1 -- start start 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c9538640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac005120 0x7f46c41424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c9538640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c41596a0 0x7f46c4159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c9538640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c414dac0 0x7f46c415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c9538640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46c4153230 con 0x7f46c41596a0 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c9538640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46c41530b0 con 0x7f46c414dac0 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c9538640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46c40d0f70 con 0x7f46ac005120 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c41596a0 0x7f46c4159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c41596a0 0x7f46c4159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58034/0 (socket says 172.21.15.37:58034) 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 -- 172.21.15.37:0/786240278 learned_addr learned my addr 172.21.15.37:0/786240278 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c37fe640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c414dac0 0x7f46c415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c2ffd640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac005120 0x7f46c41424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 -- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac005120 msgr2=0x7f46c41424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac005120 0x7f46c41424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 -- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c414dac0 msgr2=0x7f46c415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c414dac0 0x7f46c415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 -- 172.21.15.37:0/786240278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c414e700 con 0x7f46c41596a0 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.050+0000 7f46c27fc640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c41596a0 0x7f46c4159f60 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f46b8004ef0 tx=0x7f46b8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.051+0000 7f46ab7fe640 1 -- 172.21.15.37:0/786240278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b801a070 con 0x7f46c41596a0 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.051+0000 7f46ab7fe640 1 -- 172.21.15.37:0/786240278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b800f7b0 con 0x7f46c41596a0 2024-05-10T08:47:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.051+0000 7f46ab7fe640 1 -- 172.21.15.37:0/786240278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b800fb80 con 0x7f46c41596a0 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.051+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c414ed50 con 0x7f46c41596a0 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.051+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c414f310 con 0x7f46c41596a0 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.052+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c415cc00 con 0x7f46c41596a0 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.052+0000 7f46ab7fe640 1 -- 172.21.15.37:0/786240278 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46b801d070 con 0x7f46c41596a0 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.053+0000 7f46ab7fe640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b00762d0 0x7f46b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.053+0000 7f46ab7fe640 1 -- 172.21.15.37:0/786240278 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5249+0+0 (secure 0 0 0) 0x7f46b8096d00 con 0x7f46c41596a0 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.053+0000 7f46c2ffd640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b00762d0 0x7f46b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.054+0000 7f46c2ffd640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b00762d0 0x7f46b0078790 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f46b4003640 tx=0x7f46b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.057+0000 7f46ab7fe640 1 -- 172.21.15.37:0/786240278 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f46c415cc00 con 0x7f46c41596a0 2024-05-10T08:47:43.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.319+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f46c40693f0 con 0x7f46c41596a0 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.320+0000 7f46ab7fe640 1 -- 172.21.15.37:0/786240278 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f46b8060780 con 0x7f46c41596a0 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg==", 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:47:43.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ==", 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.320 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA==", 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw==", 2024-05-10T08:47:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw==", 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.322 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw==", 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg==", 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.323 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ==", 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g==", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA==", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.325 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w==", 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg==", 2024-05-10T08:47:43.326 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A==", 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.327 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg==", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw==", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:47:43.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA==", 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-10T08:47:43.329 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA83T1mpCEPLBAAZlDinj6hQh8Ccd9D/MMUDw==", 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA==", 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:47:43.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A==", 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.331 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.332 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:47:43.332 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:47:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b00762d0 msgr2=0x7f46b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b00762d0 0x7f46b0078790 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f46b4003640 tx=0x7f46b4009040 comp rx=0 tx=0).stop 2024-05-10T08:47:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c41596a0 msgr2=0x7f46c4159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c41596a0 0x7f46c4159f60 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f46b8004ef0 tx=0x7f46b8007430 comp rx=0 tx=0).stop 2024-05-10T08:47:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 shutdown_connections 2024-05-10T08:47:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f46b00762d0 0x7f46b0078790 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c414dac0 0x7f46c415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46c41596a0 0x7f46c4159f60 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 --2- 172.21.15.37:0/786240278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46ac005120 0x7f46c41424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 >> 172.21.15.37:0/786240278 conn(0x7f46c406c3a0 msgr2=0x7f46c406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:43.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 shutdown_connections 2024-05-10T08:47:43.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.322+0000 7f46c9538640 1 -- 172.21.15.37:0/786240278 wait complete. 2024-05-10T08:47:43.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:47:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.439+0000 7efd2714d640 1 Processor -- start 2024-05-10T08:47:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.439+0000 7efd2714d640 1 -- start start 2024-05-10T08:47:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.440+0000 7efd2714d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd20070d30 0x7efd200d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.440+0000 7efd2714d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd200d1300 con 0x7efd20163920 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.440+0000 7efd2714d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd200d15e0 con 0x7efd20071110 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.440+0000 7efd2714d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efd200d10d0 con 0x7efd20070d30 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.440+0000 7efd24ee9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd20070d30 0x7efd200d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.440+0000 7efd1ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efd20163920 0x7efd200703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34394/0 (socket says 172.21.15.37:34394) 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.440+0000 7efd1ffff640 1 -- 172.21.15.37:0/744009436 learned_addr learned my addr 172.21.15.37:0/744009436 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.441+0000 7efd24ee9640 1 -- 172.21.15.37:0/744009436 >> v1:172.21.15.82:6789/0 conn(0x7efd20071110 legacy=0x7efd2006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.441+0000 7efd24ee9640 1 -- 172.21.15.37:0/744009436 >> v1:172.21.15.37:6789/0 conn(0x7efd20163920 legacy=0x7efd200703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.441+0000 7efd24ee9640 1 -- 172.21.15.37:0/744009436 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd200d18c0 con 0x7efd20070d30 2024-05-10T08:47:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.441+0000 7efd24ee9640 1 --2- 172.21.15.37:0/744009436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20070d30 0x7efd200d20c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7efd140097a0 tx=0x7efd1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f734d54580e989 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.441+0000 7efd1f7fe640 1 -- 172.21.15.37:0/744009436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14037070 con 0x7efd20070d30 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.441+0000 7efd1f7fe640 1 -- 172.21.15.37:0/744009436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd14032440 con 0x7efd20070d30 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.441+0000 7efd1f7fe640 1 -- 172.21.15.37:0/744009436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14032810 con 0x7efd20070d30 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.442+0000 7efd2714d640 1 -- 172.21.15.37:0/744009436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20070d30 msgr2=0x7efd200d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.442+0000 7efd2714d640 1 --2- 172.21.15.37:0/744009436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20070d30 0x7efd200d20c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7efd140097a0 tx=0x7efd1402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.442+0000 7efd2714d640 1 -- 172.21.15.37:0/744009436 shutdown_connections 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.442+0000 7efd2714d640 1 --2- 172.21.15.37:0/744009436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20070d30 0x7efd200d20c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.442+0000 7efd2714d640 1 -- 172.21.15.37:0/744009436 >> 172.21.15.37:0/744009436 conn(0x7efd200d2e90 msgr2=0x7efd200d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.442+0000 7efd2714d640 1 -- 172.21.15.37:0/744009436 shutdown_connections 2024-05-10T08:47:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.442+0000 7efd2714d640 1 -- 172.21.15.37:0/744009436 wait complete. 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.443+0000 7efd2714d640 1 Processor -- start 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.443+0000 7efd2714d640 1 -- start start 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd2714d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd20070d30 0x7efd200c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd2714d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd20071110 0x7efd200c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd2714d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20163920 0x7efd200c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd2714d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd20070b80 con 0x7efd20163920 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd2714d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd20163db0 con 0x7efd20071110 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd2714d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efd200d1c30 con 0x7efd20070d30 2024-05-10T08:47:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd256ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20163920 0x7efd200c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd256ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20163920 0x7efd200c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58050/0 (socket says 172.21.15.37:58050) 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.444+0000 7efd256ea640 1 -- 172.21.15.37:0/2252434906 learned_addr learned my addr 172.21.15.37:0/2252434906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd24ee9640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd20070d30 0x7efd200c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd1ffff640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd20071110 0x7efd200c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd256ea640 1 -- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd20070d30 msgr2=0x7efd200c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd256ea640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd20070d30 0x7efd200c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd256ea640 1 -- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd20071110 msgr2=0x7efd200c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd256ea640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd20071110 0x7efd200c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd256ea640 1 -- 172.21.15.37:0/2252434906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd20154af0 con 0x7efd20163920 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd24ee9640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd20070d30 0x7efd200c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd256ea640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20163920 0x7efd200c8fa0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7efd1800b970 tx=0x7efd1800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd1d7fa640 1 -- 172.21.15.37:0/2252434906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18019070 con 0x7efd20163920 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd1d7fa640 1 -- 172.21.15.37:0/2252434906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1800cb40 con 0x7efd20163920 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd200c96d0 con 0x7efd20163920 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd1d7fa640 1 -- 172.21.15.37:0/2252434906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18014440 con 0x7efd20163920 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.445+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd201552a0 con 0x7efd20163920 2024-05-10T08:47:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.446+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd200693f0 con 0x7efd20163920 2024-05-10T08:47:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.447+0000 7efd1d7fa640 1 -- 172.21.15.37:0/2252434906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd1801c070 con 0x7efd20163920 2024-05-10T08:47:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.447+0000 7efd1d7fa640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd040762d0 0x7efd04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.447+0000 7efd1d7fa640 1 -- 172.21.15.37:0/2252434906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5249+0+0 (secure 0 0 0) 0x7efd180971a0 con 0x7efd20163920 2024-05-10T08:47:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.448+0000 7efd24ee9640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd040762d0 0x7efd04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.448+0000 7efd24ee9640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd040762d0 0x7efd04078790 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efd14034000 tx=0x7efd1402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.452+0000 7efd1d7fa640 1 -- 172.21.15.37:0/2252434906 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efd18060cc0 con 0x7efd20163920 2024-05-10T08:47:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.643+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efd200d3d70 con 0x7efd20163920 2024-05-10T08:47:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.643+0000 7efd1d7fa640 1 -- 172.21.15.37:0/2252434906 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) ==== 84+0+65 (secure 0 0 0) 0x7efd180605c0 con 0x7efd20163920 2024-05-10T08:47:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:43.643 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:47:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:47:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:47:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:47:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:47:43.643 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:47:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd040762d0 msgr2=0x7efd04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd040762d0 0x7efd04078790 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efd14034000 tx=0x7efd1402e000 comp rx=0 tx=0).stop 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20163920 msgr2=0x7efd200c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20163920 0x7efd200c8fa0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7efd1800b970 tx=0x7efd1800be30 comp rx=0 tx=0).stop 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 shutdown_connections 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd040762d0 0x7efd04078790 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd20163920 0x7efd200c8fa0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd20071110 0x7efd200c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 --2- 172.21.15.37:0/2252434906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efd20070d30 0x7efd200c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.645+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 >> 172.21.15.37:0/2252434906 conn(0x7efd200d2e90 msgr2=0x7efd200d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.646+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 shutdown_connections 2024-05-10T08:47:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.646+0000 7efd2714d640 1 -- 172.21.15.37:0/2252434906 wait complete. 2024-05-10T08:47:43.655 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:47:43.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:47:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.765+0000 7f1b4d35f640 1 Processor -- start 2024-05-10T08:47:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.765+0000 7f1b4d35f640 1 -- start start 2024-05-10T08:47:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b4d35f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d3670 0x7f1b480b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b4d35f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b480d1050 0x7f1b48162920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b4d35f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b480cfc00 con 0x7f1b480d3a50 2024-05-10T08:47:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b4d35f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1b480d2a10 con 0x7f1b480d1050 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b4d35f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b480d04b0 con 0x7f1b480d3670 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b477fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b480d1050 0x7f1b48162920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b467fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1b480d3a50 0x7f1b480d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34400/0 (socket says 172.21.15.37:34400) 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b467fc640 1 -- 172.21.15.37:0/1479134722 learned_addr learned my addr 172.21.15.37:0/1479134722 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b477fe640 1 -- 172.21.15.37:0/1479134722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d3670 msgr2=0x7f1b480b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b46ffd640 1 --2- 172.21.15.37:0/1479134722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d3670 0x7f1b480b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b477fe640 1 --2- 172.21.15.37:0/1479134722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d3670 0x7f1b480b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b477fe640 1 -- 172.21.15.37:0/1479134722 >> v1:172.21.15.37:6789/0 conn(0x7f1b480d3a50 legacy=0x7f1b480d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b45ffb640 1 -- 172.21.15.37:0/1479134722 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964579672 0 0) 0x7f1b480cfc00 con 0x7f1b480d3a50 2024-05-10T08:47:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.766+0000 7f1b477fe640 1 -- 172.21.15.37:0/1479134722 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b480cfea0 con 0x7f1b480d1050 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.767+0000 7f1b477fe640 1 --2- 172.21.15.37:0/1479134722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d1050 0x7f1b48162920 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f1b480d0630 tx=0x7f1b4002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc4cf97251f4d01 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.767+0000 7f1b45ffb640 1 -- 172.21.15.37:0/1479134722 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4002ae60 con 0x7f1b480d1050 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.767+0000 7f1b45ffb640 1 -- 172.21.15.37:0/1479134722 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b40007740 con 0x7f1b480d1050 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.767+0000 7f1b45ffb640 1 -- 172.21.15.37:0/1479134722 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40007b10 con 0x7f1b480d1050 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 -- 172.21.15.37:0/1479134722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d1050 msgr2=0x7f1b48162920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/1479134722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d1050 0x7f1b48162920 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f1b480d0630 tx=0x7f1b4002a640 comp rx=0 tx=0).stop 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 -- 172.21.15.37:0/1479134722 shutdown_connections 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/1479134722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d1050 0x7f1b48162920 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/1479134722 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d3670 0x7f1b480b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 -- 172.21.15.37:0/1479134722 >> 172.21.15.37:0/1479134722 conn(0x7f1b4809e390 msgr2=0x7f1b480d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 -- 172.21.15.37:0/1479134722 shutdown_connections 2024-05-10T08:47:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.768+0000 7f1b4d35f640 1 -- 172.21.15.37:0/1479134722 wait complete. 2024-05-10T08:47:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.769+0000 7f1b4d35f640 1 Processor -- start 2024-05-10T08:47:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.769+0000 7f1b4d35f640 1 -- start start 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b4d35f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d1050 0x7f1b4815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b4d35f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b480d3670 0x7f1b480cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b4d35f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d3a50 0x7f1b481f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b4d35f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48162e60 con 0x7f1b480d3a50 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b4d35f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b480d0140 con 0x7f1b480d3670 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b4d35f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b480b4f00 con 0x7f1b480d1050 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d3a50 0x7f1b481f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d3a50 0x7f1b481f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58064/0 (socket says 172.21.15.37:58064) 2024-05-10T08:47:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 -- 172.21.15.37:0/304117177 learned_addr learned my addr 172.21.15.37:0/304117177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b46ffd640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d1050 0x7f1b4815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 -- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d1050 msgr2=0x7f1b4815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b467fc640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b480d3670 0x7f1b480cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d1050 0x7f1b4815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 -- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b480d3670 msgr2=0x7f1b480cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b480d3670 0x7f1b480cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.770+0000 7f1b477fe640 1 -- 172.21.15.37:0/304117177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4815db30 con 0x7f1b480d3a50 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.771+0000 7f1b477fe640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d3a50 0x7f1b481f4f20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009e50 tx=0x7f1b40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.771+0000 7f1b3f7fe640 1 -- 172.21.15.37:0/304117177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40040070 con 0x7f1b480d3a50 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.771+0000 7f1b3f7fe640 1 -- 172.21.15.37:0/304117177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4002ae60 con 0x7f1b480d3a50 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.771+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b480cd180 con 0x7f1b480d3a50 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.771+0000 7f1b3f7fe640 1 -- 172.21.15.37:0/304117177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40045460 con 0x7f1b480d3a50 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.771+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b481f5d30 con 0x7f1b480d3a50 2024-05-10T08:47:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.772+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b480693f0 con 0x7f1b480d3a50 2024-05-10T08:47:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.772+0000 7f1b3f7fe640 1 -- 172.21.15.37:0/304117177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b40039040 con 0x7f1b480d3a50 2024-05-10T08:47:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.773+0000 7f1b3f7fe640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b280762d0 0x7f1b28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.773+0000 7f1b3f7fe640 1 -- 172.21.15.37:0/304117177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5249+0+0 (secure 0 0 0) 0x7f1b400b8bf0 con 0x7f1b480d3a50 2024-05-10T08:47:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.773+0000 7f1b46ffd640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b280762d0 0x7f1b28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.774+0000 7f1b46ffd640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b280762d0 0x7f1b28078790 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b38006fd0 tx=0x7f1b38008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.777+0000 7f1b3f7fe640 1 -- 172.21.15.37:0/304117177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1b4815db30 con 0x7f1b480d3a50 2024-05-10T08:47:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:43.968+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1b480d0b50 con 0x7f1b480d3a50 2024-05-10T08:47:44.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.920+0000 7f1b3f7fe640 1 -- 172.21.15.37:0/304117177 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) ==== 138+0+0 (secure 0 0 0) 0x7f1b40082860 con 0x7f1b480d3a50 2024-05-10T08:47:44.919 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:47:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b280762d0 msgr2=0x7f1b28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b280762d0 0x7f1b28078790 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b38006fd0 tx=0x7f1b38008040 comp rx=0 tx=0).stop 2024-05-10T08:47:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d3a50 msgr2=0x7f1b481f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d3a50 0x7f1b481f4f20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009e50 tx=0x7f1b40004a40 comp rx=0 tx=0).stop 2024-05-10T08:47:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 shutdown_connections 2024-05-10T08:47:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b280762d0 0x7f1b28078790 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b480d3a50 0x7f1b481f4f20 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b480d3670 0x7f1b480cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 --2- 172.21.15.37:0/304117177 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b480d1050 0x7f1b4815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.924+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 >> 172.21.15.37:0/304117177 conn(0x7f1b4809e390 msgr2=0x7f1b480d14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.927+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 shutdown_connections 2024-05-10T08:47:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:44.928+0000 7f1b4d35f640 1 -- 172.21.15.37:0/304117177 wait complete. 2024-05-10T08:47:44.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:47:45.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.058+0000 7f7ac2e1c640 1 Processor -- start 2024-05-10T08:47:45.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.058+0000 7f7ac2e1c640 1 -- start start 2024-05-10T08:47:45.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac2e1c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:45.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac2e1c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7abc0d0360 0x7f7abc0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac2e1c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7abc15d2a0 con 0x7f7abc06f060 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac2e1c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc06f440 con 0x7f7abc0d0360 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac2e1c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7abc1609b0 con 0x7f7abc06e0f0 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac0bb8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7abc06f060 0x7f7abc06fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34410/0 (socket says 172.21.15.37:34410) 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac0bb8640 1 -- 172.21.15.37:0/3508494787 learned_addr learned my addr 172.21.15.37:0/3508494787 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.059+0000 7f7ac13b9640 1 --2- 172.21.15.37:0/3508494787 >> v2:172.21.15.37:3300/0 conn(0x7f7abc0d0360 0x7f7abc0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7abbfff640 1 --2- 172.21.15.37:0/3508494787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7ac13b9640 1 -- 172.21.15.37:0/3508494787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 msgr2=0x7f7abc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7ac13b9640 1 --2- 172.21.15.37:0/3508494787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7ac13b9640 1 -- 172.21.15.37:0/3508494787 >> v1:172.21.15.37:6789/0 conn(0x7f7abc06f060 legacy=0x7f7abc06fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7abb7fe640 1 -- 172.21.15.37:0/3508494787 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052813139 0 0) 0x7f7abc15d2a0 con 0x7f7abc06f060 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7ac13b9640 1 -- 172.21.15.37:0/3508494787 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc160c90 con 0x7f7abc0d0360 2024-05-10T08:47:45.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7abbfff640 1 --2- 172.21.15.37:0/3508494787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.060+0000 7f7ac13b9640 1 --2- 172.21.15.37:0/3508494787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc0b3f00 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009d90 tx=0x7f7ab402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4894c2671aa7d01 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7abb7fe640 1 -- 172.21.15.37:0/3508494787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4007740 con 0x7f7abc0d0360 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7abb7fe640 1 -- 172.21.15.37:0/3508494787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab40078e0 con 0x7f7abc0d0360 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7abb7fe640 1 -- 172.21.15.37:0/3508494787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4007cb0 con 0x7f7abc0d0360 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/3508494787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 msgr2=0x7f7abc0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/3508494787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc0b3f00 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009d90 tx=0x7f7ab402a660 comp rx=0 tx=0).stop 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/3508494787 shutdown_connections 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/3508494787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc0b3f00 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/3508494787 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/3508494787 >> 172.21.15.37:0/3508494787 conn(0x7f7abc06c3a0 msgr2=0x7f7abc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/3508494787 shutdown_connections 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.061+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/3508494787 wait complete. 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.062+0000 7f7ac2e1c640 1 Processor -- start 2024-05-10T08:47:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.062+0000 7f7ac2e1c640 1 -- start start 2024-05-10T08:47:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac2e1c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc09e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac2e1c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc06f060 0x7f7abc1f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac2e1c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc09d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac2e1c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc161530 con 0x7f7abc0d0360 2024-05-10T08:47:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac2e1c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc161250 con 0x7f7abc06f060 2024-05-10T08:47:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac2e1c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7abc161810 con 0x7f7abc06e0f0 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac13b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc09d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.063+0000 7f7ac13b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc09d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58078/0 (socket says 172.21.15.37:58078) 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac13b9640 1 -- 172.21.15.37:0/1897227950 learned_addr learned my addr 172.21.15.37:0/1897227950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac0bb8640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc09e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7abbfff640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc06f060 0x7f7abc1f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac13b9640 1 -- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 msgr2=0x7f7abc09e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac13b9640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc09e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac13b9640 1 -- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc06f060 msgr2=0x7f7abc1f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac13b9640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc06f060 0x7f7abc1f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac13b9640 1 -- 172.21.15.37:0/1897227950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc09cbc0 con 0x7f7abc0d0360 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac13b9640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc09d3a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009d90 tx=0x7f7ab4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ab97fa640 1 -- 172.21.15.37:0/1897227950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4040070 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ab97fa640 1 -- 172.21.15.37:0/1897227950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab4031c40 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc1f32f0 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ab97fa640 1 -- 172.21.15.37:0/1897227950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4003990 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.064+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc1f38b0 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.065+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7abc0693f0 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.066+0000 7f7ab97fa640 1 -- 172.21.15.37:0/1897227950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ab4039040 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.067+0000 7f7ab97fa640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7aa80762d0 0x7f7aa8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.067+0000 7f7ab97fa640 1 -- 172.21.15.37:0/1897227950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5619+0+0 (secure 0 0 0) 0x7f7ab40b88d0 con 0x7f7abc0d0360 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.067+0000 7f7ac0bb8640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7aa80762d0 0x7f7aa8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.068+0000 7f7ac0bb8640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7aa80762d0 0x7f7aa8078790 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7aac000f60 tx=0x7f7aac007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.071+0000 7f7ab97fa640 1 -- 172.21.15.37:0/1897227950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7ab4081c90 con 0x7f7abc0d0360 2024-05-10T08:47:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.264+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7abc09ee30 con 0x7f7abc0d0360 2024-05-10T08:47:45.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.926+0000 7f7ab97fa640 1 -- 172.21.15.37:0/1897227950 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) ==== 170+0+0 (secure 0 0 0) 0x7f7ab4085f90 con 0x7f7abc0d0360 2024-05-10T08:47:45.926 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:47:45.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.929+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7aa80762d0 msgr2=0x7f7aa8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.929+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7aa80762d0 0x7f7aa8078790 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7aac000f60 tx=0x7f7aac007d50 comp rx=0 tx=0).stop 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.929+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 msgr2=0x7f7abc09d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.929+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc09d3a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009d90 tx=0x7f7ab4004a40 comp rx=0 tx=0).stop 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 shutdown_connections 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7aa80762d0 0x7f7aa8078790 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc0d0360 0x7f7abc09d3a0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc06f060 0x7f7abc1f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 --2- 172.21.15.37:0/1897227950 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7abc06e0f0 0x7f7abc09e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 >> 172.21.15.37:0/1897227950 conn(0x7f7abc06c3a0 msgr2=0x7f7abc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 shutdown_connections 2024-05-10T08:47:45.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:45.930+0000 7f7ac2e1c640 1 -- 172.21.15.37:0/1897227950 wait complete. 2024-05-10T08:47:45.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:47:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.062+0000 7f3609f87640 1 Processor -- start 2024-05-10T08:47:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.062+0000 7f3609f87640 1 -- start start 2024-05-10T08:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f3609f87640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f360415f4e0 0x7f36040cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f3609f87640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36040d56b0 0x7f36040d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f3609f87640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36040d0320 con 0x7f36040d3aa0 2024-05-10T08:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f3609f87640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f36040d0600 con 0x7f360415f4e0 2024-05-10T08:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f3609f87640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f36040d08e0 con 0x7f36040d56b0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f36037fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f360415f4e0 0x7f36040cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f36037fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f360415f4e0 0x7f36040cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58094/0 (socket says 172.21.15.37:58094) 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f36037fe640 1 -- 172.21.15.37:0/3984564578 learned_addr learned my addr 172.21.15.37:0/3984564578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.063+0000 7f3602ffd640 1 --1- 172.21.15.37:0/3984564578 >> v1:172.21.15.37:6789/0 conn(0x7f36040d3aa0 0x7f36040d4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34422/0 (socket says 172.21.15.37:34422) 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.064+0000 7f3603fff640 1 --2- 172.21.15.37:0/3984564578 >> v2:172.21.15.82:3300/0 conn(0x7f36040d56b0 0x7f36040d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.064+0000 7f36037fe640 1 -- 172.21.15.37:0/3984564578 >> v2:172.21.15.82:3300/0 conn(0x7f36040d56b0 msgr2=0x7f36040d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.064+0000 7f36037fe640 1 --2- 172.21.15.37:0/3984564578 >> v2:172.21.15.82:3300/0 conn(0x7f36040d56b0 0x7f36040d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.064+0000 7f36037fe640 1 -- 172.21.15.37:0/3984564578 >> v1:172.21.15.37:6789/0 conn(0x7f36040d3aa0 legacy=0x7f36040d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.064+0000 7f36037fe640 1 -- 172.21.15.37:0/3984564578 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36040d0bc0 con 0x7f360415f4e0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.064+0000 7f36027fc640 1 -- 172.21.15.37:0/3984564578 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252705071 0 0) 0x7f36040d0320 con 0x7f36040d3aa0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.064+0000 7f36037fe640 1 --2- 172.21.15.37:0/3984564578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360415f4e0 0x7f36040cfcd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f36040d2a40 tx=0x7f35f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31454de4b4e52763 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f36027fc640 1 -- 172.21.15.37:0/3984564578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4037070 con 0x7f360415f4e0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f36027fc640 1 -- 172.21.15.37:0/3984564578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f4032440 con 0x7f360415f4e0 2024-05-10T08:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f36027fc640 1 -- 172.21.15.37:0/3984564578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4032810 con 0x7f360415f4e0 2024-05-10T08:47:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 -- 172.21.15.37:0/3984564578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360415f4e0 msgr2=0x7f36040cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 --2- 172.21.15.37:0/3984564578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360415f4e0 0x7f36040cfcd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f36040d2a40 tx=0x7f35f402a270 comp rx=0 tx=0).stop 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 -- 172.21.15.37:0/3984564578 shutdown_connections 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 --2- 172.21.15.37:0/3984564578 >> v2:172.21.15.82:3300/0 conn(0x7f36040d56b0 0x7f36040d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 --2- 172.21.15.37:0/3984564578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360415f4e0 0x7f36040cfcd0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 -- 172.21.15.37:0/3984564578 >> 172.21.15.37:0/3984564578 conn(0x7f360408eac0 msgr2=0x7f360409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 -- 172.21.15.37:0/3984564578 shutdown_connections 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.065+0000 7f3609f87640 1 -- 172.21.15.37:0/3984564578 wait complete. 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.066+0000 7f3609f87640 1 Processor -- start 2024-05-10T08:47:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3609f87640 1 -- start start 2024-05-10T08:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3609f87640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36040d3aa0 0x7f36041f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3609f87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36040d56b0 0x7f36040cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3609f87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f360415f4e0 0x7f36040cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3609f87640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f36040d3f00 con 0x7f36040d56b0 2024-05-10T08:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3609f87640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f360415f8c0 con 0x7f360415f4e0 2024-05-10T08:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3609f87640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f36040d4080 con 0x7f36040d3aa0 2024-05-10T08:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.067+0000 7f3602ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36040d56b0 0x7f36040cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36040d56b0 0x7f36040cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58096/0 (socket says 172.21.15.37:58096) 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 -- 172.21.15.37:0/1025142881 learned_addr learned my addr 172.21.15.37:0/1025142881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3603fff640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f360415f4e0 0x7f36040cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f36037fe640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36040d3aa0 0x7f36041f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 -- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36040d3aa0 msgr2=0x7f36041f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36040d3aa0 0x7f36041f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 -- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f360415f4e0 msgr2=0x7f36040cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f360415f4e0 0x7f36040cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 -- 172.21.15.37:0/1025142881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36040cedc0 con 0x7f36040d56b0 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f36037fe640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36040d3aa0 0x7f36041f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3602ffd640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36040d56b0 0x7f36040cc2b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c4d0 tx=0x7f35f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f35ebfff640 1 -- 172.21.15.37:0/1025142881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8018070 con 0x7f36040d56b0 2024-05-10T08:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f35ebfff640 1 -- 172.21.15.37:0/1025142881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f8007500 con 0x7f36040d56b0 2024-05-10T08:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36040cf0a0 con 0x7f36040d56b0 2024-05-10T08:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f35ebfff640 1 -- 172.21.15.37:0/1025142881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8004a20 con 0x7f36040d56b0 2024-05-10T08:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.068+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36041f87d0 con 0x7f36040d56b0 2024-05-10T08:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.069+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36040693f0 con 0x7f36040d56b0 2024-05-10T08:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.070+0000 7f35ebfff640 1 -- 172.21.15.37:0/1025142881 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35f801b070 con 0x7f36040d56b0 2024-05-10T08:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.071+0000 7f35ebfff640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35f00762d0 0x7f35f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.071+0000 7f35ebfff640 1 -- 172.21.15.37:0/1025142881 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6001+0+0 (secure 0 0 0) 0x7f35f8096940 con 0x7f36040d56b0 2024-05-10T08:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.071+0000 7f36037fe640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35f00762d0 0x7f35f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.072+0000 7f36037fe640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35f00762d0 0x7f35f0078790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f35f4034000 tx=0x7f35f402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.075+0000 7f35ebfff640 1 -- 172.21.15.37:0/1025142881 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f35f805fbb0 con 0x7f36040d56b0 2024-05-10T08:47:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.303+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f36040d1bd0 con 0x7f36040d56b0 2024-05-10T08:47:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.928+0000 7f35ebfff640 1 -- 172.21.15.37:0/1025142881 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v77) ==== 174+0+0 (secure 0 0 0) 0x7f35f8063eb0 con 0x7f36040d56b0 2024-05-10T08:47:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 15 and data pool 16 2024-05-10T08:47:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35f00762d0 msgr2=0x7f35f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35f00762d0 0x7f35f0078790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f35f4034000 tx=0x7f35f402e000 comp rx=0 tx=0).stop 2024-05-10T08:47:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36040d56b0 msgr2=0x7f36040cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36040d56b0 0x7f36040cc2b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c4d0 tx=0x7f35f800c990 comp rx=0 tx=0).stop 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 shutdown_connections 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f35f00762d0 0x7f35f0078790 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f360415f4e0 0x7f36040cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36040d56b0 0x7f36040cc2b0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 --2- 172.21.15.37:0/1025142881 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36040d3aa0 0x7f36041f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.930+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 >> 172.21.15.37:0/1025142881 conn(0x7f360408eac0 msgr2=0x7f360409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.931+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 shutdown_connections 2024-05-10T08:47:46.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:46.931+0000 7f3609f87640 1 -- 172.21.15.37:0/1025142881 wait complete. 2024-05-10T08:47:46.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:47:47.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.070+0000 7f4d4ca64640 1 Processor -- start 2024-05-10T08:47:47.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.070+0000 7f4d4ca64640 1 -- start start 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d4ca64640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4d4815f100 0x7f4d480d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d4ca64640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d48162c60 0x7f4d481630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d4ca64640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d480d2c80 con 0x7f4d480d5bc0 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d4ca64640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4d480d35b0 con 0x7f4d48162c60 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d4ca64640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4d48163630 con 0x7f4d4815f100 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d46d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d48162c60 0x7f4d481630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d46d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d48162c60 0x7f4d481630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58108/0 (socket says 172.21.15.37:58108) 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d46d9d640 1 -- 172.21.15.37:0/487761019 learned_addr learned my addr 172.21.15.37:0/487761019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.071+0000 7f4d4659c640 1 --2- 172.21.15.37:0/487761019 >> v2:172.21.15.82:3300/0 conn(0x7f4d4815f100 0x7f4d480d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.072+0000 7f4d46d9d640 1 -- 172.21.15.37:0/487761019 >> v2:172.21.15.82:3300/0 conn(0x7f4d4815f100 msgr2=0x7f4d480d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:47.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.072+0000 7f4d46d9d640 1 --2- 172.21.15.37:0/487761019 >> v2:172.21.15.82:3300/0 conn(0x7f4d4815f100 0x7f4d480d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.072+0000 7f4d46d9d640 1 -- 172.21.15.37:0/487761019 >> v1:172.21.15.82:6789/0 conn(0x7f4d480d5bc0 legacy=0x7f4d480d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.072+0000 7f4d46d9d640 1 -- 172.21.15.37:0/487761019 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d480d2f60 con 0x7f4d48162c60 2024-05-10T08:47:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.072+0000 7f4d46d9d640 1 --2- 172.21.15.37:0/487761019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d48162c60 0x7f4d481630f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009e50 tx=0x7f4d4002a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2639acf2902f0f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.072+0000 7f4d4559a640 1 -- 172.21.15.37:0/487761019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40036070 con 0x7f4d48162c60 2024-05-10T08:47:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4559a640 1 -- 172.21.15.37:0/487761019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d40031600 con 0x7f4d48162c60 2024-05-10T08:47:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4559a640 1 -- 172.21.15.37:0/487761019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400319d0 con 0x7f4d48162c60 2024-05-10T08:47:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 -- 172.21.15.37:0/487761019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d48162c60 msgr2=0x7f4d481630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/487761019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d48162c60 0x7f4d481630f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009e50 tx=0x7f4d4002a7f0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 -- 172.21.15.37:0/487761019 shutdown_connections 2024-05-10T08:47:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/487761019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d48162c60 0x7f4d481630f0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/487761019 >> v2:172.21.15.82:3300/0 conn(0x7f4d4815f100 0x7f4d480d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 -- 172.21.15.37:0/487761019 >> 172.21.15.37:0/487761019 conn(0x7f4d4809e3e0 msgr2=0x7f4d480d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 -- 172.21.15.37:0/487761019 shutdown_connections 2024-05-10T08:47:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.073+0000 7f4d4ca64640 1 -- 172.21.15.37:0/487761019 wait complete. 2024-05-10T08:47:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.074+0000 7f4d4ca64640 1 Processor -- start 2024-05-10T08:47:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4ca64640 1 -- start start 2024-05-10T08:47:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4ca64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d480d5bc0 0x7f4d480cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4ca64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4815f100 0x7f4d481539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4ca64640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d48162c60 0x7f4d480c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4ca64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480d0d20 con 0x7f4d480d5bc0 2024-05-10T08:47:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4ca64640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480d1030 con 0x7f4d4815f100 2024-05-10T08:47:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4ca64640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4815f4e0 con 0x7f4d48162c60 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d480d5bc0 0x7f4d480cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d480d5bc0 0x7f4d480cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58120/0 (socket says 172.21.15.37:58120) 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.075+0000 7f4d4659c640 1 -- 172.21.15.37:0/2491225780 learned_addr learned my addr 172.21.15.37:0/2491225780 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d46d9d640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d48162c60 0x7f4d480c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d45d9b640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4815f100 0x7f4d481539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4659c640 1 -- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d48162c60 msgr2=0x7f4d480c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4659c640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d48162c60 0x7f4d480c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4659c640 1 -- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4815f100 msgr2=0x7f4d481539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4659c640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4815f100 0x7f4d481539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4659c640 1 -- 172.21.15.37:0/2491225780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d480c9f60 con 0x7f4d480d5bc0 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d46d9d640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d48162c60 0x7f4d480c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4659c640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d480d5bc0 0x7f4d480cc0e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800e9e0 tx=0x7f4d3800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d36ffd640 1 -- 172.21.15.37:0/2491225780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38017070 con 0x7f4d480d5bc0 2024-05-10T08:47:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d36ffd640 1 -- 172.21.15.37:0/2491225780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3800c9d0 con 0x7f4d480d5bc0 2024-05-10T08:47:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d480b2990 con 0x7f4d480d5bc0 2024-05-10T08:47:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d36ffd640 1 -- 172.21.15.37:0/2491225780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800cdc0 con 0x7f4d480d5bc0 2024-05-10T08:47:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.076+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d480cc620 con 0x7f4d480d5bc0 2024-05-10T08:47:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.077+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d480693f0 con 0x7f4d480d5bc0 2024-05-10T08:47:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.078+0000 7f4d36ffd640 1 -- 172.21.15.37:0/2491225780 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d3801a070 con 0x7f4d480d5bc0 2024-05-10T08:47:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.078+0000 7f4d36ffd640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d28076300 0x7f4d280787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.078+0000 7f4d36ffd640 1 -- 172.21.15.37:0/2491225780 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6101+0+0 (secure 0 0 0) 0x7f4d38097ab0 con 0x7f4d480d5bc0 2024-05-10T08:47:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.078+0000 7f4d45d9b640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d28076300 0x7f4d280787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.079+0000 7f4d45d9b640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d28076300 0x7f4d280787c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4d480cb6c0 tx=0x7f4d3c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.083+0000 7f4d36ffd640 1 -- 172.21.15.37:0/2491225780 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4d38061310 con 0x7f4d480d5bc0 2024-05-10T08:47:47.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.277+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d4808f190 con 0x7f4d480d5bc0 2024-05-10T08:47:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.278+0000 7f4d36ffd640 1 -- 172.21.15.37:0/2491225780 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16837 (secure 0 0 0) 0x7f4d38060c10 con 0x7f4d480d5bc0 2024-05-10T08:47:47.278 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":102,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:47:46.304812+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:47:43.973480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T08:47:45.269524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d28076300 msgr2=0x7f4d280787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d28076300 0x7f4d280787c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4d480cb6c0 tx=0x7f4d3c009040 comp rx=0 tx=0).stop 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d480d5bc0 msgr2=0x7f4d480cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d480d5bc0 0x7f4d480cc0e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800e9e0 tx=0x7f4d3800eea0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 shutdown_connections 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4d28076300 0x7f4d280787c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4d48162c60 0x7f4d480c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4815f100 0x7f4d481539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 --2- 172.21.15.37:0/2491225780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d480d5bc0 0x7f4d480cc0e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 >> 172.21.15.37:0/2491225780 conn(0x7f4d4809e3e0 msgr2=0x7f4d480cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:47.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 shutdown_connections 2024-05-10T08:47:47.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.281+0000 7f4d4ca64640 1 -- 172.21.15.37:0/2491225780 wait complete. 2024-05-10T08:47:47.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:47:47.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.396+0000 7f18a59f2640 1 Processor -- start 2024-05-10T08:47:47.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.396+0000 7f18a59f2640 1 -- start start 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.396+0000 7f18a59f2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18a0071a00 0x7f18a0167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f18a59f2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a00d15c0 con 0x7f18a00d0590 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f18a59f2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a00d18a0 con 0x7f18a01606d0 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f18a59f2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f18a00d1b80 con 0x7f18a0071a00 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18a0071a00 0x7f18a0167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18a0071a00 0x7f18a0167c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58130/0 (socket says 172.21.15.37:58130) 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189e7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f18a00d0590 0x7f18a00ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34430/0 (socket says 172.21.15.37:34430) 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189f7fe640 1 -- 172.21.15.37:0/2788219206 learned_addr learned my addr 172.21.15.37:0/2788219206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189f7fe640 1 -- 172.21.15.37:0/2788219206 >> v1:172.21.15.82:6789/0 conn(0x7f18a01606d0 legacy=0x7f18a00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189f7fe640 1 -- 172.21.15.37:0/2788219206 >> v1:172.21.15.37:6789/0 conn(0x7f18a00d0590 legacy=0x7f18a00ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189f7fe640 1 -- 172.21.15.37:0/2788219206 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00704d0 con 0x7f18a0071a00 2024-05-10T08:47:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.397+0000 7f189dffb640 1 -- 172.21.15.37:0/2788219206 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247518396 0 0) 0x7f18a00d15c0 con 0x7f18a00d0590 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f189f7fe640 1 --2- 172.21.15.37:0/2788219206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0071a00 0x7f18a0167c60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1890009870 tx=0x7f189002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1f0bc52400ed18 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f189dffb640 1 -- 172.21.15.37:0/2788219206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890037070 con 0x7f18a0071a00 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f189dffb640 1 -- 172.21.15.37:0/2788219206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1890032440 con 0x7f18a0071a00 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f189dffb640 1 -- 172.21.15.37:0/2788219206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890032810 con 0x7f18a0071a00 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f18a59f2640 1 -- 172.21.15.37:0/2788219206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0071a00 msgr2=0x7f18a0167c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f18a59f2640 1 --2- 172.21.15.37:0/2788219206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0071a00 0x7f18a0167c60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1890009870 tx=0x7f189002a1e0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f18a59f2640 1 -- 172.21.15.37:0/2788219206 shutdown_connections 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f18a59f2640 1 --2- 172.21.15.37:0/2788219206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0071a00 0x7f18a0167c60 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.398+0000 7f18a59f2640 1 -- 172.21.15.37:0/2788219206 >> 172.21.15.37:0/2788219206 conn(0x7f18a00b49d0 msgr2=0x7f18a00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.399+0000 7f18a59f2640 1 -- 172.21.15.37:0/2788219206 shutdown_connections 2024-05-10T08:47:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.399+0000 7f18a59f2640 1 -- 172.21.15.37:0/2788219206 wait complete. 2024-05-10T08:47:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.400+0000 7f18a59f2640 1 Processor -- start 2024-05-10T08:47:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.400+0000 7f18a59f2640 1 -- start start 2024-05-10T08:47:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a0071a00 0x7f18a006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00d0590 0x7f18a00c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18a01606d0 0x7f18a015d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18a01681a0 con 0x7f18a00d0590 2024-05-10T08:47:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00b5710 con 0x7f18a0071a00 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f18a0168320 con 0x7f18a01606d0 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00d0590 0x7f18a00c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00d0590 0x7f18a00c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58132/0 (socket says 172.21.15.37:58132) 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 -- 172.21.15.37:0/4270913499 learned_addr learned my addr 172.21.15.37:0/4270913499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189effd640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a0071a00 0x7f18a006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189f7fe640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18a01606d0 0x7f18a015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 -- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18a01606d0 msgr2=0x7f18a015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18a01606d0 0x7f18a015d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 -- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a0071a00 msgr2=0x7f18a006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a0071a00 0x7f18a006edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 -- 172.21.15.37:0/4270913499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00c85e0 con 0x7f18a00d0590 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f189e7fc640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00d0590 0x7f18a00c80a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f188800c3c0 tx=0x7f188800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f1897fff640 1 -- 172.21.15.37:0/4270913499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18880074e0 con 0x7f18a00d0590 2024-05-10T08:47:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f1897fff640 1 -- 172.21.15.37:0/4270913499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18880047e0 con 0x7f18a00d0590 2024-05-10T08:47:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a00c8b40 con 0x7f18a00d0590 2024-05-10T08:47:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f1897fff640 1 -- 172.21.15.37:0/4270913499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888004bd0 con 0x7f18a00d0590 2024-05-10T08:47:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.401+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a0164f60 con 0x7f18a00d0590 2024-05-10T08:47:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.402+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a00693f0 con 0x7f18a00d0590 2024-05-10T08:47:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.403+0000 7f1897fff640 1 -- 172.21.15.37:0/4270913499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1888011070 con 0x7f18a00d0590 2024-05-10T08:47:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.404+0000 7f1897fff640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1880076300 0x7f18800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.404+0000 7f1897fff640 1 -- 172.21.15.37:0/4270913499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6101+0+0 (secure 0 0 0) 0x7f1888097340 con 0x7f18a00d0590 2024-05-10T08:47:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.404+0000 7f189effd640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1880076300 0x7f18800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.405+0000 7f189effd640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1880076300 0x7f18800787c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f18a0167d20 tx=0x7f1898009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.408+0000 7f1897fff640 1 -- 172.21.15.37:0/4270913499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f18a00c85e0 con 0x7f18a00d0590 2024-05-10T08:47:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.601+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18a015f850 con 0x7f18a00d0590 2024-05-10T08:47:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.603+0000 7f1897fff640 1 -- 172.21.15.37:0/4270913499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16837 (secure 0 0 0) 0x7f1888060b10 con 0x7f18a00d0590 2024-05-10T08:47:47.602 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:47.602 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":102,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:47:46.304812+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:47:43.973480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T08:47:45.269524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1880076300 msgr2=0x7f18800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1880076300 0x7f18800787c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f18a0167d20 tx=0x7f1898009040 comp rx=0 tx=0).stop 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00d0590 msgr2=0x7f18a00c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00d0590 0x7f18a00c80a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f188800c3c0 tx=0x7f188800c880 comp rx=0 tx=0).stop 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 shutdown_connections 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1880076300 0x7f18800787c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f18a01606d0 0x7f18a015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00d0590 0x7f18a00c80a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 --2- 172.21.15.37:0/4270913499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a0071a00 0x7f18a006edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 >> 172.21.15.37:0/4270913499 conn(0x7f18a00b49d0 msgr2=0x7f18a015f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:47.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 shutdown_connections 2024-05-10T08:47:47.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.605+0000 7f18a59f2640 1 -- 172.21.15.37:0/4270913499 wait complete. 2024-05-10T08:47:47.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:47:47.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.723+0000 7fc182319640 1 Processor -- start 2024-05-10T08:47:47.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.723+0000 7fc182319640 1 -- start start 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc182319640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc17c06e0f0 0x7fc17c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc182319640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c072840 0x7fc17c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc182319640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17c0d14b0 con 0x7fc17c06e4d0 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc182319640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc17c15c920 con 0x7fc17c06e0f0 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc182319640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc17c15cc00 con 0x7fc17c072840 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc1808b6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc17c06e4d0 0x7fc17c0b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48654/0 (socket says 172.21.15.37:48654) 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc1808b6640 1 -- 172.21.15.37:0/449626932 learned_addr learned my addr 172.21.15.37:0/449626932 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc17bfff640 1 --2- 172.21.15.37:0/449626932 >> v2:172.21.15.82:3300/0 conn(0x7fc17c06e0f0 0x7fc17c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.724+0000 7fc17b7fe640 1 --2- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c072840 0x7fc17c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17affd640 1 -- 172.21.15.37:0/449626932 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710356545 0 0) 0x7fc17c0d14b0 con 0x7fc17c06e4d0 2024-05-10T08:47:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17affd640 1 -- 172.21.15.37:0/449626932 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc164003520 con 0x7fc17c06e4d0 2024-05-10T08:47:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17bfff640 1 -- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c072840 msgr2=0x7fc17c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17bfff640 1 --2- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c072840 0x7fc17c0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17bfff640 1 -- 172.21.15.37:0/449626932 >> v1:172.21.15.37:6789/0 conn(0x7fc17c06e4d0 legacy=0x7fc17c0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17affd640 1 -- 172.21.15.37:0/449626932 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4122452892 0 0) 0x7fc164003520 con 0x7fc17c06e4d0 2024-05-10T08:47:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17bfff640 1 -- 172.21.15.37:0/449626932 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c15cee0 con 0x7fc17c06e0f0 2024-05-10T08:47:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.725+0000 7fc17b7fe640 1 --2- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c072840 0x7fc17c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:47.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc17bfff640 1 --2- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e0f0 0x7fc17c15c340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0097a0 tx=0x7fc16c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e44b53908c3904 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc17affd640 1 -- 172.21.15.37:0/449626932 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c037070 con 0x7fc17c06e0f0 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc17affd640 1 -- 172.21.15.37:0/449626932 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c02aba0 con 0x7fc17c06e0f0 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc17affd640 1 -- 172.21.15.37:0/449626932 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740019f0 con 0x7fc17c06e0f0 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 -- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e0f0 msgr2=0x7fc17c15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 --2- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e0f0 0x7fc17c15c340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0097a0 tx=0x7fc16c02a110 comp rx=0 tx=0).stop 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 -- 172.21.15.37:0/449626932 shutdown_connections 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 --2- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c072840 0x7fc17c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 --2- 172.21.15.37:0/449626932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e0f0 0x7fc17c15c340 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 -- 172.21.15.37:0/449626932 >> 172.21.15.37:0/449626932 conn(0x7fc17c06c3a0 msgr2=0x7fc17c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 -- 172.21.15.37:0/449626932 shutdown_connections 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.726+0000 7fc182319640 1 -- 172.21.15.37:0/449626932 wait complete. 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 Processor -- start 2024-05-10T08:47:47.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 -- start start 2024-05-10T08:47:47.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c06e0f0 0x7fc17c14a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e4d0 0x7fc17c09ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17c072840 0x7fc17c1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c0ae650 con 0x7fc17c072840 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c06e980 con 0x7fc17c06e4d0 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.728+0000 7fc182319640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc17c0ae7d0 con 0x7fc17c06e0f0 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17c072840 0x7fc17c1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17c072840 0x7fc17c1482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58890/0 (socket says 172.21.15.37:58890) 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 -- 172.21.15.37:0/2925333999 learned_addr learned my addr 172.21.15.37:0/2925333999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc17bfff640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c06e0f0 0x7fc17c14a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc17b7fe640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e4d0 0x7fc17c09ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 -- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c06e0f0 msgr2=0x7fc17c14a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c06e0f0 0x7fc17c14a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 -- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e4d0 msgr2=0x7fc17c09ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e4d0 0x7fc17c09ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 -- 172.21.15.37:0/2925333999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c148a30 con 0x7fc17c072840 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc1808b6640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17c072840 0x7fc17c1482e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc174001b60 tx=0x7fc17400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc178ff9640 1 -- 172.21.15.37:0/2925333999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174017070 con 0x7fc17c072840 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc178ff9640 1 -- 172.21.15.37:0/2925333999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc174012400 con 0x7fc17c072840 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c148d10 con 0x7fc17c072840 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc178ff9640 1 -- 172.21.15.37:0/2925333999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740127b0 con 0x7fc17c072840 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.729+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1492d0 con 0x7fc17c072840 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.730+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c0693f0 con 0x7fc17c072840 2024-05-10T08:47:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.731+0000 7fc178ff9640 1 -- 172.21.15.37:0/2925333999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc17401a070 con 0x7fc17c072840 2024-05-10T08:47:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.732+0000 7fc178ff9640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1680762d0 0x7fc168078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.732+0000 7fc178ff9640 1 -- 172.21.15.37:0/2925333999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6101+0+0 (secure 0 0 0) 0x7fc1740975d0 con 0x7fc17c072840 2024-05-10T08:47:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.732+0000 7fc17bfff640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1680762d0 0x7fc168078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.732+0000 7fc17bfff640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1680762d0 0x7fc168078790 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc16c034000 tx=0x7fc16c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.736+0000 7fc178ff9640 1 -- 172.21.15.37:0/2925333999 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc174060750 con 0x7fc17c072840 2024-05-10T08:47:47.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:47.968+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc17c06fc70 con 0x7fc17c072840 2024-05-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.951+0000 7fc178ff9640 1 -- 172.21.15.37:0/2925333999 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) ==== 118+0+0 (secure 0 0 0) 0x7fc174064a50 con 0x7fc17c072840 2024-05-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1680762d0 msgr2=0x7fc168078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1680762d0 0x7fc168078790 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc16c034000 tx=0x7fc16c02e000 comp rx=0 tx=0).stop 2024-05-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17c072840 msgr2=0x7fc17c1482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17c072840 0x7fc17c1482e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc174001b60 tx=0x7fc17400a430 comp rx=0 tx=0).stop 2024-05-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 shutdown_connections 2024-05-10T08:47:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc1680762d0 0x7fc168078790 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17c072840 0x7fc17c1482e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc17c06e4d0 0x7fc17c09ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 --2- 172.21.15.37:0/2925333999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc17c06e0f0 0x7fc17c14a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 >> 172.21.15.37:0/2925333999 conn(0x7fc17c06c3a0 msgr2=0x7fc17c072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 shutdown_connections 2024-05-10T08:47:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:48.954+0000 7fc182319640 1 -- 172.21.15.37:0/2925333999 wait complete. 2024-05-10T08:47:48.966 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T08:47:48.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:47:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.081+0000 7fb432789640 1 Processor -- start 2024-05-10T08:47:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.081+0000 7fb432789640 1 -- start start 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.081+0000 7fb432789640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb42c06e0f0 0x7fb42c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.081+0000 7fb432789640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb42c072840 0x7fb42c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.081+0000 7fb432789640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb42c0d14b0 con 0x7fb42c06e4d0 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.081+0000 7fb432789640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb42c15c920 con 0x7fb42c072840 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.081+0000 7fb432789640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb42c15cc00 con 0x7fb42c06e0f0 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb42b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb42c072840 0x7fb42c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb430d26640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb42c06e4d0 0x7fb42c0b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48662/0 (socket says 172.21.15.37:48662) 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb430d26640 1 -- 172.21.15.37:0/1078727390 learned_addr learned my addr 172.21.15.37:0/1078727390 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb42bfff640 1 --2- 172.21.15.37:0/1078727390 >> v2:172.21.15.82:3300/0 conn(0x7fb42c06e0f0 0x7fb42c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb42b7fe640 1 -- 172.21.15.37:0/1078727390 >> v2:172.21.15.82:3300/0 conn(0x7fb42c06e0f0 msgr2=0x7fb42c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb42b7fe640 1 --2- 172.21.15.37:0/1078727390 >> v2:172.21.15.82:3300/0 conn(0x7fb42c06e0f0 0x7fb42c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb42b7fe640 1 -- 172.21.15.37:0/1078727390 >> v1:172.21.15.37:6789/0 conn(0x7fb42c06e4d0 legacy=0x7fb42c0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb42affd640 1 -- 172.21.15.37:0/1078727390 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036545542 0 0) 0x7fb42c0d14b0 con 0x7fb42c06e4d0 2024-05-10T08:47:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.082+0000 7fb42b7fe640 1 -- 172.21.15.37:0/1078727390 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c15cee0 con 0x7fb42c072840 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.083+0000 7fb42b7fe640 1 --2- 172.21.15.37:0/1078727390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0d0f70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0d1cf0 tx=0x7fb42002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b1e78124e59dd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.083+0000 7fb42affd640 1 -- 172.21.15.37:0/1078727390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420037070 con 0x7fb42c072840 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.083+0000 7fb42affd640 1 -- 172.21.15.37:0/1078727390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb420032440 con 0x7fb42c072840 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.083+0000 7fb42affd640 1 -- 172.21.15.37:0/1078727390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420032810 con 0x7fb42c072840 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.083+0000 7fb432789640 1 -- 172.21.15.37:0/1078727390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 msgr2=0x7fb42c0d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.083+0000 7fb432789640 1 --2- 172.21.15.37:0/1078727390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0d0f70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0d1cf0 tx=0x7fb42002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.084+0000 7fb432789640 1 -- 172.21.15.37:0/1078727390 shutdown_connections 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.084+0000 7fb432789640 1 --2- 172.21.15.37:0/1078727390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0d0f70 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.084+0000 7fb432789640 1 --2- 172.21.15.37:0/1078727390 >> v2:172.21.15.82:3300/0 conn(0x7fb42c06e0f0 0x7fb42c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.084+0000 7fb432789640 1 -- 172.21.15.37:0/1078727390 >> 172.21.15.37:0/1078727390 conn(0x7fb42c06c3a0 msgr2=0x7fb42c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:49.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.084+0000 7fb432789640 1 -- 172.21.15.37:0/1078727390 shutdown_connections 2024-05-10T08:47:49.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.084+0000 7fb432789640 1 -- 172.21.15.37:0/1078727390 wait complete. 2024-05-10T08:47:49.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.085+0000 7fb432789640 1 Processor -- start 2024-05-10T08:47:49.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.085+0000 7fb432789640 1 -- start start 2024-05-10T08:47:49.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb432789640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42c06e0f0 0x7fb42c1f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:49.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb432789640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb42c06e4d0 0x7fb42c148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:49.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb432789640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:49.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb432789640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0ae650 con 0x7fb42c072840 2024-05-10T08:47:49.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb432789640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c06e960 con 0x7fb42c06e0f0 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb432789640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c0ae7d0 con 0x7fb42c06e4d0 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58906/0 (socket says 172.21.15.37:58906) 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 -- 172.21.15.37:0/2703012074 learned_addr learned my addr 172.21.15.37:0/2703012074 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb42bfff640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42c06e0f0 0x7fb42c1f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb42b7fe640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb42c06e4d0 0x7fb42c148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 -- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb42c06e4d0 msgr2=0x7fb42c148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb42c06e4d0 0x7fb42c148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 -- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42c06e0f0 msgr2=0x7fb42c1f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42c06e0f0 0x7fb42c1f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 -- 172.21.15.37:0/2703012074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c0cdb10 con 0x7fb42c072840 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.086+0000 7fb430d26640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0cf2a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb42400ead0 tx=0x7fb42400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.087+0000 7fb428ff9640 1 -- 172.21.15.37:0/2703012074 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424004d70 con 0x7fb42c072840 2024-05-10T08:47:49.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.087+0000 7fb428ff9640 1 -- 172.21.15.37:0/2703012074 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb424016020 con 0x7fb42c072840 2024-05-10T08:47:49.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.087+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c0cddf0 con 0x7fb42c072840 2024-05-10T08:47:49.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.087+0000 7fb428ff9640 1 -- 172.21.15.37:0/2703012074 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42400cc10 con 0x7fb42c072840 2024-05-10T08:47:49.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.087+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c0ce3b0 con 0x7fb42c072840 2024-05-10T08:47:49.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.088+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c0693f0 con 0x7fb42c072840 2024-05-10T08:47:49.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.088+0000 7fb428ff9640 1 -- 172.21.15.37:0/2703012074 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4240070d0 con 0x7fb42c072840 2024-05-10T08:47:49.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.089+0000 7fb428ff9640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb4180762d0 0x7fb418078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:49.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.089+0000 7fb428ff9640 1 -- 172.21.15.37:0/2703012074 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fb424099cf0 con 0x7fb42c072840 2024-05-10T08:47:49.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.089+0000 7fb42bfff640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb4180762d0 0x7fb418078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:49.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.089+0000 7fb42bfff640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb4180762d0 0x7fb418078790 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009b40 tx=0x7fb41c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:49.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.093+0000 7fb428ff9640 1 -- 172.21.15.37:0/2703012074 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb42409e070 con 0x7fb42c072840 2024-05-10T08:47:49.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.322+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb42c152b20 con 0x7fb42c072840 2024-05-10T08:47:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.957+0000 7fb428ff9640 1 -- 172.21.15.37:0/2703012074 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v81) ==== 122+0+0 (secure 0 0 0) 0x7fb424020030 con 0x7fb42c072840 2024-05-10T08:47:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb4180762d0 msgr2=0x7fb418078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb4180762d0 0x7fb418078790 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009b40 tx=0x7fb41c009190 comp rx=0 tx=0).stop 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 msgr2=0x7fb42c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0cf2a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb42400ead0 tx=0x7fb42400ef90 comp rx=0 tx=0).stop 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 shutdown_connections 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb4180762d0 0x7fb418078790 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb42c072840 0x7fb42c0cf2a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb42c06e4d0 0x7fb42c148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 --2- 172.21.15.37:0/2703012074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42c06e0f0 0x7fb42c1f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.959+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 >> 172.21.15.37:0/2703012074 conn(0x7fb42c06c3a0 msgr2=0x7fb42c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.960+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 shutdown_connections 2024-05-10T08:47:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:49.960+0000 7fb432789640 1 -- 172.21.15.37:0/2703012074 wait complete. 2024-05-10T08:47:49.972 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:47:49.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.082+0000 7f5e8bccc640 1 Processor -- start 2024-05-10T08:47:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.082+0000 7f5e8bccc640 1 -- start start 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e8bccc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e840d20c0 0x7f5e84163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e8bccc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e84071110 0x7f5e8406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e8bccc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e840d1300 con 0x7f5e84070d30 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e8bccc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5e840d10d0 con 0x7f5e840d20c0 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e8bccc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5e84070b80 con 0x7f5e84071110 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e89267640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e840d20c0 0x7f5e84163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e89267640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e840d20c0 0x7f5e84163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58922/0 (socket says 172.21.15.37:58922) 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.083+0000 7f5e89267640 1 -- 172.21.15.37:0/29746187 learned_addr learned my addr 172.21.15.37:0/29746187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.084+0000 7f5e8a269640 1 --2- 172.21.15.37:0/29746187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e84071110 0x7f5e8406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.084+0000 7f5e89267640 1 -- 172.21.15.37:0/29746187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e84071110 msgr2=0x7f5e8406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.084+0000 7f5e89267640 1 --2- 172.21.15.37:0/29746187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e84071110 0x7f5e8406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.084+0000 7f5e89267640 1 -- 172.21.15.37:0/29746187 >> v1:172.21.15.82:6789/0 conn(0x7f5e84070d30 legacy=0x7f5e840703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.084+0000 7f5e89267640 1 -- 172.21.15.37:0/29746187 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840d15e0 con 0x7f5e840d20c0 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.084+0000 7f5e89267640 1 --2- 172.21.15.37:0/29746187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e840d20c0 0x7f5e84163920 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009870 tx=0x7f5e7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8a772246fdd6d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e88a66640 1 -- 172.21.15.37:0/29746187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74037070 con 0x7f5e840d20c0 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e88a66640 1 -- 172.21.15.37:0/29746187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e74032440 con 0x7f5e840d20c0 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e88a66640 1 -- 172.21.15.37:0/29746187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74032810 con 0x7f5e840d20c0 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 -- 172.21.15.37:0/29746187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e840d20c0 msgr2=0x7f5e84163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/29746187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e840d20c0 0x7f5e84163920 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009870 tx=0x7f5e7402a270 comp rx=0 tx=0).stop 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 -- 172.21.15.37:0/29746187 shutdown_connections 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/29746187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e84071110 0x7f5e8406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/29746187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e840d20c0 0x7f5e84163920 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 -- 172.21.15.37:0/29746187 >> 172.21.15.37:0/29746187 conn(0x7f5e840d2e90 msgr2=0x7f5e840d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:50.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 -- 172.21.15.37:0/29746187 shutdown_connections 2024-05-10T08:47:50.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.085+0000 7f5e8bccc640 1 -- 172.21.15.37:0/29746187 wait complete. 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 Processor -- start 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 -- start start 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e84070d30 0x7f5e841f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84071110 0x7f5e841f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e840d20c0 0x7f5e840cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84071560 con 0x7f5e84070d30 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840d1c30 con 0x7f5e84071110 2024-05-10T08:47:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.087+0000 7f5e8bccc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5e840716e0 con 0x7f5e840d20c0 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e84070d30 0x7f5e841f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e84070d30 0x7f5e841f6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58932/0 (socket says 172.21.15.37:58932) 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 -- 172.21.15.37:0/932398969 learned_addr learned my addr 172.21.15.37:0/932398969 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e8a269640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e840d20c0 0x7f5e840cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89267640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84071110 0x7f5e841f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 -- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e840d20c0 msgr2=0x7f5e840cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e840d20c0 0x7f5e840cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 -- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84071110 msgr2=0x7f5e841f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84071110 0x7f5e841f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 -- 172.21.15.37:0/932398969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e841f6a90 con 0x7f5e84070d30 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89267640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84071110 0x7f5e841f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e89a68640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e84070d30 0x7f5e841f6d90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c3f0 tx=0x7f5e8000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e7a7fc640 1 -- 172.21.15.37:0/932398969 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e800052d0 con 0x7f5e84070d30 2024-05-10T08:47:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e7a7fc640 1 -- 172.21.15.37:0/932398969 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e80005490 con 0x7f5e84070d30 2024-05-10T08:47:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e7a7fc640 1 -- 172.21.15.37:0/932398969 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80007260 con 0x7f5e84070d30 2024-05-10T08:47:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e840ca880 con 0x7f5e84070d30 2024-05-10T08:47:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.088+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e840cae40 con 0x7f5e84070d30 2024-05-10T08:47:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.089+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e84161390 con 0x7f5e84070d30 2024-05-10T08:47:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.090+0000 7f5e7a7fc640 1 -- 172.21.15.37:0/932398969 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e80007400 con 0x7f5e84070d30 2024-05-10T08:47:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.091+0000 7f5e7a7fc640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5e680762d0 0x7f5e68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.091+0000 7f5e7a7fc640 1 -- 172.21.15.37:0/932398969 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f5e80096b60 con 0x7f5e84070d30 2024-05-10T08:47:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.091+0000 7f5e89267640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5e680762d0 0x7f5e68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.092+0000 7f5e89267640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5e680762d0 0x7f5e68078790 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5e74034000 tx=0x7f5e7402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.095+0000 7f5e7a7fc640 1 -- 172.21.15.37:0/932398969 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5e84161390 con 0x7f5e84070d30 2024-05-10T08:47:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.328+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e8406fc30 con 0x7f5e84070d30 2024-05-10T08:47:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.329+0000 7f5e7a7fc640 1 -- 172.21.15.37:0/932398969 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5180 (secure 0 0 0) 0x7f5e8406fc30 con 0x7f5e84070d30 2024-05-10T08:47:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:50.328 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7446,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:47:49.323413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/902568070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":902568070},{"type":"v1","addr":"172.21.15.82:6837","nonce":902568070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7455,"qdb_cluster":[7455]},"id":7}]} 2024-05-10T08:47:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 81 2024-05-10T08:47:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5e680762d0 msgr2=0x7f5e68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5e680762d0 0x7f5e68078790 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5e74034000 tx=0x7f5e7402e000 comp rx=0 tx=0).stop 2024-05-10T08:47:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e84070d30 msgr2=0x7f5e841f6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e84070d30 0x7f5e841f6d90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c3f0 tx=0x7f5e8000c8b0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 shutdown_connections 2024-05-10T08:47:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5e680762d0 0x7f5e68078790 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5e840d20c0 0x7f5e840cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84071110 0x7f5e841f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 --2- 172.21.15.37:0/932398969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e84070d30 0x7f5e841f6d90 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 >> 172.21.15.37:0/932398969 conn(0x7f5e840d2e90 msgr2=0x7f5e84160c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:50.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 shutdown_connections 2024-05-10T08:47:50.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.331+0000 7f5e8bccc640 1 -- 172.21.15.37:0/932398969 wait complete. 2024-05-10T08:47:50.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:47:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.446+0000 7f47c1989640 1 Processor -- start 2024-05-10T08:47:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.446+0000 7f47c1989640 1 -- start start 2024-05-10T08:47:50.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47c1989640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47bc1629b0 0x7f47bc06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47c1989640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc06e110 con 0x7f47bc0b2490 2024-05-10T08:47:50.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47c1989640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc06e3f0 con 0x7f47bc070d20 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47c1989640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc070a40 con 0x7f47bc1629b0 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47baffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47bc1629b0 0x7f47bc06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47ba7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47bc0b2490 0x7f47bc070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48668/0 (socket says 172.21.15.37:48668) 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47ba7fc640 1 -- 172.21.15.37:0/1024684603 learned_addr learned my addr 172.21.15.37:0/1024684603 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47baffd640 1 -- 172.21.15.37:0/1024684603 >> v1:172.21.15.82:6789/0 conn(0x7f47bc070d20 legacy=0x7f47bc0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47baffd640 1 -- 172.21.15.37:0/1024684603 >> v1:172.21.15.37:6789/0 conn(0x7f47bc0b2490 legacy=0x7f47bc070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47baffd640 1 -- 172.21.15.37:0/1024684603 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc06e6d0 con 0x7f47bc1629b0 2024-05-10T08:47:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.447+0000 7f47b9ffb640 1 -- 172.21.15.37:0/1024684603 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598359443 0 0) 0x7f47bc06e110 con 0x7f47bc0b2490 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.448+0000 7f47baffd640 1 --2- 172.21.15.37:0/1024684603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc1629b0 0x7f47bc06eed0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0097a0 tx=0x7f47ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c20262b54d40c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.448+0000 7f47b9ffb640 1 -- 172.21.15.37:0/1024684603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac037070 con 0x7f47bc1629b0 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.448+0000 7f47b9ffb640 1 -- 172.21.15.37:0/1024684603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac032440 con 0x7f47bc1629b0 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.448+0000 7f47b9ffb640 1 -- 172.21.15.37:0/1024684603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac032810 con 0x7f47bc1629b0 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.449+0000 7f47c1989640 1 -- 172.21.15.37:0/1024684603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc1629b0 msgr2=0x7f47bc06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.449+0000 7f47c1989640 1 --2- 172.21.15.37:0/1024684603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc1629b0 0x7f47bc06eed0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0097a0 tx=0x7f47ac02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.449+0000 7f47c1989640 1 -- 172.21.15.37:0/1024684603 shutdown_connections 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.449+0000 7f47c1989640 1 --2- 172.21.15.37:0/1024684603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc1629b0 0x7f47bc06eed0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.449+0000 7f47c1989640 1 -- 172.21.15.37:0/1024684603 >> 172.21.15.37:0/1024684603 conn(0x7f47bc0b49d0 msgr2=0x7f47bc0b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.449+0000 7f47c1989640 1 -- 172.21.15.37:0/1024684603 shutdown_connections 2024-05-10T08:47:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.449+0000 7f47c1989640 1 -- 172.21.15.37:0/1024684603 wait complete. 2024-05-10T08:47:50.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.450+0000 7f47c1989640 1 Processor -- start 2024-05-10T08:47:50.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.450+0000 7f47c1989640 1 -- start start 2024-05-10T08:47:50.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47c1989640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc070d20 0x7f47bc14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47c1989640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47bc0b2490 0x7f47bc161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47c1989640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc1629b0 0x7f47bc161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47c1989640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc06f410 con 0x7f47bc070d20 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47c1989640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc06dec0 con 0x7f47bc1629b0 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47c1989640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f47bc0b03c0 con 0x7f47bc0b2490 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc070d20 0x7f47bc14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc070d20 0x7f47bc14abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58942/0 (socket says 172.21.15.37:58942) 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 -- 172.21.15.37:0/1664805609 learned_addr learned my addr 172.21.15.37:0/1664805609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 -- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47bc0b2490 msgr2=0x7f47bc161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47bc0b2490 0x7f47bc161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 -- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc1629b0 msgr2=0x7f47bc161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc1629b0 0x7f47bc161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.451+0000 7f47baffd640 1 -- 172.21.15.37:0/1664805609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc1f8530 con 0x7f47bc070d20 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.452+0000 7f47baffd640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc070d20 0x7f47bc14abe0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f47ac000c00 tx=0x7f47ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.452+0000 7f47a3fff640 1 -- 172.21.15.37:0/1664805609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac037050 con 0x7f47bc070d20 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.452+0000 7f47a3fff640 1 -- 172.21.15.37:0/1664805609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac038040 con 0x7f47bc070d20 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.452+0000 7f47a3fff640 1 -- 172.21.15.37:0/1664805609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac004470 con 0x7f47bc070d20 2024-05-10T08:47:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.452+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc1f8810 con 0x7f47bc070d20 2024-05-10T08:47:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.452+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc1f8dd0 con 0x7f47bc070d20 2024-05-10T08:47:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.453+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc0693f0 con 0x7f47bc070d20 2024-05-10T08:47:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.454+0000 7f47a3fff640 1 -- 172.21.15.37:0/1664805609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47ac030980 con 0x7f47bc070d20 2024-05-10T08:47:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.454+0000 7f47a3fff640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47a80762d0 0x7f47a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.454+0000 7f47a3fff640 1 -- 172.21.15.37:0/1664805609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f47ac0b8340 con 0x7f47bc070d20 2024-05-10T08:47:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.454+0000 7f47ba7fc640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47a80762d0 0x7f47a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.455+0000 7f47ba7fc640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47a80762d0 0x7f47a8078790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f47b0007fd0 tx=0x7f47b0007920 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.458+0000 7f47a3fff640 1 -- 172.21.15.37:0/1664805609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f47ac081b10 con 0x7f47bc070d20 2024-05-10T08:47:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.651+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47bc15ca70 con 0x7f47bc070d20 2024-05-10T08:47:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.652+0000 7f47a3fff640 1 -- 172.21.15.37:0/1664805609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16824 (secure 0 0 0) 0x7f47ac081410 con 0x7f47bc070d20 2024-05-10T08:47:50.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:50.651 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":103,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:47:47.928981+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:47:43.973480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T08:47:45.269524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:47:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47a80762d0 msgr2=0x7f47a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47a80762d0 0x7f47a8078790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f47b0007fd0 tx=0x7f47b0007920 comp rx=0 tx=0).stop 2024-05-10T08:47:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc070d20 msgr2=0x7f47bc14abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc070d20 0x7f47bc14abe0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f47ac000c00 tx=0x7f47ac0046c0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 shutdown_connections 2024-05-10T08:47:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f47a80762d0 0x7f47a8078790 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc1629b0 0x7f47bc161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f47bc0b2490 0x7f47bc161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 --2- 172.21.15.37:0/1664805609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47bc070d20 0x7f47bc14abe0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 >> 172.21.15.37:0/1664805609 conn(0x7f47bc0b49d0 msgr2=0x7f47bc0d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 shutdown_connections 2024-05-10T08:47:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.654+0000 7f47c1989640 1 -- 172.21.15.37:0/1664805609 wait complete. 2024-05-10T08:47:50.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:47:50.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:47:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.769+0000 7ffabe6b0640 1 Processor -- start 2024-05-10T08:47:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.769+0000 7ffabe6b0640 1 -- start start 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffabe6b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffab815f380 0x7ffab80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffabe6b0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab80d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffabe6b0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab80d1760 con 0x7ffab80d3b00 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffabe6b0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ffab80d30f0 con 0x7ffab815f380 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffabe6b0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80d1150 con 0x7ffab80d0cf0 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffab815f380 0x7ffab80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffabcc4d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffab80d3b00 0x7ffab8162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48670/0 (socket says 172.21.15.37:48670) 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffabcc4d640 1 -- 172.21.15.37:0/408494307 learned_addr learned my addr 172.21.15.37:0/408494307 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab77fe640 1 --2- 172.21.15.37:0/408494307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab80d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab7fff640 1 -- 172.21.15.37:0/408494307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 msgr2=0x7ffab80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab7fff640 1 --2- 172.21.15.37:0/408494307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab80d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab7fff640 1 -- 172.21.15.37:0/408494307 >> v1:172.21.15.37:6789/0 conn(0x7ffab80d3b00 legacy=0x7ffab8162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab7fff640 1 -- 172.21.15.37:0/408494307 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80d1a40 con 0x7ffab815f380 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab6ffd640 1 -- 172.21.15.37:0/408494307 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309966629 0 0) 0x7ffab80d1760 con 0x7ffab80d3b00 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.770+0000 7ffab77fe640 1 --2- 172.21.15.37:0/408494307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab80d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.771+0000 7ffab7fff640 1 --2- 172.21.15.37:0/408494307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab815f380 0x7ffab80d07b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097a0 tx=0x7ffaa802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc7776fe1c78aaf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.771+0000 7ffab6ffd640 1 -- 172.21.15.37:0/408494307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8037070 con 0x7ffab815f380 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.771+0000 7ffab6ffd640 1 -- 172.21.15.37:0/408494307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa8032440 con 0x7ffab815f380 2024-05-10T08:47:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.771+0000 7ffab6ffd640 1 -- 172.21.15.37:0/408494307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8032810 con 0x7ffab815f380 2024-05-10T08:47:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 -- 172.21.15.37:0/408494307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab815f380 msgr2=0x7ffab80d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/408494307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab815f380 0x7ffab80d07b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097a0 tx=0x7ffaa802a180 comp rx=0 tx=0).stop 2024-05-10T08:47:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 -- 172.21.15.37:0/408494307 shutdown_connections 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/408494307 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab80d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/408494307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab815f380 0x7ffab80d07b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 -- 172.21.15.37:0/408494307 >> 172.21.15.37:0/408494307 conn(0x7ffab80d4fe0 msgr2=0x7ffab80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 -- 172.21.15.37:0/408494307 shutdown_connections 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.772+0000 7ffabe6b0640 1 -- 172.21.15.37:0/408494307 wait complete. 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.773+0000 7ffabe6b0640 1 Processor -- start 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.773+0000 7ffabe6b0640 1 -- start start 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffabe6b0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab809ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffabe6b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab80d3b00 0x7ffab81f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffabe6b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab815f380 0x7ffab80a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffabe6b0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80b8e40 con 0x7ffab80d3b00 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffabe6b0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80d2370 con 0x7ffab815f380 2024-05-10T08:47:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffabe6b0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80d2000 con 0x7ffab80d0cf0 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab80d3b00 0x7ffab81f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab80d3b00 0x7ffab81f8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58962/0 (socket says 172.21.15.37:58962) 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 -- 172.21.15.37:0/2028000190 learned_addr learned my addr 172.21.15.37:0/2028000190 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 -- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 msgr2=0x7ffab809ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab809ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 -- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab815f380 msgr2=0x7ffab80a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab815f380 0x7ffab80a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 -- 172.21.15.37:0/2028000190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80a0780 con 0x7ffab80d3b00 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab77fe640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab80d3b00 0x7ffab81f8060 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c7f0 tx=0x7ffaac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.774+0000 7ffab4ff9640 1 -- 172.21.15.37:0/2028000190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac015070 con 0x7ffab80d3b00 2024-05-10T08:47:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.775+0000 7ffab4ff9640 1 -- 172.21.15.37:0/2028000190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaac007a30 con 0x7ffab80d3b00 2024-05-10T08:47:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.775+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab80a0a60 con 0x7ffab80d3b00 2024-05-10T08:47:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.775+0000 7ffab4ff9640 1 -- 172.21.15.37:0/2028000190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac007e00 con 0x7ffab80d3b00 2024-05-10T08:47:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.775+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab80a1020 con 0x7ffab80d3b00 2024-05-10T08:47:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.776+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab80693f0 con 0x7ffab80d3b00 2024-05-10T08:47:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.776+0000 7ffab4ff9640 1 -- 172.21.15.37:0/2028000190 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffaac018070 con 0x7ffab80d3b00 2024-05-10T08:47:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.777+0000 7ffab4ff9640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffaa40762d0 0x7ffaa4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.777+0000 7ffab4ff9640 1 -- 172.21.15.37:0/2028000190 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7ffaac097770 con 0x7ffab80d3b00 2024-05-10T08:47:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.777+0000 7ffab7fff640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffaa40762d0 0x7ffaa4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.777+0000 7ffab7fff640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffaa40762d0 0x7ffaa4078790 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8034000 tx=0x7ffaa802c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.781+0000 7ffab4ff9640 1 -- 172.21.15.37:0/2028000190 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ffaac060eb0 con 0x7ffab80d3b00 2024-05-10T08:47:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.968+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffab8163d40 con 0x7ffaa40762d0 2024-05-10T08:47:50.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.975+0000 7ffab4ff9640 1 -- 172.21.15.37:0/2028000190 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240281 (secure 0 0 0) 0x7ffab8163d40 con 0x7ffaa40762d0 2024-05-10T08:47:50.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:47:50.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffaa40762d0 msgr2=0x7ffaa4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffaa40762d0 0x7ffaa4078790 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8034000 tx=0x7ffaa802c000 comp rx=0 tx=0).stop 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab80d3b00 msgr2=0x7ffab81f8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab80d3b00 0x7ffab81f8060 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c7f0 tx=0x7ffaac00cbf0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 shutdown_connections 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffaa40762d0 0x7ffaa4078790 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab815f380 0x7ffab80a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffab80d3b00 0x7ffab81f8060 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 --2- 172.21.15.37:0/2028000190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffab80d0cf0 0x7ffab809ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 >> 172.21.15.37:0/2028000190 conn(0x7ffab80d4fe0 msgr2=0x7ffab80b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 shutdown_connections 2024-05-10T08:47:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:50.978+0000 7ffabe6b0640 1 -- 172.21.15.37:0/2028000190 wait complete. 2024-05-10T08:47:50.988 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-05-10T08:47:49.434969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260296,"kb_used_data":10832,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714424,"statfs":{"total":773094113280,"available":772827570176,"internally_reserved":0,"allocated":11091968,"data_stored":5741790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.512554"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924046+0000","last_change":"2024-05-10T08:47:44.924046+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924046+0000","last_undegraded":"2024-05-10T08:47:44.924046+0000","last_fullsized":"2024-05-10T08:47:44.924046+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926681+0000","last_change":"2024-05-10T08:47:44.926681+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926681+0000","last_undegraded":"2024-05-10T08:47:44.926681+0000","last_fullsized":"2024-05-10T08:47:44.926681+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924198+0000","last_change":"2024-05-10T08:47:44.924198+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924198+0000","last_undegraded":"2024-05-10T08:47:44.924198+0000","last_fullsized":"2024-05-10T08:47:44.924198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927906+0000","last_change":"2024-05-10T08:47:44.927906+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927906+0000","last_undegraded":"2024-05-10T08:47:44.927906+0000","last_fullsized":"2024-05-10T08:47:44.927906+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926663+0000","last_change":"2024-05-10T08:47:44.926663+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926663+0000","last_undegraded":"2024-05-10T08:47:44.926663+0000","last_fullsized":"2024-05-10T08:47:44.926663+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927323+0000","last_change":"2024-05-10T08:47:44.927323+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927323+0000","last_undegraded":"2024-05-10T08:47:44.927323+0000","last_fullsized":"2024-05-10T08:47:44.927323+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924090+0000","last_change":"2024-05-10T08:47:44.924090+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924090+0000","last_undegraded":"2024-05-10T08:47:44.924090+0000","last_fullsized":"2024-05-10T08:47:44.924090+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924130+0000","last_change":"2024-05-10T08:47:44.924130+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924130+0000","last_undegraded":"2024-05-10T08:47:44.924130+0000","last_fullsized":"2024-05-10T08:47:44.924130+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924089+0000","last_change":"2024-05-10T08:47:44.924089+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924089+0000","last_undegraded":"2024-05-10T08:47:44.924089+0000","last_fullsized":"2024-05-10T08:47:44.924089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.929808+0000","last_change":"2024-05-10T08:47:44.929808+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.929808+0000","last_undegraded":"2024-05-10T08:47:44.929808+0000","last_fullsized":"2024-05-10T08:47:44.929808+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926944+0000","last_change":"2024-05-10T08:47:44.926944+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926944+0000","last_undegraded":"2024-05-10T08:47:44.926944+0000","last_fullsized":"2024-05-10T08:47:44.926944+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926465+0000","last_change":"2024-05-10T08:47:44.926465+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926465+0000","last_undegraded":"2024-05-10T08:47:44.926465+0000","last_fullsized":"2024-05-10T08:47:44.926465+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926321+0000","last_change":"2024-05-10T08:47:44.926321+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926321+0000","last_undegraded":"2024-05-10T08:47:44.926321+0000","last_fullsized":"2024-05-10T08:47:44.926321+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924130+0000","last_change":"2024-05-10T08:47:44.924130+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924130+0000","last_undegraded":"2024-05-10T08:47:44.924130+0000","last_fullsized":"2024-05-10T08:47:44.924130+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926833+0000","last_change":"2024-05-10T08:47:44.926833+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926833+0000","last_undegraded":"2024-05-10T08:47:44.926833+0000","last_fullsized":"2024-05-10T08:47:44.926833+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924091+0000","last_change":"2024-05-10T08:47:44.924091+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924091+0000","last_undegraded":"2024-05-10T08:47:44.924091+0000","last_fullsized":"2024-05-10T08:47:44.924091+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927479+0000","last_change":"2024-05-10T08:47:44.927479+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927479+0000","last_undegraded":"2024-05-10T08:47:44.927479+0000","last_fullsized":"2024-05-10T08:47:44.927479+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926453+0000","last_change":"2024-05-10T08:47:44.926453+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926453+0000","last_undegraded":"2024-05-10T08:47:44.926453+0000","last_fullsized":"2024-05-10T08:47:44.926453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.930383+0000","last_change":"2024-05-10T08:47:44.930383+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.930383+0000","last_undegraded":"2024-05-10T08:47:44.930383+0000","last_fullsized":"2024-05-10T08:47:44.930383+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926938+0000","last_change":"2024-05-10T08:47:44.926938+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926938+0000","last_undegraded":"2024-05-10T08:47:44.926938+0000","last_fullsized":"2024-05-10T08:47:44.926938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.928243+0000","last_change":"2024-05-10T08:47:44.928243+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.928243+0000","last_undegraded":"2024-05-10T08:47:44.928243+0000","last_fullsized":"2024-05-10T08:47:44.928243+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926976+0000","last_change":"2024-05-10T08:47:44.926976+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926976+0000","last_undegraded":"2024-05-10T08:47:44.926976+0000","last_fullsized":"2024-05-10T08:47:44.926976+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926705+0000","last_change":"2024-05-10T08:47:44.926705+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926705+0000","last_undegraded":"2024-05-10T08:47:44.926705+0000","last_fullsized":"2024-05-10T08:47:44.926705+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927256+0000","last_change":"2024-05-10T08:47:44.927256+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927256+0000","last_undegraded":"2024-05-10T08:47:44.927256+0000","last_fullsized":"2024-05-10T08:47:44.927256+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.929334+0000","last_change":"2024-05-10T08:47:44.929334+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.929334+0000","last_undegraded":"2024-05-10T08:47:44.929334+0000","last_fullsized":"2024-05-10T08:47:44.929334+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927468+0000","last_change":"2024-05-10T08:47:44.927468+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927468+0000","last_undegraded":"2024-05-10T08:47:44.927468+0000","last_fullsized":"2024-05-10T08:47:44.927468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926344+0000","last_change":"2024-05-10T08:47:44.926344+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926344+0000","last_undegraded":"2024-05-10T08:47:44.926344+0000","last_fullsized":"2024-05-10T08:47:44.926344+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924089+0000","last_change":"2024-05-10T08:47:44.924089+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924089+0000","last_undegraded":"2024-05-10T08:47:44.924089+0000","last_fullsized":"2024-05-10T08:47:44.924089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927003+0000","last_change":"2024-05-10T08:47:44.927003+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927003+0000","last_undegraded":"2024-05-10T08:47:44.927003+0000","last_fullsized":"2024-05-10T08:47:44.927003+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926453+0000","last_change":"2024-05-10T08:47:44.926453+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926453+0000","last_undegraded":"2024-05-10T08:47:44.926453+0000","last_fullsized":"2024-05-10T08:47:44.926453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926104+0000","last_change":"2024-05-10T08:47:44.926104+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926104+0000","last_undegraded":"2024-05-10T08:47:44.926104+0000","last_fullsized":"2024-05-10T08:47:44.926104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926180+0000","last_change":"2024-05-10T08:47:44.926180+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926180+0000","last_undegraded":"2024-05-10T08:47:44.926180+0000","last_fullsized":"2024-05-10T08:47:44.926180+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":259,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-10T08:47:44.928217+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:47:44.928217+0000","last_peered":"2024-05-10T08:47:44.928217+0000","last_clean":"2024-05-10T08:47:44.928217+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:47:44.928217+0000","last_undegraded":"2024-05-10T08:47:44.928217+0000","last_fullsized":"2024-05-10T08:47:44.928217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1162052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":565475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":565475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1162052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:47:50.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:47:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.132+0000 7f76ea4e1640 1 Processor -- start 2024-05-10T08:47:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.133+0000 7f76ea4e1640 1 -- start start 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.133+0000 7f76ea4e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.133+0000 7f76ea4e1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76e40d2ce0 0x7f76e40d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.133+0000 7f76ea4e1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e40718c0 con 0x7f76e4070b90 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.133+0000 7f76ea4e1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f76e40afba0 con 0x7f76e40d2ce0 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.133+0000 7f76ea4e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f76e4071ba0 con 0x7f76e415ccb0 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e8a7e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f76e4070b90 0x7f76e4071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48674/0 (socket says 172.21.15.37:48674) 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e8a7e640 1 -- 172.21.15.37:0/1048147708 learned_addr learned my addr 172.21.15.37:0/1048147708 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e37fe640 1 --2- 172.21.15.37:0/1048147708 >> v2:172.21.15.82:3300/0 conn(0x7f76e40d2ce0 0x7f76e40d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e3fff640 1 --2- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1048147708 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452095422 0 0) 0x7f76e40718c0 con 0x7f76e4070b90 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1048147708 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76cc003520 con 0x7f76e4070b90 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e37fe640 1 -- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 msgr2=0x7f76e415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e37fe640 1 --2- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e37fe640 1 -- 172.21.15.37:0/1048147708 >> v1:172.21.15.37:6789/0 conn(0x7f76e4070b90 legacy=0x7f76e4071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1048147708 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 317921437 0 0) 0x7f76cc003520 con 0x7f76e4070b90 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e37fe640 1 -- 172.21.15.37:0/1048147708 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e4071e80 con 0x7f76e40d2ce0 2024-05-10T08:47:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.134+0000 7f76e3fff640 1 --2- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.135+0000 7f76e37fe640 1 --2- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e40d3120 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f76d80097d0 tx=0x7f76d802a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7027a8dbb6e0dd3c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.135+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1048147708 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8037070 con 0x7f76e40d2ce0 2024-05-10T08:47:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.135+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1048147708 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d802ab40 con 0x7f76e40d2ce0 2024-05-10T08:47:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.135+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1048147708 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0019f0 con 0x7f76e40d2ce0 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 -- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 msgr2=0x7f76e40d3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e40d3120 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f76d80097d0 tx=0x7f76d802a0b0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 -- 172.21.15.37:0/1048147708 shutdown_connections 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e40d3120 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/1048147708 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 -- 172.21.15.37:0/1048147708 >> 172.21.15.37:0/1048147708 conn(0x7f76e409ba40 msgr2=0x7f76e409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 -- 172.21.15.37:0/1048147708 shutdown_connections 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.136+0000 7f76ea4e1640 1 -- 172.21.15.37:0/1048147708 wait complete. 2024-05-10T08:47:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.137+0000 7f76ea4e1640 1 Processor -- start 2024-05-10T08:47:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.137+0000 7f76ea4e1640 1 -- start start 2024-05-10T08:47:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76ea4e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e4070b90 0x7f76e40c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76ea4e1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e406e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76ea4e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76ea4e1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76e40cf980 con 0x7f76e4070b90 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76ea4e1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f76e40d3660 con 0x7f76e40d2ce0 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76ea4e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f76e40cfb00 con 0x7f76e415ccb0 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e4070b90 0x7f76e40c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e4070b90 0x7f76e40c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58972/0 (socket says 172.21.15.37:58972) 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 -- 172.21.15.37:0/2561422528 learned_addr learned my addr 172.21.15.37:0/2561422528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e8a7e640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e37fe640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e406e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 -- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 msgr2=0x7f76e415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 -- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 msgr2=0x7f76e406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e406e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 -- 172.21.15.37:0/2561422528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e406ec20 con 0x7f76e4070b90 2024-05-10T08:47:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e37fe640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e406e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e3fff640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e4070b90 0x7f76e40c5770 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f76d400ebe0 tx=0x7f76d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.138+0000 7f76e0ff9640 1 -- 172.21.15.37:0/2561422528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4017070 con 0x7f76e4070b90 2024-05-10T08:47:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.139+0000 7f76e0ff9640 1 -- 172.21.15.37:0/2561422528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d400cc30 con 0x7f76e4070b90 2024-05-10T08:47:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.139+0000 7f76e0ff9640 1 -- 172.21.15.37:0/2561422528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4013470 con 0x7f76e4070b90 2024-05-10T08:47:51.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.139+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e40b3090 con 0x7f76e4070b90 2024-05-10T08:47:51.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.139+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e406e8e0 con 0x7f76e4070b90 2024-05-10T08:47:51.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.140+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e4069b00 con 0x7f76e4070b90 2024-05-10T08:47:51.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.140+0000 7f76e0ff9640 1 -- 172.21.15.37:0/2561422528 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f76d401a070 con 0x7f76e4070b90 2024-05-10T08:47:51.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.141+0000 7f76e0ff9640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f76d00762d0 0x7f76d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.141+0000 7f76e0ff9640 1 -- 172.21.15.37:0/2561422528 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f76d4097ac0 con 0x7f76e4070b90 2024-05-10T08:47:51.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.141+0000 7f76e37fe640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f76d00762d0 0x7f76d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.142+0000 7f76e37fe640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f76d00762d0 0x7f76d0078790 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76d8034000 tx=0x7f76d802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.145+0000 7f76e0ff9640 1 -- 172.21.15.37:0/2561422528 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f76d4061290 con 0x7f76e4070b90 2024-05-10T08:47:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.331+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76e415c280 con 0x7f76d00762d0 2024-05-10T08:47:51.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.337+0000 7f76e0ff9640 1 -- 172.21.15.37:0/2561422528 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240281 (secure 0 0 0) 0x7f76d807bab0 con 0x7f76d00762d0 2024-05-10T08:47:51.338 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:47:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f76d00762d0 msgr2=0x7f76d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f76d00762d0 0x7f76d0078790 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76d8034000 tx=0x7f76d802e000 comp rx=0 tx=0).stop 2024-05-10T08:47:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e4070b90 msgr2=0x7f76e40c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e4070b90 0x7f76e40c5770 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f76d400ebe0 tx=0x7f76d400c520 comp rx=0 tx=0).stop 2024-05-10T08:47:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 shutdown_connections 2024-05-10T08:47:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f76d00762d0 0x7f76d0078790 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76e415ccb0 0x7f76e415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76e40d2ce0 0x7f76e406e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 --2- 172.21.15.37:0/2561422528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e4070b90 0x7f76e40c5770 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 >> 172.21.15.37:0/2561422528 conn(0x7f76e409ba40 msgr2=0x7f76e40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 shutdown_connections 2024-05-10T08:47:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.340+0000 7f76ea4e1640 1 -- 172.21.15.37:0/2561422528 wait complete. 2024-05-10T08:47:51.350 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-05-10T08:47:49.434969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260296,"kb_used_data":10832,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714424,"statfs":{"total":773094113280,"available":772827570176,"internally_reserved":0,"allocated":11091968,"data_stored":5741790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.512554"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924046+0000","last_change":"2024-05-10T08:47:44.924046+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924046+0000","last_undegraded":"2024-05-10T08:47:44.924046+0000","last_fullsized":"2024-05-10T08:47:44.924046+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926681+0000","last_change":"2024-05-10T08:47:44.926681+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926681+0000","last_undegraded":"2024-05-10T08:47:44.926681+0000","last_fullsized":"2024-05-10T08:47:44.926681+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924198+0000","last_change":"2024-05-10T08:47:44.924198+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924198+0000","last_undegraded":"2024-05-10T08:47:44.924198+0000","last_fullsized":"2024-05-10T08:47:44.924198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927906+0000","last_change":"2024-05-10T08:47:44.927906+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927906+0000","last_undegraded":"2024-05-10T08:47:44.927906+0000","last_fullsized":"2024-05-10T08:47:44.927906+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926663+0000","last_change":"2024-05-10T08:47:44.926663+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926663+0000","last_undegraded":"2024-05-10T08:47:44.926663+0000","last_fullsized":"2024-05-10T08:47:44.926663+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927323+0000","last_change":"2024-05-10T08:47:44.927323+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927323+0000","last_undegraded":"2024-05-10T08:47:44.927323+0000","last_fullsized":"2024-05-10T08:47:44.927323+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924090+0000","last_change":"2024-05-10T08:47:44.924090+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924090+0000","last_undegraded":"2024-05-10T08:47:44.924090+0000","last_fullsized":"2024-05-10T08:47:44.924090+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924130+0000","last_change":"2024-05-10T08:47:44.924130+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924130+0000","last_undegraded":"2024-05-10T08:47:44.924130+0000","last_fullsized":"2024-05-10T08:47:44.924130+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924089+0000","last_change":"2024-05-10T08:47:44.924089+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924089+0000","last_undegraded":"2024-05-10T08:47:44.924089+0000","last_fullsized":"2024-05-10T08:47:44.924089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.929808+0000","last_change":"2024-05-10T08:47:44.929808+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.929808+0000","last_undegraded":"2024-05-10T08:47:44.929808+0000","last_fullsized":"2024-05-10T08:47:44.929808+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926944+0000","last_change":"2024-05-10T08:47:44.926944+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926944+0000","last_undegraded":"2024-05-10T08:47:44.926944+0000","last_fullsized":"2024-05-10T08:47:44.926944+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926465+0000","last_change":"2024-05-10T08:47:44.926465+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926465+0000","last_undegraded":"2024-05-10T08:47:44.926465+0000","last_fullsized":"2024-05-10T08:47:44.926465+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926321+0000","last_change":"2024-05-10T08:47:44.926321+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926321+0000","last_undegraded":"2024-05-10T08:47:44.926321+0000","last_fullsized":"2024-05-10T08:47:44.926321+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924130+0000","last_change":"2024-05-10T08:47:44.924130+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924130+0000","last_undegraded":"2024-05-10T08:47:44.924130+0000","last_fullsized":"2024-05-10T08:47:44.924130+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926833+0000","last_change":"2024-05-10T08:47:44.926833+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926833+0000","last_undegraded":"2024-05-10T08:47:44.926833+0000","last_fullsized":"2024-05-10T08:47:44.926833+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924091+0000","last_change":"2024-05-10T08:47:44.924091+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924091+0000","last_undegraded":"2024-05-10T08:47:44.924091+0000","last_fullsized":"2024-05-10T08:47:44.924091+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927479+0000","last_change":"2024-05-10T08:47:44.927479+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927479+0000","last_undegraded":"2024-05-10T08:47:44.927479+0000","last_fullsized":"2024-05-10T08:47:44.927479+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926453+0000","last_change":"2024-05-10T08:47:44.926453+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926453+0000","last_undegraded":"2024-05-10T08:47:44.926453+0000","last_fullsized":"2024-05-10T08:47:44.926453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.930383+0000","last_change":"2024-05-10T08:47:44.930383+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.930383+0000","last_undegraded":"2024-05-10T08:47:44.930383+0000","last_fullsized":"2024-05-10T08:47:44.930383+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926938+0000","last_change":"2024-05-10T08:47:44.926938+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926938+0000","last_undegraded":"2024-05-10T08:47:44.926938+0000","last_fullsized":"2024-05-10T08:47:44.926938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.928243+0000","last_change":"2024-05-10T08:47:44.928243+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.928243+0000","last_undegraded":"2024-05-10T08:47:44.928243+0000","last_fullsized":"2024-05-10T08:47:44.928243+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926976+0000","last_change":"2024-05-10T08:47:44.926976+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926976+0000","last_undegraded":"2024-05-10T08:47:44.926976+0000","last_fullsized":"2024-05-10T08:47:44.926976+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926705+0000","last_change":"2024-05-10T08:47:44.926705+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926705+0000","last_undegraded":"2024-05-10T08:47:44.926705+0000","last_fullsized":"2024-05-10T08:47:44.926705+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927256+0000","last_change":"2024-05-10T08:47:44.927256+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927256+0000","last_undegraded":"2024-05-10T08:47:44.927256+0000","last_fullsized":"2024-05-10T08:47:44.927256+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.929334+0000","last_change":"2024-05-10T08:47:44.929334+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.929334+0000","last_undegraded":"2024-05-10T08:47:44.929334+0000","last_fullsized":"2024-05-10T08:47:44.929334+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927468+0000","last_change":"2024-05-10T08:47:44.927468+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927468+0000","last_undegraded":"2024-05-10T08:47:44.927468+0000","last_fullsized":"2024-05-10T08:47:44.927468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926344+0000","last_change":"2024-05-10T08:47:44.926344+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926344+0000","last_undegraded":"2024-05-10T08:47:44.926344+0000","last_fullsized":"2024-05-10T08:47:44.926344+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.924089+0000","last_change":"2024-05-10T08:47:44.924089+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.924089+0000","last_undegraded":"2024-05-10T08:47:44.924089+0000","last_fullsized":"2024-05-10T08:47:44.924089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.927003+0000","last_change":"2024-05-10T08:47:44.927003+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.927003+0000","last_undegraded":"2024-05-10T08:47:44.927003+0000","last_fullsized":"2024-05-10T08:47:44.927003+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926453+0000","last_change":"2024-05-10T08:47:44.926453+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926453+0000","last_undegraded":"2024-05-10T08:47:44.926453+0000","last_fullsized":"2024-05-10T08:47:44.926453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926104+0000","last_change":"2024-05-10T08:47:44.926104+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926104+0000","last_undegraded":"2024-05-10T08:47:44.926104+0000","last_fullsized":"2024-05-10T08:47:44.926104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T08:47:45.922084+0000","last_change":"2024-05-10T08:47:45.922084+0000","last_active":"2024-05-10T08:47:45.922084+0000","last_peered":"2024-05-10T08:47:45.922084+0000","last_clean":"2024-05-10T08:47:45.922084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:45.922084+0000","last_undegraded":"2024-05-10T08:47:45.922084+0000","last_fullsized":"2024-05-10T08:47:45.922084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-10T08:47:44.926180+0000","last_change":"2024-05-10T08:47:44.926180+0000","last_active":"2024-05-10T08:47:44.919435+0000","last_peered":"2024-05-10T08:47:44.919435+0000","last_clean":"2024-05-10T08:47:44.919435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:47:44.926180+0000","last_undegraded":"2024-05-10T08:47:44.926180+0000","last_fullsized":"2024-05-10T08:47:44.926180+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":259,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-10T08:47:44.928217+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:47:44.928217+0000","last_peered":"2024-05-10T08:47:44.928217+0000","last_clean":"2024-05-10T08:47:44.928217+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:47:44.928217+0000","last_undegraded":"2024-05-10T08:47:44.928217+0000","last_fullsized":"2024-05-10T08:47:44.928217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1162052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":565475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":571684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":565475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1162052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:47:51.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:47:51.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 Processor -- start 2024-05-10T08:47:51.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 -- start start 2024-05-10T08:47:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd46015f420 0x7fd4600d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd4600d3ca0 0x7fd4600d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4600d1eb0 0x7fd4600d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd4600d22f0 con 0x7fd4600d1eb0 2024-05-10T08:47:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd4601630b0 con 0x7fd4600d3ca0 2024-05-10T08:47:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.496+0000 7fd466a2a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd4600d2550 con 0x7fd46015f420 2024-05-10T08:47:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4600d1eb0 0x7fd4600d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4600d1eb0 0x7fd4600d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58982/0 (socket says 172.21.15.37:58982) 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 -- 172.21.15.37:0/27585692 learned_addr learned my addr 172.21.15.37:0/27585692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd45f7fe640 1 --2- 172.21.15.37:0/27585692 >> v2:172.21.15.82:3300/0 conn(0x7fd4600d3ca0 0x7fd4600d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd45ffff640 1 --2- 172.21.15.37:0/27585692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd46015f420 0x7fd4600d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 -- 172.21.15.37:0/27585692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd46015f420 msgr2=0x7fd4600d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 --2- 172.21.15.37:0/27585692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd46015f420 0x7fd4600d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 -- 172.21.15.37:0/27585692 >> v2:172.21.15.82:3300/0 conn(0x7fd4600d3ca0 msgr2=0x7fd4600d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 --2- 172.21.15.37:0/27585692 >> v2:172.21.15.82:3300/0 conn(0x7fd4600d3ca0 0x7fd4600d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd464fc7640 1 -- 172.21.15.37:0/27585692 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4600d2c80 con 0x7fd4600d1eb0 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.497+0000 7fd45ffff640 1 --2- 172.21.15.37:0/27585692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd46015f420 0x7fd4600d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd464fc7640 1 --2- 172.21.15.37:0/27585692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d1eb0 0x7fd4600d4cc0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd4600b7b90 tx=0x7fd45802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2dc040ec9c3e04 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd45effd640 1 -- 172.21.15.37:0/27585692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458036070 con 0x7fd4600d1eb0 2024-05-10T08:47:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd45effd640 1 -- 172.21.15.37:0/27585692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd458031600 con 0x7fd4600d1eb0 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd45effd640 1 -- 172.21.15.37:0/27585692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580319d0 con 0x7fd4600d1eb0 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 -- 172.21.15.37:0/27585692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d1eb0 msgr2=0x7fd4600d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 --2- 172.21.15.37:0/27585692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d1eb0 0x7fd4600d4cc0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd4600b7b90 tx=0x7fd45802a6a0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 -- 172.21.15.37:0/27585692 shutdown_connections 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 --2- 172.21.15.37:0/27585692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d1eb0 0x7fd4600d4cc0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 --2- 172.21.15.37:0/27585692 >> v2:172.21.15.82:3300/0 conn(0x7fd4600d3ca0 0x7fd4600d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 --2- 172.21.15.37:0/27585692 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd46015f420 0x7fd4600d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 -- 172.21.15.37:0/27585692 >> 172.21.15.37:0/27585692 conn(0x7fd46008eac0 msgr2=0x7fd46009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 -- 172.21.15.37:0/27585692 shutdown_connections 2024-05-10T08:47:51.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.498+0000 7fd466a2a640 1 -- 172.21.15.37:0/27585692 wait complete. 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.499+0000 7fd466a2a640 1 Processor -- start 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.500+0000 7fd466a2a640 1 -- start start 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.500+0000 7fd466a2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600d1eb0 0x7fd46006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.500+0000 7fd466a2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600ccd60 0x7fd4600ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.500+0000 7fd466a2a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4600ca540 0x7fd4601f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.500+0000 7fd466a2a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4600d2830 con 0x7fd4600ccd60 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.500+0000 7fd466a2a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4600d3240 con 0x7fd4600d1eb0 2024-05-10T08:47:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.500+0000 7fd466a2a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd4600d5200 con 0x7fd4600ca540 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600ccd60 0x7fd4600ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600ccd60 0x7fd4600ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58998/0 (socket says 172.21.15.37:58998) 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 -- 172.21.15.37:0/4109438324 learned_addr learned my addr 172.21.15.37:0/4109438324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd464fc7640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4600ca540 0x7fd4601f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45ffff640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600d1eb0 0x7fd46006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 -- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4600ca540 msgr2=0x7fd4601f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4600ca540 0x7fd4601f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 -- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600d1eb0 msgr2=0x7fd46006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600d1eb0 0x7fd46006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 -- 172.21.15.37:0/4109438324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4601f5ce0 con 0x7fd4600ccd60 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45ffff640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600d1eb0 0x7fd46006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45f7fe640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600ccd60 0x7fd4600ca000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd45400d800 tx=0x7fd45400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45cff9640 1 -- 172.21.15.37:0/4109438324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454018020 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45cff9640 1 -- 172.21.15.37:0/4109438324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4540096a0 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd45cff9640 1 -- 172.21.15.37:0/4109438324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454009a70 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4600cc280 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.501+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46006e390 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.502+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4600693f0 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.503+0000 7fd45cff9640 1 -- 172.21.15.37:0/4109438324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd45401b020 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.503+0000 7fd45cff9640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd44c076300 0x7fd44c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.503+0000 7fd45cff9640 1 -- 172.21.15.37:0/4109438324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fd454097c10 con 0x7fd4600ccd60 2024-05-10T08:47:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.504+0000 7fd45ffff640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd44c076300 0x7fd44c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.504+0000 7fd45ffff640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd44c076300 0x7fd44c0787c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd4600cbac0 tx=0x7fd450008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.508+0000 7fd45cff9640 1 -- 172.21.15.37:0/4109438324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd454022020 con 0x7fd4600ccd60 2024-05-10T08:47:51.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.701+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4600cc0c0 con 0x7fd44c076300 2024-05-10T08:47:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.708+0000 7fd45cff9640 1 -- 172.21.15.37:0/4109438324 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7fd45000a210 con 0x7fd44c076300 2024-05-10T08:47:51.709 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:51.710 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd44c076300 msgr2=0x7fd44c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd44c076300 0x7fd44c0787c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd4600cbac0 tx=0x7fd450008040 comp rx=0 tx=0).stop 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600ccd60 msgr2=0x7fd4600ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600ccd60 0x7fd4600ca000 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd45400d800 tx=0x7fd45400dcc0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 shutdown_connections 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fd44c076300 0x7fd44c0787c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd4600ca540 0x7fd4601f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600ccd60 0x7fd4600ca000 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 --2- 172.21.15.37:0/4109438324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600d1eb0 0x7fd46006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 >> 172.21.15.37:0/4109438324 conn(0x7fd46008eac0 msgr2=0x7fd4600d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:51.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 shutdown_connections 2024-05-10T08:47:51.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.711+0000 7fd466a2a640 1 -- 172.21.15.37:0/4109438324 wait complete. 2024-05-10T08:47:51.721 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-05-10T08:47:51.435402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260656,"kb_used_data":11208,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714064,"statfs":{"total":773094113280,"available":772827201536,"internally_reserved":0,"allocated":11476992,"data_stored":5923236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001467"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930445+0000","last_change":"2024-05-10T08:47:46.952665+0000","last_active":"2024-05-10T08:47:48.930445+0000","last_peered":"2024-05-10T08:47:48.930445+0000","last_clean":"2024-05-10T08:47:48.930445+0000","last_became_active":"2024-05-10T08:47:46.952409+0000","last_became_peered":"2024-05-10T08:47:46.952409+0000","last_unstale":"2024-05-10T08:47:48.930445+0000","last_undegraded":"2024-05-10T08:47:48.930445+0000","last_fullsized":"2024-05-10T08:47:48.930445+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:34.485421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930124+0000","last_change":"2024-05-10T08:47:46.962426+0000","last_active":"2024-05-10T08:47:48.930124+0000","last_peered":"2024-05-10T08:47:48.930124+0000","last_clean":"2024-05-10T08:47:48.930124+0000","last_became_active":"2024-05-10T08:47:46.962145+0000","last_became_peered":"2024-05-10T08:47:46.962145+0000","last_unstale":"2024-05-10T08:47:48.930124+0000","last_undegraded":"2024-05-10T08:47:48.930124+0000","last_fullsized":"2024-05-10T08:47:48.930124+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930307+0000","last_change":"2024-05-10T08:47:46.955209+0000","last_active":"2024-05-10T08:47:48.930307+0000","last_peered":"2024-05-10T08:47:48.930307+0000","last_clean":"2024-05-10T08:47:48.930307+0000","last_became_active":"2024-05-10T08:47:46.954892+0000","last_became_peered":"2024-05-10T08:47:46.954892+0000","last_unstale":"2024-05-10T08:47:48.930307+0000","last_undegraded":"2024-05-10T08:47:48.930307+0000","last_fullsized":"2024-05-10T08:47:48.930307+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:40.417564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855668+0000","last_change":"2024-05-10T08:47:46.951651+0000","last_active":"2024-05-10T08:47:48.855668+0000","last_peered":"2024-05-10T08:47:48.855668+0000","last_clean":"2024-05-10T08:47:48.855668+0000","last_became_active":"2024-05-10T08:47:46.951388+0000","last_became_peered":"2024-05-10T08:47:46.951388+0000","last_unstale":"2024-05-10T08:47:48.855668+0000","last_undegraded":"2024-05-10T08:47:48.855668+0000","last_fullsized":"2024-05-10T08:47:48.855668+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:35.545609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934700+0000","last_change":"2024-05-10T08:47:46.958677+0000","last_active":"2024-05-10T08:47:47.934700+0000","last_peered":"2024-05-10T08:47:47.934700+0000","last_clean":"2024-05-10T08:47:47.934700+0000","last_became_active":"2024-05-10T08:47:46.958425+0000","last_became_peered":"2024-05-10T08:47:46.958425+0000","last_unstale":"2024-05-10T08:47:47.934700+0000","last_undegraded":"2024-05-10T08:47:47.934700+0000","last_fullsized":"2024-05-10T08:47:47.934700+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929931+0000","last_change":"2024-05-10T08:47:46.961009+0000","last_active":"2024-05-10T08:47:48.929931+0000","last_peered":"2024-05-10T08:47:48.929931+0000","last_clean":"2024-05-10T08:47:48.929931+0000","last_became_active":"2024-05-10T08:47:46.960659+0000","last_became_peered":"2024-05-10T08:47:46.960659+0000","last_unstale":"2024-05-10T08:47:48.929931+0000","last_undegraded":"2024-05-10T08:47:48.929931+0000","last_fullsized":"2024-05-10T08:47:48.929931+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929541+0000","last_change":"2024-05-10T08:47:46.953451+0000","last_active":"2024-05-10T08:47:48.929541+0000","last_peered":"2024-05-10T08:47:48.929541+0000","last_clean":"2024-05-10T08:47:48.929541+0000","last_became_active":"2024-05-10T08:47:46.953175+0000","last_became_peered":"2024-05-10T08:47:46.953175+0000","last_unstale":"2024-05-10T08:47:48.929541+0000","last_undegraded":"2024-05-10T08:47:48.929541+0000","last_fullsized":"2024-05-10T08:47:48.929541+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929904+0000","last_change":"2024-05-10T08:47:46.966090+0000","last_active":"2024-05-10T08:47:48.929904+0000","last_peered":"2024-05-10T08:47:48.929904+0000","last_clean":"2024-05-10T08:47:48.929904+0000","last_became_active":"2024-05-10T08:47:46.965256+0000","last_became_peered":"2024-05-10T08:47:46.965256+0000","last_unstale":"2024-05-10T08:47:48.929904+0000","last_undegraded":"2024-05-10T08:47:48.929904+0000","last_fullsized":"2024-05-10T08:47:48.929904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:55:05.342516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929528+0000","last_change":"2024-05-10T08:47:46.964209+0000","last_active":"2024-05-10T08:47:48.929528+0000","last_peered":"2024-05-10T08:47:48.929528+0000","last_clean":"2024-05-10T08:47:48.929528+0000","last_became_active":"2024-05-10T08:47:46.963893+0000","last_became_peered":"2024-05-10T08:47:46.963893+0000","last_unstale":"2024-05-10T08:47:48.929528+0000","last_undegraded":"2024-05-10T08:47:48.929528+0000","last_fullsized":"2024-05-10T08:47:48.929528+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934885+0000","last_change":"2024-05-10T08:47:46.954341+0000","last_active":"2024-05-10T08:47:47.934885+0000","last_peered":"2024-05-10T08:47:47.934885+0000","last_clean":"2024-05-10T08:47:47.934885+0000","last_became_active":"2024-05-10T08:47:46.954043+0000","last_became_peered":"2024-05-10T08:47:46.954043+0000","last_unstale":"2024-05-10T08:47:47.934885+0000","last_undegraded":"2024-05-10T08:47:47.934885+0000","last_fullsized":"2024-05-10T08:47:47.934885+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930534+0000","last_change":"2024-05-10T08:47:46.954094+0000","last_active":"2024-05-10T08:47:48.930534+0000","last_peered":"2024-05-10T08:47:48.930534+0000","last_clean":"2024-05-10T08:47:48.930534+0000","last_became_active":"2024-05-10T08:47:46.953761+0000","last_became_peered":"2024-05-10T08:47:46.953761+0000","last_unstale":"2024-05-10T08:47:48.930534+0000","last_undegraded":"2024-05-10T08:47:48.930534+0000","last_fullsized":"2024-05-10T08:47:48.930534+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:03.990956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934536+0000","last_change":"2024-05-10T08:47:46.956579+0000","last_active":"2024-05-10T08:47:47.934536+0000","last_peered":"2024-05-10T08:47:47.934536+0000","last_clean":"2024-05-10T08:47:47.934536+0000","last_became_active":"2024-05-10T08:47:46.955068+0000","last_became_peered":"2024-05-10T08:47:46.955068+0000","last_unstale":"2024-05-10T08:47:47.934536+0000","last_undegraded":"2024-05-10T08:47:47.934536+0000","last_fullsized":"2024-05-10T08:47:47.934536+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855547+0000","last_change":"2024-05-10T08:47:46.948562+0000","last_active":"2024-05-10T08:47:48.855547+0000","last_peered":"2024-05-10T08:47:48.855547+0000","last_clean":"2024-05-10T08:47:48.855547+0000","last_became_active":"2024-05-10T08:47:46.948287+0000","last_became_peered":"2024-05-10T08:47:46.948287+0000","last_unstale":"2024-05-10T08:47:48.855547+0000","last_undegraded":"2024-05-10T08:47:48.855547+0000","last_fullsized":"2024-05-10T08:47:48.855547+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:10.442062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933979+0000","last_change":"2024-05-10T08:47:46.951596+0000","last_active":"2024-05-10T08:47:47.933979+0000","last_peered":"2024-05-10T08:47:47.933979+0000","last_clean":"2024-05-10T08:47:47.933979+0000","last_became_active":"2024-05-10T08:47:46.951293+0000","last_became_peered":"2024-05-10T08:47:46.951293+0000","last_unstale":"2024-05-10T08:47:47.933979+0000","last_undegraded":"2024-05-10T08:47:47.933979+0000","last_fullsized":"2024-05-10T08:47:47.933979+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933798+0000","last_change":"2024-05-10T08:47:46.941772+0000","last_active":"2024-05-10T08:47:47.933798+0000","last_peered":"2024-05-10T08:47:47.933798+0000","last_clean":"2024-05-10T08:47:47.933798+0000","last_became_active":"2024-05-10T08:47:46.941508+0000","last_became_peered":"2024-05-10T08:47:46.941508+0000","last_unstale":"2024-05-10T08:47:47.933798+0000","last_undegraded":"2024-05-10T08:47:47.933798+0000","last_fullsized":"2024-05-10T08:47:47.933798+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933637+0000","last_change":"2024-05-10T08:47:46.956064+0000","last_active":"2024-05-10T08:47:47.933637+0000","last_peered":"2024-05-10T08:47:47.933637+0000","last_clean":"2024-05-10T08:47:47.933637+0000","last_became_active":"2024-05-10T08:47:46.955795+0000","last_became_peered":"2024-05-10T08:47:46.955795+0000","last_unstale":"2024-05-10T08:47:47.933637+0000","last_undegraded":"2024-05-10T08:47:47.933637+0000","last_fullsized":"2024-05-10T08:47:47.933637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930479+0000","last_change":"2024-05-10T08:47:46.954708+0000","last_active":"2024-05-10T08:47:48.930479+0000","last_peered":"2024-05-10T08:47:48.930479+0000","last_clean":"2024-05-10T08:47:48.930479+0000","last_became_active":"2024-05-10T08:47:46.954415+0000","last_became_peered":"2024-05-10T08:47:46.954415+0000","last_unstale":"2024-05-10T08:47:48.930479+0000","last_undegraded":"2024-05-10T08:47:48.930479+0000","last_fullsized":"2024-05-10T08:47:48.930479+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:24.396227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930276+0000","last_change":"2024-05-10T08:47:46.961735+0000","last_active":"2024-05-10T08:47:48.930276+0000","last_peered":"2024-05-10T08:47:48.930276+0000","last_clean":"2024-05-10T08:47:48.930276+0000","last_became_active":"2024-05-10T08:47:46.961476+0000","last_became_peered":"2024-05-10T08:47:46.961476+0000","last_unstale":"2024-05-10T08:47:48.930276+0000","last_undegraded":"2024-05-10T08:47:48.930276+0000","last_fullsized":"2024-05-10T08:47:48.930276+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:02.677927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930385+0000","last_change":"2024-05-10T08:47:46.958611+0000","last_active":"2024-05-10T08:47:48.930385+0000","last_peered":"2024-05-10T08:47:48.930385+0000","last_clean":"2024-05-10T08:47:48.930385+0000","last_became_active":"2024-05-10T08:47:46.957729+0000","last_became_peered":"2024-05-10T08:47:46.957729+0000","last_unstale":"2024-05-10T08:47:48.930385+0000","last_undegraded":"2024-05-10T08:47:48.930385+0000","last_fullsized":"2024-05-10T08:47:48.930385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:06:12.102854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934739+0000","last_change":"2024-05-10T08:47:46.952310+0000","last_active":"2024-05-10T08:47:47.934739+0000","last_peered":"2024-05-10T08:47:47.934739+0000","last_clean":"2024-05-10T08:47:47.934739+0000","last_became_active":"2024-05-10T08:47:46.951861+0000","last_became_peered":"2024-05-10T08:47:46.951861+0000","last_unstale":"2024-05-10T08:47:47.934739+0000","last_undegraded":"2024-05-10T08:47:47.934739+0000","last_fullsized":"2024-05-10T08:47:47.934739+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930104+0000","last_change":"2024-05-10T08:47:46.963435+0000","last_active":"2024-05-10T08:47:48.930104+0000","last_peered":"2024-05-10T08:47:48.930104+0000","last_clean":"2024-05-10T08:47:48.930104+0000","last_became_active":"2024-05-10T08:47:46.962767+0000","last_became_peered":"2024-05-10T08:47:46.962767+0000","last_unstale":"2024-05-10T08:47:48.930104+0000","last_undegraded":"2024-05-10T08:47:48.930104+0000","last_fullsized":"2024-05-10T08:47:48.930104+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:44:39.794997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934691+0000","last_change":"2024-05-10T08:47:46.940223+0000","last_active":"2024-05-10T08:47:47.934691+0000","last_peered":"2024-05-10T08:47:47.934691+0000","last_clean":"2024-05-10T08:47:47.934691+0000","last_became_active":"2024-05-10T08:47:46.939314+0000","last_became_peered":"2024-05-10T08:47:46.939314+0000","last_unstale":"2024-05-10T08:47:47.934691+0000","last_undegraded":"2024-05-10T08:47:47.934691+0000","last_fullsized":"2024-05-10T08:47:47.934691+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930189+0000","last_change":"2024-05-10T08:47:46.954208+0000","last_active":"2024-05-10T08:47:48.930189+0000","last_peered":"2024-05-10T08:47:48.930189+0000","last_clean":"2024-05-10T08:47:48.930189+0000","last_became_active":"2024-05-10T08:47:46.953886+0000","last_became_peered":"2024-05-10T08:47:46.953886+0000","last_unstale":"2024-05-10T08:47:48.930189+0000","last_undegraded":"2024-05-10T08:47:48.930189+0000","last_fullsized":"2024-05-10T08:47:48.930189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:36.078442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934604+0000","last_change":"2024-05-10T08:47:46.950352+0000","last_active":"2024-05-10T08:47:47.934604+0000","last_peered":"2024-05-10T08:47:47.934604+0000","last_clean":"2024-05-10T08:47:47.934604+0000","last_became_active":"2024-05-10T08:47:46.950079+0000","last_became_peered":"2024-05-10T08:47:46.950079+0000","last_unstale":"2024-05-10T08:47:47.934604+0000","last_undegraded":"2024-05-10T08:47:47.934604+0000","last_fullsized":"2024-05-10T08:47:47.934604+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934852+0000","last_change":"2024-05-10T08:47:46.954776+0000","last_active":"2024-05-10T08:47:47.934852+0000","last_peered":"2024-05-10T08:47:47.934852+0000","last_clean":"2024-05-10T08:47:47.934852+0000","last_became_active":"2024-05-10T08:47:46.954481+0000","last_became_peered":"2024-05-10T08:47:46.954481+0000","last_unstale":"2024-05-10T08:47:47.934852+0000","last_undegraded":"2024-05-10T08:47:47.934852+0000","last_fullsized":"2024-05-10T08:47:47.934852+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934711+0000","last_change":"2024-05-10T08:47:46.955415+0000","last_active":"2024-05-10T08:47:47.934711+0000","last_peered":"2024-05-10T08:47:47.934711+0000","last_clean":"2024-05-10T08:47:47.934711+0000","last_became_active":"2024-05-10T08:47:46.955090+0000","last_became_peered":"2024-05-10T08:47:46.955090+0000","last_unstale":"2024-05-10T08:47:47.934711+0000","last_undegraded":"2024-05-10T08:47:47.934711+0000","last_fullsized":"2024-05-10T08:47:47.934711+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930597+0000","last_change":"2024-05-10T08:47:46.946695+0000","last_active":"2024-05-10T08:47:48.930597+0000","last_peered":"2024-05-10T08:47:48.930597+0000","last_clean":"2024-05-10T08:47:48.930597+0000","last_became_active":"2024-05-10T08:47:46.946380+0000","last_became_peered":"2024-05-10T08:47:46.946380+0000","last_unstale":"2024-05-10T08:47:48.930597+0000","last_undegraded":"2024-05-10T08:47:48.930597+0000","last_fullsized":"2024-05-10T08:47:48.930597+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:44.547445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929856+0000","last_change":"2024-05-10T08:47:46.962200+0000","last_active":"2024-05-10T08:47:48.929856+0000","last_peered":"2024-05-10T08:47:48.929856+0000","last_clean":"2024-05-10T08:47:48.929856+0000","last_became_active":"2024-05-10T08:47:46.961918+0000","last_became_peered":"2024-05-10T08:47:46.961918+0000","last_unstale":"2024-05-10T08:47:48.929856+0000","last_undegraded":"2024-05-10T08:47:48.929856+0000","last_fullsized":"2024-05-10T08:47:48.929856+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930203+0000","last_change":"2024-05-10T08:47:46.961715+0000","last_active":"2024-05-10T08:47:48.930203+0000","last_peered":"2024-05-10T08:47:48.930203+0000","last_clean":"2024-05-10T08:47:48.930203+0000","last_became_active":"2024-05-10T08:47:46.961438+0000","last_became_peered":"2024-05-10T08:47:46.961438+0000","last_unstale":"2024-05-10T08:47:48.930203+0000","last_undegraded":"2024-05-10T08:47:48.930203+0000","last_fullsized":"2024-05-10T08:47:48.930203+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:17.069869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934135+0000","last_change":"2024-05-10T08:47:46.958806+0000","last_active":"2024-05-10T08:47:47.934135+0000","last_peered":"2024-05-10T08:47:47.934135+0000","last_clean":"2024-05-10T08:47:47.934135+0000","last_became_active":"2024-05-10T08:47:46.958544+0000","last_became_peered":"2024-05-10T08:47:46.958544+0000","last_unstale":"2024-05-10T08:47:47.934135+0000","last_undegraded":"2024-05-10T08:47:47.934135+0000","last_fullsized":"2024-05-10T08:47:47.934135+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:03.990956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929731+0000","last_change":"2024-05-10T08:47:46.951712+0000","last_active":"2024-05-10T08:47:48.929731+0000","last_peered":"2024-05-10T08:47:48.929731+0000","last_clean":"2024-05-10T08:47:48.929731+0000","last_became_active":"2024-05-10T08:47:46.951338+0000","last_became_peered":"2024-05-10T08:47:46.951338+0000","last_unstale":"2024-05-10T08:47:48.929731+0000","last_undegraded":"2024-05-10T08:47:48.929731+0000","last_fullsized":"2024-05-10T08:47:48.929731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929552+0000","last_change":"2024-05-10T08:47:46.962281+0000","last_active":"2024-05-10T08:47:48.929552+0000","last_peered":"2024-05-10T08:47:48.929552+0000","last_clean":"2024-05-10T08:47:48.929552+0000","last_became_active":"2024-05-10T08:47:46.961740+0000","last_became_peered":"2024-05-10T08:47:46.961740+0000","last_unstale":"2024-05-10T08:47:48.929552+0000","last_undegraded":"2024-05-10T08:47:48.929552+0000","last_fullsized":"2024-05-10T08:47:48.929552+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:57:41.454259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929982+0000","last_change":"2024-05-10T08:47:46.955769+0000","last_active":"2024-05-10T08:47:48.929982+0000","last_peered":"2024-05-10T08:47:48.929982+0000","last_clean":"2024-05-10T08:47:48.929982+0000","last_became_active":"2024-05-10T08:47:46.955448+0000","last_became_peered":"2024-05-10T08:47:46.955448+0000","last_unstale":"2024-05-10T08:47:48.929982+0000","last_undegraded":"2024-05-10T08:47:48.929982+0000","last_fullsized":"2024-05-10T08:47:48.929982+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:23.661741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"102'4","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855800+0000","last_change":"2024-05-10T08:47:45.951357+0000","last_active":"2024-05-10T08:47:48.855800+0000","last_peered":"2024-05-10T08:47:48.855800+0000","last_clean":"2024-05-10T08:47:48.855800+0000","last_became_active":"2024-05-10T08:47:45.951083+0000","last_became_peered":"2024-05-10T08:47:45.951083+0000","last_unstale":"2024-05-10T08:47:48.855800+0000","last_undegraded":"2024-05-10T08:47:48.855800+0000","last_fullsized":"2024-05-10T08:47:48.855800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:01.675277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929602+0000","last_change":"2024-05-10T08:47:46.966051+0000","last_active":"2024-05-10T08:47:48.929602+0000","last_peered":"2024-05-10T08:47:48.929602+0000","last_clean":"2024-05-10T08:47:48.929602+0000","last_became_active":"2024-05-10T08:47:46.965324+0000","last_became_peered":"2024-05-10T08:47:46.965324+0000","last_unstale":"2024-05-10T08:47:48.929602+0000","last_undegraded":"2024-05-10T08:47:48.929602+0000","last_fullsized":"2024-05-10T08:47:48.929602+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:51.388979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929695+0000","last_change":"2024-05-10T08:47:45.950505+0000","last_active":"2024-05-10T08:47:48.929695+0000","last_peered":"2024-05-10T08:47:48.929695+0000","last_clean":"2024-05-10T08:47:48.929695+0000","last_became_active":"2024-05-10T08:47:45.950196+0000","last_became_peered":"2024-05-10T08:47:45.950196+0000","last_unstale":"2024-05-10T08:47:48.929695+0000","last_undegraded":"2024-05-10T08:47:48.929695+0000","last_fullsized":"2024-05-10T08:47:48.929695+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:24.404918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934299+0000","last_change":"2024-05-10T08:47:46.951545+0000","last_active":"2024-05-10T08:47:47.934299+0000","last_peered":"2024-05-10T08:47:47.934299+0000","last_clean":"2024-05-10T08:47:47.934299+0000","last_became_active":"2024-05-10T08:47:46.951280+0000","last_became_peered":"2024-05-10T08:47:46.951280+0000","last_unstale":"2024-05-10T08:47:47.934299+0000","last_undegraded":"2024-05-10T08:47:47.934299+0000","last_fullsized":"2024-05-10T08:47:47.934299+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:21.078958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933613+0000","last_change":"2024-05-10T08:47:45.945401+0000","last_active":"2024-05-10T08:47:47.933613+0000","last_peered":"2024-05-10T08:47:47.933613+0000","last_clean":"2024-05-10T08:47:47.933613+0000","last_became_active":"2024-05-10T08:47:45.945054+0000","last_became_peered":"2024-05-10T08:47:45.945054+0000","last_unstale":"2024-05-10T08:47:47.933613+0000","last_undegraded":"2024-05-10T08:47:47.933613+0000","last_fullsized":"2024-05-10T08:47:47.933613+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:22:42.828175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930014+0000","last_change":"2024-05-10T08:47:46.959135+0000","last_active":"2024-05-10T08:47:48.930014+0000","last_peered":"2024-05-10T08:47:48.930014+0000","last_clean":"2024-05-10T08:47:48.930014+0000","last_became_active":"2024-05-10T08:47:46.958884+0000","last_became_peered":"2024-05-10T08:47:46.958884+0000","last_unstale":"2024-05-10T08:47:48.930014+0000","last_undegraded":"2024-05-10T08:47:48.930014+0000","last_fullsized":"2024-05-10T08:47:48.930014+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:32.633950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934703+0000","last_change":"2024-05-10T08:47:45.946621+0000","last_active":"2024-05-10T08:47:47.934703+0000","last_peered":"2024-05-10T08:47:47.934703+0000","last_clean":"2024-05-10T08:47:47.934703+0000","last_became_active":"2024-05-10T08:47:45.946083+0000","last_became_peered":"2024-05-10T08:47:45.946083+0000","last_unstale":"2024-05-10T08:47:47.934703+0000","last_undegraded":"2024-05-10T08:47:47.934703+0000","last_fullsized":"2024-05-10T08:47:47.934703+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:24.502072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855698+0000","last_change":"2024-05-10T08:47:46.947194+0000","last_active":"2024-05-10T08:47:48.855698+0000","last_peered":"2024-05-10T08:47:48.855698+0000","last_clean":"2024-05-10T08:47:48.855698+0000","last_became_active":"2024-05-10T08:47:46.946862+0000","last_became_peered":"2024-05-10T08:47:46.946862+0000","last_unstale":"2024-05-10T08:47:48.855698+0000","last_undegraded":"2024-05-10T08:47:48.855698+0000","last_fullsized":"2024-05-10T08:47:48.855698+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:30.604268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934215+0000","last_change":"2024-05-10T08:47:45.948870+0000","last_active":"2024-05-10T08:47:47.934215+0000","last_peered":"2024-05-10T08:47:47.934215+0000","last_clean":"2024-05-10T08:47:47.934215+0000","last_became_active":"2024-05-10T08:47:45.948580+0000","last_became_peered":"2024-05-10T08:47:45.948580+0000","last_unstale":"2024-05-10T08:47:47.934215+0000","last_undegraded":"2024-05-10T08:47:47.934215+0000","last_fullsized":"2024-05-10T08:47:47.934215+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:34:12.078307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930563+0000","last_change":"2024-05-10T08:47:46.958854+0000","last_active":"2024-05-10T08:47:48.930563+0000","last_peered":"2024-05-10T08:47:48.930563+0000","last_clean":"2024-05-10T08:47:48.930563+0000","last_became_active":"2024-05-10T08:47:46.957777+0000","last_became_peered":"2024-05-10T08:47:46.957777+0000","last_unstale":"2024-05-10T08:47:48.930563+0000","last_undegraded":"2024-05-10T08:47:48.930563+0000","last_fullsized":"2024-05-10T08:47:48.930563+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:10.151047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929510+0000","last_change":"2024-05-10T08:47:45.946555+0000","last_active":"2024-05-10T08:47:48.929510+0000","last_peered":"2024-05-10T08:47:48.929510+0000","last_clean":"2024-05-10T08:47:48.929510+0000","last_became_active":"2024-05-10T08:47:45.946250+0000","last_became_peered":"2024-05-10T08:47:45.946250+0000","last_unstale":"2024-05-10T08:47:48.929510+0000","last_undegraded":"2024-05-10T08:47:48.929510+0000","last_fullsized":"2024-05-10T08:47:48.929510+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:47.299832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930279+0000","last_change":"2024-05-10T08:47:46.957885+0000","last_active":"2024-05-10T08:47:48.930279+0000","last_peered":"2024-05-10T08:47:48.930279+0000","last_clean":"2024-05-10T08:47:48.930279+0000","last_became_active":"2024-05-10T08:47:46.957605+0000","last_became_peered":"2024-05-10T08:47:46.957605+0000","last_unstale":"2024-05-10T08:47:48.930279+0000","last_undegraded":"2024-05-10T08:47:48.930279+0000","last_fullsized":"2024-05-10T08:47:48.930279+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:21.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934151+0000","last_change":"2024-05-10T08:47:45.943591+0000","last_active":"2024-05-10T08:47:47.934151+0000","last_peered":"2024-05-10T08:47:47.934151+0000","last_clean":"2024-05-10T08:47:47.934151+0000","last_became_active":"2024-05-10T08:47:45.943328+0000","last_became_peered":"2024-05-10T08:47:45.943328+0000","last_unstale":"2024-05-10T08:47:47.934151+0000","last_undegraded":"2024-05-10T08:47:47.934151+0000","last_fullsized":"2024-05-10T08:47:47.934151+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:33.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855856+0000","last_change":"2024-05-10T08:47:46.946662+0000","last_active":"2024-05-10T08:47:48.855856+0000","last_peered":"2024-05-10T08:47:48.855856+0000","last_clean":"2024-05-10T08:47:48.855856+0000","last_became_active":"2024-05-10T08:47:46.946347+0000","last_became_peered":"2024-05-10T08:47:46.946347+0000","last_unstale":"2024-05-10T08:47:48.855856+0000","last_undegraded":"2024-05-10T08:47:48.855856+0000","last_fullsized":"2024-05-10T08:47:48.855856+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:22.179752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855412+0000","last_change":"2024-05-10T08:47:45.941560+0000","last_active":"2024-05-10T08:47:48.855412+0000","last_peered":"2024-05-10T08:47:48.855412+0000","last_clean":"2024-05-10T08:47:48.855412+0000","last_became_active":"2024-05-10T08:47:45.941279+0000","last_became_peered":"2024-05-10T08:47:45.941279+0000","last_unstale":"2024-05-10T08:47:48.855412+0000","last_undegraded":"2024-05-10T08:47:48.855412+0000","last_fullsized":"2024-05-10T08:47:48.855412+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:27.960286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929822+0000","last_change":"2024-05-10T08:47:46.957426+0000","last_active":"2024-05-10T08:47:48.929822+0000","last_peered":"2024-05-10T08:47:48.929822+0000","last_clean":"2024-05-10T08:47:48.929822+0000","last_became_active":"2024-05-10T08:47:46.957089+0000","last_became_peered":"2024-05-10T08:47:46.957089+0000","last_unstale":"2024-05-10T08:47:48.929822+0000","last_undegraded":"2024-05-10T08:47:48.929822+0000","last_fullsized":"2024-05-10T08:47:48.929822+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:53.037611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934733+0000","last_change":"2024-05-10T08:47:45.944927+0000","last_active":"2024-05-10T08:47:47.934733+0000","last_peered":"2024-05-10T08:47:47.934733+0000","last_clean":"2024-05-10T08:47:47.934733+0000","last_became_active":"2024-05-10T08:47:45.944637+0000","last_became_peered":"2024-05-10T08:47:45.944637+0000","last_unstale":"2024-05-10T08:47:47.934733+0000","last_undegraded":"2024-05-10T08:47:47.934733+0000","last_fullsized":"2024-05-10T08:47:47.934733+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:37.361280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934739+0000","last_change":"2024-05-10T08:47:46.961330+0000","last_active":"2024-05-10T08:47:47.934739+0000","last_peered":"2024-05-10T08:47:47.934739+0000","last_clean":"2024-05-10T08:47:47.934739+0000","last_became_active":"2024-05-10T08:47:46.960992+0000","last_became_peered":"2024-05-10T08:47:46.960992+0000","last_unstale":"2024-05-10T08:47:47.934739+0000","last_undegraded":"2024-05-10T08:47:47.934739+0000","last_fullsized":"2024-05-10T08:47:47.934739+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929800+0000","last_change":"2024-05-10T08:47:45.954303+0000","last_active":"2024-05-10T08:47:48.929800+0000","last_peered":"2024-05-10T08:47:48.929800+0000","last_clean":"2024-05-10T08:47:48.929800+0000","last_became_active":"2024-05-10T08:47:45.954002+0000","last_became_peered":"2024-05-10T08:47:45.954002+0000","last_unstale":"2024-05-10T08:47:48.929800+0000","last_undegraded":"2024-05-10T08:47:48.929800+0000","last_fullsized":"2024-05-10T08:47:48.929800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:29.601618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929671+0000","last_change":"2024-05-10T08:47:46.962806+0000","last_active":"2024-05-10T08:47:48.929671+0000","last_peered":"2024-05-10T08:47:48.929671+0000","last_clean":"2024-05-10T08:47:48.929671+0000","last_became_active":"2024-05-10T08:47:46.962467+0000","last_became_peered":"2024-05-10T08:47:46.962467+0000","last_unstale":"2024-05-10T08:47:48.929671+0000","last_undegraded":"2024-05-10T08:47:48.929671+0000","last_fullsized":"2024-05-10T08:47:48.929671+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:17.229937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934307+0000","last_change":"2024-05-10T08:47:45.947475+0000","last_active":"2024-05-10T08:47:47.934307+0000","last_peered":"2024-05-10T08:47:47.934307+0000","last_clean":"2024-05-10T08:47:47.934307+0000","last_became_active":"2024-05-10T08:47:45.947172+0000","last_became_peered":"2024-05-10T08:47:45.947172+0000","last_unstale":"2024-05-10T08:47:47.934307+0000","last_undegraded":"2024-05-10T08:47:47.934307+0000","last_fullsized":"2024-05-10T08:47:47.934307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:02.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.935002+0000","last_change":"2024-05-10T08:47:46.961804+0000","last_active":"2024-05-10T08:47:47.935002+0000","last_peered":"2024-05-10T08:47:47.935002+0000","last_clean":"2024-05-10T08:47:47.935002+0000","last_became_active":"2024-05-10T08:47:46.961504+0000","last_became_peered":"2024-05-10T08:47:46.961504+0000","last_unstale":"2024-05-10T08:47:47.935002+0000","last_undegraded":"2024-05-10T08:47:47.935002+0000","last_fullsized":"2024-05-10T08:47:47.935002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930019+0000","last_change":"2024-05-10T08:47:45.949330+0000","last_active":"2024-05-10T08:47:48.930019+0000","last_peered":"2024-05-10T08:47:48.930019+0000","last_clean":"2024-05-10T08:47:48.930019+0000","last_became_active":"2024-05-10T08:47:45.949025+0000","last_became_peered":"2024-05-10T08:47:45.949025+0000","last_unstale":"2024-05-10T08:47:48.930019+0000","last_undegraded":"2024-05-10T08:47:48.930019+0000","last_fullsized":"2024-05-10T08:47:48.930019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:05.081620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930282+0000","last_change":"2024-05-10T08:47:46.947662+0000","last_active":"2024-05-10T08:47:48.930282+0000","last_peered":"2024-05-10T08:47:48.930282+0000","last_clean":"2024-05-10T08:47:48.930282+0000","last_became_active":"2024-05-10T08:47:46.947245+0000","last_became_peered":"2024-05-10T08:47:46.947245+0000","last_unstale":"2024-05-10T08:47:48.930282+0000","last_undegraded":"2024-05-10T08:47:48.930282+0000","last_fullsized":"2024-05-10T08:47:48.930282+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:34:13.080957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934913+0000","last_change":"2024-05-10T08:47:45.948425+0000","last_active":"2024-05-10T08:47:47.934913+0000","last_peered":"2024-05-10T08:47:47.934913+0000","last_clean":"2024-05-10T08:47:47.934913+0000","last_became_active":"2024-05-10T08:47:45.948130+0000","last_became_peered":"2024-05-10T08:47:45.948130+0000","last_unstale":"2024-05-10T08:47:47.934913+0000","last_undegraded":"2024-05-10T08:47:47.934913+0000","last_fullsized":"2024-05-10T08:47:47.934913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:37.758407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930219+0000","last_change":"2024-05-10T08:47:46.954400+0000","last_active":"2024-05-10T08:47:48.930219+0000","last_peered":"2024-05-10T08:47:48.930219+0000","last_clean":"2024-05-10T08:47:48.930219+0000","last_became_active":"2024-05-10T08:47:46.954144+0000","last_became_peered":"2024-05-10T08:47:46.954144+0000","last_unstale":"2024-05-10T08:47:48.930219+0000","last_undegraded":"2024-05-10T08:47:48.930219+0000","last_fullsized":"2024-05-10T08:47:48.930219+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:31.145944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855471+0000","last_change":"2024-05-10T08:47:45.944928+0000","last_active":"2024-05-10T08:47:48.855471+0000","last_peered":"2024-05-10T08:47:48.855471+0000","last_clean":"2024-05-10T08:47:48.855471+0000","last_became_active":"2024-05-10T08:47:45.944656+0000","last_became_peered":"2024-05-10T08:47:45.944656+0000","last_unstale":"2024-05-10T08:47:48.855471+0000","last_undegraded":"2024-05-10T08:47:48.855471+0000","last_fullsized":"2024-05-10T08:47:48.855471+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:30.143294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929725+0000","last_change":"2024-05-10T08:47:46.961204+0000","last_active":"2024-05-10T08:47:48.929725+0000","last_peered":"2024-05-10T08:47:48.929725+0000","last_clean":"2024-05-10T08:47:48.929725+0000","last_became_active":"2024-05-10T08:47:46.960885+0000","last_became_peered":"2024-05-10T08:47:46.960885+0000","last_unstale":"2024-05-10T08:47:48.929725+0000","last_undegraded":"2024-05-10T08:47:48.929725+0000","last_fullsized":"2024-05-10T08:47:48.929725+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:53:47.091166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929473+0000","last_change":"2024-05-10T08:47:45.952528+0000","last_active":"2024-05-10T08:47:48.929473+0000","last_peered":"2024-05-10T08:47:48.929473+0000","last_clean":"2024-05-10T08:47:48.929473+0000","last_became_active":"2024-05-10T08:47:45.952268+0000","last_became_peered":"2024-05-10T08:47:45.952268+0000","last_unstale":"2024-05-10T08:47:48.929473+0000","last_undegraded":"2024-05-10T08:47:48.929473+0000","last_fullsized":"2024-05-10T08:47:48.929473+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:55.834413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930609+0000","last_change":"2024-05-10T08:47:46.954408+0000","last_active":"2024-05-10T08:47:48.930609+0000","last_peered":"2024-05-10T08:47:48.930609+0000","last_clean":"2024-05-10T08:47:48.930609+0000","last_became_active":"2024-05-10T08:47:46.954125+0000","last_became_peered":"2024-05-10T08:47:46.954125+0000","last_unstale":"2024-05-10T08:47:48.930609+0000","last_undegraded":"2024-05-10T08:47:48.930609+0000","last_fullsized":"2024-05-10T08:47:48.930609+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:13.431202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":22,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934902+0000","last_change":"2024-05-10T08:47:45.940286+0000","last_active":"2024-05-10T08:47:47.934902+0000","last_peered":"2024-05-10T08:47:47.934902+0000","last_clean":"2024-05-10T08:47:47.934902+0000","last_became_active":"2024-05-10T08:47:45.940000+0000","last_became_peered":"2024-05-10T08:47:45.940000+0000","last_unstale":"2024-05-10T08:47:47.934902+0000","last_undegraded":"2024-05-10T08:47:47.934902+0000","last_fullsized":"2024-05-10T08:47:47.934902+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:45.507964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930042+0000","last_change":"2024-05-10T08:47:46.961873+0000","last_active":"2024-05-10T08:47:48.930042+0000","last_peered":"2024-05-10T08:47:48.930042+0000","last_clean":"2024-05-10T08:47:48.930042+0000","last_became_active":"2024-05-10T08:47:46.961376+0000","last_became_peered":"2024-05-10T08:47:46.961376+0000","last_unstale":"2024-05-10T08:47:48.930042+0000","last_undegraded":"2024-05-10T08:47:48.930042+0000","last_fullsized":"2024-05-10T08:47:48.930042+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:19.661076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929441+0000","last_change":"2024-05-10T08:47:45.947284+0000","last_active":"2024-05-10T08:47:48.929441+0000","last_peered":"2024-05-10T08:47:48.929441+0000","last_clean":"2024-05-10T08:47:48.929441+0000","last_became_active":"2024-05-10T08:47:45.947000+0000","last_became_peered":"2024-05-10T08:47:45.947000+0000","last_unstale":"2024-05-10T08:47:48.929441+0000","last_undegraded":"2024-05-10T08:47:48.929441+0000","last_fullsized":"2024-05-10T08:47:48.929441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:46.677065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929987+0000","last_change":"2024-05-10T08:47:46.957180+0000","last_active":"2024-05-10T08:47:48.929987+0000","last_peered":"2024-05-10T08:47:48.929987+0000","last_clean":"2024-05-10T08:47:48.929987+0000","last_became_active":"2024-05-10T08:47:46.956661+0000","last_became_peered":"2024-05-10T08:47:46.956661+0000","last_unstale":"2024-05-10T08:47:48.929987+0000","last_undegraded":"2024-05-10T08:47:48.929987+0000","last_fullsized":"2024-05-10T08:47:48.929987+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934438+0000","last_change":"2024-05-10T08:47:45.944706+0000","last_active":"2024-05-10T08:47:47.934438+0000","last_peered":"2024-05-10T08:47:47.934438+0000","last_clean":"2024-05-10T08:47:47.934438+0000","last_became_active":"2024-05-10T08:47:45.944400+0000","last_became_peered":"2024-05-10T08:47:45.944400+0000","last_unstale":"2024-05-10T08:47:47.934438+0000","last_undegraded":"2024-05-10T08:47:47.934438+0000","last_fullsized":"2024-05-10T08:47:47.934438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:20.076309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934864+0000","last_change":"2024-05-10T08:47:46.939221+0000","last_active":"2024-05-10T08:47:47.934864+0000","last_peered":"2024-05-10T08:47:47.934864+0000","last_clean":"2024-05-10T08:47:47.934864+0000","last_became_active":"2024-05-10T08:47:46.938789+0000","last_became_peered":"2024-05-10T08:47:46.938789+0000","last_unstale":"2024-05-10T08:47:47.934864+0000","last_undegraded":"2024-05-10T08:47:47.934864+0000","last_fullsized":"2024-05-10T08:47:47.934864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930254+0000","last_change":"2024-05-10T08:47:45.949017+0000","last_active":"2024-05-10T08:47:48.930254+0000","last_peered":"2024-05-10T08:47:48.930254+0000","last_clean":"2024-05-10T08:47:48.930254+0000","last_became_active":"2024-05-10T08:47:45.948712+0000","last_became_peered":"2024-05-10T08:47:45.948712+0000","last_unstale":"2024-05-10T08:47:48.930254+0000","last_undegraded":"2024-05-10T08:47:48.930254+0000","last_fullsized":"2024-05-10T08:47:48.930254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:49.975788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929862+0000","last_change":"2024-05-10T08:47:46.953847+0000","last_active":"2024-05-10T08:47:48.929862+0000","last_peered":"2024-05-10T08:47:48.929862+0000","last_clean":"2024-05-10T08:47:48.929862+0000","last_became_active":"2024-05-10T08:47:46.953232+0000","last_became_peered":"2024-05-10T08:47:46.953232+0000","last_unstale":"2024-05-10T08:47:48.929862+0000","last_undegraded":"2024-05-10T08:47:48.929862+0000","last_fullsized":"2024-05-10T08:47:48.929862+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:15.976333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930243+0000","last_change":"2024-05-10T08:47:45.952459+0000","last_active":"2024-05-10T08:47:48.930243+0000","last_peered":"2024-05-10T08:47:48.930243+0000","last_clean":"2024-05-10T08:47:48.930243+0000","last_became_active":"2024-05-10T08:47:45.952125+0000","last_became_peered":"2024-05-10T08:47:45.952125+0000","last_unstale":"2024-05-10T08:47:48.930243+0000","last_undegraded":"2024-05-10T08:47:48.930243+0000","last_fullsized":"2024-05-10T08:47:48.930243+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:54.499465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930492+0000","last_change":"2024-05-10T08:47:46.947814+0000","last_active":"2024-05-10T08:47:48.930492+0000","last_peered":"2024-05-10T08:47:48.930492+0000","last_clean":"2024-05-10T08:47:48.930492+0000","last_became_active":"2024-05-10T08:47:46.947513+0000","last_became_peered":"2024-05-10T08:47:46.947513+0000","last_unstale":"2024-05-10T08:47:48.930492+0000","last_undegraded":"2024-05-10T08:47:48.930492+0000","last_fullsized":"2024-05-10T08:47:48.930492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:58.101997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929446+0000","last_change":"2024-05-10T08:47:45.947317+0000","last_active":"2024-05-10T08:47:48.929446+0000","last_peered":"2024-05-10T08:47:48.929446+0000","last_clean":"2024-05-10T08:47:48.929446+0000","last_became_active":"2024-05-10T08:47:45.946998+0000","last_became_peered":"2024-05-10T08:47:45.946998+0000","last_unstale":"2024-05-10T08:47:48.929446+0000","last_undegraded":"2024-05-10T08:47:48.929446+0000","last_fullsized":"2024-05-10T08:47:48.929446+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:06:39.491530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855775+0000","last_change":"2024-05-10T08:47:46.957527+0000","last_active":"2024-05-10T08:47:48.855775+0000","last_peered":"2024-05-10T08:47:48.855775+0000","last_clean":"2024-05-10T08:47:48.855775+0000","last_became_active":"2024-05-10T08:47:46.957224+0000","last_became_peered":"2024-05-10T08:47:46.957224+0000","last_unstale":"2024-05-10T08:47:48.855775+0000","last_undegraded":"2024-05-10T08:47:48.855775+0000","last_fullsized":"2024-05-10T08:47:48.855775+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:37.303219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929616+0000","last_change":"2024-05-10T08:47:45.947067+0000","last_active":"2024-05-10T08:47:48.929616+0000","last_peered":"2024-05-10T08:47:48.929616+0000","last_clean":"2024-05-10T08:47:48.929616+0000","last_became_active":"2024-05-10T08:47:45.946107+0000","last_became_peered":"2024-05-10T08:47:45.946107+0000","last_unstale":"2024-05-10T08:47:48.929616+0000","last_undegraded":"2024-05-10T08:47:48.929616+0000","last_fullsized":"2024-05-10T08:47:48.929616+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:33.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930034+0000","last_change":"2024-05-10T08:47:46.963419+0000","last_active":"2024-05-10T08:47:48.930034+0000","last_peered":"2024-05-10T08:47:48.930034+0000","last_clean":"2024-05-10T08:47:48.930034+0000","last_became_active":"2024-05-10T08:47:46.963059+0000","last_became_peered":"2024-05-10T08:47:46.963059+0000","last_unstale":"2024-05-10T08:47:48.930034+0000","last_undegraded":"2024-05-10T08:47:48.930034+0000","last_fullsized":"2024-05-10T08:47:48.930034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:42.025251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929973+0000","last_change":"2024-05-10T08:47:45.945090+0000","last_active":"2024-05-10T08:47:48.929973+0000","last_peered":"2024-05-10T08:47:48.929973+0000","last_clean":"2024-05-10T08:47:48.929973+0000","last_became_active":"2024-05-10T08:47:45.944805+0000","last_became_peered":"2024-05-10T08:47:45.944805+0000","last_unstale":"2024-05-10T08:47:48.929973+0000","last_undegraded":"2024-05-10T08:47:48.929973+0000","last_fullsized":"2024-05-10T08:47:48.929973+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:45.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930225+0000","last_change":"2024-05-10T08:47:46.952463+0000","last_active":"2024-05-10T08:47:48.930225+0000","last_peered":"2024-05-10T08:47:48.930225+0000","last_clean":"2024-05-10T08:47:48.930225+0000","last_became_active":"2024-05-10T08:47:46.952192+0000","last_became_peered":"2024-05-10T08:47:46.952192+0000","last_unstale":"2024-05-10T08:47:48.930225+0000","last_undegraded":"2024-05-10T08:47:48.930225+0000","last_fullsized":"2024-05-10T08:47:48.930225+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:01.200192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934790+0000","last_change":"2024-05-10T08:47:45.946159+0000","last_active":"2024-05-10T08:47:47.934790+0000","last_peered":"2024-05-10T08:47:47.934790+0000","last_clean":"2024-05-10T08:47:47.934790+0000","last_became_active":"2024-05-10T08:47:45.945848+0000","last_became_peered":"2024-05-10T08:47:45.945848+0000","last_unstale":"2024-05-10T08:47:47.934790+0000","last_undegraded":"2024-05-10T08:47:47.934790+0000","last_fullsized":"2024-05-10T08:47:47.934790+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:44.827395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934385+0000","last_change":"2024-05-10T08:47:46.952748+0000","last_active":"2024-05-10T08:47:47.934385+0000","last_peered":"2024-05-10T08:47:47.934385+0000","last_clean":"2024-05-10T08:47:47.934385+0000","last_became_active":"2024-05-10T08:47:46.952466+0000","last_became_peered":"2024-05-10T08:47:46.952466+0000","last_unstale":"2024-05-10T08:47:47.934385+0000","last_undegraded":"2024-05-10T08:47:47.934385+0000","last_fullsized":"2024-05-10T08:47:47.934385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:44.547445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"103'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929952+0000","last_change":"2024-05-10T08:47:45.948810+0000","last_active":"2024-05-10T08:47:48.929952+0000","last_peered":"2024-05-10T08:47:48.929952+0000","last_clean":"2024-05-10T08:47:48.929952+0000","last_became_active":"2024-05-10T08:47:45.948512+0000","last_became_peered":"2024-05-10T08:47:45.948512+0000","last_unstale":"2024-05-10T08:47:48.929952+0000","last_undegraded":"2024-05-10T08:47:48.929952+0000","last_fullsized":"2024-05-10T08:47:48.929952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:36.300570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855693+0000","last_change":"2024-05-10T08:47:46.956986+0000","last_active":"2024-05-10T08:47:48.855693+0000","last_peered":"2024-05-10T08:47:48.855693+0000","last_clean":"2024-05-10T08:47:48.855693+0000","last_became_active":"2024-05-10T08:47:46.956669+0000","last_became_peered":"2024-05-10T08:47:46.956669+0000","last_unstale":"2024-05-10T08:47:48.855693+0000","last_undegraded":"2024-05-10T08:47:48.855693+0000","last_fullsized":"2024-05-10T08:47:48.855693+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:22.271792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929922+0000","last_change":"2024-05-10T08:47:45.951460+0000","last_active":"2024-05-10T08:47:48.929922+0000","last_peered":"2024-05-10T08:47:48.929922+0000","last_clean":"2024-05-10T08:47:48.929922+0000","last_became_active":"2024-05-10T08:47:45.951205+0000","last_became_peered":"2024-05-10T08:47:45.951205+0000","last_unstale":"2024-05-10T08:47:48.929922+0000","last_undegraded":"2024-05-10T08:47:48.929922+0000","last_fullsized":"2024-05-10T08:47:48.929922+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:22:42.828175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929840+0000","last_change":"2024-05-10T08:47:46.944737+0000","last_active":"2024-05-10T08:47:48.929840+0000","last_peered":"2024-05-10T08:47:48.929840+0000","last_clean":"2024-05-10T08:47:48.929840+0000","last_became_active":"2024-05-10T08:47:46.944458+0000","last_became_peered":"2024-05-10T08:47:46.944458+0000","last_unstale":"2024-05-10T08:47:48.929840+0000","last_undegraded":"2024-05-10T08:47:48.929840+0000","last_fullsized":"2024-05-10T08:47:48.929840+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:44:59.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934802+0000","last_change":"2024-05-10T08:47:45.949177+0000","last_active":"2024-05-10T08:47:47.934802+0000","last_peered":"2024-05-10T08:47:47.934802+0000","last_clean":"2024-05-10T08:47:47.934802+0000","last_became_active":"2024-05-10T08:47:45.948887+0000","last_became_peered":"2024-05-10T08:47:45.948887+0000","last_unstale":"2024-05-10T08:47:47.934802+0000","last_undegraded":"2024-05-10T08:47:47.934802+0000","last_fullsized":"2024-05-10T08:47:47.934802+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:46.677065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929940+0000","last_change":"2024-05-10T08:47:46.966147+0000","last_active":"2024-05-10T08:47:48.929940+0000","last_peered":"2024-05-10T08:47:48.929940+0000","last_clean":"2024-05-10T08:47:48.929940+0000","last_became_active":"2024-05-10T08:47:46.965236+0000","last_became_peered":"2024-05-10T08:47:46.965236+0000","last_unstale":"2024-05-10T08:47:48.929940+0000","last_undegraded":"2024-05-10T08:47:48.929940+0000","last_fullsized":"2024-05-10T08:47:48.929940+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:37.003446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934200+0000","last_change":"2024-05-10T08:47:45.944910+0000","last_active":"2024-05-10T08:47:47.934200+0000","last_peered":"2024-05-10T08:47:47.934200+0000","last_clean":"2024-05-10T08:47:47.934200+0000","last_became_active":"2024-05-10T08:47:45.944599+0000","last_became_peered":"2024-05-10T08:47:45.944599+0000","last_unstale":"2024-05-10T08:47:47.934200+0000","last_undegraded":"2024-05-10T08:47:47.934200+0000","last_fullsized":"2024-05-10T08:47:47.934200+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:05.081620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929737+0000","last_change":"2024-05-10T08:47:46.962873+0000","last_active":"2024-05-10T08:47:48.929737+0000","last_peered":"2024-05-10T08:47:48.929737+0000","last_clean":"2024-05-10T08:47:48.929737+0000","last_became_active":"2024-05-10T08:47:46.962584+0000","last_became_peered":"2024-05-10T08:47:46.962584+0000","last_unstale":"2024-05-10T08:47:48.929737+0000","last_undegraded":"2024-05-10T08:47:48.929737+0000","last_fullsized":"2024-05-10T08:47:48.929737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:47.921304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929845+0000","last_change":"2024-05-10T08:47:45.952529+0000","last_active":"2024-05-10T08:47:48.929845+0000","last_peered":"2024-05-10T08:47:48.929845+0000","last_clean":"2024-05-10T08:47:48.929845+0000","last_became_active":"2024-05-10T08:47:45.952203+0000","last_became_peered":"2024-05-10T08:47:45.952203+0000","last_unstale":"2024-05-10T08:47:48.929845+0000","last_undegraded":"2024-05-10T08:47:48.929845+0000","last_fullsized":"2024-05-10T08:47:48.929845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:30.561372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934799+0000","last_change":"2024-05-10T08:47:46.939329+0000","last_active":"2024-05-10T08:47:47.934799+0000","last_peered":"2024-05-10T08:47:47.934799+0000","last_clean":"2024-05-10T08:47:47.934799+0000","last_became_active":"2024-05-10T08:47:46.938942+0000","last_became_peered":"2024-05-10T08:47:46.938942+0000","last_unstale":"2024-05-10T08:47:47.934799+0000","last_undegraded":"2024-05-10T08:47:47.934799+0000","last_fullsized":"2024-05-10T08:47:47.934799+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:31.145944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929728+0000","last_change":"2024-05-10T08:47:45.951394+0000","last_active":"2024-05-10T08:47:48.929728+0000","last_peered":"2024-05-10T08:47:48.929728+0000","last_clean":"2024-05-10T08:47:48.929728+0000","last_became_active":"2024-05-10T08:47:45.951121+0000","last_became_peered":"2024-05-10T08:47:45.951121+0000","last_unstale":"2024-05-10T08:47:48.929728+0000","last_undegraded":"2024-05-10T08:47:48.929728+0000","last_fullsized":"2024-05-10T08:47:48.929728+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:45.507964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930553+0000","last_change":"2024-05-10T08:47:46.939045+0000","last_active":"2024-05-10T08:47:48.930553+0000","last_peered":"2024-05-10T08:47:48.930553+0000","last_clean":"2024-05-10T08:47:48.930553+0000","last_became_active":"2024-05-10T08:47:46.938746+0000","last_became_peered":"2024-05-10T08:47:46.938746+0000","last_unstale":"2024-05-10T08:47:48.930553+0000","last_undegraded":"2024-05-10T08:47:48.930553+0000","last_fullsized":"2024-05-10T08:47:48.930553+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:21.078958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930101+0000","last_change":"2024-05-10T08:47:45.952553+0000","last_active":"2024-05-10T08:47:48.930101+0000","last_peered":"2024-05-10T08:47:48.930101+0000","last_clean":"2024-05-10T08:47:48.930101+0000","last_became_active":"2024-05-10T08:47:45.952305+0000","last_became_peered":"2024-05-10T08:47:45.952305+0000","last_unstale":"2024-05-10T08:47:48.930101+0000","last_undegraded":"2024-05-10T08:47:48.930101+0000","last_fullsized":"2024-05-10T08:47:48.930101+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:08.308019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929461+0000","last_change":"2024-05-10T08:47:46.946221+0000","last_active":"2024-05-10T08:47:48.929461+0000","last_peered":"2024-05-10T08:47:48.929461+0000","last_clean":"2024-05-10T08:47:48.929461+0000","last_became_active":"2024-05-10T08:47:46.945733+0000","last_became_peered":"2024-05-10T08:47:46.945733+0000","last_unstale":"2024-05-10T08:47:48.929461+0000","last_undegraded":"2024-05-10T08:47:48.929461+0000","last_fullsized":"2024-05-10T08:47:48.929461+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:41.933192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929799+0000","last_change":"2024-05-10T08:47:45.945298+0000","last_active":"2024-05-10T08:47:48.929799+0000","last_peered":"2024-05-10T08:47:48.929799+0000","last_clean":"2024-05-10T08:47:48.929799+0000","last_became_active":"2024-05-10T08:47:45.944895+0000","last_became_peered":"2024-05-10T08:47:45.944895+0000","last_unstale":"2024-05-10T08:47:48.929799+0000","last_undegraded":"2024-05-10T08:47:48.929799+0000","last_fullsized":"2024-05-10T08:47:48.929799+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:08:16.310350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":265,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933697+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:47:47.933697+0000","last_peered":"2024-05-10T08:47:47.933697+0000","last_clean":"2024-05-10T08:47:47.933697+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:47:47.933697+0000","last_undegraded":"2024-05-10T08:47:47.933697+0000","last_fullsized":"2024-05-10T08:47:47.933697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1880064,"data_stored":1182738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1298432,"data_stored":594426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1277952,"data_stored":592210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1286144,"data_stored":592302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1888256,"data_stored":1184280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:47:51.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T08:47:51.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.866+0000 7f15df02a640 1 Processor -- start 2024-05-10T08:47:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.866+0000 7f15df02a640 1 -- start start 2024-05-10T08:47:51.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.866+0000 7f15df02a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15d80d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.866+0000 7f15df02a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d81630b0 con 0x7f15d80d4cc0 2024-05-10T08:47:51.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.866+0000 7f15df02a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d80d3e70 con 0x7f15d815f420 2024-05-10T08:47:51.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.866+0000 7f15df02a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15d80d2330 con 0x7f15d80d1970 2024-05-10T08:47:51.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15dd5c7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15d80d4cc0 0x7f15d80d5130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48686/0 (socket says 172.21.15.37:48686) 2024-05-10T08:47:51.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15dd5c7640 1 -- 172.21.15.37:0/698607823 learned_addr learned my addr 172.21.15.37:0/698607823 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:51.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188798353 0 0) 0x7f15d0001110 con 0x7f15d80d4cc0 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c4003520 con 0x7f15d80d4cc0 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d7fff640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15d80d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2857078611 0 0) 0x7f15c4003520 con 0x7f15d80d4cc0 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 msgr2=0x7f15d80d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15d80d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 >> v1:172.21.15.82:6789/0 conn(0x7f15d815f420 legacy=0x7f15d80d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d80d2550 con 0x7f15d80d4cc0 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f15d0001840 con 0x7f15d80d4cc0 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d7fff640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15d80d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 >> v1:172.21.15.37:6789/0 conn(0x7f15d80d4cc0 legacy=0x7f15d80d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4004d40 0x7f15c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15d80d2330 con 0x7f15c40039e0 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15c400bad0 con 0x7f15c4004d40 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15c400bcd0 con 0x7f15d80d1970 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15dcdc6640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15d7fff640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.867+0000 7f15dd5c7640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4004d40 0x7f15c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15dcdc6640 1 -- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 msgr2=0x7f15c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15dcdc6640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15dcdc6640 1 -- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4004d40 msgr2=0x7f15c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15dcdc6640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4004d40 0x7f15c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15dcdc6640 1 -- 172.21.15.37:0/698607823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c4003520 con 0x7f15c40039e0 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15d7fff640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d80d1970 0x7f15c4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15dd5c7640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c4004d40 0x7f15c40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:51.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15dcdc6640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15c4003e00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f15c8001e20 tx=0x7f15c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2daaf53faf15e85 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8001a70 con 0x7f15c40039e0 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c802ad70 con 0x7f15c40039e0 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.868+0000 7f15d77fe640 1 -- 172.21.15.37:0/698607823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8003bb0 con 0x7f15c40039e0 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.869+0000 7f15df02a640 1 -- 172.21.15.37:0/698607823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 msgr2=0x7f15c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.869+0000 7f15df02a640 1 --2- 172.21.15.37:0/698607823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15c4003e00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f15c8001e20 tx=0x7f15c4005830 comp rx=0 tx=0).stop 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.869+0000 7f15dd5c7640 1 -- 172.21.15.37:0/698607823 reap_dead start 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.869+0000 7f15df02a640 1 -- 172.21.15.37:0/698607823 shutdown_connections 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.869+0000 7f15df02a640 1 -- 172.21.15.37:0/698607823 >> 172.21.15.37:0/698607823 conn(0x7f15d808eac0 msgr2=0x7f15d809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.869+0000 7f15df02a640 1 -- 172.21.15.37:0/698607823 shutdown_connections 2024-05-10T08:47:51.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.869+0000 7f15df02a640 1 -- 172.21.15.37:0/698607823 wait complete. 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.870+0000 7f15df02a640 1 Processor -- start 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.870+0000 7f15df02a640 1 -- start start 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15df02a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15d80cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15df02a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d814edf0 0x7f15d814bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15df02a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d8162120 0x7f15d80d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15df02a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15d80d3240 con 0x7f15c40039e0 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15df02a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15d80d2f60 con 0x7f15d814edf0 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15df02a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15d80d2830 con 0x7f15d8162120 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15dcdc6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15d80cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15dcdc6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15d80cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59004/0 (socket says 172.21.15.37:59004) 2024-05-10T08:47:51.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15dcdc6640 1 -- 172.21.15.37:0/3500038705 learned_addr learned my addr 172.21.15.37:0/3500038705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15d7fff640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d814edf0 0x7f15d814bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.871+0000 7f15dd5c7640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d8162120 0x7f15d80d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15dcdc6640 1 -- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d8162120 msgr2=0x7f15d80d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15dcdc6640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d8162120 0x7f15d80d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15dcdc6640 1 -- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d814edf0 msgr2=0x7f15d814bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15dcdc6640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d814edf0 0x7f15d814bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15dcdc6640 1 -- 172.21.15.37:0/3500038705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d814c070 con 0x7f15c40039e0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15d7fff640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d814edf0 0x7f15d814bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15dcdc6640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15d80cc0e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f15c8001e80 tx=0x7f15c80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15d57fa640 1 -- 172.21.15.37:0/3500038705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8037040 con 0x7f15c40039e0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15d57fa640 1 -- 172.21.15.37:0/3500038705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c8041070 con 0x7f15c40039e0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d8161100 con 0x7f15c40039e0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15d57fa640 1 -- 172.21.15.37:0/3500038705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8001a70 con 0x7f15c40039e0 2024-05-10T08:47:51.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.872+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d8161640 con 0x7f15c40039e0 2024-05-10T08:47:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.873+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d80693f0 con 0x7f15c40039e0 2024-05-10T08:47:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.874+0000 7f15d57fa640 1 -- 172.21.15.37:0/3500038705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f15c8007030 con 0x7f15c40039e0 2024-05-10T08:47:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.874+0000 7f15d57fa640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15b8076300 0x7f15b80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.874+0000 7f15d57fa640 1 -- 172.21.15.37:0/3500038705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f15c80b7aa0 con 0x7f15c40039e0 2024-05-10T08:47:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.874+0000 7f15d7fff640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15b8076300 0x7f15b80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.875+0000 7f15d7fff640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15b8076300 0x7f15b80787c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f15d80cea90 tx=0x7f15c0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:51.878+0000 7f15d57fa640 1 -- 172.21.15.37:0/3500038705 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f15c8081270 con 0x7f15c40039e0 2024-05-10T08:47:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.144+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f15d80b4c50 con 0x7f15c40039e0 2024-05-10T08:47:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.145+0000 7f15d57fa640 1 -- 172.21.15.37:0/3500038705 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1176 (secure 0 0 0) 0x7f15c8080b70 con 0x7f15c40039e0 2024-05-10T08:47:52.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:52.144 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":473,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":103,"num_osds":8,"num_up_osds":8,"osd_up_since":1715330409,"num_in_osds":8,"osd_in_since":1715330401,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":266911744,"bytes_avail":772827201536,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":81,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7455}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-05-10T08:47:15.427204+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15b8076300 msgr2=0x7f15b80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15b8076300 0x7f15b80787c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f15d80cea90 tx=0x7f15c0008040 comp rx=0 tx=0).stop 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 msgr2=0x7f15d80cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15d80cc0e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f15c8001e80 tx=0x7f15c80014a0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 shutdown_connections 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15b8076300 0x7f15b80787c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15d8162120 0x7f15d80d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d814edf0 0x7f15d814bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 --2- 172.21.15.37:0/3500038705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c40039e0 0x7f15d80cc0e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 >> 172.21.15.37:0/3500038705 conn(0x7f15d808eac0 msgr2=0x7f15d806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 shutdown_connections 2024-05-10T08:47:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.147+0000 7f15df02a640 1 -- 172.21.15.37:0/3500038705 wait complete. 2024-05-10T08:47:52.156 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T08:47:52.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:47:52.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.262+0000 7f740a408640 1 Processor -- start 2024-05-10T08:47:52.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.262+0000 7f740a408640 1 -- start start 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.262+0000 7f740a408640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f740415f420 0x7f74040d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.262+0000 7f740a408640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74041630b0 con 0x7f74040d2080 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.262+0000 7f740a408640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74040d2550 con 0x7f74040d3ca0 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f740a408640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f74040d2c80 con 0x7f740415f420 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f74089a5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f74040d2080 0x7f74040d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48694/0 (socket says 172.21.15.37:48694) 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f74089a5640 1 -- 172.21.15.37:0/145547900 learned_addr learned my addr 172.21.15.37:0/145547900 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636329903 0 0) 0x7f73fc001490 con 0x7f74040d2080 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ec003520 con 0x7f74040d2080 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7403fff640 1 --2- 172.21.15.37:0/145547900 >> v2:172.21.15.82:3300/0 conn(0x7f740415f420 0x7f74040d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1026123801 0 0) 0x7f73ec003520 con 0x7f74040d2080 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 >> v2:172.21.15.82:3300/0 conn(0x7f740415f420 msgr2=0x7f74040d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 --2- 172.21.15.37:0/145547900 >> v2:172.21.15.82:3300/0 conn(0x7f740415f420 0x7f74040d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 >> v1:172.21.15.82:6789/0 conn(0x7f74040d3ca0 legacy=0x7f74040d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74040d2f60 con 0x7f74040d2080 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f73fc001bc0 con 0x7f74040d2080 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 >> v1:172.21.15.37:6789/0 conn(0x7f74040d2080 legacy=0x7f74040d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec0039b0 0x7f73ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f73ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec0051c0 0x7f73ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74040d2c80 con 0x7f73ec004800 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec00c060 con 0x7f73ec0039b0 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f73ec00c260 con 0x7f73ec0051c0 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.263+0000 7f74037fe640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f73ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f7403fff640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec0039b0 0x7f73ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74089a5640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec0051c0 0x7f73ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74037fe640 1 -- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec0051c0 msgr2=0x7f73ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74037fe640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec0051c0 0x7f73ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74037fe640 1 -- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec0039b0 msgr2=0x7f73ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74037fe640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ec0039b0 0x7f73ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74037fe640 1 -- 172.21.15.37:0/145547900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec003520 con 0x7f73ec004800 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74089a5640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f73ec0051c0 0x7f73ec00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74089a5640 1 -- 172.21.15.37:0/145547900 reap_dead start 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.264+0000 7f74037fe640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f73ec004c80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001720 tx=0x7f73ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f414d5e53780a1e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8001370 con 0x7f73ec004800 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f80052d0 con 0x7f73ec004800 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f7402ffd640 1 -- 172.21.15.37:0/145547900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f802ab90 con 0x7f73ec004800 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f740a408640 1 -- 172.21.15.37:0/145547900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 msgr2=0x7f73ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f740a408640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f73ec004c80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001720 tx=0x7f73ec005830 comp rx=0 tx=0).stop 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f740a408640 1 -- 172.21.15.37:0/145547900 shutdown_connections 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f740a408640 1 --2- 172.21.15.37:0/145547900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f73ec004c80 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f740a408640 1 -- 172.21.15.37:0/145547900 >> 172.21.15.37:0/145547900 conn(0x7f740408eac0 msgr2=0x7f740409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:52.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f740a408640 1 -- 172.21.15.37:0/145547900 shutdown_connections 2024-05-10T08:47:52.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.265+0000 7f740a408640 1 -- 172.21.15.37:0/145547900 wait complete. 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.266+0000 7f740a408640 1 Processor -- start 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f740a408640 1 -- start start 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f740a408640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f74041f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f740a408640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74041f9900 0x7f74040b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f740a408640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f740415a590 0x7f74040b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f740a408640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74040d3760 con 0x7f73ec004800 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f740a408640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f74040d2830 con 0x7f74041f9900 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f740a408640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f74040d38e0 con 0x7f740415a590 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f7403fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f74041f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f7403fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f74041f93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59036/0 (socket says 172.21.15.37:59036) 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.267+0000 7f7403fff640 1 -- 172.21.15.37:0/2402401028 learned_addr learned my addr 172.21.15.37:0/2402401028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:52.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f74089a5640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f740415a590 0x7f74040b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f74037fe640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74041f9900 0x7f74040b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7403fff640 1 -- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f740415a590 msgr2=0x7f74040b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7403fff640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f740415a590 0x7f74040b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7403fff640 1 -- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74041f9900 msgr2=0x7f74040b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7403fff640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74041f9900 0x7f74040b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7403fff640 1 -- 172.21.15.37:0/2402401028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74040c8d30 con 0x7f73ec004800 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7403fff640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f74041f93c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f73f4011aa0 tx=0x7f73f4011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7400ff9640 1 -- 172.21.15.37:0/2402401028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f400fb80 con 0x7f73ec004800 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7400ff9640 1 -- 172.21.15.37:0/2402401028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f400fd20 con 0x7f73ec004800 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74040c9010 con 0x7f73ec004800 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f7400ff9640 1 -- 172.21.15.37:0/2402401028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4014660 con 0x7f73ec004800 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.268+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74040cea80 con 0x7f73ec004800 2024-05-10T08:47:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.269+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74040693f0 con 0x7f73ec004800 2024-05-10T08:47:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.270+0000 7f7400ff9640 1 -- 172.21.15.37:0/2402401028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f73f4012040 con 0x7f73ec004800 2024-05-10T08:47:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.270+0000 7f7400ff9640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73f00762d0 0x7f73f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.270+0000 7f7400ff9640 1 -- 172.21.15.37:0/2402401028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f73f4097d30 con 0x7f73ec004800 2024-05-10T08:47:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.271+0000 7f74037fe640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73f00762d0 0x7f73f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.271+0000 7f74037fe640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73f00762d0 0x7f73f0078790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f73f8032000 tx=0x7f73f802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.275+0000 7f7400ff9640 1 -- 172.21.15.37:0/2402401028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f73f4019030 con 0x7f73ec004800 2024-05-10T08:47:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.462+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74040c8ae0 con 0x7f73f00762d0 2024-05-10T08:47:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.469+0000 7f7400ff9640 1 -- 172.21.15.37:0/2402401028 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f73f807fa50 con 0x7f73f00762d0 2024-05-10T08:47:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:47:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73f00762d0 msgr2=0x7f73f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73f00762d0 0x7f73f0078790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f73f8032000 tx=0x7f73f802e000 comp rx=0 tx=0).stop 2024-05-10T08:47:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 msgr2=0x7f74041f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f74041f93c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f73f4011aa0 tx=0x7f73f4011f60 comp rx=0 tx=0).stop 2024-05-10T08:47:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 shutdown_connections 2024-05-10T08:47:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f73f00762d0 0x7f73f0078790 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f740415a590 0x7f74040b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74041f9900 0x7f74040b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 --2- 172.21.15.37:0/2402401028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec004800 0x7f74041f93c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.471+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 >> 172.21.15.37:0/2402401028 conn(0x7f740408eac0 msgr2=0x7f740415d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.472+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 shutdown_connections 2024-05-10T08:47:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:52.472+0000 7f740a408640 1 -- 172.21.15.37:0/2402401028 wait complete. 2024-05-10T08:47:52.481 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-05-10T08:47:51.435402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260656,"kb_used_data":11208,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714064,"statfs":{"total":773094113280,"available":772827201536,"internally_reserved":0,"allocated":11476992,"data_stored":5923236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001467"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930445+0000","last_change":"2024-05-10T08:47:46.952665+0000","last_active":"2024-05-10T08:47:48.930445+0000","last_peered":"2024-05-10T08:47:48.930445+0000","last_clean":"2024-05-10T08:47:48.930445+0000","last_became_active":"2024-05-10T08:47:46.952409+0000","last_became_peered":"2024-05-10T08:47:46.952409+0000","last_unstale":"2024-05-10T08:47:48.930445+0000","last_undegraded":"2024-05-10T08:47:48.930445+0000","last_fullsized":"2024-05-10T08:47:48.930445+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:34.485421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930124+0000","last_change":"2024-05-10T08:47:46.962426+0000","last_active":"2024-05-10T08:47:48.930124+0000","last_peered":"2024-05-10T08:47:48.930124+0000","last_clean":"2024-05-10T08:47:48.930124+0000","last_became_active":"2024-05-10T08:47:46.962145+0000","last_became_peered":"2024-05-10T08:47:46.962145+0000","last_unstale":"2024-05-10T08:47:48.930124+0000","last_undegraded":"2024-05-10T08:47:48.930124+0000","last_fullsized":"2024-05-10T08:47:48.930124+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930307+0000","last_change":"2024-05-10T08:47:46.955209+0000","last_active":"2024-05-10T08:47:48.930307+0000","last_peered":"2024-05-10T08:47:48.930307+0000","last_clean":"2024-05-10T08:47:48.930307+0000","last_became_active":"2024-05-10T08:47:46.954892+0000","last_became_peered":"2024-05-10T08:47:46.954892+0000","last_unstale":"2024-05-10T08:47:48.930307+0000","last_undegraded":"2024-05-10T08:47:48.930307+0000","last_fullsized":"2024-05-10T08:47:48.930307+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:40.417564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855668+0000","last_change":"2024-05-10T08:47:46.951651+0000","last_active":"2024-05-10T08:47:48.855668+0000","last_peered":"2024-05-10T08:47:48.855668+0000","last_clean":"2024-05-10T08:47:48.855668+0000","last_became_active":"2024-05-10T08:47:46.951388+0000","last_became_peered":"2024-05-10T08:47:46.951388+0000","last_unstale":"2024-05-10T08:47:48.855668+0000","last_undegraded":"2024-05-10T08:47:48.855668+0000","last_fullsized":"2024-05-10T08:47:48.855668+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:35.545609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934700+0000","last_change":"2024-05-10T08:47:46.958677+0000","last_active":"2024-05-10T08:47:47.934700+0000","last_peered":"2024-05-10T08:47:47.934700+0000","last_clean":"2024-05-10T08:47:47.934700+0000","last_became_active":"2024-05-10T08:47:46.958425+0000","last_became_peered":"2024-05-10T08:47:46.958425+0000","last_unstale":"2024-05-10T08:47:47.934700+0000","last_undegraded":"2024-05-10T08:47:47.934700+0000","last_fullsized":"2024-05-10T08:47:47.934700+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929931+0000","last_change":"2024-05-10T08:47:46.961009+0000","last_active":"2024-05-10T08:47:48.929931+0000","last_peered":"2024-05-10T08:47:48.929931+0000","last_clean":"2024-05-10T08:47:48.929931+0000","last_became_active":"2024-05-10T08:47:46.960659+0000","last_became_peered":"2024-05-10T08:47:46.960659+0000","last_unstale":"2024-05-10T08:47:48.929931+0000","last_undegraded":"2024-05-10T08:47:48.929931+0000","last_fullsized":"2024-05-10T08:47:48.929931+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929541+0000","last_change":"2024-05-10T08:47:46.953451+0000","last_active":"2024-05-10T08:47:48.929541+0000","last_peered":"2024-05-10T08:47:48.929541+0000","last_clean":"2024-05-10T08:47:48.929541+0000","last_became_active":"2024-05-10T08:47:46.953175+0000","last_became_peered":"2024-05-10T08:47:46.953175+0000","last_unstale":"2024-05-10T08:47:48.929541+0000","last_undegraded":"2024-05-10T08:47:48.929541+0000","last_fullsized":"2024-05-10T08:47:48.929541+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929904+0000","last_change":"2024-05-10T08:47:46.966090+0000","last_active":"2024-05-10T08:47:48.929904+0000","last_peered":"2024-05-10T08:47:48.929904+0000","last_clean":"2024-05-10T08:47:48.929904+0000","last_became_active":"2024-05-10T08:47:46.965256+0000","last_became_peered":"2024-05-10T08:47:46.965256+0000","last_unstale":"2024-05-10T08:47:48.929904+0000","last_undegraded":"2024-05-10T08:47:48.929904+0000","last_fullsized":"2024-05-10T08:47:48.929904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:55:05.342516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929528+0000","last_change":"2024-05-10T08:47:46.964209+0000","last_active":"2024-05-10T08:47:48.929528+0000","last_peered":"2024-05-10T08:47:48.929528+0000","last_clean":"2024-05-10T08:47:48.929528+0000","last_became_active":"2024-05-10T08:47:46.963893+0000","last_became_peered":"2024-05-10T08:47:46.963893+0000","last_unstale":"2024-05-10T08:47:48.929528+0000","last_undegraded":"2024-05-10T08:47:48.929528+0000","last_fullsized":"2024-05-10T08:47:48.929528+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934885+0000","last_change":"2024-05-10T08:47:46.954341+0000","last_active":"2024-05-10T08:47:47.934885+0000","last_peered":"2024-05-10T08:47:47.934885+0000","last_clean":"2024-05-10T08:47:47.934885+0000","last_became_active":"2024-05-10T08:47:46.954043+0000","last_became_peered":"2024-05-10T08:47:46.954043+0000","last_unstale":"2024-05-10T08:47:47.934885+0000","last_undegraded":"2024-05-10T08:47:47.934885+0000","last_fullsized":"2024-05-10T08:47:47.934885+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930534+0000","last_change":"2024-05-10T08:47:46.954094+0000","last_active":"2024-05-10T08:47:48.930534+0000","last_peered":"2024-05-10T08:47:48.930534+0000","last_clean":"2024-05-10T08:47:48.930534+0000","last_became_active":"2024-05-10T08:47:46.953761+0000","last_became_peered":"2024-05-10T08:47:46.953761+0000","last_unstale":"2024-05-10T08:47:48.930534+0000","last_undegraded":"2024-05-10T08:47:48.930534+0000","last_fullsized":"2024-05-10T08:47:48.930534+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:03.990956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934536+0000","last_change":"2024-05-10T08:47:46.956579+0000","last_active":"2024-05-10T08:47:47.934536+0000","last_peered":"2024-05-10T08:47:47.934536+0000","last_clean":"2024-05-10T08:47:47.934536+0000","last_became_active":"2024-05-10T08:47:46.955068+0000","last_became_peered":"2024-05-10T08:47:46.955068+0000","last_unstale":"2024-05-10T08:47:47.934536+0000","last_undegraded":"2024-05-10T08:47:47.934536+0000","last_fullsized":"2024-05-10T08:47:47.934536+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855547+0000","last_change":"2024-05-10T08:47:46.948562+0000","last_active":"2024-05-10T08:47:48.855547+0000","last_peered":"2024-05-10T08:47:48.855547+0000","last_clean":"2024-05-10T08:47:48.855547+0000","last_became_active":"2024-05-10T08:47:46.948287+0000","last_became_peered":"2024-05-10T08:47:46.948287+0000","last_unstale":"2024-05-10T08:47:48.855547+0000","last_undegraded":"2024-05-10T08:47:48.855547+0000","last_fullsized":"2024-05-10T08:47:48.855547+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:10.442062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933979+0000","last_change":"2024-05-10T08:47:46.951596+0000","last_active":"2024-05-10T08:47:47.933979+0000","last_peered":"2024-05-10T08:47:47.933979+0000","last_clean":"2024-05-10T08:47:47.933979+0000","last_became_active":"2024-05-10T08:47:46.951293+0000","last_became_peered":"2024-05-10T08:47:46.951293+0000","last_unstale":"2024-05-10T08:47:47.933979+0000","last_undegraded":"2024-05-10T08:47:47.933979+0000","last_fullsized":"2024-05-10T08:47:47.933979+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933798+0000","last_change":"2024-05-10T08:47:46.941772+0000","last_active":"2024-05-10T08:47:47.933798+0000","last_peered":"2024-05-10T08:47:47.933798+0000","last_clean":"2024-05-10T08:47:47.933798+0000","last_became_active":"2024-05-10T08:47:46.941508+0000","last_became_peered":"2024-05-10T08:47:46.941508+0000","last_unstale":"2024-05-10T08:47:47.933798+0000","last_undegraded":"2024-05-10T08:47:47.933798+0000","last_fullsized":"2024-05-10T08:47:47.933798+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933637+0000","last_change":"2024-05-10T08:47:46.956064+0000","last_active":"2024-05-10T08:47:47.933637+0000","last_peered":"2024-05-10T08:47:47.933637+0000","last_clean":"2024-05-10T08:47:47.933637+0000","last_became_active":"2024-05-10T08:47:46.955795+0000","last_became_peered":"2024-05-10T08:47:46.955795+0000","last_unstale":"2024-05-10T08:47:47.933637+0000","last_undegraded":"2024-05-10T08:47:47.933637+0000","last_fullsized":"2024-05-10T08:47:47.933637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930479+0000","last_change":"2024-05-10T08:47:46.954708+0000","last_active":"2024-05-10T08:47:48.930479+0000","last_peered":"2024-05-10T08:47:48.930479+0000","last_clean":"2024-05-10T08:47:48.930479+0000","last_became_active":"2024-05-10T08:47:46.954415+0000","last_became_peered":"2024-05-10T08:47:46.954415+0000","last_unstale":"2024-05-10T08:47:48.930479+0000","last_undegraded":"2024-05-10T08:47:48.930479+0000","last_fullsized":"2024-05-10T08:47:48.930479+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:24.396227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930276+0000","last_change":"2024-05-10T08:47:46.961735+0000","last_active":"2024-05-10T08:47:48.930276+0000","last_peered":"2024-05-10T08:47:48.930276+0000","last_clean":"2024-05-10T08:47:48.930276+0000","last_became_active":"2024-05-10T08:47:46.961476+0000","last_became_peered":"2024-05-10T08:47:46.961476+0000","last_unstale":"2024-05-10T08:47:48.930276+0000","last_undegraded":"2024-05-10T08:47:48.930276+0000","last_fullsized":"2024-05-10T08:47:48.930276+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:02.677927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930385+0000","last_change":"2024-05-10T08:47:46.958611+0000","last_active":"2024-05-10T08:47:48.930385+0000","last_peered":"2024-05-10T08:47:48.930385+0000","last_clean":"2024-05-10T08:47:48.930385+0000","last_became_active":"2024-05-10T08:47:46.957729+0000","last_became_peered":"2024-05-10T08:47:46.957729+0000","last_unstale":"2024-05-10T08:47:48.930385+0000","last_undegraded":"2024-05-10T08:47:48.930385+0000","last_fullsized":"2024-05-10T08:47:48.930385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:06:12.102854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934739+0000","last_change":"2024-05-10T08:47:46.952310+0000","last_active":"2024-05-10T08:47:47.934739+0000","last_peered":"2024-05-10T08:47:47.934739+0000","last_clean":"2024-05-10T08:47:47.934739+0000","last_became_active":"2024-05-10T08:47:46.951861+0000","last_became_peered":"2024-05-10T08:47:46.951861+0000","last_unstale":"2024-05-10T08:47:47.934739+0000","last_undegraded":"2024-05-10T08:47:47.934739+0000","last_fullsized":"2024-05-10T08:47:47.934739+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930104+0000","last_change":"2024-05-10T08:47:46.963435+0000","last_active":"2024-05-10T08:47:48.930104+0000","last_peered":"2024-05-10T08:47:48.930104+0000","last_clean":"2024-05-10T08:47:48.930104+0000","last_became_active":"2024-05-10T08:47:46.962767+0000","last_became_peered":"2024-05-10T08:47:46.962767+0000","last_unstale":"2024-05-10T08:47:48.930104+0000","last_undegraded":"2024-05-10T08:47:48.930104+0000","last_fullsized":"2024-05-10T08:47:48.930104+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:44:39.794997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934691+0000","last_change":"2024-05-10T08:47:46.940223+0000","last_active":"2024-05-10T08:47:47.934691+0000","last_peered":"2024-05-10T08:47:47.934691+0000","last_clean":"2024-05-10T08:47:47.934691+0000","last_became_active":"2024-05-10T08:47:46.939314+0000","last_became_peered":"2024-05-10T08:47:46.939314+0000","last_unstale":"2024-05-10T08:47:47.934691+0000","last_undegraded":"2024-05-10T08:47:47.934691+0000","last_fullsized":"2024-05-10T08:47:47.934691+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930189+0000","last_change":"2024-05-10T08:47:46.954208+0000","last_active":"2024-05-10T08:47:48.930189+0000","last_peered":"2024-05-10T08:47:48.930189+0000","last_clean":"2024-05-10T08:47:48.930189+0000","last_became_active":"2024-05-10T08:47:46.953886+0000","last_became_peered":"2024-05-10T08:47:46.953886+0000","last_unstale":"2024-05-10T08:47:48.930189+0000","last_undegraded":"2024-05-10T08:47:48.930189+0000","last_fullsized":"2024-05-10T08:47:48.930189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:36.078442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934604+0000","last_change":"2024-05-10T08:47:46.950352+0000","last_active":"2024-05-10T08:47:47.934604+0000","last_peered":"2024-05-10T08:47:47.934604+0000","last_clean":"2024-05-10T08:47:47.934604+0000","last_became_active":"2024-05-10T08:47:46.950079+0000","last_became_peered":"2024-05-10T08:47:46.950079+0000","last_unstale":"2024-05-10T08:47:47.934604+0000","last_undegraded":"2024-05-10T08:47:47.934604+0000","last_fullsized":"2024-05-10T08:47:47.934604+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934852+0000","last_change":"2024-05-10T08:47:46.954776+0000","last_active":"2024-05-10T08:47:47.934852+0000","last_peered":"2024-05-10T08:47:47.934852+0000","last_clean":"2024-05-10T08:47:47.934852+0000","last_became_active":"2024-05-10T08:47:46.954481+0000","last_became_peered":"2024-05-10T08:47:46.954481+0000","last_unstale":"2024-05-10T08:47:47.934852+0000","last_undegraded":"2024-05-10T08:47:47.934852+0000","last_fullsized":"2024-05-10T08:47:47.934852+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934711+0000","last_change":"2024-05-10T08:47:46.955415+0000","last_active":"2024-05-10T08:47:47.934711+0000","last_peered":"2024-05-10T08:47:47.934711+0000","last_clean":"2024-05-10T08:47:47.934711+0000","last_became_active":"2024-05-10T08:47:46.955090+0000","last_became_peered":"2024-05-10T08:47:46.955090+0000","last_unstale":"2024-05-10T08:47:47.934711+0000","last_undegraded":"2024-05-10T08:47:47.934711+0000","last_fullsized":"2024-05-10T08:47:47.934711+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930597+0000","last_change":"2024-05-10T08:47:46.946695+0000","last_active":"2024-05-10T08:47:48.930597+0000","last_peered":"2024-05-10T08:47:48.930597+0000","last_clean":"2024-05-10T08:47:48.930597+0000","last_became_active":"2024-05-10T08:47:46.946380+0000","last_became_peered":"2024-05-10T08:47:46.946380+0000","last_unstale":"2024-05-10T08:47:48.930597+0000","last_undegraded":"2024-05-10T08:47:48.930597+0000","last_fullsized":"2024-05-10T08:47:48.930597+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:44.547445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929856+0000","last_change":"2024-05-10T08:47:46.962200+0000","last_active":"2024-05-10T08:47:48.929856+0000","last_peered":"2024-05-10T08:47:48.929856+0000","last_clean":"2024-05-10T08:47:48.929856+0000","last_became_active":"2024-05-10T08:47:46.961918+0000","last_became_peered":"2024-05-10T08:47:46.961918+0000","last_unstale":"2024-05-10T08:47:48.929856+0000","last_undegraded":"2024-05-10T08:47:48.929856+0000","last_fullsized":"2024-05-10T08:47:48.929856+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930203+0000","last_change":"2024-05-10T08:47:46.961715+0000","last_active":"2024-05-10T08:47:48.930203+0000","last_peered":"2024-05-10T08:47:48.930203+0000","last_clean":"2024-05-10T08:47:48.930203+0000","last_became_active":"2024-05-10T08:47:46.961438+0000","last_became_peered":"2024-05-10T08:47:46.961438+0000","last_unstale":"2024-05-10T08:47:48.930203+0000","last_undegraded":"2024-05-10T08:47:48.930203+0000","last_fullsized":"2024-05-10T08:47:48.930203+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:17.069869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934135+0000","last_change":"2024-05-10T08:47:46.958806+0000","last_active":"2024-05-10T08:47:47.934135+0000","last_peered":"2024-05-10T08:47:47.934135+0000","last_clean":"2024-05-10T08:47:47.934135+0000","last_became_active":"2024-05-10T08:47:46.958544+0000","last_became_peered":"2024-05-10T08:47:46.958544+0000","last_unstale":"2024-05-10T08:47:47.934135+0000","last_undegraded":"2024-05-10T08:47:47.934135+0000","last_fullsized":"2024-05-10T08:47:47.934135+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:03.990956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929731+0000","last_change":"2024-05-10T08:47:46.951712+0000","last_active":"2024-05-10T08:47:48.929731+0000","last_peered":"2024-05-10T08:47:48.929731+0000","last_clean":"2024-05-10T08:47:48.929731+0000","last_became_active":"2024-05-10T08:47:46.951338+0000","last_became_peered":"2024-05-10T08:47:46.951338+0000","last_unstale":"2024-05-10T08:47:48.929731+0000","last_undegraded":"2024-05-10T08:47:48.929731+0000","last_fullsized":"2024-05-10T08:47:48.929731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929552+0000","last_change":"2024-05-10T08:47:46.962281+0000","last_active":"2024-05-10T08:47:48.929552+0000","last_peered":"2024-05-10T08:47:48.929552+0000","last_clean":"2024-05-10T08:47:48.929552+0000","last_became_active":"2024-05-10T08:47:46.961740+0000","last_became_peered":"2024-05-10T08:47:46.961740+0000","last_unstale":"2024-05-10T08:47:48.929552+0000","last_undegraded":"2024-05-10T08:47:48.929552+0000","last_fullsized":"2024-05-10T08:47:48.929552+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:57:41.454259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929982+0000","last_change":"2024-05-10T08:47:46.955769+0000","last_active":"2024-05-10T08:47:48.929982+0000","last_peered":"2024-05-10T08:47:48.929982+0000","last_clean":"2024-05-10T08:47:48.929982+0000","last_became_active":"2024-05-10T08:47:46.955448+0000","last_became_peered":"2024-05-10T08:47:46.955448+0000","last_unstale":"2024-05-10T08:47:48.929982+0000","last_undegraded":"2024-05-10T08:47:48.929982+0000","last_fullsized":"2024-05-10T08:47:48.929982+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:23.661741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"102'4","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855800+0000","last_change":"2024-05-10T08:47:45.951357+0000","last_active":"2024-05-10T08:47:48.855800+0000","last_peered":"2024-05-10T08:47:48.855800+0000","last_clean":"2024-05-10T08:47:48.855800+0000","last_became_active":"2024-05-10T08:47:45.951083+0000","last_became_peered":"2024-05-10T08:47:45.951083+0000","last_unstale":"2024-05-10T08:47:48.855800+0000","last_undegraded":"2024-05-10T08:47:48.855800+0000","last_fullsized":"2024-05-10T08:47:48.855800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:01.675277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929602+0000","last_change":"2024-05-10T08:47:46.966051+0000","last_active":"2024-05-10T08:47:48.929602+0000","last_peered":"2024-05-10T08:47:48.929602+0000","last_clean":"2024-05-10T08:47:48.929602+0000","last_became_active":"2024-05-10T08:47:46.965324+0000","last_became_peered":"2024-05-10T08:47:46.965324+0000","last_unstale":"2024-05-10T08:47:48.929602+0000","last_undegraded":"2024-05-10T08:47:48.929602+0000","last_fullsized":"2024-05-10T08:47:48.929602+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:51.388979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929695+0000","last_change":"2024-05-10T08:47:45.950505+0000","last_active":"2024-05-10T08:47:48.929695+0000","last_peered":"2024-05-10T08:47:48.929695+0000","last_clean":"2024-05-10T08:47:48.929695+0000","last_became_active":"2024-05-10T08:47:45.950196+0000","last_became_peered":"2024-05-10T08:47:45.950196+0000","last_unstale":"2024-05-10T08:47:48.929695+0000","last_undegraded":"2024-05-10T08:47:48.929695+0000","last_fullsized":"2024-05-10T08:47:48.929695+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:24.404918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934299+0000","last_change":"2024-05-10T08:47:46.951545+0000","last_active":"2024-05-10T08:47:47.934299+0000","last_peered":"2024-05-10T08:47:47.934299+0000","last_clean":"2024-05-10T08:47:47.934299+0000","last_became_active":"2024-05-10T08:47:46.951280+0000","last_became_peered":"2024-05-10T08:47:46.951280+0000","last_unstale":"2024-05-10T08:47:47.934299+0000","last_undegraded":"2024-05-10T08:47:47.934299+0000","last_fullsized":"2024-05-10T08:47:47.934299+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:21.078958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933613+0000","last_change":"2024-05-10T08:47:45.945401+0000","last_active":"2024-05-10T08:47:47.933613+0000","last_peered":"2024-05-10T08:47:47.933613+0000","last_clean":"2024-05-10T08:47:47.933613+0000","last_became_active":"2024-05-10T08:47:45.945054+0000","last_became_peered":"2024-05-10T08:47:45.945054+0000","last_unstale":"2024-05-10T08:47:47.933613+0000","last_undegraded":"2024-05-10T08:47:47.933613+0000","last_fullsized":"2024-05-10T08:47:47.933613+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:22:42.828175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930014+0000","last_change":"2024-05-10T08:47:46.959135+0000","last_active":"2024-05-10T08:47:48.930014+0000","last_peered":"2024-05-10T08:47:48.930014+0000","last_clean":"2024-05-10T08:47:48.930014+0000","last_became_active":"2024-05-10T08:47:46.958884+0000","last_became_peered":"2024-05-10T08:47:46.958884+0000","last_unstale":"2024-05-10T08:47:48.930014+0000","last_undegraded":"2024-05-10T08:47:48.930014+0000","last_fullsized":"2024-05-10T08:47:48.930014+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:32.633950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934703+0000","last_change":"2024-05-10T08:47:45.946621+0000","last_active":"2024-05-10T08:47:47.934703+0000","last_peered":"2024-05-10T08:47:47.934703+0000","last_clean":"2024-05-10T08:47:47.934703+0000","last_became_active":"2024-05-10T08:47:45.946083+0000","last_became_peered":"2024-05-10T08:47:45.946083+0000","last_unstale":"2024-05-10T08:47:47.934703+0000","last_undegraded":"2024-05-10T08:47:47.934703+0000","last_fullsized":"2024-05-10T08:47:47.934703+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:24.502072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855698+0000","last_change":"2024-05-10T08:47:46.947194+0000","last_active":"2024-05-10T08:47:48.855698+0000","last_peered":"2024-05-10T08:47:48.855698+0000","last_clean":"2024-05-10T08:47:48.855698+0000","last_became_active":"2024-05-10T08:47:46.946862+0000","last_became_peered":"2024-05-10T08:47:46.946862+0000","last_unstale":"2024-05-10T08:47:48.855698+0000","last_undegraded":"2024-05-10T08:47:48.855698+0000","last_fullsized":"2024-05-10T08:47:48.855698+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:30.604268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934215+0000","last_change":"2024-05-10T08:47:45.948870+0000","last_active":"2024-05-10T08:47:47.934215+0000","last_peered":"2024-05-10T08:47:47.934215+0000","last_clean":"2024-05-10T08:47:47.934215+0000","last_became_active":"2024-05-10T08:47:45.948580+0000","last_became_peered":"2024-05-10T08:47:45.948580+0000","last_unstale":"2024-05-10T08:47:47.934215+0000","last_undegraded":"2024-05-10T08:47:47.934215+0000","last_fullsized":"2024-05-10T08:47:47.934215+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:34:12.078307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930563+0000","last_change":"2024-05-10T08:47:46.958854+0000","last_active":"2024-05-10T08:47:48.930563+0000","last_peered":"2024-05-10T08:47:48.930563+0000","last_clean":"2024-05-10T08:47:48.930563+0000","last_became_active":"2024-05-10T08:47:46.957777+0000","last_became_peered":"2024-05-10T08:47:46.957777+0000","last_unstale":"2024-05-10T08:47:48.930563+0000","last_undegraded":"2024-05-10T08:47:48.930563+0000","last_fullsized":"2024-05-10T08:47:48.930563+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:10.151047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929510+0000","last_change":"2024-05-10T08:47:45.946555+0000","last_active":"2024-05-10T08:47:48.929510+0000","last_peered":"2024-05-10T08:47:48.929510+0000","last_clean":"2024-05-10T08:47:48.929510+0000","last_became_active":"2024-05-10T08:47:45.946250+0000","last_became_peered":"2024-05-10T08:47:45.946250+0000","last_unstale":"2024-05-10T08:47:48.929510+0000","last_undegraded":"2024-05-10T08:47:48.929510+0000","last_fullsized":"2024-05-10T08:47:48.929510+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:47.299832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930279+0000","last_change":"2024-05-10T08:47:46.957885+0000","last_active":"2024-05-10T08:47:48.930279+0000","last_peered":"2024-05-10T08:47:48.930279+0000","last_clean":"2024-05-10T08:47:48.930279+0000","last_became_active":"2024-05-10T08:47:46.957605+0000","last_became_peered":"2024-05-10T08:47:46.957605+0000","last_unstale":"2024-05-10T08:47:48.930279+0000","last_undegraded":"2024-05-10T08:47:48.930279+0000","last_fullsized":"2024-05-10T08:47:48.930279+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:21.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934151+0000","last_change":"2024-05-10T08:47:45.943591+0000","last_active":"2024-05-10T08:47:47.934151+0000","last_peered":"2024-05-10T08:47:47.934151+0000","last_clean":"2024-05-10T08:47:47.934151+0000","last_became_active":"2024-05-10T08:47:45.943328+0000","last_became_peered":"2024-05-10T08:47:45.943328+0000","last_unstale":"2024-05-10T08:47:47.934151+0000","last_undegraded":"2024-05-10T08:47:47.934151+0000","last_fullsized":"2024-05-10T08:47:47.934151+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:33.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855856+0000","last_change":"2024-05-10T08:47:46.946662+0000","last_active":"2024-05-10T08:47:48.855856+0000","last_peered":"2024-05-10T08:47:48.855856+0000","last_clean":"2024-05-10T08:47:48.855856+0000","last_became_active":"2024-05-10T08:47:46.946347+0000","last_became_peered":"2024-05-10T08:47:46.946347+0000","last_unstale":"2024-05-10T08:47:48.855856+0000","last_undegraded":"2024-05-10T08:47:48.855856+0000","last_fullsized":"2024-05-10T08:47:48.855856+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:22.179752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855412+0000","last_change":"2024-05-10T08:47:45.941560+0000","last_active":"2024-05-10T08:47:48.855412+0000","last_peered":"2024-05-10T08:47:48.855412+0000","last_clean":"2024-05-10T08:47:48.855412+0000","last_became_active":"2024-05-10T08:47:45.941279+0000","last_became_peered":"2024-05-10T08:47:45.941279+0000","last_unstale":"2024-05-10T08:47:48.855412+0000","last_undegraded":"2024-05-10T08:47:48.855412+0000","last_fullsized":"2024-05-10T08:47:48.855412+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:27.960286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929822+0000","last_change":"2024-05-10T08:47:46.957426+0000","last_active":"2024-05-10T08:47:48.929822+0000","last_peered":"2024-05-10T08:47:48.929822+0000","last_clean":"2024-05-10T08:47:48.929822+0000","last_became_active":"2024-05-10T08:47:46.957089+0000","last_became_peered":"2024-05-10T08:47:46.957089+0000","last_unstale":"2024-05-10T08:47:48.929822+0000","last_undegraded":"2024-05-10T08:47:48.929822+0000","last_fullsized":"2024-05-10T08:47:48.929822+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:53.037611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934733+0000","last_change":"2024-05-10T08:47:45.944927+0000","last_active":"2024-05-10T08:47:47.934733+0000","last_peered":"2024-05-10T08:47:47.934733+0000","last_clean":"2024-05-10T08:47:47.934733+0000","last_became_active":"2024-05-10T08:47:45.944637+0000","last_became_peered":"2024-05-10T08:47:45.944637+0000","last_unstale":"2024-05-10T08:47:47.934733+0000","last_undegraded":"2024-05-10T08:47:47.934733+0000","last_fullsized":"2024-05-10T08:47:47.934733+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:37.361280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934739+0000","last_change":"2024-05-10T08:47:46.961330+0000","last_active":"2024-05-10T08:47:47.934739+0000","last_peered":"2024-05-10T08:47:47.934739+0000","last_clean":"2024-05-10T08:47:47.934739+0000","last_became_active":"2024-05-10T08:47:46.960992+0000","last_became_peered":"2024-05-10T08:47:46.960992+0000","last_unstale":"2024-05-10T08:47:47.934739+0000","last_undegraded":"2024-05-10T08:47:47.934739+0000","last_fullsized":"2024-05-10T08:47:47.934739+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929800+0000","last_change":"2024-05-10T08:47:45.954303+0000","last_active":"2024-05-10T08:47:48.929800+0000","last_peered":"2024-05-10T08:47:48.929800+0000","last_clean":"2024-05-10T08:47:48.929800+0000","last_became_active":"2024-05-10T08:47:45.954002+0000","last_became_peered":"2024-05-10T08:47:45.954002+0000","last_unstale":"2024-05-10T08:47:48.929800+0000","last_undegraded":"2024-05-10T08:47:48.929800+0000","last_fullsized":"2024-05-10T08:47:48.929800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:29.601618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929671+0000","last_change":"2024-05-10T08:47:46.962806+0000","last_active":"2024-05-10T08:47:48.929671+0000","last_peered":"2024-05-10T08:47:48.929671+0000","last_clean":"2024-05-10T08:47:48.929671+0000","last_became_active":"2024-05-10T08:47:46.962467+0000","last_became_peered":"2024-05-10T08:47:46.962467+0000","last_unstale":"2024-05-10T08:47:48.929671+0000","last_undegraded":"2024-05-10T08:47:48.929671+0000","last_fullsized":"2024-05-10T08:47:48.929671+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:17.229937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934307+0000","last_change":"2024-05-10T08:47:45.947475+0000","last_active":"2024-05-10T08:47:47.934307+0000","last_peered":"2024-05-10T08:47:47.934307+0000","last_clean":"2024-05-10T08:47:47.934307+0000","last_became_active":"2024-05-10T08:47:45.947172+0000","last_became_peered":"2024-05-10T08:47:45.947172+0000","last_unstale":"2024-05-10T08:47:47.934307+0000","last_undegraded":"2024-05-10T08:47:47.934307+0000","last_fullsized":"2024-05-10T08:47:47.934307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:02.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.935002+0000","last_change":"2024-05-10T08:47:46.961804+0000","last_active":"2024-05-10T08:47:47.935002+0000","last_peered":"2024-05-10T08:47:47.935002+0000","last_clean":"2024-05-10T08:47:47.935002+0000","last_became_active":"2024-05-10T08:47:46.961504+0000","last_became_peered":"2024-05-10T08:47:46.961504+0000","last_unstale":"2024-05-10T08:47:47.935002+0000","last_undegraded":"2024-05-10T08:47:47.935002+0000","last_fullsized":"2024-05-10T08:47:47.935002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930019+0000","last_change":"2024-05-10T08:47:45.949330+0000","last_active":"2024-05-10T08:47:48.930019+0000","last_peered":"2024-05-10T08:47:48.930019+0000","last_clean":"2024-05-10T08:47:48.930019+0000","last_became_active":"2024-05-10T08:47:45.949025+0000","last_became_peered":"2024-05-10T08:47:45.949025+0000","last_unstale":"2024-05-10T08:47:48.930019+0000","last_undegraded":"2024-05-10T08:47:48.930019+0000","last_fullsized":"2024-05-10T08:47:48.930019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:05.081620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930282+0000","last_change":"2024-05-10T08:47:46.947662+0000","last_active":"2024-05-10T08:47:48.930282+0000","last_peered":"2024-05-10T08:47:48.930282+0000","last_clean":"2024-05-10T08:47:48.930282+0000","last_became_active":"2024-05-10T08:47:46.947245+0000","last_became_peered":"2024-05-10T08:47:46.947245+0000","last_unstale":"2024-05-10T08:47:48.930282+0000","last_undegraded":"2024-05-10T08:47:48.930282+0000","last_fullsized":"2024-05-10T08:47:48.930282+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:34:13.080957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934913+0000","last_change":"2024-05-10T08:47:45.948425+0000","last_active":"2024-05-10T08:47:47.934913+0000","last_peered":"2024-05-10T08:47:47.934913+0000","last_clean":"2024-05-10T08:47:47.934913+0000","last_became_active":"2024-05-10T08:47:45.948130+0000","last_became_peered":"2024-05-10T08:47:45.948130+0000","last_unstale":"2024-05-10T08:47:47.934913+0000","last_undegraded":"2024-05-10T08:47:47.934913+0000","last_fullsized":"2024-05-10T08:47:47.934913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:37.758407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930219+0000","last_change":"2024-05-10T08:47:46.954400+0000","last_active":"2024-05-10T08:47:48.930219+0000","last_peered":"2024-05-10T08:47:48.930219+0000","last_clean":"2024-05-10T08:47:48.930219+0000","last_became_active":"2024-05-10T08:47:46.954144+0000","last_became_peered":"2024-05-10T08:47:46.954144+0000","last_unstale":"2024-05-10T08:47:48.930219+0000","last_undegraded":"2024-05-10T08:47:48.930219+0000","last_fullsized":"2024-05-10T08:47:48.930219+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:31.145944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855471+0000","last_change":"2024-05-10T08:47:45.944928+0000","last_active":"2024-05-10T08:47:48.855471+0000","last_peered":"2024-05-10T08:47:48.855471+0000","last_clean":"2024-05-10T08:47:48.855471+0000","last_became_active":"2024-05-10T08:47:45.944656+0000","last_became_peered":"2024-05-10T08:47:45.944656+0000","last_unstale":"2024-05-10T08:47:48.855471+0000","last_undegraded":"2024-05-10T08:47:48.855471+0000","last_fullsized":"2024-05-10T08:47:48.855471+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:30.143294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929725+0000","last_change":"2024-05-10T08:47:46.961204+0000","last_active":"2024-05-10T08:47:48.929725+0000","last_peered":"2024-05-10T08:47:48.929725+0000","last_clean":"2024-05-10T08:47:48.929725+0000","last_became_active":"2024-05-10T08:47:46.960885+0000","last_became_peered":"2024-05-10T08:47:46.960885+0000","last_unstale":"2024-05-10T08:47:48.929725+0000","last_undegraded":"2024-05-10T08:47:48.929725+0000","last_fullsized":"2024-05-10T08:47:48.929725+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:53:47.091166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929473+0000","last_change":"2024-05-10T08:47:45.952528+0000","last_active":"2024-05-10T08:47:48.929473+0000","last_peered":"2024-05-10T08:47:48.929473+0000","last_clean":"2024-05-10T08:47:48.929473+0000","last_became_active":"2024-05-10T08:47:45.952268+0000","last_became_peered":"2024-05-10T08:47:45.952268+0000","last_unstale":"2024-05-10T08:47:48.929473+0000","last_undegraded":"2024-05-10T08:47:48.929473+0000","last_fullsized":"2024-05-10T08:47:48.929473+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:55.834413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930609+0000","last_change":"2024-05-10T08:47:46.954408+0000","last_active":"2024-05-10T08:47:48.930609+0000","last_peered":"2024-05-10T08:47:48.930609+0000","last_clean":"2024-05-10T08:47:48.930609+0000","last_became_active":"2024-05-10T08:47:46.954125+0000","last_became_peered":"2024-05-10T08:47:46.954125+0000","last_unstale":"2024-05-10T08:47:48.930609+0000","last_undegraded":"2024-05-10T08:47:48.930609+0000","last_fullsized":"2024-05-10T08:47:48.930609+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:13.431202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":22,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934902+0000","last_change":"2024-05-10T08:47:45.940286+0000","last_active":"2024-05-10T08:47:47.934902+0000","last_peered":"2024-05-10T08:47:47.934902+0000","last_clean":"2024-05-10T08:47:47.934902+0000","last_became_active":"2024-05-10T08:47:45.940000+0000","last_became_peered":"2024-05-10T08:47:45.940000+0000","last_unstale":"2024-05-10T08:47:47.934902+0000","last_undegraded":"2024-05-10T08:47:47.934902+0000","last_fullsized":"2024-05-10T08:47:47.934902+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:45.507964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930042+0000","last_change":"2024-05-10T08:47:46.961873+0000","last_active":"2024-05-10T08:47:48.930042+0000","last_peered":"2024-05-10T08:47:48.930042+0000","last_clean":"2024-05-10T08:47:48.930042+0000","last_became_active":"2024-05-10T08:47:46.961376+0000","last_became_peered":"2024-05-10T08:47:46.961376+0000","last_unstale":"2024-05-10T08:47:48.930042+0000","last_undegraded":"2024-05-10T08:47:48.930042+0000","last_fullsized":"2024-05-10T08:47:48.930042+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:19.661076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929441+0000","last_change":"2024-05-10T08:47:45.947284+0000","last_active":"2024-05-10T08:47:48.929441+0000","last_peered":"2024-05-10T08:47:48.929441+0000","last_clean":"2024-05-10T08:47:48.929441+0000","last_became_active":"2024-05-10T08:47:45.947000+0000","last_became_peered":"2024-05-10T08:47:45.947000+0000","last_unstale":"2024-05-10T08:47:48.929441+0000","last_undegraded":"2024-05-10T08:47:48.929441+0000","last_fullsized":"2024-05-10T08:47:48.929441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:46.677065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929987+0000","last_change":"2024-05-10T08:47:46.957180+0000","last_active":"2024-05-10T08:47:48.929987+0000","last_peered":"2024-05-10T08:47:48.929987+0000","last_clean":"2024-05-10T08:47:48.929987+0000","last_became_active":"2024-05-10T08:47:46.956661+0000","last_became_peered":"2024-05-10T08:47:46.956661+0000","last_unstale":"2024-05-10T08:47:48.929987+0000","last_undegraded":"2024-05-10T08:47:48.929987+0000","last_fullsized":"2024-05-10T08:47:48.929987+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934438+0000","last_change":"2024-05-10T08:47:45.944706+0000","last_active":"2024-05-10T08:47:47.934438+0000","last_peered":"2024-05-10T08:47:47.934438+0000","last_clean":"2024-05-10T08:47:47.934438+0000","last_became_active":"2024-05-10T08:47:45.944400+0000","last_became_peered":"2024-05-10T08:47:45.944400+0000","last_unstale":"2024-05-10T08:47:47.934438+0000","last_undegraded":"2024-05-10T08:47:47.934438+0000","last_fullsized":"2024-05-10T08:47:47.934438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:20.076309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934864+0000","last_change":"2024-05-10T08:47:46.939221+0000","last_active":"2024-05-10T08:47:47.934864+0000","last_peered":"2024-05-10T08:47:47.934864+0000","last_clean":"2024-05-10T08:47:47.934864+0000","last_became_active":"2024-05-10T08:47:46.938789+0000","last_became_peered":"2024-05-10T08:47:46.938789+0000","last_unstale":"2024-05-10T08:47:47.934864+0000","last_undegraded":"2024-05-10T08:47:47.934864+0000","last_fullsized":"2024-05-10T08:47:47.934864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930254+0000","last_change":"2024-05-10T08:47:45.949017+0000","last_active":"2024-05-10T08:47:48.930254+0000","last_peered":"2024-05-10T08:47:48.930254+0000","last_clean":"2024-05-10T08:47:48.930254+0000","last_became_active":"2024-05-10T08:47:45.948712+0000","last_became_peered":"2024-05-10T08:47:45.948712+0000","last_unstale":"2024-05-10T08:47:48.930254+0000","last_undegraded":"2024-05-10T08:47:48.930254+0000","last_fullsized":"2024-05-10T08:47:48.930254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:49.975788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929862+0000","last_change":"2024-05-10T08:47:46.953847+0000","last_active":"2024-05-10T08:47:48.929862+0000","last_peered":"2024-05-10T08:47:48.929862+0000","last_clean":"2024-05-10T08:47:48.929862+0000","last_became_active":"2024-05-10T08:47:46.953232+0000","last_became_peered":"2024-05-10T08:47:46.953232+0000","last_unstale":"2024-05-10T08:47:48.929862+0000","last_undegraded":"2024-05-10T08:47:48.929862+0000","last_fullsized":"2024-05-10T08:47:48.929862+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:15.976333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930243+0000","last_change":"2024-05-10T08:47:45.952459+0000","last_active":"2024-05-10T08:47:48.930243+0000","last_peered":"2024-05-10T08:47:48.930243+0000","last_clean":"2024-05-10T08:47:48.930243+0000","last_became_active":"2024-05-10T08:47:45.952125+0000","last_became_peered":"2024-05-10T08:47:45.952125+0000","last_unstale":"2024-05-10T08:47:48.930243+0000","last_undegraded":"2024-05-10T08:47:48.930243+0000","last_fullsized":"2024-05-10T08:47:48.930243+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:54.499465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930492+0000","last_change":"2024-05-10T08:47:46.947814+0000","last_active":"2024-05-10T08:47:48.930492+0000","last_peered":"2024-05-10T08:47:48.930492+0000","last_clean":"2024-05-10T08:47:48.930492+0000","last_became_active":"2024-05-10T08:47:46.947513+0000","last_became_peered":"2024-05-10T08:47:46.947513+0000","last_unstale":"2024-05-10T08:47:48.930492+0000","last_undegraded":"2024-05-10T08:47:48.930492+0000","last_fullsized":"2024-05-10T08:47:48.930492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:58.101997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929446+0000","last_change":"2024-05-10T08:47:45.947317+0000","last_active":"2024-05-10T08:47:48.929446+0000","last_peered":"2024-05-10T08:47:48.929446+0000","last_clean":"2024-05-10T08:47:48.929446+0000","last_became_active":"2024-05-10T08:47:45.946998+0000","last_became_peered":"2024-05-10T08:47:45.946998+0000","last_unstale":"2024-05-10T08:47:48.929446+0000","last_undegraded":"2024-05-10T08:47:48.929446+0000","last_fullsized":"2024-05-10T08:47:48.929446+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:06:39.491530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855775+0000","last_change":"2024-05-10T08:47:46.957527+0000","last_active":"2024-05-10T08:47:48.855775+0000","last_peered":"2024-05-10T08:47:48.855775+0000","last_clean":"2024-05-10T08:47:48.855775+0000","last_became_active":"2024-05-10T08:47:46.957224+0000","last_became_peered":"2024-05-10T08:47:46.957224+0000","last_unstale":"2024-05-10T08:47:48.855775+0000","last_undegraded":"2024-05-10T08:47:48.855775+0000","last_fullsized":"2024-05-10T08:47:48.855775+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:37.303219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929616+0000","last_change":"2024-05-10T08:47:45.947067+0000","last_active":"2024-05-10T08:47:48.929616+0000","last_peered":"2024-05-10T08:47:48.929616+0000","last_clean":"2024-05-10T08:47:48.929616+0000","last_became_active":"2024-05-10T08:47:45.946107+0000","last_became_peered":"2024-05-10T08:47:45.946107+0000","last_unstale":"2024-05-10T08:47:48.929616+0000","last_undegraded":"2024-05-10T08:47:48.929616+0000","last_fullsized":"2024-05-10T08:47:48.929616+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:33.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930034+0000","last_change":"2024-05-10T08:47:46.963419+0000","last_active":"2024-05-10T08:47:48.930034+0000","last_peered":"2024-05-10T08:47:48.930034+0000","last_clean":"2024-05-10T08:47:48.930034+0000","last_became_active":"2024-05-10T08:47:46.963059+0000","last_became_peered":"2024-05-10T08:47:46.963059+0000","last_unstale":"2024-05-10T08:47:48.930034+0000","last_undegraded":"2024-05-10T08:47:48.930034+0000","last_fullsized":"2024-05-10T08:47:48.930034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:42.025251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929973+0000","last_change":"2024-05-10T08:47:45.945090+0000","last_active":"2024-05-10T08:47:48.929973+0000","last_peered":"2024-05-10T08:47:48.929973+0000","last_clean":"2024-05-10T08:47:48.929973+0000","last_became_active":"2024-05-10T08:47:45.944805+0000","last_became_peered":"2024-05-10T08:47:45.944805+0000","last_unstale":"2024-05-10T08:47:48.929973+0000","last_undegraded":"2024-05-10T08:47:48.929973+0000","last_fullsized":"2024-05-10T08:47:48.929973+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:45.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930225+0000","last_change":"2024-05-10T08:47:46.952463+0000","last_active":"2024-05-10T08:47:48.930225+0000","last_peered":"2024-05-10T08:47:48.930225+0000","last_clean":"2024-05-10T08:47:48.930225+0000","last_became_active":"2024-05-10T08:47:46.952192+0000","last_became_peered":"2024-05-10T08:47:46.952192+0000","last_unstale":"2024-05-10T08:47:48.930225+0000","last_undegraded":"2024-05-10T08:47:48.930225+0000","last_fullsized":"2024-05-10T08:47:48.930225+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:01.200192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934790+0000","last_change":"2024-05-10T08:47:45.946159+0000","last_active":"2024-05-10T08:47:47.934790+0000","last_peered":"2024-05-10T08:47:47.934790+0000","last_clean":"2024-05-10T08:47:47.934790+0000","last_became_active":"2024-05-10T08:47:45.945848+0000","last_became_peered":"2024-05-10T08:47:45.945848+0000","last_unstale":"2024-05-10T08:47:47.934790+0000","last_undegraded":"2024-05-10T08:47:47.934790+0000","last_fullsized":"2024-05-10T08:47:47.934790+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:44.827395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934385+0000","last_change":"2024-05-10T08:47:46.952748+0000","last_active":"2024-05-10T08:47:47.934385+0000","last_peered":"2024-05-10T08:47:47.934385+0000","last_clean":"2024-05-10T08:47:47.934385+0000","last_became_active":"2024-05-10T08:47:46.952466+0000","last_became_peered":"2024-05-10T08:47:46.952466+0000","last_unstale":"2024-05-10T08:47:47.934385+0000","last_undegraded":"2024-05-10T08:47:47.934385+0000","last_fullsized":"2024-05-10T08:47:47.934385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:44.547445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"103'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929952+0000","last_change":"2024-05-10T08:47:45.948810+0000","last_active":"2024-05-10T08:47:48.929952+0000","last_peered":"2024-05-10T08:47:48.929952+0000","last_clean":"2024-05-10T08:47:48.929952+0000","last_became_active":"2024-05-10T08:47:45.948512+0000","last_became_peered":"2024-05-10T08:47:45.948512+0000","last_unstale":"2024-05-10T08:47:48.929952+0000","last_undegraded":"2024-05-10T08:47:48.929952+0000","last_fullsized":"2024-05-10T08:47:48.929952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:36.300570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855693+0000","last_change":"2024-05-10T08:47:46.956986+0000","last_active":"2024-05-10T08:47:48.855693+0000","last_peered":"2024-05-10T08:47:48.855693+0000","last_clean":"2024-05-10T08:47:48.855693+0000","last_became_active":"2024-05-10T08:47:46.956669+0000","last_became_peered":"2024-05-10T08:47:46.956669+0000","last_unstale":"2024-05-10T08:47:48.855693+0000","last_undegraded":"2024-05-10T08:47:48.855693+0000","last_fullsized":"2024-05-10T08:47:48.855693+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:22.271792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929922+0000","last_change":"2024-05-10T08:47:45.951460+0000","last_active":"2024-05-10T08:47:48.929922+0000","last_peered":"2024-05-10T08:47:48.929922+0000","last_clean":"2024-05-10T08:47:48.929922+0000","last_became_active":"2024-05-10T08:47:45.951205+0000","last_became_peered":"2024-05-10T08:47:45.951205+0000","last_unstale":"2024-05-10T08:47:48.929922+0000","last_undegraded":"2024-05-10T08:47:48.929922+0000","last_fullsized":"2024-05-10T08:47:48.929922+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:22:42.828175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929840+0000","last_change":"2024-05-10T08:47:46.944737+0000","last_active":"2024-05-10T08:47:48.929840+0000","last_peered":"2024-05-10T08:47:48.929840+0000","last_clean":"2024-05-10T08:47:48.929840+0000","last_became_active":"2024-05-10T08:47:46.944458+0000","last_became_peered":"2024-05-10T08:47:46.944458+0000","last_unstale":"2024-05-10T08:47:48.929840+0000","last_undegraded":"2024-05-10T08:47:48.929840+0000","last_fullsized":"2024-05-10T08:47:48.929840+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:44:59.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934802+0000","last_change":"2024-05-10T08:47:45.949177+0000","last_active":"2024-05-10T08:47:47.934802+0000","last_peered":"2024-05-10T08:47:47.934802+0000","last_clean":"2024-05-10T08:47:47.934802+0000","last_became_active":"2024-05-10T08:47:45.948887+0000","last_became_peered":"2024-05-10T08:47:45.948887+0000","last_unstale":"2024-05-10T08:47:47.934802+0000","last_undegraded":"2024-05-10T08:47:47.934802+0000","last_fullsized":"2024-05-10T08:47:47.934802+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:46.677065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929940+0000","last_change":"2024-05-10T08:47:46.966147+0000","last_active":"2024-05-10T08:47:48.929940+0000","last_peered":"2024-05-10T08:47:48.929940+0000","last_clean":"2024-05-10T08:47:48.929940+0000","last_became_active":"2024-05-10T08:47:46.965236+0000","last_became_peered":"2024-05-10T08:47:46.965236+0000","last_unstale":"2024-05-10T08:47:48.929940+0000","last_undegraded":"2024-05-10T08:47:48.929940+0000","last_fullsized":"2024-05-10T08:47:48.929940+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:37.003446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934200+0000","last_change":"2024-05-10T08:47:45.944910+0000","last_active":"2024-05-10T08:47:47.934200+0000","last_peered":"2024-05-10T08:47:47.934200+0000","last_clean":"2024-05-10T08:47:47.934200+0000","last_became_active":"2024-05-10T08:47:45.944599+0000","last_became_peered":"2024-05-10T08:47:45.944599+0000","last_unstale":"2024-05-10T08:47:47.934200+0000","last_undegraded":"2024-05-10T08:47:47.934200+0000","last_fullsized":"2024-05-10T08:47:47.934200+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:05.081620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929737+0000","last_change":"2024-05-10T08:47:46.962873+0000","last_active":"2024-05-10T08:47:48.929737+0000","last_peered":"2024-05-10T08:47:48.929737+0000","last_clean":"2024-05-10T08:47:48.929737+0000","last_became_active":"2024-05-10T08:47:46.962584+0000","last_became_peered":"2024-05-10T08:47:46.962584+0000","last_unstale":"2024-05-10T08:47:48.929737+0000","last_undegraded":"2024-05-10T08:47:48.929737+0000","last_fullsized":"2024-05-10T08:47:48.929737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:47.921304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929845+0000","last_change":"2024-05-10T08:47:45.952529+0000","last_active":"2024-05-10T08:47:48.929845+0000","last_peered":"2024-05-10T08:47:48.929845+0000","last_clean":"2024-05-10T08:47:48.929845+0000","last_became_active":"2024-05-10T08:47:45.952203+0000","last_became_peered":"2024-05-10T08:47:45.952203+0000","last_unstale":"2024-05-10T08:47:48.929845+0000","last_undegraded":"2024-05-10T08:47:48.929845+0000","last_fullsized":"2024-05-10T08:47:48.929845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:30.561372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934799+0000","last_change":"2024-05-10T08:47:46.939329+0000","last_active":"2024-05-10T08:47:47.934799+0000","last_peered":"2024-05-10T08:47:47.934799+0000","last_clean":"2024-05-10T08:47:47.934799+0000","last_became_active":"2024-05-10T08:47:46.938942+0000","last_became_peered":"2024-05-10T08:47:46.938942+0000","last_unstale":"2024-05-10T08:47:47.934799+0000","last_undegraded":"2024-05-10T08:47:47.934799+0000","last_fullsized":"2024-05-10T08:47:47.934799+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:31.145944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929728+0000","last_change":"2024-05-10T08:47:45.951394+0000","last_active":"2024-05-10T08:47:48.929728+0000","last_peered":"2024-05-10T08:47:48.929728+0000","last_clean":"2024-05-10T08:47:48.929728+0000","last_became_active":"2024-05-10T08:47:45.951121+0000","last_became_peered":"2024-05-10T08:47:45.951121+0000","last_unstale":"2024-05-10T08:47:48.929728+0000","last_undegraded":"2024-05-10T08:47:48.929728+0000","last_fullsized":"2024-05-10T08:47:48.929728+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:45.507964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930553+0000","last_change":"2024-05-10T08:47:46.939045+0000","last_active":"2024-05-10T08:47:48.930553+0000","last_peered":"2024-05-10T08:47:48.930553+0000","last_clean":"2024-05-10T08:47:48.930553+0000","last_became_active":"2024-05-10T08:47:46.938746+0000","last_became_peered":"2024-05-10T08:47:46.938746+0000","last_unstale":"2024-05-10T08:47:48.930553+0000","last_undegraded":"2024-05-10T08:47:48.930553+0000","last_fullsized":"2024-05-10T08:47:48.930553+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:21.078958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930101+0000","last_change":"2024-05-10T08:47:45.952553+0000","last_active":"2024-05-10T08:47:48.930101+0000","last_peered":"2024-05-10T08:47:48.930101+0000","last_clean":"2024-05-10T08:47:48.930101+0000","last_became_active":"2024-05-10T08:47:45.952305+0000","last_became_peered":"2024-05-10T08:47:45.952305+0000","last_unstale":"2024-05-10T08:47:48.930101+0000","last_undegraded":"2024-05-10T08:47:48.930101+0000","last_fullsized":"2024-05-10T08:47:48.930101+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:08.308019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929461+0000","last_change":"2024-05-10T08:47:46.946221+0000","last_active":"2024-05-10T08:47:48.929461+0000","last_peered":"2024-05-10T08:47:48.929461+0000","last_clean":"2024-05-10T08:47:48.929461+0000","last_became_active":"2024-05-10T08:47:46.945733+0000","last_became_peered":"2024-05-10T08:47:46.945733+0000","last_unstale":"2024-05-10T08:47:48.929461+0000","last_undegraded":"2024-05-10T08:47:48.929461+0000","last_fullsized":"2024-05-10T08:47:48.929461+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:41.933192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929799+0000","last_change":"2024-05-10T08:47:45.945298+0000","last_active":"2024-05-10T08:47:48.929799+0000","last_peered":"2024-05-10T08:47:48.929799+0000","last_clean":"2024-05-10T08:47:48.929799+0000","last_became_active":"2024-05-10T08:47:45.944895+0000","last_became_peered":"2024-05-10T08:47:45.944895+0000","last_unstale":"2024-05-10T08:47:48.929799+0000","last_undegraded":"2024-05-10T08:47:48.929799+0000","last_fullsized":"2024-05-10T08:47:48.929799+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:08:16.310350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":265,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933697+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:47:47.933697+0000","last_peered":"2024-05-10T08:47:47.933697+0000","last_clean":"2024-05-10T08:47:47.933697+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:47:47.933697+0000","last_undegraded":"2024-05-10T08:47:47.933697+0000","last_fullsized":"2024-05-10T08:47:47.933697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1880064,"data_stored":1182738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1298432,"data_stored":594426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1277952,"data_stored":592210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1286144,"data_stored":592302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1888256,"data_stored":1184280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:47:52.567 INFO:tasks.ceph.mds.b.smithi082.stderr:2024-05-10T08:47:52.569+0000 7fb90a4bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:47:54.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:47:54.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:47:55.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:47:55.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.594+0000 7f1b56571640 1 Processor -- start 2024-05-10T08:47:55.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.594+0000 7f1b56571640 1 -- start start 2024-05-10T08:47:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.595+0000 7f1b56571640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b5015f420 0x7f1b500d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.595+0000 7f1b56571640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b500d3ca0 0x7f1b500d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.595+0000 7f1b56571640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b501630b0 con 0x7f1b500d1eb0 2024-05-10T08:47:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.595+0000 7f1b56571640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1b500d22f0 con 0x7f1b5015f420 2024-05-10T08:47:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.595+0000 7f1b56571640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b500d2550 con 0x7f1b500d3ca0 2024-05-10T08:47:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.595+0000 7f1b54b0e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1b500d1eb0 0x7f1b500d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48710/0 (socket says 172.21.15.37:48710) 2024-05-10T08:47:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.595+0000 7f1b54b0e640 1 -- 172.21.15.37:0/2294244684 learned_addr learned my addr 172.21.15.37:0/2294244684 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4ffff640 1 --2- 172.21.15.37:0/2294244684 >> v2:172.21.15.82:3300/0 conn(0x7f1b5015f420 0x7f1b500d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4f7fe640 1 --2- 172.21.15.37:0/2294244684 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b500d3ca0 0x7f1b500d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4effd640 1 -- 172.21.15.37:0/2294244684 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867374393 0 0) 0x7f1b48001490 con 0x7f1b500d1eb0 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4effd640 1 -- 172.21.15.37:0/2294244684 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b38003520 con 0x7f1b500d1eb0 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4f7fe640 1 -- 172.21.15.37:0/2294244684 >> v2:172.21.15.82:3300/0 conn(0x7f1b5015f420 msgr2=0x7f1b500d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4f7fe640 1 --2- 172.21.15.37:0/2294244684 >> v2:172.21.15.82:3300/0 conn(0x7f1b5015f420 0x7f1b500d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4f7fe640 1 -- 172.21.15.37:0/2294244684 >> v1:172.21.15.37:6789/0 conn(0x7f1b500d1eb0 legacy=0x7f1b500d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4effd640 1 -- 172.21.15.37:0/2294244684 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1914547681 0 0) 0x7f1b38003520 con 0x7f1b500d1eb0 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4f7fe640 1 -- 172.21.15.37:0/2294244684 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b500d2c80 con 0x7f1b500d3ca0 2024-05-10T08:47:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.596+0000 7f1b4ffff640 1 --2- 172.21.15.37:0/2294244684 >> v2:172.21.15.82:3300/0 conn(0x7f1b5015f420 0x7f1b500d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.597+0000 7f1b4f7fe640 1 --2- 172.21.15.37:0/2294244684 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b500d3ca0 0x7f1b500d1970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b440097a0 tx=0x7f1b4402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01ca2a26f83a0d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.597+0000 7f1b4effd640 1 -- 172.21.15.37:0/2294244684 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44037070 con 0x7f1b500d3ca0 2024-05-10T08:47:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.597+0000 7f1b4effd640 1 -- 172.21.15.37:0/2294244684 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4402aba0 con 0x7f1b500d3ca0 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.597+0000 7f1b4effd640 1 -- 172.21.15.37:0/2294244684 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48001bc0 con 0x7f1b500d3ca0 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 -- 172.21.15.37:0/2294244684 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b500d3ca0 msgr2=0x7f1b500d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 --2- 172.21.15.37:0/2294244684 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b500d3ca0 0x7f1b500d1970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b440097a0 tx=0x7f1b4402a110 comp rx=0 tx=0).stop 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 -- 172.21.15.37:0/2294244684 shutdown_connections 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 --2- 172.21.15.37:0/2294244684 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b500d3ca0 0x7f1b500d1970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 --2- 172.21.15.37:0/2294244684 >> v2:172.21.15.82:3300/0 conn(0x7f1b5015f420 0x7f1b500d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 -- 172.21.15.37:0/2294244684 >> 172.21.15.37:0/2294244684 conn(0x7f1b5008eac0 msgr2=0x7f1b5009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 -- 172.21.15.37:0/2294244684 shutdown_connections 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.598+0000 7f1b56571640 1 -- 172.21.15.37:0/2294244684 wait complete. 2024-05-10T08:47:55.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.599+0000 7f1b56571640 1 Processor -- start 2024-05-10T08:47:55.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.599+0000 7f1b56571640 1 -- start start 2024-05-10T08:47:55.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b56571640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500d1eb0 0x7f1b50162350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b56571640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b50161e90 0x7f1b500cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b56571640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500ceb40 0x7f1b500cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b56571640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b500d2830 con 0x7f1b500ceb40 2024-05-10T08:47:55.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b56571640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b500d3240 con 0x7f1b500d1eb0 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b56571640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b500d53d0 con 0x7f1b50161e90 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500ceb40 0x7f1b500cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500ceb40 0x7f1b500cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59038/0 (socket says 172.21.15.37:59038) 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 -- 172.21.15.37:0/2685914901 learned_addr learned my addr 172.21.15.37:0/2685914901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b4f7fe640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b50161e90 0x7f1b500cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b4ffff640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500d1eb0 0x7f1b50162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 -- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b50161e90 msgr2=0x7f1b500cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b50161e90 0x7f1b500cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 -- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500d1eb0 msgr2=0x7f1b50162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500d1eb0 0x7f1b50162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b54b0e640 1 -- 172.21.15.37:0/2685914901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b500cefc0 con 0x7f1b500ceb40 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b4f7fe640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b50161e90 0x7f1b500cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.600+0000 7f1b4ffff640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500d1eb0 0x7f1b50162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:55.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.601+0000 7f1b54b0e640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500ceb40 0x7f1b500cda70 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1b48001d30 tx=0x7f1b4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:55.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.601+0000 7f1b4cff9640 1 -- 172.21.15.37:0/2685914901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48017070 con 0x7f1b500ceb40 2024-05-10T08:47:55.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.601+0000 7f1b4cff9640 1 -- 172.21.15.37:0/2685914901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b48012400 con 0x7f1b500ceb40 2024-05-10T08:47:55.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.601+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b500ca9d0 con 0x7f1b500ceb40 2024-05-10T08:47:55.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.601+0000 7f1b4cff9640 1 -- 172.21.15.37:0/2685914901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48012830 con 0x7f1b500ceb40 2024-05-10T08:47:55.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.601+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b500ca410 con 0x7f1b500ceb40 2024-05-10T08:47:55.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.602+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b500693f0 con 0x7f1b500ceb40 2024-05-10T08:47:55.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.603+0000 7f1b4cff9640 1 -- 172.21.15.37:0/2685914901 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b4801a070 con 0x7f1b500ceb40 2024-05-10T08:47:55.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.603+0000 7f1b4cff9640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b3c076300 0x7f1b3c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.603+0000 7f1b4cff9640 1 -- 172.21.15.37:0/2685914901 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f1b480976e0 con 0x7f1b500ceb40 2024-05-10T08:47:55.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.604+0000 7f1b4ffff640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b3c076300 0x7f1b3c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.604+0000 7f1b4ffff640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b3c076300 0x7f1b3c0787c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009af0 tx=0x7f1b40008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:55.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.608+0000 7f1b4cff9640 1 -- 172.21.15.37:0/2685914901 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1b501630b0 con 0x7f1b500ceb40 2024-05-10T08:47:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.795+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b5014b570 con 0x7f1b3c076300 2024-05-10T08:47:55.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.801+0000 7f1b4cff9640 1 -- 172.21.15.37:0/2685914901 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252363 (secure 0 0 0) 0x7f1b5014b570 con 0x7f1b3c076300 2024-05-10T08:47:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:47:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b3c076300 msgr2=0x7f1b3c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b3c076300 0x7f1b3c0787c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009af0 tx=0x7f1b40008040 comp rx=0 tx=0).stop 2024-05-10T08:47:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500ceb40 msgr2=0x7f1b500cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500ceb40 0x7f1b500cda70 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1b48001d30 tx=0x7f1b4800a430 comp rx=0 tx=0).stop 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 shutdown_connections 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b3c076300 0x7f1b3c0787c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500ceb40 0x7f1b500cda70 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b50161e90 0x7f1b500cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 --2- 172.21.15.37:0/2685914901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b500d1eb0 0x7f1b50162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.804+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 >> 172.21.15.37:0/2685914901 conn(0x7f1b5008eac0 msgr2=0x7f1b500d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.805+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 shutdown_connections 2024-05-10T08:47:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.805+0000 7f1b56571640 1 -- 172.21.15.37:0/2685914901 wait complete. 2024-05-10T08:47:55.814 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-05-10T08:47:55.436539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260656,"kb_used_data":11208,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714064,"statfs":{"total":773094113280,"available":772827201536,"internally_reserved":0,"allocated":11476992,"data_stored":5923236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.505792"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930445+0000","last_change":"2024-05-10T08:47:46.952665+0000","last_active":"2024-05-10T08:47:48.930445+0000","last_peered":"2024-05-10T08:47:48.930445+0000","last_clean":"2024-05-10T08:47:48.930445+0000","last_became_active":"2024-05-10T08:47:46.952409+0000","last_became_peered":"2024-05-10T08:47:46.952409+0000","last_unstale":"2024-05-10T08:47:48.930445+0000","last_undegraded":"2024-05-10T08:47:48.930445+0000","last_fullsized":"2024-05-10T08:47:48.930445+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:34.485421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930124+0000","last_change":"2024-05-10T08:47:46.962426+0000","last_active":"2024-05-10T08:47:48.930124+0000","last_peered":"2024-05-10T08:47:48.930124+0000","last_clean":"2024-05-10T08:47:48.930124+0000","last_became_active":"2024-05-10T08:47:46.962145+0000","last_became_peered":"2024-05-10T08:47:46.962145+0000","last_unstale":"2024-05-10T08:47:48.930124+0000","last_undegraded":"2024-05-10T08:47:48.930124+0000","last_fullsized":"2024-05-10T08:47:48.930124+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930307+0000","last_change":"2024-05-10T08:47:46.955209+0000","last_active":"2024-05-10T08:47:48.930307+0000","last_peered":"2024-05-10T08:47:48.930307+0000","last_clean":"2024-05-10T08:47:48.930307+0000","last_became_active":"2024-05-10T08:47:46.954892+0000","last_became_peered":"2024-05-10T08:47:46.954892+0000","last_unstale":"2024-05-10T08:47:48.930307+0000","last_undegraded":"2024-05-10T08:47:48.930307+0000","last_fullsized":"2024-05-10T08:47:48.930307+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:40.417564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855668+0000","last_change":"2024-05-10T08:47:46.951651+0000","last_active":"2024-05-10T08:47:48.855668+0000","last_peered":"2024-05-10T08:47:48.855668+0000","last_clean":"2024-05-10T08:47:48.855668+0000","last_became_active":"2024-05-10T08:47:46.951388+0000","last_became_peered":"2024-05-10T08:47:46.951388+0000","last_unstale":"2024-05-10T08:47:48.855668+0000","last_undegraded":"2024-05-10T08:47:48.855668+0000","last_fullsized":"2024-05-10T08:47:48.855668+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:09:35.545609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934700+0000","last_change":"2024-05-10T08:47:46.958677+0000","last_active":"2024-05-10T08:47:47.934700+0000","last_peered":"2024-05-10T08:47:47.934700+0000","last_clean":"2024-05-10T08:47:47.934700+0000","last_became_active":"2024-05-10T08:47:46.958425+0000","last_became_peered":"2024-05-10T08:47:46.958425+0000","last_unstale":"2024-05-10T08:47:47.934700+0000","last_undegraded":"2024-05-10T08:47:47.934700+0000","last_fullsized":"2024-05-10T08:47:47.934700+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929931+0000","last_change":"2024-05-10T08:47:46.961009+0000","last_active":"2024-05-10T08:47:48.929931+0000","last_peered":"2024-05-10T08:47:48.929931+0000","last_clean":"2024-05-10T08:47:48.929931+0000","last_became_active":"2024-05-10T08:47:46.960659+0000","last_became_peered":"2024-05-10T08:47:46.960659+0000","last_unstale":"2024-05-10T08:47:48.929931+0000","last_undegraded":"2024-05-10T08:47:48.929931+0000","last_fullsized":"2024-05-10T08:47:48.929931+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929541+0000","last_change":"2024-05-10T08:47:46.953451+0000","last_active":"2024-05-10T08:47:48.929541+0000","last_peered":"2024-05-10T08:47:48.929541+0000","last_clean":"2024-05-10T08:47:48.929541+0000","last_became_active":"2024-05-10T08:47:46.953175+0000","last_became_peered":"2024-05-10T08:47:46.953175+0000","last_unstale":"2024-05-10T08:47:48.929541+0000","last_undegraded":"2024-05-10T08:47:48.929541+0000","last_fullsized":"2024-05-10T08:47:48.929541+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929904+0000","last_change":"2024-05-10T08:47:46.966090+0000","last_active":"2024-05-10T08:47:48.929904+0000","last_peered":"2024-05-10T08:47:48.929904+0000","last_clean":"2024-05-10T08:47:48.929904+0000","last_became_active":"2024-05-10T08:47:46.965256+0000","last_became_peered":"2024-05-10T08:47:46.965256+0000","last_unstale":"2024-05-10T08:47:48.929904+0000","last_undegraded":"2024-05-10T08:47:48.929904+0000","last_fullsized":"2024-05-10T08:47:48.929904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:55:05.342516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929528+0000","last_change":"2024-05-10T08:47:46.964209+0000","last_active":"2024-05-10T08:47:48.929528+0000","last_peered":"2024-05-10T08:47:48.929528+0000","last_clean":"2024-05-10T08:47:48.929528+0000","last_became_active":"2024-05-10T08:47:46.963893+0000","last_became_peered":"2024-05-10T08:47:46.963893+0000","last_unstale":"2024-05-10T08:47:48.929528+0000","last_undegraded":"2024-05-10T08:47:48.929528+0000","last_fullsized":"2024-05-10T08:47:48.929528+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934885+0000","last_change":"2024-05-10T08:47:46.954341+0000","last_active":"2024-05-10T08:47:47.934885+0000","last_peered":"2024-05-10T08:47:47.934885+0000","last_clean":"2024-05-10T08:47:47.934885+0000","last_became_active":"2024-05-10T08:47:46.954043+0000","last_became_peered":"2024-05-10T08:47:46.954043+0000","last_unstale":"2024-05-10T08:47:47.934885+0000","last_undegraded":"2024-05-10T08:47:47.934885+0000","last_fullsized":"2024-05-10T08:47:47.934885+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930534+0000","last_change":"2024-05-10T08:47:46.954094+0000","last_active":"2024-05-10T08:47:48.930534+0000","last_peered":"2024-05-10T08:47:48.930534+0000","last_clean":"2024-05-10T08:47:48.930534+0000","last_became_active":"2024-05-10T08:47:46.953761+0000","last_became_peered":"2024-05-10T08:47:46.953761+0000","last_unstale":"2024-05-10T08:47:48.930534+0000","last_undegraded":"2024-05-10T08:47:48.930534+0000","last_fullsized":"2024-05-10T08:47:48.930534+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:03.990956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934536+0000","last_change":"2024-05-10T08:47:46.956579+0000","last_active":"2024-05-10T08:47:47.934536+0000","last_peered":"2024-05-10T08:47:47.934536+0000","last_clean":"2024-05-10T08:47:47.934536+0000","last_became_active":"2024-05-10T08:47:46.955068+0000","last_became_peered":"2024-05-10T08:47:46.955068+0000","last_unstale":"2024-05-10T08:47:47.934536+0000","last_undegraded":"2024-05-10T08:47:47.934536+0000","last_fullsized":"2024-05-10T08:47:47.934536+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855547+0000","last_change":"2024-05-10T08:47:46.948562+0000","last_active":"2024-05-10T08:47:48.855547+0000","last_peered":"2024-05-10T08:47:48.855547+0000","last_clean":"2024-05-10T08:47:48.855547+0000","last_became_active":"2024-05-10T08:47:46.948287+0000","last_became_peered":"2024-05-10T08:47:46.948287+0000","last_unstale":"2024-05-10T08:47:48.855547+0000","last_undegraded":"2024-05-10T08:47:48.855547+0000","last_fullsized":"2024-05-10T08:47:48.855547+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:10.442062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933979+0000","last_change":"2024-05-10T08:47:46.951596+0000","last_active":"2024-05-10T08:47:47.933979+0000","last_peered":"2024-05-10T08:47:47.933979+0000","last_clean":"2024-05-10T08:47:47.933979+0000","last_became_active":"2024-05-10T08:47:46.951293+0000","last_became_peered":"2024-05-10T08:47:46.951293+0000","last_unstale":"2024-05-10T08:47:47.933979+0000","last_undegraded":"2024-05-10T08:47:47.933979+0000","last_fullsized":"2024-05-10T08:47:47.933979+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933798+0000","last_change":"2024-05-10T08:47:46.941772+0000","last_active":"2024-05-10T08:47:47.933798+0000","last_peered":"2024-05-10T08:47:47.933798+0000","last_clean":"2024-05-10T08:47:47.933798+0000","last_became_active":"2024-05-10T08:47:46.941508+0000","last_became_peered":"2024-05-10T08:47:46.941508+0000","last_unstale":"2024-05-10T08:47:47.933798+0000","last_undegraded":"2024-05-10T08:47:47.933798+0000","last_fullsized":"2024-05-10T08:47:47.933798+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933637+0000","last_change":"2024-05-10T08:47:46.956064+0000","last_active":"2024-05-10T08:47:47.933637+0000","last_peered":"2024-05-10T08:47:47.933637+0000","last_clean":"2024-05-10T08:47:47.933637+0000","last_became_active":"2024-05-10T08:47:46.955795+0000","last_became_peered":"2024-05-10T08:47:46.955795+0000","last_unstale":"2024-05-10T08:47:47.933637+0000","last_undegraded":"2024-05-10T08:47:47.933637+0000","last_fullsized":"2024-05-10T08:47:47.933637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930479+0000","last_change":"2024-05-10T08:47:46.954708+0000","last_active":"2024-05-10T08:47:48.930479+0000","last_peered":"2024-05-10T08:47:48.930479+0000","last_clean":"2024-05-10T08:47:48.930479+0000","last_became_active":"2024-05-10T08:47:46.954415+0000","last_became_peered":"2024-05-10T08:47:46.954415+0000","last_unstale":"2024-05-10T08:47:48.930479+0000","last_undegraded":"2024-05-10T08:47:48.930479+0000","last_fullsized":"2024-05-10T08:47:48.930479+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:24.396227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930276+0000","last_change":"2024-05-10T08:47:46.961735+0000","last_active":"2024-05-10T08:47:48.930276+0000","last_peered":"2024-05-10T08:47:48.930276+0000","last_clean":"2024-05-10T08:47:48.930276+0000","last_became_active":"2024-05-10T08:47:46.961476+0000","last_became_peered":"2024-05-10T08:47:46.961476+0000","last_unstale":"2024-05-10T08:47:48.930276+0000","last_undegraded":"2024-05-10T08:47:48.930276+0000","last_fullsized":"2024-05-10T08:47:48.930276+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:02.677927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930385+0000","last_change":"2024-05-10T08:47:46.958611+0000","last_active":"2024-05-10T08:47:48.930385+0000","last_peered":"2024-05-10T08:47:48.930385+0000","last_clean":"2024-05-10T08:47:48.930385+0000","last_became_active":"2024-05-10T08:47:46.957729+0000","last_became_peered":"2024-05-10T08:47:46.957729+0000","last_unstale":"2024-05-10T08:47:48.930385+0000","last_undegraded":"2024-05-10T08:47:48.930385+0000","last_fullsized":"2024-05-10T08:47:48.930385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:06:12.102854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934739+0000","last_change":"2024-05-10T08:47:46.952310+0000","last_active":"2024-05-10T08:47:47.934739+0000","last_peered":"2024-05-10T08:47:47.934739+0000","last_clean":"2024-05-10T08:47:47.934739+0000","last_became_active":"2024-05-10T08:47:46.951861+0000","last_became_peered":"2024-05-10T08:47:46.951861+0000","last_unstale":"2024-05-10T08:47:47.934739+0000","last_undegraded":"2024-05-10T08:47:47.934739+0000","last_fullsized":"2024-05-10T08:47:47.934739+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930104+0000","last_change":"2024-05-10T08:47:46.963435+0000","last_active":"2024-05-10T08:47:48.930104+0000","last_peered":"2024-05-10T08:47:48.930104+0000","last_clean":"2024-05-10T08:47:48.930104+0000","last_became_active":"2024-05-10T08:47:46.962767+0000","last_became_peered":"2024-05-10T08:47:46.962767+0000","last_unstale":"2024-05-10T08:47:48.930104+0000","last_undegraded":"2024-05-10T08:47:48.930104+0000","last_fullsized":"2024-05-10T08:47:48.930104+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:44:39.794997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934691+0000","last_change":"2024-05-10T08:47:46.940223+0000","last_active":"2024-05-10T08:47:47.934691+0000","last_peered":"2024-05-10T08:47:47.934691+0000","last_clean":"2024-05-10T08:47:47.934691+0000","last_became_active":"2024-05-10T08:47:46.939314+0000","last_became_peered":"2024-05-10T08:47:46.939314+0000","last_unstale":"2024-05-10T08:47:47.934691+0000","last_undegraded":"2024-05-10T08:47:47.934691+0000","last_fullsized":"2024-05-10T08:47:47.934691+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930189+0000","last_change":"2024-05-10T08:47:46.954208+0000","last_active":"2024-05-10T08:47:48.930189+0000","last_peered":"2024-05-10T08:47:48.930189+0000","last_clean":"2024-05-10T08:47:48.930189+0000","last_became_active":"2024-05-10T08:47:46.953886+0000","last_became_peered":"2024-05-10T08:47:46.953886+0000","last_unstale":"2024-05-10T08:47:48.930189+0000","last_undegraded":"2024-05-10T08:47:48.930189+0000","last_fullsized":"2024-05-10T08:47:48.930189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:36.078442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934604+0000","last_change":"2024-05-10T08:47:46.950352+0000","last_active":"2024-05-10T08:47:47.934604+0000","last_peered":"2024-05-10T08:47:47.934604+0000","last_clean":"2024-05-10T08:47:47.934604+0000","last_became_active":"2024-05-10T08:47:46.950079+0000","last_became_peered":"2024-05-10T08:47:46.950079+0000","last_unstale":"2024-05-10T08:47:47.934604+0000","last_undegraded":"2024-05-10T08:47:47.934604+0000","last_fullsized":"2024-05-10T08:47:47.934604+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:32.126803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934852+0000","last_change":"2024-05-10T08:47:46.954776+0000","last_active":"2024-05-10T08:47:47.934852+0000","last_peered":"2024-05-10T08:47:47.934852+0000","last_clean":"2024-05-10T08:47:47.934852+0000","last_became_active":"2024-05-10T08:47:46.954481+0000","last_became_peered":"2024-05-10T08:47:46.954481+0000","last_unstale":"2024-05-10T08:47:47.934852+0000","last_undegraded":"2024-05-10T08:47:47.934852+0000","last_fullsized":"2024-05-10T08:47:47.934852+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934711+0000","last_change":"2024-05-10T08:47:46.955415+0000","last_active":"2024-05-10T08:47:47.934711+0000","last_peered":"2024-05-10T08:47:47.934711+0000","last_clean":"2024-05-10T08:47:47.934711+0000","last_became_active":"2024-05-10T08:47:46.955090+0000","last_became_peered":"2024-05-10T08:47:46.955090+0000","last_unstale":"2024-05-10T08:47:47.934711+0000","last_undegraded":"2024-05-10T08:47:47.934711+0000","last_fullsized":"2024-05-10T08:47:47.934711+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930597+0000","last_change":"2024-05-10T08:47:46.946695+0000","last_active":"2024-05-10T08:47:48.930597+0000","last_peered":"2024-05-10T08:47:48.930597+0000","last_clean":"2024-05-10T08:47:48.930597+0000","last_became_active":"2024-05-10T08:47:46.946380+0000","last_became_peered":"2024-05-10T08:47:46.946380+0000","last_unstale":"2024-05-10T08:47:48.930597+0000","last_undegraded":"2024-05-10T08:47:48.930597+0000","last_fullsized":"2024-05-10T08:47:48.930597+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:44.547445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929856+0000","last_change":"2024-05-10T08:47:46.962200+0000","last_active":"2024-05-10T08:47:48.929856+0000","last_peered":"2024-05-10T08:47:48.929856+0000","last_clean":"2024-05-10T08:47:48.929856+0000","last_became_active":"2024-05-10T08:47:46.961918+0000","last_became_peered":"2024-05-10T08:47:46.961918+0000","last_unstale":"2024-05-10T08:47:48.929856+0000","last_undegraded":"2024-05-10T08:47:48.929856+0000","last_fullsized":"2024-05-10T08:47:48.929856+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.177609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930203+0000","last_change":"2024-05-10T08:47:46.961715+0000","last_active":"2024-05-10T08:47:48.930203+0000","last_peered":"2024-05-10T08:47:48.930203+0000","last_clean":"2024-05-10T08:47:48.930203+0000","last_became_active":"2024-05-10T08:47:46.961438+0000","last_became_peered":"2024-05-10T08:47:46.961438+0000","last_unstale":"2024-05-10T08:47:48.930203+0000","last_undegraded":"2024-05-10T08:47:48.930203+0000","last_fullsized":"2024-05-10T08:47:48.930203+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:34:17.069869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934135+0000","last_change":"2024-05-10T08:47:46.958806+0000","last_active":"2024-05-10T08:47:47.934135+0000","last_peered":"2024-05-10T08:47:47.934135+0000","last_clean":"2024-05-10T08:47:47.934135+0000","last_became_active":"2024-05-10T08:47:46.958544+0000","last_became_peered":"2024-05-10T08:47:46.958544+0000","last_unstale":"2024-05-10T08:47:47.934135+0000","last_undegraded":"2024-05-10T08:47:47.934135+0000","last_fullsized":"2024-05-10T08:47:47.934135+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:03.990956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929731+0000","last_change":"2024-05-10T08:47:46.951712+0000","last_active":"2024-05-10T08:47:48.929731+0000","last_peered":"2024-05-10T08:47:48.929731+0000","last_clean":"2024-05-10T08:47:48.929731+0000","last_became_active":"2024-05-10T08:47:46.951338+0000","last_became_peered":"2024-05-10T08:47:46.951338+0000","last_unstale":"2024-05-10T08:47:48.929731+0000","last_undegraded":"2024-05-10T08:47:48.929731+0000","last_fullsized":"2024-05-10T08:47:48.929731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:55.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929552+0000","last_change":"2024-05-10T08:47:46.962281+0000","last_active":"2024-05-10T08:47:48.929552+0000","last_peered":"2024-05-10T08:47:48.929552+0000","last_clean":"2024-05-10T08:47:48.929552+0000","last_became_active":"2024-05-10T08:47:46.961740+0000","last_became_peered":"2024-05-10T08:47:46.961740+0000","last_unstale":"2024-05-10T08:47:48.929552+0000","last_undegraded":"2024-05-10T08:47:48.929552+0000","last_fullsized":"2024-05-10T08:47:48.929552+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:57:41.454259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929982+0000","last_change":"2024-05-10T08:47:46.955769+0000","last_active":"2024-05-10T08:47:48.929982+0000","last_peered":"2024-05-10T08:47:48.929982+0000","last_clean":"2024-05-10T08:47:48.929982+0000","last_became_active":"2024-05-10T08:47:46.955448+0000","last_became_peered":"2024-05-10T08:47:46.955448+0000","last_unstale":"2024-05-10T08:47:48.929982+0000","last_undegraded":"2024-05-10T08:47:48.929982+0000","last_fullsized":"2024-05-10T08:47:48.929982+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:23.661741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"102'4","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855800+0000","last_change":"2024-05-10T08:47:45.951357+0000","last_active":"2024-05-10T08:47:48.855800+0000","last_peered":"2024-05-10T08:47:48.855800+0000","last_clean":"2024-05-10T08:47:48.855800+0000","last_became_active":"2024-05-10T08:47:45.951083+0000","last_became_peered":"2024-05-10T08:47:45.951083+0000","last_unstale":"2024-05-10T08:47:48.855800+0000","last_undegraded":"2024-05-10T08:47:48.855800+0000","last_fullsized":"2024-05-10T08:47:48.855800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:01.675277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929602+0000","last_change":"2024-05-10T08:47:46.966051+0000","last_active":"2024-05-10T08:47:48.929602+0000","last_peered":"2024-05-10T08:47:48.929602+0000","last_clean":"2024-05-10T08:47:48.929602+0000","last_became_active":"2024-05-10T08:47:46.965324+0000","last_became_peered":"2024-05-10T08:47:46.965324+0000","last_unstale":"2024-05-10T08:47:48.929602+0000","last_undegraded":"2024-05-10T08:47:48.929602+0000","last_fullsized":"2024-05-10T08:47:48.929602+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:51.388979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929695+0000","last_change":"2024-05-10T08:47:45.950505+0000","last_active":"2024-05-10T08:47:48.929695+0000","last_peered":"2024-05-10T08:47:48.929695+0000","last_clean":"2024-05-10T08:47:48.929695+0000","last_became_active":"2024-05-10T08:47:45.950196+0000","last_became_peered":"2024-05-10T08:47:45.950196+0000","last_unstale":"2024-05-10T08:47:48.929695+0000","last_undegraded":"2024-05-10T08:47:48.929695+0000","last_fullsized":"2024-05-10T08:47:48.929695+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:24.404918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934299+0000","last_change":"2024-05-10T08:47:46.951545+0000","last_active":"2024-05-10T08:47:47.934299+0000","last_peered":"2024-05-10T08:47:47.934299+0000","last_clean":"2024-05-10T08:47:47.934299+0000","last_became_active":"2024-05-10T08:47:46.951280+0000","last_became_peered":"2024-05-10T08:47:46.951280+0000","last_unstale":"2024-05-10T08:47:47.934299+0000","last_undegraded":"2024-05-10T08:47:47.934299+0000","last_fullsized":"2024-05-10T08:47:47.934299+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:21.078958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933613+0000","last_change":"2024-05-10T08:47:45.945401+0000","last_active":"2024-05-10T08:47:47.933613+0000","last_peered":"2024-05-10T08:47:47.933613+0000","last_clean":"2024-05-10T08:47:47.933613+0000","last_became_active":"2024-05-10T08:47:45.945054+0000","last_became_peered":"2024-05-10T08:47:45.945054+0000","last_unstale":"2024-05-10T08:47:47.933613+0000","last_undegraded":"2024-05-10T08:47:47.933613+0000","last_fullsized":"2024-05-10T08:47:47.933613+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:22:42.828175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930014+0000","last_change":"2024-05-10T08:47:46.959135+0000","last_active":"2024-05-10T08:47:48.930014+0000","last_peered":"2024-05-10T08:47:48.930014+0000","last_clean":"2024-05-10T08:47:48.930014+0000","last_became_active":"2024-05-10T08:47:46.958884+0000","last_became_peered":"2024-05-10T08:47:46.958884+0000","last_unstale":"2024-05-10T08:47:48.930014+0000","last_undegraded":"2024-05-10T08:47:48.930014+0000","last_fullsized":"2024-05-10T08:47:48.930014+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:55:32.633950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934703+0000","last_change":"2024-05-10T08:47:45.946621+0000","last_active":"2024-05-10T08:47:47.934703+0000","last_peered":"2024-05-10T08:47:47.934703+0000","last_clean":"2024-05-10T08:47:47.934703+0000","last_became_active":"2024-05-10T08:47:45.946083+0000","last_became_peered":"2024-05-10T08:47:45.946083+0000","last_unstale":"2024-05-10T08:47:47.934703+0000","last_undegraded":"2024-05-10T08:47:47.934703+0000","last_fullsized":"2024-05-10T08:47:47.934703+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:22:24.502072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855698+0000","last_change":"2024-05-10T08:47:46.947194+0000","last_active":"2024-05-10T08:47:48.855698+0000","last_peered":"2024-05-10T08:47:48.855698+0000","last_clean":"2024-05-10T08:47:48.855698+0000","last_became_active":"2024-05-10T08:47:46.946862+0000","last_became_peered":"2024-05-10T08:47:46.946862+0000","last_unstale":"2024-05-10T08:47:48.855698+0000","last_undegraded":"2024-05-10T08:47:48.855698+0000","last_fullsized":"2024-05-10T08:47:48.855698+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:30.604268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934215+0000","last_change":"2024-05-10T08:47:45.948870+0000","last_active":"2024-05-10T08:47:47.934215+0000","last_peered":"2024-05-10T08:47:47.934215+0000","last_clean":"2024-05-10T08:47:47.934215+0000","last_became_active":"2024-05-10T08:47:45.948580+0000","last_became_peered":"2024-05-10T08:47:45.948580+0000","last_unstale":"2024-05-10T08:47:47.934215+0000","last_undegraded":"2024-05-10T08:47:47.934215+0000","last_fullsized":"2024-05-10T08:47:47.934215+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:34:12.078307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930563+0000","last_change":"2024-05-10T08:47:46.958854+0000","last_active":"2024-05-10T08:47:48.930563+0000","last_peered":"2024-05-10T08:47:48.930563+0000","last_clean":"2024-05-10T08:47:48.930563+0000","last_became_active":"2024-05-10T08:47:46.957777+0000","last_became_peered":"2024-05-10T08:47:46.957777+0000","last_unstale":"2024-05-10T08:47:48.930563+0000","last_undegraded":"2024-05-10T08:47:48.930563+0000","last_fullsized":"2024-05-10T08:47:48.930563+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:10.151047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929510+0000","last_change":"2024-05-10T08:47:45.946555+0000","last_active":"2024-05-10T08:47:48.929510+0000","last_peered":"2024-05-10T08:47:48.929510+0000","last_clean":"2024-05-10T08:47:48.929510+0000","last_became_active":"2024-05-10T08:47:45.946250+0000","last_became_peered":"2024-05-10T08:47:45.946250+0000","last_unstale":"2024-05-10T08:47:48.929510+0000","last_undegraded":"2024-05-10T08:47:48.929510+0000","last_fullsized":"2024-05-10T08:47:48.929510+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:47.299832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930279+0000","last_change":"2024-05-10T08:47:46.957885+0000","last_active":"2024-05-10T08:47:48.930279+0000","last_peered":"2024-05-10T08:47:48.930279+0000","last_clean":"2024-05-10T08:47:48.930279+0000","last_became_active":"2024-05-10T08:47:46.957605+0000","last_became_peered":"2024-05-10T08:47:46.957605+0000","last_unstale":"2024-05-10T08:47:48.930279+0000","last_undegraded":"2024-05-10T08:47:48.930279+0000","last_fullsized":"2024-05-10T08:47:48.930279+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:54:21.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934151+0000","last_change":"2024-05-10T08:47:45.943591+0000","last_active":"2024-05-10T08:47:47.934151+0000","last_peered":"2024-05-10T08:47:47.934151+0000","last_clean":"2024-05-10T08:47:47.934151+0000","last_became_active":"2024-05-10T08:47:45.943328+0000","last_became_peered":"2024-05-10T08:47:45.943328+0000","last_unstale":"2024-05-10T08:47:47.934151+0000","last_undegraded":"2024-05-10T08:47:47.934151+0000","last_fullsized":"2024-05-10T08:47:47.934151+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:33.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855856+0000","last_change":"2024-05-10T08:47:46.946662+0000","last_active":"2024-05-10T08:47:48.855856+0000","last_peered":"2024-05-10T08:47:48.855856+0000","last_clean":"2024-05-10T08:47:48.855856+0000","last_became_active":"2024-05-10T08:47:46.946347+0000","last_became_peered":"2024-05-10T08:47:46.946347+0000","last_unstale":"2024-05-10T08:47:48.855856+0000","last_undegraded":"2024-05-10T08:47:48.855856+0000","last_fullsized":"2024-05-10T08:47:48.855856+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:22.179752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855412+0000","last_change":"2024-05-10T08:47:45.941560+0000","last_active":"2024-05-10T08:47:48.855412+0000","last_peered":"2024-05-10T08:47:48.855412+0000","last_clean":"2024-05-10T08:47:48.855412+0000","last_became_active":"2024-05-10T08:47:45.941279+0000","last_became_peered":"2024-05-10T08:47:45.941279+0000","last_unstale":"2024-05-10T08:47:48.855412+0000","last_undegraded":"2024-05-10T08:47:48.855412+0000","last_fullsized":"2024-05-10T08:47:48.855412+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:27.960286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929822+0000","last_change":"2024-05-10T08:47:46.957426+0000","last_active":"2024-05-10T08:47:48.929822+0000","last_peered":"2024-05-10T08:47:48.929822+0000","last_clean":"2024-05-10T08:47:48.929822+0000","last_became_active":"2024-05-10T08:47:46.957089+0000","last_became_peered":"2024-05-10T08:47:46.957089+0000","last_unstale":"2024-05-10T08:47:48.929822+0000","last_undegraded":"2024-05-10T08:47:48.929822+0000","last_fullsized":"2024-05-10T08:47:48.929822+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:53.037611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934733+0000","last_change":"2024-05-10T08:47:45.944927+0000","last_active":"2024-05-10T08:47:47.934733+0000","last_peered":"2024-05-10T08:47:47.934733+0000","last_clean":"2024-05-10T08:47:47.934733+0000","last_became_active":"2024-05-10T08:47:45.944637+0000","last_became_peered":"2024-05-10T08:47:45.944637+0000","last_unstale":"2024-05-10T08:47:47.934733+0000","last_undegraded":"2024-05-10T08:47:47.934733+0000","last_fullsized":"2024-05-10T08:47:47.934733+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:37.361280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934739+0000","last_change":"2024-05-10T08:47:46.961330+0000","last_active":"2024-05-10T08:47:47.934739+0000","last_peered":"2024-05-10T08:47:47.934739+0000","last_clean":"2024-05-10T08:47:47.934739+0000","last_became_active":"2024-05-10T08:47:46.960992+0000","last_became_peered":"2024-05-10T08:47:46.960992+0000","last_unstale":"2024-05-10T08:47:47.934739+0000","last_undegraded":"2024-05-10T08:47:47.934739+0000","last_fullsized":"2024-05-10T08:47:47.934739+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:55.165864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929800+0000","last_change":"2024-05-10T08:47:45.954303+0000","last_active":"2024-05-10T08:47:48.929800+0000","last_peered":"2024-05-10T08:47:48.929800+0000","last_clean":"2024-05-10T08:47:48.929800+0000","last_became_active":"2024-05-10T08:47:45.954002+0000","last_became_peered":"2024-05-10T08:47:45.954002+0000","last_unstale":"2024-05-10T08:47:48.929800+0000","last_undegraded":"2024-05-10T08:47:48.929800+0000","last_fullsized":"2024-05-10T08:47:48.929800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:29.601618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929671+0000","last_change":"2024-05-10T08:47:46.962806+0000","last_active":"2024-05-10T08:47:48.929671+0000","last_peered":"2024-05-10T08:47:48.929671+0000","last_clean":"2024-05-10T08:47:48.929671+0000","last_became_active":"2024-05-10T08:47:46.962467+0000","last_became_peered":"2024-05-10T08:47:46.962467+0000","last_unstale":"2024-05-10T08:47:48.929671+0000","last_undegraded":"2024-05-10T08:47:48.929671+0000","last_fullsized":"2024-05-10T08:47:48.929671+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:17.229937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934307+0000","last_change":"2024-05-10T08:47:45.947475+0000","last_active":"2024-05-10T08:47:47.934307+0000","last_peered":"2024-05-10T08:47:47.934307+0000","last_clean":"2024-05-10T08:47:47.934307+0000","last_became_active":"2024-05-10T08:47:45.947172+0000","last_became_peered":"2024-05-10T08:47:45.947172+0000","last_unstale":"2024-05-10T08:47:47.934307+0000","last_undegraded":"2024-05-10T08:47:47.934307+0000","last_fullsized":"2024-05-10T08:47:47.934307+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:02.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.935002+0000","last_change":"2024-05-10T08:47:46.961804+0000","last_active":"2024-05-10T08:47:47.935002+0000","last_peered":"2024-05-10T08:47:47.935002+0000","last_clean":"2024-05-10T08:47:47.935002+0000","last_became_active":"2024-05-10T08:47:46.961504+0000","last_became_peered":"2024-05-10T08:47:46.961504+0000","last_unstale":"2024-05-10T08:47:47.935002+0000","last_undegraded":"2024-05-10T08:47:47.935002+0000","last_fullsized":"2024-05-10T08:47:47.935002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:28.962935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930019+0000","last_change":"2024-05-10T08:47:45.949330+0000","last_active":"2024-05-10T08:47:48.930019+0000","last_peered":"2024-05-10T08:47:48.930019+0000","last_clean":"2024-05-10T08:47:48.930019+0000","last_became_active":"2024-05-10T08:47:45.949025+0000","last_became_peered":"2024-05-10T08:47:45.949025+0000","last_unstale":"2024-05-10T08:47:48.930019+0000","last_undegraded":"2024-05-10T08:47:48.930019+0000","last_fullsized":"2024-05-10T08:47:48.930019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:05.081620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930282+0000","last_change":"2024-05-10T08:47:46.947662+0000","last_active":"2024-05-10T08:47:48.930282+0000","last_peered":"2024-05-10T08:47:48.930282+0000","last_clean":"2024-05-10T08:47:48.930282+0000","last_became_active":"2024-05-10T08:47:46.947245+0000","last_became_peered":"2024-05-10T08:47:46.947245+0000","last_unstale":"2024-05-10T08:47:48.930282+0000","last_undegraded":"2024-05-10T08:47:48.930282+0000","last_fullsized":"2024-05-10T08:47:48.930282+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:34:13.080957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934913+0000","last_change":"2024-05-10T08:47:45.948425+0000","last_active":"2024-05-10T08:47:47.934913+0000","last_peered":"2024-05-10T08:47:47.934913+0000","last_clean":"2024-05-10T08:47:47.934913+0000","last_became_active":"2024-05-10T08:47:45.948130+0000","last_became_peered":"2024-05-10T08:47:45.948130+0000","last_unstale":"2024-05-10T08:47:47.934913+0000","last_undegraded":"2024-05-10T08:47:47.934913+0000","last_fullsized":"2024-05-10T08:47:47.934913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:37.758407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930219+0000","last_change":"2024-05-10T08:47:46.954400+0000","last_active":"2024-05-10T08:47:48.930219+0000","last_peered":"2024-05-10T08:47:48.930219+0000","last_clean":"2024-05-10T08:47:48.930219+0000","last_became_active":"2024-05-10T08:47:46.954144+0000","last_became_peered":"2024-05-10T08:47:46.954144+0000","last_unstale":"2024-05-10T08:47:48.930219+0000","last_undegraded":"2024-05-10T08:47:48.930219+0000","last_fullsized":"2024-05-10T08:47:48.930219+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:31.145944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855471+0000","last_change":"2024-05-10T08:47:45.944928+0000","last_active":"2024-05-10T08:47:48.855471+0000","last_peered":"2024-05-10T08:47:48.855471+0000","last_clean":"2024-05-10T08:47:48.855471+0000","last_became_active":"2024-05-10T08:47:45.944656+0000","last_became_peered":"2024-05-10T08:47:45.944656+0000","last_unstale":"2024-05-10T08:47:48.855471+0000","last_undegraded":"2024-05-10T08:47:48.855471+0000","last_fullsized":"2024-05-10T08:47:48.855471+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:30.143294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929725+0000","last_change":"2024-05-10T08:47:46.961204+0000","last_active":"2024-05-10T08:47:48.929725+0000","last_peered":"2024-05-10T08:47:48.929725+0000","last_clean":"2024-05-10T08:47:48.929725+0000","last_became_active":"2024-05-10T08:47:46.960885+0000","last_became_peered":"2024-05-10T08:47:46.960885+0000","last_unstale":"2024-05-10T08:47:48.929725+0000","last_undegraded":"2024-05-10T08:47:48.929725+0000","last_fullsized":"2024-05-10T08:47:48.929725+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:53:47.091166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929473+0000","last_change":"2024-05-10T08:47:45.952528+0000","last_active":"2024-05-10T08:47:48.929473+0000","last_peered":"2024-05-10T08:47:48.929473+0000","last_clean":"2024-05-10T08:47:48.929473+0000","last_became_active":"2024-05-10T08:47:45.952268+0000","last_became_peered":"2024-05-10T08:47:45.952268+0000","last_unstale":"2024-05-10T08:47:48.929473+0000","last_undegraded":"2024-05-10T08:47:48.929473+0000","last_fullsized":"2024-05-10T08:47:48.929473+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:55.834413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930609+0000","last_change":"2024-05-10T08:47:46.954408+0000","last_active":"2024-05-10T08:47:48.930609+0000","last_peered":"2024-05-10T08:47:48.930609+0000","last_clean":"2024-05-10T08:47:48.930609+0000","last_became_active":"2024-05-10T08:47:46.954125+0000","last_became_peered":"2024-05-10T08:47:46.954125+0000","last_unstale":"2024-05-10T08:47:48.930609+0000","last_undegraded":"2024-05-10T08:47:48.930609+0000","last_fullsized":"2024-05-10T08:47:48.930609+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:13.431202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":22,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934902+0000","last_change":"2024-05-10T08:47:45.940286+0000","last_active":"2024-05-10T08:47:47.934902+0000","last_peered":"2024-05-10T08:47:47.934902+0000","last_clean":"2024-05-10T08:47:47.934902+0000","last_became_active":"2024-05-10T08:47:45.940000+0000","last_became_peered":"2024-05-10T08:47:45.940000+0000","last_unstale":"2024-05-10T08:47:47.934902+0000","last_undegraded":"2024-05-10T08:47:47.934902+0000","last_fullsized":"2024-05-10T08:47:47.934902+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:45.507964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930042+0000","last_change":"2024-05-10T08:47:46.961873+0000","last_active":"2024-05-10T08:47:48.930042+0000","last_peered":"2024-05-10T08:47:48.930042+0000","last_clean":"2024-05-10T08:47:48.930042+0000","last_became_active":"2024-05-10T08:47:46.961376+0000","last_became_peered":"2024-05-10T08:47:46.961376+0000","last_unstale":"2024-05-10T08:47:48.930042+0000","last_undegraded":"2024-05-10T08:47:48.930042+0000","last_fullsized":"2024-05-10T08:47:48.930042+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:10:19.661076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929441+0000","last_change":"2024-05-10T08:47:45.947284+0000","last_active":"2024-05-10T08:47:48.929441+0000","last_peered":"2024-05-10T08:47:48.929441+0000","last_clean":"2024-05-10T08:47:48.929441+0000","last_became_active":"2024-05-10T08:47:45.947000+0000","last_became_peered":"2024-05-10T08:47:45.947000+0000","last_unstale":"2024-05-10T08:47:48.929441+0000","last_undegraded":"2024-05-10T08:47:48.929441+0000","last_fullsized":"2024-05-10T08:47:48.929441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:46.677065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929987+0000","last_change":"2024-05-10T08:47:46.957180+0000","last_active":"2024-05-10T08:47:48.929987+0000","last_peered":"2024-05-10T08:47:48.929987+0000","last_clean":"2024-05-10T08:47:48.929987+0000","last_became_active":"2024-05-10T08:47:46.956661+0000","last_became_peered":"2024-05-10T08:47:46.956661+0000","last_unstale":"2024-05-10T08:47:48.929987+0000","last_undegraded":"2024-05-10T08:47:48.929987+0000","last_fullsized":"2024-05-10T08:47:48.929987+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:16.031419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934438+0000","last_change":"2024-05-10T08:47:45.944706+0000","last_active":"2024-05-10T08:47:47.934438+0000","last_peered":"2024-05-10T08:47:47.934438+0000","last_clean":"2024-05-10T08:47:47.934438+0000","last_became_active":"2024-05-10T08:47:45.944400+0000","last_became_peered":"2024-05-10T08:47:45.944400+0000","last_unstale":"2024-05-10T08:47:47.934438+0000","last_undegraded":"2024-05-10T08:47:47.934438+0000","last_fullsized":"2024-05-10T08:47:47.934438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:20.076309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934864+0000","last_change":"2024-05-10T08:47:46.939221+0000","last_active":"2024-05-10T08:47:47.934864+0000","last_peered":"2024-05-10T08:47:47.934864+0000","last_clean":"2024-05-10T08:47:47.934864+0000","last_became_active":"2024-05-10T08:47:46.938789+0000","last_became_peered":"2024-05-10T08:47:46.938789+0000","last_unstale":"2024-05-10T08:47:47.934864+0000","last_undegraded":"2024-05-10T08:47:47.934864+0000","last_fullsized":"2024-05-10T08:47:47.934864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:00.643725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930254+0000","last_change":"2024-05-10T08:47:45.949017+0000","last_active":"2024-05-10T08:47:48.930254+0000","last_peered":"2024-05-10T08:47:48.930254+0000","last_clean":"2024-05-10T08:47:48.930254+0000","last_became_active":"2024-05-10T08:47:45.948712+0000","last_became_peered":"2024-05-10T08:47:45.948712+0000","last_unstale":"2024-05-10T08:47:48.930254+0000","last_undegraded":"2024-05-10T08:47:48.930254+0000","last_fullsized":"2024-05-10T08:47:48.930254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:49.975788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929862+0000","last_change":"2024-05-10T08:47:46.953847+0000","last_active":"2024-05-10T08:47:48.929862+0000","last_peered":"2024-05-10T08:47:48.929862+0000","last_clean":"2024-05-10T08:47:48.929862+0000","last_became_active":"2024-05-10T08:47:46.953232+0000","last_became_peered":"2024-05-10T08:47:46.953232+0000","last_unstale":"2024-05-10T08:47:48.929862+0000","last_undegraded":"2024-05-10T08:47:48.929862+0000","last_fullsized":"2024-05-10T08:47:48.929862+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:00:15.976333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930243+0000","last_change":"2024-05-10T08:47:45.952459+0000","last_active":"2024-05-10T08:47:48.930243+0000","last_peered":"2024-05-10T08:47:48.930243+0000","last_clean":"2024-05-10T08:47:48.930243+0000","last_became_active":"2024-05-10T08:47:45.952125+0000","last_became_peered":"2024-05-10T08:47:45.952125+0000","last_unstale":"2024-05-10T08:47:48.930243+0000","last_undegraded":"2024-05-10T08:47:48.930243+0000","last_fullsized":"2024-05-10T08:47:48.930243+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:54.499465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930492+0000","last_change":"2024-05-10T08:47:46.947814+0000","last_active":"2024-05-10T08:47:48.930492+0000","last_peered":"2024-05-10T08:47:48.930492+0000","last_clean":"2024-05-10T08:47:48.930492+0000","last_became_active":"2024-05-10T08:47:46.947513+0000","last_became_peered":"2024-05-10T08:47:46.947513+0000","last_unstale":"2024-05-10T08:47:48.930492+0000","last_undegraded":"2024-05-10T08:47:48.930492+0000","last_fullsized":"2024-05-10T08:47:48.930492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:58.101997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929446+0000","last_change":"2024-05-10T08:47:45.947317+0000","last_active":"2024-05-10T08:47:48.929446+0000","last_peered":"2024-05-10T08:47:48.929446+0000","last_clean":"2024-05-10T08:47:48.929446+0000","last_became_active":"2024-05-10T08:47:45.946998+0000","last_became_peered":"2024-05-10T08:47:45.946998+0000","last_unstale":"2024-05-10T08:47:48.929446+0000","last_undegraded":"2024-05-10T08:47:48.929446+0000","last_fullsized":"2024-05-10T08:47:48.929446+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:06:39.491530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855775+0000","last_change":"2024-05-10T08:47:46.957527+0000","last_active":"2024-05-10T08:47:48.855775+0000","last_peered":"2024-05-10T08:47:48.855775+0000","last_clean":"2024-05-10T08:47:48.855775+0000","last_became_active":"2024-05-10T08:47:46.957224+0000","last_became_peered":"2024-05-10T08:47:46.957224+0000","last_unstale":"2024-05-10T08:47:48.855775+0000","last_undegraded":"2024-05-10T08:47:48.855775+0000","last_fullsized":"2024-05-10T08:47:48.855775+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:37.303219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929616+0000","last_change":"2024-05-10T08:47:45.947067+0000","last_active":"2024-05-10T08:47:48.929616+0000","last_peered":"2024-05-10T08:47:48.929616+0000","last_clean":"2024-05-10T08:47:48.929616+0000","last_became_active":"2024-05-10T08:47:45.946107+0000","last_became_peered":"2024-05-10T08:47:45.946107+0000","last_unstale":"2024-05-10T08:47:48.929616+0000","last_undegraded":"2024-05-10T08:47:48.929616+0000","last_fullsized":"2024-05-10T08:47:48.929616+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:33.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930034+0000","last_change":"2024-05-10T08:47:46.963419+0000","last_active":"2024-05-10T08:47:48.930034+0000","last_peered":"2024-05-10T08:47:48.930034+0000","last_clean":"2024-05-10T08:47:48.930034+0000","last_became_active":"2024-05-10T08:47:46.963059+0000","last_became_peered":"2024-05-10T08:47:46.963059+0000","last_unstale":"2024-05-10T08:47:48.930034+0000","last_undegraded":"2024-05-10T08:47:48.930034+0000","last_fullsized":"2024-05-10T08:47:48.930034+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:24:42.025251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929973+0000","last_change":"2024-05-10T08:47:45.945090+0000","last_active":"2024-05-10T08:47:48.929973+0000","last_peered":"2024-05-10T08:47:48.929973+0000","last_clean":"2024-05-10T08:47:48.929973+0000","last_became_active":"2024-05-10T08:47:45.944805+0000","last_became_peered":"2024-05-10T08:47:45.944805+0000","last_unstale":"2024-05-10T08:47:48.929973+0000","last_undegraded":"2024-05-10T08:47:48.929973+0000","last_fullsized":"2024-05-10T08:47:48.929973+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:45.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930225+0000","last_change":"2024-05-10T08:47:46.952463+0000","last_active":"2024-05-10T08:47:48.930225+0000","last_peered":"2024-05-10T08:47:48.930225+0000","last_clean":"2024-05-10T08:47:48.930225+0000","last_became_active":"2024-05-10T08:47:46.952192+0000","last_became_peered":"2024-05-10T08:47:46.952192+0000","last_unstale":"2024-05-10T08:47:48.930225+0000","last_undegraded":"2024-05-10T08:47:48.930225+0000","last_fullsized":"2024-05-10T08:47:48.930225+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:01.200192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934790+0000","last_change":"2024-05-10T08:47:45.946159+0000","last_active":"2024-05-10T08:47:47.934790+0000","last_peered":"2024-05-10T08:47:47.934790+0000","last_clean":"2024-05-10T08:47:47.934790+0000","last_became_active":"2024-05-10T08:47:45.945848+0000","last_became_peered":"2024-05-10T08:47:45.945848+0000","last_unstale":"2024-05-10T08:47:47.934790+0000","last_undegraded":"2024-05-10T08:47:47.934790+0000","last_fullsized":"2024-05-10T08:47:47.934790+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:10:44.827395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934385+0000","last_change":"2024-05-10T08:47:46.952748+0000","last_active":"2024-05-10T08:47:47.934385+0000","last_peered":"2024-05-10T08:47:47.934385+0000","last_clean":"2024-05-10T08:47:47.934385+0000","last_became_active":"2024-05-10T08:47:46.952466+0000","last_became_peered":"2024-05-10T08:47:46.952466+0000","last_unstale":"2024-05-10T08:47:47.934385+0000","last_undegraded":"2024-05-10T08:47:47.934385+0000","last_fullsized":"2024-05-10T08:47:47.934385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:21:44.547445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"103'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929952+0000","last_change":"2024-05-10T08:47:45.948810+0000","last_active":"2024-05-10T08:47:48.929952+0000","last_peered":"2024-05-10T08:47:48.929952+0000","last_clean":"2024-05-10T08:47:48.929952+0000","last_became_active":"2024-05-10T08:47:45.948512+0000","last_became_peered":"2024-05-10T08:47:45.948512+0000","last_unstale":"2024-05-10T08:47:48.929952+0000","last_undegraded":"2024-05-10T08:47:48.929952+0000","last_fullsized":"2024-05-10T08:47:48.929952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:56:36.300570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.855693+0000","last_change":"2024-05-10T08:47:46.956986+0000","last_active":"2024-05-10T08:47:48.855693+0000","last_peered":"2024-05-10T08:47:48.855693+0000","last_clean":"2024-05-10T08:47:48.855693+0000","last_became_active":"2024-05-10T08:47:46.956669+0000","last_became_peered":"2024-05-10T08:47:46.956669+0000","last_unstale":"2024-05-10T08:47:48.855693+0000","last_undegraded":"2024-05-10T08:47:48.855693+0000","last_fullsized":"2024-05-10T08:47:48.855693+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:22.271792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929922+0000","last_change":"2024-05-10T08:47:45.951460+0000","last_active":"2024-05-10T08:47:48.929922+0000","last_peered":"2024-05-10T08:47:48.929922+0000","last_clean":"2024-05-10T08:47:48.929922+0000","last_became_active":"2024-05-10T08:47:45.951205+0000","last_became_peered":"2024-05-10T08:47:45.951205+0000","last_unstale":"2024-05-10T08:47:48.929922+0000","last_undegraded":"2024-05-10T08:47:48.929922+0000","last_fullsized":"2024-05-10T08:47:48.929922+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:22:42.828175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929840+0000","last_change":"2024-05-10T08:47:46.944737+0000","last_active":"2024-05-10T08:47:48.929840+0000","last_peered":"2024-05-10T08:47:48.929840+0000","last_clean":"2024-05-10T08:47:48.929840+0000","last_became_active":"2024-05-10T08:47:46.944458+0000","last_became_peered":"2024-05-10T08:47:46.944458+0000","last_unstale":"2024-05-10T08:47:48.929840+0000","last_undegraded":"2024-05-10T08:47:48.929840+0000","last_fullsized":"2024-05-10T08:47:48.929840+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:44:59.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934802+0000","last_change":"2024-05-10T08:47:45.949177+0000","last_active":"2024-05-10T08:47:47.934802+0000","last_peered":"2024-05-10T08:47:47.934802+0000","last_clean":"2024-05-10T08:47:47.934802+0000","last_became_active":"2024-05-10T08:47:45.948887+0000","last_became_peered":"2024-05-10T08:47:45.948887+0000","last_unstale":"2024-05-10T08:47:47.934802+0000","last_undegraded":"2024-05-10T08:47:47.934802+0000","last_fullsized":"2024-05-10T08:47:47.934802+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:34:46.677065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929940+0000","last_change":"2024-05-10T08:47:46.966147+0000","last_active":"2024-05-10T08:47:48.929940+0000","last_peered":"2024-05-10T08:47:48.929940+0000","last_clean":"2024-05-10T08:47:48.929940+0000","last_became_active":"2024-05-10T08:47:46.965236+0000","last_became_peered":"2024-05-10T08:47:46.965236+0000","last_unstale":"2024-05-10T08:47:48.929940+0000","last_undegraded":"2024-05-10T08:47:48.929940+0000","last_fullsized":"2024-05-10T08:47:48.929940+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:37.003446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934200+0000","last_change":"2024-05-10T08:47:45.944910+0000","last_active":"2024-05-10T08:47:47.934200+0000","last_peered":"2024-05-10T08:47:47.934200+0000","last_clean":"2024-05-10T08:47:47.934200+0000","last_became_active":"2024-05-10T08:47:45.944599+0000","last_became_peered":"2024-05-10T08:47:45.944599+0000","last_unstale":"2024-05-10T08:47:47.934200+0000","last_undegraded":"2024-05-10T08:47:47.934200+0000","last_fullsized":"2024-05-10T08:47:47.934200+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:05.081620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929737+0000","last_change":"2024-05-10T08:47:46.962873+0000","last_active":"2024-05-10T08:47:48.929737+0000","last_peered":"2024-05-10T08:47:48.929737+0000","last_clean":"2024-05-10T08:47:48.929737+0000","last_became_active":"2024-05-10T08:47:46.962584+0000","last_became_peered":"2024-05-10T08:47:46.962584+0000","last_unstale":"2024-05-10T08:47:48.929737+0000","last_undegraded":"2024-05-10T08:47:48.929737+0000","last_fullsized":"2024-05-10T08:47:48.929737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:47.921304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929845+0000","last_change":"2024-05-10T08:47:45.952529+0000","last_active":"2024-05-10T08:47:48.929845+0000","last_peered":"2024-05-10T08:47:48.929845+0000","last_clean":"2024-05-10T08:47:48.929845+0000","last_became_active":"2024-05-10T08:47:45.952203+0000","last_became_peered":"2024-05-10T08:47:45.952203+0000","last_unstale":"2024-05-10T08:47:48.929845+0000","last_undegraded":"2024-05-10T08:47:48.929845+0000","last_fullsized":"2024-05-10T08:47:48.929845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:56:30.561372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.934799+0000","last_change":"2024-05-10T08:47:46.939329+0000","last_active":"2024-05-10T08:47:47.934799+0000","last_peered":"2024-05-10T08:47:47.934799+0000","last_clean":"2024-05-10T08:47:47.934799+0000","last_became_active":"2024-05-10T08:47:46.938942+0000","last_became_peered":"2024-05-10T08:47:46.938942+0000","last_unstale":"2024-05-10T08:47:47.934799+0000","last_undegraded":"2024-05-10T08:47:47.934799+0000","last_fullsized":"2024-05-10T08:47:47.934799+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:31.145944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929728+0000","last_change":"2024-05-10T08:47:45.951394+0000","last_active":"2024-05-10T08:47:48.929728+0000","last_peered":"2024-05-10T08:47:48.929728+0000","last_clean":"2024-05-10T08:47:48.929728+0000","last_became_active":"2024-05-10T08:47:45.951121+0000","last_became_peered":"2024-05-10T08:47:45.951121+0000","last_unstale":"2024-05-10T08:47:48.929728+0000","last_undegraded":"2024-05-10T08:47:48.929728+0000","last_fullsized":"2024-05-10T08:47:48.929728+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:28:45.507964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930553+0000","last_change":"2024-05-10T08:47:46.939045+0000","last_active":"2024-05-10T08:47:48.930553+0000","last_peered":"2024-05-10T08:47:48.930553+0000","last_clean":"2024-05-10T08:47:48.930553+0000","last_became_active":"2024-05-10T08:47:46.938746+0000","last_became_peered":"2024-05-10T08:47:46.938746+0000","last_unstale":"2024-05-10T08:47:48.930553+0000","last_undegraded":"2024-05-10T08:47:48.930553+0000","last_fullsized":"2024-05-10T08:47:48.930553+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:11:21.078958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.930101+0000","last_change":"2024-05-10T08:47:45.952553+0000","last_active":"2024-05-10T08:47:48.930101+0000","last_peered":"2024-05-10T08:47:48.930101+0000","last_clean":"2024-05-10T08:47:48.930101+0000","last_became_active":"2024-05-10T08:47:45.952305+0000","last_became_peered":"2024-05-10T08:47:45.952305+0000","last_unstale":"2024-05-10T08:47:48.930101+0000","last_undegraded":"2024-05-10T08:47:48.930101+0000","last_fullsized":"2024-05-10T08:47:48.930101+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:08.308019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929461+0000","last_change":"2024-05-10T08:47:46.946221+0000","last_active":"2024-05-10T08:47:48.929461+0000","last_peered":"2024-05-10T08:47:48.929461+0000","last_clean":"2024-05-10T08:47:48.929461+0000","last_became_active":"2024-05-10T08:47:46.945733+0000","last_became_peered":"2024-05-10T08:47:46.945733+0000","last_unstale":"2024-05-10T08:47:48.929461+0000","last_undegraded":"2024-05-10T08:47:48.929461+0000","last_fullsized":"2024-05-10T08:47:48.929461+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:45.922084+0000","last_clean_scrub_stamp":"2024-05-10T08:47:45.922084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:41.933192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:48.929799+0000","last_change":"2024-05-10T08:47:45.945298+0000","last_active":"2024-05-10T08:47:48.929799+0000","last_peered":"2024-05-10T08:47:48.929799+0000","last_clean":"2024-05-10T08:47:48.929799+0000","last_became_active":"2024-05-10T08:47:45.944895+0000","last_became_peered":"2024-05-10T08:47:45.944895+0000","last_unstale":"2024-05-10T08:47:48.929799+0000","last_undegraded":"2024-05-10T08:47:48.929799+0000","last_fullsized":"2024-05-10T08:47:48.929799+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:47:44.919435+0000","last_clean_scrub_stamp":"2024-05-10T08:47:44.919435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:08:16.310350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":265,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-05-10T08:47:47.933697+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:47:47.933697+0000","last_peered":"2024-05-10T08:47:47.933697+0000","last_clean":"2024-05-10T08:47:47.933697+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:47:47.933697+0000","last_undegraded":"2024-05-10T08:47:47.933697+0000","last_fullsized":"2024-05-10T08:47:47.933697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1880064,"data_stored":1182738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1298432,"data_stored":594426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1277952,"data_stored":592210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1286144,"data_stored":592302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":592244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1888256,"data_stored":1184280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:47:55.819 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:47:55.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T08:47:55.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.967+0000 7fce9330a640 1 Processor -- start 2024-05-10T08:47:55.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.967+0000 7fce9330a640 1 -- start start 2024-05-10T08:47:55.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce9330a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce8c0d3cd0 0x7fce8c0d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce9330a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8c0b1c90 con 0x7fce8c0b3f30 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce9330a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8c0d0a50 con 0x7fce8c15f380 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce9330a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fce8c0d0d30 con 0x7fce8c0d3cd0 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce918a7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce8c0b3f30 0x7fce8c0d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48718/0 (socket says 172.21.15.37:48718) 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce918a7640 1 -- 172.21.15.37:0/2753746940 learned_addr learned my addr 172.21.15.37:0/2753746940 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce908a5640 1 --2- 172.21.15.37:0/2753746940 >> v2:172.21.15.82:3300/0 conn(0x7fce8c0d3cd0 0x7fce8c0d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292150603 0 0) 0x7fce8c0b1c90 con 0x7fce8c0b3f30 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.968+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce78003520 con 0x7fce8c0b3f30 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.969+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826449402 0 0) 0x7fce8c0d0a50 con 0x7fce8c15f380 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.969+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce8c0b1c90 con 0x7fce8c15f380 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.969+0000 7fce908a5640 1 -- 172.21.15.37:0/2753746940 >> v1:172.21.15.82:6789/0 conn(0x7fce8c15f380 legacy=0x7fce8c0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.969+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 478655364 0 0) 0x7fce78003520 con 0x7fce8c0b3f30 2024-05-10T08:47:55.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.969+0000 7fce908a5640 1 -- 172.21.15.37:0/2753746940 >> v1:172.21.15.37:6789/0 conn(0x7fce8c0b3f30 legacy=0x7fce8c0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.969+0000 7fce908a5640 1 -- 172.21.15.37:0/2753746940 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c0b1f00 con 0x7fce8c0d3cd0 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.969+0000 7fce908a5640 1 --2- 172.21.15.37:0/2753746940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c0d3cd0 0x7fce8c0d15f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0097a0 tx=0x7fce7c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ea61ceabcd1b28e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c037070 con 0x7fce8c0d3cd0 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7c02ac50 con 0x7fce8c0d3cd0 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce83fff640 1 -- 172.21.15.37:0/2753746940 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840019f0 con 0x7fce8c0d3cd0 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce9330a640 1 -- 172.21.15.37:0/2753746940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c0d3cd0 msgr2=0x7fce8c0d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce9330a640 1 --2- 172.21.15.37:0/2753746940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c0d3cd0 0x7fce8c0d15f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0097a0 tx=0x7fce7c02a1c0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce9330a640 1 -- 172.21.15.37:0/2753746940 shutdown_connections 2024-05-10T08:47:55.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce9330a640 1 --2- 172.21.15.37:0/2753746940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c0d3cd0 0x7fce8c0d15f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce9330a640 1 -- 172.21.15.37:0/2753746940 >> 172.21.15.37:0/2753746940 conn(0x7fce8c0d4fe0 msgr2=0x7fce8c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:55.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce9330a640 1 -- 172.21.15.37:0/2753746940 shutdown_connections 2024-05-10T08:47:55.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.970+0000 7fce9330a640 1 -- 172.21.15.37:0/2753746940 wait complete. 2024-05-10T08:47:55.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.971+0000 7fce9330a640 1 Processor -- start 2024-05-10T08:47:55.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.971+0000 7fce9330a640 1 -- start start 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce9330a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce8c0b3f30 0x7fce8c161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce9330a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8c0d3cd0 0x7fce8c161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce9330a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c15f380 0x7fce8c0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce9330a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c0d06e0 con 0x7fce8c0b3f30 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce9330a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c0d1010 con 0x7fce8c15f380 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce9330a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fce8c0b3430 con 0x7fce8c0d3cd0 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce910a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce8c0b3f30 0x7fce8c161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce910a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce8c0b3f30 0x7fce8c161980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59054/0 (socket says 172.21.15.37:59054) 2024-05-10T08:47:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.972+0000 7fce910a6640 1 -- 172.21.15.37:0/3383297929 learned_addr learned my addr 172.21.15.37:0/3383297929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce918a7640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c15f380 0x7fce8c0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce908a5640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8c0d3cd0 0x7fce8c161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce910a6640 1 -- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8c0d3cd0 msgr2=0x7fce8c161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce910a6640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8c0d3cd0 0x7fce8c161ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce910a6640 1 -- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c15f380 msgr2=0x7fce8c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce910a6640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c15f380 0x7fce8c0ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce910a6640 1 -- 172.21.15.37:0/3383297929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c0cbbb0 con 0x7fce8c0b3f30 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce918a7640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c15f380 0x7fce8c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce908a5640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8c0d3cd0 0x7fce8c161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce910a6640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce8c0b3f30 0x7fce8c161980 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c410 tx=0x7fce8800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce81ffb640 1 -- 172.21.15.37:0/3383297929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88017070 con 0x7fce8c0b3f30 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce81ffb640 1 -- 172.21.15.37:0/3383297929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce880052f0 con 0x7fce8c0b3f30 2024-05-10T08:47:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8c0cb310 con 0x7fce8c0b3f30 2024-05-10T08:47:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce81ffb640 1 -- 172.21.15.37:0/3383297929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88003830 con 0x7fce8c0b3f30 2024-05-10T08:47:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.973+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8c0cb8d0 con 0x7fce8c0b3f30 2024-05-10T08:47:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.974+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8c0b5130 con 0x7fce8c0b3f30 2024-05-10T08:47:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.975+0000 7fce81ffb640 1 -- 172.21.15.37:0/3383297929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce8801a070 con 0x7fce8c0b3f30 2024-05-10T08:47:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.975+0000 7fce81ffb640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce700762d0 0x7fce70078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.976+0000 7fce81ffb640 1 -- 172.21.15.37:0/3383297929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fce88096b60 con 0x7fce8c0b3f30 2024-05-10T08:47:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.976+0000 7fce908a5640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce700762d0 0x7fce70078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.976+0000 7fce908a5640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce700762d0 0x7fce70078790 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fce7c034000 tx=0x7fce7c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:55.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:55.980+0000 7fce81ffb640 1 -- 172.21.15.37:0/3383297929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fce8c0b5130 con 0x7fce8c0b3f30 2024-05-10T08:47:56.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.250+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fce8c0693f0 con 0x7fce8c0b3f30 2024-05-10T08:47:56.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.252+0000 7fce81ffb640 1 -- 172.21.15.37:0/3383297929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7fce880603f0 con 0x7fce8c0b3f30 2024-05-10T08:47:56.251 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:47:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:47:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-10T08:47:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-10T08:47:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T08:47:56.251 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-10T08:47:56.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce700762d0 msgr2=0x7fce70078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce700762d0 0x7fce70078790 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fce7c034000 tx=0x7fce7c02e000 comp rx=0 tx=0).stop 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce8c0b3f30 msgr2=0x7fce8c161980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce8c0b3f30 0x7fce8c161980 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c410 tx=0x7fce8800c8d0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 shutdown_connections 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce700762d0 0x7fce70078790 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce8c15f380 0x7fce8c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8c0d3cd0 0x7fce8c161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 --2- 172.21.15.37:0/3383297929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce8c0b3f30 0x7fce8c161980 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 >> 172.21.15.37:0/3383297929 conn(0x7fce8c0d4fe0 msgr2=0x7fce8c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 shutdown_connections 2024-05-10T08:47:56.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.254+0000 7fce9330a640 1 -- 172.21.15.37:0/3383297929 wait complete. 2024-05-10T08:47:56.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.369+0000 7f58e5283640 1 Processor -- start 2024-05-10T08:47:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.369+0000 7f58e5283640 1 -- start start 2024-05-10T08:47:56.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58e5283640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 0x7f58e006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58e5283640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e0163d70 con 0x7f58e0070d30 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58e5283640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e00d1300 con 0x7f58e00d20c0 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58e5283640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f58e00d10d0 con 0x7f58e0163920 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58deffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58e0070d30 0x7f58e00703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48724/0 (socket says 172.21.15.37:48724) 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58deffd640 1 -- 172.21.15.37:0/2601247936 learned_addr learned my addr 172.21.15.37:0/2601247936 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58df7fe640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 0x7f58e006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370307574 0 0) 0x7f58d0001110 con 0x7f58e0070d30 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58cc003520 con 0x7f58e0070d30 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.370+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 535929748 0 0) 0x7f58cc003520 con 0x7f58e0070d30 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 msgr2=0x7f58e006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 0x7f58e006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 >> v1:172.21.15.82:6789/0 conn(0x7f58e00d20c0 legacy=0x7f58e0071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e00d15e0 con 0x7f58e0070d30 2024-05-10T08:47:56.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f58d0001840 con 0x7f58e0070d30 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 >> v1:172.21.15.37:6789/0 conn(0x7f58e0070d30 legacy=0x7f58e00703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58cc0039e0 0x7f58cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58cc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 0x7f58cc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc00b9c0 con 0x7f58cc004390 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc00bb40 con 0x7f58cc0039e0 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f58cc00bd40 con 0x7f58e0163920 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58d7fff640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58cc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58deffd640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58cc0039e0 0x7f58cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58df7fe640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 0x7f58cc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58d7fff640 1 -- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 msgr2=0x7f58cc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58d7fff640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 0x7f58cc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58d7fff640 1 -- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58cc0039e0 msgr2=0x7f58cc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:56.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58d7fff640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58cc0039e0 0x7f58cc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58d7fff640 1 -- 172.21.15.37:0/2601247936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc003520 con 0x7f58cc004390 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.371+0000 7f58df7fe640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e0163920 0x7f58cc0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.372+0000 7f58d7fff640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58cc004860 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001860 tx=0x7f58cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ba227adf754994 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.372+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8037070 con 0x7f58cc004390 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.372+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c802abf0 con 0x7f58cc004390 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.372+0000 7f58de7fc640 1 -- 172.21.15.37:0/2601247936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8001430 con 0x7f58cc004390 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.373+0000 7f58e5283640 1 -- 172.21.15.37:0/2601247936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 msgr2=0x7f58cc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.373+0000 7f58e5283640 1 --2- 172.21.15.37:0/2601247936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58cc004860 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001860 tx=0x7f58cc005830 comp rx=0 tx=0).stop 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.373+0000 7f58df7fe640 1 -- 172.21.15.37:0/2601247936 reap_dead start 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.373+0000 7f58e5283640 1 -- 172.21.15.37:0/2601247936 shutdown_connections 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.373+0000 7f58e5283640 1 -- 172.21.15.37:0/2601247936 >> 172.21.15.37:0/2601247936 conn(0x7f58e00d2e90 msgr2=0x7f58e00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.373+0000 7f58e5283640 1 -- 172.21.15.37:0/2601247936 shutdown_connections 2024-05-10T08:47:56.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.373+0000 7f58e5283640 1 -- 172.21.15.37:0/2601247936 wait complete. 2024-05-10T08:47:56.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.374+0000 7f58e5283640 1 Processor -- start 2024-05-10T08:47:56.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.374+0000 7f58e5283640 1 -- start start 2024-05-10T08:47:56.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58e5283640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58e00b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58e5283640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e015ea40 0x7f58e015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58e5283640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e00b50c0 0x7f58e015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58e5283640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58e00d1c30 con 0x7f58cc004390 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58e5283640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0070b80 con 0x7f58e00b50c0 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58e5283640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f58e006d4b0 con 0x7f58e015ea40 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58e00b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58e00b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59068/0 (socket says 172.21.15.37:59068) 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 -- 172.21.15.37:0/455203541 learned_addr learned my addr 172.21.15.37:0/455203541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58df7fe640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e00b50c0 0x7f58e015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58d7fff640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e015ea40 0x7f58e015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 -- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e015ea40 msgr2=0x7f58e015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e015ea40 0x7f58e015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 -- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e00b50c0 msgr2=0x7f58e015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e00b50c0 0x7f58e015bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 -- 172.21.15.37:0/455203541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e015eec0 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58deffd640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58e00b3920 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f58d0007290 tx=0x7f58d0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58d77fe640 1 -- 172.21.15.37:0/455203541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d001a070 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58d77fe640 1 -- 172.21.15.37:0/455203541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d000f8e0 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e00b4020 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.375+0000 7f58d77fe640 1 -- 172.21.15.37:0/455203541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d000fcb0 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.376+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e00b45e0 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.376+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e0076020 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.377+0000 7f58d77fe640 1 -- 172.21.15.37:0/455203541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58d001d070 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.377+0000 7f58d77fe640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58c00762d0 0x7f58c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.378+0000 7f58d77fe640 1 -- 172.21.15.37:0/455203541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f58d0097130 con 0x7f58cc004390 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.378+0000 7f58d7fff640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58c00762d0 0x7f58c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:56.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.378+0000 7f58d7fff640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58c00762d0 0x7f58c0078790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001860 tx=0x7f58c8009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:56.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.382+0000 7f58d77fe640 1 -- 172.21.15.37:0/455203541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f58e0076020 con 0x7f58cc004390 2024-05-10T08:47:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.612+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58e00693f0 con 0x7f58cc004390 2024-05-10T08:47:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.613+0000 7f58d77fe640 1 -- 172.21.15.37:0/455203541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5180 (secure 0 0 0) 0x7f58e0163d70 con 0x7f58cc004390 2024-05-10T08:47:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:56.612 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7446,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:47:49.323413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/902568070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":902568070},{"type":"v1","addr":"172.21.15.82:6837","nonce":902568070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7455,"qdb_cluster":[7455]},"id":7}]} 2024-05-10T08:47:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 81 2024-05-10T08:47:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58c00762d0 msgr2=0x7f58c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58c00762d0 0x7f58c0078790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001860 tx=0x7f58c8009030 comp rx=0 tx=0).stop 2024-05-10T08:47:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 msgr2=0x7f58e00b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58e00b3920 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f58d0007290 tx=0x7f58d0007750 comp rx=0 tx=0).stop 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 shutdown_connections 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58c00762d0 0x7f58c0078790 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e00b50c0 0x7f58e015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58e015ea40 0x7f58e015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 --2- 172.21.15.37:0/455203541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58cc004390 0x7f58e00b3920 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 >> 172.21.15.37:0/455203541 conn(0x7f58e00d2e90 msgr2=0x7f58e0161b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 shutdown_connections 2024-05-10T08:47:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:56.615+0000 7f58e5283640 1 -- 172.21.15.37:0/455203541 wait complete. 2024-05-10T08:47:57.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:47:46.304772+0000', 'modified': '2024-05-10T08:47:49.323413+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7455}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7455': {'gid': 7455, 'name': 'b', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/902568070', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 902568070}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 902568070}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7455, 'qdb_cluster': [7455]} 2024-05-10T08:47:57.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:47:57.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T08:47:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.140+0000 7fe2f6f32640 1 Processor -- start 2024-05-10T08:47:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.140+0000 7fe2f6f32640 1 -- start start 2024-05-10T08:47:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2f6f32640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe2f00d3cd0 0x7fe2f00cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2f6f32640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f00d3330 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2f6f32640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f00d2170 con 0x7fe2f01629a0 2024-05-10T08:47:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2f6f32640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f00d2450 con 0x7fe2f00d3cd0 2024-05-10T08:47:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2f54cf640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe2f00c9ee0 0x7fe2f00d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48734/0 (socket says 172.21.15.37:48734) 2024-05-10T08:47:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2f54cf640 1 -- 172.21.15.37:0/3463947111 learned_addr learned my addr 172.21.15.37:0/3463947111 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3463947111 >> v2:172.21.15.82:3300/0 conn(0x7fe2f00d3cd0 0x7fe2f00cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2e77fe640 1 -- 172.21.15.37:0/3463947111 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433081501 0 0) 0x7fe2f00d3330 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.141+0000 7fe2e77fe640 1 -- 172.21.15.37:0/3463947111 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d8003520 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.142+0000 7fe2e7fff640 1 -- 172.21.15.37:0/3463947111 >> v1:172.21.15.82:6789/0 conn(0x7fe2f01629a0 legacy=0x7fe2f00d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.142+0000 7fe2e77fe640 1 -- 172.21.15.37:0/3463947111 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 308537770 0 0) 0x7fe2d8003520 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.142+0000 7fe2e7fff640 1 -- 172.21.15.37:0/3463947111 >> v1:172.21.15.37:6789/0 conn(0x7fe2f00c9ee0 legacy=0x7fe2f00d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.142+0000 7fe2e7fff640 1 -- 172.21.15.37:0/3463947111 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f00d2730 con 0x7fe2f00d3cd0 2024-05-10T08:47:57.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.142+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3463947111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f00d3cd0 0x7fe2f00cfca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00097a0 tx=0x7fe2e002a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea2deedb32bafa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2e77fe640 1 -- 172.21.15.37:0/3463947111 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0037070 con 0x7fe2f00d3cd0 2024-05-10T08:47:57.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2e77fe640 1 -- 172.21.15.37:0/3463947111 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e002ab30 con 0x7fe2f00d3cd0 2024-05-10T08:47:57.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2e77fe640 1 -- 172.21.15.37:0/3463947111 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8001670 con 0x7fe2f00d3cd0 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3463947111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f00d3cd0 msgr2=0x7fe2f00cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3463947111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f00d3cd0 0x7fe2f00cfca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00097a0 tx=0x7fe2e002a0a0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3463947111 shutdown_connections 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3463947111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f00d3cd0 0x7fe2f00cfca0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3463947111 >> 172.21.15.37:0/3463947111 conn(0x7fe2f00d4fe0 msgr2=0x7fe2f00d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3463947111 shutdown_connections 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.143+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3463947111 wait complete. 2024-05-10T08:47:57.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.144+0000 7fe2f6f32640 1 Processor -- start 2024-05-10T08:47:57.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.144+0000 7fe2f6f32640 1 -- start start 2024-05-10T08:47:57.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f6f32640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00c9ee0 0x7fe2f00cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f6f32640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2f00d3cd0 0x7fe2f01f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f6f32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f01629a0 0x7fe2f01f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f6f32640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f00cf440 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f6f32640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f00cf2c0 con 0x7fe2f01629a0 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f6f32640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f00d2dc0 con 0x7fe2f00d3cd0 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00c9ee0 0x7fe2f00cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00c9ee0 0x7fe2f00cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59082/0 (socket says 172.21.15.37:59082) 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.145+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3975611227 learned_addr learned my addr 172.21.15.37:0/3975611227 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f01629a0 0x7fe2f01f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2f00d3cd0 0x7fe2f01f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2f00d3cd0 msgr2=0x7fe2f01f80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2f00d3cd0 0x7fe2f01f80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f01629a0 msgr2=0x7fe2f01f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f01629a0 0x7fe2f01f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3975611227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f01f8860 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00c9ee0 0x7fe2f00cd5d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c730 tx=0x7fe2ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2e57fa640 1 -- 172.21.15.37:0/3975611227 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec003b70 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2e57fa640 1 -- 172.21.15.37:0/3975611227 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec003d30 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2e57fa640 1 -- 172.21.15.37:0/3975611227 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00aa90 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f01f8b40 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.146+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f00b7d80 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.148+0000 7fe2e57fa640 1 -- 172.21.15.37:0/3975611227 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2ec00ac30 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.149+0000 7fe2e57fa640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2dc0762d0 0x7fe2dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.149+0000 7fe2e57fa640 1 -- 172.21.15.37:0/3975611227 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fe2ec097620 con 0x7fe2f00c9ee0 2024-05-10T08:47:57.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.149+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2dc0762d0 0x7fe2dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.149+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2dc0762d0 0x7fe2dc078790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0034000 tx=0x7fe2e002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.149+0000 7fe2f9c4f740 1 Processor -- start 2024-05-10T08:47:57.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f9c4f740 1 -- start start 2024-05-10T08:47:57.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca40760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca40ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca10bb0 0x556deca143c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556dec97a8d0 con 0x556deca3df50 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556dec933c10 con 0x556deca3e330 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556dec976890 con 0x556deca10bb0 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca40760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca40760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59094/0 (socket says 172.21.15.37:59094) 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.150+0000 7fe2f4cce640 1 -- 172.21.15.37:0/1795672627 learned_addr learned my addr 172.21.15.37:0/1795672627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca10bb0 0x556deca143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca40ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2f4cce640 1 -- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca10bb0 msgr2=0x556deca143c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca10bb0 0x556deca143c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2f4cce640 1 -- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 msgr2=0x556deca40ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca40ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2f4cce640 1 -- 172.21.15.37:0/1795672627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dec93b5d0 con 0x556deca3df50 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca40760 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05ce40 tx=0x7fe2ec05fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10c49ced755ba2b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2d6ffd640 1 -- 172.21.15.37:0/1795672627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec060680 con 0x556deca3df50 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2d6ffd640 1 -- 172.21.15.37:0/1795672627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec064980 con 0x556deca3df50 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.151+0000 7fe2d6ffd640 1 -- 172.21.15.37:0/1795672627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec05fae0 con 0x556deca3df50 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/1795672627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 msgr2=0x556deca40760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca40760 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05ce40 tx=0x7fe2ec05fdf0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/1795672627 shutdown_connections 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca10bb0 0x556deca143c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca40ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/1795672627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca40760 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/1795672627 >> 172.21.15.37:0/1795672627 conn(0x556deca12e20 msgr2=0x556deca5b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/1795672627 shutdown_connections 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/1795672627 wait complete. 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 -- start start 2024-05-10T08:47:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.152+0000 7fe2f9c4f740 1 Processor -- start 2024-05-10T08:47:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca3c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca5e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556deca5e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556deca15fd0 con 0x556deca3df50 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556dec937760 con 0x556deca3e330 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556deca162b0 con 0x556deca2b140 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f9c4f740 10 client.0 _ll_register_callbacks cb 0x556dec970cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca3c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca3c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59106/0 (socket says 172.21.15.37:59106) 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3466727425 learned_addr learned my addr 172.21.15.37:0/3466727425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca5e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556deca5e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 msgr2=0x556deca5e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556deca5e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 msgr2=0x556deca5e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca5e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.153+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3466727425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dec68c2d0 con 0x556deca3df50 2024-05-10T08:47:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca5e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556deca5e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca3c5b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05d8f0 tx=0x7fe2ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d434a77a48ef8312 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3466727425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec079040 con 0x556deca3df50 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3466727425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fe2ec080270 con 0x556deca3df50 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ec064980 con 0x556deca3df50 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3466727425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fe2ec095050 con 0x556deca3df50 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 10 client.7614 fetch_fsmap learned FSMap version 81 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x556dec7566b0 con 0x556deca3df50 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3466727425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec064980 con 0x556deca3df50 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3466727425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fe2ec0970d0 con 0x556deca3df50 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 10 client.7614 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 10 client.7614 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 20 client.7614 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca57e90 0x556deca58270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 4 client.7614 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.154+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dec8fe760 con 0x556deca57e90 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.155+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca57e90 0x556deca58270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.155+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca57e90 0x556deca58270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df8aa8c21273c583 server_cookie=1143fbd9c787ae61 in_seq=0 out_seq=0 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.155+0000 7fe2cf7fe640 10 client.7614 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3466727425 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556dec8fe760 con 0x556deca57e90 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2cf7fe640 10 client.7614 handle_command_reply: tid=0 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 client.7614 shutdown 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 msgr2=0x556deca3c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca3c5b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05d8f0 tx=0x7fe2ec001250 comp rx=0 tx=0).stop 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 shutdown_connections 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556deca5e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca5e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca57e90 0x556deca58270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3466727425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3df50 0x556deca3c5b0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2cf7fe640 0 client.7614 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:47:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 >> 172.21.15.37:0/3466727425 conn(0x556deca10bb0 msgr2=0x556deca11840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 shutdown_connections 2024-05-10T08:47:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3466727425 wait complete. 2024-05-10T08:47:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.156+0000 7fe2f9c4f740 20 client.7614 trim_cache size 0 max 16384 2024-05-10T08:47:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 Processor -- start 2024-05-10T08:47:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 -- start start 2024-05-10T08:47:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca2b140 0x556deca16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca3df50 0x556deca2a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca58460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0200d40 con 0x556deca2b140 2024-05-10T08:47:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f00b9390 con 0x556deca3e330 2024-05-10T08:47:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.175+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f02006f0 con 0x556deca3df50 2024-05-10T08:47:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca2b140 0x556deca16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca2b140 0x556deca16cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59116/0 (socket says 172.21.15.37:59116) 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3178171336 learned_addr learned my addr 172.21.15.37:0/3178171336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca3df50 0x556deca2a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca58460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca3df50 msgr2=0x556deca2a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca3df50 0x556deca2a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 msgr2=0x556deca58460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca58460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 -- 172.21.15.37:0/3178171336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556deca3dd60 con 0x556deca2b140 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca2b140 0x556deca16cc0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05fff0 tx=0x7fe2ec020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d39506be6b934e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2d67fc640 1 -- 172.21.15.37:0/3178171336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec079040 con 0x556deca2b140 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2d67fc640 1 -- 172.21.15.37:0/3178171336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec07f070 con 0x556deca2b140 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.176+0000 7fe2d67fc640 1 -- 172.21.15.37:0/3178171336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0606d0 con 0x556deca2b140 2024-05-10T08:47:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3178171336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca2b140 msgr2=0x556deca16cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca2b140 0x556deca16cc0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05fff0 tx=0x7fe2ec020000 comp rx=0 tx=0).stop 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3178171336 shutdown_connections 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3e330 0x556deca58460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca3df50 0x556deca2a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3178171336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca2b140 0x556deca16cc0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3178171336 >> 172.21.15.37:0/3178171336 conn(0x556deca10bb0 msgr2=0x556deca10f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3178171336 shutdown_connections 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3178171336 wait complete. 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 -- start start 2024-05-10T08:47:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.177+0000 7fe2f9c4f740 1 Processor -- start 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556decacd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3df50 0x556deca5a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f9c4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3e330 0x556deca3ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556deca15fd0 con 0x556deca3e330 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556dec937760 con 0x556deca3df50 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f9c4f740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556deca6f310 con 0x556deca2b140 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f9c4f740 10 client.0 _ll_register_callbacks cb 0x7fe2ec060500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3e330 0x556deca3ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3e330 0x556deca3ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59120/0 (socket says 172.21.15.37:59120) 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 -- 172.21.15.37:0/3856166107 learned_addr learned my addr 172.21.15.37:0/3856166107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556decacd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2e7fff640 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3df50 0x556deca5a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 -- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 msgr2=0x556decacd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556decacd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 -- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3df50 msgr2=0x556deca5a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3df50 0x556deca5a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.178+0000 7fe2f54cf640 1 -- 172.21.15.37:0/3856166107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556deca5a740 con 0x556deca3e330 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f54cf640 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3e330 0x556deca3ac40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8006c60 tx=0x7fe2e80146b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6bda6591f2750a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3856166107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e801b070 con 0x556deca3e330 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3856166107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fe2e8017660 con 0x556deca3e330 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ec07f070 con 0x556deca3e330 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3856166107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fe2e8026050 con 0x556deca3e330 2024-05-10T08:47:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 10 client.7620 fetch_fsmap learned FSMap version 81 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x556deca52130 con 0x556deca3e330 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3856166107 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec07f070 con 0x556deca3e330 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3856166107 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fe2e8029020 con 0x556deca3e330 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 10 client.7620 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 10 client.7620 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 20 client.7620 populate_metadata read hostname 'smithi037' 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca55100 0x556deca2d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 4 client.7620 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "status"}) -- 0x556dec9884e0 con 0x556deca55100 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.179+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca55100 0x556deca2d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f4cce640 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca55100 0x556deca2d570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb89cb63b917e00 server_cookie=96148d9866685d12 in_seq=0 out_seq=0 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2cf7fe640 10 client.7620 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2cf7fe640 1 -- 172.21.15.37:0/3856166107 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x556dec9884e0 con 0x556deca55100 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2cf7fe640 10 client.7620 handle_command_reply: tid=0 2024-05-10T08:47:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 client.7620 shutdown 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3e330 msgr2=0x556deca3ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3e330 0x556deca3ac40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8006c60 tx=0x7fe2e80146b0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 shutdown_connections 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556deca55100 0x556deca2d570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556deca3e330 0x556deca3ac40 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556deca3df50 0x556deca5a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2cf7fe640 0 client.7620 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 --2- 172.21.15.37:0/3856166107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556deca2b140 0x556decacd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 >> 172.21.15.37:0/3856166107 conn(0x556deca10bb0 msgr2=0x556deca63880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 shutdown_connections 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 1 -- 172.21.15.37:0/3856166107 wait complete. 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.180+0000 7fe2f9c4f740 20 client.7620 trim_cache size 0 max 16384 2024-05-10T08:47:57.185 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7455, 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.25170958, 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 81, 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 103, 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 103, 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.570566243 2024-05-10T08:47:57.186 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:47:57.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2dc0762d0 msgr2=0x7fe2dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2dc0762d0 0x7fe2dc078790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0034000 tx=0x7fe2e002e000 comp rx=0 tx=0).stop 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00c9ee0 msgr2=0x7fe2f00cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00c9ee0 0x7fe2f00cd5d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c730 tx=0x7fe2ec00cbf0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 shutdown_connections 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe2dc0762d0 0x7fe2dc078790 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2f01629a0 0x7fe2f01f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe2f00d3cd0 0x7fe2f01f80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 --2- 172.21.15.37:0/3975611227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00c9ee0 0x7fe2f00cd5d0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 >> 172.21.15.37:0/3975611227 conn(0x7fe2f00d4fe0 msgr2=0x7fe2f00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 shutdown_connections 2024-05-10T08:47:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.181+0000 7fe2f6f32640 1 -- 172.21.15.37:0/3975611227 wait complete. 2024-05-10T08:47:57.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:47:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.295+0000 7fba3ad19640 1 Processor -- start 2024-05-10T08:47:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.296+0000 7fba3ad19640 1 -- start start 2024-05-10T08:47:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.296+0000 7fba3ad19640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba3415f420 0x7fba340d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.296+0000 7fba3ad19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340d2080 0x7fba340d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.296+0000 7fba3ad19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba341630b0 con 0x7fba340d3ca0 2024-05-10T08:47:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.296+0000 7fba3ad19640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fba340d2550 con 0x7fba3415f420 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.296+0000 7fba3ad19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fba340d2c80 con 0x7fba340d2080 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba33fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fba340d3ca0 0x7fba340d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48736/0 (socket says 172.21.15.37:48736) 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba33fff640 1 -- 172.21.15.37:0/3684499348 learned_addr learned my addr 172.21.15.37:0/3684499348 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba38ab5640 1 --2- 172.21.15.37:0/3684499348 >> v2:172.21.15.82:3300/0 conn(0x7fba3415f420 0x7fba340d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba392b6640 1 --2- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340d2080 0x7fba340d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba337fe640 1 -- 172.21.15.37:0/3684499348 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379603248 0 0) 0x7fba1c001490 con 0x7fba340d3ca0 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba337fe640 1 -- 172.21.15.37:0/3684499348 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba20003520 con 0x7fba340d3ca0 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba38ab5640 1 -- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340d2080 msgr2=0x7fba340d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba38ab5640 1 --2- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340d2080 0x7fba340d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba38ab5640 1 -- 172.21.15.37:0/3684499348 >> v1:172.21.15.37:6789/0 conn(0x7fba340d3ca0 legacy=0x7fba340d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.297+0000 7fba38ab5640 1 -- 172.21.15.37:0/3684499348 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba340d2f60 con 0x7fba3415f420 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.298+0000 7fba38ab5640 1 --2- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3415f420 0x7fba340d3760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fba240097a0 tx=0x7fba2402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b496af13cf289e36 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.298+0000 7fba337fe640 1 -- 172.21.15.37:0/3684499348 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba24037070 con 0x7fba3415f420 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.298+0000 7fba337fe640 1 -- 172.21.15.37:0/3684499348 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba24032440 con 0x7fba3415f420 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.298+0000 7fba337fe640 1 -- 172.21.15.37:0/3684499348 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba240327f0 con 0x7fba3415f420 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 -- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3415f420 msgr2=0x7fba340d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 --2- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3415f420 0x7fba340d3760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fba240097a0 tx=0x7fba2402a180 comp rx=0 tx=0).stop 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 -- 172.21.15.37:0/3684499348 shutdown_connections 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 --2- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340d2080 0x7fba340d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 --2- 172.21.15.37:0/3684499348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3415f420 0x7fba340d3760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 -- 172.21.15.37:0/3684499348 >> 172.21.15.37:0/3684499348 conn(0x7fba3408eac0 msgr2=0x7fba3409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 -- 172.21.15.37:0/3684499348 shutdown_connections 2024-05-10T08:47:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.299+0000 7fba3ad19640 1 -- 172.21.15.37:0/3684499348 wait complete. 2024-05-10T08:47:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.300+0000 7fba3ad19640 1 Processor -- start 2024-05-10T08:47:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.300+0000 7fba3ad19640 1 -- start start 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba3ad19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba340d2080 0x7fba341585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba3ad19640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340ce9b0 0x7fba34160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba3ad19640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba340cc0e0 0x7fba340cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba3ad19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba340d5200 con 0x7fba340d2080 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba3ad19640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba340d2830 con 0x7fba340cc0e0 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba3ad19640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fba340d5380 con 0x7fba340ce9b0 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba340d2080 0x7fba341585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba340d2080 0x7fba341585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59130/0 (socket says 172.21.15.37:59130) 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 -- 172.21.15.37:0/2994570061 learned_addr learned my addr 172.21.15.37:0/2994570061 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba33fff640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340ce9b0 0x7fba34160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba392b6640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba340cc0e0 0x7fba340cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 -- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340ce9b0 msgr2=0x7fba34160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340ce9b0 0x7fba34160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 -- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba340cc0e0 msgr2=0x7fba340cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba340cc0e0 0x7fba340cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 -- 172.21.15.37:0/2994570061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba34161330 con 0x7fba340d2080 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba33fff640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340ce9b0 0x7fba34160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba392b6640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba340cc0e0 0x7fba340cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba38ab5640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba340d2080 0x7fba341585e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fba2402a1c0 tx=0x7fba240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.301+0000 7fba317fa640 1 -- 172.21.15.37:0/2994570061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba24037040 con 0x7fba340d2080 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.302+0000 7fba317fa640 1 -- 172.21.15.37:0/2994570061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba24042070 con 0x7fba340d2080 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.302+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba34161610 con 0x7fba340d2080 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.302+0000 7fba317fa640 1 -- 172.21.15.37:0/2994570061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2403b930 con 0x7fba340d2080 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.302+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba34161bd0 con 0x7fba340d2080 2024-05-10T08:47:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.303+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba340693f0 con 0x7fba340d2080 2024-05-10T08:47:57.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.303+0000 7fba317fa640 1 -- 172.21.15.37:0/2994570061 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fba2403bad0 con 0x7fba340d2080 2024-05-10T08:47:57.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.304+0000 7fba317fa640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba140762d0 0x7fba14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:57.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.304+0000 7fba317fa640 1 -- 172.21.15.37:0/2994570061 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fba240b7fe0 con 0x7fba340d2080 2024-05-10T08:47:57.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.304+0000 7fba33fff640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba140762d0 0x7fba14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:57.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.305+0000 7fba33fff640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba140762d0 0x7fba14078790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fba1c001630 tx=0x7fba1c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:57.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.308+0000 7fba317fa640 1 -- 172.21.15.37:0/2994570061 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fba240811f0 con 0x7fba340d2080 2024-05-10T08:47:57.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.539+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fba340d4780 con 0x7fba340d2080 2024-05-10T08:47:57.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.539+0000 7fba317fa640 1 -- 172.21.15.37:0/2994570061 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7fba240854f0 con 0x7fba340d2080 2024-05-10T08:47:57.538 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.541+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba140762d0 msgr2=0x7fba14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.541+0000 7fba3ad19640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba140762d0 0x7fba14078790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fba1c001630 tx=0x7fba1c009040 comp rx=0 tx=0).stop 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.541+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba340d2080 msgr2=0x7fba341585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba340d2080 0x7fba341585e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fba2402a1c0 tx=0x7fba240046c0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 shutdown_connections 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fba140762d0 0x7fba14078790 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba340cc0e0 0x7fba340cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba340ce9b0 0x7fba34160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 --2- 172.21.15.37:0/2994570061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba340d2080 0x7fba341585e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 >> 172.21.15.37:0/2994570061 conn(0x7fba3408eac0 msgr2=0x7fba340cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 shutdown_connections 2024-05-10T08:47:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57.542+0000 7fba3ad19640 1 -- 172.21.15.37:0/2994570061 wait complete. 2024-05-10T08:47:57.551 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:47:57.551 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:47:57.551 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:47:57.551 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:47:57.552 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:47:57.552 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:47:57.552 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:47:57.552 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:47:57.552 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:47:57.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:57.552 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:47:57.568 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:47:57.569 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42284sec preferred_lft 42284sec 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:47:57.570 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:47:57.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:57.571 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:47:57.633 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:47:57.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:57.635 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:47:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:47:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:47:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:47:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:47:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:47:57.692 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:47:57.692 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:47:57.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:47:57.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:47:57.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:47:57.693 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:47:57.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:47:57.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:47:57.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:57.822 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:47:57.838 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:47:57.838 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:47:57.839 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:47:57.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:57.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:47:57.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:47:57.905 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:47:57.961 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:47:57.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:47:57.961 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:47:58.017 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:47:58.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:58.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:47:58.133 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:47:58.133 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:47:58.133 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:47:58.142 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:47:58.142 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:47:58.142 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:47:58.143 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:47:58.143 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:47:58.154 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:47:58.154 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:47:58.154 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:47:58.155 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:47:58.157 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:47:58.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:58.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:47:58.183 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:47:58.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:47:58.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:47:58.288 INFO:teuthology.orchestra.run.smithi037.stdout:client6880 2024-05-10T08:47:58.288 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:58.289 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:58.305 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:58.305 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:58.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:58.362 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-05-10T08:47:58.463 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records in 2024-05-10T08:47:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records out 2024-05-10T08:47:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0402005 s, 157 MB/s 2024-05-10T08:47:58.464 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:58.465 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:58.481 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:47:58.481 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:47:58.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:47:58.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.684+0000 7fe5da951640 1 Processor -- start 2024-05-10T08:47:58.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.684+0000 7fe5da951640 1 -- start start 2024-05-10T08:47:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5da951640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5d4157540 0x7fe5d415e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5da951640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 0x7fe5d40ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5da951640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d415e550 con 0x7fe5d406fc30 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5da951640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d40701d0 con 0x7fe5d4157540 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5da951640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d40b3dc0 con 0x7fe5d40b48a0 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe5d406fc30 0x7fe5d40af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48266/0 (socket says 172.21.15.37:48266) 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d37fe640 1 -- 172.21.15.37:0/1498555372 learned_addr learned my addr 172.21.15.37:0/1498555372 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d8eee640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 0x7fe5d40ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d3fff640 1 --2- 172.21.15.37:0/1498555372 >> v2:172.21.15.82:3300/0 conn(0x7fe5d4157540 0x7fe5d415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613631168 0 0) 0x7fe5c8001110 con 0x7fe5d406fc30 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5bc003520 con 0x7fe5d406fc30 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1900034265 0 0) 0x7fe5bc003520 con 0x7fe5d406fc30 2024-05-10T08:47:58.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 msgr2=0x7fe5d40ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 0x7fe5d40ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 >> v2:172.21.15.82:3300/0 conn(0x7fe5d4157540 msgr2=0x7fe5d415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 --2- 172.21.15.37:0/1498555372 >> v2:172.21.15.82:3300/0 conn(0x7fe5d4157540 0x7fe5d415e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d40b40a0 con 0x7fe5d406fc30 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.685+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fe5c8001840 con 0x7fe5d406fc30 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 >> v1:172.21.15.37:6789/0 conn(0x7fe5d406fc30 legacy=0x7fe5d40af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d2ffd640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 0x7fe5bc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d2ffd640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc003f30 0x7fe5bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d2ffd640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5bc004d40 0x7fe5bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d40701d0 con 0x7fe5bc004d40 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d40b3dc0 con 0x7fe5bc003f30 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe5bc00b9c0 con 0x7fe5d40b48a0 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d8eee640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5bc004d40 0x7fe5bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d37fe640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc003f30 0x7fe5bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d3fff640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 0x7fe5bc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d8eee640 1 -- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 msgr2=0x7fe5bc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d8eee640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b48a0 0x7fe5bc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d8eee640 1 -- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc003f30 msgr2=0x7fe5bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d8eee640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc003f30 0x7fe5bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.686+0000 7fe5d8eee640 1 -- 172.21.15.37:0/1498555372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5bc003520 con 0x7fe5bc004d40 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5d8eee640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5bc004d40 0x7fe5bc0051c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009fc0 tx=0x7fe5bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dddac8af168092 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc009c10 con 0x7fe5bc004d40 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc036070 con 0x7fe5bc004d40 2024-05-10T08:47:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5d2ffd640 1 -- 172.21.15.37:0/1498555372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc031670 con 0x7fe5bc004d40 2024-05-10T08:47:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5da951640 1 -- 172.21.15.37:0/1498555372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5bc004d40 msgr2=0x7fe5bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5da951640 1 --2- 172.21.15.37:0/1498555372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5bc004d40 0x7fe5bc0051c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009fc0 tx=0x7fe5bc005830 comp rx=0 tx=0).stop 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5d8eee640 1 -- 172.21.15.37:0/1498555372 reap_dead start 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5da951640 1 -- 172.21.15.37:0/1498555372 shutdown_connections 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5da951640 1 -- 172.21.15.37:0/1498555372 >> 172.21.15.37:0/1498555372 conn(0x7fe5d406c3a0 msgr2=0x7fe5d406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5da951640 1 -- 172.21.15.37:0/1498555372 shutdown_connections 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.687+0000 7fe5da951640 1 -- 172.21.15.37:0/1498555372 wait complete. 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.689+0000 7fe5da951640 1 Processor -- start 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.689+0000 7fe5da951640 1 -- start start 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc004d40 0x7fe5d4141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5d414f4d0 0x7fe5d4144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b1a30 0x7fe5d40b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4157aa0 con 0x7fe5d414f4d0 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4157920 con 0x7fe5bc004d40 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d40afe50 con 0x7fe5d40b1a30 2024-05-10T08:47:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5d414f4d0 0x7fe5d4144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5d414f4d0 0x7fe5d4144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38028/0 (socket says 172.21.15.37:38028) 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 -- 172.21.15.37:0/691346262 learned_addr learned my addr 172.21.15.37:0/691346262 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d3fff640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc004d40 0x7fe5d4141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d8eee640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b1a30 0x7fe5d40b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 -- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b1a30 msgr2=0x7fe5d40b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b1a30 0x7fe5d40b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 -- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc004d40 msgr2=0x7fe5d4141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc004d40 0x7fe5d4141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 -- 172.21.15.37:0/691346262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d4151690 con 0x7fe5d414f4d0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d37fe640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5d414f4d0 0x7fe5d4144df0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007340 tx=0x7fe5c8007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d0ff9640 1 -- 172.21.15.37:0/691346262 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800f9c0 con 0x7fe5d414f4d0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d0ff9640 1 -- 172.21.15.37:0/691346262 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c8018070 con 0x7fe5d414f4d0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d4145330 con 0x7fe5d414f4d0 2024-05-10T08:47:58.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5d0ff9640 1 -- 172.21.15.37:0/691346262 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800fda0 con 0x7fe5d414f4d0 2024-05-10T08:47:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.690+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d409e680 con 0x7fe5d414f4d0 2024-05-10T08:47:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.691+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d40693f0 con 0x7fe5d414f4d0 2024-05-10T08:47:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.692+0000 7fe5d0ff9640 1 -- 172.21.15.37:0/691346262 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe5c801d460 con 0x7fe5d414f4d0 2024-05-10T08:47:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.692+0000 7fe5d0ff9640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5c0076300 0x7fe5c00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.693+0000 7fe5d0ff9640 1 -- 172.21.15.37:0/691346262 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fe5c8097710 con 0x7fe5d414f4d0 2024-05-10T08:47:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.693+0000 7fe5d3fff640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5c0076300 0x7fe5c00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.693+0000 7fe5d3fff640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5c0076300 0x7fe5c00787c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009c40 tx=0x7fe5c4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.697+0000 7fe5d0ff9640 1 -- 172.21.15.37:0/691346262 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe5d415e550 con 0x7fe5d414f4d0 2024-05-10T08:47:58.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.906+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5d4155ee0 con 0x7fe5d414f4d0 2024-05-10T08:47:58.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.906+0000 7fe5d0ff9640 1 -- 172.21.15.37:0/691346262 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7fe5c8060ee0 con 0x7fe5d414f4d0 2024-05-10T08:47:58.905 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:47:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5c0076300 msgr2=0x7fe5c00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5c0076300 0x7fe5c00787c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009c40 tx=0x7fe5c4009190 comp rx=0 tx=0).stop 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5d414f4d0 msgr2=0x7fe5d4144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5d414f4d0 0x7fe5d4144df0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007340 tx=0x7fe5c8007740 comp rx=0 tx=0).stop 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 shutdown_connections 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe5c0076300 0x7fe5c00787c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe5d40b1a30 0x7fe5d40b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5d414f4d0 0x7fe5d4144df0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 --2- 172.21.15.37:0/691346262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5bc004d40 0x7fe5d4141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 >> 172.21.15.37:0/691346262 conn(0x7fe5d406c3a0 msgr2=0x7fe5d406e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 shutdown_connections 2024-05-10T08:47:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:58.908+0000 7fe5da951640 1 -- 172.21.15.37:0/691346262 wait complete. 2024-05-10T08:47:58.918 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:47:58.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:58.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:47:58.950 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:47:58.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:47:58.950 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:47:59.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.150+0000 7effbddf0640 1 Processor -- start 2024-05-10T08:47:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.151+0000 7effbddf0640 1 -- start start 2024-05-10T08:47:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.151+0000 7effbddf0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7effb80b21f0 0x7effb806e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.151+0000 7effbddf0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.151+0000 7effbddf0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb80d0500 con 0x7effb80cf790 2024-05-10T08:47:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.151+0000 7effbddf0640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7effb81638f0 con 0x7effb80b21f0 2024-05-10T08:47:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.151+0000 7effbddf0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7effb806d810 con 0x7effb8162f50 2024-05-10T08:47:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7effb80cf790 0x7effb80cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48272/0 (socket says 172.21.15.37:48272) 2024-05-10T08:47:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb7fff640 1 -- 172.21.15.37:0/2925779182 learned_addr learned my addr 172.21.15.37:0/2925779182 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb6ffd640 1 --2- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb77fe640 1 --2- 172.21.15.37:0/2925779182 >> v2:172.21.15.82:3300/0 conn(0x7effb80b21f0 0x7effb806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb67fc640 1 -- 172.21.15.37:0/2925779182 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014320048 0 0) 0x7effb80d0500 con 0x7effb80cf790 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb67fc640 1 -- 172.21.15.37:0/2925779182 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa0003520 con 0x7effb80cf790 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb77fe640 1 -- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 msgr2=0x7effb81633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb77fe640 1 --2- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb77fe640 1 -- 172.21.15.37:0/2925779182 >> v1:172.21.15.37:6789/0 conn(0x7effb80cf790 legacy=0x7effb80cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb77fe640 1 -- 172.21.15.37:0/2925779182 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb806da60 con 0x7effb80b21f0 2024-05-10T08:47:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.152+0000 7effb6ffd640 1 --2- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:59.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.153+0000 7effb77fe640 1 --2- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 0x7effb806e540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7effa80097a0 tx=0x7effa802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=447bace5953ab7af server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.153+0000 7effb67fc640 1 -- 172.21.15.37:0/2925779182 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8037070 con 0x7effb80b21f0 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.153+0000 7effb67fc640 1 -- 172.21.15.37:0/2925779182 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa802adb0 con 0x7effb80b21f0 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.153+0000 7effb67fc640 1 -- 172.21.15.37:0/2925779182 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8032640 con 0x7effb80b21f0 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 -- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 msgr2=0x7effb806e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 --2- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 0x7effb806e540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7effa80097a0 tx=0x7effa802a060 comp rx=0 tx=0).stop 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 -- 172.21.15.37:0/2925779182 shutdown_connections 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 --2- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 --2- 172.21.15.37:0/2925779182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 0x7effb806e540 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 -- 172.21.15.37:0/2925779182 >> 172.21.15.37:0/2925779182 conn(0x7effb809ba40 msgr2=0x7effb809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 -- 172.21.15.37:0/2925779182 shutdown_connections 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.154+0000 7effbddf0640 1 -- 172.21.15.37:0/2925779182 wait complete. 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.155+0000 7effbddf0640 1 Processor -- start 2024-05-10T08:47:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.155+0000 7effbddf0640 1 -- start start 2024-05-10T08:47:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effbddf0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 0x7effb80b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effbddf0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80cf790 0x7effb80b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effbddf0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effbddf0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effb806ea80 con 0x7effb80cf790 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effbddf0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7effb806e0b0 con 0x7effb80b21f0 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effbddf0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7effb80b25d0 con 0x7effb8162f50 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80cf790 0x7effb80b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80cf790 0x7effb80b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38044/0 (socket says 172.21.15.37:38044) 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 -- 172.21.15.37:0/4194033059 learned_addr learned my addr 172.21.15.37:0/4194033059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb77fe640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 0x7effb80b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb7fff640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 -- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 msgr2=0x7effb81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 -- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 msgr2=0x7effb80b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 0x7effb80b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 -- 172.21.15.37:0/4194033059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb80c6960 con 0x7effb80cf790 2024-05-10T08:47:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb7fff640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:47:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7effb6ffd640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80cf790 0x7effb80b7da0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7effac00ebe0 tx=0x7effac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.156+0000 7eff9ffff640 1 -- 172.21.15.37:0/4194033059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac017070 con 0x7effb80cf790 2024-05-10T08:47:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.157+0000 7eff9ffff640 1 -- 172.21.15.37:0/4194033059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac00cc30 con 0x7effb80cf790 2024-05-10T08:47:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.157+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb80b8540 con 0x7effb80cf790 2024-05-10T08:47:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.157+0000 7eff9ffff640 1 -- 172.21.15.37:0/4194033059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac013470 con 0x7effb80cf790 2024-05-10T08:47:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.157+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb80c6c00 con 0x7effb80cf790 2024-05-10T08:47:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.157+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb8069b00 con 0x7effb80cf790 2024-05-10T08:47:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.158+0000 7eff9ffff640 1 -- 172.21.15.37:0/4194033059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7effac01a070 con 0x7effb80cf790 2024-05-10T08:47:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.159+0000 7eff9ffff640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa40762d0 0x7effa4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.159+0000 7eff9ffff640 1 -- 172.21.15.37:0/4194033059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7effac097a10 con 0x7effb80cf790 2024-05-10T08:47:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.159+0000 7effb77fe640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa40762d0 0x7effa4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.159+0000 7effb77fe640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa40762d0 0x7effa4078790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7effa8034000 tx=0x7effa802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.163+0000 7eff9ffff640 1 -- 172.21.15.37:0/4194033059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7effac060b90 con 0x7effb80cf790 2024-05-10T08:47:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.393+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effb81636d0 con 0x7effb80cf790 2024-05-10T08:47:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.393+0000 7eff9ffff640 1 -- 172.21.15.37:0/4194033059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5180 (secure 0 0 0) 0x7effac064e90 con 0x7effb80cf790 2024-05-10T08:47:59.392 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:59.393 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7446,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:47:49.323413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/902568070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":902568070},{"type":"v1","addr":"172.21.15.82:6837","nonce":902568070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7455,"qdb_cluster":[7455]},"id":7}]} 2024-05-10T08:47:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 81 2024-05-10T08:47:59.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa40762d0 msgr2=0x7effa4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa40762d0 0x7effa4078790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7effa8034000 tx=0x7effa802e000 comp rx=0 tx=0).stop 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80cf790 msgr2=0x7effb80b7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80cf790 0x7effb80b7da0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7effac00ebe0 tx=0x7effac00c520 comp rx=0 tx=0).stop 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 shutdown_connections 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7effa40762d0 0x7effa4078790 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb8162f50 0x7effb81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80cf790 0x7effb80b7da0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 --2- 172.21.15.37:0/4194033059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb80b21f0 0x7effb80b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 >> 172.21.15.37:0/4194033059 conn(0x7effb809ba40 msgr2=0x7effb80d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 shutdown_connections 2024-05-10T08:47:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.396+0000 7effbddf0640 1 -- 172.21.15.37:0/4194033059 wait complete. 2024-05-10T08:47:59.406 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-05-10T08:47:59.540 INFO:teuthology.orchestra.run.smithi082.stdout:{"message":"","return_code":0} 2024-05-10T08:47:59.540 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:47:59.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:47:59.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.645+0000 7fb1620fc640 1 Processor -- start 2024-05-10T08:47:59.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.645+0000 7fb1620fc640 1 -- start start 2024-05-10T08:47:59.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb1620fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb15c15d060 0x7fb15c072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb1620fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c1613e0 0x7fb15c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb1620fc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15c0d0390 con 0x7fb15c0703a0 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb1620fc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb15c0d1070 con 0x7fb15c15d060 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb1620fc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb15c0d0670 con 0x7fb15c1613e0 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb15b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb15c15d060 0x7fb15c072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb15b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb15c15d060 0x7fb15c072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38048/0 (socket says 172.21.15.37:38048) 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.646+0000 7fb15b7fe640 1 -- 172.21.15.37:0/638383901 learned_addr learned my addr 172.21.15.37:0/638383901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.647+0000 7fb15bfff640 1 --2- 172.21.15.37:0/638383901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c1613e0 0x7fb15c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.647+0000 7fb15b7fe640 1 -- 172.21.15.37:0/638383901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c1613e0 msgr2=0x7fb15c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.647+0000 7fb15b7fe640 1 --2- 172.21.15.37:0/638383901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c1613e0 0x7fb15c15d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.647+0000 7fb15b7fe640 1 -- 172.21.15.37:0/638383901 >> v1:172.21.15.82:6789/0 conn(0x7fb15c0703a0 legacy=0x7fb15c160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.647+0000 7fb15b7fe640 1 -- 172.21.15.37:0/638383901 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c0d0950 con 0x7fb15c15d060 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.647+0000 7fb15b7fe640 1 --2- 172.21.15.37:0/638383901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c072050 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009870 tx=0x7fb14c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f1e206009625e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb15a7fc640 1 -- 172.21.15.37:0/638383901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c037070 con 0x7fb15c15d060 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb15a7fc640 1 -- 172.21.15.37:0/638383901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c032440 con 0x7fb15c15d060 2024-05-10T08:47:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb15a7fc640 1 -- 172.21.15.37:0/638383901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c032810 con 0x7fb15c15d060 2024-05-10T08:47:59.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 -- 172.21.15.37:0/638383901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 msgr2=0x7fb15c072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 --2- 172.21.15.37:0/638383901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c072050 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009870 tx=0x7fb14c02a180 comp rx=0 tx=0).stop 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 -- 172.21.15.37:0/638383901 shutdown_connections 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 --2- 172.21.15.37:0/638383901 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c1613e0 0x7fb15c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 --2- 172.21.15.37:0/638383901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c072050 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 -- 172.21.15.37:0/638383901 >> 172.21.15.37:0/638383901 conn(0x7fb15c09ba40 msgr2=0x7fb15c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 -- 172.21.15.37:0/638383901 shutdown_connections 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.648+0000 7fb1620fc640 1 -- 172.21.15.37:0/638383901 wait complete. 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.649+0000 7fb1620fc640 1 Processor -- start 2024-05-10T08:47:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.650+0000 7fb1620fc640 1 -- start start 2024-05-10T08:47:59.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.650+0000 7fb1620fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c0703a0 0x7fb15c1e8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.650+0000 7fb1620fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.650+0000 7fb1620fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb15c1613e0 0x7fb15c1e6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.650+0000 7fb1620fc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c070990 con 0x7fb15c15d060 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.650+0000 7fb1620fc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c070810 con 0x7fb15c1613e0 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.650+0000 7fb1620fc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb15c15d980 con 0x7fb15c0703a0 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38062/0 (socket says 172.21.15.37:38062) 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 -- 172.21.15.37:0/598373255 learned_addr learned my addr 172.21.15.37:0/598373255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15b7fe640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c0703a0 0x7fb15c1e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15bfff640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb15c1613e0 0x7fb15c1e6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 -- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c0703a0 msgr2=0x7fb15c1e8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c0703a0 0x7fb15c1e8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 -- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb15c1613e0 msgr2=0x7fb15c1e6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb15c1613e0 0x7fb15c1e6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 -- 172.21.15.37:0/598373255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c1e73f0 con 0x7fb15c15d060 2024-05-10T08:47:59.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15b7fe640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c0703a0 0x7fb15c1e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:47:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb15affd640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c152020 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c460 tx=0x7fb15000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb143fff640 1 -- 172.21.15.37:0/598373255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150016020 con 0x7fb15c15d060 2024-05-10T08:47:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb143fff640 1 -- 172.21.15.37:0/598373255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb150012870 con 0x7fb15c15d060 2024-05-10T08:47:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb143fff640 1 -- 172.21.15.37:0/598373255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150012c60 con 0x7fb15c15d060 2024-05-10T08:47:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15c1e76d0 con 0x7fb15c15d060 2024-05-10T08:47:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.651+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15c1e7c90 con 0x7fb15c15d060 2024-05-10T08:47:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.653+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb15c069b00 con 0x7fb15c15d060 2024-05-10T08:47:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.653+0000 7fb143fff640 1 -- 172.21.15.37:0/598373255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb150019020 con 0x7fb15c15d060 2024-05-10T08:47:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.654+0000 7fb143fff640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1480762d0 0x7fb148078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.654+0000 7fb143fff640 1 -- 172.21.15.37:0/598373255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fb150097490 con 0x7fb15c15d060 2024-05-10T08:47:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.654+0000 7fb15b7fe640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1480762d0 0x7fb148078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.654+0000 7fb15b7fe640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1480762d0 0x7fb148078790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb14c034000 tx=0x7fb14c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.658+0000 7fb143fff640 1 -- 172.21.15.37:0/598373255 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb150020030 con 0x7fb15c15d060 2024-05-10T08:47:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.890+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb15c152560 con 0x7fb15c15d060 2024-05-10T08:47:59.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.890+0000 7fb143fff640 1 -- 172.21.15.37:0/598373255 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5180 (secure 0 0 0) 0x7fb1500604e0 con 0x7fb15c15d060 2024-05-10T08:47:59.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:47:59.889 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7446,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:47:49.323413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/902568070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":902568070},{"type":"v1","addr":"172.21.15.82:6837","nonce":902568070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7455,"qdb_cluster":[7455]},"id":7}]} 2024-05-10T08:47:59.890 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 81 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1480762d0 msgr2=0x7fb148078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1480762d0 0x7fb148078790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb14c034000 tx=0x7fb14c02e000 comp rx=0 tx=0).stop 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 msgr2=0x7fb15c152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c152020 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c460 tx=0x7fb15000c920 comp rx=0 tx=0).stop 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 shutdown_connections 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1480762d0 0x7fb148078790 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb15c1613e0 0x7fb15c1e6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c15d060 0x7fb15c152020 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 --2- 172.21.15.37:0/598373255 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb15c0703a0 0x7fb15c1e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 >> 172.21.15.37:0/598373255 conn(0x7fb15c09ba40 msgr2=0x7fb15c15dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:59.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 shutdown_connections 2024-05-10T08:47:59.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.893+0000 7fb1620fc640 1 -- 172.21.15.37:0/598373255 wait complete. 2024-05-10T08:47:59.903 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-05-10T08:47:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.948+0000 7f593b887f40 1 Processor -- start 2024-05-10T08:47:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.948+0000 7f593b887f40 1 -- start start 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f593b887f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db143660 0x5641db155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f593b887f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db1e8560 0x5641db27adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f593b887f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8940 0x5641db27b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f593b887f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5641db115ff0 con 0x5641db143660 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f593b887f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5641db0baf50 con 0x5641db1e8940 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f593b887f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5641db116de0 con 0x5641db1e8560 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f5939381640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db143660 0x5641db155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f5939381640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db143660 0x5641db155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38074/0 (socket says 172.21.15.37:38074) 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f5939381640 1 -- 172.21.15.37:0/2325823726 learned_addr learned my addr 172.21.15.37:0/2325823726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f5939b82640 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8940 0x5641db27b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.949+0000 7f5938b80640 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db1e8560 0x5641db27adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f5939381640 1 -- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db1e8560 msgr2=0x5641db27adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f5939381640 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db1e8560 0x5641db27adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f5939381640 1 -- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8940 msgr2=0x5641db27b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f5939381640 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8940 0x5641db27b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f5939381640 1 -- 172.21.15.37:0/2325823726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641db154c20 con 0x5641db143660 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f5939381640 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db143660 0x5641db155ab0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f592c0017b0 tx=0x7f592c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8223feb809c21a39 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f592b7fe640 1 -- 172.21.15.37:0/2325823726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c003650 con 0x5641db143660 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f592b7fe640 1 -- 172.21.15.37:0/2325823726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592c0037f0 con 0x5641db143660 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f592b7fe640 1 -- 172.21.15.37:0/2325823726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c003bc0 con 0x5641db143660 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f593b887f40 1 -- 172.21.15.37:0/2325823726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db143660 msgr2=0x5641db155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f593b887f40 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db143660 0x5641db155ab0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f592c0017b0 tx=0x7f592c001c70 comp rx=0 tx=0).stop 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.950+0000 7f593b887f40 1 -- 172.21.15.37:0/2325823726 shutdown_connections 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8940 0x5641db27b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db1e8560 0x5641db27adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 --2- 172.21.15.37:0/2325823726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db143660 0x5641db155ab0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 -- 172.21.15.37:0/2325823726 >> 172.21.15.37:0/2325823726 conn(0x5641db140b40 msgr2=0x5641db115850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 -- 172.21.15.37:0/2325823726 shutdown_connections 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 -- 172.21.15.37:0/2325823726 wait complete. 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 Processor -- start 2024-05-10T08:47:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.951+0000 7f593b887f40 1 -- start start 2024-05-10T08:47:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f593b887f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db143660 0x5641db1ea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f593b887f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8560 0x5641db1df920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f593b887f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db1e8940 0x5641db1e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f593b887f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5641db1eb950 con 0x5641db1e8940 2024-05-10T08:47:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f593b887f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5641db1ebba0 con 0x5641db1e8560 2024-05-10T08:47:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f593b887f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5641db140460 con 0x5641db143660 2024-05-10T08:47:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db1e8940 0x5641db1e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db1e8940 0x5641db1e67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38090/0 (socket says 172.21.15.37:38090) 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 -- 172.21.15.37:0/1210848842 learned_addr learned my addr 172.21.15.37:0/1210848842 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5938b80640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8560 0x5641db1df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939381640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db143660 0x5641db1ea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 -- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db143660 msgr2=0x5641db1ea1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5641db143660 0x5641db1ea1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 -- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8560 msgr2=0x5641db1df920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641db1e8560 0x5641db1df920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 -- 172.21.15.37:0/1210848842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641db1145f0 con 0x5641db1e8940 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.952+0000 7f5939b82640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db1e8940 0x5641db1e67d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5934045d50 tx=0x7f5934002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.953+0000 7f592a7fc640 1 -- 172.21.15.37:0/1210848842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934066070 con 0x5641db1e8940 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.953+0000 7f592a7fc640 1 -- 172.21.15.37:0/1210848842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5934054c50 con 0x5641db1e8940 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.953+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641db1e2ab0 con 0x5641db1e8940 2024-05-10T08:47:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.953+0000 7f592a7fc640 1 -- 172.21.15.37:0/1210848842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934059040 con 0x5641db1e8940 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.953+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641db1e7580 con 0x5641db1e8940 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.954+0000 7f592a7fc640 1 -- 172.21.15.37:0/1210848842 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5934069070 con 0x5641db1e8940 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.955+0000 7f592a7fc640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f591c074cb0 0x7f591c077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.955+0000 7f592a7fc640 1 -- 172.21.15.37:0/1210848842 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f59340da340 con 0x5641db1e8940 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.955+0000 7f5939381640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f591c074cb0 0x7f591c077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.955+0000 7f593b887f40 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5641db15a290 0x5641db157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.955+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x5641db157ab0 con 0x5641db15a290 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.955+0000 7f5938b80640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5641db15a290 0x5641db157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.955+0000 7f5938b80640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5641db15a290 0x5641db157570 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f5939381640 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f591c074cb0 0x7f591c077170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f592c001cb0 tx=0x7f592c008070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:47:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f5938b80640 1 -- 172.21.15.37:0/1210848842 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7f5930009b10 con 0x5641db15a290 2024-05-10T08:47:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5641db15a290 msgr2=0x5641db157570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x5641db15a290 0x5641db157570 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f591c074cb0 msgr2=0x7f591c077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f591c074cb0 0x7f591c077170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f592c001cb0 tx=0x7f592c008070 comp rx=0 tx=0).stop 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db1e8940 msgr2=0x5641db1e67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 --2- 172.21.15.37:0/1210848842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641db1e8940 0x5641db1e67d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5934045d50 tx=0x7f5934002fb0 comp rx=0 tx=0).stop 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f5939b82640 1 -- 172.21.15.37:0/1210848842 reap_dead start 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 shutdown_connections 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 >> 172.21.15.37:0/1210848842 conn(0x5641db140b40 msgr2=0x5641db115850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 shutdown_connections 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:47:59.956+0000 7f593b887f40 1 -- 172.21.15.37:0/1210848842 wait complete. 2024-05-10T08:47:59.960 INFO:teuthology.orchestra.run.smithi037.stdout:����� 2024-05-10T08:47:59.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:48:00.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.065+0000 7f6b96990640 1 Processor -- start 2024-05-10T08:48:00.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.065+0000 7f6b96990640 1 -- start start 2024-05-10T08:48:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b96990640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b900d3cd0 0x7f6b900cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b96990640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b900c9ee0 0x7f6b900d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b96990640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b900d3330 con 0x7f6b901629a0 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b96990640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6b900d2170 con 0x7f6b900c9ee0 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b96990640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b900d2450 con 0x7f6b900d3cd0 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b94f2d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b900c9ee0 0x7f6b900d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b8f7fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b900d3cd0 0x7f6b900cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b8ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6b901629a0 0x7f6b900d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:44642/0 (socket says 172.21.15.37:44642) 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b94f2d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b900c9ee0 0x7f6b900d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:44554/0 (socket says 172.21.15.37:44554) 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b8f7fe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b900d3cd0 0x7f6b900cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53314/0 (socket says 172.21.15.37:53314) 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.066+0000 7f6b8ffff640 1 -- 172.21.15.37:0/4292948437 learned_addr learned my addr 172.21.15.37:0/4292948437 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.067+0000 7f6b8effd640 1 -- 172.21.15.37:0/4292948437 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581008909 0 0) 0x7f6b900d3330 con 0x7f6b901629a0 2024-05-10T08:48:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.067+0000 7f6b8effd640 1 -- 172.21.15.37:0/4292948437 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b78003520 con 0x7f6b901629a0 2024-05-10T08:48:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.067+0000 7f6b8f7fe640 1 -- 172.21.15.37:0/4292948437 >> v2:172.21.15.82:3300/0 conn(0x7f6b900c9ee0 msgr2=0x7f6b900d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.067+0000 7f6b8f7fe640 1 --2- 172.21.15.37:0/4292948437 >> v2:172.21.15.82:3300/0 conn(0x7f6b900c9ee0 0x7f6b900d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.067+0000 7f6b8f7fe640 1 -- 172.21.15.37:0/4292948437 >> v1:172.21.15.82:6789/0 conn(0x7f6b901629a0 legacy=0x7f6b900d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.067+0000 7f6b8f7fe640 1 -- 172.21.15.37:0/4292948437 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b900d2730 con 0x7f6b900d3cd0 2024-05-10T08:48:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.067+0000 7f6b94f2d640 1 --2- 172.21.15.37:0/4292948437 >> v2:172.21.15.82:3300/0 conn(0x7f6b900c9ee0 0x7f6b900d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b8f7fe640 1 --2- 172.21.15.37:0/4292948437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b900d3cd0 0x7f6b900cfca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b840097a0 tx=0x7f6b8402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5492ef32a2e15972 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b8effd640 1 -- 172.21.15.37:0/4292948437 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84037070 con 0x7f6b900d3cd0 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b8effd640 1 -- 172.21.15.37:0/4292948437 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8402adb0 con 0x7f6b900d3cd0 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b8effd640 1 -- 172.21.15.37:0/4292948437 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84032660 con 0x7f6b900d3cd0 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 -- 172.21.15.37:0/4292948437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b900d3cd0 msgr2=0x7f6b900cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 --2- 172.21.15.37:0/4292948437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b900d3cd0 0x7f6b900cfca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b840097a0 tx=0x7f6b8402a060 comp rx=0 tx=0).stop 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 -- 172.21.15.37:0/4292948437 shutdown_connections 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 --2- 172.21.15.37:0/4292948437 >> v2:172.21.15.82:3300/0 conn(0x7f6b900c9ee0 0x7f6b900d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 --2- 172.21.15.37:0/4292948437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b900d3cd0 0x7f6b900cfca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 -- 172.21.15.37:0/4292948437 >> 172.21.15.37:0/4292948437 conn(0x7f6b900d4fe0 msgr2=0x7f6b900d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 -- 172.21.15.37:0/4292948437 shutdown_connections 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.068+0000 7f6b96990640 1 -- 172.21.15.37:0/4292948437 wait complete. 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.069+0000 7f6b96990640 1 Processor -- start 2024-05-10T08:48:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.070+0000 7f6b96990640 1 -- start start 2024-05-10T08:48:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.070+0000 7f6b96990640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b900c9ee0 0x7f6b900d1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.070+0000 7f6b96990640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b900d3cd0 0x7f6b900d1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.070+0000 7f6b96990640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b901629a0 0x7f6b900b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.070+0000 7f6b96990640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900cf440 con 0x7f6b900d3cd0 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.070+0000 7f6b96990640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900cf2c0 con 0x7f6b900c9ee0 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.070+0000 7f6b96990640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b900d2dc0 con 0x7f6b901629a0 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b900d3cd0 0x7f6b900d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b94f2d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b901629a0 0x7f6b900b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b900d3cd0 0x7f6b900d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38094/0 (socket says 172.21.15.37:38094) 2024-05-10T08:48:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b900c9ee0 0x7f6b900d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8f7fe640 1 -- 172.21.15.37:0/1228295083 learned_addr learned my addr 172.21.15.37:0/1228295083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b94f2d640 1 -- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b900c9ee0 msgr2=0x7f6b900d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b94f2d640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b900c9ee0 0x7f6b900d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b94f2d640 1 -- 172.21.15.37:0/1228295083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b900d3cd0 msgr2=0x7f6b900d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b94f2d640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b900d3cd0 0x7f6b900d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b94f2d640 1 -- 172.21.15.37:0/1228295083 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b900cd200 con 0x7f6b901629a0 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8f7fe640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b900d3cd0 0x7f6b900d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b94f2d640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b901629a0 0x7f6b900b85f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800efc0 tx=0x7f6b8800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8cff9640 1 -- 172.21.15.37:0/1228295083 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88018030 con 0x7f6b901629a0 2024-05-10T08:48:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8cff9640 1 -- 172.21.15.37:0/1228295083 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8800cd30 con 0x7f6b901629a0 2024-05-10T08:48:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b900cd4e0 con 0x7f6b901629a0 2024-05-10T08:48:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b8cff9640 1 -- 172.21.15.37:0/1228295083 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88003bb0 con 0x7f6b901629a0 2024-05-10T08:48:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.071+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b900cdaa0 con 0x7f6b901629a0 2024-05-10T08:48:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.072+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b900693f0 con 0x7f6b901629a0 2024-05-10T08:48:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.073+0000 7f6b8cff9640 1 -- 172.21.15.37:0/1228295083 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b8801b070 con 0x7f6b901629a0 2024-05-10T08:48:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.073+0000 7f6b8cff9640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b7c0762d0 0x7f6b7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.073+0000 7f6b8cff9640 1 -- 172.21.15.37:0/1228295083 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f6b88097fe0 con 0x7f6b901629a0 2024-05-10T08:48:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.073+0000 7f6b8ffff640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b7c0762d0 0x7f6b7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.074+0000 7f6b8ffff640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b7c0762d0 0x7f6b7c078790 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6b80005880 tx=0x7f6b80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.078+0000 7f6b8cff9640 1 -- 172.21.15.37:0/1228295083 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6b88010040 con 0x7f6b901629a0 2024-05-10T08:48:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.308+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6b90160aa0 con 0x7f6b901629a0 2024-05-10T08:48:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.309+0000 7f6b8cff9640 1 -- 172.21.15.37:0/1228295083 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7f6b88061170 con 0x7f6b901629a0 2024-05-10T08:48:00.308 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:48:00.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b7c0762d0 msgr2=0x7f6b7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:00.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b7c0762d0 0x7f6b7c078790 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6b80005880 tx=0x7f6b80009040 comp rx=0 tx=0).stop 2024-05-10T08:48:00.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b901629a0 msgr2=0x7f6b900b85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b901629a0 0x7f6b900b85f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800efc0 tx=0x7f6b8800c490 comp rx=0 tx=0).stop 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 shutdown_connections 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b7c0762d0 0x7f6b7c078790 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b901629a0 0x7f6b900b85f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b900d3cd0 0x7f6b900d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 --2- 172.21.15.37:0/1228295083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b900c9ee0 0x7f6b900d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 >> 172.21.15.37:0/1228295083 conn(0x7f6b900d4fe0 msgr2=0x7f6b9006dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 shutdown_connections 2024-05-10T08:48:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00.311+0000 7f6b96990640 1 -- 172.21.15.37:0/1228295083 wait complete. 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:48:00.321 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:48:00.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:00.322 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:48:00.339 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42281sec preferred_lft 42281sec 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:48:00.340 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:48:00.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:48:00.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:00.342 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:48:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:48:00.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:00.407 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:48:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:48:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:48:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:48:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:48:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:48:00.464 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:48:00.464 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:48:00.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:48:00.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:48:00.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:48:00.464 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:48:00.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:48:00.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:48:00.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:00.594 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:48:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:48:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:48:00.610 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:48:00.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:00.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:48:00.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:48:00.676 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:48:00.732 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:48:00.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:48:00.733 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:48:00.788 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:48:00.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:00.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:48:00.873 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:48:00.874 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:48:00.874 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:48:00.882 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:48:00.882 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:48:00.883 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:48:00.883 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:48:00.883 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:48:00.887 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:48:00.887 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:48:00.887 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:48:00.888 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:48:00.889 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:48:00.891 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:48:00.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:00.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:48:00.917 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:48:01.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:48:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:48:01.017 INFO:teuthology.orchestra.run.smithi037.stdout:client7659 2024-05-10T08:48:01.017 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:48:01.017 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:48:01.033 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:48:01.034 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:48:01.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:01.091 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-05-10T08:48:01.185 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records in 2024-05-10T08:48:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records out 2024-05-10T08:48:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0360941 s, 174 MB/s 2024-05-10T08:48:01.186 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:48:01.186 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:48:01.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:01.202 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-05-10T08:48:01.291 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records in 2024-05-10T08:48:01.291 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records out 2024-05-10T08:48:01.291 INFO:teuthology.orchestra.run.smithi037.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0315047 s, 200 MB/s 2024-05-10T08:48:01.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:01.292 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T08:48:01.310 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2024-05-10T08:48:01.310 INFO:teuthology.orchestra.run.smithi037.stdout:./file2_sixmegs 2024-05-10T08:48:01.310 INFO:teuthology.orchestra.run.smithi037.stdout:./file3_sixmegs 2024-05-10T08:48:01.310 INFO:teuthology.orchestra.run.smithi037.stdout:./file1_sixmegs 2024-05-10T08:48:01.311 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:48:01.311 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:48:01.311 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:48:01.311 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:48:01.311 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T08:48:01.311 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:48:01.417 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:48:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:48:01.426 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:48:01.427 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:48:01.427 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:48:01.427 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:48:01.427 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-05-10T08:48:01.427 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:48:01.535 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2024-05-10T08:48:01.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:48:01.544 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:48:01.544 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:48:01.544 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:48:01.544 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:48:01.544 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-05-10T08:48:01.544 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:48:01.652 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2024-05-10T08:48:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:48:01.662 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:48:01.662 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:48:01.662 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:48:01.662 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:48:01.662 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-05-10T08:48:01.662 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:48:01.769 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2024-05-10T08:48:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:48:01.779 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:48:01.779 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:48:01.835 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:48:01.835 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:48:01.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:48:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.039+0000 7f15f1615640 1 Processor -- start 2024-05-10T08:48:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.039+0000 7f15f1615640 1 -- start start 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.040+0000 7f15f1615640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15ec06f540 0x7f15ec070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.040+0000 7f15f1615640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15ec071020 0x7f15ec0732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.040+0000 7f15f1615640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15ec06fa40 con 0x7f15ec15bc50 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.040+0000 7f15f1615640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f15ec06fd20 con 0x7f15ec06f540 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.040+0000 7f15f1615640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f15ec070000 con 0x7f15ec071020 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.040+0000 7f15ea7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15ec06f540 0x7f15ec070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15eaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15ec15bc50 0x7f15ec0b5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48286/0 (socket says 172.21.15.37:48286) 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15eaffd640 1 -- 172.21.15.37:0/3697549247 learned_addr learned my addr 172.21.15.37:0/3697549247 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15eb7fe640 1 --2- 172.21.15.37:0/3697549247 >> v2:172.21.15.82:3300/0 conn(0x7f15ec071020 0x7f15ec0732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15ea7fc640 1 -- 172.21.15.37:0/3697549247 >> v2:172.21.15.82:3300/0 conn(0x7f15ec071020 msgr2=0x7f15ec0732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15ea7fc640 1 --2- 172.21.15.37:0/3697549247 >> v2:172.21.15.82:3300/0 conn(0x7f15ec071020 0x7f15ec0732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15ea7fc640 1 -- 172.21.15.37:0/3697549247 >> v1:172.21.15.37:6789/0 conn(0x7f15ec15bc50 legacy=0x7f15ec0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15ea7fc640 1 -- 172.21.15.37:0/3697549247 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ec0702e0 con 0x7f15ec06f540 2024-05-10T08:48:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.041+0000 7f15e9ffb640 1 -- 172.21.15.37:0/3697549247 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688228599 0 0) 0x7f15ec06fa40 con 0x7f15ec15bc50 2024-05-10T08:48:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15ea7fc640 1 --2- 172.21.15.37:0/3697549247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec06f540 0x7f15ec070ae0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f15ec073f30 tx=0x7f15d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc21e9a45c657b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15e9ffb640 1 -- 172.21.15.37:0/3697549247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4037070 con 0x7f15ec06f540 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15e9ffb640 1 -- 172.21.15.37:0/3697549247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d4032440 con 0x7f15ec06f540 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15e9ffb640 1 -- 172.21.15.37:0/3697549247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4032810 con 0x7f15ec06f540 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 -- 172.21.15.37:0/3697549247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec06f540 msgr2=0x7f15ec070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 --2- 172.21.15.37:0/3697549247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec06f540 0x7f15ec070ae0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f15ec073f30 tx=0x7f15d402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 -- 172.21.15.37:0/3697549247 shutdown_connections 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 --2- 172.21.15.37:0/3697549247 >> v2:172.21.15.82:3300/0 conn(0x7f15ec071020 0x7f15ec0732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 --2- 172.21.15.37:0/3697549247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec06f540 0x7f15ec070ae0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 -- 172.21.15.37:0/3697549247 >> 172.21.15.37:0/3697549247 conn(0x7f15ec0b3c40 msgr2=0x7f15ec0b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 -- 172.21.15.37:0/3697549247 shutdown_connections 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.042+0000 7f15f1615640 1 -- 172.21.15.37:0/3697549247 wait complete. 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.044+0000 7f15f1615640 1 Processor -- start 2024-05-10T08:48:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.044+0000 7f15f1615640 1 -- start start 2024-05-10T08:48:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15f1615640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15ec06f540 0x7f15ec15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15f1615640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15ec15bc50 0x7f15ec15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15f1615640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec14d600 0x7f15ec0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15f1615640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15ec15c1b0 con 0x7f15ec14d600 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15f1615640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15ec15c030 con 0x7f15ec15bc50 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15f1615640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15ec073800 con 0x7f15ec06f540 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec14d600 0x7f15ec0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec14d600 0x7f15ec0b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38120/0 (socket says 172.21.15.37:38120) 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 -- 172.21.15.37:0/2242345806 learned_addr learned my addr 172.21.15.37:0/2242345806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eaffd640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15ec06f540 0x7f15ec15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15ea7fc640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15ec15bc50 0x7f15ec15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 -- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15ec06f540 msgr2=0x7f15ec15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15ec06f540 0x7f15ec15dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 -- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15ec15bc50 msgr2=0x7f15ec15c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15ec15bc50 0x7f15ec15c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 -- 172.21.15.37:0/2242345806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ec15cba0 con 0x7f15ec14d600 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15ea7fc640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15ec15bc50 0x7f15ec15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eaffd640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15ec06f540 0x7f15ec15dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15eb7fe640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec14d600 0x7f15ec0b4d30 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f15e400d800 tx=0x7f15e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.045+0000 7f15e37fe640 1 -- 172.21.15.37:0/2242345806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e400b660 con 0x7f15ec14d600 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.046+0000 7f15e37fe640 1 -- 172.21.15.37:0/2242345806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e4019070 con 0x7f15ec14d600 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.046+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ec15ce80 con 0x7f15ec14d600 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.046+0000 7f15e37fe640 1 -- 172.21.15.37:0/2242345806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e400ba60 con 0x7f15ec14d600 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.046+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ec0aea50 con 0x7f15ec14d600 2024-05-10T08:48:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.047+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15ec15d3a0 con 0x7f15ec14d600 2024-05-10T08:48:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.047+0000 7f15e37fe640 1 -- 172.21.15.37:0/2242345806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f15e400bc00 con 0x7f15ec14d600 2024-05-10T08:48:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.048+0000 7f15e37fe640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15cc076300 0x7f15cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.048+0000 7f15e37fe640 1 -- 172.21.15.37:0/2242345806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f15e4097b50 con 0x7f15ec14d600 2024-05-10T08:48:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.048+0000 7f15eaffd640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15cc076300 0x7f15cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.048+0000 7f15eaffd640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15cc076300 0x7f15cc0787c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f15dc007fd0 tx=0x7f15dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.052+0000 7f15e37fe640 1 -- 172.21.15.37:0/2242345806 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f15ec15d3a0 con 0x7f15ec14d600 2024-05-10T08:48:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.254+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f15ec069b00 con 0x7f15ec14d600 2024-05-10T08:48:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.254+0000 7f15e37fe640 1 -- 172.21.15.37:0/2242345806 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7f15e4061320 con 0x7f15ec14d600 2024-05-10T08:48:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:48:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15cc076300 msgr2=0x7f15cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15cc076300 0x7f15cc0787c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f15dc007fd0 tx=0x7f15dc009040 comp rx=0 tx=0).stop 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec14d600 msgr2=0x7f15ec0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec14d600 0x7f15ec0b4d30 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f15e400d800 tx=0x7f15e400dcc0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 shutdown_connections 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f15cc076300 0x7f15cc0787c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec14d600 0x7f15ec0b4d30 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15ec15bc50 0x7f15ec15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 --2- 172.21.15.37:0/2242345806 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15ec06f540 0x7f15ec15dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 >> 172.21.15.37:0/2242345806 conn(0x7f15ec0b3c40 msgr2=0x7f15ec15edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 shutdown_connections 2024-05-10T08:48:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.256+0000 7f15f1615640 1 -- 172.21.15.37:0/2242345806 wait complete. 2024-05-10T08:48:02.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:48:02.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:02.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:48:02.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:48:02.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:02.316 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:48:02.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:48:02.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.491+0000 7fdb31bef640 1 Processor -- start 2024-05-10T08:48:02.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.491+0000 7fdb31bef640 1 -- start start 2024-05-10T08:48:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.491+0000 7fdb31bef640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c15f420 0x7fdb2c0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.491+0000 7fdb31bef640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb2c0d2080 0x7fdb2c0d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.491+0000 7fdb31bef640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb2c1630b0 con 0x7fdb2c0d3ca0 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.491+0000 7fdb31bef640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2c0d2550 con 0x7fdb2c0d2080 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.491+0000 7fdb31bef640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d2c80 con 0x7fdb2c15f420 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb2c0d2080 0x7fdb2c0d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdb2c0d3ca0 0x7fdb2c0d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48302/0 (socket says 172.21.15.37:48302) 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2affd640 1 -- 172.21.15.37:0/2391787221 learned_addr learned my addr 172.21.15.37:0/2391787221 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/2391787221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c15f420 0x7fdb2c0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2bfff640 1 -- 172.21.15.37:0/2391787221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c15f420 msgr2=0x7fdb2c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2bfff640 1 --2- 172.21.15.37:0/2391787221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c15f420 0x7fdb2c0d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2bfff640 1 -- 172.21.15.37:0/2391787221 >> v1:172.21.15.37:6789/0 conn(0x7fdb2c0d3ca0 legacy=0x7fdb2c0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2a7fc640 1 -- 172.21.15.37:0/2391787221 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2797640095 0 0) 0x7fdb20001110 con 0x7fdb2c0d3ca0 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.492+0000 7fdb2bfff640 1 -- 172.21.15.37:0/2391787221 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0d2f60 con 0x7fdb2c0d2080 2024-05-10T08:48:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb2bfff640 1 --2- 172.21.15.37:0/2391787221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0d4cc0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009d90 tx=0x7fdb2402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ee174d2ac2e452 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb2a7fc640 1 -- 172.21.15.37:0/2391787221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24007740 con 0x7fdb2c0d2080 2024-05-10T08:48:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb2a7fc640 1 -- 172.21.15.37:0/2391787221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb240078e0 con 0x7fdb2c0d2080 2024-05-10T08:48:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb2a7fc640 1 -- 172.21.15.37:0/2391787221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24007cb0 con 0x7fdb2c0d2080 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 -- 172.21.15.37:0/2391787221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0d2080 msgr2=0x7fdb2c0d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 --2- 172.21.15.37:0/2391787221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0d4cc0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009d90 tx=0x7fdb2402a660 comp rx=0 tx=0).stop 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 -- 172.21.15.37:0/2391787221 shutdown_connections 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 --2- 172.21.15.37:0/2391787221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0d4cc0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 --2- 172.21.15.37:0/2391787221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c15f420 0x7fdb2c0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 -- 172.21.15.37:0/2391787221 >> 172.21.15.37:0/2391787221 conn(0x7fdb2c08eac0 msgr2=0x7fdb2c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 -- 172.21.15.37:0/2391787221 shutdown_connections 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.493+0000 7fdb31bef640 1 -- 172.21.15.37:0/2391787221 wait complete. 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.495+0000 7fdb31bef640 1 Processor -- start 2024-05-10T08:48:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.495+0000 7fdb31bef640 1 -- start start 2024-05-10T08:48:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb31bef640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb31bef640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c0ca5e0 0x7fdb2c0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb31bef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c160e30 0x7fdb2c1612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb31bef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d5200 con 0x7fdb2c160e30 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb31bef640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d2830 con 0x7fdb2c0d2080 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb31bef640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d5380 con 0x7fdb2c0ca5e0 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c160e30 0x7fdb2c1612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c160e30 0x7fdb2c1612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38138/0 (socket says 172.21.15.37:38138) 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 -- 172.21.15.37:0/876626777 learned_addr learned my addr 172.21.15.37:0/876626777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2affd640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c0ca5e0 0x7fdb2c0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 -- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c0ca5e0 msgr2=0x7fdb2c0caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c0ca5e0 0x7fdb2c0caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 -- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c0d2080 msgr2=0x7fdb2c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 -- 172.21.15.37:0/876626777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c1599f0 con 0x7fdb2c160e30 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb2bfff640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c160e30 0x7fdb2c1612b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009eb0 tx=0x7fdb24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb13fff640 1 -- 172.21.15.37:0/876626777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24040070 con 0x7fdb2c160e30 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb13fff640 1 -- 172.21.15.37:0/876626777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb24031bc0 con 0x7fdb2c160e30 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c159c90 con 0x7fdb2c160e30 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.496+0000 7fdb13fff640 1 -- 172.21.15.37:0/876626777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2403c420 con 0x7fdb2c160e30 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.497+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c15a250 con 0x7fdb2c160e30 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.498+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c0693f0 con 0x7fdb2c160e30 2024-05-10T08:48:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.498+0000 7fdb13fff640 1 -- 172.21.15.37:0/876626777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb24039040 con 0x7fdb2c160e30 2024-05-10T08:48:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.499+0000 7fdb13fff640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb180762d0 0x7fdb18078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.499+0000 7fdb13fff640 1 -- 172.21.15.37:0/876626777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fdb240b8c20 con 0x7fdb2c160e30 2024-05-10T08:48:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.499+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb180762d0 0x7fdb18078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.499+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb180762d0 0x7fdb18078790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00b9f0 tx=0x7fdb1c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.503+0000 7fdb13fff640 1 -- 172.21.15.37:0/876626777 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdb240823f0 con 0x7fdb2c160e30 2024-05-10T08:48:02.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.738+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb2c0b4c50 con 0x7fdb2c160e30 2024-05-10T08:48:02.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.738+0000 7fdb13fff640 1 -- 172.21.15.37:0/876626777 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5180 (secure 0 0 0) 0x7fdb24081cf0 con 0x7fdb2c160e30 2024-05-10T08:48:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7446,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:47:49.323413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/902568070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":902568070},{"type":"v1","addr":"172.21.15.82:6837","nonce":902568070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7455,"qdb_cluster":[7455]},"id":7}]} 2024-05-10T08:48:02.738 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 81 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb180762d0 msgr2=0x7fdb18078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb180762d0 0x7fdb18078790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00b9f0 tx=0x7fdb1c008040 comp rx=0 tx=0).stop 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c160e30 msgr2=0x7fdb2c1612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c160e30 0x7fdb2c1612b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009eb0 tx=0x7fdb24004a40 comp rx=0 tx=0).stop 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 shutdown_connections 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb180762d0 0x7fdb18078790 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c160e30 0x7fdb2c1612b0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb2c0ca5e0 0x7fdb2c0caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 --2- 172.21.15.37:0/876626777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c0d2080 0x7fdb2c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.740+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 >> 172.21.15.37:0/876626777 conn(0x7fdb2c08eac0 msgr2=0x7fdb2c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.741+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 shutdown_connections 2024-05-10T08:48:02.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:02.741+0000 7fdb31bef640 1 -- 172.21.15.37:0/876626777 wait complete. 2024-05-10T08:48:02.751 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-05-10T08:48:02.889 INFO:teuthology.orchestra.run.smithi082.stdout:{"message":"","return_code":0} 2024-05-10T08:48:02.890 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T08:48:02.890 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:48:02.890 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:48:02.907 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:48:02.907 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:48:02.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:02.907 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:48:02.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:48:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-10T08:48:02.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo daemon-helper kill ceph --cluster ceph -w 2024-05-10T08:48:03.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:03.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-05-10T08:48:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.117+0000 7fdb771b6640 1 Processor -- start 2024-05-10T08:48:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.117+0000 7fdb771b6640 1 -- start start 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb771b6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb70162b70 0x7fdb700d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb771b6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdb700d3480 0x7fdb700b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb771b6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb70162f50 con 0x7fdb700d3910 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb771b6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdb700d1f60 con 0x7fdb70162b70 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb771b6640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdb700d3ee0 con 0x7fdb700d3480 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb74f52640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb70162b70 0x7fdb700d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb74f52640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb70162b70 0x7fdb700d2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38152/0 (socket says 172.21.15.37:38152) 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb74f52640 1 -- 172.21.15.37:0/2440657220 learned_addr learned my addr 172.21.15.37:0/2440657220 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2440657220 >> v2:172.21.15.82:3300/0 conn(0x7fdb700d3480 0x7fdb700b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb74f52640 1 -- 172.21.15.37:0/2440657220 >> v2:172.21.15.82:3300/0 conn(0x7fdb700d3480 msgr2=0x7fdb700b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb74f52640 1 --2- 172.21.15.37:0/2440657220 >> v2:172.21.15.82:3300/0 conn(0x7fdb700d3480 0x7fdb700b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb74f52640 1 -- 172.21.15.37:0/2440657220 >> v1:172.21.15.82:6789/0 conn(0x7fdb700d3910 legacy=0x7fdb700b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb74f52640 1 -- 172.21.15.37:0/2440657220 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb700d21b0 con 0x7fdb70162b70 2024-05-10T08:48:03.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.118+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2440657220 >> v2:172.21.15.82:3300/0 conn(0x7fdb700d3480 0x7fdb700b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.119+0000 7fdb74f52640 1 --2- 172.21.15.37:0/2440657220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb70162b70 0x7fdb700d2f40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fdb7006c5c0 tx=0x7fdb6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8579f353fcc6a6bd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.119+0000 7fdb6f7fe640 1 -- 172.21.15.37:0/2440657220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64037070 con 0x7fdb70162b70 2024-05-10T08:48:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.119+0000 7fdb6f7fe640 1 -- 172.21.15.37:0/2440657220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb64032440 con 0x7fdb70162b70 2024-05-10T08:48:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.119+0000 7fdb6f7fe640 1 -- 172.21.15.37:0/2440657220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64032810 con 0x7fdb70162b70 2024-05-10T08:48:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 -- 172.21.15.37:0/2440657220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb70162b70 msgr2=0x7fdb700d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 --2- 172.21.15.37:0/2440657220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb70162b70 0x7fdb700d2f40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fdb7006c5c0 tx=0x7fdb6402a270 comp rx=0 tx=0).stop 2024-05-10T08:48:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 -- 172.21.15.37:0/2440657220 shutdown_connections 2024-05-10T08:48:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 --2- 172.21.15.37:0/2440657220 >> v2:172.21.15.82:3300/0 conn(0x7fdb700d3480 0x7fdb700b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 --2- 172.21.15.37:0/2440657220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb70162b70 0x7fdb700d2f40 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 -- 172.21.15.37:0/2440657220 >> 172.21.15.37:0/2440657220 conn(0x7fdb700d5040 msgr2=0x7fdb700d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 -- 172.21.15.37:0/2440657220 shutdown_connections 2024-05-10T08:48:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.120+0000 7fdb771b6640 1 -- 172.21.15.37:0/2440657220 wait complete. 2024-05-10T08:48:03.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.121+0000 7fdb771b6640 1 Processor -- start 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.121+0000 7fdb771b6640 1 -- start start 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb771b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb700d3480 0x7fdb70160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb771b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700d3910 0x7fdb700cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb771b6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb70162b70 0x7fdb7015e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb771b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700b42f0 con 0x7fdb700d3480 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb771b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700b4170 con 0x7fdb700d3910 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb771b6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700d0c60 con 0x7fdb70162b70 2024-05-10T08:48:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb700d3480 0x7fdb70160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb700d3480 0x7fdb70160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38164/0 (socket says 172.21.15.37:38164) 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 -- 172.21.15.37:0/3236815321 learned_addr learned my addr 172.21.15.37:0/3236815321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700d3910 0x7fdb700cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb75753640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb70162b70 0x7fdb7015e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 -- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb70162b70 msgr2=0x7fdb7015e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb70162b70 0x7fdb7015e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 -- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700d3910 msgr2=0x7fdb700cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700d3910 0x7fdb700cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb74f52640 1 -- 172.21.15.37:0/3236815321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb700b2120 con 0x7fdb700d3480 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700d3910 0x7fdb700cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.122+0000 7fdb75753640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb70162b70 0x7fdb7015e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.123+0000 7fdb74f52640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb700d3480 0x7fdb70160370 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fdb6402a2b0 tx=0x7fdb640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.123+0000 7fdb6d7fa640 1 -- 172.21.15.37:0/3236815321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64037040 con 0x7fdb700d3480 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.123+0000 7fdb6d7fa640 1 -- 172.21.15.37:0/3236815321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb64042070 con 0x7fdb700d3480 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.123+0000 7fdb6d7fa640 1 -- 172.21.15.37:0/3236815321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64030880 con 0x7fdb700d3480 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.123+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb700ce2e0 con 0x7fdb700d3480 2024-05-10T08:48:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.123+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb700b23e0 con 0x7fdb700d3480 2024-05-10T08:48:03.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.125+0000 7fdb6d7fa640 1 -- 172.21.15.37:0/3236815321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb64030a20 con 0x7fdb700d3480 2024-05-10T08:48:03.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.125+0000 7fdb6d7fa640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb540762d0 0x7fdb54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.125+0000 7fdb6d7fa640 1 -- 172.21.15.37:0/3236815321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fdb640b8040 con 0x7fdb700d3480 2024-05-10T08:48:03.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.125+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb540762d0 0x7fdb54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 Processor -- start 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 -- start start 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb540762d0 0x7fdb54078790 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdb700cd560 tx=0x7fdb5c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305420220 0x5563053d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x5563054026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305402c00 0x5563053d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55630533bcf0 con 0x556305403340 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5563052f4e10 con 0x556305402c00 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.126+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556305337cb0 con 0x556305420220 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x5563054026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x5563054026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38166/0 (socket says 172.21.15.37:38166) 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2892513280 learned_addr learned my addr 172.21.15.37:0/2892513280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb75753640 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305402c00 0x5563053d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb74f52640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305420220 0x5563053d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2892513280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305420220 msgr2=0x5563053d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305420220 0x5563053d2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2892513280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305402c00 msgr2=0x5563053d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305402c00 0x5563053d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2892513280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563051157e0 con 0x556305403340 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x5563054026c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c010ac0 tx=0x7fdb5c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ebcba2555f792f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb5a7fc640 1 -- 172.21.15.37:0/2892513280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c01c050 con 0x556305403340 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb5a7fc640 1 -- 172.21.15.37:0/2892513280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c026070 con 0x556305403340 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.127+0000 7fdb5a7fc640 1 -- 172.21.15.37:0/2892513280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00f040 con 0x556305403340 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 -- 172.21.15.37:0/2892513280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 msgr2=0x5563054026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x5563054026c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c010ac0 tx=0x7fdb5c013000 comp rx=0 tx=0).stop 2024-05-10T08:48:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 -- 172.21.15.37:0/2892513280 shutdown_connections 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305402c00 0x5563053d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x5563054026c0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2892513280 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305420220 0x5563053d2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 -- 172.21.15.37:0/2892513280 >> 172.21.15.37:0/2892513280 conn(0x5563053d4e20 msgr2=0x55630541d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 -- 172.21.15.37:0/2892513280 shutdown_connections 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 -- 172.21.15.37:0/2892513280 wait complete. 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.128+0000 7fdb79fae740 1 -- start start 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 1 Processor -- start 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305403340 0x5563054306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x5563053f0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563053f0ed0 0x5563054152e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5563053d6fd0 con 0x5563053f0ed0 2024-05-10T08:48:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5563052f8940 con 0x556305420220 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5563053d63c0 con 0x556305403340 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.129+0000 7fdb79fae740 10 client.0 _ll_register_callbacks cb 0x5563052fb440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb75753640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563053f0ed0 0x5563054152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb74f52640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305403340 0x5563054306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x5563053f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb75753640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563053f0ed0 0x5563054152e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38168/0 (socket says 172.21.15.37:38168) 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb75753640 1 -- 172.21.15.37:0/1189131555 learned_addr learned my addr 172.21.15.37:0/1189131555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb74f52640 1 -- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 msgr2=0x5563053f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb74f52640 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x5563053f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb74f52640 1 -- 172.21.15.37:0/1189131555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563053f0ed0 msgr2=0x5563054152e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb74f52640 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563053f0ed0 0x5563054152e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb74f52640 1 -- 172.21.15.37:0/1189131555 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x556305175f70 con 0x556305403340 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb75753640 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563053f0ed0 0x5563054152e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x5563053f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb74f52640 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305403340 0x5563054306a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdb640b63b0 tx=0x7fdb64030f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f9e189d8a80ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3301/0 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/1189131555 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64045570 con 0x556305403340 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/1189131555 <== mon.2 v2:172.21.15.82:3301/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fdb64089a50 con 0x556305403340 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5c026070 con 0x556305403340 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/1189131555 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdb64081110 con 0x556305403340 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb79fae740 10 client.6347 fetch_fsmap learned FSMap version 81 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.130+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55630500d170 con 0x556305403340 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/1189131555 <== mon.2 v2:172.21.15.82:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c026070 con 0x556305403340 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/1189131555 <== mon.2 v2:172.21.15.82:3301/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fdb6403a070 con 0x556305403340 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb79fae740 10 client.6347 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb79fae740 10 client.6347 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb79fae740 20 client.6347 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:03.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb79fae740 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556305430d90 0x556305431170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb79fae740 4 client.6347 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556305349900 con 0x556305430d90 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556305430d90 0x556305431170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556305430d90 0x556305431170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b906c403f255e9b server_cookie=b27b9f78da59c83f in_seq=0 out_seq=0 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.131+0000 7fdb4f7fe640 10 client.6347 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/1189131555 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556305349900 con 0x556305430d90 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb4f7fe640 10 client.6347 handle_command_reply: tid=0 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 client.6347 shutdown 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305403340 msgr2=0x5563054306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305403340 0x5563054306a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdb640b63b0 tx=0x7fdb64030f90 comp rx=0 tx=0).stop 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 shutdown_connections 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x556305430d90 0x556305431170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563053f0ed0 0x5563054152e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x5563053f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb4f7fe640 0 client.6347 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 --2- 172.21.15.37:0/1189131555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556305403340 0x5563054306a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 >> 172.21.15.37:0/1189131555 conn(0x556305402c00 msgr2=0x55630541d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 shutdown_connections 2024-05-10T08:48:03.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 1 -- 172.21.15.37:0/1189131555 wait complete. 2024-05-10T08:48:03.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.132+0000 7fdb79fae740 20 client.6347 trim_cache size 0 max 16384 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.137+0000 7f350bddd640 1 Processor -- start 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.137+0000 7f350bddd640 1 -- start start 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.138+0000 7f350bddd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 0x7f35040d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.138+0000 7f350bddd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35040cfe60 con 0x7f350415f4c0 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.138+0000 7f350bddd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35040d0100 con 0x7f35040d3da0 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.138+0000 7f350bddd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f35040d03e0 con 0x7f35040d2e90 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.138+0000 7f3509b79640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f350415f4c0 0x7f35040d3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48304/0 (socket says 172.21.15.37:48304) 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.138+0000 7f3509b79640 1 -- 172.21.15.37:0/2119811108 learned_addr learned my addr 172.21.15.37:0/2119811108 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f350a37a640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 0x7f35040d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606632676 0 0) 0x7f35040cfe60 con 0x7f350415f4c0 2024-05-10T08:48:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34ec003520 con 0x7f350415f4c0 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2767262383 0 0) 0x7f34ec003520 con 0x7f350415f4c0 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 msgr2=0x7f35040d5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 0x7f35040d5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 >> v1:172.21.15.82:6789/0 conn(0x7f35040d3da0 legacy=0x7f35040b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35040d06c0 con 0x7f350415f4c0 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f34fc001690 con 0x7f350415f4c0 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 >> v1:172.21.15.37:6789/0 conn(0x7f350415f4c0 legacy=0x7f35040d3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 0x7f34ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34ec003f20 0x7f34ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f34ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35040d03e0 con 0x7f34ec004d40 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec00ba20 con 0x7f34ec003f20 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34ec00bc20 con 0x7f35040d2e90 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f350a37a640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f34ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3509b79640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 0x7f34ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f3509378640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34ec003f20 0x7f34ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f350a37a640 1 -- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 msgr2=0x7f34ec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f350a37a640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040d2e90 0x7f34ec0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f350a37a640 1 -- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34ec003f20 msgr2=0x7f34ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f350a37a640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34ec003f20 0x7f34ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.139+0000 7f350a37a640 1 -- 172.21.15.37:0/2119811108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec003520 con 0x7f34ec004d40 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.140+0000 7f350a37a640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f34ec0051c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009fc0 tx=0x7f34ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be87b07402872e28 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.140+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4009c10 con 0x7f34ec004d40 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.140+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f4036070 con 0x7f34ec004d40 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.140+0000 7f3508b77640 1 -- 172.21.15.37:0/2119811108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4031880 con 0x7f34ec004d40 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.141+0000 7f350bddd640 1 -- 172.21.15.37:0/2119811108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 msgr2=0x7f34ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.141+0000 7f350bddd640 1 --2- 172.21.15.37:0/2119811108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f34ec0051c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009fc0 tx=0x7f34ec005830 comp rx=0 tx=0).stop 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.141+0000 7f350a37a640 1 -- 172.21.15.37:0/2119811108 reap_dead start 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.141+0000 7f350bddd640 1 -- 172.21.15.37:0/2119811108 shutdown_connections 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.141+0000 7f350bddd640 1 -- 172.21.15.37:0/2119811108 >> 172.21.15.37:0/2119811108 conn(0x7f35040d50b0 msgr2=0x7f35040d54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.141+0000 7f350bddd640 1 -- 172.21.15.37:0/2119811108 shutdown_connections 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.141+0000 7f350bddd640 1 -- 172.21.15.37:0/2119811108 wait complete. 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.142+0000 7f350bddd640 1 Processor -- start 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.142+0000 7f350bddd640 1 -- start start 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350bddd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f3504157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350bddd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35040b9ee0 0x7f35040ba360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350bddd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040a14b0 0x7f35040a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350bddd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f350415f8a0 con 0x7f34ec004d40 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350bddd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35040d09a0 con 0x7f35040b9ee0 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350bddd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f35040d2400 con 0x7f35040a14b0 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f3504157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f3504157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38194/0 (socket says 172.21.15.37:38194) 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 -- 172.21.15.37:0/2021408821 learned_addr learned my addr 172.21.15.37:0/2021408821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350a37a640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040a14b0 0x7f35040a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509378640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35040b9ee0 0x7f35040ba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 -- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040a14b0 msgr2=0x7f35040a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040a14b0 0x7f35040a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 -- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35040b9ee0 msgr2=0x7f35040ba360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35040b9ee0 0x7f35040ba360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509b79640 1 -- 172.21.15.37:0/2021408821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3504157ab0 con 0x7f34ec004d40 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f3509378640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35040b9ee0 0x7f35040ba360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.143+0000 7f350a37a640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35040a14b0 0x7f35040a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.144+0000 7f3509b79640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec004d40 0x7f3504157570 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f34fc001200 tx=0x7f34fc007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.144+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00f9c0 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.144+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc018070 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.144+0000 7f350bddd640 1 -- 172.21.15.37:0/2021408821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350409fdb0 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.144+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00fde0 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.144+0000 7f350bddd640 1 -- 172.21.15.37:0/2021408821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35040a0370 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.144+0000 7f350bddd640 1 -- 172.21.15.37:0/2021408821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f35040693f0 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.146+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f34fc01d460 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.146+0000 7f35027fc640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34f00762d0 0x7f34f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.146+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f34fc098300 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.146+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+512 (secure 0 0 0) 0x7f3504157ab0 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.146+0000 7f3509378640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34f00762d0 0x7f34f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.147+0000 7f350bddd640 1 -- 172.21.15.37:0/2021408821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f35040d3470 con 0x7f34ec004d40 2024-05-10T08:48:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.147+0000 7f3509378640 1 --2- 172.21.15.37:0/2021408821 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34f00762d0 0x7f34f0078790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f35040d5500 tx=0x7f34f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.152+0000 7fdb79fae740 1 Processor -- start 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb79fae740 1 -- start start 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x5563053f0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x556305415060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x55630541d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb79fae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70201d80 con 0x556305403340 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70200db0 con 0x556305420220 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdb701f8db0 con 0x5563053f0ed0 2024-05-10T08:48:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x556305415060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x556305415060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38196/0 (socket says 172.21.15.37:38196) 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.153+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2034972637 learned_addr learned my addr 172.21.15.37:0/2034972637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb75753640 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x55630541d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb74f52640 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x5563053f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 msgr2=0x5563053f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x5563053f0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 msgr2=0x55630541d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x55630541d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb6ffff640 1 -- 172.21.15.37:0/2034972637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563054314e0 con 0x556305403340 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x556305415060 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c023040 tx=0x7fdb5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171c6b2ab90e54ca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb59ffb640 1 -- 172.21.15.37:0/2034972637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c01c040 con 0x556305403340 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb59ffb640 1 -- 172.21.15.37:0/2034972637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c026040 con 0x556305403340 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.154+0000 7fdb59ffb640 1 -- 172.21.15.37:0/2034972637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c037640 con 0x556305403340 2024-05-10T08:48:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 -- 172.21.15.37:0/2034972637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 msgr2=0x556305415060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x556305415060 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c023040 tx=0x7fdb5c017000 comp rx=0 tx=0).stop 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 -- 172.21.15.37:0/2034972637 shutdown_connections 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305420220 0x55630541d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305403340 0x556305415060 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 --2- 172.21.15.37:0/2034972637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x5563053f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 -- 172.21.15.37:0/2034972637 >> 172.21.15.37:0/2034972637 conn(0x556305402c00 msgr2=0x5563053cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 -- 172.21.15.37:0/2034972637 shutdown_connections 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 -- 172.21.15.37:0/2034972637 wait complete. 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.155+0000 7fdb79fae740 1 -- start start 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 1 Processor -- start 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x55630549aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305403340 0x5563053f0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305420220 0x5563053f0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70200760 con 0x556305420220 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5563053d59c0 con 0x556305403340 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55630541bf00 con 0x5563053f0ed0 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.156+0000 7fdb79fae740 10 client.0 _ll_register_callbacks cb 0x7fdb64080ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305420220 0x5563053f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb74f52640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x55630549aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305403340 0x5563053f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb74f52640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x55630549aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:53410/0 (socket says 172.21.15.37:53410) 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305420220 0x5563053f0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38206/0 (socket says 172.21.15.37:38206) 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb74f52640 1 -- 172.21.15.37:0/3756430241 learned_addr learned my addr 172.21.15.37:0/3756430241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 -- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 msgr2=0x55630549aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x55630549aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 -- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305403340 msgr2=0x5563053f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305403340 0x5563053f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 -- 172.21.15.37:0/3756430241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563053d5f60 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb6ffff640 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305403340 0x5563053f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb75753640 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305420220 0x5563053f0780 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fdb68014a90 tx=0x7fdb68014f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d7784c52d9acbc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/3756430241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6801a070 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/3756430241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fdb68003b70 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5c026040 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/3756430241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdb68025050 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb79fae740 10 client.7701 fetch_fsmap learned FSMap version 81 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.157+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55630541a2f0 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/3756430241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c026040 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/3756430241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fdb68028020 con 0x556305420220 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb79fae740 10 client.7701 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb79fae740 10 client.7701 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-05-10T08:48:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb79fae740 20 client.7701 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb79fae740 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5563053feed0 0x55630549b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb79fae740 4 client.7701 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x556305343770 con 0x5563053feed0 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb74f52640 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5563053feed0 0x55630549b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb74f52640 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5563053feed0 0x55630549b260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e76e112238bf4f0 server_cookie=32a02566956f3c1 in_seq=0 out_seq=0 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.158+0000 7fdb4f7fe640 10 client.7701 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb4f7fe640 1 -- 172.21.15.37:0/3756430241 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556305343770 con 0x5563053feed0 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb4f7fe640 10 client.7701 handle_command_reply: tid=0 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 client.7701 shutdown 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305420220 msgr2=0x5563053f0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305420220 0x5563053f0780 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fdb68014a90 tx=0x7fdb68014f50 comp rx=0 tx=0).stop 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 shutdown_connections 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5563053feed0 0x55630549b260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb4f7fe640 0 client.7701 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556305420220 0x5563053f0780 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556305403340 0x5563053f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 --2- 172.21.15.37:0/3756430241 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5563053f0ed0 0x55630549aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 >> 172.21.15.37:0/3756430241 conn(0x556305402c00 msgr2=0x5563053cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 shutdown_connections 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 1 -- 172.21.15.37:0/3756430241 wait complete. 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.159+0000 7fdb79fae740 20 client.7701 trim_cache size 0 max 16384 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:48:03.166 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "f418d862-ec05-4611-8b38-0d09d63acb48", 2024-05-10T08:48:03.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:48:03.167 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:48:03.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb540762d0 msgr2=0x7fdb54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb540762d0 0x7fdb54078790 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdb700cd560 tx=0x7fdb5c008040 comp rx=0 tx=0).stop 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb700d3480 msgr2=0x7fdb70160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb700d3480 0x7fdb70160370 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fdb6402a2b0 tx=0x7fdb640046c0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 shutdown_connections 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdb540762d0 0x7fdb54078790 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdb70162b70 0x7fdb7015e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700d3910 0x7fdb700cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 --2- 172.21.15.37:0/3236815321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb700d3480 0x7fdb70160370 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 >> 172.21.15.37:0/3236815321 conn(0x7fdb700d5040 msgr2=0x7fdb70161d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 shutdown_connections 2024-05-10T08:48:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.160+0000 7fdb771b6640 1 -- 172.21.15.37:0/3236815321 wait complete. 2024-05-10T08:48:03.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:03.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T08:48:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.278+0000 7ff12816a640 1 Processor -- start 2024-05-10T08:48:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.278+0000 7ff12816a640 1 -- start start 2024-05-10T08:48:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.279+0000 7ff12816a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 0x7ff120166970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.279+0000 7ff12816a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12015c920 con 0x7ff12006e0f0 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.279+0000 7ff12816a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12015cc00 con 0x7ff120072840 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.279+0000 7ff12816a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff12015cee0 con 0x7ff12015c340 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.279+0000 7ff125f06640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff12006e0f0 0x7ff1200d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48306/0 (socket says 172.21.15.37:48306) 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.279+0000 7ff125f06640 1 -- 172.21.15.37:0/4114451805 learned_addr learned my addr 172.21.15.37:0/4114451805 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff126707640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 0x7ff120166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554427807 0 0) 0x7ff12015c920 con 0x7ff12006e0f0 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff10c003520 con 0x7ff12006e0f0 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2992374933 0 0) 0x7ff10c003520 con 0x7ff12006e0f0 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 msgr2=0x7ff120166970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 0x7ff120166970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 >> v1:172.21.15.82:6789/0 conn(0x7ff120072840 legacy=0x7ff12006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12015d1c0 con 0x7ff12006e0f0 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7ff11c001670 con 0x7ff12006e0f0 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff126707640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 0x7ff120166970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 >> v1:172.21.15.37:6789/0 conn(0x7ff12006e0f0 legacy=0x7ff1200d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 0x7ff10c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c003f20 0x7ff10c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c004d40 0x7ff10c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff12015cee0 con 0x7ff10c003f20 2024-05-10T08:48:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c00bad0 con 0x7ff10c004d40 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c00bcd0 con 0x7ff12015c340 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff125705640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c003f20 0x7ff10c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff126707640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c004d40 0x7ff10c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff125f06640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 0x7ff10c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff125705640 1 -- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 msgr2=0x7ff10c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff125705640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff12015c340 0x7ff10c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff125705640 1 -- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c004d40 msgr2=0x7ff10c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff125705640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff10c004d40 0x7ff10c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.280+0000 7ff125705640 1 -- 172.21.15.37:0/4114451805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c003520 con 0x7ff10c003f20 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.281+0000 7ff125705640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c003f20 0x7ff10c004800 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff110001830 tx=0x7ff10c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7bf3bc878e8d95 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.281+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110037070 con 0x7ff10c003f20 2024-05-10T08:48:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.281+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11002abe0 con 0x7ff10c003f20 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.281+0000 7ff124f04640 1 -- 172.21.15.37:0/4114451805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110001430 con 0x7ff10c003f20 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.282+0000 7ff12816a640 1 -- 172.21.15.37:0/4114451805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c003f20 msgr2=0x7ff10c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.282+0000 7ff12816a640 1 --2- 172.21.15.37:0/4114451805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c003f20 0x7ff10c004800 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff110001830 tx=0x7ff10c005830 comp rx=0 tx=0).stop 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.282+0000 7ff126707640 1 -- 172.21.15.37:0/4114451805 reap_dead start 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.282+0000 7ff12816a640 1 -- 172.21.15.37:0/4114451805 shutdown_connections 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.282+0000 7ff12816a640 1 -- 172.21.15.37:0/4114451805 >> 172.21.15.37:0/4114451805 conn(0x7ff12006c3a0 msgr2=0x7ff12006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.282+0000 7ff12816a640 1 -- 172.21.15.37:0/4114451805 shutdown_connections 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.282+0000 7ff12816a640 1 -- 172.21.15.37:0/4114451805 wait complete. 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.283+0000 7ff12816a640 1 Processor -- start 2024-05-10T08:48:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.283+0000 7ff12816a640 1 -- start start 2024-05-10T08:48:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff12816a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003f20 0x7ff12014d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff12816a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1200ce680 0x7ff1201f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff12816a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120150a10 0x7ff12014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff12816a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff120153230 con 0x7ff1200ce680 2024-05-10T08:48:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff12816a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201530b0 con 0x7ff120150a10 2024-05-10T08:48:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff12816a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff120164960 con 0x7ff10c003f20 2024-05-10T08:48:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1200ce680 0x7ff1201f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1200ce680 0x7ff1201f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38226/0 (socket says 172.21.15.37:38226) 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 -- 172.21.15.37:0/4236780444 learned_addr learned my addr 172.21.15.37:0/4236780444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff126707640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120150a10 0x7ff12014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125f06640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003f20 0x7ff12014d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 -- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003f20 msgr2=0x7ff12014d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003f20 0x7ff12014d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 -- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120150a10 msgr2=0x7ff12014eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120150a10 0x7ff12014eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 -- 172.21.15.37:0/4236780444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff120151520 con 0x7ff1200ce680 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.284+0000 7ff125705640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1200ce680 0x7ff1201f2d50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff11002a670 tx=0x7ff110001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.285+0000 7ff1167fc640 1 -- 172.21.15.37:0/4236780444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11003f020 con 0x7ff1200ce680 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.285+0000 7ff1167fc640 1 -- 172.21.15.37:0/4236780444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff110005270 con 0x7ff1200ce680 2024-05-10T08:48:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.285+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff120151240 con 0x7ff1200ce680 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.285+0000 7ff1167fc640 1 -- 172.21.15.37:0/4236780444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110037040 con 0x7ff1200ce680 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.285+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1200cf0e0 con 0x7ff1200ce680 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.287+0000 7ff1167fc640 1 -- 172.21.15.37:0/4236780444 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff110042020 con 0x7ff1200ce680 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.287+0000 7ff1167fc640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff1040762d0 0x7ff104078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.287+0000 7ff1167fc640 1 -- 172.21.15.37:0/4236780444 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7ff1100b73c0 con 0x7ff1200ce680 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.287+0000 7ff125f06640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff1040762d0 0x7ff104078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.288+0000 7ff125f06640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff1040762d0 0x7ff104078790 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff1200d1020 tx=0x7ff11c000ef0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.288+0000 7ff12ae82740 1 Processor -- start 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.288+0000 7ff12ae82740 1 -- start start 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa6c450 0x55aa0aa70250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa44160 0x55aa0aa6c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa6f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff12ae82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aa0aa0c690 con 0x55aa0aa6cd70 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa0a9a9f30 con 0x55aa0aa44160 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55aa0a962b20 con 0x55aa0aa6c450 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa6f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa6f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38228/0 (socket says 172.21.15.37:38228) 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 -- 172.21.15.37:0/1862345937 learned_addr learned my addr 172.21.15.37:0/1862345937 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff125705640 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa44160 0x55aa0aa6c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff125f06640 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa6c450 0x55aa0aa70250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 -- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa6c450 msgr2=0x55aa0aa70250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa6c450 0x55aa0aa70250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 -- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa44160 msgr2=0x55aa0aa6c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa44160 0x55aa0aa6c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 -- 172.21.15.37:0/1862345937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa0a95ae60 con 0x55aa0aa6cd70 2024-05-10T08:48:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff126707640 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa6f600 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff1200744e0 tx=0x7ff118009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d839fb462c5b242a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff1037fe640 1 -- 172.21.15.37:0/1862345937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118003da0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff1037fe640 1 -- 172.21.15.37:0/1862345937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11801e070 con 0x55aa0aa6cd70 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.289+0000 7ff1037fe640 1 -- 172.21.15.37:0/1862345937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118004270 con 0x55aa0aa6cd70 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 -- 172.21.15.37:0/1862345937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 msgr2=0x55aa0aa6f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa6f600 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff1200744e0 tx=0x7ff118009750 comp rx=0 tx=0).stop 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 -- 172.21.15.37:0/1862345937 shutdown_connections 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa6f600 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa44160 0x55aa0aa6c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1862345937 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa6c450 0x55aa0aa70250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 -- 172.21.15.37:0/1862345937 >> 172.21.15.37:0/1862345937 conn(0x55aa0aa41d60 msgr2=0x55aa0aa8a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 -- 172.21.15.37:0/1862345937 shutdown_connections 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.290+0000 7ff12ae82740 1 -- 172.21.15.37:0/1862345937 wait complete. 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.291+0000 7ff12ae82740 1 -- start start 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.291+0000 7ff12ae82740 1 Processor -- start 2024-05-10T08:48:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa61130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa6a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff12ae82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aa0a9665e0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa0a9a5ef0 con 0x55aa0aa6c450 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55aa0aa400b0 con 0x55aa0aa609f0 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff12ae82740 10 client.0 _ll_register_callbacks cb 0x55aa0a961320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38230/0 (socket says 172.21.15.37:38230) 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 -- 172.21.15.37:0/974608637 learned_addr learned my addr 172.21.15.37:0/974608637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff126707640 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa6a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125f06640 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa61130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 -- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 msgr2=0x55aa0aa6a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa6a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 -- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 msgr2=0x55aa0aa61130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa61130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 -- 172.21.15.37:0/974608637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa0a7857d0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff125705640 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa604b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff11007c5b0 tx=0x7ff110080ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6cd080a628102a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff100ff9640 1 -- 172.21.15.37:0/974608637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110080530 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.292+0000 7ff100ff9640 1 -- 172.21.15.37:0/974608637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7ff110087b20 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff11801e070 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff100ff9640 1 -- 172.21.15.37:0/974608637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff110084830 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 10 client.7713 fetch_fsmap learned FSMap version 81 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55aa0a6bb3f0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff100ff9640 1 -- 172.21.15.37:0/974608637 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11801e070 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff100ff9640 1 -- 172.21.15.37:0/974608637 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7ff110099be0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 10 client.7713 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:48:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 10 client.7713 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 20 client.7713 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa6ad50 0x55aa0aaac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 4 client.7713 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa0a9b7b40 con 0x55aa0aa6ad50 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.293+0000 7ff125f06640 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa6ad50 0x55aa0aaac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff125f06640 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa6ad50 0x55aa0aaac390 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f9ced0fd0ae157b server_cookie=8667a564639a5050 in_seq=0 out_seq=0 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff100ff9640 10 client.7713 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff100ff9640 1 -- 172.21.15.37:0/974608637 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa0a9b7b40 con 0x55aa0aa6ad50 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff100ff9640 10 client.7713 handle_command_reply: tid=0 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 client.7713 shutdown 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 msgr2=0x55aa0aa604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa604b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff11007c5b0 tx=0x7ff110080ad0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 shutdown_connections 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa6a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa6ad50 0x55aa0aaac390 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa604b0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 --2- 172.21.15.37:0/974608637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa61130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff100ff9640 0 client.7713 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.294+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 >> 172.21.15.37:0/974608637 conn(0x55aa0aa44160 msgr2=0x55aa0aa40b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.295+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 shutdown_connections 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.295+0000 7ff12ae82740 1 -- 172.21.15.37:0/974608637 wait complete. 2024-05-10T08:48:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.295+0000 7ff12ae82740 20 client.7713 trim_cache size 0 max 16384 2024-05-10T08:48:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.313+0000 7ff12ae82740 1 Processor -- start 2024-05-10T08:48:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.313+0000 7ff12ae82740 1 -- start start 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa40b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa66820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa66d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff12ae82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201fe150 con 0x55aa0aa6cd70 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201fd300 con 0x55aa0aa6c450 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff12015e910 con 0x55aa0aa609f0 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa66d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa66d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38240/0 (socket says 172.21.15.37:38240) 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 -- 172.21.15.37:0/1327990922 learned_addr learned my addr 172.21.15.37:0/1327990922 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff125f06640 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa40b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff125705640 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa66820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 -- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 msgr2=0x55aa0aa40b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa40b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 -- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 msgr2=0x55aa0aa66820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa66820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 -- 172.21.15.37:0/1327990922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa0a67b0f0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff125f06640 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa40b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.314+0000 7ff126707640 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa66d60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff118009790 tx=0x7ff118019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dbe4004d3de9c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff102ffd640 1 -- 172.21.15.37:0/1327990922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1180234c0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff102ffd640 1 -- 172.21.15.37:0/1327990922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11801e040 con 0x55aa0aa6cd70 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff102ffd640 1 -- 172.21.15.37:0/1327990922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118023880 con 0x55aa0aa6cd70 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 -- 172.21.15.37:0/1327990922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 msgr2=0x55aa0aa66d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa66d60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff118009790 tx=0x7ff118019000 comp rx=0 tx=0).stop 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 -- 172.21.15.37:0/1327990922 shutdown_connections 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa66d60 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0aa66820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 --2- 172.21.15.37:0/1327990922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa40b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 -- 172.21.15.37:0/1327990922 >> 172.21.15.37:0/1327990922 conn(0x55aa0aa44160 msgr2=0x55aa0aa45120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 -- 172.21.15.37:0/1327990922 shutdown_connections 2024-05-10T08:48:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.315+0000 7ff12ae82740 1 -- 172.21.15.37:0/1327990922 wait complete. 2024-05-10T08:48:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.316+0000 7ff12ae82740 1 -- start start 2024-05-10T08:48:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.316+0000 7ff12ae82740 1 Processor -- start 2024-05-10T08:48:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa72920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0ab0b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa44540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aa0aa43520 con 0x55aa0aa6cd70 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff12015ef60 con 0x55aa0aa6c450 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55aa0a9ac440 con 0x55aa0aa609f0 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 10 client.0 _ll_register_callbacks cb 0x7ff11007c4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa44540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa44540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38254/0 (socket says 172.21.15.37:38254) 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 -- 172.21.15.37:0/2053546930 learned_addr learned my addr 172.21.15.37:0/2053546930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff125705640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0ab0b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 -- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 msgr2=0x55aa0aa72920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff125f06640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa72920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa72920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 -- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 msgr2=0x55aa0ab0b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0ab0b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 -- 172.21.15.37:0/2053546930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa0aa3f470 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff125705640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0ab0b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff126707640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa44540 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff118000f80 tx=0x7ff118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5342dac9477406c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff100ff9640 1 -- 172.21.15.37:0/2053546930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11803b060 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff100ff9640 1 -- 172.21.15.37:0/2053546930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7ff118023df0 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.317+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff11801e040 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff100ff9640 1 -- 172.21.15.37:0/2053546930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff118041050 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 10 client.7719 fetch_fsmap learned FSMap version 81 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55aa0aa6d860 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff100ff9640 1 -- 172.21.15.37:0/2053546930 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11801e040 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff100ff9640 1 -- 172.21.15.37:0/2053546930 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7ff118044020 con 0x55aa0aa6cd70 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 10 client.7719 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:48:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 10 client.7719 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 20 client.7719 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa44a80 0x55aa0aa687c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 4 client.7719 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aa0a9b19b0 con 0x55aa0aa44a80 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff125f06640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa44a80 0x55aa0aa687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff125f06640 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa44a80 0x55aa0aa687c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d21872493db6c6b server_cookie=4387d8750909bcb0 in_seq=0 out_seq=0 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.318+0000 7ff100ff9640 10 client.7719 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff100ff9640 1 -- 172.21.15.37:0/2053546930 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55aa0a9b19b0 con 0x55aa0aa44a80 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff100ff9640 10 client.7719 handle_command_reply: tid=0 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 client.7719 shutdown 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 msgr2=0x55aa0aa44540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa44540 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff118000f80 tx=0x7ff118004a40 comp rx=0 tx=0).stop 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 shutdown_connections 2024-05-10T08:48:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x55aa0aa44a80 0x55aa0aa687c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa0aa6cd70 0x55aa0aa44540 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa0aa6c450 0x55aa0ab0b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff100ff9640 0 client.7719 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 --2- 172.21.15.37:0/2053546930 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55aa0aa609f0 0x55aa0aa72920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 >> 172.21.15.37:0/2053546930 conn(0x55aa0aa44160 msgr2=0x55aa0aa6a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 shutdown_connections 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 1 -- 172.21.15.37:0/2053546930 wait complete. 2024-05-10T08:48:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12ae82740 20 client.7719 trim_cache size 0 max 16384 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: "f418d862-ec05-4611-8b38-0d09d63acb48": { 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "f418d862-ec05-4611-8b38-0d09d63acb48", 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:48:03.326 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:48:03.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff1040762d0 msgr2=0x7ff104078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12816a640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff1040762d0 0x7ff104078790 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff1200d1020 tx=0x7ff11c000ef0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1200ce680 msgr2=0x7ff1201f2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:03.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.319+0000 7ff12816a640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1200ce680 0x7ff1201f2d50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff11002a670 tx=0x7ff110001230 comp rx=0 tx=0).stop 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 shutdown_connections 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ff1040762d0 0x7ff104078790 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff120150a10 0x7ff12014eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1200ce680 0x7ff1201f2d50 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 --2- 172.21.15.37:0/4236780444 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff10c003f20 0x7ff12014d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 >> 172.21.15.37:0/4236780444 conn(0x7ff12006c3a0 msgr2=0x7ff12006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 shutdown_connections 2024-05-10T08:48:03.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:03.320+0000 7ff12816a640 1 -- 172.21.15.37:0/4236780444 wait complete. 2024-05-10T08:48:03.329 INFO:tasks.cephfs.filesystem:scrub status for tag:f418d862-ec05-4611-8b38-0d09d63acb48 - {'path': '/', 'tag': 'f418d862-ec05-4611-8b38-0d09d63acb48', 'options': 'recursive,repair'} 2024-05-10T08:48:04.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:04.002+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 7 ==== log(8 entries from seq 1 at 2024-05-10T08:48:03.159958+0000) ==== 1779+0+0 (secure 0 0 0) 0x7f34fc0967b0 con 0x7f34ec004d40 2024-05-10T08:48:04.001 INFO:teuthology.orchestra.run.smithi037.stdout: cluster: 2024-05-10T08:48:04.001 INFO:teuthology.orchestra.run.smithi037.stdout: id: 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:48:04.001 INFO:teuthology.orchestra.run.smithi037.stdout: health: HEALTH_OK 2024-05-10T08:48:04.001 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: services: 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: mgr: x(active, since 7m), standbys: y 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: mds: 1/1 daemons up, 3 standby 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: osd: 8 osds: 8 up (since 7m), 8 in (since 8m) 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: data: 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: volumes: 1/1 healthy 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: pools: 3 pools, 97 pgs 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: objects: 26 objects, 6.6 MiB 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: usage: 267 MiB used, 720 GiB / 720 GiB avail 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: pgs: 97 active+clean 2024-05-10T08:48:04.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout: io: 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout: client: 85 B/s rd, 515 KiB/s wr, 0 op/s rd, 5 op/s wr 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:03.159958+0000 mds.b [INF] scrub queued for path: / 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:03.159961+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:03.159965+0000 mds.b [INF] scrub summary: active paths [/] 2024-05-10T08:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:03.161079+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-05-10T08:48:05.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:05.004+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 8 ==== log(2 entries from seq 904 at 2024-05-10T08:48:04.755637+0000) ==== 559+0+0 (secure 0 0 0) 0x7f34fc0980d0 con 0x7f34ec004d40 2024-05-10T08:48:06.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:06.759+0000 7f35027fc640 1 -- 172.21.15.37:0/2021408821 <== mon.0 v2:172.21.15.37:3300/0 9 ==== log(1 entries from seq 5 at 2024-05-10T08:48:06.613796+0000) ==== 189+0+0 (secure 0 0 0) 0x7f34fc061630 con 0x7f34ec004d40 2024-05-10T08:48:06.758 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:06.613796+0000 mds.b [INF] scrub summary: idle 2024-05-10T08:48:24.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:48:24.398 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:48:33.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:33.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T08:48:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.450+0000 7f29e0d6a640 1 Processor -- start 2024-05-10T08:48:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.450+0000 7f29e0d6a640 1 -- start start 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29e0d6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29dc0aedf0 0x7f29dc0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29e0d6a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 0x7f29dc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29e0d6a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc09ff30 con 0x7f29dc06c3a0 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29e0d6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc15e360 con 0x7f29dc0aedf0 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29e0d6a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc15d750 con 0x7f29dc15d180 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29da59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f29dc06c3a0 0x7f29dc06c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44056/0 (socket says 172.21.15.37:44056) 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29da59c640 1 -- 172.21.15.37:0/2193179709 learned_addr learned my addr 172.21.15.37:0/2193179709 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29dad9d640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 0x7f29dc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2193179709 >> v2:172.21.15.82:3300/0 conn(0x7f29dc0aedf0 0x7f29dc0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897013907 0 0) 0x7f29dc09ff30 con 0x7f29dc06c3a0 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.451+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c8003520 con 0x7f29dc06c3a0 2024-05-10T08:48:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2872397391 0 0) 0x7f29c8003520 con 0x7f29dc06c3a0 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 msgr2=0x7f29dc0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 0x7f29dc0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 >> v2:172.21.15.82:3300/0 conn(0x7f29dc0aedf0 msgr2=0x7f29dc0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 --2- 172.21.15.37:0/2193179709 >> v2:172.21.15.82:3300/0 conn(0x7f29dc0aedf0 0x7f29dc0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc15da30 con 0x7f29dc06c3a0 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f29cc001670 con 0x7f29dc06c3a0 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 >> v1:172.21.15.37:6789/0 conn(0x7f29dc06c3a0 legacy=0x7f29dc06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 0x7f29c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29c8003f30 0x7f29c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8004d40 0x7f29c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc15e360 con 0x7f29c8003f30 2024-05-10T08:48:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc15d750 con 0x7f29c8004d40 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29c800b9c0 con 0x7f29dc15d180 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29c8003f30 0x7f29c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29dad9d640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8004d40 0x7f29c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29da59c640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 0x7f29c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d3fff640 1 -- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 msgr2=0x7f29c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29dc15d180 0x7f29c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d3fff640 1 -- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8004d40 msgr2=0x7f29c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c8004d40 0x7f29c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.452+0000 7f29d3fff640 1 -- 172.21.15.37:0/2193179709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c8003520 con 0x7f29c8003f30 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.453+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29c8003f30 0x7f29c8004800 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009ac0 tx=0x7f29c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe37bdfc0258b5be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.453+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4036070 con 0x7f29c8003f30 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.453+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c4031400 con 0x7f29c8003f30 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.453+0000 7f29d9d9b640 1 -- 172.21.15.37:0/2193179709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4009690 con 0x7f29c8003f30 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.454+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2193179709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29c8003f30 msgr2=0x7f29c8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.454+0000 7f29e0d6a640 1 --2- 172.21.15.37:0/2193179709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29c8003f30 0x7f29c8004800 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009ac0 tx=0x7f29c8005830 comp rx=0 tx=0).stop 2024-05-10T08:48:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.454+0000 7f29dad9d640 1 -- 172.21.15.37:0/2193179709 reap_dead start 2024-05-10T08:48:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.454+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2193179709 shutdown_connections 2024-05-10T08:48:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.454+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2193179709 >> 172.21.15.37:0/2193179709 conn(0x7f29dc0b3b10 msgr2=0x7f29dc0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.454+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2193179709 shutdown_connections 2024-05-10T08:48:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.454+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2193179709 wait complete. 2024-05-10T08:48:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.455+0000 7f29e0d6a640 1 Processor -- start 2024-05-10T08:48:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.455+0000 7f29e0d6a640 1 -- start start 2024-05-10T08:48:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29e0d6a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29c8003f30 0x7f29dc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29e0d6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29dc1f3b20 0x7f29dc0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29e0d6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc1549e0 0x7f29dc153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29e0d6a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0b6130 con 0x7f29dc1f3b20 2024-05-10T08:48:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29e0d6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc15dff0 con 0x7f29dc1549e0 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29e0d6a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc0b62b0 con 0x7f29c8003f30 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29dc1f3b20 0x7f29dc0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29dc1f3b20 0x7f29dc0b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36736/0 (socket says 172.21.15.37:36736) 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 -- 172.21.15.37:0/2923405922 learned_addr learned my addr 172.21.15.37:0/2923405922 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 -- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29c8003f30 msgr2=0x7f29dc0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29c8003f30 0x7f29dc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 -- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc1549e0 msgr2=0x7f29dc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc1549e0 0x7f29dc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.456+0000 7f29d3fff640 1 -- 172.21.15.37:0/2923405922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0b0af0 con 0x7f29dc1f3b20 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.457+0000 7f29d3fff640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29dc1f3b20 0x7f29dc0b1b90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f29c4000c00 tx=0x7f29c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.457+0000 7f29d2ffd640 1 -- 172.21.15.37:0/2923405922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4040020 con 0x7f29dc1f3b20 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.457+0000 7f29d2ffd640 1 -- 172.21.15.37:0/2923405922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c40039c0 con 0x7f29dc1f3b20 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.457+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc0b0dd0 con 0x7f29dc1f3b20 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.457+0000 7f29d2ffd640 1 -- 172.21.15.37:0/2923405922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4036040 con 0x7f29dc1f3b20 2024-05-10T08:48:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.457+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc0b1390 con 0x7f29dc1f3b20 2024-05-10T08:48:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.459+0000 7f29d2ffd640 1 -- 172.21.15.37:0/2923405922 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29c4043020 con 0x7f29dc1f3b20 2024-05-10T08:48:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.459+0000 7f29d2ffd640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29bc076300 0x7f29bc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.460+0000 7f29d2ffd640 1 -- 172.21.15.37:0/2923405922 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6159+0+0 (secure 0 0 0) 0x7f29c40b7860 con 0x7f29dc1f3b20 2024-05-10T08:48:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.460+0000 7f29da59c640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29bc076300 0x7f29bc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.460+0000 7f29e3a80740 1 Processor -- start 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.460+0000 7f29da59c640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29bc076300 0x7f29bc0787c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f29cc000f60 tx=0x7f29cc000ed0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.460+0000 7f29e3a80740 1 -- start start 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x563782579af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825a9b40 0x56378257e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29e3a80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563782546690 con 0x5637825c7160 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5637824e3f30 con 0x5637825aa280 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56378249cb20 con 0x5637825a9b40 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x563782579af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x563782579af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36752/0 (socket says 172.21.15.37:36752) 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 -- 172.21.15.37:0/3630386705 learned_addr learned my addr 172.21.15.37:0/3630386705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29d3fff640 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29dad9d640 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825a9b40 0x56378257e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 -- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825a9b40 msgr2=0x56378257e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825a9b40 0x56378257e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 -- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 msgr2=0x5637825a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.461+0000 7f29da59c640 1 -- 172.21.15.37:0/3630386705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563782494e60 con 0x5637825c7160 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.462+0000 7f29da59c640 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x563782579af0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f29cc001770 tx=0x7f29cc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a394756e411874b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.462+0000 7f29bbfff640 1 -- 172.21.15.37:0/3630386705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc004c70 con 0x5637825c7160 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.462+0000 7f29bbfff640 1 -- 172.21.15.37:0/3630386705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc004e10 con 0x5637825c7160 2024-05-10T08:48:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.462+0000 7f29bbfff640 1 -- 172.21.15.37:0/3630386705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc021650 con 0x5637825c7160 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.462+0000 7f29e3a80740 1 -- 172.21.15.37:0/3630386705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 msgr2=0x563782579af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.462+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x563782579af0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f29cc001770 tx=0x7f29cc007f90 comp rx=0 tx=0).stop 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 -- 172.21.15.37:0/3630386705 shutdown_connections 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825a9b40 0x56378257e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3630386705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x563782579af0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 -- 172.21.15.37:0/3630386705 >> 172.21.15.37:0/3630386705 conn(0x56378257bd60 msgr2=0x5637825c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 -- 172.21.15.37:0/3630386705 shutdown_connections 2024-05-10T08:48:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 -- 172.21.15.37:0/3630386705 wait complete. 2024-05-10T08:48:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 -- start start 2024-05-10T08:48:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.463+0000 7f29e3a80740 1 Processor -- start 2024-05-10T08:48:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c7160 0x5637825ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c5a20 0x5637825c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29e3a80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5637824a05e0 con 0x5637825c5a20 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5637824dfef0 con 0x5637825c7160 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56378257df10 con 0x5637825aa280 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29e3a80740 10 client.0 _ll_register_callbacks cb 0x56378249b320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c5a20 0x5637825c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c5a20 0x5637825c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36754/0 (socket says 172.21.15.37:36754) 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.464+0000 7f29dad9d640 1 -- 172.21.15.37:0/3510819642 learned_addr learned my addr 172.21.15.37:0/3510819642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29da59c640 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29d3fff640 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c7160 0x5637825ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29dad9d640 1 -- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 msgr2=0x5637825938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29dad9d640 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29dad9d640 1 -- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c7160 msgr2=0x5637825ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29dad9d640 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c7160 0x5637825ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29dad9d640 1 -- 172.21.15.37:0/3510819642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637822bf7d0 con 0x5637825c5a20 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29dad9d640 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c5a20 0x5637825c5ea0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06d400 tx=0x7f29d4014de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcb104b660aaeb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29b97fa640 1 -- 172.21.15.37:0/3510819642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4012cd0 con 0x5637825c5a20 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29b97fa640 1 -- 172.21.15.37:0/3510819642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6159+0+0 (secure 0 0 0) 0x7f29d401e420 con 0x5637825c5a20 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29cc004e10 con 0x5637825c5a20 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29b97fa640 1 -- 172.21.15.37:0/3510819642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f29d4012e70 con 0x5637825c5a20 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29e3a80740 10 client.7731 fetch_fsmap learned FSMap version 81 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.465+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x5637821f53f0 con 0x5637825c5a20 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29b97fa640 1 -- 172.21.15.37:0/3510819642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc004e10 con 0x5637825c5a20 2024-05-10T08:48:33.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29b97fa640 1 -- 172.21.15.37:0/3510819642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7f29d402b080 con 0x5637825c5a20 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29e3a80740 10 client.7731 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29e3a80740 10 client.7731 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29e3a80740 20 client.7731 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825bc580 0x5637825bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29e3a80740 4 client.7731 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637824f1b40 con 0x5637825bc580 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29da59c640 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825bc580 0x5637825bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29da59c640 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825bc580 0x5637825bc990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be33d8bd82e86f91 server_cookie=13ae3aa0585d69bc in_seq=0 out_seq=0 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.466+0000 7f29b97fa640 10 client.7731 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29b97fa640 1 -- 172.21.15.37:0/3510819642 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5637824f1b40 con 0x5637825bc580 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29b97fa640 10 client.7731 handle_command_reply: tid=0 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 client.7731 shutdown 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c5a20 msgr2=0x5637825c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c5a20 0x5637825c5ea0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06d400 tx=0x7f29d4014de0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 shutdown_connections 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825bc580 0x5637825bc990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c5a20 0x5637825c5ea0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c7160 0x5637825ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29b97fa640 0 client.7731 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 --2- 172.21.15.37:0/3510819642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 >> 172.21.15.37:0/3510819642 conn(0x5637825a9b40 msgr2=0x563782579230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.467+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 shutdown_connections 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.468+0000 7f29e3a80740 1 -- 172.21.15.37:0/3510819642 wait complete. 2024-05-10T08:48:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.468+0000 7f29e3a80740 20 client.7731 trim_cache size 0 max 16384 2024-05-10T08:48:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.486+0000 7f29e3a80740 1 Processor -- start 2024-05-10T08:48:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.486+0000 7f29e3a80740 1 -- start start 2024-05-10T08:48:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825c5a20 0x5637825c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29e3a80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc200440 con 0x5637825c7160 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1ff480 con 0x5637825aa280 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc1fe890 con 0x5637825c5a20 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36764/0 (socket says 172.21.15.37:36764) 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 -- 172.21.15.37:0/967232367 learned_addr learned my addr 172.21.15.37:0/967232367 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29da59c640 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29d3fff640 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825c5a20 0x5637825c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 -- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825c5a20 msgr2=0x5637825c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825c5a20 0x5637825c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 -- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 msgr2=0x5637825c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 -- 172.21.15.37:0/967232367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637821b50f0 con 0x5637825c7160 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29d3fff640 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825c5a20 0x5637825c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29da59c640 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29dad9d640 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c7a20 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f29d4013010 tx=0x7f29d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6051985b99016b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29bb7fe640 1 -- 172.21.15.37:0/967232367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4012cd0 con 0x5637825c7160 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29bb7fe640 1 -- 172.21.15.37:0/967232367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d401ea40 con 0x5637825c7160 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.487+0000 7f29bb7fe640 1 -- 172.21.15.37:0/967232367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d401ee30 con 0x5637825c7160 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 -- 172.21.15.37:0/967232367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 msgr2=0x5637825c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c7a20 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f29d4013010 tx=0x7f29d4019000 comp rx=0 tx=0).stop 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 -- 172.21.15.37:0/967232367 shutdown_connections 2024-05-10T08:48:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c7a20 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825c5a20 0x5637825c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 --2- 172.21.15.37:0/967232367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825aa280 0x5637825c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 -- 172.21.15.37:0/967232367 >> 172.21.15.37:0/967232367 conn(0x5637825a9b40 msgr2=0x563782593700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 -- 172.21.15.37:0/967232367 shutdown_connections 2024-05-10T08:48:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.488+0000 7f29e3a80740 1 -- 172.21.15.37:0/967232367 wait complete. 2024-05-10T08:48:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.489+0000 7f29e3a80740 1 -- start start 2024-05-10T08:48:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.489+0000 7f29e3a80740 1 Processor -- start 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825a4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c5a20 0x5637825ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1fee30 con 0x5637825c7160 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56378257f9d0 con 0x5637825c5a20 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5637825a4fb0 con 0x5637825aa280 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 10 client.0 _ll_register_callbacks cb 0x7f29d40092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36774/0 (socket says 172.21.15.37:36774) 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 -- 172.21.15.37:0/54326696 learned_addr learned my addr 172.21.15.37:0/54326696 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29da59c640 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29d3fff640 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c5a20 0x5637825ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 -- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 msgr2=0x5637825a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 -- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c5a20 msgr2=0x5637825ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c5a20 0x5637825ba870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 -- 172.21.15.37:0/54326696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637825c7c10 con 0x5637825c7160 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29dad9d640 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c45f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f29d401ea10 tx=0x7f29d4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b530c980d73a0956 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29b97fa640 1 -- 172.21.15.37:0/54326696 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d401ee00 con 0x5637825c7160 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29b97fa640 1 -- 172.21.15.37:0/54326696 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6159+0+0 (secure 0 0 0) 0x7f29d403b440 con 0x5637825c7160 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.490+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29d401ea40 con 0x5637825c7160 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29b97fa640 1 -- 172.21.15.37:0/54326696 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f29d4049050 con 0x5637825c7160 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 10 client.7737 fetch_fsmap learned FSMap version 81 2024-05-10T08:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x5637825c3280 con 0x5637825c7160 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29b97fa640 1 -- 172.21.15.37:0/54326696 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d401ea40 con 0x5637825c7160 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29b97fa640 1 -- 172.21.15.37:0/54326696 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7f29d404c020 con 0x5637825c7160 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 10 client.7737 fetch_fsmap finished waiting for FSMap version 81 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 10 client.7737 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 20 client.7737 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825a65b0 0x5637825c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 4 client.7737 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 --> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5637824eb9b0 con 0x5637825a65b0 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.491+0000 7f29da59c640 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825a65b0 0x5637825c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29da59c640 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825a65b0 0x5637825c4b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e19f0f889cf11086 server_cookie=5609c81a603ac603 in_seq=0 out_seq=0 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29b97fa640 10 client.7737 ms_handle_connect on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29b97fa640 1 -- 172.21.15.37:0/54326696 <== mds.0 v2:172.21.15.82:6835/902568070 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5637824eb9b0 con 0x5637825a65b0 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29b97fa640 10 client.7737 handle_command_reply: tid=0 2024-05-10T08:48:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 client.7737 shutdown 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 msgr2=0x5637825c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c45f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f29d401ea10 tx=0x7f29d4004ab0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 shutdown_connections 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:6835/902568070,v1:172.21.15.82:6837/902568070] conn(0x5637825a65b0 0x5637825c4b30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637825c7160 0x5637825c45f0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637825c5a20 0x5637825ba870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29b97fa640 0 client.7737 ms_handle_reset on v2:172.21.15.82:6835/902568070 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 --2- 172.21.15.37:0/54326696 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5637825aa280 0x5637825a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 >> 172.21.15.37:0/54326696 conn(0x5637825a9b40 msgr2=0x563782579bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 shutdown_connections 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 1 -- 172.21.15.37:0/54326696 wait complete. 2024-05-10T08:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.492+0000 7f29e3a80740 20 client.7737 trim_cache size 0 max 16384 2024-05-10T08:48:33.498 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:48:33.498 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:48:33.498 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:48:33.498 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29bc076300 msgr2=0x7f29bc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29bc076300 0x7f29bc0787c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f29cc000f60 tx=0x7f29cc000ed0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29dc1f3b20 msgr2=0x7f29dc0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29dc1f3b20 0x7f29dc0b1b90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f29c4000c00 tx=0x7f29c4004730 comp rx=0 tx=0).stop 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 shutdown_connections 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f29bc076300 0x7f29bc0787c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29dc1549e0 0x7f29dc153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29dc1f3b20 0x7f29dc0b1b90 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 --2- 172.21.15.37:0/2923405922 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29c8003f30 0x7f29dc0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 >> 172.21.15.37:0/2923405922 conn(0x7f29dc0b3b10 msgr2=0x7f29dc15e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 shutdown_connections 2024-05-10T08:48:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.493+0000 7f29e0d6a640 1 -- 172.21.15.37:0/2923405922 wait complete. 2024-05-10T08:48:33.503 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:48:33.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:48:33.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.710+0000 7f15509af640 1 Processor -- start 2024-05-10T08:48:33.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.710+0000 7f15509af640 1 -- start start 2024-05-10T08:48:33.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.711+0000 7f15509af640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f154c072840 0x7f154c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.711+0000 7f15509af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154c15c920 con 0x7f154c06e0f0 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.711+0000 7f15509af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154c15cc00 con 0x7f154c06e4d0 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.711+0000 7f15509af640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f154c15cee0 con 0x7f154c072840 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.711+0000 7f1549d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f154c072840 0x7f154c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.711+0000 7f154a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f154c06e0f0 0x7f154c0d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44062/0 (socket says 172.21.15.37:44062) 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.711+0000 7f154a59c640 1 -- 172.21.15.37:0/2958522934 learned_addr learned my addr 172.21.15.37:0/2958522934 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.712+0000 7f1549d9b640 1 -- 172.21.15.37:0/2958522934 >> v1:172.21.15.82:6789/0 conn(0x7f154c06e4d0 legacy=0x7f154c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.712+0000 7f1549d9b640 1 -- 172.21.15.37:0/2958522934 >> v1:172.21.15.37:6789/0 conn(0x7f154c06e0f0 legacy=0x7f154c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.712+0000 7f1549d9b640 1 -- 172.21.15.37:0/2958522934 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c15d1c0 con 0x7f154c072840 2024-05-10T08:48:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.712+0000 7f154959a640 1 -- 172.21.15.37:0/2958522934 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461525530 0 0) 0x7f154c15c920 con 0x7f154c06e0f0 2024-05-10T08:48:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.712+0000 7f1549d9b640 1 --2- 172.21.15.37:0/2958522934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c072840 0x7f154c15c340 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f15400097a0 tx=0x7f154002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cdeade60b93e14 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f154959a640 1 -- 172.21.15.37:0/2958522934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540037070 con 0x7f154c072840 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f154959a640 1 -- 172.21.15.37:0/2958522934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1540032440 con 0x7f154c072840 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f154959a640 1 -- 172.21.15.37:0/2958522934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540032810 con 0x7f154c072840 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f15509af640 1 -- 172.21.15.37:0/2958522934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c072840 msgr2=0x7f154c15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f15509af640 1 --2- 172.21.15.37:0/2958522934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c072840 0x7f154c15c340 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f15400097a0 tx=0x7f154002a1e0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f15509af640 1 -- 172.21.15.37:0/2958522934 shutdown_connections 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f15509af640 1 --2- 172.21.15.37:0/2958522934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c072840 0x7f154c15c340 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f15509af640 1 -- 172.21.15.37:0/2958522934 >> 172.21.15.37:0/2958522934 conn(0x7f154c06c3a0 msgr2=0x7f154c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f15509af640 1 -- 172.21.15.37:0/2958522934 shutdown_connections 2024-05-10T08:48:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.713+0000 7f15509af640 1 -- 172.21.15.37:0/2958522934 wait complete. 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 Processor -- start 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 -- start start 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e0f0 0x7f154c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154c06e4d0 0x7f154c155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f154c072840 0x7f154c13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f154c0ae7d0 con 0x7f154c06e0f0 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f154c0ae650 con 0x7f154c072840 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f15509af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f154c1530b0 con 0x7f154c06e4d0 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.715+0000 7f154a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e0f0 0x7f154c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e0f0 0x7f154c0b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36802/0 (socket says 172.21.15.37:36802) 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 -- 172.21.15.37:0/2092762774 learned_addr learned my addr 172.21.15.37:0/2092762774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f1549d9b640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154c06e4d0 0x7f154c155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154ad9d640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f154c072840 0x7f154c13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 -- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154c06e4d0 msgr2=0x7f154c155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154c06e4d0 0x7f154c155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 -- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f154c072840 msgr2=0x7f154c13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f154c072840 0x7f154c13fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 -- 172.21.15.37:0/2092762774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c154780 con 0x7f154c06e0f0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f154a59c640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e0f0 0x7f154c0b3ca0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c500 tx=0x7f153c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f153affd640 1 -- 172.21.15.37:0/2092762774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c018070 con 0x7f154c06e0f0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f153affd640 1 -- 172.21.15.37:0/2092762774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153c007580 con 0x7f154c06e0f0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c154a60 con 0x7f154c06e0f0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f153affd640 1 -- 172.21.15.37:0/2092762774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c004a20 con 0x7f154c06e0f0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.716+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c155020 con 0x7f154c06e0f0 2024-05-10T08:48:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.717+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154c0693f0 con 0x7f154c06e0f0 2024-05-10T08:48:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.718+0000 7f153affd640 1 -- 172.21.15.37:0/2092762774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f153c01b070 con 0x7f154c06e0f0 2024-05-10T08:48:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.718+0000 7f153affd640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f152c0762d0 0x7f152c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.718+0000 7f153affd640 1 -- 172.21.15.37:0/2092762774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6159+0+0 (secure 0 0 0) 0x7f153c096aa0 con 0x7f154c06e0f0 2024-05-10T08:48:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.718+0000 7f1549d9b640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f152c0762d0 0x7f152c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.719+0000 7f1549d9b640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f152c0762d0 0x7f152c078790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1540034000 tx=0x7f154002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.723+0000 7f153affd640 1 -- 172.21.15.37:0/2092762774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f153c0602d0 con 0x7f154c06e0f0 2024-05-10T08:48:33.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.952+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f154c0cd200 con 0x7f154c06e0f0 2024-05-10T08:48:33.951 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:48:33.953+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:48:33.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.954+0000 7f153affd640 1 -- 172.21.15.37:0/2092762774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) ==== 161+0+0 (secure 0 0 0) 0x7f153c05fbd0 con 0x7f154c06e0f0 2024-05-10T08:48:33.952 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f152c0762d0 msgr2=0x7f152c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f152c0762d0 0x7f152c078790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1540034000 tx=0x7f154002e000 comp rx=0 tx=0).stop 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e0f0 msgr2=0x7f154c0b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e0f0 0x7f154c0b3ca0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c500 tx=0x7f153c00c9c0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 shutdown_connections 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f152c0762d0 0x7f152c078790 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f154c072840 0x7f154c13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f154c06e4d0 0x7f154c155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 --2- 172.21.15.37:0/2092762774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e0f0 0x7f154c0b3ca0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.956+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 >> 172.21.15.37:0/2092762774 conn(0x7f154c06c3a0 msgr2=0x7f154c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.957+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 shutdown_connections 2024-05-10T08:48:33.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:33.957+0000 7f15509af640 1 -- 172.21.15.37:0/2092762774 wait complete. 2024-05-10T08:48:33.960 INFO:tasks.ceph.mds.b.smithi082.stderr: -7091> 2024-05-10T08:47:52.569+0000 7fb90a4bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:48:33.967 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-05-10T08:48:33.995 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:48:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.014+0000 7f27b7b20280 1 -- start start 2024-05-10T08:48:34.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.014+0000 7f27b7b20280 1 Processor -- start 2024-05-10T08:48:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c70410c00 0x561c711e8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c70411800 0x561c711e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c70411c00 0x561c711e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b7b20280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561c711ae180 con 0x561c70411c00 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b7b20280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c70472900 con 0x561c70411800 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b7b20280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x561c70472480 con 0x561c70410c00 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b600f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c70411c00 0x561c711e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b600f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c70411c00 0x561c711e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36816/0 (socket says 172.21.15.37:36816) 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b600f640 1 -- 172.21.15.37:0/1514545229 learned_addr learned my addr 172.21.15.37:0/1514545229 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b600f640 1 -- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c70410c00 msgr2=0x561c711e8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b500d640 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c70411800 0x561c711e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b580e640 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c70410c00 0x561c711e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.015+0000 7f27b600f640 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c70410c00 0x561c711e8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b600f640 1 -- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c70411800 msgr2=0x561c711e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b600f640 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c70411800 0x561c711e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b600f640 1 -- 172.21.15.37:0/1514545229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c70446780 con 0x561c70411c00 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b500d640 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c70411800 0x561c711e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b600f640 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c70411c00 0x561c711e8b00 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x561c712397d0 tx=0x561c711b2a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b5222d8ada8a37 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b3009640 1 -- 172.21.15.37:0/1514545229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561c70436680 con 0x561c70411c00 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b3009640 1 -- 172.21.15.37:0/1514545229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561c7043c700 con 0x561c70411c00 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b3009640 1 -- 172.21.15.37:0/1514545229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561c70436b60 con 0x561c70411c00 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b7b20280 1 -- 172.21.15.37:0/1514545229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c704474a0 con 0x561c70411c00 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b7b20280 1 -- 172.21.15.37:0/1514545229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561c70446000 con 0x561c70411c00 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b7b20280 4 waiting for MDS map... 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b3009640 1 -- 172.21.15.37:0/1514545229 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x561c712e4600 con 0x561c70411c00 2024-05-10T08:48:34.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b3009640 1 -- 172.21.15.37:0/1514545229 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 82) ==== 2885+0+0 (secure 0 0 0) 0x561c7046b180 con 0x561c70411c00 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b7b20280 4 Got MDS map 82 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b7b20280 10 main: JournalTool::main 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.016+0000 7f27b7b20280 4 main: JournalTool: connecting to RADOS... 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 Processor -- start 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 -- start start 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712eb400 0x561c711e9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb800 0x561c711e9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712ebc00 0x561c711e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561c70472180 con 0x561c712eb400 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c711aed80 con 0x561c712eb800 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.017+0000 7f27b7b20280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x561c711aef00 con 0x561c712ebc00 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712eb400 0x561c711e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712eb400 0x561c711e9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36832/0 (socket says 172.21.15.37:36832) 2024-05-10T08:48:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 -- 172.21.15.37:0/2537127728 learned_addr learned my addr 172.21.15.37:0/2537127728 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b580e640 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb800 0x561c711e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712ebc00 0x561c711e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 -- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712ebc00 msgr2=0x561c711e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712ebc00 0x561c711e9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 -- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb800 msgr2=0x561c711e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb800 0x561c711e9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 -- 172.21.15.37:0/2537127728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c704463c0 con 0x561c712eb400 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b500d640 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712eb400 0x561c711e9080 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x561c71300630 tx=0x561c711b1f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c203b07ffab223 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b1005640 1 -- 172.21.15.37:0/2537127728 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561c704369c0 con 0x561c712eb400 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b1005640 1 -- 172.21.15.37:0/2537127728 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561c7043cfc0 con 0x561c712eb400 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b1005640 1 -- 172.21.15.37:0/2537127728 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561c70436680 con 0x561c712eb400 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b7b20280 1 -- 172.21.15.37:0/2537127728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712eb400 msgr2=0x561c711e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.018+0000 7f27b7b20280 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712eb400 0x561c711e9080 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x561c71300630 tx=0x561c711b1f20 comp rx=0 tx=0).stop 2024-05-10T08:48:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 -- 172.21.15.37:0/2537127728 shutdown_connections 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712ebc00 0x561c711e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb800 0x561c711e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 --2- 172.21.15.37:0/2537127728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712eb400 0x561c711e9080 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 -- 172.21.15.37:0/2537127728 >> 172.21.15.37:0/2537127728 conn(0x561c712eb000 msgr2=0x561c7050b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 -- 172.21.15.37:0/2537127728 shutdown_connections 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 -- 172.21.15.37:0/2537127728 wait complete. 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 Processor -- start 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.019+0000 7f27b7b20280 1 -- start start 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb400 0x561c711e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712eb800 0x561c711e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712ebc00 0x561c711e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561c711af200 con 0x561c712ebc00 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c711af080 con 0x561c712eb400 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x561c711af380 con 0x561c712eb800 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712ebc00 0x561c711e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712ebc00 0x561c711e9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36836/0 (socket says 172.21.15.37:36836) 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 -- 172.21.15.37:0/3885526790 learned_addr learned my addr 172.21.15.37:0/3885526790 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b580e640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712eb800 0x561c711e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb400 0x561c711e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 -- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712eb800 msgr2=0x561c711e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c712eb800 0x561c711e9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 -- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb400 msgr2=0x561c711e9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c712eb400 0x561c711e9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 -- 172.21.15.37:0/3885526790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c70446780 con 0x561c712ebc00 2024-05-10T08:48:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b500d640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712ebc00 0x561c711e9b80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x561c71300960 tx=0x561c711b0660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27af802640 1 -- 172.21.15.37:0/3885526790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561c70436b60 con 0x561c712ebc00 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27af802640 1 -- 172.21.15.37:0/3885526790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561c7043ce00 con 0x561c712ebc00 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c704474a0 con 0x561c712ebc00 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27af802640 1 -- 172.21.15.37:0/3885526790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561c704364e0 con 0x561c712ebc00 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c70446960 con 0x561c712ebc00 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.020+0000 7f27b7b20280 4 main: JournalTool: resolving pool 15 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27af802640 1 -- 172.21.15.37:0/3885526790 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x561c71366c00 con 0x561c712ebc00 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27af802640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x561c707ae000 0x561c711ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27af802640 1 -- 172.21.15.37:0/3885526790 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x561c7121a600 con 0x561c712ebc00 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27b7b20280 4 main: JournalTool: creating IoCtx.. 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27b7b20280 4 main: Executing for rank 0 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27b7b20280 4 Filtering by inode '1099511627777' 2024-05-10T08:48:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27b7b20280 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x561c707ae400 0x561c711ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x561c707ae800 con 0x561c707ae400 2024-05-10T08:48:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27b580e640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x561c707ae000 0x561c711ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.022+0000 7f27b500d640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x561c707ae400 0x561c711ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.023+0000 7f27b580e640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x561c707ae000 0x561c711ea100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x561c7119ed80 tx=0x561c70734840 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.023+0000 7f27b500d640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x561c707ae400 0x561c711ea680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.023+0000 7f27b500d640 1 -- 172.21.15.37:0/3885526790 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x561c7051e000 con 0x561c707ae400 2024-05-10T08:48:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.023+0000 7f27b7b20280 4 Pointer 400.00000000 is readable 2024-05-10T08:48:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.023+0000 7f27b7b20280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-10T08:48:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.023+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x561c707aec00 con 0x561c707ae400 2024-05-10T08:48:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b500d640 1 -- 172.21.15.37:0/3885526790 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x561c7051e000 con 0x561c707ae400 2024-05-10T08:48:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 10 Header 0x400000 0x407d21 0x40809d 2024-05-10T08:48:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 10 Starting journal scan from offset 0x407d21 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x561c707af000 con 0x561c707ae400 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b500d640 1 -- 172.21.15.37:0/3885526790 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x561c7051e000 con 0x561c707ae400 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 10 Parsing data, 0x37c bytes available 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 10 Attempting decode at 0x407d21 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 10 Consumed 0x37c bytes 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 10 Valid entry at 0x407d21 2024-05-10T08:48:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x561c707af400 0x561c711eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x561c707be000 con 0x561c707af400 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.024+0000 7f27b600f640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x561c707af400 0x561c711eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b600f640 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x561c707af400 0x561c711eac00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b600f640 1 -- 172.21.15.37:0/3885526790 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561c7051e500 con 0x561c707af400 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 4 Reached end of journal objects 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 4 Scanned objects, 0 missing, 1 valid 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 4 Events scanned, 0 gaps 2024-05-10T08:48:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 4 Found 1 valid events 2024-05-10T08:48:34.034 INFO:teuthology.orchestra.run.smithi037.stdout:Events by type: 2024-05-10T08:48:34.034 INFO:teuthology.orchestra.run.smithi037.stdout:Errors: 0 2024-05-10T08:48:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 4 Selected 0 events events for processing 2024-05-10T08:48:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 4 0 events 2024-05-10T08:48:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x561c707ae400 msgr2=0x561c711ea680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x561c707ae400 0x561c711ea680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x561c707af400 msgr2=0x561c711eac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x561c707af400 0x561c711eac00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x561c707ae000 msgr2=0x561c711ea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x561c707ae000 0x561c711ea100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x561c7119ed80 tx=0x561c70734840 comp rx=0 tx=0).stop 2024-05-10T08:48:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712ebc00 msgr2=0x561c711e9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 --2- 172.21.15.37:0/3885526790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c712ebc00 0x561c711e9b80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x561c71300960 tx=0x561c711b0660 comp rx=0 tx=0).stop 2024-05-10T08:48:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b580e640 1 -- 172.21.15.37:0/3885526790 reap_dead start 2024-05-10T08:48:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b580e640 1 -- 172.21.15.37:0/3885526790 reap_dead start 2024-05-10T08:48:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 shutdown_connections 2024-05-10T08:48:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 >> 172.21.15.37:0/3885526790 conn(0x561c712eb000 msgr2=0x561c7050b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 shutdown_connections 2024-05-10T08:48:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.025+0000 7f27b7b20280 1 -- 172.21.15.37:0/3885526790 wait complete. 2024-05-10T08:48:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 -- 172.21.15.37:0/1514545229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c70411c00 msgr2=0x561c711e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c70411c00 0x561c711e8b00 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x561c712397d0 tx=0x561c711b2a80 comp rx=0 tx=0).stop 2024-05-10T08:48:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 -- 172.21.15.37:0/1514545229 shutdown_connections 2024-05-10T08:48:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c70411c00 0x561c711e8b00 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c70411800 0x561c711e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 --2- 172.21.15.37:0/1514545229 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x561c70410c00 0x561c711e8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 -- 172.21.15.37:0/1514545229 >> 172.21.15.37:0/1514545229 conn(0x561c70411000 msgr2=0x561c7050a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 -- 172.21.15.37:0/1514545229 shutdown_connections 2024-05-10T08:48:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.026+0000 7f27b7b20280 1 -- 172.21.15.37:0/1514545229 wait complete. 2024-05-10T08:48:34.042 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.075380, result: Events by type: Errors: 0 2024-05-10T08:48:34.043 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-05-10T08:48:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.088+0000 7fd0c1e0e280 1 -- start start 2024-05-10T08:48:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.088+0000 7fd0c1e0e280 1 Processor -- start 2024-05-10T08:48:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558148c12c00 0x5581499ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558148c13800 0x5581499ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558148c13c00 0x5581499eab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581499f4180 con 0x558148c13c00 2024-05-10T08:48:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5581499f4300 con 0x558148c12c00 2024-05-10T08:48:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5581499f4480 con 0x558148c13800 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558148c13c00 0x5581499eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558148c13c00 0x5581499eab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36854/0 (socket says 172.21.15.37:36854) 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 -- 172.21.15.37:0/1125669421 learned_addr learned my addr 172.21.15.37:0/1125669421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558148c12c00 0x5581499ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558148c13800 0x5581499ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 -- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558148c13800 msgr2=0x5581499ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558148c13800 0x5581499ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 -- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558148c12c00 msgr2=0x5581499ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558148c12c00 0x5581499ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0c00ab640 1 -- 172.21.15.37:0/1125669421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558148c48780 con 0x558148c13c00 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.089+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558148c13800 0x5581499ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0c00ab640 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558148c13c00 0x5581499eab00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x558149a3d590 tx=0x5581499b5020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a29bc8cab99f78 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0bd0a5640 1 -- 172.21.15.37:0/1125669421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558148c38680 con 0x558148c13c00 2024-05-10T08:48:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0bd0a5640 1 -- 172.21.15.37:0/1125669421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558148c3ea80 con 0x558148c13c00 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0bd0a5640 1 -- 172.21.15.37:0/1125669421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558148c38b60 con 0x558148c13c00 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/1125669421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558148c483c0 con 0x558148c13c00 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/1125669421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x558148c49680 con 0x558148c13c00 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0c1e0e280 4 waiting for MDS map... 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0bd0a5640 1 -- 172.21.15.37:0/1125669421 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x558149af2a00 con 0x558148c13c00 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0bd0a5640 1 -- 172.21.15.37:0/1125669421 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 82) ==== 2885+0+0 (secure 0 0 0) 0x558148c6d180 con 0x558148c13c00 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0c1e0e280 4 Got MDS map 82 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0c1e0e280 10 main: JournalTool::main 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.090+0000 7fd0c1e0e280 4 main: JournalTool: connecting to RADOS... 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 Processor -- start 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 -- start start 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7400 0x5581499eb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 0x5581499ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581499f4600 con 0x558149ae7800 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5581499f4780 con 0x558149ae7400 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5581499f4900 con 0x558149ae7c00 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0bf8aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0bf8aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36858/0 (socket says 172.21.15.37:36858) 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0bf8aa640 1 -- 172.21.15.37:0/61398408 learned_addr learned my addr 172.21.15.37:0/61398408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.091+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7400 0x5581499eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 0x5581499ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bf8aa640 1 -- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 msgr2=0x5581499ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 0x5581499ebb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bf8aa640 1 -- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7400 msgr2=0x5581499eb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7400 0x5581499eb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bf8aa640 1 -- 172.21.15.37:0/61398408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558148c494a0 con 0x558149ae7800 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7800 0x5581499eb600 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x558149b04ab0 tx=0x558149b09800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780f3b4d7fc1904c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bb0a1640 1 -- 172.21.15.37:0/61398408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558148c38680 con 0x558149ae7800 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bb0a1640 1 -- 172.21.15.37:0/61398408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558148c3efc0 con 0x558149ae7800 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0bb0a1640 1 -- 172.21.15.37:0/61398408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558148c38b60 con 0x558149ae7800 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/61398408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7800 msgr2=0x5581499eb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7800 0x5581499eb600 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x558149b04ab0 tx=0x558149b09800 comp rx=0 tx=0).stop 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/61398408 shutdown_connections 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 0x5581499ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.092+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/61398408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7400 0x5581499eb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.093+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/61398408 >> 172.21.15.37:0/61398408 conn(0x558149ae7000 msgr2=0x558148d0b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.093+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/61398408 shutdown_connections 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.093+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/61398408 wait complete. 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.093+0000 7fd0c1e0e280 1 Processor -- start 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.093+0000 7fd0c1e0e280 1 -- start start 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7400 0x5581499eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 0x5581499ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581499f5b00 con 0x558149ae7400 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5581499f5980 con 0x558149ae7800 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5581499f5800 con 0x558149ae7c00 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7400 0x5581499eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7400 0x5581499eb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36874/0 (socket says 172.21.15.37:36874) 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 -- 172.21.15.37:0/125958953 learned_addr learned my addr 172.21.15.37:0/125958953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 0x5581499ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 -- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 msgr2=0x5581499ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558149ae7c00 0x5581499ebb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 -- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7800 msgr2=0x5581499eb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 -- 172.21.15.37:0/125958953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558148c48780 con 0x558149ae7400 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558149ae7800 0x5581499eb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7400 0x5581499eb080 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x558149a3d050 tx=0x5581499b4c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0b989e640 1 -- 172.21.15.37:0/125958953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558148c389c0 con 0x558149ae7400 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0b989e640 1 -- 172.21.15.37:0/125958953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558148c3ee00 con 0x558149ae7400 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558148c483c0 con 0x558149ae7400 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0b989e640 1 -- 172.21.15.37:0/125958953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558148c38680 con 0x558149ae7400 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558148c49680 con 0x558149ae7400 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.094+0000 7fd0c1e0e280 4 main: JournalTool: resolving pool 15 2024-05-10T08:48:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0b989e640 1 -- 172.21.15.37:0/125958953 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x558149a22c00 con 0x558149ae7400 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0b989e640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558149a1ac00 0x5581499ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0b989e640 1 -- 172.21.15.37:0/125958953 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x558149a20c00 con 0x558149ae7400 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0c1e0e280 4 main: JournalTool: creating IoCtx.. 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0c1e0e280 4 main: Executing for rank 0 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0c1e0e280 4 Filtering by inode '1099511627778' 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558149a1b000 0x5581499ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558149a1b400 con 0x558149a1b000 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558149a1ac00 0x5581499ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.096+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558149a1b000 0x5581499ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0bf8aa640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558149a1ac00 0x5581499ec100 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x558149b04ab0 tx=0x5581499b4fc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0bf0a9640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558149a1b000 0x5581499ec680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0bf0a9640 1 -- 172.21.15.37:0/125958953 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x558148d20000 con 0x558149a1b000 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0c1e0e280 4 Pointer 400.00000000 is readable 2024-05-10T08:48:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0c1e0e280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558149a1b800 con 0x558149a1b000 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0bf0a9640 1 -- 172.21.15.37:0/125958953 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x558148d20000 con 0x558149a1b000 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0c1e0e280 10 Header 0x400000 0x407d21 0x40809d 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0c1e0e280 10 Starting journal scan from offset 0x407d21 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.097+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558149a1bc00 con 0x558149a1b000 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0bf0a9640 1 -- 172.21.15.37:0/125958953 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x558148d20000 con 0x558149a1b000 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 10 Parsing data, 0x37c bytes available 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 10 Attempting decode at 0x407d21 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 10 Consumed 0x37c bytes 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 10 Valid entry at 0x407d21 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558148f32000 0x5581499ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) -- 0x558148f32400 con 0x558148f32000 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c00ab640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558148f32000 0x5581499ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c00ab640 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558148f32000 0x5581499ecc00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c00ab640 1 -- 172.21.15.37:0/125958953 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x558148d20500 con 0x558148f32000 2024-05-10T08:48:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 4 Reached end of journal objects 2024-05-10T08:48:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 4 Scanned objects, 0 missing, 1 valid 2024-05-10T08:48:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 4 Events scanned, 0 gaps 2024-05-10T08:48:34.108 INFO:teuthology.orchestra.run.smithi037.stdout:Events by type: 2024-05-10T08:48:34.108 INFO:teuthology.orchestra.run.smithi037.stdout:Errors: 0 2024-05-10T08:48:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 4 Found 1 valid events 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 4 Selected 0 events events for processing 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 4 0 events 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558149a1b000 msgr2=0x5581499ec680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x558149a1b000 0x5581499ec680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558148f32000 msgr2=0x5581499ecc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.098+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x558148f32000 0x5581499ecc00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558149a1ac00 msgr2=0x5581499ec100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x558149a1ac00 0x5581499ec100 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x558149b04ab0 tx=0x5581499b4fc0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7400 msgr2=0x5581499eb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/125958953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558149ae7400 0x5581499eb080 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x558149a3d050 tx=0x5581499b4c60 comp rx=0 tx=0).stop 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0bf8aa640 1 -- 172.21.15.37:0/125958953 reap_dead start 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0bf8aa640 1 -- 172.21.15.37:0/125958953 reap_dead start 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 shutdown_connections 2024-05-10T08:48:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 >> 172.21.15.37:0/125958953 conn(0x558149ae7000 msgr2=0x558148d0b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 shutdown_connections 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/125958953 wait complete. 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/1125669421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558148c13c00 msgr2=0x5581499eab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558148c13c00 0x5581499eab00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x558149a3d590 tx=0x5581499b5020 comp rx=0 tx=0).stop 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/1125669421 shutdown_connections 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558148c13c00 0x5581499eab00 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x558148c13800 0x5581499ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 --2- 172.21.15.37:0/1125669421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558148c12c00 0x5581499ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/1125669421 >> 172.21.15.37:0/1125669421 conn(0x558148c13000 msgr2=0x558148d0b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/1125669421 shutdown_connections 2024-05-10T08:48:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.099+0000 7fd0c1e0e280 1 -- 172.21.15.37:0/1125669421 wait complete. 2024-05-10T08:48:34.112 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.069963, result: Events by type: Errors: 0 2024-05-10T08:48:34.113 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-05-10T08:48:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.159+0000 7fdd7e716f40 1 Processor -- start 2024-05-10T08:48:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.159+0000 7fdd7e716f40 1 -- start start 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7e716f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e47c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7e716f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64e502b0 0x555a64e4b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7e716f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64eda500 0x555a64edc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7e716f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555a64e35780 con 0x555a64eda500 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7e716f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555a64dadf50 con 0x555a64e35330 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7e716f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x555a64e4da00 con 0x555a64e502b0 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64eda500 0x555a64edc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64eda500 0x555a64edc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36882/0 (socket says 172.21.15.37:36882) 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 -- 172.21.15.37:0/2752939674 learned_addr learned my addr 172.21.15.37:0/2752939674 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7c210640 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e47c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 -- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64e502b0 msgr2=0x555a64e4b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64e502b0 0x555a64e4b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 -- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 msgr2=0x555a64e47c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e47c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7ca11640 1 -- 172.21.15.37:0/2752939674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a64e058a0 con 0x555a64eda500 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.160+0000 7fdd7c210640 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e47c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7ca11640 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64eda500 0x555a64edc2a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fdd740016e0 tx=0x7fdd74001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7313ea84750366 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7aa0d640 1 -- 172.21.15.37:0/2752939674 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd740062e0 con 0x555a64eda500 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7aa0d640 1 -- 172.21.15.37:0/2752939674 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd74003670 con 0x555a64eda500 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7aa0d640 1 -- 172.21.15.37:0/2752939674 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74003aa0 con 0x555a64eda500 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2752939674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64eda500 msgr2=0x555a64edc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64eda500 0x555a64edc2a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fdd740016e0 tx=0x7fdd74001ba0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2752939674 shutdown_connections 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64eda500 0x555a64edc2a0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64e502b0 0x555a64e4b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2752939674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e47c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2752939674 >> 172.21.15.37:0/2752939674 conn(0x555a64e05b30 msgr2=0x555a64e31eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2752939674 shutdown_connections 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.161+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2752939674 wait complete. 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.162+0000 7fdd7e716f40 1 Processor -- start 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.162+0000 7fdd7e716f40 1 -- start start 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7e716f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e2d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7e716f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64e502b0 0x555a64ec4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7e716f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64eda500 0x555a64ed7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7e716f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555a64e30f60 con 0x555a64e502b0 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7e716f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555a64edaaf0 con 0x555a64e35330 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7e716f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x555a64e31240 con 0x555a64eda500 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64e502b0 0x555a64ec4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64e502b0 0x555a64ec4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36896/0 (socket says 172.21.15.37:36896) 2024-05-10T08:48:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 -- 172.21.15.37:0/2243263989 learned_addr learned my addr 172.21.15.37:0/2243263989 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7c210640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e2d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ca11640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64eda500 0x555a64ed7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 -- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64eda500 msgr2=0x555a64ed7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555a64eda500 0x555a64ed7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 -- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 msgr2=0x555a64e2d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a64e35330 0x555a64e2d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 -- 172.21.15.37:0/2243263989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a64ed6380 con 0x555a64e502b0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7ba0f640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64e502b0 0x555a64ec4540 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fdd70057040 tx=0x7fdd70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd79a0b640 1 -- 172.21.15.37:0/2243263989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70059040 con 0x555a64e502b0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd79a0b640 1 -- 172.21.15.37:0/2243263989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd70054bb0 con 0x555a64e502b0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a64ed6660 con 0x555a64e502b0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.163+0000 7fdd79a0b640 1 -- 172.21.15.37:0/2243263989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7005f470 con 0x555a64e502b0 2024-05-10T08:48:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.164+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a64ed6c20 con 0x555a64e502b0 2024-05-10T08:48:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.165+0000 7fdd79a0b640 1 -- 172.21.15.37:0/2243263989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd7005f610 con 0x555a64e502b0 2024-05-10T08:48:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.165+0000 7fdd79a0b640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd68074ce0 0x7fdd680771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.166+0000 7fdd79a0b640 1 -- 172.21.15.37:0/2243263989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fdd700da750 con 0x555a64e502b0 2024-05-10T08:48:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.166+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x555a64ebbc40 0x555a64ed81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.166+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) -- 0x555a64e2d790 con 0x555a64ebbc40 2024-05-10T08:48:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.166+0000 7fdd7c210640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd68074ce0 0x7fdd680771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.166+0000 7fdd7ca11640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x555a64ebbc40 0x555a64ed81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.166+0000 7fdd7ca11640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x555a64ebbc40 0x555a64ed81c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.166+0000 7fdd7c210640 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd68074ce0 0x7fdd680771a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c005fd0 tx=0x7fdd6c00d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7ca11640 1 -- 172.21.15.37:0/2243263989 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v106'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fdd7401b040 con 0x555a64ebbc40 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x555a64ebbc40 msgr2=0x555a64ed81c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x555a64ebbc40 0x555a64ed81c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd68074ce0 msgr2=0x7fdd680771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd68074ce0 0x7fdd680771a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c005fd0 tx=0x7fdd6c00d040 comp rx=0 tx=0).stop 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64e502b0 msgr2=0x555a64ec4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 --2- 172.21.15.37:0/2243263989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555a64e502b0 0x555a64ec4540 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fdd70057040 tx=0x7fdd70005830 comp rx=0 tx=0).stop 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7ca11640 1 -- 172.21.15.37:0/2243263989 reap_dead start 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 shutdown_connections 2024-05-10T08:48:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 >> 172.21.15.37:0/2243263989 conn(0x555a64e05b30 msgr2=0x555a64edcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 shutdown_connections 2024-05-10T08:48:34.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.168+0000 7fdd7e716f40 1 -- 172.21.15.37:0/2243263989 wait complete. 2024-05-10T08:48:34.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T08:48:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.317+0000 7fe92d524640 1 Processor -- start 2024-05-10T08:48:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.317+0000 7fe92d524640 1 -- start start 2024-05-10T08:48:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe92d524640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe92815f0c0 0x7fe9280b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe92d524640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9281638e0 0x7fe9280b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe92d524640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9280b1260 con 0x7fe92806c3a0 2024-05-10T08:48:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe92d524640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe928163450 con 0x7fe92815f0c0 2024-05-10T08:48:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe92d524640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe9281604b0 con 0x7fe9281638e0 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe926ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe92815f0c0 0x7fe9280b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe9277fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe92806c3a0 0x7fe928073170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44106/0 (socket says 172.21.15.37:44106) 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe9277fe640 1 -- 172.21.15.37:0/2750503014 learned_addr learned my addr 172.21.15.37:0/2750503014 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe91ffff640 1 --2- 172.21.15.37:0/2750503014 >> v2:172.21.15.82:3300/0 conn(0x7fe9281638e0 0x7fe9280b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe926ffd640 1 -- 172.21.15.37:0/2750503014 >> v2:172.21.15.82:3300/0 conn(0x7fe9281638e0 msgr2=0x7fe9280b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe926ffd640 1 --2- 172.21.15.37:0/2750503014 >> v2:172.21.15.82:3300/0 conn(0x7fe9281638e0 0x7fe9280b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe926ffd640 1 -- 172.21.15.37:0/2750503014 >> v1:172.21.15.37:6789/0 conn(0x7fe92806c3a0 legacy=0x7fe928073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe9267fc640 1 -- 172.21.15.37:0/2750503014 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644745556 0 0) 0x7fe920001490 con 0x7fe92806c3a0 2024-05-10T08:48:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.318+0000 7fe926ffd640 1 -- 172.21.15.37:0/2750503014 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9280b14e0 con 0x7fe92815f0c0 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.319+0000 7fe926ffd640 1 --2- 172.21.15.37:0/2750503014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe9280b6f40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe92806ea70 tx=0x7fe91802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdddee47f31888c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.319+0000 7fe9267fc640 1 -- 172.21.15.37:0/2750503014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918037070 con 0x7fe92815f0c0 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.319+0000 7fe9267fc640 1 -- 172.21.15.37:0/2750503014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe918032440 con 0x7fe92815f0c0 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.319+0000 7fe9267fc640 1 -- 172.21.15.37:0/2750503014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918032810 con 0x7fe92815f0c0 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 -- 172.21.15.37:0/2750503014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 msgr2=0x7fe9280b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 --2- 172.21.15.37:0/2750503014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe9280b6f40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe92806ea70 tx=0x7fe91802a1a0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 -- 172.21.15.37:0/2750503014 shutdown_connections 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 --2- 172.21.15.37:0/2750503014 >> v2:172.21.15.82:3300/0 conn(0x7fe9281638e0 0x7fe9280b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 --2- 172.21.15.37:0/2750503014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe9280b6f40 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 -- 172.21.15.37:0/2750503014 >> 172.21.15.37:0/2750503014 conn(0x7fe9280b3b10 msgr2=0x7fe9280b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 -- 172.21.15.37:0/2750503014 shutdown_connections 2024-05-10T08:48:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.320+0000 7fe92d524640 1 -- 172.21.15.37:0/2750503014 wait complete. 2024-05-10T08:48:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.321+0000 7fe92d524640 1 Processor -- start 2024-05-10T08:48:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.321+0000 7fe92d524640 1 -- start start 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe92d524640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe92806c3a0 0x7fe92815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe92d524640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe92815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe92d524640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9281638e0 0x7fe928146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe92d524640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280b17c0 con 0x7fe92815f0c0 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe92d524640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281630e0 con 0x7fe92806c3a0 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe92d524640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe92806c7e0 con 0x7fe9281638e0 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe92815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe92815d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36920/0 (socket says 172.21.15.37:36920) 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 -- 172.21.15.37:0/1771811495 learned_addr learned my addr 172.21.15.37:0/1771811495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:34.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe926ffd640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe92806c3a0 0x7fe92815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe9277fe640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9281638e0 0x7fe928146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 -- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9281638e0 msgr2=0x7fe928146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9281638e0 0x7fe928146800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 -- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe92806c3a0 msgr2=0x7fe92815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe92806c3a0 0x7fe92815ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 -- 172.21.15.37:0/1771811495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe928146d40 con 0x7fe92815f0c0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.322+0000 7fe91ffff640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe92815d7c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e8a0 tx=0x7fe91000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.323+0000 7fe91f7fe640 1 -- 172.21.15.37:0/1771811495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910017070 con 0x7fe92815f0c0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.323+0000 7fe91f7fe640 1 -- 172.21.15.37:0/1771811495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91000c940 con 0x7fe92815f0c0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.323+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92815b580 con 0x7fe92815f0c0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.323+0000 7fe91f7fe640 1 -- 172.21.15.37:0/1771811495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91000cd30 con 0x7fe92815f0c0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.323+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92815bb40 con 0x7fe92815f0c0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.324+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92806a8f0 con 0x7fe92815f0c0 2024-05-10T08:48:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.324+0000 7fe91f7fe640 1 -- 172.21.15.37:0/1771811495 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe91001a070 con 0x7fe92815f0c0 2024-05-10T08:48:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.325+0000 7fe91f7fe640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe9080762d0 0x7fe908078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.325+0000 7fe91f7fe640 1 -- 172.21.15.37:0/1771811495 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fe910097700 con 0x7fe92815f0c0 2024-05-10T08:48:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.325+0000 7fe926ffd640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe9080762d0 0x7fe908078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.326+0000 7fe926ffd640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe9080762d0 0x7fe908078790 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe918034000 tx=0x7fe91802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:34.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.329+0000 7fe91f7fe640 1 -- 172.21.15.37:0/1771811495 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe910060e40 con 0x7fe92815f0c0 2024-05-10T08:48:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.559+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fe9280693f0 con 0x7fe92815f0c0 2024-05-10T08:48:34.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.955+0000 7fe91f7fe640 1 -- 172.21.15.37:0/1771811495 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v83) ==== 162+0+0 (secure 0 0 0) 0x7fe910060740 con 0x7fe92815f0c0 2024-05-10T08:48:34.954 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe9080762d0 msgr2=0x7fe908078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe9080762d0 0x7fe908078790 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe918034000 tx=0x7fe91802e000 comp rx=0 tx=0).stop 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 msgr2=0x7fe92815d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe92815d7c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e8a0 tx=0x7fe91000ed60 comp rx=0 tx=0).stop 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 shutdown_connections 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe9080762d0 0x7fe908078790 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe9281638e0 0x7fe928146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92815f0c0 0x7fe92815d7c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 --2- 172.21.15.37:0/1771811495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe92806c3a0 0x7fe92815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 >> 172.21.15.37:0/1771811495 conn(0x7fe9280b3b10 msgr2=0x7fe92815e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:34.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 shutdown_connections 2024-05-10T08:48:34.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:34.958+0000 7fe92d524640 1 -- 172.21.15.37:0/1771811495 wait complete. 2024-05-10T08:48:34.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:48:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.080+0000 7f218ecc4640 1 Processor -- start 2024-05-10T08:48:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.080+0000 7f218ecc4640 1 -- start start 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218ecc4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21881638e0 0x7f21880b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218ecc4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f218806c3a0 0x7f218806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218ecc4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21880b14e0 con 0x7f218815f0c0 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218ecc4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2188163450 con 0x7f218806c3a0 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218ecc4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f218806cd20 con 0x7f21881638e0 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218d261640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f218806c3a0 0x7f218806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218d261640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f218806c3a0 0x7f218806c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36926/0 (socket says 172.21.15.37:36926) 2024-05-10T08:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218d261640 1 -- 172.21.15.37:0/2708132517 learned_addr learned my addr 172.21.15.37:0/2708132517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f2187fff640 1 --2- 172.21.15.37:0/2708132517 >> v2:172.21.15.82:3300/0 conn(0x7f21881638e0 0x7f21880b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218d261640 1 -- 172.21.15.37:0/2708132517 >> v2:172.21.15.82:3300/0 conn(0x7f21881638e0 msgr2=0x7f21880b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218d261640 1 --2- 172.21.15.37:0/2708132517 >> v2:172.21.15.82:3300/0 conn(0x7f21881638e0 0x7f21880b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218d261640 1 -- 172.21.15.37:0/2708132517 >> v1:172.21.15.82:6789/0 conn(0x7f218815f0c0 legacy=0x7f21880b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.081+0000 7f218d261640 1 -- 172.21.15.37:0/2708132517 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21881604b0 con 0x7f218806c3a0 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.082+0000 7f218d261640 1 --2- 172.21.15.37:0/2708132517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218806c3a0 0x7f218806c7e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f218806ea70 tx=0x7f218002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adecaf43641cf39b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.082+0000 7f21877fe640 1 -- 172.21.15.37:0/2708132517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180036070 con 0x7f218806c3a0 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.082+0000 7f21877fe640 1 -- 172.21.15.37:0/2708132517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2180031600 con 0x7f218806c3a0 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.082+0000 7f21877fe640 1 -- 172.21.15.37:0/2708132517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21800319d0 con 0x7f218806c3a0 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 -- 172.21.15.37:0/2708132517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218806c3a0 msgr2=0x7f218806c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 --2- 172.21.15.37:0/2708132517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218806c3a0 0x7f218806c7e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f218806ea70 tx=0x7f218002a730 comp rx=0 tx=0).stop 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 -- 172.21.15.37:0/2708132517 shutdown_connections 2024-05-10T08:48:35.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 --2- 172.21.15.37:0/2708132517 >> v2:172.21.15.82:3300/0 conn(0x7f21881638e0 0x7f21880b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 --2- 172.21.15.37:0/2708132517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218806c3a0 0x7f218806c7e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 -- 172.21.15.37:0/2708132517 >> 172.21.15.37:0/2708132517 conn(0x7f21880b3b10 msgr2=0x7f21880b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 -- 172.21.15.37:0/2708132517 shutdown_connections 2024-05-10T08:48:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.083+0000 7f218ecc4640 1 -- 172.21.15.37:0/2708132517 wait complete. 2024-05-10T08:48:35.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.084+0000 7f218ecc4640 1 Processor -- start 2024-05-10T08:48:35.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.084+0000 7f218ecc4640 1 -- start start 2024-05-10T08:48:35.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218ecc4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806c3a0 0x7f21880d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:35.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218ecc4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815f0c0 0x7f2188073170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:35.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218ecc4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21881638e0 0x7f21880736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:35.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218ecc4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21880b17c0 con 0x7f21881638e0 2024-05-10T08:48:35.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218ecc4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21881630e0 con 0x7f218815f0c0 2024-05-10T08:48:35.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218ecc4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f218815f4a0 con 0x7f218806c3a0 2024-05-10T08:48:35.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21881638e0 0x7f21880736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:35.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21881638e0 0x7f21880736b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36942/0 (socket says 172.21.15.37:36942) 2024-05-10T08:48:35.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 -- 172.21.15.37:0/460777164 learned_addr learned my addr 172.21.15.37:0/460777164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:35.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f2187fff640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815f0c0 0x7f2188073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:35.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218ca60640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806c3a0 0x7f21880d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:35.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 -- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806c3a0 msgr2=0x7f21880d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:35.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806c3a0 0x7f21880d0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 -- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815f0c0 msgr2=0x7f2188073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815f0c0 0x7f2188073170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 -- 172.21.15.37:0/460777164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21880d1270 con 0x7f21881638e0 2024-05-10T08:48:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f2187fff640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815f0c0 0x7f2188073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.085+0000 7f218d261640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21881638e0 0x7f21880736b0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f2180009f40 tx=0x7f2180004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.086+0000 7f21857fa640 1 -- 172.21.15.37:0/460777164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180036050 con 0x7f21881638e0 2024-05-10T08:48:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.086+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21881504f0 con 0x7f21881638e0 2024-05-10T08:48:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.086+0000 7f21857fa640 1 -- 172.21.15.37:0/460777164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2180042070 con 0x7f21881638e0 2024-05-10T08:48:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.086+0000 7f21857fa640 1 -- 172.21.15.37:0/460777164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180009510 con 0x7f21881638e0 2024-05-10T08:48:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.086+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21880c7c40 con 0x7f21881638e0 2024-05-10T08:48:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.087+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f218806a8f0 con 0x7f21881638e0 2024-05-10T08:48:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.087+0000 7f21857fa640 1 -- 172.21.15.37:0/460777164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2180007bf0 con 0x7f21881638e0 2024-05-10T08:48:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.088+0000 7f21857fa640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f216c0762d0 0x7f216c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:35.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.088+0000 7f21857fa640 1 -- 172.21.15.37:0/460777164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f21800b8660 con 0x7f21881638e0 2024-05-10T08:48:35.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.088+0000 7f218ca60640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f216c0762d0 0x7f216c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:35.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.088+0000 7f218ca60640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f216c0762d0 0x7f216c078790 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f217c001640 tx=0x7f217c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:35.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.092+0000 7f21857fa640 1 -- 172.21.15.37:0/460777164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f21880d1270 con 0x7f21881638e0 2024-05-10T08:48:35.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.322+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2188075eb0 con 0x7f21881638e0 2024-05-10T08:48:35.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.323+0000 7f21857fa640 1 -- 172.21.15.37:0/460777164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5175 (secure 0 0 0) 0x7f2180081c90 con 0x7f21881638e0 2024-05-10T08:48:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:35.324 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:48:34.958995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7446":{"gid":7446,"name":"a","rank":0,"incarnation":84,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f216c0762d0 msgr2=0x7f216c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f216c0762d0 0x7f216c078790 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f217c001640 tx=0x7f217c009040 comp rx=0 tx=0).stop 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21881638e0 msgr2=0x7f21880736b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21881638e0 0x7f21880736b0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f2180009f40 tx=0x7f2180004a40 comp rx=0 tx=0).stop 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 shutdown_connections 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f216c0762d0 0x7f216c078790 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21881638e0 0x7f21880736b0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815f0c0 0x7f2188073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 --2- 172.21.15.37:0/460777164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f218806c3a0 0x7f21880d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 >> 172.21.15.37:0/460777164 conn(0x7f21880b3b10 msgr2=0x7f21881616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 shutdown_connections 2024-05-10T08:48:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:35.325+0000 7f218ecc4640 1 -- 172.21.15.37:0/460777164 wait complete. 2024-05-10T08:48:35.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:47:46.304772+0000', 'modified': '2024-05-10T08:48:34.958995+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7446}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7446': {'gid': 7446, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6834/3773299798', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3773299798}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 3773299798}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:48:35.738 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7446:up:replay 2024-05-10T08:48:36.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:48:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.857+0000 7f97ce74d640 1 Processor -- start 2024-05-10T08:48:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.857+0000 7f97ce74d640 1 -- start start 2024-05-10T08:48:36.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97ce74d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97c8070d30 0x7f97c80d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:36.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97ce74d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f97c8071110 0x7f97c806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97ce74d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c80d1300 con 0x7f97c8163920 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97ce74d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f97c80d10d0 con 0x7f97c8070d30 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97ce74d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f97c8163db0 con 0x7f97c8071110 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97c8070d30 0x7f97c80d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97c8070d30 0x7f97c80d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36956/0 (socket says 172.21.15.37:36956) 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f97c8163920 0x7f97c80703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44120/0 (socket says 172.21.15.37:44120) 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c7fff640 1 -- 172.21.15.37:0/3731627805 learned_addr learned my addr 172.21.15.37:0/3731627805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97cccea640 1 --2- 172.21.15.37:0/3731627805 >> v2:172.21.15.82:3300/0 conn(0x7f97c8071110 0x7f97c806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c7fff640 1 -- 172.21.15.37:0/3731627805 >> v2:172.21.15.82:3300/0 conn(0x7f97c8071110 msgr2=0x7f97c806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c7fff640 1 --2- 172.21.15.37:0/3731627805 >> v2:172.21.15.82:3300/0 conn(0x7f97c8071110 0x7f97c806d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c7fff640 1 -- 172.21.15.37:0/3731627805 >> v1:172.21.15.37:6789/0 conn(0x7f97c8163920 legacy=0x7f97c80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c7fff640 1 -- 172.21.15.37:0/3731627805 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c80d15e0 con 0x7f97c8070d30 2024-05-10T08:48:36.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.858+0000 7f97c6ffd640 1 -- 172.21.15.37:0/3731627805 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648698346 0 0) 0x7f97c80d1300 con 0x7f97c8163920 2024-05-10T08:48:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.859+0000 7f97c7fff640 1 --2- 172.21.15.37:0/3731627805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c80d20c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f97c8073540 tx=0x7f97b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7be7afcf602c3fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.859+0000 7f97c6ffd640 1 -- 172.21.15.37:0/3731627805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037070 con 0x7f97c8070d30 2024-05-10T08:48:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.859+0000 7f97c6ffd640 1 -- 172.21.15.37:0/3731627805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8032440 con 0x7f97c8070d30 2024-05-10T08:48:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.859+0000 7f97c6ffd640 1 -- 172.21.15.37:0/3731627805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8032810 con 0x7f97c8070d30 2024-05-10T08:48:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 -- 172.21.15.37:0/3731627805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 msgr2=0x7f97c80d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 --2- 172.21.15.37:0/3731627805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c80d20c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f97c8073540 tx=0x7f97b802a270 comp rx=0 tx=0).stop 2024-05-10T08:48:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 -- 172.21.15.37:0/3731627805 shutdown_connections 2024-05-10T08:48:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 --2- 172.21.15.37:0/3731627805 >> v2:172.21.15.82:3300/0 conn(0x7f97c8071110 0x7f97c806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 --2- 172.21.15.37:0/3731627805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c80d20c0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 -- 172.21.15.37:0/3731627805 >> 172.21.15.37:0/3731627805 conn(0x7f97c80d2e90 msgr2=0x7f97c80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 -- 172.21.15.37:0/3731627805 shutdown_connections 2024-05-10T08:48:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.860+0000 7f97ce74d640 1 -- 172.21.15.37:0/3731627805 wait complete. 2024-05-10T08:48:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.861+0000 7f97ce74d640 1 Processor -- start 2024-05-10T08:48:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97ce74d640 1 -- start start 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97ce74d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c81f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97ce74d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8071110 0x7f97c80c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97ce74d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c8163920 0x7f97c80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97ce74d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80d1c30 con 0x7f97c8070d30 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97ce74d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97c8070b80 con 0x7f97c8071110 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97ce74d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f97c8071560 con 0x7f97c8163920 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c81f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c81f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36964/0 (socket says 172.21.15.37:36964) 2024-05-10T08:48:36.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.862+0000 7f97c7fff640 1 -- 172.21.15.37:0/702399090 learned_addr learned my addr 172.21.15.37:0/702399090 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c77fe640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8071110 0x7f97c80c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97cccea640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c8163920 0x7f97c80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c7fff640 1 -- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c8163920 msgr2=0x7f97c80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c7fff640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c8163920 0x7f97c80c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c7fff640 1 -- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8071110 msgr2=0x7f97c80c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c7fff640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8071110 0x7f97c80c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c7fff640 1 -- 172.21.15.37:0/702399090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c815dbe0 con 0x7f97c8070d30 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97cccea640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c8163920 0x7f97c80c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c7fff640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c81f5780 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000c00 tx=0x7f97b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c4ff9640 1 -- 172.21.15.37:0/702399090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8041020 con 0x7f97c8070d30 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c4ff9640 1 -- 172.21.15.37:0/702399090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b80306c0 con 0x7f97c8070d30 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c815dec0 con 0x7f97c8070d30 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97c4ff9640 1 -- 172.21.15.37:0/702399090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037040 con 0x7f97c8070d30 2024-05-10T08:48:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.863+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c815e480 con 0x7f97c8070d30 2024-05-10T08:48:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.864+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c806fc30 con 0x7f97c8070d30 2024-05-10T08:48:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.865+0000 7f97c4ff9640 1 -- 172.21.15.37:0/702399090 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f97b8044020 con 0x7f97c8070d30 2024-05-10T08:48:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.866+0000 7f97c4ff9640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b40762d0 0x7f97b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.866+0000 7f97c4ff9640 1 -- 172.21.15.37:0/702399090 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f97b80b7ee0 con 0x7f97c8070d30 2024-05-10T08:48:36.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.866+0000 7f97c77fe640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b40762d0 0x7f97b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:36.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.867+0000 7f97c77fe640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b40762d0 0x7f97b4078790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f97c814b650 tx=0x7f97bc007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:36.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:36.870+0000 7f97c4ff9640 1 -- 172.21.15.37:0/702399090 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f97c806fc30 con 0x7f97c8070d30 2024-05-10T08:48:37.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.103+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97c80693f0 con 0x7f97c8070d30 2024-05-10T08:48:37.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.104+0000 7f97c4ff9640 1 -- 172.21.15.37:0/702399090 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5176 (secure 0 0 0) 0x7f97b804b030 con 0x7f97c8070d30 2024-05-10T08:48:37.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:37.103 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:48:35.975347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7446":{"gid":7446,"name":"a","rank":0,"incarnation":84,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T08:48:37.103 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 86 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b40762d0 msgr2=0x7f97b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b40762d0 0x7f97b4078790 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f97c814b650 tx=0x7f97bc007de0 comp rx=0 tx=0).stop 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 msgr2=0x7f97c81f5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c81f5780 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000c00 tx=0x7f97b80046c0 comp rx=0 tx=0).stop 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 shutdown_connections 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f97b40762d0 0x7f97b4078790 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f97c8163920 0x7f97c80c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8071110 0x7f97c80c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 --2- 172.21.15.37:0/702399090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c8070d30 0x7f97c81f5780 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 >> 172.21.15.37:0/702399090 conn(0x7f97c80d2e90 msgr2=0x7f97c80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 shutdown_connections 2024-05-10T08:48:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:37.106+0000 7f97ce74d640 1 -- 172.21.15.37:0/702399090 wait complete. 2024-05-10T08:48:37.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:47:46.304772+0000', 'modified': '2024-05-10T08:48:35.975347+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7446}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7446': {'gid': 7446, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:rejoin', 'state_seq': 16, 'addr': '172.21.15.37:6834/3773299798', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3773299798}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 3773299798}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:48:37.519 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7446:up:rejoin 2024-05-10T08:48:38.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:48:38.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.637+0000 7fde1daf1640 1 Processor -- start 2024-05-10T08:48:38.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.637+0000 7fde1daf1640 1 -- start start 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.638+0000 7fde1daf1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde1806c3a0 0x7fde180b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.638+0000 7fde1daf1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.638+0000 7fde1daf1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde1809ff30 con 0x7fde1815d180 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.638+0000 7fde1daf1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fde1815e360 con 0x7fde1806c3a0 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.638+0000 7fde1daf1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fde1815d750 con 0x7fde180aedf0 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.638+0000 7fde177fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde1806c3a0 0x7fde180b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.638+0000 7fde177fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde1806c3a0 0x7fde180b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51692/0 (socket says 172.21.15.37:51692) 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde177fe640 1 -- 172.21.15.37:0/1920955840 learned_addr learned my addr 172.21.15.37:0/1920955840 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde16ffd640 1 --2- 172.21.15.37:0/1920955840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde177fe640 1 -- 172.21.15.37:0/1920955840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 msgr2=0x7fde180b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:38.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde177fe640 1 --2- 172.21.15.37:0/1920955840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde177fe640 1 -- 172.21.15.37:0/1920955840 >> v1:172.21.15.37:6789/0 conn(0x7fde1815d180 legacy=0x7fde1806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:38.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde177fe640 1 -- 172.21.15.37:0/1920955840 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1815da30 con 0x7fde1806c3a0 2024-05-10T08:48:38.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde167fc640 1 -- 172.21.15.37:0/1920955840 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656424533 0 0) 0x7fde1809ff30 con 0x7fde1815d180 2024-05-10T08:48:38.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.639+0000 7fde16ffd640 1 --2- 172.21.15.37:0/1920955840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:38.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde177fe640 1 --2- 172.21.15.37:0/1920955840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde180b13f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fde08009870 tx=0x7fde0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7057339918d7a3a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:38.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde167fc640 1 -- 172.21.15.37:0/1920955840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08037070 con 0x7fde1806c3a0 2024-05-10T08:48:38.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde167fc640 1 -- 172.21.15.37:0/1920955840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde08032440 con 0x7fde1806c3a0 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde167fc640 1 -- 172.21.15.37:0/1920955840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08032810 con 0x7fde1806c3a0 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 -- 172.21.15.37:0/1920955840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 msgr2=0x7fde180b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 --2- 172.21.15.37:0/1920955840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde180b13f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fde08009870 tx=0x7fde0802a270 comp rx=0 tx=0).stop 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 -- 172.21.15.37:0/1920955840 shutdown_connections 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 --2- 172.21.15.37:0/1920955840 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 --2- 172.21.15.37:0/1920955840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde180b13f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 -- 172.21.15.37:0/1920955840 >> 172.21.15.37:0/1920955840 conn(0x7fde180b3b10 msgr2=0x7fde180b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 -- 172.21.15.37:0/1920955840 shutdown_connections 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.640+0000 7fde1daf1640 1 -- 172.21.15.37:0/1920955840 wait complete. 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.642+0000 7fde1daf1640 1 Processor -- start 2024-05-10T08:48:38.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.642+0000 7fde1daf1640 1 -- start start 2024-05-10T08:48:38.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde1daf1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde181f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:38.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde1daf1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:38.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde1daf1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde1815d180 0x7fde181561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:38.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde1daf1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde180b4fc0 con 0x7fde1806c3a0 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde1daf1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde1815dff0 con 0x7fde1815d180 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde1daf1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fde180b5140 con 0x7fde180aedf0 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde181f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde181f8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51700/0 (socket says 172.21.15.37:51700) 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 -- 172.21.15.37:0/249953017 learned_addr learned my addr 172.21.15.37:0/249953017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde16ffd640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde17fff640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde1815d180 0x7fde181561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 -- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 msgr2=0x7fde180d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 -- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde1815d180 msgr2=0x7fde181561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde1815d180 0x7fde181561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 -- 172.21.15.37:0/249953017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde18156b30 con 0x7fde1806c3a0 2024-05-10T08:48:38.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde17fff640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde1815d180 0x7fde181561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde177fe640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde181f8fd0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fde0802a2b0 tx=0x7fde080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fddfffff640 1 -- 172.21.15.37:0/249953017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08041020 con 0x7fde1806c3a0 2024-05-10T08:48:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fddfffff640 1 -- 172.21.15.37:0/249953017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde080306c0 con 0x7fde1806c3a0 2024-05-10T08:48:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde181f84f0 con 0x7fde1806c3a0 2024-05-10T08:48:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.643+0000 7fddfffff640 1 -- 172.21.15.37:0/249953017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08037040 con 0x7fde1806c3a0 2024-05-10T08:48:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.644+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde181f8ab0 con 0x7fde1806c3a0 2024-05-10T08:48:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.644+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde180693f0 con 0x7fde1806c3a0 2024-05-10T08:48:38.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.645+0000 7fddfffff640 1 -- 172.21.15.37:0/249953017 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde08044020 con 0x7fde1806c3a0 2024-05-10T08:48:38.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.646+0000 7fddfffff640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde040762d0 0x7fde04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:38.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.646+0000 7fddfffff640 1 -- 172.21.15.37:0/249953017 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fde080b7fa0 con 0x7fde1806c3a0 2024-05-10T08:48:38.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.646+0000 7fde16ffd640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde040762d0 0x7fde04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:38.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.647+0000 7fde16ffd640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde040762d0 0x7fde04078790 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fde18076030 tx=0x7fde0c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:38.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.650+0000 7fddfffff640 1 -- 172.21.15.37:0/249953017 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fde0804b030 con 0x7fde1806c3a0 2024-05-10T08:48:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.888+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde180b1000 con 0x7fde1806c3a0 2024-05-10T08:48:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.889+0000 7fddfffff640 1 -- 172.21.15.37:0/249953017 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5183 (secure 0 0 0) 0x7fde08081770 con 0x7fde1806c3a0 2024-05-10T08:48:38.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:38.888 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:48:37.979109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7446":{"gid":7446,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":17,"addr":"172.21.15.37:6834/3773299798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3773299798},{"type":"v1","addr":"172.21.15.37:6834","nonce":3773299798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7446,"qdb_cluster":[7446]},"id":7}]} 2024-05-10T08:48:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 87 2024-05-10T08:48:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde040762d0 msgr2=0x7fde04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde040762d0 0x7fde04078790 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fde18076030 tx=0x7fde0c008040 comp rx=0 tx=0).stop 2024-05-10T08:48:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 msgr2=0x7fde181f8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde181f8fd0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fde0802a2b0 tx=0x7fde080046c0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 shutdown_connections 2024-05-10T08:48:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fde040762d0 0x7fde04078790 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde1815d180 0x7fde181561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde180aedf0 0x7fde180d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 --2- 172.21.15.37:0/249953017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde1806c3a0 0x7fde181f8fd0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 >> 172.21.15.37:0/249953017 conn(0x7fde180b3b10 msgr2=0x7fde1815fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 shutdown_connections 2024-05-10T08:48:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:38.891+0000 7fde1daf1640 1 -- 172.21.15.37:0/249953017 wait complete. 2024-05-10T08:48:39.304 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:47:46.304772+0000', 'modified': '2024-05-10T08:48:37.979109+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7446}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7446': {'gid': 7446, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.37:6834/3773299798', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3773299798}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 3773299798}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7446, 'qdb_cluster': [7446]} 2024-05-10T08:48:39.304 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:48:39.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T08:48:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.415+0000 7f5d50254640 1 Processor -- start 2024-05-10T08:48:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.415+0000 7f5d50254640 1 -- start start 2024-05-10T08:48:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d50254640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5d4815c340 0x7f5d48166970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d50254640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4815c920 con 0x7f5d48072840 2024-05-10T08:48:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d50254640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4815cc00 con 0x7f5d4806e0f0 2024-05-10T08:48:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d50254640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4815cee0 con 0x7f5d4815c340 2024-05-10T08:48:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d4e7f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5d4815c340 0x7f5d48166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d4e7f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5d4815c340 0x7f5d48166970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51704/0 (socket says 172.21.15.37:51704) 2024-05-10T08:48:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/4103046246 learned_addr learned my addr 172.21.15.37:0/4103046246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d4d7ef640 1 --1- 172.21.15.37:0/4103046246 >> v1:172.21.15.37:6789/0 conn(0x7f5d48072840 0x7f5d4806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45432/0 (socket says 172.21.15.37:45432) 2024-05-10T08:48:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/4103046246 >> v1:172.21.15.82:6789/0 conn(0x7f5d4806e0f0 legacy=0x7f5d480d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.416+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/4103046246 >> v1:172.21.15.37:6789/0 conn(0x7f5d48072840 legacy=0x7f5d4806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.417+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/4103046246 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4815d1c0 con 0x7f5d4815c340 2024-05-10T08:48:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.417+0000 7f5d4cfee640 1 -- 172.21.15.37:0/4103046246 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250801389 0 0) 0x7f5d4815c920 con 0x7f5d48072840 2024-05-10T08:48:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.417+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/4103046246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d4815c340 0x7f5d48166970 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009870 tx=0x7f5d4002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd05b9a891ce51e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.417+0000 7f5d4cfee640 1 -- 172.21.15.37:0/4103046246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40037070 con 0x7f5d4815c340 2024-05-10T08:48:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.417+0000 7f5d4cfee640 1 -- 172.21.15.37:0/4103046246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40032440 con 0x7f5d4815c340 2024-05-10T08:48:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.417+0000 7f5d4cfee640 1 -- 172.21.15.37:0/4103046246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40032810 con 0x7f5d4815c340 2024-05-10T08:48:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.418+0000 7f5d50254640 1 -- 172.21.15.37:0/4103046246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d4815c340 msgr2=0x7f5d48166970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.418+0000 7f5d50254640 1 --2- 172.21.15.37:0/4103046246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d4815c340 0x7f5d48166970 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009870 tx=0x7f5d4002a210 comp rx=0 tx=0).stop 2024-05-10T08:48:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.418+0000 7f5d50254640 1 -- 172.21.15.37:0/4103046246 shutdown_connections 2024-05-10T08:48:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.418+0000 7f5d50254640 1 --2- 172.21.15.37:0/4103046246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d4815c340 0x7f5d48166970 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.418+0000 7f5d50254640 1 -- 172.21.15.37:0/4103046246 >> 172.21.15.37:0/4103046246 conn(0x7f5d4806c3a0 msgr2=0x7f5d4806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.418+0000 7f5d50254640 1 -- 172.21.15.37:0/4103046246 shutdown_connections 2024-05-10T08:48:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.418+0000 7f5d50254640 1 -- 172.21.15.37:0/4103046246 wait complete. 2024-05-10T08:48:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.419+0000 7f5d50254640 1 Processor -- start 2024-05-10T08:48:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.419+0000 7f5d50254640 1 -- start start 2024-05-10T08:48:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d50254640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5d4806e0f0 0x7f5d4814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d50254640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d48072840 0x7f5d48143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d50254640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d4815c340 0x7f5d48143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d50254640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d48153230 con 0x7f5d48072840 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d50254640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481530b0 con 0x7f5d4815c340 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d50254640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5d48166eb0 con 0x7f5d4806e0f0 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d4d7ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d48072840 0x7f5d48143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d4d7ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d48072840 0x7f5d48143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51720/0 (socket says 172.21.15.37:51720) 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d4d7ef640 1 -- 172.21.15.37:0/3532844657 learned_addr learned my addr 172.21.15.37:0/3532844657 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d4815c340 0x7f5d48143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.420+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5d4806e0f0 0x7f5d4814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d4d7ef640 1 -- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5d4806e0f0 msgr2=0x7f5d4814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5d4806e0f0 0x7f5d4814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d4d7ef640 1 -- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d4815c340 msgr2=0x7f5d48143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d4815c340 0x7f5d48143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d4d7ef640 1 -- 172.21.15.37:0/3532844657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4814d500 con 0x7f5d48072840 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d4815c340 0x7f5d48143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d48072840 0x7f5d48143750 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c4b0 tx=0x7f5d3c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d3a7fc640 1 -- 172.21.15.37:0/3532844657 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c018070 con 0x7f5d48072840 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d3a7fc640 1 -- 172.21.15.37:0/3532844657 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c007500 con 0x7f5d48072840 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4814d7e0 con 0x7f5d48072840 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d3a7fc640 1 -- 172.21.15.37:0/3532844657 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c004a20 con 0x7f5d48072840 2024-05-10T08:48:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.421+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d480cd600 con 0x7f5d48072840 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.423+0000 7f5d3a7fc640 1 -- 172.21.15.37:0/3532844657 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5d3c01b070 con 0x7f5d48072840 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.423+0000 7f5d3a7fc640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5d2c0762d0 0x7f5d2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.423+0000 7f5d3a7fc640 1 -- 172.21.15.37:0/3532844657 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f5d3c096b80 con 0x7f5d48072840 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.423+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5d2c0762d0 0x7f5d2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.424+0000 7f5d52f69740 1 Processor -- start 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.424+0000 7f5d52f69740 1 -- start start 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.424+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5d2c0762d0 0x7f5d2c078790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5d44005520 tx=0x7f5d44009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdd9ed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdd9edca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9bdbb0 0x557fdd9c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d52f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fdd9278d0 con 0x557fdd9bdbb0 2024-05-10T08:48:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557fdd8e0c10 con 0x557fdd9eaf50 2024-05-10T08:48:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x557fdd923890 con 0x557fdd9eb330 2024-05-10T08:48:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9bdbb0 0x557fdd9c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9bdbb0 0x557fdd9c13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51724/0 (socket says 172.21.15.37:51724) 2024-05-10T08:48:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/999158066 learned_addr learned my addr 172.21.15.37:0/999158066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdd9edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdd9ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 msgr2=0x557fdd9edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdd9edca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 msgr2=0x557fdd9ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdd9ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/999158066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fdd8e85d0 con 0x557fdd9bdbb0 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9bdbb0 0x557fdd9c13c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f5d400090b0 tx=0x7f5d4002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73339ffd37ccb631 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d2b7fe640 1 -- 172.21.15.37:0/999158066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40037040 con 0x557fdd9bdbb0 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d2b7fe640 1 -- 172.21.15.37:0/999158066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40032740 con 0x557fdd9bdbb0 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.425+0000 7f5d2b7fe640 1 -- 172.21.15.37:0/999158066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40032af0 con 0x557fdd9bdbb0 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 -- 172.21.15.37:0/999158066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9bdbb0 msgr2=0x557fdd9c13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9bdbb0 0x557fdd9c13c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f5d400090b0 tx=0x7f5d4002c000 comp rx=0 tx=0).stop 2024-05-10T08:48:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 -- 172.21.15.37:0/999158066 shutdown_connections 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9bdbb0 0x557fdd9c13c0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdd9edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 --2- 172.21.15.37:0/999158066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdd9ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 -- 172.21.15.37:0/999158066 >> 172.21.15.37:0/999158066 conn(0x557fdd9bfe20 msgr2=0x557fdda08760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 -- 172.21.15.37:0/999158066 shutdown_connections 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.426+0000 7f5d52f69740 1 -- 172.21.15.37:0/999158066 wait complete. 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.427+0000 7f5d52f69740 1 -- start start 2024-05-10T08:48:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.427+0000 7f5d52f69740 1 Processor -- start 2024-05-10T08:48:39.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eaf50 0x557fdd9ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eb330 0x557fdd9e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9e95d0 0x557fdd9e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d52f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fdd9c2fd0 con 0x557fdd9eaf50 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557fdd8e4760 con 0x557fdd9eb330 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x557fdd9c32b0 con 0x557fdd9e95d0 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d52f69740 10 client.0 _ll_register_callbacks cb 0x557fdd91dcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eaf50 0x557fdd9ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eaf50 0x557fdd9ddab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51730/0 (socket says 172.21.15.37:51730) 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 -- 172.21.15.37:0/2648348723 learned_addr learned my addr 172.21.15.37:0/2648348723 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 -- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9e95d0 msgr2=0x557fdd9e9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9e95d0 0x557fdd9e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eb330 0x557fdd9e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 -- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eb330 msgr2=0x557fdd9e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eb330 0x557fdd9e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 -- 172.21.15.37:0/2648348723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fdd6392d0 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eb330 0x557fdd9e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eaf50 0x557fdd9ddab0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5d44015710 tx=0x7f5d44003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ca398169e33f74 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.428+0000 7f5d28ff9640 1 -- 172.21.15.37:0/2648348723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44025020 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d28ff9640 1 -- 172.21.15.37:0/2648348723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f5d44010040 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d40032740 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d28ff9640 1 -- 172.21.15.37:0/2648348723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f5d4402f050 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 10 client.7839 fetch_fsmap learned FSMap version 87 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x557fdd7036b0 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d28ff9640 1 -- 172.21.15.37:0/2648348723 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40032740 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d28ff9640 1 -- 172.21.15.37:0/2648348723 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f5d44032020 con 0x557fdd9eaf50 2024-05-10T08:48:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 10 client.7839 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 10 client.7839 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 20 client.7839 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9e44d0 0x557fdd9e48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 4 client.7839 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fdd8ab760 con 0x557fdd9e44d0 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9e44d0 0x557fdd9e48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d28ff9640 10 client.7839 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.429+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9e44d0 0x557fdd9e48b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=922a16b749ccd904 server_cookie=f9369cb7fbff46f4 in_seq=0 out_seq=0 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d28ff9640 1 -- 172.21.15.37:0/2648348723 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fdd8ab760 con 0x557fdd9e44d0 2024-05-10T08:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d28ff9640 10 client.7839 handle_command_reply: tid=0 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 client.7839 shutdown 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eaf50 msgr2=0x557fdd9ddab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eaf50 0x557fdd9ddab0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5d44015710 tx=0x7f5d44003ae0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 shutdown_connections 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9e44d0 0x557fdd9e48b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9e95d0 0x557fdd9e9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eb330 0x557fdd9e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d28ff9640 0 client.7839 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 --2- 172.21.15.37:0/2648348723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eaf50 0x557fdd9ddab0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 >> 172.21.15.37:0/2648348723 conn(0x557fdd9bdbb0 msgr2=0x557fdd9be860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 shutdown_connections 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.430+0000 7f5d52f69740 1 -- 172.21.15.37:0/2648348723 wait complete. 2024-05-10T08:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.431+0000 7f5d52f69740 20 client.7839 trim_cache size 0 max 16384 2024-05-10T08:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.450+0000 7f5d52f69740 1 Processor -- start 2024-05-10T08:48:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.450+0000 7f5d52f69740 1 -- start start 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9e95d0 0x557fdda2c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eaf50 0x557fdd9e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eb330 0x557fdd9e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d52f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481ffc60 con 0x557fdd9eb330 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481fecc0 con 0x557fdd9e95d0 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5d480cedf0 con 0x557fdd9eaf50 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eb330 0x557fdd9e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eb330 0x557fdd9e30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51734/0 (socket says 172.21.15.37:51734) 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/1703255125 learned_addr learned my addr 172.21.15.37:0/1703255125 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eaf50 msgr2=0x557fdd9e2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eaf50 0x557fdd9e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9e95d0 msgr2=0x557fdda2c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9e95d0 0x557fdda2c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9e95d0 0x557fdda2c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 -- 172.21.15.37:0/1703255125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fdd9e9d80 con 0x557fdd9eb330 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9e95d0 0x557fdda2c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eb330 0x557fdd9e30a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009630 tx=0x7f5d4002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b4bcc1f0d73fdf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d2affd640 1 -- 172.21.15.37:0/1703255125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4004c070 con 0x557fdd9eb330 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d2affd640 1 -- 172.21.15.37:0/1703255125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40004450 con 0x557fdd9eb330 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.451+0000 7f5d2affd640 1 -- 172.21.15.37:0/1703255125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40037040 con 0x557fdd9eb330 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 -- 172.21.15.37:0/1703255125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eb330 msgr2=0x557fdd9e30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eb330 0x557fdd9e30a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009630 tx=0x7f5d4002c070 comp rx=0 tx=0).stop 2024-05-10T08:48:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 -- 172.21.15.37:0/1703255125 shutdown_connections 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9eb330 0x557fdd9e30a0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eaf50 0x557fdd9e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 --2- 172.21.15.37:0/1703255125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9e95d0 0x557fdda2c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 -- 172.21.15.37:0/1703255125 >> 172.21.15.37:0/1703255125 conn(0x557fdd9bdbb0 msgr2=0x557fdd9e48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 -- 172.21.15.37:0/1703255125 shutdown_connections 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 -- 172.21.15.37:0/1703255125 wait complete. 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.452+0000 7f5d52f69740 1 -- start start 2024-05-10T08:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 1 Processor -- start 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9e95d0 0x557fdd9e0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdda8a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdda0b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fdd9e1600 con 0x557fdd9e95d0 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481fe670 con 0x557fdd9eaf50 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x557fdd9e22c0 con 0x557fdd9eb330 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d52f69740 10 client.0 _ll_register_callbacks cb 0x7f5d4400e960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.453+0000 7f5d4dff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9e95d0 0x557fdd9e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9e95d0 0x557fdd9e0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51748/0 (socket says 172.21.15.37:51748) 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 -- 172.21.15.37:0/3919154013 learned_addr learned my addr 172.21.15.37:0/3919154013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4e7f1640 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdda0b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdda8a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 -- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 msgr2=0x557fdda0b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdda0b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 -- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 msgr2=0x557fdda8a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdda8a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 -- 172.21.15.37:0/3919154013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fdd9f10f0 con 0x557fdd9e95d0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d4dff0640 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9e95d0 0x557fdd9e0020 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5d4402a5e0 tx=0x7f5d44015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d971e79624bb7b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d28ff9640 1 -- 172.21.15.37:0/3919154013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44038060 con 0x557fdd9e95d0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d28ff9640 1 -- 172.21.15.37:0/3919154013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f5d4402aa60 con 0x557fdd9e95d0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d40004450 con 0x557fdd9e95d0 2024-05-10T08:48:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d28ff9640 1 -- 172.21.15.37:0/3919154013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f5d4403e050 con 0x557fdd9e95d0 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d52f69740 10 client.7845 fetch_fsmap learned FSMap version 87 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x557fdda0ba80 con 0x557fdd9e95d0 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.454+0000 7f5d28ff9640 1 -- 172.21.15.37:0/3919154013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40004450 con 0x557fdd9e95d0 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d28ff9640 1 -- 172.21.15.37:0/3919154013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f5d44041020 con 0x557fdd9e95d0 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 10 client.7845 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 10 client.7845 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 20 client.7845 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9be770 0x557fdd9e8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 4 client.7845 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "status"}) -- 0x557fdd9e5700 con 0x557fdd9be770 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9be770 0x557fdd9e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d28ff9640 10 client.7845 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d4d7ef640 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9be770 0x557fdd9e8040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb113717622dc05e server_cookie=b2d25e2c5702c2fb in_seq=0 out_seq=0 2024-05-10T08:48:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d28ff9640 1 -- 172.21.15.37:0/3919154013 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x557fdd9e5700 con 0x557fdd9be770 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d28ff9640 10 client.7845 handle_command_reply: tid=0 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 client.7845 shutdown 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9e95d0 msgr2=0x557fdd9e0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9e95d0 0x557fdd9e0020 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5d4402a5e0 tx=0x7f5d44015000 comp rx=0 tx=0).stop 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 shutdown_connections 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x557fdd9be770 0x557fdd9e8040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x557fdd9eb330 0x557fdda0b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fdd9eaf50 0x557fdda8a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d28ff9640 0 client.7845 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 --2- 172.21.15.37:0/3919154013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fdd9e95d0 0x557fdd9e0020 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.455+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 >> 172.21.15.37:0/3919154013 conn(0x557fdd9bdbb0 msgr2=0x557fdd9e48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 shutdown_connections 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d52f69740 1 -- 172.21.15.37:0/3919154013 wait complete. 2024-05-10T08:48:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d52f69740 20 client.7845 trim_cache size 0 max 16384 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7446, 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.491691544, 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 87, 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 106, 2024-05-10T08:48:39.461 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 106, 2024-05-10T08:48:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 57.853981820999998 2024-05-10T08:48:39.462 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:48:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5d2c0762d0 msgr2=0x7f5d2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5d2c0762d0 0x7f5d2c078790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5d44005520 tx=0x7f5d44009040 comp rx=0 tx=0).stop 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d48072840 msgr2=0x7f5d48143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d48072840 0x7f5d48143750 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c4b0 tx=0x7f5d3c00c970 comp rx=0 tx=0).stop 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 shutdown_connections 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5d2c0762d0 0x7f5d2c078790 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d4815c340 0x7f5d48143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d48072840 0x7f5d48143750 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 --2- 172.21.15.37:0/3532844657 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5d4806e0f0 0x7f5d4814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 >> 172.21.15.37:0/3532844657 conn(0x7f5d4806c3a0 msgr2=0x7f5d4806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 shutdown_connections 2024-05-10T08:48:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.456+0000 7f5d50254640 1 -- 172.21.15.37:0/3532844657 wait complete. 2024-05-10T08:48:39.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo daemon-helper kill ceph --cluster ceph -w 2024-05-10T08:48:39.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:39.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-05-10T08:48:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.577+0000 7f3405474640 1 Processor -- start 2024-05-10T08:48:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.577+0000 7f3405474640 1 -- start start 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f3405474640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3400160d50 0x7f3400161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f3405474640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 0x7f34000d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f3405474640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3400070760 con 0x7f340015d3d0 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f3405474640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f34000d17e0 con 0x7f3400160d50 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f3405474640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34000d1a30 con 0x7f34000d2760 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f33fe7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3400160d50 0x7f3400161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f33fe7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3400160d50 0x7f3400161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51758/0 (socket says 172.21.15.37:51758) 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.578+0000 7f33fe7fc640 1 -- 172.21.15.37:0/1491580133 learned_addr learned my addr 172.21.15.37:0/1491580133 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fe7fc640 1 -- 172.21.15.37:0/1491580133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 msgr2=0x7f34000d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/1491580133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 0x7f34000d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fe7fc640 1 -- 172.21.15.37:0/1491580133 >> v1:172.21.15.82:6789/0 conn(0x7f340015d3d0 legacy=0x7f3400071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fe7fc640 1 -- 172.21.15.37:0/1491580133 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000d1d10 con 0x7f3400160d50 2024-05-10T08:48:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/1491580133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3400160d50 0x7f3400161200 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009870 tx=0x7f33f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc676ce0a2a00e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fdffb640 1 -- 172.21.15.37:0/1491580133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4037070 con 0x7f3400160d50 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fdffb640 1 -- 172.21.15.37:0/1491580133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f4032440 con 0x7f3400160d50 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.579+0000 7f33fdffb640 1 -- 172.21.15.37:0/1491580133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4032810 con 0x7f3400160d50 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 -- 172.21.15.37:0/1491580133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3400160d50 msgr2=0x7f3400161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 --2- 172.21.15.37:0/1491580133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3400160d50 0x7f3400161200 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009870 tx=0x7f33f402a210 comp rx=0 tx=0).stop 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 -- 172.21.15.37:0/1491580133 shutdown_connections 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 --2- 172.21.15.37:0/1491580133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 0x7f34000d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 --2- 172.21.15.37:0/1491580133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3400160d50 0x7f3400161200 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 -- 172.21.15.37:0/1491580133 >> 172.21.15.37:0/1491580133 conn(0x7f340009ba40 msgr2=0x7f340009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 -- 172.21.15.37:0/1491580133 shutdown_connections 2024-05-10T08:48:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.580+0000 7f3405474640 1 -- 172.21.15.37:0/1491580133 wait complete. 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.581+0000 7f3405474640 1 Processor -- start 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f3405474640 1 -- start start 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f3405474640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 0x7f340015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f3405474640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340015d3d0 0x7f340015c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f3405474640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3400160d50 0x7f34001f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f3405474640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3400070380 con 0x7f340015d3d0 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f3405474640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34000cf550 con 0x7f3400160d50 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f3405474640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3400070500 con 0x7f34000d2760 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f33fe7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340015d3d0 0x7f340015c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f33fe7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340015d3d0 0x7f340015c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51762/0 (socket says 172.21.15.37:51762) 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.582+0000 7f33fe7fc640 1 -- 172.21.15.37:0/3047541923 learned_addr learned my addr 172.21.15.37:0/3047541923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3400160d50 0x7f34001f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33feffd640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 0x7f340015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33fe7fc640 1 -- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 msgr2=0x7f340015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 0x7f340015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33fe7fc640 1 -- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3400160d50 msgr2=0x7f34001f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3400160d50 0x7f34001f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33fe7fc640 1 -- 172.21.15.37:0/3047541923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34001f9610 con 0x7f340015d3d0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3400160d50 0x7f34001f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340015d3d0 0x7f340015c8b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009870 tx=0x7f33f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33e77fe640 1 -- 172.21.15.37:0/3047541923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4041070 con 0x7f340015d3d0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33e77fe640 1 -- 172.21.15.37:0/3047541923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f403c870 con 0x7f340015d3d0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340006d550 con 0x7f340015d3d0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f33e77fe640 1 -- 172.21.15.37:0/3047541923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4037040 con 0x7f340015d3d0 2024-05-10T08:48:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.583+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001f98b0 con 0x7f340015d3d0 2024-05-10T08:48:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.585+0000 7f33e77fe640 1 -- 172.21.15.37:0/3047541923 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f33f4044070 con 0x7f340015d3d0 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.585+0000 7f33e77fe640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33ec0762d0 0x7f33ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.585+0000 7f33e77fe640 1 -- 172.21.15.37:0/3047541923 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f33f40b82f0 con 0x7f340015d3d0 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.586+0000 7f33feffd640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33ec0762d0 0x7f33ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.586+0000 7f3408183740 1 Processor -- start 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.586+0000 7f33feffd640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33ec0762d0 0x7f33ec078790 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.586+0000 7f3408183740 1 -- start start 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0827bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f3408183740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0857c00 0x5648e082ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f3408183740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5648e0790cf0 con 0x5648e0857c00 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648e0749e10 con 0x5648e0875220 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5648e078ccb0 con 0x5648e0858340 2024-05-10T08:48:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0857c00 0x5648e082ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0857c00 0x5648e082ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51764/0 (socket says 172.21.15.37:51764) 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 -- 172.21.15.37:0/4245192670 learned_addr learned my addr 172.21.15.37:0/4245192670 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33feffd640 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0827bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 -- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 msgr2=0x5648e08576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 -- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 msgr2=0x5648e0827bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0827bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.587+0000 7f33ff7fe640 1 -- 172.21.15.37:0/4245192670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e056a7e0 con 0x5648e0857c00 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.588+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0857c00 0x5648e082ca10 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f33f800c420 tx=0x7f33f800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869efd094573153b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.588+0000 7f33e4ff9640 1 -- 172.21.15.37:0/4245192670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8016420 con 0x5648e0857c00 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.588+0000 7f33e4ff9640 1 -- 172.21.15.37:0/4245192670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f80165c0 con 0x5648e0857c00 2024-05-10T08:48:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.588+0000 7f33e4ff9640 1 -- 172.21.15.37:0/4245192670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8016970 con 0x5648e0857c00 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 -- 172.21.15.37:0/4245192670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0857c00 msgr2=0x5648e082ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0857c00 0x5648e082ca10 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f33f800c420 tx=0x7f33f800c820 comp rx=0 tx=0).stop 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 -- 172.21.15.37:0/4245192670 shutdown_connections 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0857c00 0x5648e082ca10 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 --2- 172.21.15.37:0/4245192670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0827bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 -- 172.21.15.37:0/4245192670 >> 172.21.15.37:0/4245192670 conn(0x5648e0829e20 msgr2=0x5648e08726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 -- 172.21.15.37:0/4245192670 shutdown_connections 2024-05-10T08:48:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 -- 172.21.15.37:0/4245192670 wait complete. 2024-05-10T08:48:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 -- start start 2024-05-10T08:48:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.589+0000 7f3408183740 1 Processor -- start 2024-05-10T08:48:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f3408183740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e08713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0883810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0873d90 0x5648e0874210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f3408183740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5648e082bfd0 con 0x5648e0858340 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648e074d940 con 0x5648e0875220 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5648e082b3c0 con 0x5648e0873d90 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f33feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e08713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f3408183740 10 client.0 _ll_register_callbacks cb 0x5648e0750440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f33feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e08713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51774/0 (socket says 172.21.15.37:51774) 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f33feffd640 1 -- 172.21.15.37:0/1849549361 learned_addr learned my addr 172.21.15.37:0/1849549361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0883810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.590+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0873d90 0x5648e0874210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33feffd640 1 -- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0873d90 msgr2=0x5648e0874210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33feffd640 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0873d90 0x5648e0874210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33feffd640 1 -- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 msgr2=0x5648e0883810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33feffd640 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0883810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33feffd640 1 -- 172.21.15.37:0/1849549361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e05caf70 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33feffd640 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e08713b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f33f000df40 tx=0x7f33f00046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaa657bef332e52 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33ddffb640 1 -- 172.21.15.37:0/1849549361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0024030 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33ddffb640 1 -- 172.21.15.37:0/1849549361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f33f001d040 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f80165c0 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33ddffb640 1 -- 172.21.15.37:0/1849549361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f33f002d050 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f3408183740 10 client.7857 fetch_fsmap learned FSMap version 87 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5648e0462170 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33ddffb640 1 -- 172.21.15.37:0/1849549361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f80165c0 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.591+0000 7f33ddffb640 1 -- 172.21.15.37:0/1849549361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f33f0030020 con 0x5648e0858340 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f3408183740 10 client.7857 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f3408183740 10 client.7857 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f3408183740 20 client.7857 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f3408183740 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e0886880 0x5648e0886cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f3408183740 4 client.7857 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648e079e900 con 0x5648e0886880 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e0886880 0x5648e0886cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f33ddffb640 10 client.7857 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.592+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e0886880 0x5648e0886cd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6419f514b7ec0459 server_cookie=b7644df8d6e7be48 in_seq=0 out_seq=0 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f33ddffb640 1 -- 172.21.15.37:0/1849549361 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5648e079e900 con 0x5648e0886880 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f33ddffb640 10 client.7857 handle_command_reply: tid=0 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 client.7857 shutdown 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 msgr2=0x5648e08713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e08713b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f33f000df40 tx=0x7f33f00046f0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 shutdown_connections 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e0886880 0x5648e0886cd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0873d90 0x5648e0874210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0875220 0x5648e0883810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 --2- 172.21.15.37:0/1849549361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e08713b0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f33ddffb640 0 client.7857 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 >> 172.21.15.37:0/1849549361 conn(0x5648e0857c00 msgr2=0x5648e08272f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 shutdown_connections 2024-05-10T08:48:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 1 -- 172.21.15.37:0/1849549361 wait complete. 2024-05-10T08:48:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.593+0000 7f3408183740 20 client.7857 trim_cache size 0 max 16384 2024-05-10T08:48:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.598+0000 7f9b0e7f2640 1 Processor -- start 2024-05-10T08:48:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.598+0000 7f9b0e7f2640 1 -- start start 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.599+0000 7f9b0e7f2640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b080736f0 0x7f9b080cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.599+0000 7f9b0e7f2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b08160900 con 0x7f9b08160450 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.599+0000 7f9b0e7f2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0815cf80 con 0x7f9b080ce050 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.599+0000 7f9b0e7f2640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0815ffc0 con 0x7f9b080736f0 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.599+0000 7f9b077fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9b08160450 0x7f9b08072fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45446/0 (socket says 172.21.15.37:45446) 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.599+0000 7f9b077fe640 1 -- 172.21.15.37:0/1844817864 learned_addr learned my addr 172.21.15.37:0/1844817864 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b0cd8f640 1 --2- 172.21.15.37:0/1844817864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b080736f0 0x7f9b080cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b06ffd640 1 -- 172.21.15.37:0/1844817864 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874274709 0 0) 0x7f9b08160900 con 0x7f9b08160450 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b06ffd640 1 -- 172.21.15.37:0/1844817864 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af0003520 con 0x7f9b08160450 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b06ffd640 1 -- 172.21.15.37:0/1844817864 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052154329 0 0) 0x7f9b0815cf80 con 0x7f9b080ce050 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b06ffd640 1 -- 172.21.15.37:0/1844817864 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b08160900 con 0x7f9b080ce050 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b0cd8f640 1 -- 172.21.15.37:0/1844817864 >> v1:172.21.15.82:6789/0 conn(0x7f9b080ce050 legacy=0x7f9b0815c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b0cd8f640 1 -- 172.21.15.37:0/1844817864 >> v1:172.21.15.37:6789/0 conn(0x7f9b08160450 legacy=0x7f9b08072fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.600+0000 7f9b0cd8f640 1 -- 172.21.15.37:0/1844817864 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0815d260 con 0x7f9b080736f0 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b0cd8f640 1 --2- 172.21.15.37:0/1844817864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b080736f0 0x7f9b080cf920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009dc0 tx=0x7f9b0002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f7d0231126df10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b06ffd640 1 -- 172.21.15.37:0/1844817864 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00007740 con 0x7f9b080736f0 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b06ffd640 1 -- 172.21.15.37:0/1844817864 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b000078e0 con 0x7f9b080736f0 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b06ffd640 1 -- 172.21.15.37:0/1844817864 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00007cb0 con 0x7f9b080736f0 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/1844817864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b080736f0 msgr2=0x7f9b080cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b0e7f2640 1 --2- 172.21.15.37:0/1844817864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b080736f0 0x7f9b080cf920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009dc0 tx=0x7f9b0002a6d0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/1844817864 shutdown_connections 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b0e7f2640 1 --2- 172.21.15.37:0/1844817864 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b080736f0 0x7f9b080cf920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.601+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/1844817864 >> 172.21.15.37:0/1844817864 conn(0x7f9b080d1d50 msgr2=0x7f9b080d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.602+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/1844817864 shutdown_connections 2024-05-10T08:48:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.602+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/1844817864 wait complete. 2024-05-10T08:48:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.603+0000 7f9b0e7f2640 1 Processor -- start 2024-05-10T08:48:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.603+0000 7f9b0e7f2640 1 -- start start 2024-05-10T08:48:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b0e7f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b080736f0 0x7f9b08149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b0e7f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b080ce050 0x7f9b080c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b0e7f2640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b08160450 0x7f9b080b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b0e7f2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b080d1460 con 0x7f9b080ce050 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b0e7f2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0815fc50 con 0x7f9b080736f0 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b0e7f2640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0815cb60 con 0x7f9b08160450 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b080ce050 0x7f9b080c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b080ce050 0x7f9b080c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51778/0 (socket says 172.21.15.37:51778) 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 -- 172.21.15.37:0/444989644 learned_addr learned my addr 172.21.15.37:0/444989644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b07fff640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b080736f0 0x7f9b08149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b0cd8f640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b08160450 0x7f9b080b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 -- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b08160450 msgr2=0x7f9b080b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9b08160450 0x7f9b080b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 -- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b080736f0 msgr2=0x7f9b08149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b080736f0 0x7f9b08149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 -- 172.21.15.37:0/444989644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0814a030 con 0x7f9b080ce050 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b077fe640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b080ce050 0x7f9b080c8e20 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c410 tx=0x7f9afc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.604+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc017070 con 0x7f9b080ce050 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.605+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc005ce0 con 0x7f9b080ce050 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.605+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/444989644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b080b56a0 con 0x7f9b080ce050 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.605+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0072d0 con 0x7f9b080ce050 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.605+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/444989644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b080c74b0 con 0x7f9b080ce050 2024-05-10T08:48:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.605+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/444989644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f9b08069b00 con 0x7f9b080ce050 2024-05-10T08:48:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.606+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9afc01a070 con 0x7f9b080ce050 2024-05-10T08:48:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.607+0000 7f9b04ff9640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9af40762d0 0x7f9af4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.607+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f9afc0976d0 con 0x7f9b080ce050 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.607+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+512 (secure 0 0 0) 0x7f9afc097b60 con 0x7f9b080ce050 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.607+0000 7f9b07fff640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9af40762d0 0x7f9af4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.607+0000 7f9b0e7f2640 1 -- 172.21.15.37:0/444989644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f9b080cd3b0 con 0x7f9b080ce050 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.607+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 7 ==== log(2 entries from seq 928 at 2024-05-10T08:48:37.979182+0000) ==== 389+0+0 (secure 0 0 0) 0x7f9afc095e00 con 0x7f9b080ce050 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stdout: cluster: 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stdout: id: 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stdout: health: HEALTH_OK 2024-05-10T08:48:39.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: services: 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: mgr: x(active, since 8m), standbys: y 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: mds: 1/1 daemons up, 3 standby 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: data: 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: volumes: 1/1 healthy 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: pools: 3 pools, 97 pgs 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: objects: 30 objects, 19 MiB 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: pgs: 97 active+clean 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: io: 2024-05-10T08:48:39.609 INFO:teuthology.orchestra.run.smithi037.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-05-10T08:48:39.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:39.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:48:39.610 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:37.979182+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T08:48:39.610 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:37.979213+0000 mon.a [INF] Cluster is now healthy 2024-05-10T08:48:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.608+0000 7f9b07fff640 1 --2- 172.21.15.37:0/444989644 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9af40762d0 0x7f9af4078790 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9af8007fd0 tx=0x7f9af8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.613+0000 7f3408183740 1 Processor -- start 2024-05-10T08:48:39.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.613+0000 7f3408183740 1 -- start start 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08833e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f3408183740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0875220 0x5648e087f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f3408183740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3400202180 con 0x5648e0875220 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3400201200 con 0x5648e0873d90 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f340015b680 con 0x5648e0858340 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f33ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0875220 0x5648e087f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f33ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0875220 0x5648e087f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51794/0 (socket says 172.21.15.37:51794) 2024-05-10T08:48:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f33ff7fe640 1 -- 172.21.15.37:0/1169918108 learned_addr learned my addr 172.21.15.37:0/1169918108 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.614+0000 7f33feffd640 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08833e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33ff7fe640 1 -- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 msgr2=0x5648e08833e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08833e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33ff7fe640 1 -- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 msgr2=0x5648e087edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33ff7fe640 1 -- 172.21.15.37:0/1169918108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e082af60 con 0x5648e0875220 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33feffd640 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08833e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0875220 0x5648e087f2f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009fb0 tx=0x7f33f8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d619b5090b2cf36 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33dffff640 1 -- 172.21.15.37:0/1169918108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8009ab0 con 0x5648e0875220 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33dffff640 1 -- 172.21.15.37:0/1169918108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f801f460 con 0x5648e0875220 2024-05-10T08:48:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.615+0000 7f33dffff640 1 -- 172.21.15.37:0/1169918108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f801f630 con 0x5648e0875220 2024-05-10T08:48:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 -- 172.21.15.37:0/1169918108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0875220 msgr2=0x5648e087f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0875220 0x5648e087f2f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009fb0 tx=0x7f33f8011000 comp rx=0 tx=0).stop 2024-05-10T08:48:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 -- 172.21.15.37:0/1169918108 shutdown_connections 2024-05-10T08:48:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0875220 0x5648e087f2f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 --2- 172.21.15.37:0/1169918108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0858340 0x5648e08833e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 -- 172.21.15.37:0/1169918108 >> 172.21.15.37:0/1169918108 conn(0x5648e0857c00 msgr2=0x5648e085ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 -- 172.21.15.37:0/1169918108 shutdown_connections 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 -- 172.21.15.37:0/1169918108 wait complete. 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 -- start start 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.616+0000 7f3408183740 1 Processor -- start 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f3408183740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e087edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f3408183740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0875220 0x5648e087f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f3408183740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5648e082dae0 con 0x5648e0858340 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f340015bcd0 con 0x5648e0873d90 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f3408183740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5648e082a9c0 con 0x5648e0875220 2024-05-10T08:48:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f3408183740 10 client.0 _ll_register_callbacks cb 0x7f33f000bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f33feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e087edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f33feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e087edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51800/0 (socket says 172.21.15.37:51800) 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f33feffd640 1 -- 172.21.15.37:0/3490702750 learned_addr learned my addr 172.21.15.37:0/3490702750 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f33ff7fe640 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0875220 0x5648e087f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.617+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33feffd640 1 -- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0875220 msgr2=0x5648e087f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33feffd640 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0875220 0x5648e087f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33feffd640 1 -- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 msgr2=0x5648e087f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33feffd640 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33feffd640 1 -- 172.21.15.37:0/3490702750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e085a550 con 0x5648e0858340 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33feffd640 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e087edb0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f33f0028820 tx=0x7f33f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d57e30f74c58f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33ddffb640 1 -- 172.21.15.37:0/3490702750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0035070 con 0x5648e0858340 2024-05-10T08:48:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33ddffb640 1 -- 172.21.15.37:0/3490702750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f33f0028a00 con 0x5648e0858340 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f801f460 con 0x5648e0858340 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33ddffb640 1 -- 172.21.15.37:0/3490702750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f33f0040050 con 0x5648e0858340 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 10 client.7869 fetch_fsmap learned FSMap version 87 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5648e0874370 con 0x5648e0858340 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33ddffb640 1 -- 172.21.15.37:0/3490702750 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f801f460 con 0x5648e0858340 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f33ddffb640 1 -- 172.21.15.37:0/3490702750 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f33f0043020 con 0x5648e0858340 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 10 client.7869 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 10 client.7869 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 20 client.7869 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e08f07e0 0x5648e0826a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 4 client.7869 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.618+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x5648e0798770 con 0x5648e08f07e0 2024-05-10T08:48:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.619+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e08f07e0 0x5648e0826a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.619+0000 7f33fe7fc640 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e08f07e0 0x5648e0826a60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f6eee161a23e11 server_cookie=57d0fa37d2745cdd in_seq=0 out_seq=0 2024-05-10T08:48:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.619+0000 7f33ddffb640 10 client.7869 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.619+0000 7f33ddffb640 1 -- 172.21.15.37:0/3490702750 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5648e0798770 con 0x5648e08f07e0 2024-05-10T08:48:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f33ddffb640 10 client.7869 handle_command_reply: tid=0 2024-05-10T08:48:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 client.7869 shutdown 2024-05-10T08:48:39.623 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-05-10T08:48:39.623 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-05-10T08:48:39.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 msgr2=0x5648e087edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e087edb0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f33f0028820 tx=0x7f33f0014000 comp rx=0 tx=0).stop 2024-05-10T08:48:39.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 shutdown_connections 2024-05-10T08:48:39.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x5648e08f07e0 0x5648e0826a60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.624 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-05-10T08:48:39.624 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-05-10T08:48:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f33ddffb640 0 client.7869 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5648e0875220 0x5648e087f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648e0873d90 0x5648e087f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 --2- 172.21.15.37:0/3490702750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e0858340 0x5648e087edb0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 >> 172.21.15.37:0/3490702750 conn(0x5648e0857c00 msgr2=0x5648e0875ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 shutdown_connections 2024-05-10T08:48:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 1 -- 172.21.15.37:0/3490702750 wait complete. 2024-05-10T08:48:39.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.620+0000 7f3408183740 20 client.7869 trim_cache size 0 max 16384 2024-05-10T08:48:39.626 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:48:39.626 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-10T08:48:39.626 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "6880de42-c2c9-4718-ac96-b44d56dd9a54", 2024-05-10T08:48:39.626 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-10T08:48:39.626 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:48:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33ec0762d0 msgr2=0x7f33ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33ec0762d0 0x7f33ec078790 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).stop 2024-05-10T08:48:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340015d3d0 msgr2=0x7f340015c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340015d3d0 0x7f340015c8b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009870 tx=0x7f33f40046c0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 shutdown_connections 2024-05-10T08:48:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f33ec0762d0 0x7f33ec078790 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3400160d50 0x7f34001f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340015d3d0 0x7f340015c8b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 --2- 172.21.15.37:0/3047541923 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34000d2760 0x7f340015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 >> 172.21.15.37:0/3047541923 conn(0x7f340009ba40 msgr2=0x7f34001559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 shutdown_connections 2024-05-10T08:48:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.621+0000 7f3405474640 1 -- 172.21.15.37:0/3047541923 wait complete. 2024-05-10T08:48:39.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:48:39.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T08:48:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.738+0000 7fc634812640 1 Processor -- start 2024-05-10T08:48:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.738+0000 7fc634812640 1 -- start start 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.739+0000 7fc634812640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 0x7fc63006e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.739+0000 7fc634812640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6300b4590 con 0x7fc63015bc80 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.739+0000 7fc634812640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6300b4870 con 0x7fc6301524f0 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.739+0000 7fc634812640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc6300d1300 con 0x7fc63006e390 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.739+0000 7fc62e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc63015bc80 0x7fc6300d0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45462/0 (socket says 172.21.15.37:45462) 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.739+0000 7fc62e59c640 1 -- 172.21.15.37:0/1802195931 learned_addr learned my addr 172.21.15.37:0/1802195931 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189727237 0 0) 0x7fc6300b4590 con 0x7fc63015bc80 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 0x7fc63006e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc618005730 con 0x7fc63015bc80 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2006415791 0 0) 0x7fc618005730 con 0x7fc63015bc80 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 msgr2=0x7fc63006e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 0x7fc63006e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 >> v1:172.21.15.82:6789/0 conn(0x7fc6301524f0 legacy=0x7fc6300b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6300b4b50 con 0x7fc63015bc80 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fc620001670 con 0x7fc63015bc80 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 >> v1:172.21.15.37:6789/0 conn(0x7fc63015bc80 legacy=0x7fc6300d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc618005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 0x7fc618006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc618006f50 0x7fc6180073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6300d1300 con 0x7fc618005bf0 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc61800dbd0 con 0x7fc618006f50 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc61800ddd0 con 0x7fc63006e390 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc618005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 0x7fc618006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc618006f50 0x7fc6180073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62e59c640 1 -- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 msgr2=0x7fc618006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc63006e390 0x7fc618006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62e59c640 1 -- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc618006f50 msgr2=0x7fc6180073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc618006f50 0x7fc6180073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.740+0000 7fc62e59c640 1 -- 172.21.15.37:0/1802195931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc618005730 con 0x7fc618005bf0 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.741+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc618005fd0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c240 tx=0x7fc618007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337df254d56a43b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.741+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620007d30 con 0x7fc618005bf0 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.741+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc620005af0 con 0x7fc618005bf0 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.741+0000 7fc62d59a640 1 -- 172.21.15.37:0/1802195931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620007070 con 0x7fc618005bf0 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.742+0000 7fc634812640 1 -- 172.21.15.37:0/1802195931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 msgr2=0x7fc618005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.742+0000 7fc634812640 1 --2- 172.21.15.37:0/1802195931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc618005fd0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c240 tx=0x7fc618007a40 comp rx=0 tx=0).stop 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.742+0000 7fc62ed9d640 1 -- 172.21.15.37:0/1802195931 reap_dead start 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.742+0000 7fc634812640 1 -- 172.21.15.37:0/1802195931 shutdown_connections 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.742+0000 7fc634812640 1 -- 172.21.15.37:0/1802195931 >> 172.21.15.37:0/1802195931 conn(0x7fc63006c3a0 msgr2=0x7fc63006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.742+0000 7fc634812640 1 -- 172.21.15.37:0/1802195931 shutdown_connections 2024-05-10T08:48:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.742+0000 7fc634812640 1 -- 172.21.15.37:0/1802195931 wait complete. 2024-05-10T08:48:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.743+0000 7fc634812640 1 Processor -- start 2024-05-10T08:48:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.743+0000 7fc634812640 1 -- start start 2024-05-10T08:48:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc634812640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc6301f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc634812640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6300b0130 0x7fc6301485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc634812640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63009c510 0x7fc6301e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc634812640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6300b4330 con 0x7fc618005bf0 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc634812640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6300b51a0 con 0x7fc63009c510 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc634812640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc6301528f0 con 0x7fc6300b0130 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc62e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc6301f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc62e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc6301f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51816/0 (socket says 172.21.15.37:51816) 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc62e59c640 1 -- 172.21.15.37:0/1123903525 learned_addr learned my addr 172.21.15.37:0/1123903525 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.744+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6300b0130 0x7fc6301485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63009c510 0x7fc6301e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62e59c640 1 -- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6300b0130 msgr2=0x7fc6301485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6300b0130 0x7fc6301485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62e59c640 1 -- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63009c510 msgr2=0x7fc6301e5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63009c510 0x7fc6301e5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62e59c640 1 -- 172.21.15.37:0/1123903525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6301f94e0 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6300b0130 0x7fc6301485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc6301f8660 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc62002ad80 tx=0x7fc63015bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc61effd640 1 -- 172.21.15.37:0/1123903525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620041020 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc61effd640 1 -- 172.21.15.37:0/1123903525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc620001430 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc630148b30 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc61effd640 1 -- 172.21.15.37:0/1123903525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620007070 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.745+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6301f8f20 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.747+0000 7fc61effd640 1 -- 172.21.15.37:0/1123903525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc620044020 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.747+0000 7fc61effd640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc610076300 0x7fc6100787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.747+0000 7fc61effd640 1 -- 172.21.15.37:0/1123903525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fc6200b7bb0 con 0x7fc618005bf0 2024-05-10T08:48:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.748+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc610076300 0x7fc6100787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.748+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc610076300 0x7fc6100787c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc6300af7e0 tx=0x7fc624009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.748+0000 7fc637605740 1 Processor -- start 2024-05-10T08:48:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.748+0000 7fc637605740 1 -- start start 2024-05-10T08:48:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc637605740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x5597117e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711817600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711817b40 0x5597117ec950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc637605740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5597117b4690 con 0x559711835160 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559711751f30 con 0x559711818280 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55971170ab20 con 0x559711817b40 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc62e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x5597117e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc62e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x5597117e7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51826/0 (socket says 172.21.15.37:51826) 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc62e59c640 1 -- 172.21.15.37:0/1913427632 learned_addr learned my addr 172.21.15.37:0/1913427632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711817600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.749+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711817b40 0x5597117ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc62e59c640 1 -- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711817b40 msgr2=0x5597117ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711817b40 0x5597117ec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc62e59c640 1 -- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 msgr2=0x559711817600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711817600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc62e59c640 1 -- 172.21.15.37:0/1913427632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559711702e60 con 0x559711835160 2024-05-10T08:48:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711817600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x5597117e7af0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc6200b5df0 tx=0x7fc620080ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ce40d7acd0102b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc60ffff640 1 -- 172.21.15.37:0/1913427632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620089300 con 0x559711835160 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc60ffff640 1 -- 172.21.15.37:0/1913427632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6200812e0 con 0x559711835160 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.750+0000 7fc60ffff640 1 -- 172.21.15.37:0/1913427632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620080be0 con 0x559711835160 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 -- 172.21.15.37:0/1913427632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 msgr2=0x5597117e7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x5597117e7af0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc6200b5df0 tx=0x7fc620080ab0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 -- 172.21.15.37:0/1913427632 shutdown_connections 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711817b40 0x5597117ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711817600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 --2- 172.21.15.37:0/1913427632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x5597117e7af0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 -- 172.21.15.37:0/1913427632 >> 172.21.15.37:0/1913427632 conn(0x5597117e9d60 msgr2=0x559711832600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 -- 172.21.15.37:0/1913427632 shutdown_connections 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 -- 172.21.15.37:0/1913427632 wait complete. 2024-05-10T08:48:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 -- start start 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.751+0000 7fc637605740 1 Processor -- start 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711819c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc637605740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711833730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x559711833c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc637605740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55971170e5e0 con 0x559711835160 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55971174def0 con 0x559711818280 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55971170ab20 con 0x559711807ed0 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc637605740 10 client.0 _ll_register_callbacks cb 0x559711709320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc62dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711833730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc62dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711833730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51832/0 (socket says 172.21.15.37:51832) 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc62dd9b640 1 -- 172.21.15.37:0/1805190942 learned_addr learned my addr 172.21.15.37:0/1805190942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711819c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.752+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x559711833c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc62dd9b640 1 -- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 msgr2=0x559711833c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x559711833c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc62dd9b640 1 -- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 msgr2=0x559711819c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711819c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc62dd9b640 1 -- 172.21.15.37:0/1805190942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971152d7d0 con 0x559711835160 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711833730 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fc624001e40 tx=0x7fc624007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2db4d12abd8279f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc60d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc60d7fa640 1 -- 172.21.15.37:0/1805190942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624022400 con 0x559711835160 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc60d7fa640 1 -- 172.21.15.37:0/1805190942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fc624024940 con 0x559711835160 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6200812e0 con 0x559711835160 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc60d7fa640 1 -- 172.21.15.37:0/1805190942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc624024b40 con 0x559711835160 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc637605740 10 client.7881 fetch_fsmap learned FSMap version 87 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5597114633f0 con 0x559711835160 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc60d7fa640 1 -- 172.21.15.37:0/1805190942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6200812e0 con 0x559711835160 2024-05-10T08:48:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc60d7fa640 1 -- 172.21.15.37:0/1805190942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7fc624024ce0 con 0x559711835160 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc637605740 10 client.7881 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.753+0000 7fc637605740 10 client.7881 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc637605740 20 client.7881 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc637605740 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711818c40 0x559711819080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc637605740 4 client.7881 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55971175fb40 con 0x559711818c40 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711818c40 0x559711819080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc62e59c640 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711818c40 0x559711819080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39c4f9e47ed0e81b server_cookie=ba13d22bee4a10c7 in_seq=0 out_seq=0 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc60d7fa640 10 client.7881 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc60d7fa640 1 -- 172.21.15.37:0/1805190942 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55971175fb40 con 0x559711818c40 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc60d7fa640 10 client.7881 handle_command_reply: tid=0 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.754+0000 7fc637605740 1 client.7881 shutdown 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 msgr2=0x559711833730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711833730 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fc624001e40 tx=0x7fc624007ca0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 shutdown_connections 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711818c40 0x559711819080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x559711833c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711833730 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 --2- 172.21.15.37:0/1805190942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x559711819c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc60d7fa640 0 client.7881 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 >> 172.21.15.37:0/1805190942 conn(0x559711817b40 msgr2=0x5597117e8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 shutdown_connections 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 1 -- 172.21.15.37:0/1805190942 wait complete. 2024-05-10T08:48:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.755+0000 7fc637605740 20 client.7881 trim_cache size 0 max 16384 2024-05-10T08:48:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.773+0000 7fc637605740 1 Processor -- start 2024-05-10T08:48:39.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.773+0000 7fc637605740 1 -- start start 2024-05-10T08:48:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc637605740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711835160 0x559711827f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc637605740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc630202690 con 0x559711818280 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6302016b0 con 0x559711807ed0 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc630200a40 con 0x559711835160 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51840/0 (socket says 172.21.15.37:51840) 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 -- 172.21.15.37:0/2333562202 learned_addr learned my addr 172.21.15.37:0/2333562202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62e59c640 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711835160 0x559711827f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 -- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711835160 msgr2=0x559711827f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711835160 0x559711827f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 -- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711807ed0 msgr2=0x5597118334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 -- 172.21.15.37:0/2333562202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597114230f0 con 0x559711818280 2024-05-10T08:48:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711835160 0x559711827f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711818280 0x5597118339e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fc624014ca0 tx=0x7fc62401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95767566d25409a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc60f7fe640 1 -- 172.21.15.37:0/2333562202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624024ce0 con 0x559711818280 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc60f7fe640 1 -- 172.21.15.37:0/2333562202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc624022400 con 0x559711818280 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.774+0000 7fc60f7fe640 1 -- 172.21.15.37:0/2333562202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624024e80 con 0x559711818280 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 -- 172.21.15.37:0/2333562202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711818280 msgr2=0x5597118339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711818280 0x5597118339e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fc624014ca0 tx=0x7fc62401c000 comp rx=0 tx=0).stop 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 -- 172.21.15.37:0/2333562202 shutdown_connections 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711835160 0x559711827f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 --2- 172.21.15.37:0/2333562202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 -- 172.21.15.37:0/2333562202 >> 172.21.15.37:0/2333562202 conn(0x559711817b40 msgr2=0x5597117e3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 -- 172.21.15.37:0/2333562202 shutdown_connections 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 -- 172.21.15.37:0/2333562202 wait complete. 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.775+0000 7fc637605740 1 -- start start 2024-05-10T08:48:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 1 Processor -- start 2024-05-10T08:48:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711835a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5597117b4690 con 0x559711835160 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc630201060 con 0x559711818280 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x559711751f30 con 0x559711807ed0 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.776+0000 7fc637605740 10 client.0 _ll_register_callbacks cb 0x7fc624007a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711835a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711835a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51846/0 (socket says 172.21.15.37:51846) 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 -- 172.21.15.37:0/2513160125 learned_addr learned my addr 172.21.15.37:0/2513160125 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62dd9b640 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62e59c640 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 -- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 msgr2=0x5597118334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 -- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 msgr2=0x5597118339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 -- 172.21.15.37:0/2513160125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559711830f40 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc62ed9d640 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711835a20 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc628019e20 tx=0x7fc628017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d60462521f2b4b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc60d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc60d7fa640 1 -- 172.21.15.37:0/2513160125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628003b90 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc60d7fa640 1 -- 172.21.15.37:0/2513160125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fc628003d30 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc624022400 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc60d7fa640 1 -- 172.21.15.37:0/2513160125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc628004030 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc637605740 10 client.7887 fetch_fsmap learned FSMap version 87 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.777+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5597118125e0 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc60d7fa640 1 -- 172.21.15.37:0/2513160125 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc624022400 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc60d7fa640 1 -- 172.21.15.37:0/2513160125 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7fc62802a050 con 0x559711835160 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 10 client.7887 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 10 client.7887 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 20 client.7887 populate_metadata read hostname 'smithi037' 2024-05-10T08:48:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711897760 0x559711835f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 4 client.7887 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597117599b0 con 0x559711897760 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc62e59c640 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711897760 0x559711835f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc60d7fa640 10 client.7887 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc62e59c640 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711897760 0x559711835f60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b7d8ec89276551 server_cookie=7a3da658e1f5b54 in_seq=0 out_seq=0 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc60d7fa640 1 -- 172.21.15.37:0/2513160125 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x5597117599b0 con 0x559711897760 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc60d7fa640 10 client.7887 handle_command_reply: tid=0 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 client.7887 shutdown 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 msgr2=0x559711835a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711835a20 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc628019e20 tx=0x7fc628017780 comp rx=0 tx=0).stop 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 shutdown_connections 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x559711897760 0x559711835f60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559711835160 0x559711835a20 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559711818280 0x5597118339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 --2- 172.21.15.37:0/2513160125 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x559711807ed0 0x5597118334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc60d7fa640 0 client.7887 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.778+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 >> 172.21.15.37:0/2513160125 conn(0x559711817b40 msgr2=0x5597117e31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 shutdown_connections 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc637605740 1 -- 172.21.15.37:0/2513160125 wait complete. 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc637605740 20 client.7887 trim_cache size 0 max 16384 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T08:48:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-10T08:48:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: "6880de42-c2c9-4718-ac96-b44d56dd9a54": { 2024-05-10T08:48:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-10T08:48:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "6880de42-c2c9-4718-ac96-b44d56dd9a54", 2024-05-10T08:48:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2024-05-10T08:48:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:48:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:48:39.785 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc610076300 msgr2=0x7fc6100787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc610076300 0x7fc6100787c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc6300af7e0 tx=0x7fc624009040 comp rx=0 tx=0).stop 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 msgr2=0x7fc6301f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc6301f8660 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc62002ad80 tx=0x7fc63015bb30 comp rx=0 tx=0).stop 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 shutdown_connections 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc610076300 0x7fc6100787c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63009c510 0x7fc6301e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6300b0130 0x7fc6301485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 --2- 172.21.15.37:0/1123903525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc618005bf0 0x7fc6301f8660 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:48:39.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 >> 172.21.15.37:0/1123903525 conn(0x7fc63006c3a0 msgr2=0x7fc63006e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:48:39.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 shutdown_connections 2024-05-10T08:48:39.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:39.779+0000 7fc634812640 1 -- 172.21.15.37:0/1123903525 wait complete. 2024-05-10T08:48:39.789 INFO:tasks.cephfs.filesystem:scrub status for tag:6880de42-c2c9-4718-ac96-b44d56dd9a54 - {'path': '/', 'tag': '6880de42-c2c9-4718-ac96-b44d56dd9a54', 'options': 'recursive,repair'} 2024-05-10T08:48:40.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:40.993+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 8 ==== log(8 entries from seq 1 at 2024-05-10T08:48:39.620539+0000) ==== 1407+0+0 (secure 0 0 0) 0x7f9afc095af0 con 0x7f9b080ce050 2024-05-10T08:48:40.992 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.620539+0000 mds.a [INF] scrub queued for path: / 2024-05-10T08:48:40.993 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.620543+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-05-10T08:48:40.993 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.620549+0000 mds.a [INF] scrub summary: active paths [/] 2024-05-10T08:48:40.993 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.621069+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-05-10T08:48:40.993 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.621075+0000 mds.a [ERR] inode table repaired for inode: 0x10000000001 2024-05-10T08:48:40.993 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.621269+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-05-10T08:48:40.993 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.621276+0000 mds.a [ERR] inode table repaired for inode: 0x10000000002 2024-05-10T08:48:40.993 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:39.621715+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-05-10T08:48:42.001 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:48:41.606465+0000 mds.a [INF] scrub summary: idle 2024-05-10T08:48:42.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:48:42.002+0000 7f9b04ff9640 1 -- 172.21.15.37:0/444989644 <== mon.0 v2:172.21.15.37:3300/0 9 ==== log(1 entries from seq 9 at 2024-05-10T08:48:41.606465+0000) ==== 189+0+0 (secure 0 0 0) 0x7f9afc05ca50 con 0x7f9b080ce050 2024-05-10T08:48:42.569 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-10T08:48:42.570+0000 7fa064db7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:48:54.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:48:54.468 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:49:09.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:09.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-05-10T08:49:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.911+0000 7fef498f1640 1 Processor -- start 2024-05-10T08:49:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.911+0000 7fef498f1640 1 -- start start 2024-05-10T08:49:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef498f1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef4406e0f0 0x7fef4415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef498f1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef44072840 0x7fef440d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef498f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef4406e4d0 0x7fef440b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef498f1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fef440d14b0 con 0x7fef4406e4d0 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef498f1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fef4415c920 con 0x7fef4406e0f0 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef498f1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fef4415cc00 con 0x7fef44072840 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef4406e4d0 0x7fef440b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef4406e4d0 0x7fef440b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36244/0 (socket says 172.21.15.37:36244) 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 -- 172.21.15.37:0/2874409579 learned_addr learned my addr 172.21.15.37:0/2874409579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/2874409579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef44072840 0x7fef440d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2874409579 >> v2:172.21.15.82:3300/0 conn(0x7fef4406e0f0 0x7fef4415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 -- 172.21.15.37:0/2874409579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef44072840 msgr2=0x7fef440d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 --2- 172.21.15.37:0/2874409579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef44072840 0x7fef440d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 -- 172.21.15.37:0/2874409579 >> v2:172.21.15.82:3300/0 conn(0x7fef4406e0f0 msgr2=0x7fef4415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 --2- 172.21.15.37:0/2874409579 >> v2:172.21.15.82:3300/0 conn(0x7fef4406e0f0 0x7fef4415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef437fe640 1 -- 172.21.15.37:0/2874409579 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4415cee0 con 0x7fef4406e4d0 2024-05-10T08:49:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.912+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2874409579 >> v2:172.21.15.82:3300/0 conn(0x7fef4406e0f0 0x7fef4415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.913+0000 7fef437fe640 1 --2- 172.21.15.37:0/2874409579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b4e30 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fef440d1cf0 tx=0x7fef3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7efc3f3bc97feee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.913+0000 7fef427fc640 1 -- 172.21.15.37:0/2874409579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c036070 con 0x7fef4406e4d0 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.913+0000 7fef427fc640 1 -- 172.21.15.37:0/2874409579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3c031600 con 0x7fef4406e4d0 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.913+0000 7fef427fc640 1 -- 172.21.15.37:0/2874409579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0319d0 con 0x7fef4406e4d0 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 -- 172.21.15.37:0/2874409579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 msgr2=0x7fef440b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 --2- 172.21.15.37:0/2874409579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b4e30 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fef440d1cf0 tx=0x7fef3c02a6a0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 -- 172.21.15.37:0/2874409579 shutdown_connections 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 --2- 172.21.15.37:0/2874409579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b4e30 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 --2- 172.21.15.37:0/2874409579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef44072840 0x7fef440d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 --2- 172.21.15.37:0/2874409579 >> v2:172.21.15.82:3300/0 conn(0x7fef4406e0f0 0x7fef4415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 -- 172.21.15.37:0/2874409579 >> 172.21.15.37:0/2874409579 conn(0x7fef4406c3a0 msgr2=0x7fef4406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 -- 172.21.15.37:0/2874409579 shutdown_connections 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.914+0000 7fef498f1640 1 -- 172.21.15.37:0/2874409579 wait complete. 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.915+0000 7fef498f1640 1 Processor -- start 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.915+0000 7fef498f1640 1 -- start start 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef498f1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef4406e0f0 0x7fef441520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef498f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef498f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44072840 0x7fef440b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef498f1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef440ae650 con 0x7fef4406e4d0 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef498f1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef4406e980 con 0x7fef44072840 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef498f1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fef440ae7d0 con 0x7fef4406e0f0 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36254/0 (socket says 172.21.15.37:36254) 2024-05-10T08:49:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 -- 172.21.15.37:0/1608736429 learned_addr learned my addr 172.21.15.37:0/1608736429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef42ffd640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef4406e0f0 0x7fef441520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef437fe640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44072840 0x7fef440b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 -- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef4406e0f0 msgr2=0x7fef441520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef4406e0f0 0x7fef441520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 -- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44072840 msgr2=0x7fef440b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44072840 0x7fef440b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef3a7fc640 1 -- 172.21.15.37:0/1608736429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef440b3560 con 0x7fef4406e4d0 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef42ffd640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef4406e0f0 0x7fef441520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.916+0000 7fef437fe640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44072840 0x7fef440b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.917+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b0d00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00d5c0 tx=0x7fef2c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.917+0000 7fef40ff9640 1 -- 172.21.15.37:0/1608736429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0125f0 con 0x7fef4406e4d0 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.917+0000 7fef40ff9640 1 -- 172.21.15.37:0/1608736429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c019070 con 0x7fef4406e4d0 2024-05-10T08:49:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.917+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef440b2cc0 con 0x7fef4406e4d0 2024-05-10T08:49:09.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.917+0000 7fef40ff9640 1 -- 172.21.15.37:0/1608736429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0129d0 con 0x7fef4406e4d0 2024-05-10T08:49:09.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.917+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef440b3280 con 0x7fef4406e4d0 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.919+0000 7fef40ff9640 1 -- 172.21.15.37:0/1608736429 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef2c012b70 con 0x7fef4406e4d0 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.919+0000 7fef40ff9640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef240762d0 0x7fef24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.919+0000 7fef40ff9640 1 -- 172.21.15.37:0/1608736429 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fef2c097bb0 con 0x7fef4406e4d0 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.919+0000 7fef42ffd640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef240762d0 0x7fef24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.920+0000 7fef4c60b740 1 Processor -- start 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.920+0000 7fef4c60b740 1 -- start start 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.920+0000 7fef42ffd640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef240762d0 0x7fef24078790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fef440b0cb0 tx=0x7fef34008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76abfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 0x55af76aef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76aefb40 0x55af76ac4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef4c60b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55af76a8c690 con 0x55af76aefb40 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55af76a29f30 con 0x55af76b0d160 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55af769e2b20 con 0x55af76af0280 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76aefb40 0x55af76ac4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76aefb40 0x55af76ac4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36266/0 (socket says 172.21.15.37:36266) 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 -- 172.21.15.37:0/3452009327 learned_addr learned my addr 172.21.15.37:0/3452009327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef42ffd640 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76abfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 0x55af76aef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 -- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 msgr2=0x55af76aef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 0x55af76aef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 -- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 msgr2=0x55af76abfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76abfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 -- 172.21.15.37:0/3452009327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af769dae60 con 0x55af76aefb40 2024-05-10T08:49:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.921+0000 7fef437fe640 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76aefb40 0x55af76ac4950 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fef3c02ac90 tx=0x7fef3c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d2030fb04782b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef397fa640 1 -- 172.21.15.37:0/3452009327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c036040 con 0x55af76aefb40 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef397fa640 1 -- 172.21.15.37:0/3452009327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3c03c650 con 0x55af76aefb40 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef397fa640 1 -- 172.21.15.37:0/3452009327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c03ca00 con 0x55af76aefb40 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 -- 172.21.15.37:0/3452009327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76aefb40 msgr2=0x55af76ac4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76aefb40 0x55af76ac4950 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fef3c02ac90 tx=0x7fef3c02e000 comp rx=0 tx=0).stop 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 -- 172.21.15.37:0/3452009327 shutdown_connections 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76aefb40 0x55af76ac4950 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 0x55af76aef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 --2- 172.21.15.37:0/3452009327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76abfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 -- 172.21.15.37:0/3452009327 >> 172.21.15.37:0/3452009327 conn(0x55af76ac1d60 msgr2=0x55af76b0a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.922+0000 7fef4c60b740 1 -- 172.21.15.37:0/3452009327 shutdown_connections 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.923+0000 7fef4c60b740 1 -- 172.21.15.37:0/3452009327 wait complete. 2024-05-10T08:49:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.923+0000 7fef4c60b740 1 -- start start 2024-05-10T08:49:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.923+0000 7fef4c60b740 1 Processor -- start 2024-05-10T08:49:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76adff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76af2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef4c60b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55af769e65e0 con 0x55af76b0d160 2024-05-10T08:49:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55af76a25ef0 con 0x55af76af0280 2024-05-10T08:49:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55af76ac3f10 con 0x55af76af15d0 2024-05-10T08:49:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef4c60b740 10 client.0 _ll_register_callbacks cb 0x55af769e1320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76af2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76af2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36268/0 (socket says 172.21.15.37:36268) 2024-05-10T08:49:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 -- 172.21.15.37:0/2511740484 learned_addr learned my addr 172.21.15.37:0/2511740484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76adff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef437fe640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 -- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 msgr2=0x55af76aee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 -- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 msgr2=0x55af76adff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76adff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef3a7fc640 1 -- 172.21.15.37:0/2511740484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af768057d0 con 0x55af76b0d160 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.924+0000 7fef437fe640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76af2070 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00df80 tx=0x7fef2c0693c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef0b83f7fe1259d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef227fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef227fc640 1 -- 172.21.15.37:0/2511740484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c079030 con 0x55af76b0d160 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef227fc640 1 -- 172.21.15.37:0/2511740484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fef2c095b50 con 0x55af76b0d160 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef3c03c650 con 0x55af76b0d160 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef227fc640 1 -- 172.21.15.37:0/2511740484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fef2c060be0 con 0x55af76b0d160 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 10 client.7899 fetch_fsmap learned FSMap version 87 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x55af7673b3f0 con 0x55af76b0d160 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef227fc640 1 -- 172.21.15.37:0/2511740484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3c03c650 con 0x55af76b0d160 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef227fc640 1 -- 172.21.15.37:0/2511740484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7fef2c013070 con 0x55af76b0d160 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 10 client.7899 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 10 client.7899 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 20 client.7899 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76aeecb0 0x55af76b1a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 4 client.7899 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af76a37b40 con 0x55af76aeecb0 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.925+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76aeecb0 0x55af76b1a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76aeecb0 0x55af76b1a360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0174c5b72d1f8d4 server_cookie=355082d49c3948e9 in_seq=0 out_seq=0 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef227fc640 10 client.7899 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef227fc640 1 -- 172.21.15.37:0/2511740484 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55af76a37b40 con 0x55af76aeecb0 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef227fc640 10 client.7899 handle_command_reply: tid=0 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 client.7899 shutdown 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 msgr2=0x55af76af2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76af2070 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00df80 tx=0x7fef2c0693c0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 shutdown_connections 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76aeecb0 0x55af76b1a360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76af2070 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef227fc640 0 client.7899 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2511740484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76adff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.926+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 >> 172.21.15.37:0/2511740484 conn(0x55af76aefb40 msgr2=0x55af76abf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.927+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 shutdown_connections 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.927+0000 7fef4c60b740 1 -- 172.21.15.37:0/2511740484 wait complete. 2024-05-10T08:49:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.927+0000 7fef4c60b740 20 client.7899 trim_cache size 0 max 16384 2024-05-10T08:49:09.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.945+0000 7fef4c60b740 1 Processor -- start 2024-05-10T08:49:09.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.945+0000 7fef4c60b740 1 -- start start 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 0x55af76ac3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76af15d0 0x55af76ac43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76b19d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef4c60b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef44202040 con 0x55af76af15d0 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef442010a0 con 0x55af76b0d160 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fef440cc420 con 0x55af76af0280 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76af15d0 0x55af76ac43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76af15d0 0x55af76ac43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36284/0 (socket says 172.21.15.37:36284) 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 -- 172.21.15.37:0/4072799849 learned_addr learned my addr 172.21.15.37:0/4072799849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 -- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 msgr2=0x55af76ac3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 0x55af76ac3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 -- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 msgr2=0x55af76b19d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef437fe640 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76b19d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76b19d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 -- 172.21.15.37:0/4072799849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af766fb0f0 con 0x55af76af15d0 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef437fe640 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76b19d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76af15d0 0x55af76ac43c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0608e0 tx=0x7fef2c020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e507ce27345c4f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef38ff9640 1 -- 172.21.15.37:0/4072799849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c079070 con 0x55af76af15d0 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef38ff9640 1 -- 172.21.15.37:0/4072799849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c011df0 con 0x55af76af15d0 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.946+0000 7fef38ff9640 1 -- 172.21.15.37:0/4072799849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c060080 con 0x55af76af15d0 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 -- 172.21.15.37:0/4072799849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76af15d0 msgr2=0x55af76ac43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76af15d0 0x55af76ac43c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0608e0 tx=0x7fef2c020070 comp rx=0 tx=0).stop 2024-05-10T08:49:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 -- 172.21.15.37:0/4072799849 shutdown_connections 2024-05-10T08:49:09.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76b0d160 0x55af76b19d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76af15d0 0x55af76ac43c0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 --2- 172.21.15.37:0/4072799849 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af0280 0x55af76ac3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 -- 172.21.15.37:0/4072799849 >> 172.21.15.37:0/4072799849 conn(0x55af76aefb40 msgr2=0x55af76b0de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:09.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 -- 172.21.15.37:0/4072799849 shutdown_connections 2024-05-10T08:49:09.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.947+0000 7fef4c60b740 1 -- 172.21.15.37:0/4072799849 wait complete. 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.948+0000 7fef4c60b740 1 -- start start 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.948+0000 7fef4c60b740 1 Processor -- start 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76b87870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aedf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76aeb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55af76a2c460 con 0x55af76b0d160 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef44200a80 con 0x55af76af0280 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55af76ac5170 con 0x55af76af15d0 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 10 client.0 _ll_register_callbacks cb 0x7fef2c060350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76aeb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76aeb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36288/0 (socket says 172.21.15.37:36288) 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 -- 172.21.15.37:0/2254519660 learned_addr learned my addr 172.21.15.37:0/2254519660 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76b87870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef3a7fc640 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aedf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 -- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 msgr2=0x55af76aedf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aedf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 -- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 msgr2=0x55af76b87870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76b87870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 -- 172.21.15.37:0/2254519660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af76aed760 con 0x55af76b0d160 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef437fe640 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76aeb680 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009f40 tx=0x7fef3c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f2c4c4fb11352 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef227fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef227fc640 1 -- 172.21.15.37:0/2254519660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c036040 con 0x55af76b0d160 2024-05-10T08:49:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef227fc640 1 -- 172.21.15.37:0/2254519660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7fef3c004250 con 0x55af76b0d160 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.949+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef2c011df0 con 0x55af76b0d160 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef227fc640 1 -- 172.21.15.37:0/2254519660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fef3c056050 con 0x55af76b0d160 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 10 client.7905 fetch_fsmap learned FSMap version 87 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x55af76ac4f70 con 0x55af76b0d160 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef227fc640 1 -- 172.21.15.37:0/2254519660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c011df0 con 0x55af76b0d160 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef227fc640 1 -- 172.21.15.37:0/2254519660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7fef3c059020 con 0x55af76b0d160 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 10 client.7905 fetch_fsmap finished waiting for FSMap version 87 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 10 client.7905 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 20 client.7905 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76af1a20 0x55af76aebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 4 client.7905 mds_command: new command op to 7446 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 --> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55af76a319b0 con 0x55af76af1a20 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76af1a20 0x55af76aebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef42ffd640 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76af1a20 0x55af76aebbc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d14873d2924523b server_cookie=c80dbc2d5b46c9b3 in_seq=0 out_seq=0 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef227fc640 10 client.7905 ms_handle_connect on v2:172.21.15.37:6833/3773299798 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef227fc640 1 -- 172.21.15.37:0/2254519660 <== mds.0 v2:172.21.15.37:6833/3773299798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55af76a319b0 con 0x55af76af1a20 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef227fc640 10 client.7905 handle_command_reply: tid=0 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 1 client.7905 shutdown 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.950+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 msgr2=0x55af76aeb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76aeb680 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009f40 tx=0x7fef3c004ab0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 shutdown_connections 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:6833/3773299798,v1:172.21.15.37:6834/3773299798] conn(0x55af76af1a20 0x55af76aebbc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55af76b0d160 0x55af76aeb680 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef227fc640 0 client.7905 ms_handle_reset on v2:172.21.15.37:6833/3773299798 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55af76af15d0 0x55af76aedf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 --2- 172.21.15.37:0/2254519660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af76af0280 0x55af76b87870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 >> 172.21.15.37:0/2254519660 conn(0x55af76aefb40 msgr2=0x55af76b09310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 shutdown_connections 2024-05-10T08:49:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 1 -- 172.21.15.37:0/2254519660 wait complete. 2024-05-10T08:49:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef4c60b740 20 client.7905 trim_cache size 0 max 16384 2024-05-10T08:49:09.956 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:09.956 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-10T08:49:09.956 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-10T08:49:09.956 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef240762d0 msgr2=0x7fef24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef240762d0 0x7fef24078790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fef440b0cb0 tx=0x7fef34008040 comp rx=0 tx=0).stop 2024-05-10T08:49:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 msgr2=0x7fef440b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b0d00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00d5c0 tx=0x7fef2c00da80 comp rx=0 tx=0).stop 2024-05-10T08:49:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 shutdown_connections 2024-05-10T08:49:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef240762d0 0x7fef24078790 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44072840 0x7fef440b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4406e4d0 0x7fef440b0d00 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 --2- 172.21.15.37:0/1608736429 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef4406e0f0 0x7fef441520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 >> 172.21.15.37:0/1608736429 conn(0x7fef4406c3a0 msgr2=0x7fef440afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 shutdown_connections 2024-05-10T08:49:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:09.951+0000 7fef498f1640 1 -- 172.21.15.37:0/1608736429 wait complete. 2024-05-10T08:49:09.961 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T08:49:10.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:49:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.169+0000 7f8776bdd640 1 Processor -- start 2024-05-10T08:49:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.169+0000 7f8776bdd640 1 -- start start 2024-05-10T08:49:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f8776bdd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f877015f420 0x7f87700d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f8776bdd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87700d2080 0x7f87700d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f8776bdd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87701630b0 con 0x7f87700d3ca0 2024-05-10T08:49:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f8776bdd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f87700d2550 con 0x7f87700d2080 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f8776bdd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f87700d2c80 con 0x7f877015f420 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f877517a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87700d2080 0x7f87700d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f876ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f87700d3ca0 0x7f87700d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41210/0 (socket says 172.21.15.37:41210) 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f877517a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87700d2080 0x7f87700d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36302/0 (socket says 172.21.15.37:36302) 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.170+0000 7f876ffff640 1 -- 172.21.15.37:0/1910343897 learned_addr learned my addr 172.21.15.37:0/1910343897 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.171+0000 7f8774979640 1 --2- 172.21.15.37:0/1910343897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f877015f420 0x7f87700d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.171+0000 7f877517a640 1 -- 172.21.15.37:0/1910343897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f877015f420 msgr2=0x7f87700d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.171+0000 7f877517a640 1 --2- 172.21.15.37:0/1910343897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f877015f420 0x7f87700d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.171+0000 7f877517a640 1 -- 172.21.15.37:0/1910343897 >> v1:172.21.15.37:6789/0 conn(0x7f87700d3ca0 legacy=0x7f87700d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.171+0000 7f877517a640 1 -- 172.21.15.37:0/1910343897 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87700d2f60 con 0x7f87700d2080 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.171+0000 7f876f7fe640 1 -- 172.21.15.37:0/1910343897 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685038320 0 0) 0x7f8764001110 con 0x7f87700d3ca0 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.171+0000 7f877517a640 1 --2- 172.21.15.37:0/1910343897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700d2080 0x7f87700d4cc0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f8768009d90 tx=0x7f876802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77650afa37d51ea0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f876f7fe640 1 -- 172.21.15.37:0/1910343897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768007740 con 0x7f87700d2080 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f876f7fe640 1 -- 172.21.15.37:0/1910343897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87680078e0 con 0x7f87700d2080 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f876f7fe640 1 -- 172.21.15.37:0/1910343897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768007cb0 con 0x7f87700d2080 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 -- 172.21.15.37:0/1910343897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700d2080 msgr2=0x7f87700d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 --2- 172.21.15.37:0/1910343897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700d2080 0x7f87700d4cc0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f8768009d90 tx=0x7f876802a660 comp rx=0 tx=0).stop 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 -- 172.21.15.37:0/1910343897 shutdown_connections 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 --2- 172.21.15.37:0/1910343897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700d2080 0x7f87700d4cc0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 --2- 172.21.15.37:0/1910343897 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f877015f420 0x7f87700d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 -- 172.21.15.37:0/1910343897 >> 172.21.15.37:0/1910343897 conn(0x7f877008eac0 msgr2=0x7f877009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 -- 172.21.15.37:0/1910343897 shutdown_connections 2024-05-10T08:49:10.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.172+0000 7f8776bdd640 1 -- 172.21.15.37:0/1910343897 wait complete. 2024-05-10T08:49:10.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.173+0000 7f8776bdd640 1 Processor -- start 2024-05-10T08:49:10.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f8776bdd640 1 -- start start 2024-05-10T08:49:10.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f8776bdd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87700d2080 0x7f877015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f8776bdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87701e8b80 0x7f87700cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f8776bdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700ce0f0 0x7f87700ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f8776bdd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87700d5200 con 0x7f87700ce0f0 2024-05-10T08:49:10.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f8776bdd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87700d2830 con 0x7f87701e8b80 2024-05-10T08:49:10.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f8776bdd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f87700d5380 con 0x7f87700d2080 2024-05-10T08:49:10.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.174+0000 7f877517a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700ce0f0 0x7f87700ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700ce0f0 0x7f87700ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36316/0 (socket says 172.21.15.37:36316) 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 -- 172.21.15.37:0/2710915587 learned_addr learned my addr 172.21.15.37:0/2710915587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f876ffff640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87701e8b80 0x7f87700cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f8774979640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87700d2080 0x7f877015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 -- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87700d2080 msgr2=0x7f877015e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87700d2080 0x7f877015e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 -- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87701e8b80 msgr2=0x7f87700cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87701e8b80 0x7f87700cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 -- 172.21.15.37:0/2710915587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87701e9040 con 0x7f87700ce0f0 2024-05-10T08:49:10.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f877517a640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700ce0f0 0x7f87700ce5a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f876802ac50 tx=0x7f8768004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f876d7fa640 1 -- 172.21.15.37:0/2710915587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768040070 con 0x7f87700ce0f0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f876d7fa640 1 -- 172.21.15.37:0/2710915587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8768031bc0 con 0x7f87700ce0f0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f876d7fa640 1 -- 172.21.15.37:0/2710915587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768009450 con 0x7f87700ce0f0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87701e9320 con 0x7f87700ce0f0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.175+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87701e98e0 con 0x7f87700ce0f0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.176+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87700693f0 con 0x7f87700ce0f0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.177+0000 7f876d7fa640 1 -- 172.21.15.37:0/2710915587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8768039040 con 0x7f87700ce0f0 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.177+0000 7f876d7fa640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f875c076300 0x7f875c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.177+0000 7f876d7fa640 1 -- 172.21.15.37:0/2710915587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6245+0+0 (secure 0 0 0) 0x7f87680b9090 con 0x7f87700ce0f0 2024-05-10T08:49:10.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.178+0000 7f8774979640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f875c076300 0x7f875c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.178+0000 7f8774979640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f875c076300 0x7f875c0787c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8760009a30 tx=0x7f8760008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.182+0000 7f876d7fa640 1 -- 172.21.15.37:0/2710915587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f87680827d0 con 0x7f87700ce0f0 2024-05-10T08:49:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.416+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f87700b4c50 con 0x7f87700ce0f0 2024-05-10T08:49:10.415 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:49:10.417+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:49:10.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.418+0000 7f876d7fa640 1 -- 172.21.15.37:0/2710915587 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) ==== 161+0+0 (secure 0 0 0) 0x7f87680820d0 con 0x7f87700ce0f0 2024-05-10T08:49:10.417 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:49:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f875c076300 msgr2=0x7f875c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f875c076300 0x7f875c0787c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8760009a30 tx=0x7f8760008040 comp rx=0 tx=0).stop 2024-05-10T08:49:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700ce0f0 msgr2=0x7f87700ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700ce0f0 0x7f87700ce5a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f876802ac50 tx=0x7f8768004a40 comp rx=0 tx=0).stop 2024-05-10T08:49:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 shutdown_connections 2024-05-10T08:49:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f875c076300 0x7f875c0787c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700ce0f0 0x7f87700ce5a0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87701e8b80 0x7f87700cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 --2- 172.21.15.37:0/2710915587 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87700d2080 0x7f877015e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 >> 172.21.15.37:0/2710915587 conn(0x7f877008eac0 msgr2=0x7f87700b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:10.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 shutdown_connections 2024-05-10T08:49:10.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.421+0000 7f8776bdd640 1 -- 172.21.15.37:0/2710915587 wait complete. 2024-05-10T08:49:10.422 INFO:tasks.ceph.mds.a.smithi037.stderr: -1148> 2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-05-10T08:49:10.422 INFO:tasks.ceph.mds.a.smithi037.stderr: -1145> 2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-05-10T08:49:10.422 INFO:tasks.ceph.mds.a.smithi037.stderr: -1128> 2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-05-10T08:49:10.422 INFO:tasks.ceph.mds.a.smithi037.stderr: -1125> 2024-05-10T08:48:39.620+0000 7fa060daf640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-05-10T08:49:10.422 INFO:tasks.ceph.mds.a.smithi037.stderr: -877> 2024-05-10T08:48:42.570+0000 7fa064db7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:49:10.432 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-05-10T08:49:10.449 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:49:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.474+0000 7f94381da280 1 -- start start 2024-05-10T08:49:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.474+0000 7f94381da280 1 Processor -- start 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f94381da280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69bb1ec00 0x55b69c8ec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f94381da280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69bb1f800 0x55b69c8ec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f94381da280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69bb1fc00 0x55b69c8ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f94381da280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b69c8bc180 con 0x55b69bb1fc00 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f94381da280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b69c8bc300 con 0x55b69bb1ec00 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f94381da280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b69c8bc480 con 0x55b69bb1f800 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f9437187640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69bb1fc00 0x55b69c8ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f9437187640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69bb1fc00 0x55b69c8ecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36352/0 (socket says 172.21.15.37:36352) 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f9437187640 1 -- 172.21.15.37:0/3587193762 learned_addr learned my addr 172.21.15.37:0/3587193762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f9436986640 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69bb1ec00 0x55b69c8ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.475+0000 7f9436185640 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69bb1f800 0x55b69c8ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9437187640 1 -- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69bb1f800 msgr2=0x55b69c8ec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9437187640 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69bb1f800 0x55b69c8ec580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9437187640 1 -- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69bb1ec00 msgr2=0x55b69c8ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9437187640 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69bb1ec00 0x55b69c8ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9437187640 1 -- 172.21.15.37:0/3587193762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69bb54780 con 0x55b69bb1fc00 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9437187640 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69bb1fc00 0x55b69c8ecb00 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x55b69c949320 tx=0x55b69c8c0120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e175b6dc69b98e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9434181640 1 -- 172.21.15.37:0/3587193762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b69bb44680 con 0x55b69bb1fc00 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9434181640 1 -- 172.21.15.37:0/3587193762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b69bb4a700 con 0x55b69bb1fc00 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9434181640 1 -- 172.21.15.37:0/3587193762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b69bb44b60 con 0x55b69bb1fc00 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f94381da280 1 -- 172.21.15.37:0/3587193762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69bb554a0 con 0x55b69bb1fc00 2024-05-10T08:49:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f94381da280 1 -- 172.21.15.37:0/3587193762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b69bb54000 con 0x55b69bb1fc00 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f94381da280 4 waiting for MDS map... 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9434181640 1 -- 172.21.15.37:0/3587193762 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x55b69ca00600 con 0x55b69bb1fc00 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f9434181640 1 -- 172.21.15.37:0/3587193762 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 88) ==== 2885+0+0 (secure 0 0 0) 0x55b69bb79180 con 0x55b69bb1fc00 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f94381da280 4 Got MDS map 88 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f94381da280 10 main: main 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.476+0000 7f94381da280 4 main: connecting to RADOS... 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 Processor -- start 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 -- start start 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 0x55b69c8ed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1800 0x55b69c8ed600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1c00 0x55b69c8edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b69c8bc600 con 0x55b69c9e1c00 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b69c8bc780 con 0x55b69c9e1400 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f94381da280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b69c8bc900 con 0x55b69c9e1800 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f9436185640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1c00 0x55b69c8edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f9436185640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1c00 0x55b69c8edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36366/0 (socket says 172.21.15.37:36366) 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.477+0000 7f9436185640 1 -- 172.21.15.37:0/2196416398 learned_addr learned my addr 172.21.15.37:0/2196416398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436185640 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 0x55b69c8ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436986640 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1800 0x55b69c8ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436185640 1 -- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1800 msgr2=0x55b69c8ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436185640 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1800 0x55b69c8ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436185640 1 -- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 msgr2=0x55b69c8ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436185640 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 0x55b69c8ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436185640 1 -- 172.21.15.37:0/2196416398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69bb543c0 con 0x55b69c9e1c00 2024-05-10T08:49:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f9436185640 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1c00 0x55b69c8edb80 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x55b69ca56660 tx=0x55b69c8be720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dad4e36e345671 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f943217d640 1 -- 172.21.15.37:0/2196416398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b69bb449c0 con 0x55b69c9e1c00 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f943217d640 1 -- 172.21.15.37:0/2196416398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b69bb4afc0 con 0x55b69c9e1c00 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f943217d640 1 -- 172.21.15.37:0/2196416398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b69bb44680 con 0x55b69c9e1c00 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f94381da280 1 -- 172.21.15.37:0/2196416398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1c00 msgr2=0x55b69c8edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f94381da280 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1c00 0x55b69c8edb80 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x55b69ca56660 tx=0x55b69c8be720 comp rx=0 tx=0).stop 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f94381da280 1 -- 172.21.15.37:0/2196416398 shutdown_connections 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f94381da280 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1c00 0x55b69c8edb80 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f94381da280 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1800 0x55b69c8ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f94381da280 1 --2- 172.21.15.37:0/2196416398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 0x55b69c8ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.478+0000 7f94381da280 1 -- 172.21.15.37:0/2196416398 >> 172.21.15.37:0/2196416398 conn(0x55b69c9e1000 msgr2=0x55b69bc17000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.479+0000 7f94381da280 1 -- 172.21.15.37:0/2196416398 shutdown_connections 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.479+0000 7f94381da280 1 -- 172.21.15.37:0/2196416398 wait complete. 2024-05-10T08:49:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.479+0000 7f94381da280 1 Processor -- start 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.479+0000 7f94381da280 1 -- start start 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 0x55b69c8ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1800 0x55b69c8ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1c00 0x55b69c8edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b69c8bd980 con 0x55b69c9e1800 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b69c8bd800 con 0x55b69c9e1400 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b69c8bd680 con 0x55b69c9e1c00 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1800 0x55b69c8ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1800 0x55b69c8ed600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36376/0 (socket says 172.21.15.37:36376) 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 -- 172.21.15.37:0/3951105569 learned_addr learned my addr 172.21.15.37:0/3951105569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436185640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1c00 0x55b69c8edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436185640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 0x55b69c8ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 -- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1c00 msgr2=0x55b69c8edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69c9e1c00 0x55b69c8edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 -- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 msgr2=0x55b69c8ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69c9e1400 0x55b69c8ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 -- 172.21.15.37:0/3951105569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69bb54780 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f9436986640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1800 0x55b69c8ed600 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x55b69ca57440 tx=0x55b69c9eb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f943097a640 1 -- 172.21.15.37:0/3951105569 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b69bb449c0 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f943097a640 1 -- 172.21.15.37:0/3951105569 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b69bb4afc0 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b69bb554a0 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f943097a640 1 -- 172.21.15.37:0/3951105569 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b69bb44680 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69bb54960 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.480+0000 7f94381da280 4 main: resolving pool 15 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f943097a640 1 -- 172.21.15.37:0/3951105569 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55b69c9eec00 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f943097a640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55b69ca76c00 0x55b69c8ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f943097a640 1 -- 172.21.15.37:0/3951105569 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x55b69ca7ca00 con 0x55b69c9e1800 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f94381da280 4 main: creating IoCtx.. 2024-05-10T08:49:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f94381da280 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55b69ca77000 0x55b69c8ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) -- 0x55b69ca77400 con 0x55b69ca77000 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f9436185640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55b69ca76c00 0x55b69c8ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.482+0000 7f9436185640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55b69ca77000 0x55b69c8ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f9436185640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55b69ca77000 0x55b69c8ee680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f9436185640 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55b69ca76c00 0x55b69c8ee100 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55b69ca56870 tx=0x55b69c8be780 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f9436185640 1 -- 172.21.15.37:0/3951105569 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55b69c8ac000 con 0x55b69ca77000 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "0": { 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "data": { 2024-05-10T08:49:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 5, 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "inotable": { 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "projected_free": [ 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "start": 1099511627779, 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "len": 1099511627773 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "free": [ 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "start": 1099511627779, 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "len": 1099511627773 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:49:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:10.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:10.491 INFO:teuthology.orchestra.run.smithi037.stdout: "result": 0 2024-05-10T08:49:10.491 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:10.491 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:10.491 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55b69ca77000 msgr2=0x55b69c8ee680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55b69ca77000 0x55b69c8ee680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55b69ca76c00 msgr2=0x55b69c8ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x55b69ca76c00 0x55b69c8ee100 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55b69ca56870 tx=0x55b69c8be780 comp rx=0 tx=0).stop 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1800 msgr2=0x55b69c8ed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 --2- 172.21.15.37:0/3951105569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69c9e1800 0x55b69c8ed600 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x55b69ca57440 tx=0x55b69c9eb800 comp rx=0 tx=0).stop 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f9436986640 1 -- 172.21.15.37:0/3951105569 reap_dead start 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 shutdown_connections 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 >> 172.21.15.37:0/3951105569 conn(0x55b69c9e1000 msgr2=0x55b69bc17000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 shutdown_connections 2024-05-10T08:49:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.483+0000 7f94381da280 1 -- 172.21.15.37:0/3951105569 wait complete. 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 -- 172.21.15.37:0/3587193762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69bb1fc00 msgr2=0x55b69c8ecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69bb1fc00 0x55b69c8ecb00 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x55b69c949320 tx=0x55b69c8c0120 comp rx=0 tx=0).stop 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 -- 172.21.15.37:0/3587193762 shutdown_connections 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b69bb1fc00 0x55b69c8ecb00 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b69bb1f800 0x55b69c8ec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 --2- 172.21.15.37:0/3587193762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b69bb1ec00 0x55b69c8ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 -- 172.21.15.37:0/3587193762 >> 172.21.15.37:0/3587193762 conn(0x55b69bb1f000 msgr2=0x55b69bc16800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 -- 172.21.15.37:0/3587193762 shutdown_connections 2024-05-10T08:49:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.484+0000 7f94381da280 1 -- 172.21.15.37:0/3587193762 wait complete. 2024-05-10T08:49:10.494 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.062681, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-05-10T08:49:10.495 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:49:10.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:49:10.580 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:49:10.627 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:49:10.627 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:10.627 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:10.627 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:10.644 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:49:10.644 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:10.644 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:49:10.644 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:10.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:49:10.663 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:10.663 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:10.663 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:10.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:49:10.701 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:10.701 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:49:10.701 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:10.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:49:10.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:10.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.845+0000 7fef74ebd640 1 Processor -- start 2024-05-10T08:49:10.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.845+0000 7fef74ebd640 1 -- start start 2024-05-10T08:49:10.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef74ebd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef70157540 0x7fef7015e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef74ebd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7015e550 con 0x7fef7006fc30 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef74ebd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef700701d0 con 0x7fef700b48a0 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef74ebd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fef700b3dc0 con 0x7fef70157540 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef65d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef7006fc30 0x7fef700af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41222/0 (socket says 172.21.15.37:41222) 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef65d9b640 1 -- 172.21.15.37:0/757764137 learned_addr learned my addr 172.21.15.37:0/757764137 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156944621 0 0) 0x7fef58001110 con 0x7fef7006fc30 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c003520 con 0x7fef7006fc30 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6e59c640 1 --2- 172.21.15.37:0/757764137 >> v2:172.21.15.82:3300/0 conn(0x7fef70157540 0x7fef7015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1211564240 0 0) 0x7fef5c003520 con 0x7fef7006fc30 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 >> v2:172.21.15.82:3300/0 conn(0x7fef70157540 msgr2=0x7fef7015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 --2- 172.21.15.37:0/757764137 >> v2:172.21.15.82:3300/0 conn(0x7fef70157540 0x7fef7015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 >> v1:172.21.15.82:6789/0 conn(0x7fef700b48a0 legacy=0x7fef700ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef700b40a0 con 0x7fef7006fc30 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fef58001840 con 0x7fef7006fc30 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 >> v1:172.21.15.37:6789/0 conn(0x7fef7006fc30 legacy=0x7fef700af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef5c004800 0x7fef5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.846+0000 7fef6dd9b640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5c0051c0 0x7fef5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef700b3dc0 con 0x7fef5c0039b0 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c00c110 con 0x7fef5c0051c0 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c00c310 con 0x7fef5c004800 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6e59c640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef65d9b640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef5c004800 0x7fef5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6ed9d640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5c0051c0 0x7fef5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6e59c640 1 -- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef5c004800 msgr2=0x7fef5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6e59c640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef5c004800 0x7fef5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6e59c640 1 -- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5c0051c0 msgr2=0x7fef5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6e59c640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5c0051c0 0x7fef5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6e59c640 1 -- 172.21.15.37:0/757764137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c003520 con 0x7fef5c0039b0 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef65d9b640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef5c004800 0x7fef5c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6ed9d640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5c0051c0 0x7fef5c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.847+0000 7fef6ed9d640 1 -- 172.21.15.37:0/757764137 reap_dead start 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef6e59c640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef5c003dd0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fef6000ba30 tx=0x7fef5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3a92bdb60b684 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60030070 con 0x7fef5c0039b0 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6002ade0 con 0x7fef5c0039b0 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef6dd9b640 1 -- 172.21.15.37:0/757764137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6000b600 con 0x7fef5c0039b0 2024-05-10T08:49:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef74ebd640 1 -- 172.21.15.37:0/757764137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 msgr2=0x7fef5c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef74ebd640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef5c003dd0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fef6000ba30 tx=0x7fef5c005830 comp rx=0 tx=0).stop 2024-05-10T08:49:10.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef74ebd640 1 -- 172.21.15.37:0/757764137 shutdown_connections 2024-05-10T08:49:10.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef74ebd640 1 --2- 172.21.15.37:0/757764137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef5c003dd0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef74ebd640 1 -- 172.21.15.37:0/757764137 >> 172.21.15.37:0/757764137 conn(0x7fef7006c3a0 msgr2=0x7fef7006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:10.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef74ebd640 1 -- 172.21.15.37:0/757764137 shutdown_connections 2024-05-10T08:49:10.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.848+0000 7fef74ebd640 1 -- 172.21.15.37:0/757764137 wait complete. 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.850+0000 7fef74ebd640 1 Processor -- start 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.850+0000 7fef74ebd640 1 -- start start 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.850+0000 7fef74ebd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef70152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef74ebd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef70155c30 0x7fef701442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef74ebd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef701447f0 0x7fef701f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef74ebd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef70157aa0 con 0x7fef5c0039b0 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef74ebd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef70157920 con 0x7fef701447f0 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef74ebd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fef7015e010 con 0x7fef70155c30 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef70152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef70152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36400/0 (socket says 172.21.15.37:36400) 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 -- 172.21.15.37:0/2047695317 learned_addr learned my addr 172.21.15.37:0/2047695317 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6ed9d640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef701447f0 0x7fef701f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef65d9b640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef70155c30 0x7fef701442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 -- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef70155c30 msgr2=0x7fef701442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef70155c30 0x7fef701442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 -- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef701447f0 msgr2=0x7fef701f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef701447f0 0x7fef701f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 -- 172.21.15.37:0/2047695317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef70144c70 con 0x7fef5c0039b0 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6ed9d640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef701447f0 0x7fef701f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef6e59c640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef70152e20 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fef60035d90 tx=0x7fef600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef677fe640 1 -- 172.21.15.37:0/2047695317 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60043030 con 0x7fef5c0039b0 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef677fe640 1 -- 172.21.15.37:0/2047695317 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6002abe0 con 0x7fef5c0039b0 2024-05-10T08:49:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef70153490 con 0x7fef5c0039b0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef677fe640 1 -- 172.21.15.37:0/2047695317 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6000b600 con 0x7fef5c0039b0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.851+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7009da60 con 0x7fef5c0039b0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.852+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7009d5b0 con 0x7fef5c0039b0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.853+0000 7fef677fe640 1 -- 172.21.15.37:0/2047695317 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef60046070 con 0x7fef5c0039b0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.854+0000 7fef677fe640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef50076300 0x7fef500787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.854+0000 7fef677fe640 1 -- 172.21.15.37:0/2047695317 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7fef600b8230 con 0x7fef5c0039b0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.854+0000 7fef65d9b640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef50076300 0x7fef500787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.854+0000 7fef65d9b640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef50076300 0x7fef500787c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fef580012b0 tx=0x7fef58001640 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:10.858+0000 7fef677fe640 1 -- 172.21.15.37:0/2047695317 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fef60081920 con 0x7fef5c0039b0 2024-05-10T08:49:11.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.087+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef700693f0 con 0x7fef5c0039b0 2024-05-10T08:49:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.087+0000 7fef677fe640 1 -- 172.21.15.37:0/2047695317 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+4342 (secure 0 0 0) 0x7fef60006c30 con 0x7fef5c0039b0 2024-05-10T08:49:11.086 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:11.086 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:49:10.418153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T08:49:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 88 2024-05-10T08:49:11.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef50076300 msgr2=0x7fef500787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef50076300 0x7fef500787c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fef580012b0 tx=0x7fef58001640 comp rx=0 tx=0).stop 2024-05-10T08:49:11.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 msgr2=0x7fef70152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef70152e20 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fef60035d90 tx=0x7fef600046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 shutdown_connections 2024-05-10T08:49:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef50076300 0x7fef500787c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef701447f0 0x7fef701f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef70155c30 0x7fef701442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 --2- 172.21.15.37:0/2047695317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c0039b0 0x7fef70152e20 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 >> 172.21.15.37:0/2047695317 conn(0x7fef7006c3a0 msgr2=0x7fef7015b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 shutdown_connections 2024-05-10T08:49:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.089+0000 7fef74ebd640 1 -- 172.21.15.37:0/2047695317 wait complete. 2024-05-10T08:49:11.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.204+0000 7f08c3fda640 1 Processor -- start 2024-05-10T08:49:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.204+0000 7f08c3fda640 1 -- start start 2024-05-10T08:49:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c3fda640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc070d30 0x7f08bc0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c3fda640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08bc163920 0x7f08bc0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c3fda640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08bc163d80 con 0x7f08bc071110 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c3fda640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f08bc0d10d0 con 0x7f08bc163920 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c3fda640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc070b80 con 0x7f08bc070d30 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c1575640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08bc163920 0x7f08bc0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c1575640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08bc163920 0x7f08bc0703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36416/0 (socket says 172.21.15.37:36416) 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.205+0000 7f08c1575640 1 -- 172.21.15.37:0/70273226 learned_addr learned my addr 172.21.15.37:0/70273226 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.206+0000 7f08c1d76640 1 --2- 172.21.15.37:0/70273226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc070d30 0x7f08bc0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.206+0000 7f08c1575640 1 -- 172.21.15.37:0/70273226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc070d30 msgr2=0x7f08bc0d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.206+0000 7f08c1575640 1 --2- 172.21.15.37:0/70273226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc070d30 0x7f08bc0d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.206+0000 7f08c1575640 1 -- 172.21.15.37:0/70273226 >> v1:172.21.15.82:6789/0 conn(0x7f08bc071110 legacy=0x7f08bc06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.206+0000 7f08c1575640 1 -- 172.21.15.37:0/70273226 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc0708e0 con 0x7f08bc163920 2024-05-10T08:49:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.206+0000 7f08c1575640 1 --2- 172.21.15.37:0/70273226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0703a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009870 tx=0x7f08b002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1775e3521b9c1ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c0d74640 1 -- 172.21.15.37:0/70273226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0037070 con 0x7f08bc163920 2024-05-10T08:49:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c0d74640 1 -- 172.21.15.37:0/70273226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b0032440 con 0x7f08bc163920 2024-05-10T08:49:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c0d74640 1 -- 172.21.15.37:0/70273226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0032810 con 0x7f08bc163920 2024-05-10T08:49:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 -- 172.21.15.37:0/70273226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 msgr2=0x7f08bc0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 --2- 172.21.15.37:0/70273226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0703a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009870 tx=0x7f08b002a210 comp rx=0 tx=0).stop 2024-05-10T08:49:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 -- 172.21.15.37:0/70273226 shutdown_connections 2024-05-10T08:49:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 --2- 172.21.15.37:0/70273226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0703a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 --2- 172.21.15.37:0/70273226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc070d30 0x7f08bc0d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 -- 172.21.15.37:0/70273226 >> 172.21.15.37:0/70273226 conn(0x7f08bc0d2e90 msgr2=0x7f08bc0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 -- 172.21.15.37:0/70273226 shutdown_connections 2024-05-10T08:49:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.207+0000 7f08c3fda640 1 -- 172.21.15.37:0/70273226 wait complete. 2024-05-10T08:49:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.208+0000 7f08c3fda640 1 Processor -- start 2024-05-10T08:49:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.208+0000 7f08c3fda640 1 -- start start 2024-05-10T08:49:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c3fda640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc070d30 0x7f08bc0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c3fda640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc071110 0x7f08bc159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c3fda640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c3fda640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc0d15e0 con 0x7f08bc163920 2024-05-10T08:49:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c3fda640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc0d1c30 con 0x7f08bc070d30 2024-05-10T08:49:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c3fda640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc0d18c0 con 0x7f08bc071110 2024-05-10T08:49:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c2577640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c2577640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36428/0 (socket says 172.21.15.37:36428) 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.209+0000 7f08c2577640 1 -- 172.21.15.37:0/133581520 learned_addr learned my addr 172.21.15.37:0/133581520 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c2577640 1 -- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc071110 msgr2=0x7f08bc159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c2577640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc071110 0x7f08bc159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c2577640 1 -- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc070d30 msgr2=0x7f08bc0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c1d76640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc070d30 0x7f08bc0cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c2577640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc070d30 0x7f08bc0cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c2577640 1 -- 172.21.15.37:0/133581520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc1f5a80 con 0x7f08bc163920 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c2577640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0b61b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c7b0 tx=0x7f08ac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08ba7fc640 1 -- 172.21.15.37:0/133581520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac004b60 con 0x7f08bc163920 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08ba7fc640 1 -- 172.21.15.37:0/133581520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ac004d00 con 0x7f08bc163920 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08bc0b5190 con 0x7f08bc163920 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08ba7fc640 1 -- 172.21.15.37:0/133581520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00aa90 con 0x7f08bc163920 2024-05-10T08:49:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.210+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08bc0b83c0 con 0x7f08bc163920 2024-05-10T08:49:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.211+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08bc06fc30 con 0x7f08bc163920 2024-05-10T08:49:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.212+0000 7f08ba7fc640 1 -- 172.21.15.37:0/133581520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f08ac00ac30 con 0x7f08bc163920 2024-05-10T08:49:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.212+0000 7f08ba7fc640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08a80762d0 0x7f08a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.212+0000 7f08ba7fc640 1 -- 172.21.15.37:0/133581520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7f08ac097a50 con 0x7f08bc163920 2024-05-10T08:49:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.212+0000 7f08c1d76640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08a80762d0 0x7f08a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.213+0000 7f08c1d76640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08a80762d0 0x7f08a8078790 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b7c0 tx=0x7f08b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.217+0000 7f08ba7fc640 1 -- 172.21.15.37:0/133581520 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f08bc06fc30 con 0x7f08bc163920 2024-05-10T08:49:11.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.446+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08bc0693f0 con 0x7f08bc163920 2024-05-10T08:49:11.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.447+0000 7f08ba7fc640 1 -- 172.21.15.37:0/133581520 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5167 (secure 0 0 0) 0x7f08ac020070 con 0x7f08bc163920 2024-05-10T08:49:11.446 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:11.446 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2261445736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2261445736},{"type":"v1","addr":"172.21.15.37:6834","nonce":2261445736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:49:10.418153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T08:49:11.446 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 89 2024-05-10T08:49:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08a80762d0 msgr2=0x7f08a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08a80762d0 0x7f08a8078790 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b7c0 tx=0x7f08b4008040 comp rx=0 tx=0).stop 2024-05-10T08:49:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 msgr2=0x7f08bc0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0b61b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c7b0 tx=0x7f08ac00cc70 comp rx=0 tx=0).stop 2024-05-10T08:49:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 shutdown_connections 2024-05-10T08:49:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f08a80762d0 0x7f08a8078790 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08bc163920 0x7f08bc0b61b0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08bc071110 0x7f08bc159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 --2- 172.21.15.37:0/133581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc070d30 0x7f08bc0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 >> 172.21.15.37:0/133581520 conn(0x7f08bc0d2e90 msgr2=0x7f08bc160e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:11.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 shutdown_connections 2024-05-10T08:49:11.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.449+0000 7f08c3fda640 1 -- 172.21.15.37:0/133581520 wait complete. 2024-05-10T08:49:11.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:49:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.564+0000 7fa59b9e4640 1 Processor -- start 2024-05-10T08:49:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.565+0000 7fa59b9e4640 1 -- start start 2024-05-10T08:49:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.565+0000 7fa59b9e4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5940d1970 0x7fa5940d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa59b9e4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5941630b0 con 0x7fa59415f420 2024-05-10T08:49:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa59b9e4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5940d3e70 con 0x7fa5940d4cc0 2024-05-10T08:49:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa59b9e4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa5940d2550 con 0x7fa5940d1970 2024-05-10T08:49:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa599780640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa59415f420 0x7fa5940d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41236/0 (socket says 172.21.15.37:41236) 2024-05-10T08:49:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa599780640 1 -- 172.21.15.37:0/4268713719 learned_addr learned my addr 172.21.15.37:0/4268713719 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892514612 0 0) 0x7fa590001110 con 0x7fa59415f420 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa580003520 con 0x7fa59415f420 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa598f7f640 1 --2- 172.21.15.37:0/4268713719 >> v2:172.21.15.82:3300/0 conn(0x7fa5940d1970 0x7fa5940d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2188702375 0 0) 0x7fa580003520 con 0x7fa59415f420 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 >> v2:172.21.15.82:3300/0 conn(0x7fa5940d1970 msgr2=0x7fa5940d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 --2- 172.21.15.37:0/4268713719 >> v2:172.21.15.82:3300/0 conn(0x7fa5940d1970 0x7fa5940d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 >> v1:172.21.15.82:6789/0 conn(0x7fa5940d4cc0 legacy=0x7fa5940d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5940d2c80 con 0x7fa59415f420 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fa590001840 con 0x7fa59415f420 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 >> v1:172.21.15.37:6789/0 conn(0x7fa59415f420 legacy=0x7fa5940d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5800039b0 0x7fa580003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa580004800 0x7fa580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5800051c0 0x7fa58000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940d2550 con 0x7fa580004800 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa58000c060 con 0x7fa5800039b0 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa58000c260 con 0x7fa5800051c0 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.566+0000 7fa598f7f640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa580004800 0x7fa580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa599780640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5800039b0 0x7fa580003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa599f81640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5800051c0 0x7fa58000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa598f7f640 1 -- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5800051c0 msgr2=0x7fa58000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa598f7f640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5800051c0 0x7fa58000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa598f7f640 1 -- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5800039b0 msgr2=0x7fa580003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa598f7f640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5800039b0 0x7fa580003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa598f7f640 1 -- 172.21.15.37:0/4268713719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa580003520 con 0x7fa580004800 2024-05-10T08:49:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa599f81640 1 -- 172.21.15.37:0/4268713719 reap_dead start 2024-05-10T08:49:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.567+0000 7fa598f7f640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa580004800 0x7fa580004c80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa584009ac0 tx=0x7fa580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edcc849664fe30e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584036070 con 0x7fa580004800 2024-05-10T08:49:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584031400 con 0x7fa580004800 2024-05-10T08:49:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa58bfff640 1 -- 172.21.15.37:0/4268713719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584009690 con 0x7fa580004800 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa59b9e4640 1 -- 172.21.15.37:0/4268713719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa580004800 msgr2=0x7fa580004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa580004800 0x7fa580004c80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa584009ac0 tx=0x7fa580005830 comp rx=0 tx=0).stop 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa59b9e4640 1 -- 172.21.15.37:0/4268713719 shutdown_connections 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/4268713719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa580004800 0x7fa580004c80 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa59b9e4640 1 -- 172.21.15.37:0/4268713719 >> 172.21.15.37:0/4268713719 conn(0x7fa59408eac0 msgr2=0x7fa59409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa59b9e4640 1 -- 172.21.15.37:0/4268713719 shutdown_connections 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.568+0000 7fa59b9e4640 1 -- 172.21.15.37:0/4268713719 wait complete. 2024-05-10T08:49:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.569+0000 7fa59b9e4640 1 Processor -- start 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.569+0000 7fa59b9e4640 1 -- start start 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa59b9e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa580004800 0x7fa5940ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa59b9e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5941f5400 0x7fa5940ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa59b9e4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5940cde20 0x7fa5940ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa59b9e4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940d2830 con 0x7fa5941f5400 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa59b9e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940d3240 con 0x7fa580004800 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa59b9e4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa5940d1e20 con 0x7fa5940cde20 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa598f7f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5941f5400 0x7fa5940ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa598f7f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5941f5400 0x7fa5940ba2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36444/0 (socket says 172.21.15.37:36444) 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa598f7f640 1 -- 172.21.15.37:0/1485403675 learned_addr learned my addr 172.21.15.37:0/1485403675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa599780640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa580004800 0x7fa5940ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.570+0000 7fa599f81640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5940cde20 0x7fa5940ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa598f7f640 1 -- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5940cde20 msgr2=0x7fa5940ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa598f7f640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5940cde20 0x7fa5940ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa598f7f640 1 -- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa580004800 msgr2=0x7fa5940ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa598f7f640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa580004800 0x7fa5940ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa598f7f640 1 -- 172.21.15.37:0/1485403675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5940ba7f0 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa599780640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa580004800 0x7fa5940ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa598f7f640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5941f5400 0x7fa5940ba2b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa584034040 tx=0x7fa584004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa589ffb640 1 -- 172.21.15.37:0/1485403675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58403f020 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa589ffb640 1 -- 172.21.15.37:0/1485403675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584037040 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5940cd0d0 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa589ffb640 1 -- 172.21.15.37:0/1485403675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584036070 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.571+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5940cd690 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.572+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5940693f0 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.573+0000 7fa589ffb640 1 -- 172.21.15.37:0/1485403675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa584042020 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.573+0000 7fa589ffb640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5780762d0 0x7fa578078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.573+0000 7fa589ffb640 1 -- 172.21.15.37:0/1485403675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7fa5840b7070 con 0x7fa5941f5400 2024-05-10T08:49:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.574+0000 7fa599780640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5780762d0 0x7fa578078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.574+0000 7fa599780640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5780762d0 0x7fa578078790 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa590007fd0 tx=0x7fa590009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.578+0000 7fa589ffb640 1 -- 172.21.15.37:0/1485403675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa584080760 con 0x7fa5941f5400 2024-05-10T08:49:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.769+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5940cf3a0 con 0x7fa5941f5400 2024-05-10T08:49:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.770+0000 7fa589ffb640 1 -- 172.21.15.37:0/1485403675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+17178 (secure 0 0 0) 0x7fa584080060 con 0x7fa5941f5400 2024-05-10T08:49:11.769 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:11.769 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":107,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:10.417961+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:47:43.973480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T08:47:45.269524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.4","mappings":[{"from":1,"to":7}]},{"pgid":"16.29","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/3773299798":"2024-05-11T08:49:10.417937+0000","172.21.15.37:6833/3773299798":"2024-05-11T08:49:10.417937+0000","172.21.15.82:6837/902568070":"2024-05-11T08:48:33.953799+0000","172.21.15.82:6835/902568070":"2024-05-11T08:48:33.953799+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:49:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5780762d0 msgr2=0x7fa578078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5780762d0 0x7fa578078790 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa590007fd0 tx=0x7fa590009040 comp rx=0 tx=0).stop 2024-05-10T08:49:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5941f5400 msgr2=0x7fa5940ba2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5941f5400 0x7fa5940ba2b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa584034040 tx=0x7fa584004730 comp rx=0 tx=0).stop 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 shutdown_connections 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa5780762d0 0x7fa578078790 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5940cde20 0x7fa5940ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5941f5400 0x7fa5940ba2b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 --2- 172.21.15.37:0/1485403675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa580004800 0x7fa5940ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 >> 172.21.15.37:0/1485403675 conn(0x7fa59408eac0 msgr2=0x7fa5940d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 shutdown_connections 2024-05-10T08:49:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.772+0000 7fa59b9e4640 1 -- 172.21.15.37:0/1485403675 wait complete. 2024-05-10T08:49:11.783 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:49:11.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.887+0000 7f7ded3b6640 1 Processor -- start 2024-05-10T08:49:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.887+0000 7f7ded3b6640 1 -- start start 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7ded3b6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7de8070d30 0x7f7de80d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7ded3b6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8071110 0x7f7de806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7ded3b6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de80d1300 con 0x7f7de8163920 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7ded3b6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7de80d10d0 con 0x7f7de8070d30 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7ded3b6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7de8163db0 con 0x7f7de8071110 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7de8070d30 0x7f7de80d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7de8070d30 0x7f7de80d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36448/0 (socket says 172.21.15.37:36448) 2024-05-10T08:49:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de6ffd640 1 -- 172.21.15.37:0/3985948739 learned_addr learned my addr 172.21.15.37:0/3985948739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de77fe640 1 --2- 172.21.15.37:0/3985948739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8071110 0x7f7de806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de6ffd640 1 -- 172.21.15.37:0/3985948739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8071110 msgr2=0x7f7de806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de6ffd640 1 --2- 172.21.15.37:0/3985948739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8071110 0x7f7de806d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de6ffd640 1 -- 172.21.15.37:0/3985948739 >> v1:172.21.15.82:6789/0 conn(0x7f7de8163920 legacy=0x7f7de80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.888+0000 7f7de6ffd640 1 -- 172.21.15.37:0/3985948739 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de80d15e0 con 0x7f7de8070d30 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.889+0000 7f7de6ffd640 1 --2- 172.21.15.37:0/3985948739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8070d30 0x7f7de80d20c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b456d9029235d5e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.889+0000 7f7de67fc640 1 -- 172.21.15.37:0/3985948739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8037070 con 0x7f7de8070d30 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.889+0000 7f7de67fc640 1 -- 172.21.15.37:0/3985948739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd8032440 con 0x7f7de8070d30 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.889+0000 7f7de67fc640 1 -- 172.21.15.37:0/3985948739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8032810 con 0x7f7de8070d30 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 -- 172.21.15.37:0/3985948739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8070d30 msgr2=0x7f7de80d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/3985948739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8070d30 0x7f7de80d20c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd802a210 comp rx=0 tx=0).stop 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 -- 172.21.15.37:0/3985948739 shutdown_connections 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/3985948739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8071110 0x7f7de806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/3985948739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8070d30 0x7f7de80d20c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 -- 172.21.15.37:0/3985948739 >> 172.21.15.37:0/3985948739 conn(0x7f7de80d2e90 msgr2=0x7f7de80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:11.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 -- 172.21.15.37:0/3985948739 shutdown_connections 2024-05-10T08:49:11.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.890+0000 7f7ded3b6640 1 -- 172.21.15.37:0/3985948739 wait complete. 2024-05-10T08:49:11.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.891+0000 7f7ded3b6640 1 Processor -- start 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.891+0000 7f7ded3b6640 1 -- start start 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ded3b6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8070d30 0x7f7de81f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ded3b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8071110 0x7f7de80b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ded3b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de8163920 0x7f7de806e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ded3b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7de80d1c30 con 0x7f7de8071110 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ded3b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8070b80 con 0x7f7de8163920 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ded3b6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7de80715a0 con 0x7f7de8070d30 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8071110 0x7f7de80b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8071110 0x7f7de80b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36460/0 (socket says 172.21.15.37:36460) 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 -- 172.21.15.37:0/1875446567 learned_addr learned my addr 172.21.15.37:0/1875446567 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7de77fe640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de8163920 0x7f7de806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 -- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8070d30 msgr2=0x7f7de81f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8070d30 0x7f7de81f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 -- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de8163920 msgr2=0x7f7de806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de8163920 0x7f7de806e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 -- 172.21.15.37:0/1875446567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de80cd4c0 con 0x7f7de8071110 2024-05-10T08:49:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddffff640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8071110 0x7f7de80b83f0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000b3c0 tx=0x7f7dd000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddf7fe640 1 -- 172.21.15.37:0/1875446567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0011830 con 0x7f7de8071110 2024-05-10T08:49:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddf7fe640 1 -- 172.21.15.37:0/1875446567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd0016070 con 0x7f7de8071110 2024-05-10T08:49:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ddf7fe640 1 -- 172.21.15.37:0/1875446567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0011c50 con 0x7f7de8071110 2024-05-10T08:49:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.892+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de80cd7a0 con 0x7f7de8071110 2024-05-10T08:49:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.893+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de80cdd60 con 0x7f7de8071110 2024-05-10T08:49:11.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.893+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de8076080 con 0x7f7de8071110 2024-05-10T08:49:11.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.894+0000 7f7ddf7fe640 1 -- 172.21.15.37:0/1875446567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7dd001b460 con 0x7f7de8071110 2024-05-10T08:49:11.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.895+0000 7f7ddf7fe640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7dc80762d0 0x7f7dc8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:11.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.895+0000 7f7ddf7fe640 1 -- 172.21.15.37:0/1875446567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7f7dd0097390 con 0x7f7de8071110 2024-05-10T08:49:11.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.895+0000 7f7de6ffd640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7dc80762d0 0x7f7dc8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:11.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.896+0000 7f7de6ffd640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7dc80762d0 0x7f7dc8078790 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8034000 tx=0x7f7dd802c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:11.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:11.899+0000 7f7ddf7fe640 1 -- 172.21.15.37:0/1875446567 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7de8076080 con 0x7f7de8071110 2024-05-10T08:49:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.130+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7de80d3d70 con 0x7f7de8071110 2024-05-10T08:49:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.131+0000 7f7ddf7fe640 1 -- 172.21.15.37:0/1875446567 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5167 (secure 0 0 0) 0x7f7dd0020020 con 0x7f7de8071110 2024-05-10T08:49:12.130 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:12.130 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2261445736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2261445736},{"type":"v1","addr":"172.21.15.37:6834","nonce":2261445736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:49:10.418153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T08:49:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 89 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7dc80762d0 msgr2=0x7f7dc8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7dc80762d0 0x7f7dc8078790 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8034000 tx=0x7f7dd802c000 comp rx=0 tx=0).stop 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8071110 msgr2=0x7f7de80b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8071110 0x7f7de80b83f0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000b3c0 tx=0x7f7dd000b880 comp rx=0 tx=0).stop 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 shutdown_connections 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7dc80762d0 0x7f7dc8078790 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de8163920 0x7f7de806e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de8071110 0x7f7de80b83f0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 --2- 172.21.15.37:0/1875446567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7de8070d30 0x7f7de81f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 >> 172.21.15.37:0/1875446567 conn(0x7f7de80d2e90 msgr2=0x7f7de8160af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:12.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 shutdown_connections 2024-05-10T08:49:12.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.133+0000 7f7ded3b6640 1 -- 172.21.15.37:0/1875446567 wait complete. 2024-05-10T08:49:12.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.248+0000 7fc5bd9c8640 1 Processor -- start 2024-05-10T08:49:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.248+0000 7fc5bd9c8640 1 -- start start 2024-05-10T08:49:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5bd9c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 0x7fc5b80d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5bd9c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b80d3330 con 0x7fc5b80d3cd0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5bd9c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b80d2170 con 0x7fc5b81629a0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5bd9c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b80d2450 con 0x7fc5b80c9ee0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5b67fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc5b80d3cd0 0x7fc5b80cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41244/0 (socket says 172.21.15.37:41244) 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5b67fc640 1 -- 172.21.15.37:0/1737888773 learned_addr learned my addr 172.21.15.37:0/1737888773 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 0x7fc5b80d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272577692 0 0) 0x7fc5b80d3330 con 0x7fc5b80d3cd0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a4003520 con 0x7fc5b80d3cd0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.249+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508735488 0 0) 0x7fc5b80d2170 con 0x7fc5b81629a0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5b80d3330 con 0x7fc5b81629a0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1179183608 0 0) 0x7fc5a4003520 con 0x7fc5b80d3cd0 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 msgr2=0x7fc5b80d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 0x7fc5b80d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 >> v1:172.21.15.82:6789/0 conn(0x7fc5b81629a0 legacy=0x7fc5b80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b80d2730 con 0x7fc5b80d3cd0 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fc5a0001670 con 0x7fc5b80d3cd0 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 0x7fc5b80d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 >> v1:172.21.15.37:6789/0 conn(0x7fc5b80d3cd0 legacy=0x7fc5b80cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 0x7fc5a4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5a4004100 0x7fc5a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a4004d40 0x7fc5a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b80d2450 con 0x7fc5a4004d40 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a400bc00 con 0x7fc5a4004100 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a400be00 con 0x7fc5b80c9ee0 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a4004d40 0x7fc5a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b6ffd640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 0x7fc5a4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b67fc640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5a4004100 0x7fc5a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b77fe640 1 -- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 msgr2=0x7fc5a4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5b80c9ee0 0x7fc5a4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b77fe640 1 -- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5a4004100 msgr2=0x7fc5a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5a4004100 0x7fc5a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.250+0000 7fc5b77fe640 1 -- 172.21.15.37:0/1737888773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a4003520 con 0x7fc5a4004d40 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.251+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a4004d40 0x7fc5a40051c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000e350 tx=0x7fc5a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f58f5d83588e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.251+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0009dc0 con 0x7fc5a4004d40 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.251+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0003b90 con 0x7fc5a4004d40 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.251+0000 7fc5b5ffb640 1 -- 172.21.15.37:0/1737888773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0004030 con 0x7fc5a4004d40 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.252+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/1737888773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a4004d40 msgr2=0x7fc5a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.252+0000 7fc5bd9c8640 1 --2- 172.21.15.37:0/1737888773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a4004d40 0x7fc5a40051c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000e350 tx=0x7fc5a4005830 comp rx=0 tx=0).stop 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.252+0000 7fc5b77fe640 1 -- 172.21.15.37:0/1737888773 reap_dead start 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.252+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/1737888773 shutdown_connections 2024-05-10T08:49:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.252+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/1737888773 >> 172.21.15.37:0/1737888773 conn(0x7fc5b80d4fe0 msgr2=0x7fc5b80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.252+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/1737888773 shutdown_connections 2024-05-10T08:49:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.252+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/1737888773 wait complete. 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.253+0000 7fc5bd9c8640 1 Processor -- start 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.253+0000 7fc5bd9c8640 1 -- start start 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5bd9c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5a4004d40 0x7fc5b80b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5bd9c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b80cd230 0x7fc5b80cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5bd9c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5b809ef30 0x7fc5b809f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5bd9c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b80cf440 con 0x7fc5b809ef30 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5bd9c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b80cf2c0 con 0x7fc5b80cd230 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5bd9c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b80d2dc0 con 0x7fc5a4004d40 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5b809ef30 0x7fc5b809f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5b809ef30 0x7fc5b809f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36478/0 (socket says 172.21.15.37:36478) 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 -- 172.21.15.37:0/2088553933 learned_addr learned my addr 172.21.15.37:0/2088553933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b67fc640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b80cd230 0x7fc5b80cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b6ffd640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5a4004d40 0x7fc5b80b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 -- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5a4004d40 msgr2=0x7fc5b80b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5a4004d40 0x7fc5b80b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 -- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b80cd230 msgr2=0x7fc5b80cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b80cd230 0x7fc5b80cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 -- 172.21.15.37:0/2088553933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b809fc60 con 0x7fc5b809ef30 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b67fc640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b80cd230 0x7fc5b80cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b6ffd640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5a4004d40 0x7fc5b80b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.254+0000 7fc5b77fe640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5b809ef30 0x7fc5b809f3b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000e470 tx=0x7fc5b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.255+0000 7fc5affff640 1 -- 172.21.15.37:0/2088553933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0046070 con 0x7fc5b809ef30 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.255+0000 7fc5affff640 1 -- 172.21.15.37:0/2088553933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0009a50 con 0x7fc5b809ef30 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.255+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b814e350 con 0x7fc5b809ef30 2024-05-10T08:49:12.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.255+0000 7fc5affff640 1 -- 172.21.15.37:0/2088553933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0009dc0 con 0x7fc5b809ef30 2024-05-10T08:49:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.255+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b814e910 con 0x7fc5b809ef30 2024-05-10T08:49:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.256+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b814eb10 con 0x7fc5b809ef30 2024-05-10T08:49:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.256+0000 7fc5affff640 1 -- 172.21.15.37:0/2088553933 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc5b002e610 con 0x7fc5b809ef30 2024-05-10T08:49:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.257+0000 7fc5affff640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5980762d0 0x7fc598078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.257+0000 7fc5affff640 1 -- 172.21.15.37:0/2088553933 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7fc5b00b80c0 con 0x7fc5b809ef30 2024-05-10T08:49:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.257+0000 7fc5b6ffd640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5980762d0 0x7fc598078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.258+0000 7fc5b6ffd640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5980762d0 0x7fc598078790 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80010e0 tx=0x7fc5a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.261+0000 7fc5affff640 1 -- 172.21.15.37:0/2088553933 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc5b814eb10 con 0x7fc5b809ef30 2024-05-10T08:49:12.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.495+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5b80693f0 con 0x7fc5b809ef30 2024-05-10T08:49:12.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.495+0000 7fc5affff640 1 -- 172.21.15.37:0/2088553933 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5167 (secure 0 0 0) 0x7fc5b0032070 con 0x7fc5b809ef30 2024-05-10T08:49:12.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:12.494 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2261445736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2261445736},{"type":"v1","addr":"172.21.15.37:6834","nonce":2261445736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:47:46.304772+0000","modified":"2024-05-10T08:49:10.418153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-05-10T08:49:12.495 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 89 2024-05-10T08:49:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.497+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5980762d0 msgr2=0x7fc598078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5980762d0 0x7fc598078790 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80010e0 tx=0x7fc5a8009040 comp rx=0 tx=0).stop 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5b809ef30 msgr2=0x7fc5b809f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5b809ef30 0x7fc5b809f3b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000e470 tx=0x7fc5b0009750 comp rx=0 tx=0).stop 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 shutdown_connections 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc5980762d0 0x7fc598078790 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5b809ef30 0x7fc5b809f3b0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5b80cd230 0x7fc5b80cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 --2- 172.21.15.37:0/2088553933 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5a4004d40 0x7fc5b80b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 >> 172.21.15.37:0/2088553933 conn(0x7fc5b80d4fe0 msgr2=0x7fc5b80cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 shutdown_connections 2024-05-10T08:49:12.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.498+0000 7fc5bd9c8640 1 -- 172.21.15.37:0/2088553933 wait complete. 2024-05-10T08:49:12.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:49:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.613+0000 7f0ec4e72640 1 Processor -- start 2024-05-10T08:49:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.614+0000 7f0ec4e72640 1 -- start start 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.614+0000 7f0ec4e72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ec015f0c0 0x7f0ec00b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.614+0000 7f0ec4e72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.614+0000 7f0ec4e72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec006c3a0 0x7f0ec006c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.614+0000 7f0ec4e72640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0ec0163450 con 0x7f0ec006c3a0 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.614+0000 7f0ec4e72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0ec00b1260 con 0x7f0ec015f0c0 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.614+0000 7f0ec4e72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec00b14e0 con 0x7f0ec01638e0 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec006c3a0 0x7f0ec006c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec006c3a0 0x7f0ec006c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36492/0 (socket says 172.21.15.37:36492) 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 -- 172.21.15.37:0/1906484017 learned_addr learned my addr 172.21.15.37:0/1906484017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebe59c640 1 --2- 172.21.15.37:0/1906484017 >> v2:172.21.15.82:3300/0 conn(0x7f0ec015f0c0 0x7f0ec00b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/1906484017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 -- 172.21.15.37:0/1906484017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 msgr2=0x7f0ec00b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 --2- 172.21.15.37:0/1906484017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 -- 172.21.15.37:0/1906484017 >> v2:172.21.15.82:3300/0 conn(0x7f0ec015f0c0 msgr2=0x7f0ec00b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 --2- 172.21.15.37:0/1906484017 >> v2:172.21.15.82:3300/0 conn(0x7f0ec015f0c0 0x7f0ec00b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.615+0000 7f0ebed9d640 1 -- 172.21.15.37:0/1906484017 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec0162e00 con 0x7f0ec006c3a0 2024-05-10T08:49:12.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ebed9d640 1 --2- 172.21.15.37:0/1906484017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec006c3a0 0x7f0ec006c830 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0071200 tx=0x7f0eb802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1616e3161c2979 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ebdd9b640 1 -- 172.21.15.37:0/1906484017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8036070 con 0x7f0ec006c3a0 2024-05-10T08:49:12.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ebdd9b640 1 -- 172.21.15.37:0/1906484017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb8031600 con 0x7f0ec006c3a0 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ebdd9b640 1 -- 172.21.15.37:0/1906484017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80319d0 con 0x7f0ec006c3a0 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 -- 172.21.15.37:0/1906484017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec006c3a0 msgr2=0x7f0ec006c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/1906484017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec006c3a0 0x7f0ec006c830 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0071200 tx=0x7f0eb802a6a0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 -- 172.21.15.37:0/1906484017 shutdown_connections 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/1906484017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec006c3a0 0x7f0ec006c830 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/1906484017 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/1906484017 >> v2:172.21.15.82:3300/0 conn(0x7f0ec015f0c0 0x7f0ec00b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 -- 172.21.15.37:0/1906484017 >> 172.21.15.37:0/1906484017 conn(0x7f0ec00b3b10 msgr2=0x7f0ec00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 -- 172.21.15.37:0/1906484017 shutdown_connections 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.616+0000 7f0ec4e72640 1 -- 172.21.15.37:0/1906484017 wait complete. 2024-05-10T08:49:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 Processor -- start 2024-05-10T08:49:12.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 -- start start 2024-05-10T08:49:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ec006c3a0 0x7f0ec0153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015f0c0 0x7f0ec01599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0073170 con 0x7f0ec015f0c0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec00b17c0 con 0x7f0ec006c3a0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.618+0000 7f0ec4e72640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec00732f0 con 0x7f0ec01638e0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015f0c0 0x7f0ec01599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015f0c0 0x7f0ec01599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36500/0 (socket says 172.21.15.37:36500) 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 -- 172.21.15.37:0/2463034036 learned_addr learned my addr 172.21.15.37:0/2463034036 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0ebe59c640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ec006c3a0 0x7f0ec0153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0ebed9d640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 -- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 msgr2=0x7f0ec00b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 -- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ec006c3a0 msgr2=0x7f0ec0153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ec006c3a0 0x7f0ec0153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 -- 172.21.15.37:0/2463034036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec015b100 con 0x7f0ec015f0c0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015f0c0 0x7f0ec01599e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800d5f0 tx=0x7f0ea800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/2463034036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80125f0 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/2463034036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea8019070 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec015b3a0 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/2463034036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80129d0 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.619+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec015b960 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.620+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec006a8f0 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.621+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/2463034036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ea8012b70 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.622+0000 7f0eb6ffd640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ea00762d0 0x7f0ea0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.622+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/2463034036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7f0ea8097c20 con 0x7f0ec015f0c0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.622+0000 7f0ebe59c640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ea00762d0 0x7f0ea0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.622+0000 7f0ebe59c640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ea00762d0 0x7f0ea0078790 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0006fd0 tx=0x7f0eb0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.626+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/2463034036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0ea8060c20 con 0x7f0ec015f0c0 2024-05-10T08:49:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.824+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ec0070230 con 0x7f0ec015f0c0 2024-05-10T08:49:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.825+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/2463034036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+17178 (secure 0 0 0) 0x7f0ec0070230 con 0x7f0ec015f0c0 2024-05-10T08:49:12.824 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:12.825 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":107,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:10.417961+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:47:43.973480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-10T08:47:45.269524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.4","mappings":[{"from":1,"to":7}]},{"pgid":"16.29","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/3773299798":"2024-05-11T08:49:10.417937+0000","172.21.15.37:6833/3773299798":"2024-05-11T08:49:10.417937+0000","172.21.15.82:6837/902568070":"2024-05-11T08:48:33.953799+0000","172.21.15.82:6835/902568070":"2024-05-11T08:48:33.953799+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ea00762d0 msgr2=0x7f0ea0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ea00762d0 0x7f0ea0078790 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0006fd0 tx=0x7f0eb0008040 comp rx=0 tx=0).stop 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015f0c0 msgr2=0x7f0ec01599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015f0c0 0x7f0ec01599e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800d5f0 tx=0x7f0ea800dab0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 shutdown_connections 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0ea00762d0 0x7f0ea0078790 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0ec01638e0 0x7f0ec00b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015f0c0 0x7f0ec01599e0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 --2- 172.21.15.37:0/2463034036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ec006c3a0 0x7f0ec0153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.827+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 >> 172.21.15.37:0/2463034036 conn(0x7f0ec00b3b10 msgr2=0x7f0ec015f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.828+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 shutdown_connections 2024-05-10T08:49:12.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.828+0000 7f0ec4e72640 1 -- 172.21.15.37:0/2463034036 wait complete. 2024-05-10T08:49:12.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:49:12.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.944+0000 7fcba64d1640 1 Processor -- start 2024-05-10T08:49:12.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.944+0000 7fcba64d1640 1 -- start start 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcba64d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcba00d1970 0x7fcba00d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcba64d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba00d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcba64d1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba01630b0 con 0x7fcba015f420 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcba64d1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcba00d3e70 con 0x7fcba00d1970 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcba64d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcba00d5670 con 0x7fcba00d4cc0 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcba4a6e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba00d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb97fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcba00d1970 0x7fcba00d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb9ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcba015f420 0x7fcba00d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:36042/0 (socket says 172.21.15.37:36042) 2024-05-10T08:49:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcba4a6e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba00d5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:46190/0 (socket says 172.21.15.37:46190) 2024-05-10T08:49:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb9ffff640 1 -- 172.21.15.37:0/4000055857 learned_addr learned my addr 172.21.15.37:0/4000055857 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb97fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcba00d1970 0x7fcba00d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:50778/0 (socket says 172.21.15.37:50778) 2024-05-10T08:49:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb97fff640 1 -- 172.21.15.37:0/4000055857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 msgr2=0x7fcba00d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb97fff640 1 --2- 172.21.15.37:0/4000055857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba00d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb97fff640 1 -- 172.21.15.37:0/4000055857 >> v1:172.21.15.82:6789/0 conn(0x7fcba015f420 legacy=0x7fcba00d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.945+0000 7fcb97fff640 1 -- 172.21.15.37:0/4000055857 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba00d2550 con 0x7fcba00d1970 2024-05-10T08:49:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.946+0000 7fcb97fff640 1 --2- 172.21.15.37:0/4000055857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 0x7fcba00d1e20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcb880097a0 tx=0x7fcb8802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffcb46c375fc5787 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.946+0000 7fcb9f7fe640 1 -- 172.21.15.37:0/4000055857 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88037070 con 0x7fcba00d1970 2024-05-10T08:49:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.946+0000 7fcb9f7fe640 1 -- 172.21.15.37:0/4000055857 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb88032440 con 0x7fcba00d1970 2024-05-10T08:49:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.946+0000 7fcb9f7fe640 1 -- 172.21.15.37:0/4000055857 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88032810 con 0x7fcba00d1970 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 -- 172.21.15.37:0/4000055857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 msgr2=0x7fcba00d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 --2- 172.21.15.37:0/4000055857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 0x7fcba00d1e20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcb880097a0 tx=0x7fcb8802a180 comp rx=0 tx=0).stop 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 -- 172.21.15.37:0/4000055857 shutdown_connections 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 --2- 172.21.15.37:0/4000055857 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba00d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 --2- 172.21.15.37:0/4000055857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 0x7fcba00d1e20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 -- 172.21.15.37:0/4000055857 >> 172.21.15.37:0/4000055857 conn(0x7fcba008eac0 msgr2=0x7fcba009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 -- 172.21.15.37:0/4000055857 shutdown_connections 2024-05-10T08:49:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.947+0000 7fcba64d1640 1 -- 172.21.15.37:0/4000055857 wait complete. 2024-05-10T08:49:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.948+0000 7fcba64d1640 1 Processor -- start 2024-05-10T08:49:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.948+0000 7fcba64d1640 1 -- start start 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba64d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 0x7fcba00ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba64d1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba64d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba006e320 0x7fcba0147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba64d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcba00d3240 con 0x7fcba006e320 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba64d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcba00d2f60 con 0x7fcba00d1970 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba64d1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcba00d2830 con 0x7fcba00d4cc0 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba006e320 0x7fcba0147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba006e320 0x7fcba0147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36502/0 (socket says 172.21.15.37:36502) 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 -- 172.21.15.37:0/1297495607 learned_addr learned my addr 172.21.15.37:0/1297495607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcb9ffff640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 0x7fcba00ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcb97fff640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 -- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 msgr2=0x7fcba006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 -- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 msgr2=0x7fcba00ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 0x7fcba00ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.949+0000 7fcba4a6e640 1 -- 172.21.15.37:0/1297495607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba0148b50 con 0x7fcba006e320 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.950+0000 7fcba4a6e640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba006e320 0x7fcba0147e50 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800efc0 tx=0x7fcb9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.950+0000 7fcb9d7fa640 1 -- 172.21.15.37:0/1297495607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98018020 con 0x7fcba006e320 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.950+0000 7fcb9d7fa640 1 -- 172.21.15.37:0/1297495607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98014480 con 0x7fcba006e320 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.950+0000 7fcb9d7fa640 1 -- 172.21.15.37:0/1297495607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98014870 con 0x7fcba006e320 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.950+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba0145fa0 con 0x7fcba006e320 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.950+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba00ce5b0 con 0x7fcba006e320 2024-05-10T08:49:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.951+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba00c88c0 con 0x7fcba006e320 2024-05-10T08:49:12.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.951+0000 7fcb9d7fa640 1 -- 172.21.15.37:0/1297495607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcb98005d10 con 0x7fcba006e320 2024-05-10T08:49:12.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.952+0000 7fcb9d7fa640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcb80076300 0x7fcb800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:12.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.952+0000 7fcb9d7fa640 1 -- 172.21.15.37:0/1297495607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7fcb98098440 con 0x7fcba006e320 2024-05-10T08:49:12.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.952+0000 7fcb9ffff640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcb80076300 0x7fcb800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:12.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.953+0000 7fcb9ffff640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcb80076300 0x7fcb800787c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcb90000f60 tx=0x7fcb90009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:12.956+0000 7fcb9d7fa640 1 -- 172.21.15.37:0/1297495607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcba00c88c0 con 0x7fcba006e320 2024-05-10T08:49:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.186+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcba00693f0 con 0x7fcba006e320 2024-05-10T08:49:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.538+0000 7fcb9d7fa640 1 -- 172.21.15.37:0/1297495607 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7fcb98022070 con 0x7fcba006e320 2024-05-10T08:49:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:49:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcb80076300 msgr2=0x7fcb800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcb80076300 0x7fcb800787c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcb90000f60 tx=0x7fcb90009040 comp rx=0 tx=0).stop 2024-05-10T08:49:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba006e320 msgr2=0x7fcba0147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba006e320 0x7fcba0147e50 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800efc0 tx=0x7fcb9800c490 comp rx=0 tx=0).stop 2024-05-10T08:49:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 shutdown_connections 2024-05-10T08:49:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcb80076300 0x7fcb800787c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba006e320 0x7fcba0147e50 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcba00d4cc0 0x7fcba006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 --2- 172.21.15.37:0/1297495607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcba00d1970 0x7fcba00ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 >> 172.21.15.37:0/1297495607 conn(0x7fcba008eac0 msgr2=0x7fcba0163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 shutdown_connections 2024-05-10T08:49:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.540+0000 7fcba64d1640 1 -- 172.21.15.37:0/1297495607 wait complete. 2024-05-10T08:49:13.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:49:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.661+0000 7fea27138640 1 Processor -- start 2024-05-10T08:49:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.661+0000 7fea27138640 1 -- start start 2024-05-10T08:49:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea27138640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea2006da00 0x7fea20073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea27138640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea200b65f0 con 0x7fea2006d620 2024-05-10T08:49:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea27138640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea200b5120 con 0x7fea201637b0 2024-05-10T08:49:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea27138640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fea200afaa0 con 0x7fea2006da00 2024-05-10T08:49:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea24ed4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fea2006d620 0x7fea200af2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41256/0 (socket says 172.21.15.37:41256) 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea24ed4640 1 -- 172.21.15.37:0/4113178778 learned_addr learned my addr 172.21.15.37:0/4113178778 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1ffff640 1 --2- 172.21.15.37:0/4113178778 >> v2:172.21.15.82:3300/0 conn(0x7fea2006da00 0x7fea20073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817780102 0 0) 0x7fea200b65f0 con 0x7fea2006d620 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea10003520 con 0x7fea2006d620 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200232872 0 0) 0x7fea200b5120 con 0x7fea201637b0 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea200b65f0 con 0x7fea201637b0 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1387582422 0 0) 0x7fea10003520 con 0x7fea2006d620 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1ffff640 1 -- 172.21.15.37:0/4113178778 >> v1:172.21.15.82:6789/0 conn(0x7fea201637b0 legacy=0x7fea200b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1ffff640 1 -- 172.21.15.37:0/4113178778 >> v1:172.21.15.37:6789/0 conn(0x7fea2006d620 legacy=0x7fea200af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.662+0000 7fea1ffff640 1 -- 172.21.15.37:0/4113178778 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea200b5400 con 0x7fea2006da00 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.663+0000 7fea1ffff640 1 --2- 172.21.15.37:0/4113178778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20073800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0097a0 tx=0x7fea0c02a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3778a94b47834e86 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.663+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c037070 con 0x7fea2006da00 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.663+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0c02ab30 con 0x7fea2006da00 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.663+0000 7fea1f7fe640 1 -- 172.21.15.37:0/4113178778 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14001670 con 0x7fea2006da00 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.664+0000 7fea27138640 1 -- 172.21.15.37:0/4113178778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 msgr2=0x7fea20073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.664+0000 7fea27138640 1 --2- 172.21.15.37:0/4113178778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20073800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0097a0 tx=0x7fea0c02a0a0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.664+0000 7fea27138640 1 -- 172.21.15.37:0/4113178778 shutdown_connections 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.664+0000 7fea27138640 1 --2- 172.21.15.37:0/4113178778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20073800 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.664+0000 7fea27138640 1 -- 172.21.15.37:0/4113178778 >> 172.21.15.37:0/4113178778 conn(0x7fea200728c0 msgr2=0x7fea20072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.664+0000 7fea27138640 1 -- 172.21.15.37:0/4113178778 shutdown_connections 2024-05-10T08:49:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.664+0000 7fea27138640 1 -- 172.21.15.37:0/4113178778 wait complete. 2024-05-10T08:49:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.665+0000 7fea27138640 1 Processor -- start 2024-05-10T08:49:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.665+0000 7fea27138640 1 -- start start 2024-05-10T08:49:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea27138640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2006d620 0x7fea20149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea27138640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20161390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea27138640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea201637b0 0x7fea20155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea27138640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea2006e920 con 0x7fea201637b0 2024-05-10T08:49:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea27138640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea200b5a50 con 0x7fea2006da00 2024-05-10T08:49:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea27138640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea2006eaa0 con 0x7fea2006d620 2024-05-10T08:49:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea256d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea201637b0 0x7fea20155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea256d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea201637b0 0x7fea20155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36518/0 (socket says 172.21.15.37:36518) 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.666+0000 7fea256d5640 1 -- 172.21.15.37:0/3809725680 learned_addr learned my addr 172.21.15.37:0/3809725680 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea1ffff640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20161390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea24ed4640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2006d620 0x7fea20149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea256d5640 1 -- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2006d620 msgr2=0x7fea20149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea256d5640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2006d620 0x7fea20149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea256d5640 1 -- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 msgr2=0x7fea20161390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea256d5640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20161390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea256d5640 1 -- 172.21.15.37:0/3809725680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea20156c50 con 0x7fea201637b0 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea1ffff640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20161390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea256d5640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea201637b0 0x7fea20155d60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c6e0 tx=0x7fea1800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea1d7fa640 1 -- 172.21.15.37:0/3809725680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18003b70 con 0x7fea201637b0 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea1d7fa640 1 -- 172.21.15.37:0/3809725680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea18003d10 con 0x7fea201637b0 2024-05-10T08:49:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea20156f30 con 0x7fea201637b0 2024-05-10T08:49:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea1d7fa640 1 -- 172.21.15.37:0/3809725680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea180052d0 con 0x7fea201637b0 2024-05-10T08:49:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.667+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea2014a4d0 con 0x7fea201637b0 2024-05-10T08:49:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.668+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea200693f0 con 0x7fea201637b0 2024-05-10T08:49:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.669+0000 7fea1d7fa640 1 -- 172.21.15.37:0/3809725680 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea18005470 con 0x7fea201637b0 2024-05-10T08:49:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.669+0000 7fea1d7fa640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea040762d0 0x7fea04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.669+0000 7fea1d7fa640 1 -- 172.21.15.37:0/3809725680 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7fea18097770 con 0x7fea201637b0 2024-05-10T08:49:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.670+0000 7fea24ed4640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea040762d0 0x7fea04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.670+0000 7fea24ed4640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea040762d0 0x7fea04078790 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fea14001380 tx=0x7fea14009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:13.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.673+0000 7fea1d7fa640 1 -- 172.21.15.37:0/3809725680 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fea18060e70 con 0x7fea201637b0 2024-05-10T08:49:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:13.903+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fea200b1e90 con 0x7fea201637b0 2024-05-10T08:49:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.545+0000 7fea1d7fa640 1 -- 172.21.15.37:0/3809725680 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) ==== 104+0+0 (secure 0 0 0) 0x7fea18060770 con 0x7fea201637b0 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea040762d0 msgr2=0x7fea04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea040762d0 0x7fea04078790 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fea14001380 tx=0x7fea14009040 comp rx=0 tx=0).stop 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea201637b0 msgr2=0x7fea20155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea201637b0 0x7fea20155d60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c6e0 tx=0x7fea1800cba0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 shutdown_connections 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fea040762d0 0x7fea04078790 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea201637b0 0x7fea20155d60 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2006da00 0x7fea20161390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 --2- 172.21.15.37:0/3809725680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea2006d620 0x7fea20149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 >> 172.21.15.37:0/3809725680 conn(0x7fea200728c0 msgr2=0x7fea20162570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 shutdown_connections 2024-05-10T08:49:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.548+0000 7fea27138640 1 -- 172.21.15.37:0/3809725680 wait complete. 2024-05-10T08:49:14.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:49:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.671+0000 7fbb3e693640 1 Processor -- start 2024-05-10T08:49:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.671+0000 7fbb3e693640 1 -- start start 2024-05-10T08:49:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb3e693640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb380d3670 0x7fbb380b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb3e693640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb380d3a50 0x7fbb380d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb3e693640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb380cfc00 con 0x7fbb380d0e80 2024-05-10T08:49:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb3e693640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbb380d2a10 con 0x7fbb380d3a50 2024-05-10T08:49:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb3e693640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbb380d04b0 con 0x7fbb380d3670 2024-05-10T08:49:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb377fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb380d3a50 0x7fbb380d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb3cc30640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb380d0e80 0x7fbb380d19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41268/0 (socket says 172.21.15.37:41268) 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb3cc30640 1 -- 172.21.15.37:0/1566826270 learned_addr learned my addr 172.21.15.37:0/1566826270 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb37fff640 1 --2- 172.21.15.37:0/1566826270 >> v2:172.21.15.82:3300/0 conn(0x7fbb380d3670 0x7fbb380b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb377fe640 1 -- 172.21.15.37:0/1566826270 >> v2:172.21.15.82:3300/0 conn(0x7fbb380d3670 msgr2=0x7fbb380b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb377fe640 1 --2- 172.21.15.37:0/1566826270 >> v2:172.21.15.82:3300/0 conn(0x7fbb380d3670 0x7fbb380b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb377fe640 1 -- 172.21.15.37:0/1566826270 >> v1:172.21.15.37:6789/0 conn(0x7fbb380d0e80 legacy=0x7fbb380d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb36ffd640 1 -- 172.21.15.37:0/1566826270 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960077232 0 0) 0x7fbb380cfc00 con 0x7fbb380d0e80 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.672+0000 7fbb377fe640 1 -- 172.21.15.37:0/1566826270 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb380cfea0 con 0x7fbb380d3a50 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.673+0000 7fbb37fff640 1 --2- 172.21.15.37:0/1566826270 >> v2:172.21.15.82:3300/0 conn(0x7fbb380d3670 0x7fbb380b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.673+0000 7fbb377fe640 1 --2- 172.21.15.37:0/1566826270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb380d0940 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fbb3808f7c0 tx=0x7fbb2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cc1517e3cac3a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.673+0000 7fbb36ffd640 1 -- 172.21.15.37:0/1566826270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c037070 con 0x7fbb380d3a50 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.673+0000 7fbb36ffd640 1 -- 172.21.15.37:0/1566826270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c032440 con 0x7fbb380d3a50 2024-05-10T08:49:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.673+0000 7fbb36ffd640 1 -- 172.21.15.37:0/1566826270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c032810 con 0x7fbb380d3a50 2024-05-10T08:49:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 -- 172.21.15.37:0/1566826270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 msgr2=0x7fbb380d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 --2- 172.21.15.37:0/1566826270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb380d0940 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fbb3808f7c0 tx=0x7fbb2c02a1a0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 -- 172.21.15.37:0/1566826270 shutdown_connections 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 --2- 172.21.15.37:0/1566826270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb380d0940 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 --2- 172.21.15.37:0/1566826270 >> v2:172.21.15.82:3300/0 conn(0x7fbb380d3670 0x7fbb380b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 -- 172.21.15.37:0/1566826270 >> 172.21.15.37:0/1566826270 conn(0x7fbb3809e390 msgr2=0x7fbb380d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 -- 172.21.15.37:0/1566826270 shutdown_connections 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.674+0000 7fbb3e693640 1 -- 172.21.15.37:0/1566826270 wait complete. 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.675+0000 7fbb3e693640 1 Processor -- start 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.675+0000 7fbb3e693640 1 -- start start 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3e693640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380d0e80 0x7fbb380b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3e693640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380d3670 0x7fbb38158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3e693640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb3815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3e693640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb380d0140 con 0x7fbb380d3a50 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3e693640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb380d2730 con 0x7fbb380d3670 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3e693640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb380b4f00 con 0x7fbb380d0e80 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3cc30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb3815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3cc30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb3815c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36546/0 (socket says 172.21.15.37:36546) 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb3cc30640 1 -- 172.21.15.37:0/2743957700 learned_addr learned my addr 172.21.15.37:0/2743957700 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb377fe640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380d3670 0x7fbb38158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.676+0000 7fbb37fff640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380d0e80 0x7fbb380b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3cc30640 1 -- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380d0e80 msgr2=0x7fbb380b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3cc30640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380d0e80 0x7fbb380b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3cc30640 1 -- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380d3670 msgr2=0x7fbb38158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3cc30640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380d3670 0x7fbb38158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3cc30640 1 -- 172.21.15.37:0/2743957700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3815bb90 con 0x7fbb380d3a50 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3cc30640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb3815c720 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c7a0 tx=0x7fbb3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb34ff9640 1 -- 172.21.15.37:0/2743957700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30018070 con 0x7fbb380d3a50 2024-05-10T08:49:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb34ff9640 1 -- 172.21.15.37:0/2743957700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3000a640 con 0x7fbb380d3a50 2024-05-10T08:49:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3815b5d0 con 0x7fbb380d3a50 2024-05-10T08:49:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb34ff9640 1 -- 172.21.15.37:0/2743957700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000aab0 con 0x7fbb380d3a50 2024-05-10T08:49:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.677+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb380b96e0 con 0x7fbb380d3a50 2024-05-10T08:49:14.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.678+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb380693f0 con 0x7fbb380d3a50 2024-05-10T08:49:14.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.679+0000 7fbb34ff9640 1 -- 172.21.15.37:0/2743957700 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb3001b070 con 0x7fbb380d3a50 2024-05-10T08:49:14.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.679+0000 7fbb34ff9640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb240762d0 0x7fbb24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:14.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.680+0000 7fbb34ff9640 1 -- 172.21.15.37:0/2743957700 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6331+0+0 (secure 0 0 0) 0x7fbb30096cf0 con 0x7fbb380d3a50 2024-05-10T08:49:14.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.680+0000 7fbb37fff640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb240762d0 0x7fbb24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:14.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.680+0000 7fbb37fff640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb240762d0 0x7fbb24078790 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbb28006fd0 tx=0x7fbb28008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:14.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.684+0000 7fbb34ff9640 1 -- 172.21.15.37:0/2743957700 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbb3009b070 con 0x7fbb380d3a50 2024-05-10T08:49:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:14.873+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbb380d22f0 con 0x7fbb380d3a50 2024-05-10T08:49:15.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.552+0000 7fbb34ff9640 1 -- 172.21.15.37:0/2743957700 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v108) ==== 181+0+0 (secure 0 0 0) 0x7fbb3005fe20 con 0x7fbb380d3a50 2024-05-10T08:49:15.551 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:49:15.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb240762d0 msgr2=0x7fbb24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb240762d0 0x7fbb24078790 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbb28006fd0 tx=0x7fbb28008040 comp rx=0 tx=0).stop 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 msgr2=0x7fbb3815c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb3815c720 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c7a0 tx=0x7fbb3000cc60 comp rx=0 tx=0).stop 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 shutdown_connections 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbb240762d0 0x7fbb24078790 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb380d3a50 0x7fbb3815c720 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb380d3670 0x7fbb38158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 --2- 172.21.15.37:0/2743957700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb380d0e80 0x7fbb380b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 >> 172.21.15.37:0/2743957700 conn(0x7fbb3809e390 msgr2=0x7fbb380b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:15.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 shutdown_connections 2024-05-10T08:49:15.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.555+0000 7fbb3e693640 1 -- 172.21.15.37:0/2743957700 wait complete. 2024-05-10T08:49:15.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:49:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.679+0000 7f85b0c20640 1 Processor -- start 2024-05-10T08:49:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.679+0000 7f85b0c20640 1 -- start start 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85b0c20640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85ac1629f0 0x7f85ac0d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85b0c20640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 0x7f85ac0d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85b0c20640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac0cde80 con 0x7f85ac0d1ba0 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85b0c20640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f85ac0ce120 con 0x7f85ac1629f0 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85b0c20640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac0ce400 con 0x7f85ac0d22a0 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85aad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85ac0d1ba0 0x7f85ac0ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41278/0 (socket says 172.21.15.37:41278) 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85aad9d640 1 -- 172.21.15.37:0/324533462 learned_addr learned my addr 172.21.15.37:0/324533462 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a1d9b640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 0x7f85ac0d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85aa59c640 1 --2- 172.21.15.37:0/324533462 >> v2:172.21.15.82:3300/0 conn(0x7f85ac1629f0 0x7f85ac0d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457686682 0 0) 0x7f85ac0cde80 con 0x7f85ac0d1ba0 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8598003520 con 0x7f85ac0d1ba0 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 998993596 0 0) 0x7f8598003520 con 0x7f85ac0d1ba0 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 msgr2=0x7f85ac0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 0x7f85ac0d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 >> v2:172.21.15.82:3300/0 conn(0x7f85ac1629f0 msgr2=0x7f85ac0d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 --2- 172.21.15.37:0/324533462 >> v2:172.21.15.82:3300/0 conn(0x7f85ac1629f0 0x7f85ac0d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac0ce6e0 con 0x7f85ac0d1ba0 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f85a40019f0 con 0x7f85ac0d1ba0 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 >> v1:172.21.15.37:6789/0 conn(0x7f85ac0d1ba0 legacy=0x7f85ac0ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85980039b0 0x7f8598003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 0x7f8598004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8598004d40 0x7f85980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac0ce120 con 0x7f8598004d40 2024-05-10T08:49:15.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac0ce400 con 0x7f85980039b0 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f859800b9c0 con 0x7f85ac0d22a0 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.680+0000 7f85aad9d640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8598004d40 0x7f85980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85a1d9b640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 0x7f8598004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85aa59c640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85980039b0 0x7f8598003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85aad9d640 1 -- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 msgr2=0x7f8598004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85aad9d640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0d22a0 0x7f8598004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85aad9d640 1 -- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85980039b0 msgr2=0x7f8598003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85aad9d640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85980039b0 0x7f8598003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85aad9d640 1 -- 172.21.15.37:0/324533462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598003520 con 0x7f8598004d40 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.681+0000 7f85aad9d640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8598004d40 0x7f85980051c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f85a400a890 tx=0x7f8598005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539486c629e7a390 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a400a4e0 con 0x7f8598004d40 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a402f070 con 0x7f8598004d40 2024-05-10T08:49:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85a9d9b640 1 -- 172.21.15.37:0/324533462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a402bcf0 con 0x7f8598004d40 2024-05-10T08:49:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85b0c20640 1 -- 172.21.15.37:0/324533462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8598004d40 msgr2=0x7f85980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85b0c20640 1 --2- 172.21.15.37:0/324533462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8598004d40 0x7f85980051c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f85a400a890 tx=0x7f8598005830 comp rx=0 tx=0).stop 2024-05-10T08:49:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85aad9d640 1 -- 172.21.15.37:0/324533462 reap_dead start 2024-05-10T08:49:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85b0c20640 1 -- 172.21.15.37:0/324533462 shutdown_connections 2024-05-10T08:49:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85b0c20640 1 -- 172.21.15.37:0/324533462 >> 172.21.15.37:0/324533462 conn(0x7f85ac0d2d80 msgr2=0x7f85ac0d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85b0c20640 1 -- 172.21.15.37:0/324533462 shutdown_connections 2024-05-10T08:49:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.682+0000 7f85b0c20640 1 -- 172.21.15.37:0/324533462 wait complete. 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 Processor -- start 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 -- start start 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8598004d40 0x7f85ac1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac0b74c0 0x7f85ac1f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0b7940 0x7f85ac1f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac06e850 con 0x7f85ac0b74c0 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac06e6d0 con 0x7f8598004d40 2024-05-10T08:49:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85b0c20640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac06e9d0 con 0x7f85ac0b7940 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85a1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac0b74c0 0x7f85ac1f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85a1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac0b74c0 0x7f85ac1f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36552/0 (socket says 172.21.15.37:36552) 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.684+0000 7f85a1d9b640 1 -- 172.21.15.37:0/632885741 learned_addr learned my addr 172.21.15.37:0/632885741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85aa59c640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8598004d40 0x7f85ac1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85aad9d640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0b7940 0x7f85ac1f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a1d9b640 1 -- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0b7940 msgr2=0x7f85ac1f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a1d9b640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0b7940 0x7f85ac1f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a1d9b640 1 -- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8598004d40 msgr2=0x7f85ac1f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a1d9b640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8598004d40 0x7f85ac1f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a1d9b640 1 -- 172.21.15.37:0/632885741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac1f5b60 con 0x7f85ac0b74c0 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a1d9b640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac0b74c0 0x7f85ac1f4060 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8594011910 tx=0x7f8594011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a37fe640 1 -- 172.21.15.37:0/632885741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594019070 con 0x7f85ac0b74c0 2024-05-10T08:49:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a37fe640 1 -- 172.21.15.37:0/632885741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8594004240 con 0x7f85ac0b74c0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac0cd4c0 con 0x7f85ac0b74c0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85a37fe640 1 -- 172.21.15.37:0/632885741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859400f820 con 0x7f85ac0b74c0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.685+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac1f6250 con 0x7f85ac0b74c0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.686+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ac1f5d60 con 0x7f85ac0b74c0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.687+0000 7f85a37fe640 1 -- 172.21.15.37:0/632885741 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f859401c070 con 0x7f85ac0b74c0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.687+0000 7f85a37fe640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f858c0762d0 0x7f858c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.687+0000 7f85a37fe640 1 -- 172.21.15.37:0/632885741 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5893+0+0 (secure 0 0 0) 0x7f85940979f0 con 0x7f85ac0b74c0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.688+0000 7f85aa59c640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f858c0762d0 0x7f858c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:15.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.688+0000 7f85aa59c640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f858c0762d0 0x7f858c078790 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f85ac15cd40 tx=0x7f859c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:15.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.692+0000 7f85a37fe640 1 -- 172.21.15.37:0/632885741 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f85ac1f5b60 con 0x7f85ac0b74c0 2024-05-10T08:49:15.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:15.887+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f85ac0693f0 con 0x7f85ac0b74c0 2024-05-10T08:49:16.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.557+0000 7f85a37fe640 1 -- 172.21.15.37:0/632885741 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v109) ==== 169+0+0 (secure 0 0 0) 0x7f8594060c40 con 0x7f85ac0b74c0 2024-05-10T08:49:16.556 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:49:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.562+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f858c0762d0 msgr2=0x7f858c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.562+0000 7f85b0c20640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f858c0762d0 0x7f858c078790 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f85ac15cd40 tx=0x7f859c009190 comp rx=0 tx=0).stop 2024-05-10T08:49:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.562+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac0b74c0 msgr2=0x7f85ac1f4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.562+0000 7f85b0c20640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac0b74c0 0x7f85ac1f4060 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8594011910 tx=0x7f8594011d10 comp rx=0 tx=0).stop 2024-05-10T08:49:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.563+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 shutdown_connections 2024-05-10T08:49:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.563+0000 7f85b0c20640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f858c0762d0 0x7f858c078790 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.563+0000 7f85b0c20640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f85ac0b7940 0x7f85ac1f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.563+0000 7f85b0c20640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac0b74c0 0x7f85ac1f4060 secure :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8594011910 tx=0x7f8594011d10 comp rx=0 tx=0).stop 2024-05-10T08:49:16.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.563+0000 7f85b0c20640 1 --2- 172.21.15.37:0/632885741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8598004d40 0x7f85ac1f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.563+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 >> 172.21.15.37:0/632885741 conn(0x7f85ac0d2d80 msgr2=0x7f85ac160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:16.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.564+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 shutdown_connections 2024-05-10T08:49:16.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.564+0000 7f85b0c20640 1 -- 172.21.15.37:0/632885741 wait complete. 2024-05-10T08:49:16.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T08:49:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.692+0000 7f06aceea640 1 Processor -- start 2024-05-10T08:49:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.692+0000 7f06aceea640 1 -- start start 2024-05-10T08:49:16.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06aceea640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06a80aedf0 0x7f06a80b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:16.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06aceea640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a809ff30 con 0x7f06a806c3a0 2024-05-10T08:49:16.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06aceea640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a815d750 con 0x7f06a815d180 2024-05-10T08:49:16.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06aceea640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f06a815e360 con 0x7f06a80aedf0 2024-05-10T08:49:16.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06a5d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06a80aedf0 0x7f06a80b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:16.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06a5d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06a80aedf0 0x7f06a80b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36562/0 (socket says 172.21.15.37:36562) 2024-05-10T08:49:16.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06a659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06a806c3a0 0x7f06a806c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41282/0 (socket says 172.21.15.37:41282) 2024-05-10T08:49:16.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.693+0000 7f06a5d9b640 1 -- 172.21.15.37:0/1651401205 learned_addr learned my addr 172.21.15.37:0/1651401205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:16.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.694+0000 7f06a5d9b640 1 -- 172.21.15.37:0/1651401205 >> v1:172.21.15.82:6789/0 conn(0x7f06a815d180 legacy=0x7f06a80b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:16.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.694+0000 7f06a5d9b640 1 -- 172.21.15.37:0/1651401205 >> v1:172.21.15.37:6789/0 conn(0x7f06a806c3a0 legacy=0x7f06a806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.694+0000 7f06a5d9b640 1 -- 172.21.15.37:0/1651401205 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a815da30 con 0x7f06a80aedf0 2024-05-10T08:49:16.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.694+0000 7f06a559a640 1 -- 172.21.15.37:0/1651401205 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334807048 0 0) 0x7f06a809ff30 con 0x7f06a806c3a0 2024-05-10T08:49:16.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.694+0000 7f06a5d9b640 1 --2- 172.21.15.37:0/1651401205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a80aedf0 0x7f06a80b13f0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0690009870 tx=0x7f069002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20128cd8c3abe46 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:16.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06a559a640 1 -- 172.21.15.37:0/1651401205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690037070 con 0x7f06a80aedf0 2024-05-10T08:49:16.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06a559a640 1 -- 172.21.15.37:0/1651401205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0690032440 con 0x7f06a80aedf0 2024-05-10T08:49:16.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06a559a640 1 -- 172.21.15.37:0/1651401205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690032810 con 0x7f06a80aedf0 2024-05-10T08:49:16.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06aceea640 1 -- 172.21.15.37:0/1651401205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a80aedf0 msgr2=0x7f06a80b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06aceea640 1 --2- 172.21.15.37:0/1651401205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a80aedf0 0x7f06a80b13f0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0690009870 tx=0x7f069002a2a0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06aceea640 1 -- 172.21.15.37:0/1651401205 shutdown_connections 2024-05-10T08:49:16.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06aceea640 1 --2- 172.21.15.37:0/1651401205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a80aedf0 0x7f06a80b13f0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06aceea640 1 -- 172.21.15.37:0/1651401205 >> 172.21.15.37:0/1651401205 conn(0x7f06a80b3b10 msgr2=0x7f06a80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:16.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06aceea640 1 -- 172.21.15.37:0/1651401205 shutdown_connections 2024-05-10T08:49:16.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.695+0000 7f06aceea640 1 -- 172.21.15.37:0/1651401205 wait complete. 2024-05-10T08:49:16.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 Processor -- start 2024-05-10T08:49:16.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 -- start start 2024-05-10T08:49:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06a806c3a0 0x7f06a81530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a80aedf0 0x7f06a81488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a815d180 0x7f06a81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80b6130 con 0x7f06a815d180 2024-05-10T08:49:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06a815dff0 con 0x7f06a80aedf0 2024-05-10T08:49:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06aceea640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f06a80b62b0 con 0x7f06a806c3a0 2024-05-10T08:49:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.697+0000 7f06a6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a815d180 0x7f06a81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a815d180 0x7f06a81585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36574/0 (socket says 172.21.15.37:36574) 2024-05-10T08:49:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 -- 172.21.15.37:0/2766074617 learned_addr learned my addr 172.21.15.37:0/2766074617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a659c640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06a806c3a0 0x7f06a81530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a5d9b640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a80aedf0 0x7f06a81488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 -- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06a806c3a0 msgr2=0x7f06a81530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06a806c3a0 0x7f06a81530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 -- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a80aedf0 msgr2=0x7f06a81488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a80aedf0 0x7f06a81488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 -- 172.21.15.37:0/2766074617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a8153620 con 0x7f06a815d180 2024-05-10T08:49:16.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a5d9b640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a80aedf0 0x7f06a81488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06a6d9d640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a815d180 0x7f06a81585e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b440 tx=0x7f06a000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f069effd640 1 -- 172.21.15.37:0/2766074617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0015020 con 0x7f06a815d180 2024-05-10T08:49:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f069effd640 1 -- 172.21.15.37:0/2766074617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a0011830 con 0x7f06a815d180 2024-05-10T08:49:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a8148e10 con 0x7f06a815d180 2024-05-10T08:49:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f069effd640 1 -- 172.21.15.37:0/2766074617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0011c20 con 0x7f06a815d180 2024-05-10T08:49:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.698+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a8152600 con 0x7f06a815d180 2024-05-10T08:49:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.699+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a806a8f0 con 0x7f06a815d180 2024-05-10T08:49:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.700+0000 7f069effd640 1 -- 172.21.15.37:0/2766074617 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06a0018020 con 0x7f06a815d180 2024-05-10T08:49:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.700+0000 7f069effd640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06880762d0 0x7f0688078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.700+0000 7f069effd640 1 -- 172.21.15.37:0/2766074617 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7f06a00972e0 con 0x7f06a815d180 2024-05-10T08:49:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.701+0000 7f06a659c640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06880762d0 0x7f0688078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.701+0000 7f06a659c640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06880762d0 0x7f0688078790 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06980012e0 tx=0x7f0698009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.705+0000 7f069effd640 1 -- 172.21.15.37:0/2766074617 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f06a001f020 con 0x7f06a815d180 2024-05-10T08:49:16.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.894+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f06a80b0cb0 con 0x7f06a815d180 2024-05-10T08:49:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.898+0000 7f069effd640 1 -- 172.21.15.37:0/2766074617 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f06a0060df0 con 0x7f06a815d180 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06880762d0 msgr2=0x7f0688078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06880762d0 0x7f0688078790 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06980012e0 tx=0x7f0698009040 comp rx=0 tx=0).stop 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a815d180 msgr2=0x7f06a81585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a815d180 0x7f06a81585e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b440 tx=0x7f06a000b900 comp rx=0 tx=0).stop 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 shutdown_connections 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f06880762d0 0x7f0688078790 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a815d180 0x7f06a81585e0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a80aedf0 0x7f06a81488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 --2- 172.21.15.37:0/2766074617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06a806c3a0 0x7f06a81530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 >> 172.21.15.37:0/2766074617 conn(0x7f06a80b3b10 msgr2=0x7f06a815f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 shutdown_connections 2024-05-10T08:49:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:16.900+0000 7f06aceea640 1 -- 172.21.15.37:0/2766074617 wait complete. 2024-05-10T08:49:16.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-05-10T08:49:17.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.015+0000 7f6ca07ac640 1 Processor -- start 2024-05-10T08:49:17.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.015+0000 7f6ca07ac640 1 -- start start 2024-05-10T08:49:17.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6ca07ac640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 0x7f6c9806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6ca07ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c980d0530 0x7f6c980b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6ca07ac640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9815d2a0 con 0x7f6c9806fe30 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6ca07ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6c9806f440 con 0x7f6c980d0530 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6ca07ac640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6c981609b0 con 0x7f6c9806f060 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6c9ed49640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c980d0530 0x7f6c980b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6c9ed49640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c980d0530 0x7f6c980b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36580/0 (socket says 172.21.15.37:36580) 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.016+0000 7f6c9ed49640 1 -- 172.21.15.37:0/4210612275 learned_addr learned my addr 172.21.15.37:0/4210612275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.017+0000 7f6c9e548640 1 --2- 172.21.15.37:0/4210612275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 0x7f6c9806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.017+0000 7f6c9ed49640 1 -- 172.21.15.37:0/4210612275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 msgr2=0x7f6c9806e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.017+0000 7f6c9ed49640 1 --2- 172.21.15.37:0/4210612275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 0x7f6c9806e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.017+0000 7f6c9ed49640 1 -- 172.21.15.37:0/4210612275 >> v1:172.21.15.82:6789/0 conn(0x7f6c9806fe30 legacy=0x7f6c980cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:17.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.017+0000 7f6c9ed49640 1 -- 172.21.15.37:0/4210612275 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c98160c90 con 0x7f6c980d0530 2024-05-10T08:49:17.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.017+0000 7f6c9ed49640 1 --2- 172.21.15.37:0/4210612275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c980b3f00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009e50 tx=0x7f6c9002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1c69be2056e048 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:17.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.017+0000 7f6c9d546640 1 -- 172.21.15.37:0/4210612275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90036070 con 0x7f6c980d0530 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6c9d546640 1 -- 172.21.15.37:0/4210612275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c90031600 con 0x7f6c980d0530 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6c9d546640 1 -- 172.21.15.37:0/4210612275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c900319d0 con 0x7f6c980d0530 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 -- 172.21.15.37:0/4210612275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 msgr2=0x7f6c980b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/4210612275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c980b3f00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009e50 tx=0x7f6c9002a6c0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 -- 172.21.15.37:0/4210612275 shutdown_connections 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/4210612275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c980b3f00 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/4210612275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 0x7f6c9806e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 -- 172.21.15.37:0/4210612275 >> 172.21.15.37:0/4210612275 conn(0x7f6c9806c3a0 msgr2=0x7f6c9806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 -- 172.21.15.37:0/4210612275 shutdown_connections 2024-05-10T08:49:17.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.018+0000 7f6ca07ac640 1 -- 172.21.15.37:0/4210612275 wait complete. 2024-05-10T08:49:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.019+0000 7f6ca07ac640 1 Processor -- start 2024-05-10T08:49:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.019+0000 7f6ca07ac640 1 -- start start 2024-05-10T08:49:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6ca07ac640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 0x7f6c98154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6ca07ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c9806fe30 0x7f6c9809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6ca07ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c981e8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6ca07ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98161530 con 0x7f6c980d0530 2024-05-10T08:49:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6ca07ac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98161250 con 0x7f6c9806fe30 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6ca07ac640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6c98161810 con 0x7f6c9806f060 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6c9ed49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c981e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6c9ed49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c981e8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36594/0 (socket says 172.21.15.37:36594) 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6c9ed49640 1 -- 172.21.15.37:0/1384899919 learned_addr learned my addr 172.21.15.37:0/1384899919 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6c9ed49640 1 -- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 msgr2=0x7f6c98154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6c9ed49640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 0x7f6c98154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6c9ed49640 1 -- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c9806fe30 msgr2=0x7f6c9809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.020+0000 7f6c9ed49640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c9806fe30 0x7f6c9809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.021+0000 7f6c9ed49640 1 -- 172.21.15.37:0/1384899919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c980cf0e0 con 0x7f6c980d0530 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.021+0000 7f6c9ed49640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c981e8870 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009f70 tx=0x7f6c90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.021+0000 7f6c8effd640 1 -- 172.21.15.37:0/1384899919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90036050 con 0x7f6c980d0530 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.021+0000 7f6c8effd640 1 -- 172.21.15.37:0/1384899919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c90042070 con 0x7f6c980d0530 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.021+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9809ccf0 con 0x7f6c980d0530 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.021+0000 7f6c8effd640 1 -- 172.21.15.37:0/1384899919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90009510 con 0x7f6c980d0530 2024-05-10T08:49:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.021+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9809e230 con 0x7f6c980d0530 2024-05-10T08:49:17.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.022+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c980693f0 con 0x7f6c980d0530 2024-05-10T08:49:17.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.023+0000 7f6c8effd640 1 -- 172.21.15.37:0/1384899919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c90007c50 con 0x7f6c980d0530 2024-05-10T08:49:17.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.023+0000 7f6c8effd640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c7c0762d0 0x7f6c7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.023+0000 7f6c8effd640 1 -- 172.21.15.37:0/1384899919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7f6c900b84b0 con 0x7f6c980d0530 2024-05-10T08:49:17.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.023+0000 7f6c9e548640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c7c0762d0 0x7f6c7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.024+0000 7f6c9e548640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c7c0762d0 0x7f6c7c078790 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006fd0 tx=0x7f6c94008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:17.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.027+0000 7f6c8effd640 1 -- 172.21.15.37:0/1384899919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6c90081fc0 con 0x7f6c980d0530 2024-05-10T08:49:17.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.297+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f6c9806fc10 con 0x7f6c980d0530 2024-05-10T08:49:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.558+0000 7f6c8effd640 1 -- 172.21.15.37:0/1384899919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v412) ==== 146+0+0 (secure 0 0 0) 0x7f6c900818c0 con 0x7f6c980d0530 2024-05-10T08:49:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.560+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c7c0762d0 msgr2=0x7f6c7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.560+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c7c0762d0 0x7f6c7c078790 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006fd0 tx=0x7f6c94008040 comp rx=0 tx=0).stop 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.560+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 msgr2=0x7f6c981e8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.560+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c981e8870 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009f70 tx=0x7f6c90004a40 comp rx=0 tx=0).stop 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 shutdown_connections 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6c7c0762d0 0x7f6c7c078790 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c980d0530 0x7f6c981e8870 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c9806fe30 0x7f6c9809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 --2- 172.21.15.37:0/1384899919 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6c9806f060 0x7f6c98154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 >> 172.21.15.37:0/1384899919 conn(0x7f6c9806c3a0 msgr2=0x7f6c980cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 shutdown_connections 2024-05-10T08:49:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.561+0000 7f6ca07ac640 1 -- 172.21.15.37:0/1384899919 wait complete. 2024-05-10T08:49:17.571 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-05-10T08:49:17.571 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-05-10T08:49:17.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:49:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.677+0000 7f79253f7640 1 Processor -- start 2024-05-10T08:49:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.677+0000 7f79253f7640 1 -- start start 2024-05-10T08:49:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.678+0000 7f79253f7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f792015ccb0 0x7f792015d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.678+0000 7f79253f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 0x7f7920071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.678+0000 7f79253f7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79200718c0 con 0x7f79200d2ce0 2024-05-10T08:49:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.678+0000 7f79253f7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f79200afba0 con 0x7f792015ccb0 2024-05-10T08:49:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.678+0000 7f79253f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7920071ba0 con 0x7f7920070b90 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.678+0000 7f791e7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f79200d2ce0 0x7f79200d3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41292/0 (socket says 172.21.15.37:41292) 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.678+0000 7f791e7fc640 1 -- 172.21.15.37:0/1583536861 learned_addr learned my addr 172.21.15.37:0/1583536861 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791effd640 1 --2- 172.21.15.37:0/1583536861 >> v2:172.21.15.82:3300/0 conn(0x7f792015ccb0 0x7f792015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791f7fe640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 0x7f7920071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834385396 0 0) 0x7f79200718c0 con 0x7f79200d2ce0 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f790c003520 con 0x7f79200d2ce0 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2400880893 0 0) 0x7f790c003520 con 0x7f79200d2ce0 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 msgr2=0x7f7920071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 0x7f7920071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 >> v2:172.21.15.82:3300/0 conn(0x7f792015ccb0 msgr2=0x7f792015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 --2- 172.21.15.37:0/1583536861 >> v2:172.21.15.82:3300/0 conn(0x7f792015ccb0 0x7f792015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7920071e80 con 0x7f79200d2ce0 2024-05-10T08:49:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f7908001670 con 0x7f79200d2ce0 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 >> v1:172.21.15.37:6789/0 conn(0x7f79200d2ce0 legacy=0x7f79200d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f790c0039b0 0x7f790c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c004800 0x7f790c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 0x7f790c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7920071ba0 con 0x7f790c0039b0 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f790c00b9c0 con 0x7f790c004800 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f790c00bb40 con 0x7f7920070b90 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791effd640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f790c0039b0 0x7f790c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791e7fc640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c004800 0x7f790c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791f7fe640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 0x7f790c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791effd640 1 -- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 msgr2=0x7f790c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791effd640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7920070b90 0x7f790c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791effd640 1 -- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c004800 msgr2=0x7f790c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791effd640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790c004800 0x7f790c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.679+0000 7f791effd640 1 -- 172.21.15.37:0/1583536861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c003520 con 0x7f790c0039b0 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.680+0000 7f791effd640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f790c0039b0 0x7f790c003dd0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f7918009ac0 tx=0x7f790c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484449f3559609f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.680+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918036070 con 0x7f790c0039b0 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.680+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7918031400 con 0x7f790c0039b0 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.680+0000 7f791dffb640 1 -- 172.21.15.37:0/1583536861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918009690 con 0x7f790c0039b0 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.681+0000 7f79253f7640 1 -- 172.21.15.37:0/1583536861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f790c0039b0 msgr2=0x7f790c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.681+0000 7f79253f7640 1 --2- 172.21.15.37:0/1583536861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f790c0039b0 0x7f790c003dd0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f7918009ac0 tx=0x7f790c005830 comp rx=0 tx=0).stop 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.681+0000 7f791f7fe640 1 -- 172.21.15.37:0/1583536861 reap_dead start 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.681+0000 7f79253f7640 1 -- 172.21.15.37:0/1583536861 shutdown_connections 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.681+0000 7f79253f7640 1 -- 172.21.15.37:0/1583536861 >> 172.21.15.37:0/1583536861 conn(0x7f792009ba40 msgr2=0x7f792009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.681+0000 7f79253f7640 1 -- 172.21.15.37:0/1583536861 shutdown_connections 2024-05-10T08:49:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.681+0000 7f79253f7640 1 -- 172.21.15.37:0/1583536861 wait complete. 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.682+0000 7f79253f7640 1 Processor -- start 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.682+0000 7f79253f7640 1 -- start start 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f79253f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0039b0 0x7f792015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f79253f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79200c8400 0x7f79200b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f79253f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79200b80e0 0x7f79201f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f79253f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79200711a0 con 0x7f79200b80e0 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f79253f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7920071020 con 0x7f79200c8400 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f79253f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7920071320 con 0x7f790c0039b0 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f791f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79200b80e0 0x7f79201f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f791f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79200b80e0 0x7f79201f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36620/0 (socket says 172.21.15.37:36620) 2024-05-10T08:49:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f791f7fe640 1 -- 172.21.15.37:0/3285616948 learned_addr learned my addr 172.21.15.37:0/3285616948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f791e7fc640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79200c8400 0x7f79200b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.683+0000 7f791effd640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0039b0 0x7f792015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f791f7fe640 1 -- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0039b0 msgr2=0x7f792015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f791f7fe640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0039b0 0x7f792015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f791f7fe640 1 -- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79200c8400 msgr2=0x7f79200b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f791f7fe640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79200c8400 0x7f79200b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f791f7fe640 1 -- 172.21.15.37:0/3285616948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79200c6900 con 0x7f79200b80e0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f791effd640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0039b0 0x7f792015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f791f7fe640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79200b80e0 0x7f79201f5e70 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f7910011bf0 tx=0x7f791000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f79177fe640 1 -- 172.21.15.37:0/3285616948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791000fdb0 con 0x7f79200b80e0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f79177fe640 1 -- 172.21.15.37:0/3285616948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7910015430 con 0x7f79200b80e0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79200c6be0 con 0x7f79200b80e0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f79177fe640 1 -- 172.21.15.37:0/3285616948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910015820 con 0x7f79200b80e0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.684+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79200c71a0 con 0x7f79200b80e0 2024-05-10T08:49:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.685+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79200b8560 con 0x7f79200b80e0 2024-05-10T08:49:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.686+0000 7f79177fe640 1 -- 172.21.15.37:0/3285616948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f79100159c0 con 0x7f79200b80e0 2024-05-10T08:49:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.686+0000 7f79177fe640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7900076300 0x7f79000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.686+0000 7f79177fe640 1 -- 172.21.15.37:0/3285616948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7f7910098130 con 0x7f79200b80e0 2024-05-10T08:49:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.686+0000 7f791effd640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7900076300 0x7f79000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.687+0000 7f791effd640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7900076300 0x7f79000787c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7918033000 tx=0x7f7918008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.691+0000 7f79177fe640 1 -- 172.21.15.37:0/3285616948 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7910019030 con 0x7f79200b80e0 2024-05-10T08:49:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.888+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7920069b00 con 0x7f79200b80e0 2024-05-10T08:49:17.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.889+0000 7f79177fe640 1 -- 172.21.15.37:0/3285616948 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+13371 (secure 0 0 0) 0x7f7910010040 con 0x7f79200b80e0 2024-05-10T08:49:17.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:17.888 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":109,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:16.553624+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/3773299798":"2024-05-11T08:49:10.417937+0000","172.21.15.37:6833/3773299798":"2024-05-11T08:49:10.417937+0000","172.21.15.82:6837/902568070":"2024-05-11T08:48:33.953799+0000","172.21.15.82:6835/902568070":"2024-05-11T08:48:33.953799+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7900076300 msgr2=0x7f79000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7900076300 0x7f79000787c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7918033000 tx=0x7f7918008030 comp rx=0 tx=0).stop 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79200b80e0 msgr2=0x7f79201f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79200b80e0 0x7f79201f5e70 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f7910011bf0 tx=0x7f791000f580 comp rx=0 tx=0).stop 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 shutdown_connections 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7900076300 0x7f79000787c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79200b80e0 0x7f79201f5e70 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79200c8400 0x7f79200b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 --2- 172.21.15.37:0/3285616948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f790c0039b0 0x7f792015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 >> 172.21.15.37:0/3285616948 conn(0x7f792009ba40 msgr2=0x7f79200b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 shutdown_connections 2024-05-10T08:49:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:17.891+0000 7f79253f7640 1 -- 172.21.15.37:0/3285616948 wait complete. 2024-05-10T08:49:17.901 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T08:40:11.341540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T08:49:17.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T08:49:18.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.012+0000 7fce8edf7640 1 Processor -- start 2024-05-10T08:49:18.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.012+0000 7fce8edf7640 1 -- start start 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce8edf7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 0x7fce880cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce8edf7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce880d56b0 0x7fce880d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce8edf7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce880d0320 con 0x7fce880d3aa0 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce8edf7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fce880d0600 con 0x7fce880d56b0 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce8edf7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fce880d08e0 con 0x7fce8815f4e0 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce87fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce880d3aa0 0x7fce880d4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37746/0 (socket says 172.21.15.37:37746) 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce87fff640 1 -- 172.21.15.37:0/1248163517 learned_addr learned my addr 172.21.15.37:0/1248163517 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.013+0000 7fce8cb93640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 0x7fce880cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891772303 0 0) 0x7fce880d0320 con 0x7fce880d3aa0 2024-05-10T08:49:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce78003520 con 0x7fce880d3aa0 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8d394640 1 --2- 172.21.15.37:0/1248163517 >> v2:172.21.15.82:3300/0 conn(0x7fce880d56b0 0x7fce880d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3893116967 0 0) 0x7fce78003520 con 0x7fce880d3aa0 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 msgr2=0x7fce880cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 0x7fce880cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 >> v2:172.21.15.82:3300/0 conn(0x7fce880d56b0 msgr2=0x7fce880d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 --2- 172.21.15.37:0/1248163517 >> v2:172.21.15.82:3300/0 conn(0x7fce880d56b0 0x7fce880d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce880d0bc0 con 0x7fce880d3aa0 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fce74001670 con 0x7fce880d3aa0 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 >> v1:172.21.15.37:6789/0 conn(0x7fce880d3aa0 legacy=0x7fce880d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce780039b0 0x7fce78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 0x7fce78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d40 0x7fce780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce880d0600 con 0x7fce78004d40 2024-05-10T08:49:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce880d08e0 con 0x7fce780039b0 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fce7800ba40 con 0x7fce8815f4e0 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8d394640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d40 0x7fce780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8cb93640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce780039b0 0x7fce78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce87fff640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 0x7fce78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8d394640 1 -- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 msgr2=0x7fce78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8d394640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce8815f4e0 0x7fce78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8d394640 1 -- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce780039b0 msgr2=0x7fce78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8d394640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce780039b0 0x7fce78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.014+0000 7fce8d394640 1 -- 172.21.15.37:0/1248163517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce78003520 con 0x7fce78004d40 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.015+0000 7fce8d394640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d40 0x7fce780051c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fce80007360 tx=0x7fce78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52af06c3770f5a6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.015+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80009be0 con 0x7fce78004d40 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.015+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8002e620 con 0x7fce78004d40 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.015+0000 7fce877fe640 1 -- 172.21.15.37:0/1248163517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8002e9f0 con 0x7fce78004d40 2024-05-10T08:49:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.016+0000 7fce8edf7640 1 -- 172.21.15.37:0/1248163517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d40 msgr2=0x7fce780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.016+0000 7fce8edf7640 1 --2- 172.21.15.37:0/1248163517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d40 0x7fce780051c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fce80007360 tx=0x7fce78005830 comp rx=0 tx=0).stop 2024-05-10T08:49:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.016+0000 7fce8d394640 1 -- 172.21.15.37:0/1248163517 reap_dead start 2024-05-10T08:49:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.016+0000 7fce8edf7640 1 -- 172.21.15.37:0/1248163517 shutdown_connections 2024-05-10T08:49:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.016+0000 7fce8edf7640 1 -- 172.21.15.37:0/1248163517 >> 172.21.15.37:0/1248163517 conn(0x7fce8808eac0 msgr2=0x7fce8809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.016+0000 7fce8edf7640 1 -- 172.21.15.37:0/1248163517 shutdown_connections 2024-05-10T08:49:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.016+0000 7fce8edf7640 1 -- 172.21.15.37:0/1248163517 wait complete. 2024-05-10T08:49:18.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.017+0000 7fce8edf7640 1 Processor -- start 2024-05-10T08:49:18.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.017+0000 7fce8edf7640 1 -- start start 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8edf7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce78004d40 0x7fce88155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8edf7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce881f8e80 0x7fce881612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8edf7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce88155a20 0x7fce881579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8edf7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce880d3f00 con 0x7fce88155a20 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8edf7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce8815f8c0 con 0x7fce881f8e80 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8edf7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fce880d4080 con 0x7fce78004d40 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8d394640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce88155a20 0x7fce881579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8d394640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce88155a20 0x7fce881579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33608/0 (socket says 172.21.15.37:33608) 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.018+0000 7fce8d394640 1 -- 172.21.15.37:0/1275913869 learned_addr learned my addr 172.21.15.37:0/1275913869 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8cb93640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce78004d40 0x7fce88155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce87fff640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce881f8e80 0x7fce881612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8d394640 1 -- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce78004d40 msgr2=0x7fce88155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8d394640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce78004d40 0x7fce88155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8d394640 1 -- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce881f8e80 msgr2=0x7fce881612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8d394640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce881f8e80 0x7fce881612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8d394640 1 -- 172.21.15.37:0/1275913869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce88155f90 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8d394640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce88155a20 0x7fce881579c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fce80007450 tx=0x7fce80004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce857fa640 1 -- 172.21.15.37:0/1275913869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80009be0 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce857fa640 1 -- 172.21.15.37:0/1275913869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8002e420 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce881f83a0 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce857fa640 1 -- 172.21.15.37:0/1275913869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80038280 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.019+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce88161800 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.020+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce880693f0 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.021+0000 7fce857fa640 1 -- 172.21.15.37:0/1275913869 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce80040030 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.021+0000 7fce857fa640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce6c0762d0 0x7fce6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.022+0000 7fce857fa640 1 -- 172.21.15.37:0/1275913869 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7fce800b7580 con 0x7fce88155a20 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.022+0000 7fce8cb93640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce6c0762d0 0x7fce6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.022+0000 7fce8cb93640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce6c0762d0 0x7fce6c078790 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009b40 tx=0x7fce7c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.027+0000 7fce857fa640 1 -- 172.21.15.37:0/1275913869 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fce80032030 con 0x7fce88155a20 2024-05-10T08:49:18.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.214+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fce880b4330 con 0x7fce88155a20 2024-05-10T08:49:18.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.214+0000 7fce857fa640 1 -- 172.21.15.37:0/1275913869 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) ==== 93+0+10 (secure 0 0 0) 0x7fce8002e5f0 con 0x7fce88155a20 2024-05-10T08:49:18.213 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-10T08:49:18.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce6c0762d0 msgr2=0x7fce6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce6c0762d0 0x7fce6c078790 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009b40 tx=0x7fce7c009190 comp rx=0 tx=0).stop 2024-05-10T08:49:18.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce88155a20 msgr2=0x7fce881579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce88155a20 0x7fce881579c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fce80007450 tx=0x7fce80004ab0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 shutdown_connections 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fce6c0762d0 0x7fce6c078790 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce88155a20 0x7fce881579c0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce881f8e80 0x7fce881612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 --2- 172.21.15.37:0/1275913869 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fce78004d40 0x7fce88155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.216+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 >> 172.21.15.37:0/1275913869 conn(0x7fce8808eac0 msgr2=0x7fce8815e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.217+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 shutdown_connections 2024-05-10T08:49:18.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.217+0000 7fce8edf7640 1 -- 172.21.15.37:0/1275913869 wait complete. 2024-05-10T08:49:18.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-05-10T08:49:18.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.331+0000 7fef2c0dc640 1 Processor -- start 2024-05-10T08:49:18.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.331+0000 7fef2c0dc640 1 -- start start 2024-05-10T08:49:18.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef2c0dc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef241629a0 0x7fef240d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef2c0dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d0cb0 0x7fef240d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef2c0dc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef240d3330 con 0x7fef240d2dc0 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef2c0dc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fef240d2170 con 0x7fef241629a0 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef2c0dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fef240d2450 con 0x7fef240d0cb0 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef2a679640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d0cb0 0x7fef240d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef29e78640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef241629a0 0x7fef240d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef29677640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fef240d2dc0 0x7fef240c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:38406/0 (socket says 172.21.15.37:38406) 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.332+0000 7fef29677640 1 -- 172.21.15.37:0/567616875 learned_addr learned my addr 172.21.15.37:0/567616875 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.333+0000 7fef29e78640 1 -- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d0cb0 msgr2=0x7fef240d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.333+0000 7fef29e78640 1 --2- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d0cb0 0x7fef240d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.333+0000 7fef29e78640 1 -- 172.21.15.37:0/567616875 >> v1:172.21.15.82:6789/0 conn(0x7fef240d2dc0 legacy=0x7fef240c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.333+0000 7fef29e78640 1 -- 172.21.15.37:0/567616875 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef240d2730 con 0x7fef241629a0 2024-05-10T08:49:18.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.333+0000 7fef2a679640 1 --2- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d0cb0 0x7fef240d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:18.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef29e78640 1 --2- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef241629a0 0x7fef240d35c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0097a0 tx=0x7fef1c02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec795a5874532bc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:18.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef28e76640 1 -- 172.21.15.37:0/567616875 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c037070 con 0x7fef241629a0 2024-05-10T08:49:18.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef28e76640 1 -- 172.21.15.37:0/567616875 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c02adb0 con 0x7fef241629a0 2024-05-10T08:49:18.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef28e76640 1 -- 172.21.15.37:0/567616875 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c032660 con 0x7fef241629a0 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 -- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef241629a0 msgr2=0x7fef240d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef241629a0 0x7fef240d35c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0097a0 tx=0x7fef1c02a060 comp rx=0 tx=0).stop 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 -- 172.21.15.37:0/567616875 shutdown_connections 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d0cb0 0x7fef240d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/567616875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef241629a0 0x7fef240d35c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 -- 172.21.15.37:0/567616875 >> 172.21.15.37:0/567616875 conn(0x7fef240d4fe0 msgr2=0x7fef240d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 -- 172.21.15.37:0/567616875 shutdown_connections 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.334+0000 7fef2c0dc640 1 -- 172.21.15.37:0/567616875 wait complete. 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 Processor -- start 2024-05-10T08:49:18.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 -- start start 2024-05-10T08:49:18.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef240d0cb0 0x7fef2414f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d2dc0 0x7fef241612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef241629a0 0x7fef24161810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef240cf440 con 0x7fef241629a0 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef240cf2c0 con 0x7fef240d0cb0 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2c0dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fef240c95e0 con 0x7fef240d2dc0 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.336+0000 7fef2a679640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef241629a0 0x7fef24161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef241629a0 0x7fef24161810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33618/0 (socket says 172.21.15.37:33618) 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 -- 172.21.15.37:0/395310877 learned_addr learned my addr 172.21.15.37:0/395310877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef29e78640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef240d0cb0 0x7fef2414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef29677640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d2dc0 0x7fef241612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 -- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d2dc0 msgr2=0x7fef241612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d2dc0 0x7fef241612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 -- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef240d0cb0 msgr2=0x7fef2414f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef240d0cb0 0x7fef2414f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 -- 172.21.15.37:0/395310877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef240b9d30 con 0x7fef241629a0 2024-05-10T08:49:18.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2a679640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef241629a0 0x7fef24161810 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fef1400efc0 tx=0x7fef14009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:18.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef227fc640 1 -- 172.21.15.37:0/395310877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14018030 con 0x7fef241629a0 2024-05-10T08:49:18.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef227fc640 1 -- 172.21.15.37:0/395310877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1400cde0 con 0x7fef241629a0 2024-05-10T08:49:18.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef240ba010 con 0x7fef241629a0 2024-05-10T08:49:18.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef227fc640 1 -- 172.21.15.37:0/395310877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14003bb0 con 0x7fef241629a0 2024-05-10T08:49:18.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.337+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef240ba5d0 con 0x7fef241629a0 2024-05-10T08:49:18.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.338+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef240693f0 con 0x7fef241629a0 2024-05-10T08:49:18.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.339+0000 7fef227fc640 1 -- 172.21.15.37:0/395310877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef1401b070 con 0x7fef241629a0 2024-05-10T08:49:18.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.339+0000 7fef227fc640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef100762d0 0x7fef10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:18.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.339+0000 7fef227fc640 1 -- 172.21.15.37:0/395310877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7fef14097cf0 con 0x7fef241629a0 2024-05-10T08:49:18.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.340+0000 7fef29e78640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef100762d0 0x7fef10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:18.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.340+0000 7fef29e78640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef100762d0 0x7fef10078790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fef1c034000 tx=0x7fef1c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:18.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.344+0000 7fef227fc640 1 -- 172.21.15.37:0/395310877 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fef1409c070 con 0x7fef241629a0 2024-05-10T08:49:18.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:18.612+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7fef240c9070 con 0x7fef241629a0 2024-05-10T08:49:19.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.568+0000 7fef227fc640 1 -- 172.21.15.37:0/395310877 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v414) ==== 147+0+0 (secure 0 0 0) 0x7fef14010040 con 0x7fef241629a0 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef100762d0 msgr2=0x7fef10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef100762d0 0x7fef10078790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fef1c034000 tx=0x7fef1c02e000 comp rx=0 tx=0).stop 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef241629a0 msgr2=0x7fef24161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef241629a0 0x7fef24161810 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fef1400efc0 tx=0x7fef14009f90 comp rx=0 tx=0).stop 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 shutdown_connections 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fef100762d0 0x7fef10078790 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef241629a0 0x7fef24161810 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fef240d2dc0 0x7fef241612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 --2- 172.21.15.37:0/395310877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef240d0cb0 0x7fef2414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 >> 172.21.15.37:0/395310877 conn(0x7fef240d4fe0 msgr2=0x7fef240d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 shutdown_connections 2024-05-10T08:49:19.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.572+0000 7fef2c0dc640 1 -- 172.21.15.37:0/395310877 wait complete. 2024-05-10T08:49:19.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T08:49:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.703+0000 7f1998408640 1 Processor -- start 2024-05-10T08:49:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.703+0000 7f1998408640 1 -- start start 2024-05-10T08:49:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f1998408640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19900aedf0 0x7f19900b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f1998408640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199009ff30 con 0x7f199015d180 2024-05-10T08:49:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f1998408640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199015d750 con 0x7f199006c3a0 2024-05-10T08:49:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f1998408640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f199015e360 con 0x7f19900aedf0 2024-05-10T08:49:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19959a3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19900aedf0 0x7f19900b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19959a3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19900aedf0 0x7f19900b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33620/0 (socket says 172.21.15.37:33620) 2024-05-10T08:49:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19969a5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f199015d180 0x7f19900b4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37752/0 (socket says 172.21.15.37:37752) 2024-05-10T08:49:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19959a3640 1 -- 172.21.15.37:0/2905899066 learned_addr learned my addr 172.21.15.37:0/2905899066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19959a3640 1 -- 172.21.15.37:0/2905899066 >> v1:172.21.15.82:6789/0 conn(0x7f199006c3a0 legacy=0x7f199006c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19959a3640 1 -- 172.21.15.37:0/2905899066 >> v1:172.21.15.37:6789/0 conn(0x7f199015d180 legacy=0x7f19900b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19959a3640 1 -- 172.21.15.37:0/2905899066 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199015da30 con 0x7f19900aedf0 2024-05-10T08:49:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.704+0000 7f19951a2640 1 -- 172.21.15.37:0/2905899066 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181352651 0 0) 0x7f199009ff30 con 0x7f199015d180 2024-05-10T08:49:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.705+0000 7f19959a3640 1 --2- 172.21.15.37:0/2905899066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19900aedf0 0x7f19900b13f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f1984009870 tx=0x7f198402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a804f4741a88bf11 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.705+0000 7f19951a2640 1 -- 172.21.15.37:0/2905899066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984037070 con 0x7f19900aedf0 2024-05-10T08:49:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.705+0000 7f19951a2640 1 -- 172.21.15.37:0/2905899066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1984032440 con 0x7f19900aedf0 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.705+0000 7f19951a2640 1 -- 172.21.15.37:0/2905899066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984032810 con 0x7f19900aedf0 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.706+0000 7f1998408640 1 -- 172.21.15.37:0/2905899066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19900aedf0 msgr2=0x7f19900b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.706+0000 7f1998408640 1 --2- 172.21.15.37:0/2905899066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19900aedf0 0x7f19900b13f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f1984009870 tx=0x7f198402a2a0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.706+0000 7f1998408640 1 -- 172.21.15.37:0/2905899066 shutdown_connections 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.706+0000 7f1998408640 1 --2- 172.21.15.37:0/2905899066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19900aedf0 0x7f19900b13f0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.706+0000 7f1998408640 1 -- 172.21.15.37:0/2905899066 >> 172.21.15.37:0/2905899066 conn(0x7f19900b3b10 msgr2=0x7f19900b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.706+0000 7f1998408640 1 -- 172.21.15.37:0/2905899066 shutdown_connections 2024-05-10T08:49:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.706+0000 7f1998408640 1 -- 172.21.15.37:0/2905899066 wait complete. 2024-05-10T08:49:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.707+0000 7f1998408640 1 Processor -- start 2024-05-10T08:49:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.707+0000 7f1998408640 1 -- start start 2024-05-10T08:49:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f1998408640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199006c3a0 0x7f1990156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f1998408640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19900aedf0 0x7f1990140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f1998408640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f199015d180 0x7f1990157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f1998408640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19900b6130 con 0x7f199015d180 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f1998408640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f199015dff0 con 0x7f199006c3a0 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f1998408640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f19900b62b0 con 0x7f19900aedf0 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f199015d180 0x7f1990157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f199015d180 0x7f1990157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33630/0 (socket says 172.21.15.37:33630) 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 -- 172.21.15.37:0/1497002898 learned_addr learned my addr 172.21.15.37:0/1497002898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19961a4640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199006c3a0 0x7f1990156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19959a3640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19900aedf0 0x7f1990140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 -- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19900aedf0 msgr2=0x7f1990140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19900aedf0 0x7f1990140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 -- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199006c3a0 msgr2=0x7f1990156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199006c3a0 0x7f1990156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19969a5640 1 -- 172.21.15.37:0/1497002898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1990157d50 con 0x7f199015d180 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.708+0000 7f19959a3640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19900aedf0 0x7f1990140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.709+0000 7f19969a5640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f199015d180 0x7f1990157500 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f198800c410 tx=0x7f198800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.709+0000 7f198effd640 1 -- 172.21.15.37:0/1497002898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19880074e0 con 0x7f199015d180 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.709+0000 7f198effd640 1 -- 172.21.15.37:0/1497002898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19880047e0 con 0x7f199015d180 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.709+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1990158030 con 0x7f199015d180 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.709+0000 7f198effd640 1 -- 172.21.15.37:0/1497002898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988004bd0 con 0x7f199015d180 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.709+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19901585f0 con 0x7f199015d180 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.710+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19900693f0 con 0x7f199015d180 2024-05-10T08:49:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.711+0000 7f198effd640 1 -- 172.21.15.37:0/1497002898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1988011070 con 0x7f199015d180 2024-05-10T08:49:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.711+0000 7f198effd640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f197c076300 0x7f197c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.711+0000 7f198effd640 1 -- 172.21.15.37:0/1497002898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7f19880970b0 con 0x7f199015d180 2024-05-10T08:49:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.711+0000 7f19961a4640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f197c076300 0x7f197c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.712+0000 7f19961a4640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f197c076300 0x7f197c0787c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1980005520 tx=0x7f1980009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.716+0000 7f198effd640 1 -- 172.21.15.37:0/1497002898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1988060aa0 con 0x7f199015d180 2024-05-10T08:49:19.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.911+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f19900b44b0 con 0x7f199015d180 2024-05-10T08:49:19.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.916+0000 7f198effd640 1 -- 172.21.15.37:0/1497002898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f19880603a0 con 0x7f199015d180 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.918+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f197c076300 msgr2=0x7f197c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f197c076300 0x7f197c0787c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1980005520 tx=0x7f1980009040 comp rx=0 tx=0).stop 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f199015d180 msgr2=0x7f1990157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f199015d180 0x7f1990157500 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f198800c410 tx=0x7f198800c8d0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 shutdown_connections 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f197c076300 0x7f197c0787c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f199015d180 0x7f1990157500 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19900aedf0 0x7f1990140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 --2- 172.21.15.37:0/1497002898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199006c3a0 0x7f1990156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 >> 172.21.15.37:0/1497002898 conn(0x7f19900b3b10 msgr2=0x7f1990073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 shutdown_connections 2024-05-10T08:49:19.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:19.919+0000 7f1998408640 1 -- 172.21.15.37:0/1497002898 wait complete. 2024-05-10T08:49:19.928 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:49:19.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:49:19.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:49:20.013 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:49:20.013 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:20.013 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:20.029 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:49:20.029 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:49:20.030 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:20.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:49:20.072 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:20.072 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:20.088 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:49:20.088 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:49:20.088 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:20.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:49:20.131 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T08:49:20.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.235+0000 7fe0dc0dc640 1 Processor -- start 2024-05-10T08:49:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.235+0000 7fe0dc0dc640 1 -- start start 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.236+0000 7fe0dc0dc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0d406e0f0 0x7fe0d415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.236+0000 7fe0dc0dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 0x7fe0d40d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.236+0000 7fe0dc0dc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0d40d14b0 con 0x7fe0d406e4d0 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.236+0000 7fe0dc0dc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d415c920 con 0x7fe0d406e0f0 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.236+0000 7fe0dc0dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d415cc00 con 0x7fe0d4072840 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.236+0000 7fe0da679640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0d406e4d0 0x7fe0d40b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37754/0 (socket says 172.21.15.37:37754) 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.236+0000 7fe0da679640 1 -- 172.21.15.37:0/1171515646 learned_addr learned my addr 172.21.15.37:0/1171515646 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d9e78640 1 --2- 172.21.15.37:0/1171515646 >> v2:172.21.15.82:3300/0 conn(0x7fe0d406e0f0 0x7fe0d415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874879365 0 0) 0x7fe0d40d14b0 con 0x7fe0d406e4d0 2024-05-10T08:49:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d9677640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 0x7fe0d40d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c0003520 con 0x7fe0d406e4d0 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 588665651 0 0) 0x7fe0c0003520 con 0x7fe0d406e4d0 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 msgr2=0x7fe0d40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 0x7fe0d40d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 >> v2:172.21.15.82:3300/0 conn(0x7fe0d406e0f0 msgr2=0x7fe0d415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 --2- 172.21.15.37:0/1171515646 >> v2:172.21.15.82:3300/0 conn(0x7fe0d406e0f0 0x7fe0d415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d415cee0 con 0x7fe0d406e4d0 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fe0cc0019f0 con 0x7fe0d406e4d0 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 >> v1:172.21.15.37:6789/0 conn(0x7fe0d406e4d0 legacy=0x7fe0d40b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00039b0 0x7fe0c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 0x7fe0c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0004d40 0x7fe0c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d415c920 con 0x7fe0c0004d40 2024-05-10T08:49:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d415cc00 con 0x7fe0c00039b0 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c000b9c0 con 0x7fe0d4072840 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0da679640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0004d40 0x7fe0c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d9677640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 0x7fe0c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0d9e78640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00039b0 0x7fe0c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0da679640 1 -- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 msgr2=0x7fe0c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0da679640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4072840 0x7fe0c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0da679640 1 -- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00039b0 msgr2=0x7fe0c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0da679640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c00039b0 0x7fe0c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.237+0000 7fe0da679640 1 -- 172.21.15.37:0/1171515646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c0003520 con 0x7fe0c0004d40 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.238+0000 7fe0da679640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0004d40 0x7fe0c00051c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a870 tx=0x7fe0c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8718b72a32e1c642 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.238+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00a4c0 con 0x7fe0c0004d40 2024-05-10T08:49:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.238+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc02f070 con 0x7fe0c0004d40 2024-05-10T08:49:20.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.238+0000 7fe0d8e76640 1 -- 172.21.15.37:0/1171515646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc02bcc0 con 0x7fe0c0004d40 2024-05-10T08:49:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.239+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/1171515646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0004d40 msgr2=0x7fe0c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.239+0000 7fe0dc0dc640 1 --2- 172.21.15.37:0/1171515646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0004d40 0x7fe0c00051c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a870 tx=0x7fe0c0005830 comp rx=0 tx=0).stop 2024-05-10T08:49:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.239+0000 7fe0da679640 1 -- 172.21.15.37:0/1171515646 reap_dead start 2024-05-10T08:49:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.239+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/1171515646 shutdown_connections 2024-05-10T08:49:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.239+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/1171515646 >> 172.21.15.37:0/1171515646 conn(0x7fe0d406c3a0 msgr2=0x7fe0d406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.239+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/1171515646 shutdown_connections 2024-05-10T08:49:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.239+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/1171515646 wait complete. 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.240+0000 7fe0dc0dc640 1 Processor -- start 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.240+0000 7fe0dc0dc640 1 -- start start 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0dc0dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c0004d40 0x7fe0d409df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0dc0dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4150d10 0x7fe0d40b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0dc0dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0d40b2c70 0x7fe0d40b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0dc0dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d40ae650 con 0x7fe0d40b2c70 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0dc0dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d406e980 con 0x7fe0c0004d40 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0dc0dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d40ae7d0 con 0x7fe0d4150d10 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0d40b2c70 0x7fe0d40b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0d40b2c70 0x7fe0d40b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33646/0 (socket says 172.21.15.37:33646) 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 -- 172.21.15.37:0/3664146301 learned_addr learned my addr 172.21.15.37:0/3664146301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0d9677640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4150d10 0x7fe0d40b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0d9e78640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c0004d40 0x7fe0d409df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 -- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4150d10 msgr2=0x7fe0d40b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4150d10 0x7fe0d40b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 -- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c0004d40 msgr2=0x7fe0d409df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c0004d40 0x7fe0d409df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.241+0000 7fe0da679640 1 -- 172.21.15.37:0/3664146301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d40b31a0 con 0x7fe0d40b2c70 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.242+0000 7fe0da679640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0d40b2c70 0x7fe0d40b06d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a870 tx=0x7fe0cc001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.242+0000 7fe0ca7fc640 1 -- 172.21.15.37:0/3664146301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00a4c0 con 0x7fe0d40b2c70 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.242+0000 7fe0ca7fc640 1 -- 172.21.15.37:0/3664146301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0019e0 con 0x7fe0d40b2c70 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.242+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d40b3480 con 0x7fe0d40b2c70 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.242+0000 7fe0ca7fc640 1 -- 172.21.15.37:0/3664146301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc002030 con 0x7fe0d40b2c70 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.242+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d40ce120 con 0x7fe0d40b2c70 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.243+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d40ce450 con 0x7fe0d40b2c70 2024-05-10T08:49:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.243+0000 7fe0ca7fc640 1 -- 172.21.15.37:0/3664146301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe0cc034a80 con 0x7fe0d40b2c70 2024-05-10T08:49:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.244+0000 7fe0ca7fc640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0b80762d0 0x7fe0b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.244+0000 7fe0ca7fc640 1 -- 172.21.15.37:0/3664146301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7fe0cc0b79b0 con 0x7fe0d40b2c70 2024-05-10T08:49:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.244+0000 7fe0d9e78640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0b80762d0 0x7fe0b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.245+0000 7fe0d9e78640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0b80762d0 0x7fe0b8078790 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000bda0 tx=0x7fe0d000b3a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:20.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.248+0000 7fe0ca7fc640 1 -- 172.21.15.37:0/3664146301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe0cc046060 con 0x7fe0d40b2c70 2024-05-10T08:49:20.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.478+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0d40693f0 con 0x7fe0d40b2c70 2024-05-10T08:49:20.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.479+0000 7fe0ca7fc640 1 -- 172.21.15.37:0/3664146301 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+3866 (secure 0 0 0) 0x7fe0cc081390 con 0x7fe0d40b2c70 2024-05-10T08:49:20.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:20.478 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1023202788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1023202788},{"type":"v1","addr":"172.21.15.82:6836","nonce":1023202788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/720351718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":720351718},{"type":"v1","addr":"172.21.15.82:6837","nonce":720351718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1882803771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1882803771},{"type":"v1","addr":"172.21.15.37:6835","nonce":1882803771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2261445736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2261445736},{"type":"v1","addr":"172.21.15.37:6834","nonce":2261445736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[]} 2024-05-10T08:49:20.478 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 91 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0b80762d0 msgr2=0x7fe0b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0b80762d0 0x7fe0b8078790 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000bda0 tx=0x7fe0d000b3a0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0d40b2c70 msgr2=0x7fe0d40b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0d40b2c70 0x7fe0d40b06d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a870 tx=0x7fe0cc001360 comp rx=0 tx=0).stop 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 shutdown_connections 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe0b80762d0 0x7fe0b8078790 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0d40b2c70 0x7fe0d40b06d0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0d4150d10 0x7fe0d40b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 --2- 172.21.15.37:0/3664146301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c0004d40 0x7fe0d409df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 >> 172.21.15.37:0/3664146301 conn(0x7fe0d406c3a0 msgr2=0x7fe0d415d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 shutdown_connections 2024-05-10T08:49:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.481+0000 7fe0dc0dc640 1 -- 172.21.15.37:0/3664146301 wait complete. 2024-05-10T08:49:20.491 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T08:49:20.492 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T08:49:20.492 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:49:20.492 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:49:20.492 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T08:49:20.492 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T08:49:20.492 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:49:20.492 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:49:20.492 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T08:49:20.493 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T08:49:20.493 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:49:20.493 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:49:20.493 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T08:49:20.493 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T08:49:20.493 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:49:20.493 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:49:20.502 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:49:20.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T08:49:20.503 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:49:20.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T08:49:20.505 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:49:20.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T08:49:20.505 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:49:20.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T08:49:20.545 INFO:tasks.ceph.mds.a:Started 2024-05-10T08:49:20.545 DEBUG:teuthology.parallel:result is None 2024-05-10T08:49:20.546 INFO:tasks.ceph.mds.c:Started 2024-05-10T08:49:20.546 DEBUG:teuthology.parallel:result is None 2024-05-10T08:49:20.548 INFO:tasks.ceph.mds.d:Started 2024-05-10T08:49:20.548 DEBUG:teuthology.parallel:result is None 2024-05-10T08:49:20.549 INFO:tasks.ceph.mds.b:Started 2024-05-10T08:49:20.549 DEBUG:teuthology.parallel:result is None 2024-05-10T08:49:20.549 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T08:49:20.624 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-10T08:49:20.624 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:49:20.632 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:49:20.632 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-05-10T08:49:20.632 INFO:tasks.ceph.mds.d.smithi082.stderr:2024-05-10T08:49:20.634+0000 7f0b47488640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T08:49:20.633 INFO:tasks.ceph.mds.d.smithi082.stderr:2024-05-10T08:49:20.635+0000 7f0b47488640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2024-05-10T08:49:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.661+0000 7f3f6dd0a640 1 Processor -- start 2024-05-10T08:49:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.661+0000 7f3f6dd0a640 1 -- start start 2024-05-10T08:49:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f6dd0a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f6815f420 0x7f3f680d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f6dd0a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f680d3ca0 0x7f3f680d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f6dd0a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f680d1eb0 0x7f3f680d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f6dd0a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3f681630b0 con 0x7f3f680d3ca0 2024-05-10T08:49:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f6dd0a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3f680d2550 con 0x7f3f6815f420 2024-05-10T08:49:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f6dd0a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3f680d2c80 con 0x7f3f680d1eb0 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f680d3ca0 0x7f3f680d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f680d3ca0 0x7f3f680d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33688/0 (socket says 172.21.15.37:33688) 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 -- 172.21.15.37:0/2133594605 learned_addr learned my addr 172.21.15.37:0/2133594605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f67fff640 1 --2- 172.21.15.37:0/2133594605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f680d1eb0 0x7f3f680d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 -- 172.21.15.37:0/2133594605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f680d1eb0 msgr2=0x7f3f680d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f677fe640 1 --2- 172.21.15.37:0/2133594605 >> v2:172.21.15.82:3300/0 conn(0x7f3f6815f420 0x7f3f680d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 --2- 172.21.15.37:0/2133594605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f680d1eb0 0x7f3f680d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 -- 172.21.15.37:0/2133594605 >> v2:172.21.15.82:3300/0 conn(0x7f3f6815f420 msgr2=0x7f3f680d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 --2- 172.21.15.37:0/2133594605 >> v2:172.21.15.82:3300/0 conn(0x7f3f6815f420 0x7f3f680d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f66ffd640 1 -- 172.21.15.37:0/2133594605 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f680d2f60 con 0x7f3f680d3ca0 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f67fff640 1 --2- 172.21.15.37:0/2133594605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f680d1eb0 0x7f3f680d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.662+0000 7f3f677fe640 1 --2- 172.21.15.37:0/2133594605 >> v2:172.21.15.82:3300/0 conn(0x7f3f6815f420 0x7f3f680d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.663+0000 7f3f66ffd640 1 --2- 172.21.15.37:0/2133594605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f680d3ca0 0x7f3f680d1970 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f3f680d5ec0 tx=0x7f3f5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b896a648742c84 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.663+0000 7f3f667fc640 1 -- 172.21.15.37:0/2133594605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c037070 con 0x7f3f680d3ca0 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.663+0000 7f3f667fc640 1 -- 172.21.15.37:0/2133594605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f5c032440 con 0x7f3f680d3ca0 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.663+0000 7f3f667fc640 1 -- 172.21.15.37:0/2133594605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c032810 con 0x7f3f680d3ca0 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.663+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/2133594605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f680d3ca0 msgr2=0x7f3f680d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.663+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/2133594605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f680d3ca0 0x7f3f680d1970 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f3f680d5ec0 tx=0x7f3f5c02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.664+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/2133594605 shutdown_connections 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.664+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/2133594605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f680d1eb0 0x7f3f680d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.664+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/2133594605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f680d3ca0 0x7f3f680d1970 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.664+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/2133594605 >> v2:172.21.15.82:3300/0 conn(0x7f3f6815f420 0x7f3f680d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.664+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/2133594605 >> 172.21.15.37:0/2133594605 conn(0x7f3f6808eac0 msgr2=0x7f3f6809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.664+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/2133594605 shutdown_connections 2024-05-10T08:49:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.664+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/2133594605 wait complete. 2024-05-10T08:49:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.665+0000 7f3f6dd0a640 1 Processor -- start 2024-05-10T08:49:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.665+0000 7f3f6dd0a640 1 -- start start 2024-05-10T08:49:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f6dd0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f680d1eb0 0x7f3f681f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f6dd0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f6815e7d0 0x7f3f681ea480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f6dd0a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f681ea9c0 0x7f3f680cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f6dd0a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f680d5200 con 0x7f3f6815e7d0 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f6dd0a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f680d2830 con 0x7f3f680d1eb0 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f6dd0a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3f680d5380 con 0x7f3f681ea9c0 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f6815e7d0 0x7f3f681ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f6815e7d0 0x7f3f681ea480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33698/0 (socket says 172.21.15.37:33698) 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 -- 172.21.15.37:0/3603034508 learned_addr learned my addr 172.21.15.37:0/3603034508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f67fff640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f681ea9c0 0x7f3f680cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f677fe640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f680d1eb0 0x7f3f681f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 -- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f681ea9c0 msgr2=0x7f3f680cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f681ea9c0 0x7f3f680cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 -- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f680d1eb0 msgr2=0x7f3f681f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f680d1eb0 0x7f3f681f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 -- 172.21.15.37:0/3603034508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f680c8ca0 con 0x7f3f6815e7d0 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f67fff640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f681ea9c0 0x7f3f680cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.666+0000 7f3f66ffd640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f6815e7d0 0x7f3f681ea480 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c000c00 tx=0x7f3f5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.667+0000 7f3f4ffff640 1 -- 172.21.15.37:0/3603034508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c037040 con 0x7f3f6815e7d0 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.667+0000 7f3f4ffff640 1 -- 172.21.15.37:0/3603034508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f5c042070 con 0x7f3f6815e7d0 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.667+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f681f6900 con 0x7f3f6815e7d0 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.667+0000 7f3f4ffff640 1 -- 172.21.15.37:0/3603034508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c030bb0 con 0x7f3f6815e7d0 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.667+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f680c9220 con 0x7f3f6815e7d0 2024-05-10T08:49:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.668+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f680693f0 con 0x7f3f6815e7d0 2024-05-10T08:49:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.668+0000 7f3f4ffff640 1 -- 172.21.15.37:0/3603034508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f5c047460 con 0x7f3f6815e7d0 2024-05-10T08:49:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.669+0000 7f3f4ffff640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f540762d0 0x7f3f54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.669+0000 7f3f4ffff640 1 -- 172.21.15.37:0/3603034508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5421+0+0 (secure 0 0 0) 0x7f3f5c0b80a0 con 0x7f3f6815e7d0 2024-05-10T08:49:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.669+0000 7f3f677fe640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f540762d0 0x7f3f54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.670+0000 7f3f677fe640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f540762d0 0x7f3f54078790 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800a950 tx=0x7f3f58008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.673+0000 7f3f4ffff640 1 -- 172.21.15.37:0/3603034508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3f5c081bb0 con 0x7f3f6815e7d0 2024-05-10T08:49:20.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:20.876+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3f681eada0 con 0x7f3f6815e7d0 2024-05-10T08:49:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.582+0000 7f3f4ffff640 1 -- 172.21.15.37:0/3603034508 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7f3f5c0814b0 con 0x7f3f6815e7d0 2024-05-10T08:49:21.581 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-10T08:49:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f540762d0 msgr2=0x7f3f54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f540762d0 0x7f3f54078790 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800a950 tx=0x7f3f58008040 comp rx=0 tx=0).stop 2024-05-10T08:49:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f6815e7d0 msgr2=0x7f3f681ea480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f6815e7d0 0x7f3f681ea480 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c000c00 tx=0x7f3f5c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 shutdown_connections 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3f540762d0 0x7f3f54078790 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3f681ea9c0 0x7f3f680cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f6815e7d0 0x7f3f681ea480 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 --2- 172.21.15.37:0/3603034508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f680d1eb0 0x7f3f681f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 >> 172.21.15.37:0/3603034508 conn(0x7f3f6808eac0 msgr2=0x7f3f680b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 shutdown_connections 2024-05-10T08:49:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.586+0000 7f3f6dd0a640 1 -- 172.21.15.37:0/3603034508 wait complete. 2024-05-10T08:49:21.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T08:49:21.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.711+0000 7fc362b87640 1 Processor -- start 2024-05-10T08:49:21.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.711+0000 7fc362b87640 1 -- start start 2024-05-10T08:49:21.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc362b87640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc35c15f0c0 0x7fc35c0b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc362b87640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc362b87640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc35c0b1260 con 0x7fc35c06c3a0 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc362b87640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc35c163450 con 0x7fc35c15f0c0 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc362b87640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc35c1604b0 con 0x7fc35c1638e0 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc360923640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc35c15f0c0 0x7fc35c0b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc361124640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc35c06c3a0 0x7fc35c073170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37762/0 (socket says 172.21.15.37:37762) 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.712+0000 7fc361124640 1 -- 172.21.15.37:0/1132929399 learned_addr learned my addr 172.21.15.37:0/1132929399 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.713+0000 7fc35bfff640 1 --2- 172.21.15.37:0/1132929399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.713+0000 7fc360923640 1 -- 172.21.15.37:0/1132929399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 msgr2=0x7fc35c0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.713+0000 7fc360923640 1 --2- 172.21.15.37:0/1132929399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c0b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.713+0000 7fc360923640 1 -- 172.21.15.37:0/1132929399 >> v1:172.21.15.37:6789/0 conn(0x7fc35c06c3a0 legacy=0x7fc35c073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.713+0000 7fc360923640 1 -- 172.21.15.37:0/1132929399 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c0b14e0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.713+0000 7fc360923640 1 --2- 172.21.15.37:0/1132929399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c0b6f40 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009d90 tx=0x7fc34c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4fefcd8cd23a0a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc35b7fe640 1 -- 172.21.15.37:0/1132929399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c007740 con 0x7fc35c15f0c0 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc35b7fe640 1 -- 172.21.15.37:0/1132929399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c0078e0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc35b7fe640 1 -- 172.21.15.37:0/1132929399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c007cb0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 -- 172.21.15.37:0/1132929399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 msgr2=0x7fc35c0b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 --2- 172.21.15.37:0/1132929399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c0b6f40 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009d90 tx=0x7fc34c02a660 comp rx=0 tx=0).stop 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 -- 172.21.15.37:0/1132929399 shutdown_connections 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 --2- 172.21.15.37:0/1132929399 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 --2- 172.21.15.37:0/1132929399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c0b6f40 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 -- 172.21.15.37:0/1132929399 >> 172.21.15.37:0/1132929399 conn(0x7fc35c0b3b10 msgr2=0x7fc35c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 -- 172.21.15.37:0/1132929399 shutdown_connections 2024-05-10T08:49:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.714+0000 7fc362b87640 1 -- 172.21.15.37:0/1132929399 wait complete. 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.715+0000 7fc362b87640 1 Processor -- start 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.716+0000 7fc362b87640 1 -- start start 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.716+0000 7fc362b87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35c06c3a0 0x7fc35c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.716+0000 7fc362b87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.716+0000 7fc362b87640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.716+0000 7fc362b87640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c0b17c0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.716+0000 7fc362b87640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c1630e0 con 0x7fc35c06c3a0 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.716+0000 7fc362b87640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc35c06c830 con 0x7fc35c1638e0 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33728/0 (socket says 172.21.15.37:33728) 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 -- 172.21.15.37:0/2671387652 learned_addr learned my addr 172.21.15.37:0/2671387652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc361124640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc360923640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35c06c3a0 0x7fc35c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 -- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 msgr2=0x7fc35c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 -- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35c06c3a0 msgr2=0x7fc35c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35c06c3a0 0x7fc35c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 -- 172.21.15.37:0/2671387652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c15b590 con 0x7fc35c15f0c0 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc361124640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc360923640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35c06c3a0 0x7fc35c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc35bfff640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c158190 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc34400d5f0 tx=0x7fc34400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc3597fa640 1 -- 172.21.15.37:0/2671387652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440125f0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc3597fa640 1 -- 172.21.15.37:0/2671387652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc344019070 con 0x7fc35c15f0c0 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c15b870 con 0x7fc35c15f0c0 2024-05-10T08:49:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc3597fa640 1 -- 172.21.15.37:0/2671387652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440129d0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.717+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c15be30 con 0x7fc35c15f0c0 2024-05-10T08:49:21.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.718+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c06a8f0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.719+0000 7fc3597fa640 1 -- 172.21.15.37:0/2671387652 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc344012b70 con 0x7fc35c15f0c0 2024-05-10T08:49:21.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.719+0000 7fc3597fa640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc33c0762d0 0x7fc33c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:21.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.720+0000 7fc3597fa640 1 -- 172.21.15.37:0/2671387652 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5249+0+0 (secure 0 0 0) 0x7fc3440977e0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.720+0000 7fc360923640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc33c0762d0 0x7fc33c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:21.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.720+0000 7fc360923640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc33c0762d0 0x7fc33c078790 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc34c034000 tx=0x7fc34c02f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.724+0000 7fc3597fa640 1 -- 172.21.15.37:0/2671387652 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc344061390 con 0x7fc35c15f0c0 2024-05-10T08:49:21.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.990+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc35c0693f0 con 0x7fc35c15f0c0 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.990+0000 7fc3597fa640 1 -- 172.21.15.37:0/2671387652 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7fc344060c90 con 0x7fc35c15f0c0 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mThQ4DBAA/QAf0YlTu9V6diS9gX2SEg==", 2024-05-10T08:49:21.989 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mvB4MGBAAiMqIkydxhcyS/Z35hiMXPQ==", 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:49:21.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mihlnExAA2jRhT6wYCVTCUWTt3jQpYA==", 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.991 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mExMTHxAAHmoE3E1YYq5Vl29xpm6cWw==", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBB3T1mJwscAhAAmlvuIm5GZQD6AfYm5JqyEw==", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.992 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBE3T1m+WseARAATYD1ewpL+xOqPnL28HOgfw==", 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.993 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBG3T1mJwJkOxAArZLRb4TWAdzBL7OG/BHyLg==", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBJ3T1mpE4mOhAA+i59OXDSgF4489f9mIFwVQ==", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.994 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBQ3T1mmKvZBxAAZwxXmhLBcxxnVZMGsIsp/g==", 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBT3T1mEeBKBhAAlgQ6LzuCyMqLhxAVYkfYTA==", 2024-05-10T08:49:21.995 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBW3T1mTBBLBBAAiEhzS3a7E5Mt7DUDaxNi1w==", 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBZ3T1mtvmYAxAAXyZrKxctxAFVsoSEinYpxg==", 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A==", 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1moiAWLBAAQmpS+vkSh8hhRgcp1QGdeg==", 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.998 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmZ3oKBAAYcqM95u4+JxcjvXUjh/Niw==", 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mjiCrMRAAgmKd6tcroxVlTHeEpZ0cDA==", 2024-05-10T08:49:21.999 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA83T1mpCEPLBAAZlDinj6hQh8Ccd9D/MMUDw==", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:22.000 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mmlfiCBAAx0zK88W+xoLHbuVopSolNA==", 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA93T1mtV5dBRAAqAcv0KMBR19MgHImfDGo2A==", 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-10T08:49:22.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-10T08:49:22.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-10T08:49:22.002 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-10T08:49:22.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:22.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:22.002 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-10T08:49:22.002 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc33c0762d0 msgr2=0x7fc33c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc33c0762d0 0x7fc33c078790 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc34c034000 tx=0x7fc34c02f000 comp rx=0 tx=0).stop 2024-05-10T08:49:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 msgr2=0x7fc35c158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c158190 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc34400d5f0 tx=0x7fc34400dab0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 shutdown_connections 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc33c0762d0 0x7fc33c078790 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc35c1638e0 0x7fc35c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c15f0c0 0x7fc35c158190 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 --2- 172.21.15.37:0/2671387652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35c06c3a0 0x7fc35c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 >> 172.21.15.37:0/2671387652 conn(0x7fc35c0b3b10 msgr2=0x7fc35c0d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 shutdown_connections 2024-05-10T08:49:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:21.992+0000 7fc362b87640 1 -- 172.21.15.37:0/2671387652 wait complete. 2024-05-10T08:49:22.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T08:49:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.109+0000 7fc05bf24640 1 Processor -- start 2024-05-10T08:49:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.109+0000 7fc05bf24640 1 -- start start 2024-05-10T08:49:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc05bf24640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc05415f380 0x7fc0540d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc05bf24640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0540d0cf0 0x7fc0540d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc05bf24640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540d1760 con 0x7fc0540d3b00 2024-05-10T08:49:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc05bf24640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc0540d30f0 con 0x7fc05415f380 2024-05-10T08:49:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc05bf24640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc0540d3f50 con 0x7fc0540d0cf0 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc059cc0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc05415f380 0x7fc0540d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc05a4c1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc0540d3b00 0x7fc054162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37778/0 (socket says 172.21.15.37:37778) 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc05a4c1640 1 -- 172.21.15.37:0/2949252463 learned_addr learned my addr 172.21.15.37:0/2949252463 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.110+0000 7fc0594bf640 1 --2- 172.21.15.37:0/2949252463 >> v2:172.21.15.82:3300/0 conn(0x7fc0540d0cf0 0x7fc0540d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc059cc0640 1 -- 172.21.15.37:0/2949252463 >> v2:172.21.15.82:3300/0 conn(0x7fc0540d0cf0 msgr2=0x7fc0540d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc059cc0640 1 --2- 172.21.15.37:0/2949252463 >> v2:172.21.15.82:3300/0 conn(0x7fc0540d0cf0 0x7fc0540d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc059cc0640 1 -- 172.21.15.37:0/2949252463 >> v1:172.21.15.37:6789/0 conn(0x7fc0540d3b00 legacy=0x7fc054162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc059cc0640 1 -- 172.21.15.37:0/2949252463 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0540d1a40 con 0x7fc05415f380 2024-05-10T08:49:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc058cbe640 1 -- 172.21.15.37:0/2949252463 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213931260 0 0) 0x7fc0540d1760 con 0x7fc0540d3b00 2024-05-10T08:49:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc059cc0640 1 --2- 172.21.15.37:0/2949252463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540d07b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fc0540b7b00 tx=0x7fc05002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adedfe7f1012056 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc058cbe640 1 -- 172.21.15.37:0/2949252463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050037070 con 0x7fc05415f380 2024-05-10T08:49:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc058cbe640 1 -- 172.21.15.37:0/2949252463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc050032440 con 0x7fc05415f380 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.111+0000 7fc058cbe640 1 -- 172.21.15.37:0/2949252463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050032810 con 0x7fc05415f380 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 -- 172.21.15.37:0/2949252463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 msgr2=0x7fc0540d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 --2- 172.21.15.37:0/2949252463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540d07b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fc0540b7b00 tx=0x7fc05002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 -- 172.21.15.37:0/2949252463 shutdown_connections 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 --2- 172.21.15.37:0/2949252463 >> v2:172.21.15.82:3300/0 conn(0x7fc0540d0cf0 0x7fc0540d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 --2- 172.21.15.37:0/2949252463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540d07b0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 -- 172.21.15.37:0/2949252463 >> 172.21.15.37:0/2949252463 conn(0x7fc0540d4fe0 msgr2=0x7fc0540d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 -- 172.21.15.37:0/2949252463 shutdown_connections 2024-05-10T08:49:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.112+0000 7fc05bf24640 1 -- 172.21.15.37:0/2949252463 wait complete. 2024-05-10T08:49:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.113+0000 7fc05bf24640 1 Processor -- start 2024-05-10T08:49:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.113+0000 7fc05bf24640 1 -- start start 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05bf24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0540d0cf0 0x7fc0540a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05bf24640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0540d3b00 0x7fc05415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05bf24640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05bf24640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0540b8e40 con 0x7fc05415f380 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05bf24640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0540d2370 con 0x7fc0540d0cf0 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05bf24640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc0540d2000 con 0x7fc0540d3b00 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05a4c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05a4c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540a2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33750/0 (socket says 172.21.15.37:33750) 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc05a4c1640 1 -- 172.21.15.37:0/1110654975 learned_addr learned my addr 172.21.15.37:0/1110654975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc0594bf640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0540d3b00 0x7fc05415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.114+0000 7fc059cc0640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0540d0cf0 0x7fc0540a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05a4c1640 1 -- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0540d3b00 msgr2=0x7fc05415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05a4c1640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0540d3b00 0x7fc05415de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05a4c1640 1 -- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0540d0cf0 msgr2=0x7fc0540a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05a4c1640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0540d0cf0 0x7fc0540a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05a4c1640 1 -- 172.21.15.37:0/1110654975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0540a0900 con 0x7fc05415f380 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05a4c1640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540a2510 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c810 tx=0x7fc04c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc04a7fc640 1 -- 172.21.15.37:0/1110654975 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c018070 con 0x7fc05415f380 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc04a7fc640 1 -- 172.21.15.37:0/1110654975 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c00a640 con 0x7fc05415f380 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc04a7fc640 1 -- 172.21.15.37:0/1110654975 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00aa30 con 0x7fc05415f380 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0540a0be0 con 0x7fc05415f380 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.115+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0540a11a0 con 0x7fc05415f380 2024-05-10T08:49:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.116+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0540a15d0 con 0x7fc05415f380 2024-05-10T08:49:22.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.116+0000 7fc04a7fc640 1 -- 172.21.15.37:0/1110654975 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc04c01b070 con 0x7fc05415f380 2024-05-10T08:49:22.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.117+0000 7fc04a7fc640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0380762d0 0x7fc038078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.117+0000 7fc04a7fc640 1 -- 172.21.15.37:0/1110654975 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5249+0+0 (secure 0 0 0) 0x7fc04c096b90 con 0x7fc05415f380 2024-05-10T08:49:22.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.117+0000 7fc059cc0640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0380762d0 0x7fc038078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.118+0000 7fc059cc0640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0380762d0 0x7fc038078790 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc050034000 tx=0x7fc05002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:22.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.121+0000 7fc04a7fc640 1 -- 172.21.15.37:0/1110654975 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc04c060580 con 0x7fc05415f380 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.312+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc05408cfd0 con 0x7fc05415f380 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.312+0000 7fc04a7fc640 1 -- 172.21.15.37:0/1110654975 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) ==== 84+0+65 (secure 0 0 0) 0x7fc04c05fe80 con 0x7fc05415f380 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-10T08:49:22.311 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-10T08:49:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-10T08:49:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0380762d0 msgr2=0x7fc038078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0380762d0 0x7fc038078790 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc050034000 tx=0x7fc05002e000 comp rx=0 tx=0).stop 2024-05-10T08:49:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 msgr2=0x7fc0540a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540a2510 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c810 tx=0x7fc04c00ccd0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 shutdown_connections 2024-05-10T08:49:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc0380762d0 0x7fc038078790 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc05415f380 0x7fc0540a2510 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc0540d3b00 0x7fc05415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 --2- 172.21.15.37:0/1110654975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0540d0cf0 0x7fc0540a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 >> 172.21.15.37:0/1110654975 conn(0x7fc0540d4fe0 msgr2=0x7fc0540b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 shutdown_connections 2024-05-10T08:49:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.314+0000 7fc05bf24640 1 -- 172.21.15.37:0/1110654975 wait complete. 2024-05-10T08:49:22.324 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T08:49:22.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T08:49:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.433+0000 7efdbf0bd640 1 Processor -- start 2024-05-10T08:49:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.433+0000 7efdbf0bd640 1 -- start start 2024-05-10T08:49:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdbf0bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdb815d2a0 0x7efdb80cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdbf0bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efdb80c9600 0x7efdb80cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdbf0bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80cec40 con 0x7efdb815d680 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdbf0bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efdb80cef20 con 0x7efdb815d2a0 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdbf0bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efdb80c6b10 con 0x7efdb80c9600 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdbce59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdb815d2a0 0x7efdb80cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdb7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efdb815d680 0x7efdb80d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37794/0 (socket says 172.21.15.37:37794) 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.434+0000 7efdb7fff640 1 -- 172.21.15.37:0/2232650566 learned_addr learned my addr 172.21.15.37:0/2232650566 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.435+0000 7efdbd65a640 1 --2- 172.21.15.37:0/2232650566 >> v2:172.21.15.82:3300/0 conn(0x7efdb80c9600 0x7efdb80cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.435+0000 7efdbce59640 1 -- 172.21.15.37:0/2232650566 >> v2:172.21.15.82:3300/0 conn(0x7efdb80c9600 msgr2=0x7efdb80cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.435+0000 7efdbce59640 1 --2- 172.21.15.37:0/2232650566 >> v2:172.21.15.82:3300/0 conn(0x7efdb80c9600 0x7efdb80cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.435+0000 7efdbce59640 1 -- 172.21.15.37:0/2232650566 >> v1:172.21.15.37:6789/0 conn(0x7efdb815d680 legacy=0x7efdb80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.435+0000 7efdbce59640 1 -- 172.21.15.37:0/2232650566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80c6df0 con 0x7efdb815d2a0 2024-05-10T08:49:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.435+0000 7efdb77fe640 1 -- 172.21.15.37:0/2232650566 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959884449 0 0) 0x7efdb80cec40 con 0x7efdb815d680 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.435+0000 7efdbce59640 1 --2- 172.21.15.37:0/2232650566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80cf670 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7efdb80cf2d0 tx=0x7efdb002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90596f137ddaf3a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdb77fe640 1 -- 172.21.15.37:0/2232650566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0037070 con 0x7efdb815d2a0 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdb77fe640 1 -- 172.21.15.37:0/2232650566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0032440 con 0x7efdb815d2a0 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdb77fe640 1 -- 172.21.15.37:0/2232650566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0032810 con 0x7efdb815d2a0 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 -- 172.21.15.37:0/2232650566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 msgr2=0x7efdb80cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/2232650566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80cf670 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7efdb80cf2d0 tx=0x7efdb002a230 comp rx=0 tx=0).stop 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 -- 172.21.15.37:0/2232650566 shutdown_connections 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/2232650566 >> v2:172.21.15.82:3300/0 conn(0x7efdb80c9600 0x7efdb80cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/2232650566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80cf670 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 -- 172.21.15.37:0/2232650566 >> 172.21.15.37:0/2232650566 conn(0x7efdb80d2f20 msgr2=0x7efdb80d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 -- 172.21.15.37:0/2232650566 shutdown_connections 2024-05-10T08:49:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.436+0000 7efdbf0bd640 1 -- 172.21.15.37:0/2232650566 wait complete. 2024-05-10T08:49:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.437+0000 7efdbf0bd640 1 Processor -- start 2024-05-10T08:49:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.437+0000 7efdbf0bd640 1 -- start start 2024-05-10T08:49:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.438+0000 7efdbf0bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb80c9600 0x7efdb80b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.438+0000 7efdbf0bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.438+0000 7efdbf0bd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb815d680 0x7efdb80a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.438+0000 7efdbf0bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efdb80ce870 con 0x7efdb815d2a0 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.438+0000 7efdbf0bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efdb80ce6f0 con 0x7efdb80c9600 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.438+0000 7efdbf0bd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efdb80ce9f0 con 0x7efdb815d680 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.438+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33778/0 (socket says 172.21.15.37:33778) 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 -- 172.21.15.37:0/4256561802 learned_addr learned my addr 172.21.15.37:0/4256561802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdbce59640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb80c9600 0x7efdb80b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdbd65a640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb815d680 0x7efdb80a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 -- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb815d680 msgr2=0x7efdb80a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb815d680 0x7efdb80a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 -- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb80c9600 msgr2=0x7efdb80b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb80c9600 0x7efdb80b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 -- 172.21.15.37:0/4256561802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80b7020 con 0x7efdb815d2a0 2024-05-10T08:49:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb7fff640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80aff40 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7efda800c7b0 tx=0x7efda800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb57fa640 1 -- 172.21.15.37:0/4256561802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8018070 con 0x7efdb815d2a0 2024-05-10T08:49:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb57fa640 1 -- 172.21.15.37:0/4256561802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda800a640 con 0x7efdb815d2a0 2024-05-10T08:49:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdb57fa640 1 -- 172.21.15.37:0/4256561802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda800aa30 con 0x7efdb815d2a0 2024-05-10T08:49:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb80b7300 con 0x7efdb815d2a0 2024-05-10T08:49:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.439+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb80b78c0 con 0x7efdb815d2a0 2024-05-10T08:49:22.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.440+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb80b7ac0 con 0x7efdb815d2a0 2024-05-10T08:49:22.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.441+0000 7efdb57fa640 1 -- 172.21.15.37:0/4256561802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efda801b070 con 0x7efdb815d2a0 2024-05-10T08:49:22.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.441+0000 7efdb57fa640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd980762d0 0x7efd98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:22.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.442+0000 7efdb57fa640 1 -- 172.21.15.37:0/4256561802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5249+0+0 (secure 0 0 0) 0x7efda8096950 con 0x7efdb815d2a0 2024-05-10T08:49:22.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.442+0000 7efdbce59640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd980762d0 0x7efd98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:22.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.442+0000 7efdbce59640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd980762d0 0x7efd98078790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efdb0034000 tx=0x7efdb002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:22.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.446+0000 7efdb57fa640 1 -- 172.21.15.37:0/4256561802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efdb80b7ac0 con 0x7efdb815d2a0 2024-05-10T08:49:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:22.641+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efdb8069b00 con 0x7efdb815d2a0 2024-05-10T08:49:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.585+0000 7efdb57fa640 1 -- 172.21.15.37:0/4256561802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) ==== 138+0+0 (secure 0 0 0) 0x7efda805feb0 con 0x7efdb815d2a0 2024-05-10T08:49:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-10T08:49:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd980762d0 msgr2=0x7efd98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd980762d0 0x7efd98078790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efdb0034000 tx=0x7efdb002e000 comp rx=0 tx=0).stop 2024-05-10T08:49:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 msgr2=0x7efdb80aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80aff40 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7efda800c7b0 tx=0x7efda800cc70 comp rx=0 tx=0).stop 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 shutdown_connections 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efd980762d0 0x7efd98078790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efdb815d680 0x7efdb80a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb815d2a0 0x7efdb80aff40 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 --2- 172.21.15.37:0/4256561802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb80c9600 0x7efdb80b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.588+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 >> 172.21.15.37:0/4256561802 conn(0x7efdb80d2f20 msgr2=0x7efdb80c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.589+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 shutdown_connections 2024-05-10T08:49:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.589+0000 7efdbf0bd640 1 -- 172.21.15.37:0/4256561802 wait complete. 2024-05-10T08:49:23.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T08:49:23.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.724+0000 7f256a693640 1 Processor -- start 2024-05-10T08:49:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.724+0000 7f256a693640 1 -- start start 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.724+0000 7f256a693640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 0x7f25640cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.724+0000 7f256a693640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25640d0320 con 0x7f25640d56b0 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.724+0000 7f256a693640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25640d0600 con 0x7f25640d3aa0 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f256a693640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f25640d08e0 con 0x7f256415f4e0 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2568c30640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f25640d56b0 0x7f25640d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37796/0 (socket says 172.21.15.37:37796) 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2568c30640 1 -- 172.21.15.37:0/4236417561 learned_addr learned my addr 172.21.15.37:0/4236417561 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2563fff640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 0x7f25640cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978794070 0 0) 0x7f25640d0320 con 0x7f25640d56b0 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f254c003520 con 0x7f25640d56b0 2024-05-10T08:49:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 477111777 0 0) 0x7f254c003520 con 0x7f25640d56b0 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 msgr2=0x7f25640cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 0x7f25640cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 >> v1:172.21.15.82:6789/0 conn(0x7f25640d3aa0 legacy=0x7f25640d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25640d0bc0 con 0x7f25640d56b0 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f255c0019f0 con 0x7f25640d56b0 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 >> v1:172.21.15.37:6789/0 conn(0x7f25640d56b0 legacy=0x7f25640d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 0x7f254c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f254c003f60 0x7f254c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f254c004d40 0x7f254c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25640d08e0 con 0x7f254c004d40 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f254c00baa0 con 0x7f254c003f60 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f254c00bca0 con 0x7f256415f4e0 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2568c30640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f254c004d40 0x7f254c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.725+0000 7f2563fff640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 0x7f254c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.726+0000 7f25637fe640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f254c003f60 0x7f254c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.726+0000 7f2568c30640 1 -- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 msgr2=0x7f254c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.726+0000 7f2568c30640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f256415f4e0 0x7f254c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.726+0000 7f2568c30640 1 -- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f254c003f60 msgr2=0x7f254c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.726+0000 7f2568c30640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f254c003f60 0x7f254c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.726+0000 7f2568c30640 1 -- 172.21.15.37:0/4236417561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c003520 con 0x7f254c004d40 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.726+0000 7f2568c30640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f254c004d40 0x7f254c0051c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f255c00a850 tx=0x7f254c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b60b267c543f6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c00a4a0 con 0x7f254c004d40 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c02f070 con 0x7f254c004d40 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f2562ffd640 1 -- 172.21.15.37:0/4236417561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c02bd20 con 0x7f254c004d40 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f256a693640 1 -- 172.21.15.37:0/4236417561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f254c004d40 msgr2=0x7f254c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f256a693640 1 --2- 172.21.15.37:0/4236417561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f254c004d40 0x7f254c0051c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f255c00a850 tx=0x7f254c005830 comp rx=0 tx=0).stop 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f2568c30640 1 -- 172.21.15.37:0/4236417561 reap_dead start 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f256a693640 1 -- 172.21.15.37:0/4236417561 shutdown_connections 2024-05-10T08:49:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f256a693640 1 -- 172.21.15.37:0/4236417561 >> 172.21.15.37:0/4236417561 conn(0x7f256408eac0 msgr2=0x7f256409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:23.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f256a693640 1 -- 172.21.15.37:0/4236417561 shutdown_connections 2024-05-10T08:49:23.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.727+0000 7f256a693640 1 -- 172.21.15.37:0/4236417561 wait complete. 2024-05-10T08:49:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.728+0000 7f256a693640 1 Processor -- start 2024-05-10T08:49:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.729+0000 7f256a693640 1 -- start start 2024-05-10T08:49:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.729+0000 7f256a693640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f254c004d40 0x7f2564155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.729+0000 7f256a693640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25641f90a0 0x7f25640ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.729+0000 7f256a693640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25641580c0 0x7f25641f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f256a693640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25640d3f00 con 0x7f25641580c0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f256a693640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f256415f8c0 con 0x7f25641f90a0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f256a693640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f25640d4080 con 0x7f254c004d40 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25641580c0 0x7f25641f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25641580c0 0x7f25641f8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33806/0 (socket says 172.21.15.37:33806) 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 -- 172.21.15.37:0/91089126 learned_addr learned my addr 172.21.15.37:0/91089126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f25637fe640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25641f90a0 0x7f25640ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2563fff640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f254c004d40 0x7f2564155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 -- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f254c004d40 msgr2=0x7f2564155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f254c004d40 0x7f2564155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 -- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25641f90a0 msgr2=0x7f25640ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25641f90a0 0x7f25640ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 -- 172.21.15.37:0/91089126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2564157020 con 0x7f25641580c0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2568c30640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25641580c0 0x7f25641f8470 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f255c00a970 tx=0x7f255c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2560ff9640 1 -- 172.21.15.37:0/91089126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c00a480 con 0x7f25641580c0 2024-05-10T08:49:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2560ff9640 1 -- 172.21.15.37:0/91089126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c004b60 con 0x7f25641580c0 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2564157300 con 0x7f25641580c0 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.730+0000 7f2560ff9640 1 -- 172.21.15.37:0/91089126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c034470 con 0x7f25641580c0 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.731+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25641578c0 con 0x7f25641580c0 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.731+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25640693f0 con 0x7f25641580c0 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.732+0000 7f2560ff9640 1 -- 172.21.15.37:0/91089126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f255c046060 con 0x7f25641580c0 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.733+0000 7f2560ff9640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25500762d0 0x7f2550078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.733+0000 7f2560ff9640 1 -- 172.21.15.37:0/91089126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5619+0+0 (secure 0 0 0) 0x7f255c0b73d0 con 0x7f25641580c0 2024-05-10T08:49:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.733+0000 7f2563fff640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25500762d0 0x7f2550078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:23.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.734+0000 7f2563fff640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25500762d0 0x7f2550078790 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2554009bc0 tx=0x7f2554009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.737+0000 7f2560ff9640 1 -- 172.21.15.37:0/91089126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f255c080d10 con 0x7f25641580c0 2024-05-10T08:49:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:23.929+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f256406e7f0 con 0x7f25641580c0 2024-05-10T08:49:24.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.588+0000 7f2560ff9640 1 -- 172.21.15.37:0/91089126 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) ==== 170+0+0 (secure 0 0 0) 0x7f255c080610 con 0x7f25641580c0 2024-05-10T08:49:24.587 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.590+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25500762d0 msgr2=0x7f2550078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.590+0000 7f256a693640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25500762d0 0x7f2550078790 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2554009bc0 tx=0x7f2554009190 comp rx=0 tx=0).stop 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.590+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25641580c0 msgr2=0x7f25641f8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.590+0000 7f256a693640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25641580c0 0x7f25641f8470 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f255c00a970 tx=0x7f255c001dc0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 shutdown_connections 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25500762d0 0x7f2550078790 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25641580c0 0x7f25641f8470 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25641f90a0 0x7f25640ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 --2- 172.21.15.37:0/91089126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f254c004d40 0x7f2564155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 >> 172.21.15.37:0/91089126 conn(0x7f256408eac0 msgr2=0x7f25640d2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:24.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 shutdown_connections 2024-05-10T08:49:24.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.591+0000 7f256a693640 1 -- 172.21.15.37:0/91089126 wait complete. 2024-05-10T08:49:24.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:49:24.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:49:24.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T08:49:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.775+0000 7f08a8083640 1 Processor -- start 2024-05-10T08:49:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.775+0000 7f08a8083640 1 -- start start 2024-05-10T08:49:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a8083640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08a006d620 0x7f08a0073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a8083640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08a006da00 0x7f08a00af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a8083640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a00af800 con 0x7f08a00b5ee0 2024-05-10T08:49:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a8083640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f08a00afaa0 con 0x7f08a006da00 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a8083640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f08a00b5a50 con 0x7f08a006d620 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a561e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08a006da00 0x7f08a00af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a6620640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08a00b5ee0 0x7f08a006e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37804/0 (socket says 172.21.15.37:37804) 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a6620640 1 -- 172.21.15.37:0/3954865628 learned_addr learned my addr 172.21.15.37:0/3954865628 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a5e1f640 1 --2- 172.21.15.37:0/3954865628 >> v2:172.21.15.82:3300/0 conn(0x7f08a006d620 0x7f08a0073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a561e640 1 -- 172.21.15.37:0/3954865628 >> v2:172.21.15.82:3300/0 conn(0x7f08a006d620 msgr2=0x7f08a0073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a561e640 1 --2- 172.21.15.37:0/3954865628 >> v2:172.21.15.82:3300/0 conn(0x7f08a006d620 0x7f08a0073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a561e640 1 -- 172.21.15.37:0/3954865628 >> v1:172.21.15.37:6789/0 conn(0x7f08a00b5ee0 legacy=0x7f08a006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a561e640 1 -- 172.21.15.37:0/3954865628 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00b5120 con 0x7f08a006da00 2024-05-10T08:49:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.776+0000 7f08a4e1d640 1 -- 172.21.15.37:0/3954865628 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969052022 0 0) 0x7f08a00af800 con 0x7f08a00b5ee0 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.777+0000 7f08a561e640 1 --2- 172.21.15.37:0/3954865628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a006da00 0x7f08a00af2c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f08a0069030 tx=0x7f089002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedaf50316af2302 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.777+0000 7f08a4e1d640 1 -- 172.21.15.37:0/3954865628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890037070 con 0x7f08a006da00 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.777+0000 7f08a4e1d640 1 -- 172.21.15.37:0/3954865628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089002add0 con 0x7f08a006da00 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.777+0000 7f08a4e1d640 1 -- 172.21.15.37:0/3954865628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890032660 con 0x7f08a006da00 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 -- 172.21.15.37:0/3954865628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a006da00 msgr2=0x7f08a00af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 --2- 172.21.15.37:0/3954865628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a006da00 0x7f08a00af2c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f08a0069030 tx=0x7f089002a080 comp rx=0 tx=0).stop 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 -- 172.21.15.37:0/3954865628 shutdown_connections 2024-05-10T08:49:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 --2- 172.21.15.37:0/3954865628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a006da00 0x7f08a00af2c0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 --2- 172.21.15.37:0/3954865628 >> v2:172.21.15.82:3300/0 conn(0x7f08a006d620 0x7f08a0073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 -- 172.21.15.37:0/3954865628 >> 172.21.15.37:0/3954865628 conn(0x7f08a00728c0 msgr2=0x7f08a0072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 -- 172.21.15.37:0/3954865628 shutdown_connections 2024-05-10T08:49:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.778+0000 7f08a8083640 1 -- 172.21.15.37:0/3954865628 wait complete. 2024-05-10T08:49:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.779+0000 7f08a8083640 1 Processor -- start 2024-05-10T08:49:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.779+0000 7f08a8083640 1 -- start start 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a8083640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08a006d620 0x7f08a01f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a8083640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08a006da00 0x7f08a00ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a8083640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a00b5ee0 0x7f08a014b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a8083640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08a006f030 con 0x7f08a00b5ee0 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a8083640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08a00b56e0 con 0x7f08a006da00 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a8083640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f08a006f1b0 con 0x7f08a006d620 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a6620640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a00b5ee0 0x7f08a014b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a6620640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a00b5ee0 0x7f08a014b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33826/0 (socket says 172.21.15.37:33826) 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a6620640 1 -- 172.21.15.37:0/3327247797 learned_addr learned my addr 172.21.15.37:0/3327247797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a561e640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08a006da00 0x7f08a00ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:24.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.780+0000 7f08a5e1f640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08a006d620 0x7f08a01f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a6620640 1 -- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08a006d620 msgr2=0x7f08a01f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a6620640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08a006d620 0x7f08a01f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a6620640 1 -- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08a006da00 msgr2=0x7f08a00ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a6620640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08a006da00 0x7f08a00ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a6620640 1 -- 172.21.15.37:0/3327247797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00cf000 con 0x7f08a00b5ee0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a561e640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08a006da00 0x7f08a00ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a6620640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a00b5ee0 0x7f08a014b0c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f089800c7e0 tx=0x7f089800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08967fc640 1 -- 172.21.15.37:0/3327247797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898018070 con 0x7f08a00b5ee0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08967fc640 1 -- 172.21.15.37:0/3327247797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089800a640 con 0x7f08a00b5ee0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a00cf2a0 con 0x7f08a00b5ee0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08967fc640 1 -- 172.21.15.37:0/3327247797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089800aa30 con 0x7f08a00b5ee0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.781+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a00cf860 con 0x7f08a00b5ee0 2024-05-10T08:49:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.782+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a00693f0 con 0x7f08a00b5ee0 2024-05-10T08:49:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.783+0000 7f08967fc640 1 -- 172.21.15.37:0/3327247797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f089801b070 con 0x7f08a00b5ee0 2024-05-10T08:49:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.783+0000 7f08967fc640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0884076300 0x7f08840787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.783+0000 7f08967fc640 1 -- 172.21.15.37:0/3327247797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6001+0+0 (secure 0 0 0) 0x7f0898096cf0 con 0x7f08a00b5ee0 2024-05-10T08:49:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.783+0000 7f08a5e1f640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0884076300 0x7f08840787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:24.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.784+0000 7f08a5e1f640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0884076300 0x7f08840787c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f089c009a30 tx=0x7f089c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:24.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:24.788+0000 7f08967fc640 1 -- 172.21.15.37:0/3327247797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f089809b070 con 0x7f08a00b5ee0 2024-05-10T08:49:25.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.023+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f08a00b2510 con 0x7f08a00b5ee0 2024-05-10T08:49:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.609+0000 7f08967fc640 1 -- 172.21.15.37:0/3327247797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v94) ==== 174+0+0 (secure 0 0 0) 0x7f0898060520 con 0x7f08a00b5ee0 2024-05-10T08:49:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 17 and data pool 18 2024-05-10T08:49:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.616+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0884076300 msgr2=0x7f08840787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.616+0000 7f08a8083640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0884076300 0x7f08840787c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f089c009a30 tx=0x7f089c008040 comp rx=0 tx=0).stop 2024-05-10T08:49:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.616+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a00b5ee0 msgr2=0x7f08a014b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.616+0000 7f08a8083640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a00b5ee0 0x7f08a014b0c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f089800c7e0 tx=0x7f089800cca0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 shutdown_connections 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0884076300 0x7f08840787c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08a00b5ee0 0x7f08a014b0c0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08a006da00 0x7f08a00ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 --2- 172.21.15.37:0/3327247797 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f08a006d620 0x7f08a01f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 >> 172.21.15.37:0/3327247797 conn(0x7f08a00728c0 msgr2=0x7f08a00b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 shutdown_connections 2024-05-10T08:49:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.617+0000 7f08a8083640 1 -- 172.21.15.37:0/3327247797 wait complete. 2024-05-10T08:49:25.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:49:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.751+0000 7fdd7eae8640 1 Processor -- start 2024-05-10T08:49:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.751+0000 7fdd7eae8640 1 -- start start 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7eae8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd781629b0 0x7fdd7806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7eae8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 0x7fdd78070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7eae8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd7806e110 con 0x7fdd78070d20 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7eae8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7806dec0 con 0x7fdd781629b0 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7eae8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7806e3f0 con 0x7fdd780b2490 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7d085640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdd78070d20 0x7fdd780afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37814/0 (socket says 172.21.15.37:37814) 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7d085640 1 -- 172.21.15.37:0/2728386751 learned_addr learned my addr 172.21.15.37:0/2728386751 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd7c884640 1 --2- 172.21.15.37:0/2728386751 >> v2:172.21.15.82:3300/0 conn(0x7fdd781629b0 0x7fdd7806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 0x7fdd78070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26571326 0 0) 0x7fdd7806e110 con 0x7fdd78070d20 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.752+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd60003520 con 0x7fdd78070d20 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2167664046 0 0) 0x7fdd60003520 con 0x7fdd78070d20 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 msgr2=0x7fdd78070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 0x7fdd78070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 >> v2:172.21.15.82:3300/0 conn(0x7fdd781629b0 msgr2=0x7fdd7806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 --2- 172.21.15.37:0/2728386751 >> v2:172.21.15.82:3300/0 conn(0x7fdd781629b0 0x7fdd7806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7806e6d0 con 0x7fdd78070d20 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fdd700019f0 con 0x7fdd78070d20 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 >> v1:172.21.15.37:6789/0 conn(0x7fdd78070d20 legacy=0x7fdd780afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd600039b0 0x7fdd60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 0x7fdd60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd60004d40 0x7fdd600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7806dec0 con 0x7fdd600039b0 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7806e3f0 con 0x7fdd60004d40 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6000b9c0 con 0x7fdd780b2490 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd7c884640 1 --2- 172.21.15.37:0/2728386751 >> v2:172.21.15.82:3300/0 conn(0x7fdd781629b0 0x7fdd7806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 0x7fdd60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd7c884640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd600039b0 0x7fdd60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd7d085640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd60004d40 0x7fdd600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6ffff640 1 -- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd60004d40 msgr2=0x7fdd600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd60004d40 0x7fdd600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6ffff640 1 -- 172.21.15.37:0/2728386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd600039b0 msgr2=0x7fdd60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd600039b0 0x7fdd60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd6ffff640 1 -- 172.21.15.37:0/2728386751 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd60003520 con 0x7fdd780b2490 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.753+0000 7fdd7c884640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd600039b0 0x7fdd60003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.754+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 0x7fdd60004800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009ac0 tx=0x7fdd60005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89cd1582474c1678 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.754+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68036070 con 0x7fdd780b2490 2024-05-10T08:49:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.754+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd68031400 con 0x7fdd780b2490 2024-05-10T08:49:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.754+0000 7fdd6f7fe640 1 -- 172.21.15.37:0/2728386751 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68009690 con 0x7fdd780b2490 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.755+0000 7fdd7eae8640 1 -- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 msgr2=0x7fdd60004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.755+0000 7fdd7eae8640 1 --2- 172.21.15.37:0/2728386751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780b2490 0x7fdd60004800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009ac0 tx=0x7fdd60005830 comp rx=0 tx=0).stop 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.755+0000 7fdd7d085640 1 -- 172.21.15.37:0/2728386751 reap_dead start 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.755+0000 7fdd7eae8640 1 -- 172.21.15.37:0/2728386751 shutdown_connections 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.755+0000 7fdd7eae8640 1 -- 172.21.15.37:0/2728386751 >> 172.21.15.37:0/2728386751 conn(0x7fdd780b49d0 msgr2=0x7fdd780b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.755+0000 7fdd7eae8640 1 -- 172.21.15.37:0/2728386751 shutdown_connections 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.755+0000 7fdd7eae8640 1 -- 172.21.15.37:0/2728386751 wait complete. 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.756+0000 7fdd7eae8640 1 Processor -- start 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.756+0000 7fdd7eae8640 1 -- start start 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7eae8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd780b2490 0x7fdd78151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7eae8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780cc750 0x7fdd780c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7eae8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd780ccbb0 0x7fdd780c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7eae8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd780b03c0 con 0x7fdd780b2490 2024-05-10T08:49:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7eae8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7806f410 con 0x7fdd780ccbb0 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7eae8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdd780b0540 con 0x7fdd780cc750 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd780b2490 0x7fdd78151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd780b2490 0x7fdd78151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33844/0 (socket says 172.21.15.37:33844) 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 -- 172.21.15.37:0/1889387208 learned_addr learned my addr 172.21.15.37:0/1889387208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780cc750 0x7fdd780c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7d085640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd780ccbb0 0x7fdd780c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 -- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780cc750 msgr2=0x7fdd780c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780cc750 0x7fdd780c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 -- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd780ccbb0 msgr2=0x7fdd780c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd780ccbb0 0x7fdd780c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 -- 172.21.15.37:0/1889387208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd78160a40 con 0x7fdd780b2490 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780cc750 0x7fdd780c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7d085640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd780ccbb0 0x7fdd780c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.757+0000 7fdd7c884640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd780b2490 0x7fdd78151450 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fdd74006d40 tx=0x7fdd7400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.758+0000 7fdd6d7fa640 1 -- 172.21.15.37:0/1889387208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74011e80 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.758+0000 7fdd6d7fa640 1 -- 172.21.15.37:0/1889387208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd74014440 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.758+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd78160d20 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.758+0000 7fdd6d7fa640 1 -- 172.21.15.37:0/1889387208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74014810 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.758+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd780ca0b0 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.759+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd780ca2b0 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.759+0000 7fdd6d7fa640 1 -- 172.21.15.37:0/1889387208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd74012040 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.760+0000 7fdd6d7fa640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd640762d0 0x7fdd64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.760+0000 7fdd6d7fa640 1 -- 172.21.15.37:0/1889387208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fdd74098290 con 0x7fdd780b2490 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.760+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd640762d0 0x7fdd64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.761+0000 7fdd6ffff640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd640762d0 0x7fdd64078790 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdd68033000 tx=0x7fdd68008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:25.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.764+0000 7fdd6d7fa640 1 -- 172.21.15.37:0/1889387208 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdd780ca2b0 con 0x7fdd780b2490 2024-05-10T08:49:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.956+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd780693f0 con 0x7fdd780b2490 2024-05-10T08:49:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.957+0000 7fdd6d7fa640 1 -- 172.21.15.37:0/1889387208 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16905 (secure 0 0 0) 0x7fdd74019030 con 0x7fdd780b2490 2024-05-10T08:49:25.957 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:25.957 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":116,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:25.024610+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:49:22.646272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T08:49:23.934335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.959+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd640762d0 msgr2=0x7fdd64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.959+0000 7fdd7eae8640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd640762d0 0x7fdd64078790 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdd68033000 tx=0x7fdd68008030 comp rx=0 tx=0).stop 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.959+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd780b2490 msgr2=0x7fdd78151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.959+0000 7fdd7eae8640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd780b2490 0x7fdd78151450 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fdd74006d40 tx=0x7fdd7400f610 comp rx=0 tx=0).stop 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 shutdown_connections 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdd640762d0 0x7fdd64078790 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd780ccbb0 0x7fdd780c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdd780cc750 0x7fdd780c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 --2- 172.21.15.37:0/1889387208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd780b2490 0x7fdd78151450 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 >> 172.21.15.37:0/1889387208 conn(0x7fdd780b49d0 msgr2=0x7fdd780b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 shutdown_connections 2024-05-10T08:49:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:25.960+0000 7fdd7eae8640 1 -- 172.21.15.37:0/1889387208 wait complete. 2024-05-10T08:49:25.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:49:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.075+0000 7fb7bda93640 1 Processor -- start 2024-05-10T08:49:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.075+0000 7fb7bda93640 1 -- start start 2024-05-10T08:49:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.076+0000 7fb7bda93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80d3cd0 0x7fb7b80cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.076+0000 7fb7bda93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b80d3330 con 0x7fb7b81629a0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.076+0000 7fb7bda93640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b80d2170 con 0x7fb7b80c9ee0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.076+0000 7fb7bda93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b80d2450 con 0x7fb7b80d3cd0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.076+0000 7fb7b77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb7b81629a0 0x7fb7b80d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37820/0 (socket says 172.21.15.37:37820) 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.076+0000 7fb7b77fe640 1 -- 172.21.15.37:0/2519570547 learned_addr learned my addr 172.21.15.37:0/2519570547 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.076+0000 7fb7b6ffd640 1 --2- 172.21.15.37:0/2519570547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80d3cd0 0x7fb7b80cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.077+0000 7fb7b67fc640 1 -- 172.21.15.37:0/2519570547 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016792898 0 0) 0x7fb7b80d3330 con 0x7fb7b81629a0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.077+0000 7fb7b67fc640 1 -- 172.21.15.37:0/2519570547 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a0003520 con 0x7fb7b81629a0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.077+0000 7fb7b67fc640 1 -- 172.21.15.37:0/2519570547 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195600676 0 0) 0x7fb7b80d2170 con 0x7fb7b80c9ee0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.077+0000 7fb7b67fc640 1 -- 172.21.15.37:0/2519570547 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7b80d3330 con 0x7fb7b80c9ee0 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.077+0000 7fb7b6ffd640 1 -- 172.21.15.37:0/2519570547 >> v1:172.21.15.82:6789/0 conn(0x7fb7b80c9ee0 legacy=0x7fb7b80d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.077+0000 7fb7b6ffd640 1 -- 172.21.15.37:0/2519570547 >> v1:172.21.15.37:6789/0 conn(0x7fb7b81629a0 legacy=0x7fb7b80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.077+0000 7fb7b6ffd640 1 -- 172.21.15.37:0/2519570547 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b80d2730 con 0x7fb7b80d3cd0 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7b6ffd640 1 --2- 172.21.15.37:0/2519570547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80d3cd0 0x7fb7b80cfca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0097d0 tx=0x7fb7ac02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203e553cb7a33d5c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7b67fc640 1 -- 172.21.15.37:0/2519570547 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac037070 con 0x7fb7b80d3cd0 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7b67fc640 1 -- 172.21.15.37:0/2519570547 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac02ae50 con 0x7fb7b80d3cd0 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7b67fc640 1 -- 172.21.15.37:0/2519570547 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac032640 con 0x7fb7b80d3cd0 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7bda93640 1 -- 172.21.15.37:0/2519570547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80d3cd0 msgr2=0x7fb7b80cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7bda93640 1 --2- 172.21.15.37:0/2519570547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80d3cd0 0x7fb7b80cfca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0097d0 tx=0x7fb7ac02a100 comp rx=0 tx=0).stop 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7bda93640 1 -- 172.21.15.37:0/2519570547 shutdown_connections 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7bda93640 1 --2- 172.21.15.37:0/2519570547 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80d3cd0 0x7fb7b80cfca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7bda93640 1 -- 172.21.15.37:0/2519570547 >> 172.21.15.37:0/2519570547 conn(0x7fb7b80d4fe0 msgr2=0x7fb7b80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7bda93640 1 -- 172.21.15.37:0/2519570547 shutdown_connections 2024-05-10T08:49:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.078+0000 7fb7bda93640 1 -- 172.21.15.37:0/2519570547 wait complete. 2024-05-10T08:49:26.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.079+0000 7fb7bda93640 1 Processor -- start 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7bda93640 1 -- start start 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7bda93640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80c9ee0 0x7fb7b80b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7bda93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7b80d3cd0 0x7fb7b80cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7bda93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b81629a0 0x7fb7b81f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7bda93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b80cf440 con 0x7fb7b81629a0 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7bda93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b80cf2c0 con 0x7fb7b80d3cd0 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7bda93640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b80d2dc0 con 0x7fb7b80c9ee0 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.080+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b81629a0 0x7fb7b81f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b81629a0 0x7fb7b81f8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33856/0 (socket says 172.21.15.37:33856) 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 -- 172.21.15.37:0/1486563650 learned_addr learned my addr 172.21.15.37:0/1486563650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b77fe640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80c9ee0 0x7fb7b80b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b6ffd640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7b80d3cd0 0x7fb7b80cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 -- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80c9ee0 msgr2=0x7fb7b80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80c9ee0 0x7fb7b80b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 -- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7b80d3cd0 msgr2=0x7fb7b80cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7b80d3cd0 0x7fb7b80cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 -- 172.21.15.37:0/1486563650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b80b46b0 con 0x7fb7b81629a0 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7b7fff640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b81629a0 0x7fb7b81f8260 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c790 tx=0x7fb7b000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb79ffff640 1 -- 172.21.15.37:0/1486563650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0003b70 con 0x7fb7b81629a0 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb79ffff640 1 -- 172.21.15.37:0/1486563650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b0003d10 con 0x7fb7b81629a0 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b81f8b20 con 0x7fb7b81629a0 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb79ffff640 1 -- 172.21.15.37:0/1486563650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b000aa50 con 0x7fb7b81629a0 2024-05-10T08:49:26.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.081+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b80b4920 con 0x7fb7b81629a0 2024-05-10T08:49:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.082+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b80693f0 con 0x7fb7b81629a0 2024-05-10T08:49:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.083+0000 7fb79ffff640 1 -- 172.21.15.37:0/1486563650 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb7b000abf0 con 0x7fb7b81629a0 2024-05-10T08:49:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.083+0000 7fb79ffff640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7a40762d0 0x7fb7a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.084+0000 7fb79ffff640 1 -- 172.21.15.37:0/1486563650 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7fb7b0097670 con 0x7fb7b81629a0 2024-05-10T08:49:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.084+0000 7fb7b77fe640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7a40762d0 0x7fb7a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.084+0000 7fb7b77fe640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7a40762d0 0x7fb7a4078790 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80011e0 tx=0x7fb7a8007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:26.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.088+0000 7fb79ffff640 1 -- 172.21.15.37:0/1486563650 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb7b0060750 con 0x7fb7b81629a0 2024-05-10T08:49:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.281+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7b80d38a0 con 0x7fb7b81629a0 2024-05-10T08:49:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.282+0000 7fb79ffff640 1 -- 172.21.15.37:0/1486563650 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16905 (secure 0 0 0) 0x7fb7b0064a50 con 0x7fb7b81629a0 2024-05-10T08:49:26.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:26.281 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":116,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:25.024610+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:49:22.646272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T08:49:23.934335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7a40762d0 msgr2=0x7fb7a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7a40762d0 0x7fb7a4078790 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80011e0 tx=0x7fb7a8007d30 comp rx=0 tx=0).stop 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b81629a0 msgr2=0x7fb7b81f8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b81629a0 0x7fb7b81f8260 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c790 tx=0x7fb7b000cc50 comp rx=0 tx=0).stop 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 shutdown_connections 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb7a40762d0 0x7fb7a4078790 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b81629a0 0x7fb7b81f8260 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7b80d3cd0 0x7fb7b80cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 --2- 172.21.15.37:0/1486563650 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7b80c9ee0 0x7fb7b80b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 >> 172.21.15.37:0/1486563650 conn(0x7fb7b80d4fe0 msgr2=0x7fb7b80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 shutdown_connections 2024-05-10T08:49:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.284+0000 7fb7bda93640 1 -- 172.21.15.37:0/1486563650 wait complete. 2024-05-10T08:49:26.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T08:49:26.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.402+0000 7f092a7af640 1 Processor -- start 2024-05-10T08:49:26.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.402+0000 7f092a7af640 1 -- start start 2024-05-10T08:49:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f092a7af640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f09241629b0 0x7f092406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f092a7af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f092406e110 con 0x7f09240b2490 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f092a7af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f092406e3f0 con 0x7f0924070d20 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f092a7af640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0924070a40 con 0x7f09241629b0 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f09237fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09240b2490 0x7f0924070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37830/0 (socket says 172.21.15.37:37830) 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f09237fe640 1 -- 172.21.15.37:0/293502589 learned_addr learned my addr 172.21.15.37:0/293502589 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f0923fff640 1 --2- 172.21.15.37:0/293502589 >> v2:172.21.15.82:3300/0 conn(0x7f09241629b0 0x7f092406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348527681 0 0) 0x7f092406e110 con 0x7f09240b2490 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.403+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f090c003520 con 0x7f09240b2490 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 530401327 0 0) 0x7f090c003520 con 0x7f09240b2490 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 >> v2:172.21.15.82:3300/0 conn(0x7f09241629b0 msgr2=0x7f092406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 --2- 172.21.15.37:0/293502589 >> v2:172.21.15.82:3300/0 conn(0x7f09241629b0 0x7f092406eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 >> v1:172.21.15.82:6789/0 conn(0x7f0924070d20 legacy=0x7f09240afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092406e6d0 con 0x7f09240b2490 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f0918001670 con 0x7f09240b2490 2024-05-10T08:49:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 >> v1:172.21.15.37:6789/0 conn(0x7f09240b2490 legacy=0x7f0924070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f090c0039b0 0x7f090c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f090c004800 0x7f090c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c0051c0 0x7f090c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0924070a40 con 0x7f090c004800 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f090c00c010 con 0x7f090c0051c0 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f090c00c210 con 0x7f090c0039b0 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f09237fe640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f090c004800 0x7f090c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0923fff640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f090c0039b0 0x7f090c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0928d4c640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c0051c0 0x7f090c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f09237fe640 1 -- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f090c0039b0 msgr2=0x7f090c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f09237fe640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f090c0039b0 0x7f090c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f09237fe640 1 -- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c0051c0 msgr2=0x7f090c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f09237fe640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c0051c0 0x7f090c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f0928d4c640 1 -- 172.21.15.37:0/293502589 reap_dead start 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.404+0000 7f09237fe640 1 -- 172.21.15.37:0/293502589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c003520 con 0x7f090c004800 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.405+0000 7f09237fe640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f090c004800 0x7f090c004c80 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f091800c160 tx=0x7f090c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d59479eeba2306 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.405+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918007c80 con 0x7f090c004800 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.405+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0918005af0 con 0x7f090c004800 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.405+0000 7f0922ffd640 1 -- 172.21.15.37:0/293502589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918007070 con 0x7f090c004800 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.405+0000 7f092a7af640 1 -- 172.21.15.37:0/293502589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f090c004800 msgr2=0x7f090c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.406+0000 7f092a7af640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f090c004800 0x7f090c004c80 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f091800c160 tx=0x7f090c005830 comp rx=0 tx=0).stop 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.406+0000 7f092a7af640 1 -- 172.21.15.37:0/293502589 shutdown_connections 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.406+0000 7f092a7af640 1 --2- 172.21.15.37:0/293502589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f090c004800 0x7f090c004c80 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.406+0000 7f092a7af640 1 -- 172.21.15.37:0/293502589 >> 172.21.15.37:0/293502589 conn(0x7f09240b49d0 msgr2=0x7f09240b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.406+0000 7f092a7af640 1 -- 172.21.15.37:0/293502589 shutdown_connections 2024-05-10T08:49:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.406+0000 7f092a7af640 1 -- 172.21.15.37:0/293502589 wait complete. 2024-05-10T08:49:26.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.407+0000 7f092a7af640 1 Processor -- start 2024-05-10T08:49:26.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.407+0000 7f092a7af640 1 -- start start 2024-05-10T08:49:26.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f092a7af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c004800 0x7f092414b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f092a7af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09240b5ac0 0x7f09240b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f092a7af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092415bb50 0x7f092415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f092a7af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09240711d0 con 0x7f092415bb50 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f092a7af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f092406dec0 con 0x7f090c004800 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f092a7af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0924071350 con 0x7f09240b5ac0 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092415bb50 0x7f092415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092415bb50 0x7f092415bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33872/0 (socket says 172.21.15.37:33872) 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 -- 172.21.15.37:0/3325152525 learned_addr learned my addr 172.21.15.37:0/3325152525 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0923fff640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c004800 0x7f092414b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f09237fe640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09240b5ac0 0x7f09240b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 -- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09240b5ac0 msgr2=0x7f09240b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09240b5ac0 0x7f09240b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 -- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c004800 msgr2=0x7f092414b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c004800 0x7f092414b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 -- 172.21.15.37:0/3325152525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092415c840 con 0x7f092415bb50 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0928d4c640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092415bb50 0x7f092415bfd0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f0924073290 tx=0x7f091c00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0920ff9640 1 -- 172.21.15.37:0/3325152525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c019070 con 0x7f092415bb50 2024-05-10T08:49:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.408+0000 7f0920ff9640 1 -- 172.21.15.37:0/3325152525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c006e20 con 0x7f092415bb50 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.409+0000 7f0920ff9640 1 -- 172.21.15.37:0/3325152525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c003b90 con 0x7f092415bb50 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.409+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092415cb20 con 0x7f092415bb50 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.409+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092415d0e0 con 0x7f092415bb50 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.410+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09240693f0 con 0x7f092415bb50 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.410+0000 7f0920ff9640 1 -- 172.21.15.37:0/3325152525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f091c01c070 con 0x7f092415bb50 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.411+0000 7f0920ff9640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09100762d0 0x7f0910078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.411+0000 7f0920ff9640 1 -- 172.21.15.37:0/3325152525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6101+0+0 (secure 0 0 0) 0x7f091c096aa0 con 0x7f092415bb50 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.411+0000 7f0923fff640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09100762d0 0x7f0910078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.411+0000 7f0923fff640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09100762d0 0x7f0910078790 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0914009b00 tx=0x7f0914008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.415+0000 7f0920ff9640 1 -- 172.21.15.37:0/3325152525 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f091c060270 con 0x7f092415bb50 2024-05-10T08:49:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:26.644+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f09240706b0 con 0x7f092415bb50 2024-05-10T08:49:27.585 INFO:tasks.ceph.mds.d.smithi082.stderr:2024-05-10T08:49:27.587+0000 7f0b4147c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:49:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.630+0000 7f0920ff9640 1 -- 172.21.15.37:0/3325152525 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v97) ==== 118+0+0 (secure 0 0 0) 0x7f091c05fb70 con 0x7f092415bb50 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09100762d0 msgr2=0x7f0910078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09100762d0 0x7f0910078790 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0914009b00 tx=0x7f0914008040 comp rx=0 tx=0).stop 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092415bb50 msgr2=0x7f092415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092415bb50 0x7f092415bfd0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f0924073290 tx=0x7f091c00fd40 comp rx=0 tx=0).stop 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 shutdown_connections 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f09100762d0 0x7f0910078790 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f092415bb50 0x7f092415bfd0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09240b5ac0 0x7f09240b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 --2- 172.21.15.37:0/3325152525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f090c004800 0x7f092414b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 >> 172.21.15.37:0/3325152525 conn(0x7f09240b49d0 msgr2=0x7f09240b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 shutdown_connections 2024-05-10T08:49:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.633+0000 7f092a7af640 1 -- 172.21.15.37:0/3325152525 wait complete. 2024-05-10T08:49:27.645 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T08:49:27.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T08:49:27.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.760+0000 7fcc7299d640 1 Processor -- start 2024-05-10T08:49:27.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.760+0000 7fcc7299d640 1 -- start start 2024-05-10T08:49:27.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc7299d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc6c06e0f0 0x7fcc6c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc7299d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6c15c920 con 0x7fcc6c072840 2024-05-10T08:49:27.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc7299d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6c15cc00 con 0x7fcc6c06e4d0 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc7299d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcc6c15cee0 con 0x7fcc6c06e0f0 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc6b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcc6c072840 0x7fcc6c0d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49420/0 (socket says 172.21.15.37:49420) 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc6b7fe640 1 -- 172.21.15.37:0/1615223247 learned_addr learned my addr 172.21.15.37:0/1615223247 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1615223247 >> v2:172.21.15.82:3300/0 conn(0x7fcc6c06e0f0 0x7fcc6c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701670088 0 0) 0x7fcc6c15c920 con 0x7fcc6c072840 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc54003520 con 0x7fcc6c072840 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.761+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1674033854 0 0) 0x7fcc54003520 con 0x7fcc6c072840 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 >> v2:172.21.15.82:3300/0 conn(0x7fcc6c06e0f0 msgr2=0x7fcc6c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 --2- 172.21.15.37:0/1615223247 >> v2:172.21.15.82:3300/0 conn(0x7fcc6c06e0f0 0x7fcc6c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 >> v1:172.21.15.82:6789/0 conn(0x7fcc6c06e4d0 legacy=0x7fcc6c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c15d1c0 con 0x7fcc6c072840 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fcc60001670 con 0x7fcc6c072840 2024-05-10T08:49:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 >> v1:172.21.15.37:6789/0 conn(0x7fcc6c072840 legacy=0x7fcc6c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc54004800 0x7fcc54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc540051c0 0x7fcc5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c15cee0 con 0x7fcc54003a00 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5400c0c0 con 0x7fcc540051c0 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5400c2c0 con 0x7fcc54004800 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc70f3a640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc540051c0 0x7fcc5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6b7fe640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc54004800 0x7fcc54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6bfff640 1 -- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc54004800 msgr2=0x7fcc54004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc54004800 0x7fcc54004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6bfff640 1 -- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc540051c0 msgr2=0x7fcc5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc540051c0 0x7fcc5400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc6bfff640 1 -- 172.21.15.37:0/1615223247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc54003520 con 0x7fcc54003a00 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc70f3a640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc540051c0 0x7fcc5400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.762+0000 7fcc70f3a640 1 -- 172.21.15.37:0/1615223247 reap_dead start 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc54003e20 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009650 tx=0x7fcc54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369e96a6f0efbc99 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c038070 con 0x7fcc54003a00 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c033400 con 0x7fcc54003a00 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc6affd640 1 -- 172.21.15.37:0/1615223247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c009690 con 0x7fcc54003a00 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc7299d640 1 -- 172.21.15.37:0/1615223247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 msgr2=0x7fcc54003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc54003e20 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009650 tx=0x7fcc54005830 comp rx=0 tx=0).stop 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc7299d640 1 -- 172.21.15.37:0/1615223247 shutdown_connections 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1615223247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc54003e20 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc7299d640 1 -- 172.21.15.37:0/1615223247 >> 172.21.15.37:0/1615223247 conn(0x7fcc6c06c3a0 msgr2=0x7fcc6c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc7299d640 1 -- 172.21.15.37:0/1615223247 shutdown_connections 2024-05-10T08:49:27.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.763+0000 7fcc7299d640 1 -- 172.21.15.37:0/1615223247 wait complete. 2024-05-10T08:49:27.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.765+0000 7fcc7299d640 1 Processor -- start 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.765+0000 7fcc7299d640 1 -- start start 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc6c1e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6c1f4c10 0x7fcc6c0cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc6c0cde00 0x7fcc6c0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c0ae7d0 con 0x7fcc54003a00 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c0ae650 con 0x7fcc6c1f4c10 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6c1530b0 con 0x7fcc6c0cde00 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc6c1e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc6c1e4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43452/0 (socket says 172.21.15.37:43452) 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 -- 172.21.15.37:0/1957432264 learned_addr learned my addr 172.21.15.37:0/1957432264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6b7fe640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6c1f4c10 0x7fcc6c0cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc70f3a640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc6c0cde00 0x7fcc6c0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 -- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc6c0cde00 msgr2=0x7fcc6c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc6c0cde00 0x7fcc6c0ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 -- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6c1f4c10 msgr2=0x7fcc6c0cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6c1f4c10 0x7fcc6c0cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 -- 172.21.15.37:0/1957432264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c158be0 con 0x7fcc54003a00 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc6bfff640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc6c1e4940 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009bb0 tx=0x7fcc5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc68ff9640 1 -- 172.21.15.37:0/1957432264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c038040 con 0x7fcc54003a00 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc68ff9640 1 -- 172.21.15.37:0/1957432264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c041070 con 0x7fcc54003a00 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc68ff9640 1 -- 172.21.15.37:0/1957432264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c003a30 con 0x7fcc54003a00 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c158ec0 con 0x7fcc54003a00 2024-05-10T08:49:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.766+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c0d02c0 con 0x7fcc54003a00 2024-05-10T08:49:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.767+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c0b0830 con 0x7fcc54003a00 2024-05-10T08:49:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.768+0000 7fcc68ff9640 1 -- 172.21.15.37:0/1957432264 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc5c003bd0 con 0x7fcc54003a00 2024-05-10T08:49:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.769+0000 7fcc68ff9640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc58076300 0x7fcc580787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.769+0000 7fcc68ff9640 1 -- 172.21.15.37:0/1957432264 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fcc5c0b6d20 con 0x7fcc54003a00 2024-05-10T08:49:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.769+0000 7fcc6b7fe640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc58076300 0x7fcc580787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.770+0000 7fcc6b7fe640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc58076300 0x7fcc580787c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001050 tx=0x7fcc60009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:27.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:27.773+0000 7fcc68ff9640 1 -- 172.21.15.37:0/1957432264 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcc5c04a020 con 0x7fcc54003a00 2024-05-10T08:49:28.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.003+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcc6c1593e0 con 0x7fcc54003a00 2024-05-10T08:49:28.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.631+0000 7fcc68ff9640 1 -- 172.21.15.37:0/1957432264 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v98) ==== 122+0+0 (secure 0 0 0) 0x7fcc5c0804f0 con 0x7fcc54003a00 2024-05-10T08:49:28.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.634+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc58076300 msgr2=0x7fcc580787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.634+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc58076300 0x7fcc580787c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001050 tx=0x7fcc60009040 comp rx=0 tx=0).stop 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.634+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 msgr2=0x7fcc6c1e4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.634+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc6c1e4940 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009bb0 tx=0x7fcc5c004730 comp rx=0 tx=0).stop 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 shutdown_connections 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcc58076300 0x7fcc580787c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcc6c0cde00 0x7fcc6c0ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6c1f4c10 0x7fcc6c0cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 --2- 172.21.15.37:0/1957432264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc54003a00 0x7fcc6c1e4940 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 >> 172.21.15.37:0/1957432264 conn(0x7fcc6c06c3a0 msgr2=0x7fcc6c15eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 shutdown_connections 2024-05-10T08:49:28.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.635+0000 7fcc7299d640 1 -- 172.21.15.37:0/1957432264 wait complete. 2024-05-10T08:49:28.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T08:49:28.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.758+0000 7f50c11c8640 1 Processor -- start 2024-05-10T08:49:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.758+0000 7f50c11c8640 1 -- start start 2024-05-10T08:49:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50c11c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50bc06da00 0x7f50bc073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50c11c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50bc1637b0 0x7f50bc0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50c11c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50bc0b5120 con 0x7f50bc06d620 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50c11c8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f50bc0afaa0 con 0x7f50bc06da00 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50c11c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f50bc0b5a50 con 0x7f50bc1637b0 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50ba59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50bc06da00 0x7f50bc073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50bad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50bc06d620 0x7f50bc0af2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49424/0 (socket says 172.21.15.37:49424) 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.759+0000 7f50bad9d640 1 -- 172.21.15.37:0/3384167942 learned_addr learned my addr 172.21.15.37:0/3384167942 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.760+0000 7f50bb59e640 1 --2- 172.21.15.37:0/3384167942 >> v2:172.21.15.82:3300/0 conn(0x7f50bc1637b0 0x7f50bc0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.760+0000 7f50ba59c640 1 -- 172.21.15.37:0/3384167942 >> v2:172.21.15.82:3300/0 conn(0x7f50bc1637b0 msgr2=0x7f50bc0b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.760+0000 7f50ba59c640 1 --2- 172.21.15.37:0/3384167942 >> v2:172.21.15.82:3300/0 conn(0x7f50bc1637b0 0x7f50bc0b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.760+0000 7f50ba59c640 1 -- 172.21.15.37:0/3384167942 >> v1:172.21.15.37:6789/0 conn(0x7f50bc06d620 legacy=0x7f50bc0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.760+0000 7f50ba59c640 1 -- 172.21.15.37:0/3384167942 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc0b5400 con 0x7f50bc06da00 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.760+0000 7f50bb59e640 1 --2- 172.21.15.37:0/3384167942 >> v2:172.21.15.82:3300/0 conn(0x7f50bc1637b0 0x7f50bc0b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.760+0000 7f50ba59c640 1 --2- 172.21.15.37:0/3384167942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc073800 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f50bc06e780 tx=0x7f50a402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16214dbf7069d035 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50b9d9b640 1 -- 172.21.15.37:0/3384167942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4037070 con 0x7f50bc06da00 2024-05-10T08:49:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50b9d9b640 1 -- 172.21.15.37:0/3384167942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a402add0 con 0x7f50bc06da00 2024-05-10T08:49:28.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50b9d9b640 1 -- 172.21.15.37:0/3384167942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4032660 con 0x7f50bc06da00 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 -- 172.21.15.37:0/3384167942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 msgr2=0x7f50bc073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 --2- 172.21.15.37:0/3384167942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc073800 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f50bc06e780 tx=0x7f50a402a080 comp rx=0 tx=0).stop 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 -- 172.21.15.37:0/3384167942 shutdown_connections 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 --2- 172.21.15.37:0/3384167942 >> v2:172.21.15.82:3300/0 conn(0x7f50bc1637b0 0x7f50bc0b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 --2- 172.21.15.37:0/3384167942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc073800 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 -- 172.21.15.37:0/3384167942 >> 172.21.15.37:0/3384167942 conn(0x7f50bc0728c0 msgr2=0x7f50bc072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 -- 172.21.15.37:0/3384167942 shutdown_connections 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.761+0000 7f50c11c8640 1 -- 172.21.15.37:0/3384167942 wait complete. 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.763+0000 7f50c11c8640 1 Processor -- start 2024-05-10T08:49:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.763+0000 7f50c11c8640 1 -- start start 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50c11c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50bc06d620 0x7f50bc158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50c11c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50c11c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50bc1637b0 0x7f50bc0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50c11c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc0b65a0 con 0x7f50bc06da00 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50c11c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc0b6420 con 0x7f50bc1637b0 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50c11c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f50bc06e920 con 0x7f50bc06d620 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc1571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43470/0 (socket says 172.21.15.37:43470) 2024-05-10T08:49:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 -- 172.21.15.37:0/4053966523 learned_addr learned my addr 172.21.15.37:0/4053966523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50bb59e640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50bc1637b0 0x7f50bc0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50bad9d640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50bc06d620 0x7f50bc158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 -- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50bc06d620 msgr2=0x7f50bc158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50bc06d620 0x7f50bc158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 -- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50bc1637b0 msgr2=0x7f50bc0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50bc1637b0 0x7f50bc0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 -- 172.21.15.37:0/4053966523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc153160 con 0x7f50bc06da00 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50bad9d640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50bc06d620 0x7f50bc158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50ba59c640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc1571d0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c00 tx=0x7f50a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50b37fe640 1 -- 172.21.15.37:0/4053966523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4037040 con 0x7f50bc06da00 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50b37fe640 1 -- 172.21.15.37:0/4053966523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a403b430 con 0x7f50bc06da00 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.764+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc1591d0 con 0x7f50bc06da00 2024-05-10T08:49:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.765+0000 7f50b37fe640 1 -- 172.21.15.37:0/4053966523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a403b800 con 0x7f50bc06da00 2024-05-10T08:49:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.765+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc159790 con 0x7f50bc06da00 2024-05-10T08:49:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.766+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50bc159f90 con 0x7f50bc06da00 2024-05-10T08:49:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.766+0000 7f50b37fe640 1 -- 172.21.15.37:0/4053966523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50a4044020 con 0x7f50bc06da00 2024-05-10T08:49:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.767+0000 7f50b37fe640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f509c076300 0x7f509c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.767+0000 7f50b37fe640 1 -- 172.21.15.37:0/4053966523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f50a40b7780 con 0x7f50bc06da00 2024-05-10T08:49:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.767+0000 7f50bad9d640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f509c076300 0x7f509c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.767+0000 7f50bad9d640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f509c076300 0x7f509c0787c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f50b4000f60 tx=0x7f50b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:28.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:28.771+0000 7f50b37fe640 1 -- 172.21.15.37:0/4053966523 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f50bc159f90 con 0x7f50bc06da00 2024-05-10T08:49:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.004+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50bc0693f0 con 0x7f50bc06da00 2024-05-10T08:49:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.004+0000 7f50b37fe640 1 -- 172.21.15.37:0/4053966523 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5180 (secure 0 0 0) 0x7f50a4080eb0 con 0x7f50bc06da00 2024-05-10T08:49:29.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:29.003 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":98,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/202078248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":202078248},{"type":"v1","addr":"172.21.15.37:6835","nonce":202078248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:28.004653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2344331780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2344331780},{"type":"v1","addr":"172.21.15.82:6837","nonce":2344331780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8052,"qdb_cluster":[8052]},"id":8}]} 2024-05-10T08:49:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 98 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f509c076300 msgr2=0x7f509c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f509c076300 0x7f509c0787c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f50b4000f60 tx=0x7f50b4009040 comp rx=0 tx=0).stop 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 msgr2=0x7f50bc1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc1571d0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c00 tx=0x7f50a40046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 shutdown_connections 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f509c076300 0x7f509c0787c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50bc1637b0 0x7f50bc0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc06da00 0x7f50bc1571d0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 --2- 172.21.15.37:0/4053966523 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50bc06d620 0x7f50bc158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 >> 172.21.15.37:0/4053966523 conn(0x7f50bc0728c0 msgr2=0x7f50bc1539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.006+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 shutdown_connections 2024-05-10T08:49:29.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.007+0000 7f50c11c8640 1 -- 172.21.15.37:0/4053966523 wait complete. 2024-05-10T08:49:29.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:49:29.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.121+0000 7fcee89e4640 1 Processor -- start 2024-05-10T08:49:29.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.121+0000 7fcee89e4640 1 -- start start 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.122+0000 7fcee89e4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcee415f0c0 0x7fcee40b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.122+0000 7fcee89e4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcee406c3a0 0x7fcee406c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.122+0000 7fcee89e4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee40b14e0 con 0x7fcee41638e0 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.122+0000 7fcee89e4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcee4163450 con 0x7fcee406c3a0 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.122+0000 7fcee89e4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcee406cd20 con 0x7fcee415f0c0 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee2d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcee406c3a0 0x7fcee406c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee2d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcee406c3a0 0x7fcee406c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43478/0 (socket says 172.21.15.37:43478) 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3622691324 learned_addr learned my addr 172.21.15.37:0/3622691324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee259c640 1 --2- 172.21.15.37:0/3622691324 >> v2:172.21.15.82:3300/0 conn(0x7fcee415f0c0 0x7fcee40b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3622691324 >> v2:172.21.15.82:3300/0 conn(0x7fcee415f0c0 msgr2=0x7fcee40b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee2d9d640 1 --2- 172.21.15.37:0/3622691324 >> v2:172.21.15.82:3300/0 conn(0x7fcee415f0c0 0x7fcee40b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3622691324 >> v1:172.21.15.82:6789/0 conn(0x7fcee41638e0 legacy=0x7fcee40b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.123+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3622691324 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee41604b0 con 0x7fcee406c3a0 2024-05-10T08:49:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee2d9d640 1 --2- 172.21.15.37:0/3622691324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee406c3a0 0x7fcee406c7e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fcee4071200 tx=0x7fcedc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8fc33728754979 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee159a640 1 -- 172.21.15.37:0/3622691324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc036070 con 0x7fcee406c3a0 2024-05-10T08:49:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee159a640 1 -- 172.21.15.37:0/3622691324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc031600 con 0x7fcee406c3a0 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee159a640 1 -- 172.21.15.37:0/3622691324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0319d0 con 0x7fcee406c3a0 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee89e4640 1 -- 172.21.15.37:0/3622691324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee406c3a0 msgr2=0x7fcee406c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3622691324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee406c3a0 0x7fcee406c7e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fcee4071200 tx=0x7fcedc02a6f0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee89e4640 1 -- 172.21.15.37:0/3622691324 shutdown_connections 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3622691324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee406c3a0 0x7fcee406c7e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3622691324 >> v2:172.21.15.82:3300/0 conn(0x7fcee415f0c0 0x7fcee40b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.124+0000 7fcee89e4640 1 -- 172.21.15.37:0/3622691324 >> 172.21.15.37:0/3622691324 conn(0x7fcee40b3b10 msgr2=0x7fcee40b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.125+0000 7fcee89e4640 1 -- 172.21.15.37:0/3622691324 shutdown_connections 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.125+0000 7fcee89e4640 1 -- 172.21.15.37:0/3622691324 wait complete. 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.126+0000 7fcee89e4640 1 Processor -- start 2024-05-10T08:49:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.126+0000 7fcee89e4640 1 -- start start 2024-05-10T08:49:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee89e4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcee406c3a0 0x7fcee414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee89e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415f0c0 0x7fcee41eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee89e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee41638e0 0x7fcee41eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee89e4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40b17c0 con 0x7fcee41638e0 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee89e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcee41630e0 con 0x7fcee415f0c0 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee89e4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcee415f4a0 con 0x7fcee406c3a0 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee41638e0 0x7fcee41eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee41638e0 0x7fcee41eb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43492/0 (socket says 172.21.15.37:43492) 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3854591967 learned_addr learned my addr 172.21.15.37:0/3854591967 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee1d9b640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415f0c0 0x7fcee41eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee259c640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcee406c3a0 0x7fcee414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcee406c3a0 msgr2=0x7fcee414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcee406c3a0 0x7fcee414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415f0c0 msgr2=0x7fcee41eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415f0c0 0x7fcee41eac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 -- 172.21.15.37:0/3854591967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee415d5f0 con 0x7fcee41638e0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee2d9d640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee41638e0 0x7fcee41eb170 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcedc02ace0 tx=0x7fcedc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcedaffd640 1 -- 172.21.15.37:0/3854591967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc036050 con 0x7fcee41638e0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcedaffd640 1 -- 172.21.15.37:0/3854591967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc042070 con 0x7fcee41638e0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee415d8d0 con 0x7fcee41638e0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.127+0000 7fcedaffd640 1 -- 172.21.15.37:0/3854591967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc009510 con 0x7fcee41638e0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.128+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee41f8820 con 0x7fcee41638e0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.128+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee406a8f0 con 0x7fcee41638e0 2024-05-10T08:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.129+0000 7fcedaffd640 1 -- 172.21.15.37:0/3854591967 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcedc007bd0 con 0x7fcee41638e0 2024-05-10T08:49:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.129+0000 7fcedaffd640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcec40762d0 0x7fcec4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.130+0000 7fcedaffd640 1 -- 172.21.15.37:0/3854591967 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fcedc0b85e0 con 0x7fcee41638e0 2024-05-10T08:49:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.130+0000 7fcee259c640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcec40762d0 0x7fcec4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.130+0000 7fcee259c640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcec40762d0 0x7fcec4078790 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fced4006fd0 tx=0x7fced4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.134+0000 7fcedaffd640 1 -- 172.21.15.37:0/3854591967 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcedc081640 con 0x7fcee41638e0 2024-05-10T08:49:29.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.325+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcee40693f0 con 0x7fcee41638e0 2024-05-10T08:49:29.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.326+0000 7fcedaffd640 1 -- 172.21.15.37:0/3854591967 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16892 (secure 0 0 0) 0x7fcedc085940 con 0x7fcee41638e0 2024-05-10T08:49:29.325 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:29.325 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":117,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:26.610469+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:49:22.646272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T08:49:23.934335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:49:29.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcec40762d0 msgr2=0x7fcec4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcec40762d0 0x7fcec4078790 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fced4006fd0 tx=0x7fced4008040 comp rx=0 tx=0).stop 2024-05-10T08:49:29.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee41638e0 msgr2=0x7fcee41eb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee41638e0 0x7fcee41eb170 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcedc02ace0 tx=0x7fcedc004a40 comp rx=0 tx=0).stop 2024-05-10T08:49:29.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 shutdown_connections 2024-05-10T08:49:29.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fcec40762d0 0x7fcec4078790 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcee41638e0 0x7fcee41eb170 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415f0c0 0x7fcee41eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 --2- 172.21.15.37:0/3854591967 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcee406c3a0 0x7fcee414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 >> 172.21.15.37:0/3854591967 conn(0x7fcee40b3b10 msgr2=0x7fcee4073dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:29.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 shutdown_connections 2024-05-10T08:49:29.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.328+0000 7fcee89e4640 1 -- 172.21.15.37:0/3854591967 wait complete. 2024-05-10T08:49:29.338 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:49:29.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:49:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.443+0000 7f3315c54640 1 Processor -- start 2024-05-10T08:49:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.443+0000 7f3315c54640 1 -- start start 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.444+0000 7f3315c54640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 0x7f33100712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.444+0000 7f3315c54640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33100718c0 con 0x7f33100d33f0 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.444+0000 7f3315c54640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3310071ba0 con 0x7f331015ccb0 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.444+0000 7f3315c54640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f33100afba0 con 0x7f33100b1040 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.444+0000 7f330effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33100d33f0 0x7f3310070b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49428/0 (socket says 172.21.15.37:49428) 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330effd640 1 -- 172.21.15.37:0/4028241549 learned_addr learned my addr 172.21.15.37:0/4028241549 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330ffff640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 0x7f33100712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130278270 0 0) 0x7f33100718c0 con 0x7f33100d33f0 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32f8003520 con 0x7f33100d33f0 2024-05-10T08:49:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1820884865 0 0) 0x7f32f8003520 con 0x7f33100d33f0 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 msgr2=0x7f33100712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 0x7f33100712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 >> v1:172.21.15.82:6789/0 conn(0x7f331015ccb0 legacy=0x7f33100d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3310071e80 con 0x7f33100d33f0 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f3304001670 con 0x7f33100d33f0 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 >> v1:172.21.15.37:6789/0 conn(0x7f33100d33f0 legacy=0x7f3310070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32f80039e0 0x7f32f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 0x7f32f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f8004d40 0x7f32f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32f800ba70 con 0x7f32f80039e0 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32f800bc20 con 0x7f32f8004d40 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f32f800be20 con 0x7f33100b1040 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330f7fe640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32f80039e0 0x7f32f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330effd640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 0x7f32f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330ffff640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f8004d40 0x7f32f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330f7fe640 1 -- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 msgr2=0x7f32f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330f7fe640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33100b1040 0x7f32f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330f7fe640 1 -- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f8004d40 msgr2=0x7f32f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.445+0000 7f330f7fe640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f8004d40 0x7f32f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.446+0000 7f330f7fe640 1 -- 172.21.15.37:0/4028241549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f8003520 con 0x7f32f80039e0 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.446+0000 7f330ffff640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f8004d40 0x7f32f80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.446+0000 7f330f7fe640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32f80039e0 0x7f32f8003e00 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f3300001720 tx=0x7f32f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946e97837f827a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.446+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300001370 con 0x7f32f80039e0 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.446+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33000052d0 con 0x7f32f80039e0 2024-05-10T08:49:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.446+0000 7f330e7fc640 1 -- 172.21.15.37:0/4028241549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330002abc0 con 0x7f32f80039e0 2024-05-10T08:49:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.447+0000 7f3315c54640 1 -- 172.21.15.37:0/4028241549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32f80039e0 msgr2=0x7f32f8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.447+0000 7f3315c54640 1 --2- 172.21.15.37:0/4028241549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32f80039e0 0x7f32f8003e00 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f3300001720 tx=0x7f32f8005830 comp rx=0 tx=0).stop 2024-05-10T08:49:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.447+0000 7f330ffff640 1 -- 172.21.15.37:0/4028241549 reap_dead start 2024-05-10T08:49:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.447+0000 7f3315c54640 1 -- 172.21.15.37:0/4028241549 shutdown_connections 2024-05-10T08:49:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.447+0000 7f3315c54640 1 -- 172.21.15.37:0/4028241549 >> 172.21.15.37:0/4028241549 conn(0x7f331009ba40 msgr2=0x7f331009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.447+0000 7f3315c54640 1 -- 172.21.15.37:0/4028241549 shutdown_connections 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.447+0000 7f3315c54640 1 -- 172.21.15.37:0/4028241549 wait complete. 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.448+0000 7f3315c54640 1 Processor -- start 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.448+0000 7f3315c54640 1 -- start start 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f3315c54640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32f80039e0 0x7f33101593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f3315c54640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33101f8590 0x7f33101f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f3315c54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33101f8f50 0x7f331006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f3315c54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3310071420 con 0x7f33101f8f50 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f3315c54640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33100712a0 con 0x7f33101f8590 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f3315c54640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f33100715a0 con 0x7f32f80039e0 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f330ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33101f8f50 0x7f331006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f330ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33101f8f50 0x7f331006d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43520/0 (socket says 172.21.15.37:43520) 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f330ffff640 1 -- 172.21.15.37:0/381145918 learned_addr learned my addr 172.21.15.37:0/381145918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f330effd640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33101f8590 0x7f33101f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.449+0000 7f330f7fe640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32f80039e0 0x7f33101593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f330ffff640 1 -- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32f80039e0 msgr2=0x7f33101593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f330ffff640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32f80039e0 0x7f33101593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f330ffff640 1 -- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33101f8590 msgr2=0x7f33101f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f330ffff640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33101f8590 0x7f33101f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f330ffff640 1 -- 172.21.15.37:0/381145918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33100b8a40 con 0x7f33101f8f50 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f330f7fe640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32f80039e0 0x7f33101593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f330ffff640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33101f8f50 0x7f331006d4b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f33100b14d0 tx=0x7f3308009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f32f7fff640 1 -- 172.21.15.37:0/381145918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308011e90 con 0x7f33101f8f50 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f32f7fff640 1 -- 172.21.15.37:0/381145918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330801c070 con 0x7f33101f8f50 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33100b6530 con 0x7f33101f8f50 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f32f7fff640 1 -- 172.21.15.37:0/381145918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33080166b0 con 0x7f33101f8f50 2024-05-10T08:49:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.450+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33100b6af0 con 0x7f33101f8f50 2024-05-10T08:49:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.451+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33100b6e20 con 0x7f33101f8f50 2024-05-10T08:49:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.452+0000 7f32f7fff640 1 -- 172.21.15.37:0/381145918 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3308005d10 con 0x7f33101f8f50 2024-05-10T08:49:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.452+0000 7f32f7fff640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32fc0764a0 0x7f32fc078960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.452+0000 7f32f7fff640 1 -- 172.21.15.37:0/381145918 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f3308097d20 con 0x7f33101f8f50 2024-05-10T08:49:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.452+0000 7f330f7fe640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32fc0764a0 0x7f32fc078960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.453+0000 7f330f7fe640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32fc0764a0 0x7f32fc078960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3300032000 tx=0x7f330002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.456+0000 7f32f7fff640 1 -- 172.21.15.37:0/381145918 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f33080614f0 con 0x7f33101f8f50 2024-05-10T08:49:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.646+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3310069b00 con 0x7f32fc0764a0 2024-05-10T08:49:29.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.653+0000 7f32f7fff640 1 -- 172.21.15.37:0/381145918 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247074 (secure 0 0 0) 0x7f3310069b00 con 0x7f32fc0764a0 2024-05-10T08:49:29.654 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:49:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32fc0764a0 msgr2=0x7f32fc078960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32fc0764a0 0x7f32fc078960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3300032000 tx=0x7f330002e000 comp rx=0 tx=0).stop 2024-05-10T08:49:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33101f8f50 msgr2=0x7f331006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33101f8f50 0x7f331006d4b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f33100b14d0 tx=0x7f3308009f90 comp rx=0 tx=0).stop 2024-05-10T08:49:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 shutdown_connections 2024-05-10T08:49:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f32fc0764a0 0x7f32fc078960 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33101f8f50 0x7f331006d4b0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33101f8590 0x7f33101f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 --2- 172.21.15.37:0/381145918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32f80039e0 0x7f33101593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 >> 172.21.15.37:0/381145918 conn(0x7f331009ba40 msgr2=0x7f33100b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 shutdown_connections 2024-05-10T08:49:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.656+0000 7f3315c54640 1 -- 172.21.15.37:0/381145918 wait complete. 2024-05-10T08:49:29.666 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-10T08:49:29.460175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261776,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712944,"statfs":{"total":773094113280,"available":772826054656,"internally_reserved":0,"allocated":12607488,"data_stored":6480068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.872833"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595077+0000","last_change":"2024-05-10T08:49:24.595077+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595077+0000","last_undegraded":"2024-05-10T08:49:24.595077+0000","last_fullsized":"2024-05-10T08:49:24.595077+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596786+0000","last_change":"2024-05-10T08:49:24.596786+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596786+0000","last_undegraded":"2024-05-10T08:49:24.596786+0000","last_fullsized":"2024-05-10T08:49:24.596786+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596709+0000","last_change":"2024-05-10T08:49:24.596709+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596709+0000","last_undegraded":"2024-05-10T08:49:24.596709+0000","last_fullsized":"2024-05-10T08:49:24.596709+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600049+0000","last_change":"2024-05-10T08:49:24.600049+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600049+0000","last_undegraded":"2024-05-10T08:49:24.600049+0000","last_fullsized":"2024-05-10T08:49:24.600049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596062+0000","last_change":"2024-05-10T08:49:24.596062+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596062+0000","last_undegraded":"2024-05-10T08:49:24.596062+0000","last_fullsized":"2024-05-10T08:49:24.596062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602787+0000","last_change":"2024-05-10T08:49:24.602787+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602787+0000","last_undegraded":"2024-05-10T08:49:24.602787+0000","last_fullsized":"2024-05-10T08:49:24.602787+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604367+0000","last_change":"2024-05-10T08:49:24.604367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604367+0000","last_undegraded":"2024-05-10T08:49:24.604367+0000","last_fullsized":"2024-05-10T08:49:24.604367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.594672+0000","last_change":"2024-05-10T08:49:24.594672+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.594672+0000","last_undegraded":"2024-05-10T08:49:24.594672+0000","last_fullsized":"2024-05-10T08:49:24.594672+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601376+0000","last_change":"2024-05-10T08:49:24.601376+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601376+0000","last_undegraded":"2024-05-10T08:49:24.601376+0000","last_fullsized":"2024-05-10T08:49:24.601376+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600807+0000","last_change":"2024-05-10T08:49:24.600807+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600807+0000","last_undegraded":"2024-05-10T08:49:24.600807+0000","last_fullsized":"2024-05-10T08:49:24.600807+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595613+0000","last_change":"2024-05-10T08:49:24.595613+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595613+0000","last_undegraded":"2024-05-10T08:49:24.595613+0000","last_fullsized":"2024-05-10T08:49:24.595613+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605569+0000","last_change":"2024-05-10T08:49:24.605569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605569+0000","last_undegraded":"2024-05-10T08:49:24.605569+0000","last_fullsized":"2024-05-10T08:49:24.605569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600333+0000","last_change":"2024-05-10T08:49:24.600333+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600333+0000","last_undegraded":"2024-05-10T08:49:24.600333+0000","last_fullsized":"2024-05-10T08:49:24.600333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597790+0000","last_change":"2024-05-10T08:49:24.597790+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597790+0000","last_undegraded":"2024-05-10T08:49:24.597790+0000","last_fullsized":"2024-05-10T08:49:24.597790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596397+0000","last_change":"2024-05-10T08:49:24.596397+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596397+0000","last_undegraded":"2024-05-10T08:49:24.596397+0000","last_fullsized":"2024-05-10T08:49:24.596397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605222+0000","last_change":"2024-05-10T08:49:24.605222+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605222+0000","last_undegraded":"2024-05-10T08:49:24.605222+0000","last_fullsized":"2024-05-10T08:49:24.605222+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599847+0000","last_change":"2024-05-10T08:49:24.599847+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599847+0000","last_undegraded":"2024-05-10T08:49:24.599847+0000","last_fullsized":"2024-05-10T08:49:24.599847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596292+0000","last_change":"2024-05-10T08:49:24.596292+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596292+0000","last_undegraded":"2024-05-10T08:49:24.596292+0000","last_fullsized":"2024-05-10T08:49:24.596292+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598770+0000","last_change":"2024-05-10T08:49:24.598770+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598770+0000","last_undegraded":"2024-05-10T08:49:24.598770+0000","last_fullsized":"2024-05-10T08:49:24.598770+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599557+0000","last_change":"2024-05-10T08:49:24.599557+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599557+0000","last_undegraded":"2024-05-10T08:49:24.599557+0000","last_fullsized":"2024-05-10T08:49:24.599557+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601137+0000","last_change":"2024-05-10T08:49:24.601137+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601137+0000","last_undegraded":"2024-05-10T08:49:24.601137+0000","last_fullsized":"2024-05-10T08:49:24.601137+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595006+0000","last_change":"2024-05-10T08:49:24.595006+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595006+0000","last_undegraded":"2024-05-10T08:49:24.595006+0000","last_fullsized":"2024-05-10T08:49:24.595006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599858+0000","last_change":"2024-05-10T08:49:24.599858+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599858+0000","last_undegraded":"2024-05-10T08:49:24.599858+0000","last_fullsized":"2024-05-10T08:49:24.599858+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600044+0000","last_change":"2024-05-10T08:49:24.600044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600044+0000","last_undegraded":"2024-05-10T08:49:24.600044+0000","last_fullsized":"2024-05-10T08:49:24.600044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601886+0000","last_change":"2024-05-10T08:49:24.601886+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601886+0000","last_undegraded":"2024-05-10T08:49:24.601886+0000","last_fullsized":"2024-05-10T08:49:24.601886+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600569+0000","last_change":"2024-05-10T08:49:24.600569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600569+0000","last_undegraded":"2024-05-10T08:49:24.600569+0000","last_fullsized":"2024-05-10T08:49:24.600569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598326+0000","last_change":"2024-05-10T08:49:24.598326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598326+0000","last_undegraded":"2024-05-10T08:49:24.598326+0000","last_fullsized":"2024-05-10T08:49:24.598326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605130+0000","last_change":"2024-05-10T08:49:24.605130+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605130+0000","last_undegraded":"2024-05-10T08:49:24.605130+0000","last_fullsized":"2024-05-10T08:49:24.605130+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599499+0000","last_change":"2024-05-10T08:49:24.599499+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599499+0000","last_undegraded":"2024-05-10T08:49:24.599499+0000","last_fullsized":"2024-05-10T08:49:24.599499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597368+0000","last_change":"2024-05-10T08:49:24.597368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597368+0000","last_undegraded":"2024-05-10T08:49:24.597368+0000","last_fullsized":"2024-05-10T08:49:24.597368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599992+0000","last_change":"2024-05-10T08:49:24.599992+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599992+0000","last_undegraded":"2024-05-10T08:49:24.599992+0000","last_fullsized":"2024-05-10T08:49:24.599992+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599370+0000","last_change":"2024-05-10T08:49:24.599370+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599370+0000","last_undegraded":"2024-05-10T08:49:24.599370+0000","last_fullsized":"2024-05-10T08:49:24.599370+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599355+0000","last_change":"2024-05-10T08:49:24.599355+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599355+0000","last_undegraded":"2024-05-10T08:49:24.599355+0000","last_fullsized":"2024-05-10T08:49:24.599355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.607022+0000","last_change":"2024-05-10T08:49:24.605641+0000","last_active":"2024-05-10T08:49:24.607022+0000","last_peered":"2024-05-10T08:49:24.607022+0000","last_clean":"2024-05-10T08:49:24.607022+0000","last_became_active":"2024-05-10T08:49:24.605358+0000","last_became_peered":"2024-05-10T08:49:24.605358+0000","last_unstale":"2024-05-10T08:49:24.607022+0000","last_undegraded":"2024-05-10T08:49:24.607022+0000","last_fullsized":"2024-05-10T08:49:24.607022+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.603434+0000","last_change":"2024-05-10T08:49:24.603434+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.603434+0000","last_undegraded":"2024-05-10T08:49:24.603434+0000","last_fullsized":"2024-05-10T08:49:24.603434+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614220+0000","last_change":"2024-05-10T08:49:24.604270+0000","last_active":"2024-05-10T08:49:24.614220+0000","last_peered":"2024-05-10T08:49:24.614220+0000","last_clean":"2024-05-10T08:49:24.614220+0000","last_became_active":"2024-05-10T08:49:24.603998+0000","last_became_peered":"2024-05-10T08:49:24.603998+0000","last_unstale":"2024-05-10T08:49:24.614220+0000","last_undegraded":"2024-05-10T08:49:24.614220+0000","last_fullsized":"2024-05-10T08:49:24.614220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600688+0000","last_change":"2024-05-10T08:49:24.600688+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600688+0000","last_undegraded":"2024-05-10T08:49:24.600688+0000","last_fullsized":"2024-05-10T08:49:24.600688+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616768+0000","last_change":"2024-05-10T08:49:24.615247+0000","last_active":"2024-05-10T08:49:24.616768+0000","last_peered":"2024-05-10T08:49:24.616768+0000","last_clean":"2024-05-10T08:49:24.616768+0000","last_became_active":"2024-05-10T08:49:24.614956+0000","last_became_peered":"2024-05-10T08:49:24.614956+0000","last_unstale":"2024-05-10T08:49:24.616768+0000","last_undegraded":"2024-05-10T08:49:24.616768+0000","last_fullsized":"2024-05-10T08:49:24.616768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600948+0000","last_change":"2024-05-10T08:49:24.600948+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600948+0000","last_undegraded":"2024-05-10T08:49:24.600948+0000","last_fullsized":"2024-05-10T08:49:24.600948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614099+0000","last_change":"2024-05-10T08:49:24.605015+0000","last_active":"2024-05-10T08:49:24.614099+0000","last_peered":"2024-05-10T08:49:24.614099+0000","last_clean":"2024-05-10T08:49:24.614099+0000","last_became_active":"2024-05-10T08:49:24.604737+0000","last_became_peered":"2024-05-10T08:49:24.604737+0000","last_unstale":"2024-05-10T08:49:24.614099+0000","last_undegraded":"2024-05-10T08:49:24.614099+0000","last_fullsized":"2024-05-10T08:49:24.614099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598862+0000","last_change":"2024-05-10T08:49:24.598862+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598862+0000","last_undegraded":"2024-05-10T08:49:24.598862+0000","last_fullsized":"2024-05-10T08:49:24.598862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605913+0000","last_change":"2024-05-10T08:49:24.603241+0000","last_active":"2024-05-10T08:49:24.605913+0000","last_peered":"2024-05-10T08:49:24.605913+0000","last_clean":"2024-05-10T08:49:24.605913+0000","last_became_active":"2024-05-10T08:49:24.602715+0000","last_became_peered":"2024-05-10T08:49:24.602715+0000","last_unstale":"2024-05-10T08:49:24.605913+0000","last_undegraded":"2024-05-10T08:49:24.605913+0000","last_fullsized":"2024-05-10T08:49:24.605913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:38.914133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595047+0000","last_change":"2024-05-10T08:49:24.595047+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595047+0000","last_undegraded":"2024-05-10T08:49:24.595047+0000","last_fullsized":"2024-05-10T08:49:24.595047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614631+0000","last_change":"2024-05-10T08:49:24.611527+0000","last_active":"2024-05-10T08:49:24.614631+0000","last_peered":"2024-05-10T08:49:24.614631+0000","last_clean":"2024-05-10T08:49:24.614631+0000","last_became_active":"2024-05-10T08:49:24.611240+0000","last_became_peered":"2024-05-10T08:49:24.611240+0000","last_unstale":"2024-05-10T08:49:24.614631+0000","last_undegraded":"2024-05-10T08:49:24.614631+0000","last_fullsized":"2024-05-10T08:49:24.614631+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:55.542337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596921+0000","last_change":"2024-05-10T08:49:24.596921+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596921+0000","last_undegraded":"2024-05-10T08:49:24.596921+0000","last_fullsized":"2024-05-10T08:49:24.596921+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608849+0000","last_change":"2024-05-10T08:49:24.607869+0000","last_active":"2024-05-10T08:49:24.608849+0000","last_peered":"2024-05-10T08:49:24.608849+0000","last_clean":"2024-05-10T08:49:24.608849+0000","last_became_active":"2024-05-10T08:49:24.607585+0000","last_became_peered":"2024-05-10T08:49:24.607585+0000","last_unstale":"2024-05-10T08:49:24.608849+0000","last_undegraded":"2024-05-10T08:49:24.608849+0000","last_fullsized":"2024-05-10T08:49:24.608849+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:19.236787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599587+0000","last_change":"2024-05-10T08:49:24.599587+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599587+0000","last_undegraded":"2024-05-10T08:49:24.599587+0000","last_fullsized":"2024-05-10T08:49:24.599587+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619683+0000","last_change":"2024-05-10T08:49:24.616592+0000","last_active":"2024-05-10T08:49:24.619683+0000","last_peered":"2024-05-10T08:49:24.619683+0000","last_clean":"2024-05-10T08:49:24.619683+0000","last_became_active":"2024-05-10T08:49:24.616144+0000","last_became_peered":"2024-05-10T08:49:24.616144+0000","last_unstale":"2024-05-10T08:49:24.619683+0000","last_undegraded":"2024-05-10T08:49:24.619683+0000","last_fullsized":"2024-05-10T08:49:24.619683+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:08.054238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598368+0000","last_change":"2024-05-10T08:49:24.598368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598368+0000","last_undegraded":"2024-05-10T08:49:24.598368+0000","last_fullsized":"2024-05-10T08:49:24.598368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614937+0000","last_change":"2024-05-10T08:49:24.614099+0000","last_active":"2024-05-10T08:49:24.614937+0000","last_peered":"2024-05-10T08:49:24.614937+0000","last_clean":"2024-05-10T08:49:24.614937+0000","last_became_active":"2024-05-10T08:49:24.613780+0000","last_became_peered":"2024-05-10T08:49:24.613780+0000","last_unstale":"2024-05-10T08:49:24.614937+0000","last_undegraded":"2024-05-10T08:49:24.614937+0000","last_fullsized":"2024-05-10T08:49:24.614937+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600801+0000","last_change":"2024-05-10T08:49:24.600801+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600801+0000","last_undegraded":"2024-05-10T08:49:24.600801+0000","last_fullsized":"2024-05-10T08:49:24.600801+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.610588+0000","last_change":"2024-05-10T08:49:24.608713+0000","last_active":"2024-05-10T08:49:24.610588+0000","last_peered":"2024-05-10T08:49:24.610588+0000","last_clean":"2024-05-10T08:49:24.610588+0000","last_became_active":"2024-05-10T08:49:24.608441+0000","last_became_peered":"2024-05-10T08:49:24.608441+0000","last_unstale":"2024-05-10T08:49:24.610588+0000","last_undegraded":"2024-05-10T08:49:24.610588+0000","last_fullsized":"2024-05-10T08:49:24.610588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:29.670353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595073+0000","last_change":"2024-05-10T08:49:24.595073+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595073+0000","last_undegraded":"2024-05-10T08:49:24.595073+0000","last_fullsized":"2024-05-10T08:49:24.595073+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614415+0000","last_change":"2024-05-10T08:49:24.612764+0000","last_active":"2024-05-10T08:49:24.614415+0000","last_peered":"2024-05-10T08:49:24.614415+0000","last_clean":"2024-05-10T08:49:24.614415+0000","last_became_active":"2024-05-10T08:49:24.612363+0000","last_became_peered":"2024-05-10T08:49:24.612363+0000","last_unstale":"2024-05-10T08:49:24.614415+0000","last_undegraded":"2024-05-10T08:49:24.614415+0000","last_fullsized":"2024-05-10T08:49:24.614415+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:21.634515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601493+0000","last_change":"2024-05-10T08:49:24.601493+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601493+0000","last_undegraded":"2024-05-10T08:49:24.601493+0000","last_fullsized":"2024-05-10T08:49:24.601493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.606216+0000","last_change":"2024-05-10T08:49:24.602612+0000","last_active":"2024-05-10T08:49:24.606216+0000","last_peered":"2024-05-10T08:49:24.606216+0000","last_clean":"2024-05-10T08:49:24.606216+0000","last_became_active":"2024-05-10T08:49:24.602252+0000","last_became_peered":"2024-05-10T08:49:24.602252+0000","last_unstale":"2024-05-10T08:49:24.606216+0000","last_undegraded":"2024-05-10T08:49:24.606216+0000","last_fullsized":"2024-05-10T08:49:24.606216+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:59.078558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597711+0000","last_change":"2024-05-10T08:49:24.597711+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597711+0000","last_undegraded":"2024-05-10T08:49:24.597711+0000","last_fullsized":"2024-05-10T08:49:24.597711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608495+0000","last_change":"2024-05-10T08:49:24.607083+0000","last_active":"2024-05-10T08:49:24.608495+0000","last_peered":"2024-05-10T08:49:24.608495+0000","last_clean":"2024-05-10T08:49:24.608495+0000","last_became_active":"2024-05-10T08:49:24.606742+0000","last_became_peered":"2024-05-10T08:49:24.606742+0000","last_unstale":"2024-05-10T08:49:24.608495+0000","last_undegraded":"2024-05-10T08:49:24.608495+0000","last_fullsized":"2024-05-10T08:49:24.608495+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:58.863821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598628+0000","last_change":"2024-05-10T08:49:24.598628+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598628+0000","last_undegraded":"2024-05-10T08:49:24.598628+0000","last_fullsized":"2024-05-10T08:49:24.598628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612086+0000","last_change":"2024-05-10T08:49:24.607947+0000","last_active":"2024-05-10T08:49:24.612086+0000","last_peered":"2024-05-10T08:49:24.612086+0000","last_clean":"2024-05-10T08:49:24.612086+0000","last_became_active":"2024-05-10T08:49:24.606257+0000","last_became_peered":"2024-05-10T08:49:24.606257+0000","last_unstale":"2024-05-10T08:49:24.612086+0000","last_undegraded":"2024-05-10T08:49:24.612086+0000","last_fullsized":"2024-05-10T08:49:24.612086+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:47.247345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598086+0000","last_change":"2024-05-10T08:49:24.598086+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598086+0000","last_undegraded":"2024-05-10T08:49:24.598086+0000","last_fullsized":"2024-05-10T08:49:24.598086+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605220+0000","last_change":"2024-05-10T08:49:24.601162+0000","last_active":"2024-05-10T08:49:24.605220+0000","last_peered":"2024-05-10T08:49:24.605220+0000","last_clean":"2024-05-10T08:49:24.605220+0000","last_became_active":"2024-05-10T08:49:24.600846+0000","last_became_peered":"2024-05-10T08:49:24.600846+0000","last_unstale":"2024-05-10T08:49:24.605220+0000","last_undegraded":"2024-05-10T08:49:24.605220+0000","last_fullsized":"2024-05-10T08:49:24.605220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:16.315391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599451+0000","last_change":"2024-05-10T08:49:24.599451+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599451+0000","last_undegraded":"2024-05-10T08:49:24.599451+0000","last_fullsized":"2024-05-10T08:49:24.599451+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619016+0000","last_change":"2024-05-10T08:49:24.615565+0000","last_active":"2024-05-10T08:49:24.619016+0000","last_peered":"2024-05-10T08:49:24.619016+0000","last_clean":"2024-05-10T08:49:24.619016+0000","last_became_active":"2024-05-10T08:49:24.615280+0000","last_became_peered":"2024-05-10T08:49:24.615280+0000","last_unstale":"2024-05-10T08:49:24.619016+0000","last_undegraded":"2024-05-10T08:49:24.619016+0000","last_fullsized":"2024-05-10T08:49:24.619016+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595074+0000","last_change":"2024-05-10T08:49:24.595074+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595074+0000","last_undegraded":"2024-05-10T08:49:24.595074+0000","last_fullsized":"2024-05-10T08:49:24.595074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616317+0000","last_change":"2024-05-10T08:49:24.613433+0000","last_active":"2024-05-10T08:49:24.616317+0000","last_peered":"2024-05-10T08:49:24.616317+0000","last_clean":"2024-05-10T08:49:24.616317+0000","last_became_active":"2024-05-10T08:49:24.613090+0000","last_became_peered":"2024-05-10T08:49:24.613090+0000","last_unstale":"2024-05-10T08:49:24.616317+0000","last_undegraded":"2024-05-10T08:49:24.616317+0000","last_fullsized":"2024-05-10T08:49:24.616317+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:35:50.740398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604327+0000","last_change":"2024-05-10T08:49:24.604327+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604327+0000","last_undegraded":"2024-05-10T08:49:24.604327+0000","last_fullsized":"2024-05-10T08:49:24.604327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612170+0000","last_change":"2024-05-10T08:49:24.610562+0000","last_active":"2024-05-10T08:49:24.612170+0000","last_peered":"2024-05-10T08:49:24.612170+0000","last_clean":"2024-05-10T08:49:24.612170+0000","last_became_active":"2024-05-10T08:49:24.610152+0000","last_became_peered":"2024-05-10T08:49:24.610152+0000","last_unstale":"2024-05-10T08:49:24.612170+0000","last_undegraded":"2024-05-10T08:49:24.612170+0000","last_fullsized":"2024-05-10T08:49:24.612170+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600889+0000","last_change":"2024-05-10T08:49:24.600889+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600889+0000","last_undegraded":"2024-05-10T08:49:24.600889+0000","last_fullsized":"2024-05-10T08:49:24.600889+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616795+0000","last_change":"2024-05-10T08:49:24.615638+0000","last_active":"2024-05-10T08:49:24.616795+0000","last_peered":"2024-05-10T08:49:24.616795+0000","last_clean":"2024-05-10T08:49:24.616795+0000","last_became_active":"2024-05-10T08:49:24.615399+0000","last_became_peered":"2024-05-10T08:49:24.615399+0000","last_unstale":"2024-05-10T08:49:24.616795+0000","last_undegraded":"2024-05-10T08:49:24.616795+0000","last_fullsized":"2024-05-10T08:49:24.616795+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604768+0000","last_change":"2024-05-10T08:49:24.604768+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604768+0000","last_undegraded":"2024-05-10T08:49:24.604768+0000","last_fullsized":"2024-05-10T08:49:24.604768+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619031+0000","last_change":"2024-05-10T08:49:24.612901+0000","last_active":"2024-05-10T08:49:24.619031+0000","last_peered":"2024-05-10T08:49:24.619031+0000","last_clean":"2024-05-10T08:49:24.619031+0000","last_became_active":"2024-05-10T08:49:24.612581+0000","last_became_peered":"2024-05-10T08:49:24.612581+0000","last_unstale":"2024-05-10T08:49:24.619031+0000","last_undegraded":"2024-05-10T08:49:24.619031+0000","last_fullsized":"2024-05-10T08:49:24.619031+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:29.603142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597260+0000","last_change":"2024-05-10T08:49:24.597260+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597260+0000","last_undegraded":"2024-05-10T08:49:24.597260+0000","last_fullsized":"2024-05-10T08:49:24.597260+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611462+0000","last_change":"2024-05-10T08:49:24.609174+0000","last_active":"2024-05-10T08:49:24.611462+0000","last_peered":"2024-05-10T08:49:24.611462+0000","last_clean":"2024-05-10T08:49:24.611462+0000","last_became_active":"2024-05-10T08:49:24.608853+0000","last_became_peered":"2024-05-10T08:49:24.608853+0000","last_unstale":"2024-05-10T08:49:24.611462+0000","last_undegraded":"2024-05-10T08:49:24.611462+0000","last_fullsized":"2024-05-10T08:49:24.611462+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596476+0000","last_change":"2024-05-10T08:49:24.596476+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596476+0000","last_undegraded":"2024-05-10T08:49:24.596476+0000","last_fullsized":"2024-05-10T08:49:24.596476+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619255+0000","last_change":"2024-05-10T08:49:24.613705+0000","last_active":"2024-05-10T08:49:24.619255+0000","last_peered":"2024-05-10T08:49:24.619255+0000","last_clean":"2024-05-10T08:49:24.619255+0000","last_became_active":"2024-05-10T08:49:24.613437+0000","last_became_peered":"2024-05-10T08:49:24.613437+0000","last_unstale":"2024-05-10T08:49:24.619255+0000","last_undegraded":"2024-05-10T08:49:24.619255+0000","last_fullsized":"2024-05-10T08:49:24.619255+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:54.519083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599831+0000","last_change":"2024-05-10T08:49:24.599831+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599831+0000","last_undegraded":"2024-05-10T08:49:24.599831+0000","last_fullsized":"2024-05-10T08:49:24.599831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615852+0000","last_change":"2024-05-10T08:49:24.614766+0000","last_active":"2024-05-10T08:49:24.615852+0000","last_peered":"2024-05-10T08:49:24.615852+0000","last_clean":"2024-05-10T08:49:24.615852+0000","last_became_active":"2024-05-10T08:49:24.614473+0000","last_became_peered":"2024-05-10T08:49:24.614473+0000","last_unstale":"2024-05-10T08:49:24.615852+0000","last_undegraded":"2024-05-10T08:49:24.615852+0000","last_fullsized":"2024-05-10T08:49:24.615852+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602326+0000","last_change":"2024-05-10T08:49:24.602326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602326+0000","last_undegraded":"2024-05-10T08:49:24.602326+0000","last_fullsized":"2024-05-10T08:49:24.602326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.618963+0000","last_change":"2024-05-10T08:49:24.612126+0000","last_active":"2024-05-10T08:49:24.618963+0000","last_peered":"2024-05-10T08:49:24.618963+0000","last_clean":"2024-05-10T08:49:24.618963+0000","last_became_active":"2024-05-10T08:49:24.611698+0000","last_became_peered":"2024-05-10T08:49:24.611698+0000","last_unstale":"2024-05-10T08:49:24.618963+0000","last_undegraded":"2024-05-10T08:49:24.618963+0000","last_fullsized":"2024-05-10T08:49:24.618963+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:59.540500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598128+0000","last_change":"2024-05-10T08:49:24.598128+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598128+0000","last_undegraded":"2024-05-10T08:49:24.598128+0000","last_fullsized":"2024-05-10T08:49:24.598128+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615041+0000","last_change":"2024-05-10T08:49:24.614157+0000","last_active":"2024-05-10T08:49:24.615041+0000","last_peered":"2024-05-10T08:49:24.615041+0000","last_clean":"2024-05-10T08:49:24.615041+0000","last_became_active":"2024-05-10T08:49:24.613727+0000","last_became_peered":"2024-05-10T08:49:24.613727+0000","last_unstale":"2024-05-10T08:49:24.615041+0000","last_undegraded":"2024-05-10T08:49:24.615041+0000","last_fullsized":"2024-05-10T08:49:24.615041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598271+0000","last_change":"2024-05-10T08:49:24.598271+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598271+0000","last_undegraded":"2024-05-10T08:49:24.598271+0000","last_fullsized":"2024-05-10T08:49:24.598271+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613193+0000","last_change":"2024-05-10T08:49:24.611676+0000","last_active":"2024-05-10T08:49:24.613193+0000","last_peered":"2024-05-10T08:49:24.613193+0000","last_clean":"2024-05-10T08:49:24.613193+0000","last_became_active":"2024-05-10T08:49:24.611373+0000","last_became_peered":"2024-05-10T08:49:24.611373+0000","last_unstale":"2024-05-10T08:49:24.613193+0000","last_undegraded":"2024-05-10T08:49:24.613193+0000","last_fullsized":"2024-05-10T08:49:24.613193+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599090+0000","last_change":"2024-05-10T08:49:24.599090+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599090+0000","last_undegraded":"2024-05-10T08:49:24.599090+0000","last_fullsized":"2024-05-10T08:49:24.599090+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619626+0000","last_change":"2024-05-10T08:49:24.615827+0000","last_active":"2024-05-10T08:49:24.619626+0000","last_peered":"2024-05-10T08:49:24.619626+0000","last_clean":"2024-05-10T08:49:24.619626+0000","last_became_active":"2024-05-10T08:49:24.615518+0000","last_became_peered":"2024-05-10T08:49:24.615518+0000","last_unstale":"2024-05-10T08:49:24.619626+0000","last_undegraded":"2024-05-10T08:49:24.619626+0000","last_fullsized":"2024-05-10T08:49:24.619626+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:18:28.973442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604300+0000","last_change":"2024-05-10T08:49:24.604300+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604300+0000","last_undegraded":"2024-05-10T08:49:24.604300+0000","last_fullsized":"2024-05-10T08:49:24.604300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608142+0000","last_change":"2024-05-10T08:49:24.606919+0000","last_active":"2024-05-10T08:49:24.608142+0000","last_peered":"2024-05-10T08:49:24.608142+0000","last_clean":"2024-05-10T08:49:24.608142+0000","last_became_active":"2024-05-10T08:49:24.606647+0000","last_became_peered":"2024-05-10T08:49:24.606647+0000","last_unstale":"2024-05-10T08:49:24.608142+0000","last_undegraded":"2024-05-10T08:49:24.608142+0000","last_fullsized":"2024-05-10T08:49:24.608142+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:30.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595044+0000","last_change":"2024-05-10T08:49:24.595044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595044+0000","last_undegraded":"2024-05-10T08:49:24.595044+0000","last_fullsized":"2024-05-10T08:49:24.595044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608188+0000","last_change":"2024-05-10T08:49:24.605573+0000","last_active":"2024-05-10T08:49:24.608188+0000","last_peered":"2024-05-10T08:49:24.608188+0000","last_clean":"2024-05-10T08:49:24.608188+0000","last_became_active":"2024-05-10T08:49:24.605298+0000","last_became_peered":"2024-05-10T08:49:24.605298+0000","last_unstale":"2024-05-10T08:49:24.608188+0000","last_undegraded":"2024-05-10T08:49:24.608188+0000","last_fullsized":"2024-05-10T08:49:24.608188+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:31.211848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598367+0000","last_change":"2024-05-10T08:49:24.598367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598367+0000","last_undegraded":"2024-05-10T08:49:24.598367+0000","last_fullsized":"2024-05-10T08:49:24.598367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619704+0000","last_change":"2024-05-10T08:49:24.616821+0000","last_active":"2024-05-10T08:49:24.619704+0000","last_peered":"2024-05-10T08:49:24.619704+0000","last_clean":"2024-05-10T08:49:24.619704+0000","last_became_active":"2024-05-10T08:49:24.616451+0000","last_became_peered":"2024-05-10T08:49:24.616451+0000","last_unstale":"2024-05-10T08:49:24.619704+0000","last_undegraded":"2024-05-10T08:49:24.619704+0000","last_fullsized":"2024-05-10T08:49:24.619704+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:32.831419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597883+0000","last_change":"2024-05-10T08:49:24.597883+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597883+0000","last_undegraded":"2024-05-10T08:49:24.597883+0000","last_fullsized":"2024-05-10T08:49:24.597883+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611520+0000","last_change":"2024-05-10T08:49:24.609428+0000","last_active":"2024-05-10T08:49:24.611520+0000","last_peered":"2024-05-10T08:49:24.611520+0000","last_clean":"2024-05-10T08:49:24.611520+0000","last_became_active":"2024-05-10T08:49:24.609148+0000","last_became_peered":"2024-05-10T08:49:24.609148+0000","last_unstale":"2024-05-10T08:49:24.611520+0000","last_undegraded":"2024-05-10T08:49:24.611520+0000","last_fullsized":"2024-05-10T08:49:24.611520+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600696+0000","last_change":"2024-05-10T08:49:24.600696+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600696+0000","last_undegraded":"2024-05-10T08:49:24.600696+0000","last_fullsized":"2024-05-10T08:49:24.600696+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613910+0000","last_change":"2024-05-10T08:49:24.608777+0000","last_active":"2024-05-10T08:49:24.613910+0000","last_peered":"2024-05-10T08:49:24.613910+0000","last_clean":"2024-05-10T08:49:24.613910+0000","last_became_active":"2024-05-10T08:49:24.608491+0000","last_became_peered":"2024-05-10T08:49:24.608491+0000","last_unstale":"2024-05-10T08:49:24.613910+0000","last_undegraded":"2024-05-10T08:49:24.613910+0000","last_fullsized":"2024-05-10T08:49:24.613910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:58.506187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":288,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.602081+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:49:24.602081+0000","last_peered":"2024-05-10T08:49:24.602081+0000","last_clean":"2024-05-10T08:49:24.602081+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:49:24.602081+0000","last_undegraded":"2024-05-10T08:49:24.602081+0000","last_fullsized":"2024-05-10T08:49:24.602081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33148,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338692,"statfs":{"total":96636764160,"available":96602820608,"internally_reserved":0,"allocated":2015232,"data_stored":1249451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2027520,"data_stored":1256118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:49:29.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:49:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.811+0000 7f1ee615f640 1 Processor -- start 2024-05-10T08:49:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.811+0000 7f1ee615f640 1 -- start start 2024-05-10T08:49:29.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1ee615f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ee00d0590 0x7f1ee00ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1ee615f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ee00ce610 0x7f1ee00709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1ee615f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee00d15c0 con 0x7f1ee01606d0 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1ee615f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee00d18a0 con 0x7f1ee00d0590 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1ee615f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee00d1b80 con 0x7f1ee00ce610 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ee00d0590 0x7f1ee00ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ee00d0590 0x7f1ee00ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43524/0 (socket says 172.21.15.37:43524) 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edeffd640 1 -- 172.21.15.37:0/3688973720 learned_addr learned my addr 172.21.15.37:0/3688973720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edeffd640 1 -- 172.21.15.37:0/3688973720 >> v2:172.21.15.82:3300/0 conn(0x7f1ee00ce610 msgr2=0x7f1ee00709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edffff640 1 --2- 172.21.15.37:0/3688973720 >> v2:172.21.15.82:3300/0 conn(0x7f1ee00ce610 0x7f1ee00709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edeffd640 1 --2- 172.21.15.37:0/3688973720 >> v2:172.21.15.82:3300/0 conn(0x7f1ee00ce610 0x7f1ee00709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edeffd640 1 -- 172.21.15.37:0/3688973720 >> v1:172.21.15.82:6789/0 conn(0x7f1ee01606d0 legacy=0x7f1ee00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edeffd640 1 -- 172.21.15.37:0/3688973720 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee00704d0 con 0x7f1ee00d0590 2024-05-10T08:49:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.812+0000 7f1edffff640 1 --2- 172.21.15.37:0/3688973720 >> v2:172.21.15.82:3300/0 conn(0x7f1ee00ce610 0x7f1ee00709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.813+0000 7f1edeffd640 1 --2- 172.21.15.37:0/3688973720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00d0590 0x7f1ee00ce0d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00b8e20 tx=0x7f1ed402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea542df6cfe1431 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.813+0000 7f1ede7fc640 1 -- 172.21.15.37:0/3688973720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4037070 con 0x7f1ee00d0590 2024-05-10T08:49:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.813+0000 7f1ede7fc640 1 -- 172.21.15.37:0/3688973720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed402ae20 con 0x7f1ee00d0590 2024-05-10T08:49:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.813+0000 7f1ede7fc640 1 -- 172.21.15.37:0/3688973720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4032660 con 0x7f1ee00d0590 2024-05-10T08:49:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 -- 172.21.15.37:0/3688973720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00d0590 msgr2=0x7f1ee00ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 --2- 172.21.15.37:0/3688973720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00d0590 0x7f1ee00ce0d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00b8e20 tx=0x7f1ed402a110 comp rx=0 tx=0).stop 2024-05-10T08:49:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 -- 172.21.15.37:0/3688973720 shutdown_connections 2024-05-10T08:49:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 --2- 172.21.15.37:0/3688973720 >> v2:172.21.15.82:3300/0 conn(0x7f1ee00ce610 0x7f1ee00709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 --2- 172.21.15.37:0/3688973720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00d0590 0x7f1ee00ce0d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 -- 172.21.15.37:0/3688973720 >> 172.21.15.37:0/3688973720 conn(0x7f1ee00b49d0 msgr2=0x7f1ee00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 -- 172.21.15.37:0/3688973720 shutdown_connections 2024-05-10T08:49:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.814+0000 7f1ee615f640 1 -- 172.21.15.37:0/3688973720 wait complete. 2024-05-10T08:49:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.815+0000 7f1ee615f640 1 Processor -- start 2024-05-10T08:49:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.815+0000 7f1ee615f640 1 -- start start 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1ee615f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00ce610 0x7f1ee00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1ee615f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee00d0590 0x7f1ee00b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1ee615f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee01606d0 0x7f1ee00cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1ee615f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee00710b0 con 0x7f1ee00ce610 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1ee615f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee0070f30 con 0x7f1ee00d0590 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1ee615f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee0071230 con 0x7f1ee01606d0 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1edf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00ce610 0x7f1ee00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1edf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00ce610 0x7f1ee00c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43534/0 (socket says 172.21.15.37:43534) 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1edf7fe640 1 -- 172.21.15.37:0/482685001 learned_addr learned my addr 172.21.15.37:0/482685001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.816+0000 7f1edeffd640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee00d0590 0x7f1ee00b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edffff640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee01606d0 0x7f1ee00cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edf7fe640 1 -- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee01606d0 msgr2=0x7f1ee00cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edf7fe640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee01606d0 0x7f1ee00cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edf7fe640 1 -- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee00d0590 msgr2=0x7f1ee00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edf7fe640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee00d0590 0x7f1ee00b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edf7fe640 1 -- 172.21.15.37:0/482685001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee00b8310 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edeffd640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee00d0590 0x7f1ee00b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1edf7fe640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00ce610 0x7f1ee00c91d0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000b3f0 tx=0x7f1ed000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1ec7fff640 1 -- 172.21.15.37:0/482685001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0015020 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1ec7fff640 1 -- 172.21.15.37:0/482685001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed0011830 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee00c9710 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1ec7fff640 1 -- 172.21.15.37:0/482685001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0011c20 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.817+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee00b7550 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.818+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee00693f0 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.819+0000 7f1ec7fff640 1 -- 172.21.15.37:0/482685001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ed0018020 con 0x7f1ee00ce610 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.819+0000 7f1ec7fff640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1ecc076300 0x7f1ecc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.819+0000 7f1ec7fff640 1 -- 172.21.15.37:0/482685001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f1ed00975e0 con 0x7f1ee00ce610 2024-05-10T08:49:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.819+0000 7f1edeffd640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1ecc076300 0x7f1ecc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.820+0000 7f1edeffd640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1ecc076300 0x7f1ecc0787c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4034000 tx=0x7f1ed402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:29.823+0000 7f1ec7fff640 1 -- 172.21.15.37:0/482685001 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1ed001f020 con 0x7f1ee00ce610 2024-05-10T08:49:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.009+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ee0070b90 con 0x7f1ecc076300 2024-05-10T08:49:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.015+0000 7f1ec7fff640 1 -- 172.21.15.37:0/482685001 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247074 (secure 0 0 0) 0x7f1ed407e540 con 0x7f1ecc076300 2024-05-10T08:49:30.017 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1ecc076300 msgr2=0x7f1ecc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1ecc076300 0x7f1ecc0787c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4034000 tx=0x7f1ed402e000 comp rx=0 tx=0).stop 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00ce610 msgr2=0x7f1ee00c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00ce610 0x7f1ee00c91d0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000b3f0 tx=0x7f1ed000b8b0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 shutdown_connections 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1ecc076300 0x7f1ecc0787c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ee01606d0 0x7f1ee00cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ee00d0590 0x7f1ee00b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 --2- 172.21.15.37:0/482685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ee00ce610 0x7f1ee00c91d0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 >> 172.21.15.37:0/482685001 conn(0x7f1ee00b49d0 msgr2=0x7f1ee00cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.018+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 shutdown_connections 2024-05-10T08:49:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.019+0000 7f1ee615f640 1 -- 172.21.15.37:0/482685001 wait complete. 2024-05-10T08:49:30.028 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-10T08:49:29.460175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261776,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712944,"statfs":{"total":773094113280,"available":772826054656,"internally_reserved":0,"allocated":12607488,"data_stored":6480068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.872833"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595077+0000","last_change":"2024-05-10T08:49:24.595077+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595077+0000","last_undegraded":"2024-05-10T08:49:24.595077+0000","last_fullsized":"2024-05-10T08:49:24.595077+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596786+0000","last_change":"2024-05-10T08:49:24.596786+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596786+0000","last_undegraded":"2024-05-10T08:49:24.596786+0000","last_fullsized":"2024-05-10T08:49:24.596786+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596709+0000","last_change":"2024-05-10T08:49:24.596709+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596709+0000","last_undegraded":"2024-05-10T08:49:24.596709+0000","last_fullsized":"2024-05-10T08:49:24.596709+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600049+0000","last_change":"2024-05-10T08:49:24.600049+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600049+0000","last_undegraded":"2024-05-10T08:49:24.600049+0000","last_fullsized":"2024-05-10T08:49:24.600049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596062+0000","last_change":"2024-05-10T08:49:24.596062+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596062+0000","last_undegraded":"2024-05-10T08:49:24.596062+0000","last_fullsized":"2024-05-10T08:49:24.596062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602787+0000","last_change":"2024-05-10T08:49:24.602787+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602787+0000","last_undegraded":"2024-05-10T08:49:24.602787+0000","last_fullsized":"2024-05-10T08:49:24.602787+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604367+0000","last_change":"2024-05-10T08:49:24.604367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604367+0000","last_undegraded":"2024-05-10T08:49:24.604367+0000","last_fullsized":"2024-05-10T08:49:24.604367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.594672+0000","last_change":"2024-05-10T08:49:24.594672+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.594672+0000","last_undegraded":"2024-05-10T08:49:24.594672+0000","last_fullsized":"2024-05-10T08:49:24.594672+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601376+0000","last_change":"2024-05-10T08:49:24.601376+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601376+0000","last_undegraded":"2024-05-10T08:49:24.601376+0000","last_fullsized":"2024-05-10T08:49:24.601376+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600807+0000","last_change":"2024-05-10T08:49:24.600807+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600807+0000","last_undegraded":"2024-05-10T08:49:24.600807+0000","last_fullsized":"2024-05-10T08:49:24.600807+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595613+0000","last_change":"2024-05-10T08:49:24.595613+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595613+0000","last_undegraded":"2024-05-10T08:49:24.595613+0000","last_fullsized":"2024-05-10T08:49:24.595613+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605569+0000","last_change":"2024-05-10T08:49:24.605569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605569+0000","last_undegraded":"2024-05-10T08:49:24.605569+0000","last_fullsized":"2024-05-10T08:49:24.605569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600333+0000","last_change":"2024-05-10T08:49:24.600333+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600333+0000","last_undegraded":"2024-05-10T08:49:24.600333+0000","last_fullsized":"2024-05-10T08:49:24.600333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597790+0000","last_change":"2024-05-10T08:49:24.597790+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597790+0000","last_undegraded":"2024-05-10T08:49:24.597790+0000","last_fullsized":"2024-05-10T08:49:24.597790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596397+0000","last_change":"2024-05-10T08:49:24.596397+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596397+0000","last_undegraded":"2024-05-10T08:49:24.596397+0000","last_fullsized":"2024-05-10T08:49:24.596397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605222+0000","last_change":"2024-05-10T08:49:24.605222+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605222+0000","last_undegraded":"2024-05-10T08:49:24.605222+0000","last_fullsized":"2024-05-10T08:49:24.605222+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599847+0000","last_change":"2024-05-10T08:49:24.599847+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599847+0000","last_undegraded":"2024-05-10T08:49:24.599847+0000","last_fullsized":"2024-05-10T08:49:24.599847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596292+0000","last_change":"2024-05-10T08:49:24.596292+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596292+0000","last_undegraded":"2024-05-10T08:49:24.596292+0000","last_fullsized":"2024-05-10T08:49:24.596292+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598770+0000","last_change":"2024-05-10T08:49:24.598770+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598770+0000","last_undegraded":"2024-05-10T08:49:24.598770+0000","last_fullsized":"2024-05-10T08:49:24.598770+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599557+0000","last_change":"2024-05-10T08:49:24.599557+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599557+0000","last_undegraded":"2024-05-10T08:49:24.599557+0000","last_fullsized":"2024-05-10T08:49:24.599557+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601137+0000","last_change":"2024-05-10T08:49:24.601137+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601137+0000","last_undegraded":"2024-05-10T08:49:24.601137+0000","last_fullsized":"2024-05-10T08:49:24.601137+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595006+0000","last_change":"2024-05-10T08:49:24.595006+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595006+0000","last_undegraded":"2024-05-10T08:49:24.595006+0000","last_fullsized":"2024-05-10T08:49:24.595006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599858+0000","last_change":"2024-05-10T08:49:24.599858+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599858+0000","last_undegraded":"2024-05-10T08:49:24.599858+0000","last_fullsized":"2024-05-10T08:49:24.599858+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600044+0000","last_change":"2024-05-10T08:49:24.600044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600044+0000","last_undegraded":"2024-05-10T08:49:24.600044+0000","last_fullsized":"2024-05-10T08:49:24.600044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601886+0000","last_change":"2024-05-10T08:49:24.601886+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601886+0000","last_undegraded":"2024-05-10T08:49:24.601886+0000","last_fullsized":"2024-05-10T08:49:24.601886+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600569+0000","last_change":"2024-05-10T08:49:24.600569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600569+0000","last_undegraded":"2024-05-10T08:49:24.600569+0000","last_fullsized":"2024-05-10T08:49:24.600569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598326+0000","last_change":"2024-05-10T08:49:24.598326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598326+0000","last_undegraded":"2024-05-10T08:49:24.598326+0000","last_fullsized":"2024-05-10T08:49:24.598326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605130+0000","last_change":"2024-05-10T08:49:24.605130+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605130+0000","last_undegraded":"2024-05-10T08:49:24.605130+0000","last_fullsized":"2024-05-10T08:49:24.605130+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599499+0000","last_change":"2024-05-10T08:49:24.599499+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599499+0000","last_undegraded":"2024-05-10T08:49:24.599499+0000","last_fullsized":"2024-05-10T08:49:24.599499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597368+0000","last_change":"2024-05-10T08:49:24.597368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597368+0000","last_undegraded":"2024-05-10T08:49:24.597368+0000","last_fullsized":"2024-05-10T08:49:24.597368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599992+0000","last_change":"2024-05-10T08:49:24.599992+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599992+0000","last_undegraded":"2024-05-10T08:49:24.599992+0000","last_fullsized":"2024-05-10T08:49:24.599992+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599370+0000","last_change":"2024-05-10T08:49:24.599370+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599370+0000","last_undegraded":"2024-05-10T08:49:24.599370+0000","last_fullsized":"2024-05-10T08:49:24.599370+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599355+0000","last_change":"2024-05-10T08:49:24.599355+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599355+0000","last_undegraded":"2024-05-10T08:49:24.599355+0000","last_fullsized":"2024-05-10T08:49:24.599355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.607022+0000","last_change":"2024-05-10T08:49:24.605641+0000","last_active":"2024-05-10T08:49:24.607022+0000","last_peered":"2024-05-10T08:49:24.607022+0000","last_clean":"2024-05-10T08:49:24.607022+0000","last_became_active":"2024-05-10T08:49:24.605358+0000","last_became_peered":"2024-05-10T08:49:24.605358+0000","last_unstale":"2024-05-10T08:49:24.607022+0000","last_undegraded":"2024-05-10T08:49:24.607022+0000","last_fullsized":"2024-05-10T08:49:24.607022+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.603434+0000","last_change":"2024-05-10T08:49:24.603434+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.603434+0000","last_undegraded":"2024-05-10T08:49:24.603434+0000","last_fullsized":"2024-05-10T08:49:24.603434+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614220+0000","last_change":"2024-05-10T08:49:24.604270+0000","last_active":"2024-05-10T08:49:24.614220+0000","last_peered":"2024-05-10T08:49:24.614220+0000","last_clean":"2024-05-10T08:49:24.614220+0000","last_became_active":"2024-05-10T08:49:24.603998+0000","last_became_peered":"2024-05-10T08:49:24.603998+0000","last_unstale":"2024-05-10T08:49:24.614220+0000","last_undegraded":"2024-05-10T08:49:24.614220+0000","last_fullsized":"2024-05-10T08:49:24.614220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600688+0000","last_change":"2024-05-10T08:49:24.600688+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600688+0000","last_undegraded":"2024-05-10T08:49:24.600688+0000","last_fullsized":"2024-05-10T08:49:24.600688+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616768+0000","last_change":"2024-05-10T08:49:24.615247+0000","last_active":"2024-05-10T08:49:24.616768+0000","last_peered":"2024-05-10T08:49:24.616768+0000","last_clean":"2024-05-10T08:49:24.616768+0000","last_became_active":"2024-05-10T08:49:24.614956+0000","last_became_peered":"2024-05-10T08:49:24.614956+0000","last_unstale":"2024-05-10T08:49:24.616768+0000","last_undegraded":"2024-05-10T08:49:24.616768+0000","last_fullsized":"2024-05-10T08:49:24.616768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600948+0000","last_change":"2024-05-10T08:49:24.600948+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600948+0000","last_undegraded":"2024-05-10T08:49:24.600948+0000","last_fullsized":"2024-05-10T08:49:24.600948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614099+0000","last_change":"2024-05-10T08:49:24.605015+0000","last_active":"2024-05-10T08:49:24.614099+0000","last_peered":"2024-05-10T08:49:24.614099+0000","last_clean":"2024-05-10T08:49:24.614099+0000","last_became_active":"2024-05-10T08:49:24.604737+0000","last_became_peered":"2024-05-10T08:49:24.604737+0000","last_unstale":"2024-05-10T08:49:24.614099+0000","last_undegraded":"2024-05-10T08:49:24.614099+0000","last_fullsized":"2024-05-10T08:49:24.614099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598862+0000","last_change":"2024-05-10T08:49:24.598862+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598862+0000","last_undegraded":"2024-05-10T08:49:24.598862+0000","last_fullsized":"2024-05-10T08:49:24.598862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605913+0000","last_change":"2024-05-10T08:49:24.603241+0000","last_active":"2024-05-10T08:49:24.605913+0000","last_peered":"2024-05-10T08:49:24.605913+0000","last_clean":"2024-05-10T08:49:24.605913+0000","last_became_active":"2024-05-10T08:49:24.602715+0000","last_became_peered":"2024-05-10T08:49:24.602715+0000","last_unstale":"2024-05-10T08:49:24.605913+0000","last_undegraded":"2024-05-10T08:49:24.605913+0000","last_fullsized":"2024-05-10T08:49:24.605913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:38.914133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595047+0000","last_change":"2024-05-10T08:49:24.595047+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595047+0000","last_undegraded":"2024-05-10T08:49:24.595047+0000","last_fullsized":"2024-05-10T08:49:24.595047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614631+0000","last_change":"2024-05-10T08:49:24.611527+0000","last_active":"2024-05-10T08:49:24.614631+0000","last_peered":"2024-05-10T08:49:24.614631+0000","last_clean":"2024-05-10T08:49:24.614631+0000","last_became_active":"2024-05-10T08:49:24.611240+0000","last_became_peered":"2024-05-10T08:49:24.611240+0000","last_unstale":"2024-05-10T08:49:24.614631+0000","last_undegraded":"2024-05-10T08:49:24.614631+0000","last_fullsized":"2024-05-10T08:49:24.614631+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:55.542337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596921+0000","last_change":"2024-05-10T08:49:24.596921+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596921+0000","last_undegraded":"2024-05-10T08:49:24.596921+0000","last_fullsized":"2024-05-10T08:49:24.596921+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608849+0000","last_change":"2024-05-10T08:49:24.607869+0000","last_active":"2024-05-10T08:49:24.608849+0000","last_peered":"2024-05-10T08:49:24.608849+0000","last_clean":"2024-05-10T08:49:24.608849+0000","last_became_active":"2024-05-10T08:49:24.607585+0000","last_became_peered":"2024-05-10T08:49:24.607585+0000","last_unstale":"2024-05-10T08:49:24.608849+0000","last_undegraded":"2024-05-10T08:49:24.608849+0000","last_fullsized":"2024-05-10T08:49:24.608849+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:19.236787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599587+0000","last_change":"2024-05-10T08:49:24.599587+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599587+0000","last_undegraded":"2024-05-10T08:49:24.599587+0000","last_fullsized":"2024-05-10T08:49:24.599587+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619683+0000","last_change":"2024-05-10T08:49:24.616592+0000","last_active":"2024-05-10T08:49:24.619683+0000","last_peered":"2024-05-10T08:49:24.619683+0000","last_clean":"2024-05-10T08:49:24.619683+0000","last_became_active":"2024-05-10T08:49:24.616144+0000","last_became_peered":"2024-05-10T08:49:24.616144+0000","last_unstale":"2024-05-10T08:49:24.619683+0000","last_undegraded":"2024-05-10T08:49:24.619683+0000","last_fullsized":"2024-05-10T08:49:24.619683+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:08.054238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598368+0000","last_change":"2024-05-10T08:49:24.598368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598368+0000","last_undegraded":"2024-05-10T08:49:24.598368+0000","last_fullsized":"2024-05-10T08:49:24.598368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614937+0000","last_change":"2024-05-10T08:49:24.614099+0000","last_active":"2024-05-10T08:49:24.614937+0000","last_peered":"2024-05-10T08:49:24.614937+0000","last_clean":"2024-05-10T08:49:24.614937+0000","last_became_active":"2024-05-10T08:49:24.613780+0000","last_became_peered":"2024-05-10T08:49:24.613780+0000","last_unstale":"2024-05-10T08:49:24.614937+0000","last_undegraded":"2024-05-10T08:49:24.614937+0000","last_fullsized":"2024-05-10T08:49:24.614937+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600801+0000","last_change":"2024-05-10T08:49:24.600801+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600801+0000","last_undegraded":"2024-05-10T08:49:24.600801+0000","last_fullsized":"2024-05-10T08:49:24.600801+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.610588+0000","last_change":"2024-05-10T08:49:24.608713+0000","last_active":"2024-05-10T08:49:24.610588+0000","last_peered":"2024-05-10T08:49:24.610588+0000","last_clean":"2024-05-10T08:49:24.610588+0000","last_became_active":"2024-05-10T08:49:24.608441+0000","last_became_peered":"2024-05-10T08:49:24.608441+0000","last_unstale":"2024-05-10T08:49:24.610588+0000","last_undegraded":"2024-05-10T08:49:24.610588+0000","last_fullsized":"2024-05-10T08:49:24.610588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:29.670353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595073+0000","last_change":"2024-05-10T08:49:24.595073+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595073+0000","last_undegraded":"2024-05-10T08:49:24.595073+0000","last_fullsized":"2024-05-10T08:49:24.595073+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614415+0000","last_change":"2024-05-10T08:49:24.612764+0000","last_active":"2024-05-10T08:49:24.614415+0000","last_peered":"2024-05-10T08:49:24.614415+0000","last_clean":"2024-05-10T08:49:24.614415+0000","last_became_active":"2024-05-10T08:49:24.612363+0000","last_became_peered":"2024-05-10T08:49:24.612363+0000","last_unstale":"2024-05-10T08:49:24.614415+0000","last_undegraded":"2024-05-10T08:49:24.614415+0000","last_fullsized":"2024-05-10T08:49:24.614415+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:21.634515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601493+0000","last_change":"2024-05-10T08:49:24.601493+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601493+0000","last_undegraded":"2024-05-10T08:49:24.601493+0000","last_fullsized":"2024-05-10T08:49:24.601493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.606216+0000","last_change":"2024-05-10T08:49:24.602612+0000","last_active":"2024-05-10T08:49:24.606216+0000","last_peered":"2024-05-10T08:49:24.606216+0000","last_clean":"2024-05-10T08:49:24.606216+0000","last_became_active":"2024-05-10T08:49:24.602252+0000","last_became_peered":"2024-05-10T08:49:24.602252+0000","last_unstale":"2024-05-10T08:49:24.606216+0000","last_undegraded":"2024-05-10T08:49:24.606216+0000","last_fullsized":"2024-05-10T08:49:24.606216+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:59.078558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597711+0000","last_change":"2024-05-10T08:49:24.597711+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597711+0000","last_undegraded":"2024-05-10T08:49:24.597711+0000","last_fullsized":"2024-05-10T08:49:24.597711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608495+0000","last_change":"2024-05-10T08:49:24.607083+0000","last_active":"2024-05-10T08:49:24.608495+0000","last_peered":"2024-05-10T08:49:24.608495+0000","last_clean":"2024-05-10T08:49:24.608495+0000","last_became_active":"2024-05-10T08:49:24.606742+0000","last_became_peered":"2024-05-10T08:49:24.606742+0000","last_unstale":"2024-05-10T08:49:24.608495+0000","last_undegraded":"2024-05-10T08:49:24.608495+0000","last_fullsized":"2024-05-10T08:49:24.608495+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:58.863821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598628+0000","last_change":"2024-05-10T08:49:24.598628+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598628+0000","last_undegraded":"2024-05-10T08:49:24.598628+0000","last_fullsized":"2024-05-10T08:49:24.598628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612086+0000","last_change":"2024-05-10T08:49:24.607947+0000","last_active":"2024-05-10T08:49:24.612086+0000","last_peered":"2024-05-10T08:49:24.612086+0000","last_clean":"2024-05-10T08:49:24.612086+0000","last_became_active":"2024-05-10T08:49:24.606257+0000","last_became_peered":"2024-05-10T08:49:24.606257+0000","last_unstale":"2024-05-10T08:49:24.612086+0000","last_undegraded":"2024-05-10T08:49:24.612086+0000","last_fullsized":"2024-05-10T08:49:24.612086+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:47.247345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598086+0000","last_change":"2024-05-10T08:49:24.598086+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598086+0000","last_undegraded":"2024-05-10T08:49:24.598086+0000","last_fullsized":"2024-05-10T08:49:24.598086+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605220+0000","last_change":"2024-05-10T08:49:24.601162+0000","last_active":"2024-05-10T08:49:24.605220+0000","last_peered":"2024-05-10T08:49:24.605220+0000","last_clean":"2024-05-10T08:49:24.605220+0000","last_became_active":"2024-05-10T08:49:24.600846+0000","last_became_peered":"2024-05-10T08:49:24.600846+0000","last_unstale":"2024-05-10T08:49:24.605220+0000","last_undegraded":"2024-05-10T08:49:24.605220+0000","last_fullsized":"2024-05-10T08:49:24.605220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:16.315391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599451+0000","last_change":"2024-05-10T08:49:24.599451+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599451+0000","last_undegraded":"2024-05-10T08:49:24.599451+0000","last_fullsized":"2024-05-10T08:49:24.599451+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619016+0000","last_change":"2024-05-10T08:49:24.615565+0000","last_active":"2024-05-10T08:49:24.619016+0000","last_peered":"2024-05-10T08:49:24.619016+0000","last_clean":"2024-05-10T08:49:24.619016+0000","last_became_active":"2024-05-10T08:49:24.615280+0000","last_became_peered":"2024-05-10T08:49:24.615280+0000","last_unstale":"2024-05-10T08:49:24.619016+0000","last_undegraded":"2024-05-10T08:49:24.619016+0000","last_fullsized":"2024-05-10T08:49:24.619016+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595074+0000","last_change":"2024-05-10T08:49:24.595074+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595074+0000","last_undegraded":"2024-05-10T08:49:24.595074+0000","last_fullsized":"2024-05-10T08:49:24.595074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616317+0000","last_change":"2024-05-10T08:49:24.613433+0000","last_active":"2024-05-10T08:49:24.616317+0000","last_peered":"2024-05-10T08:49:24.616317+0000","last_clean":"2024-05-10T08:49:24.616317+0000","last_became_active":"2024-05-10T08:49:24.613090+0000","last_became_peered":"2024-05-10T08:49:24.613090+0000","last_unstale":"2024-05-10T08:49:24.616317+0000","last_undegraded":"2024-05-10T08:49:24.616317+0000","last_fullsized":"2024-05-10T08:49:24.616317+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:35:50.740398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604327+0000","last_change":"2024-05-10T08:49:24.604327+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604327+0000","last_undegraded":"2024-05-10T08:49:24.604327+0000","last_fullsized":"2024-05-10T08:49:24.604327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612170+0000","last_change":"2024-05-10T08:49:24.610562+0000","last_active":"2024-05-10T08:49:24.612170+0000","last_peered":"2024-05-10T08:49:24.612170+0000","last_clean":"2024-05-10T08:49:24.612170+0000","last_became_active":"2024-05-10T08:49:24.610152+0000","last_became_peered":"2024-05-10T08:49:24.610152+0000","last_unstale":"2024-05-10T08:49:24.612170+0000","last_undegraded":"2024-05-10T08:49:24.612170+0000","last_fullsized":"2024-05-10T08:49:24.612170+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600889+0000","last_change":"2024-05-10T08:49:24.600889+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600889+0000","last_undegraded":"2024-05-10T08:49:24.600889+0000","last_fullsized":"2024-05-10T08:49:24.600889+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616795+0000","last_change":"2024-05-10T08:49:24.615638+0000","last_active":"2024-05-10T08:49:24.616795+0000","last_peered":"2024-05-10T08:49:24.616795+0000","last_clean":"2024-05-10T08:49:24.616795+0000","last_became_active":"2024-05-10T08:49:24.615399+0000","last_became_peered":"2024-05-10T08:49:24.615399+0000","last_unstale":"2024-05-10T08:49:24.616795+0000","last_undegraded":"2024-05-10T08:49:24.616795+0000","last_fullsized":"2024-05-10T08:49:24.616795+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604768+0000","last_change":"2024-05-10T08:49:24.604768+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604768+0000","last_undegraded":"2024-05-10T08:49:24.604768+0000","last_fullsized":"2024-05-10T08:49:24.604768+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619031+0000","last_change":"2024-05-10T08:49:24.612901+0000","last_active":"2024-05-10T08:49:24.619031+0000","last_peered":"2024-05-10T08:49:24.619031+0000","last_clean":"2024-05-10T08:49:24.619031+0000","last_became_active":"2024-05-10T08:49:24.612581+0000","last_became_peered":"2024-05-10T08:49:24.612581+0000","last_unstale":"2024-05-10T08:49:24.619031+0000","last_undegraded":"2024-05-10T08:49:24.619031+0000","last_fullsized":"2024-05-10T08:49:24.619031+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:29.603142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597260+0000","last_change":"2024-05-10T08:49:24.597260+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597260+0000","last_undegraded":"2024-05-10T08:49:24.597260+0000","last_fullsized":"2024-05-10T08:49:24.597260+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611462+0000","last_change":"2024-05-10T08:49:24.609174+0000","last_active":"2024-05-10T08:49:24.611462+0000","last_peered":"2024-05-10T08:49:24.611462+0000","last_clean":"2024-05-10T08:49:24.611462+0000","last_became_active":"2024-05-10T08:49:24.608853+0000","last_became_peered":"2024-05-10T08:49:24.608853+0000","last_unstale":"2024-05-10T08:49:24.611462+0000","last_undegraded":"2024-05-10T08:49:24.611462+0000","last_fullsized":"2024-05-10T08:49:24.611462+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596476+0000","last_change":"2024-05-10T08:49:24.596476+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596476+0000","last_undegraded":"2024-05-10T08:49:24.596476+0000","last_fullsized":"2024-05-10T08:49:24.596476+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619255+0000","last_change":"2024-05-10T08:49:24.613705+0000","last_active":"2024-05-10T08:49:24.619255+0000","last_peered":"2024-05-10T08:49:24.619255+0000","last_clean":"2024-05-10T08:49:24.619255+0000","last_became_active":"2024-05-10T08:49:24.613437+0000","last_became_peered":"2024-05-10T08:49:24.613437+0000","last_unstale":"2024-05-10T08:49:24.619255+0000","last_undegraded":"2024-05-10T08:49:24.619255+0000","last_fullsized":"2024-05-10T08:49:24.619255+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:54.519083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599831+0000","last_change":"2024-05-10T08:49:24.599831+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599831+0000","last_undegraded":"2024-05-10T08:49:24.599831+0000","last_fullsized":"2024-05-10T08:49:24.599831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615852+0000","last_change":"2024-05-10T08:49:24.614766+0000","last_active":"2024-05-10T08:49:24.615852+0000","last_peered":"2024-05-10T08:49:24.615852+0000","last_clean":"2024-05-10T08:49:24.615852+0000","last_became_active":"2024-05-10T08:49:24.614473+0000","last_became_peered":"2024-05-10T08:49:24.614473+0000","last_unstale":"2024-05-10T08:49:24.615852+0000","last_undegraded":"2024-05-10T08:49:24.615852+0000","last_fullsized":"2024-05-10T08:49:24.615852+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602326+0000","last_change":"2024-05-10T08:49:24.602326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602326+0000","last_undegraded":"2024-05-10T08:49:24.602326+0000","last_fullsized":"2024-05-10T08:49:24.602326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.618963+0000","last_change":"2024-05-10T08:49:24.612126+0000","last_active":"2024-05-10T08:49:24.618963+0000","last_peered":"2024-05-10T08:49:24.618963+0000","last_clean":"2024-05-10T08:49:24.618963+0000","last_became_active":"2024-05-10T08:49:24.611698+0000","last_became_peered":"2024-05-10T08:49:24.611698+0000","last_unstale":"2024-05-10T08:49:24.618963+0000","last_undegraded":"2024-05-10T08:49:24.618963+0000","last_fullsized":"2024-05-10T08:49:24.618963+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:59.540500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598128+0000","last_change":"2024-05-10T08:49:24.598128+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598128+0000","last_undegraded":"2024-05-10T08:49:24.598128+0000","last_fullsized":"2024-05-10T08:49:24.598128+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615041+0000","last_change":"2024-05-10T08:49:24.614157+0000","last_active":"2024-05-10T08:49:24.615041+0000","last_peered":"2024-05-10T08:49:24.615041+0000","last_clean":"2024-05-10T08:49:24.615041+0000","last_became_active":"2024-05-10T08:49:24.613727+0000","last_became_peered":"2024-05-10T08:49:24.613727+0000","last_unstale":"2024-05-10T08:49:24.615041+0000","last_undegraded":"2024-05-10T08:49:24.615041+0000","last_fullsized":"2024-05-10T08:49:24.615041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598271+0000","last_change":"2024-05-10T08:49:24.598271+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598271+0000","last_undegraded":"2024-05-10T08:49:24.598271+0000","last_fullsized":"2024-05-10T08:49:24.598271+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613193+0000","last_change":"2024-05-10T08:49:24.611676+0000","last_active":"2024-05-10T08:49:24.613193+0000","last_peered":"2024-05-10T08:49:24.613193+0000","last_clean":"2024-05-10T08:49:24.613193+0000","last_became_active":"2024-05-10T08:49:24.611373+0000","last_became_peered":"2024-05-10T08:49:24.611373+0000","last_unstale":"2024-05-10T08:49:24.613193+0000","last_undegraded":"2024-05-10T08:49:24.613193+0000","last_fullsized":"2024-05-10T08:49:24.613193+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599090+0000","last_change":"2024-05-10T08:49:24.599090+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599090+0000","last_undegraded":"2024-05-10T08:49:24.599090+0000","last_fullsized":"2024-05-10T08:49:24.599090+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619626+0000","last_change":"2024-05-10T08:49:24.615827+0000","last_active":"2024-05-10T08:49:24.619626+0000","last_peered":"2024-05-10T08:49:24.619626+0000","last_clean":"2024-05-10T08:49:24.619626+0000","last_became_active":"2024-05-10T08:49:24.615518+0000","last_became_peered":"2024-05-10T08:49:24.615518+0000","last_unstale":"2024-05-10T08:49:24.619626+0000","last_undegraded":"2024-05-10T08:49:24.619626+0000","last_fullsized":"2024-05-10T08:49:24.619626+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:18:28.973442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604300+0000","last_change":"2024-05-10T08:49:24.604300+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604300+0000","last_undegraded":"2024-05-10T08:49:24.604300+0000","last_fullsized":"2024-05-10T08:49:24.604300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608142+0000","last_change":"2024-05-10T08:49:24.606919+0000","last_active":"2024-05-10T08:49:24.608142+0000","last_peered":"2024-05-10T08:49:24.608142+0000","last_clean":"2024-05-10T08:49:24.608142+0000","last_became_active":"2024-05-10T08:49:24.606647+0000","last_became_peered":"2024-05-10T08:49:24.606647+0000","last_unstale":"2024-05-10T08:49:24.608142+0000","last_undegraded":"2024-05-10T08:49:24.608142+0000","last_fullsized":"2024-05-10T08:49:24.608142+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:30.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595044+0000","last_change":"2024-05-10T08:49:24.595044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595044+0000","last_undegraded":"2024-05-10T08:49:24.595044+0000","last_fullsized":"2024-05-10T08:49:24.595044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608188+0000","last_change":"2024-05-10T08:49:24.605573+0000","last_active":"2024-05-10T08:49:24.608188+0000","last_peered":"2024-05-10T08:49:24.608188+0000","last_clean":"2024-05-10T08:49:24.608188+0000","last_became_active":"2024-05-10T08:49:24.605298+0000","last_became_peered":"2024-05-10T08:49:24.605298+0000","last_unstale":"2024-05-10T08:49:24.608188+0000","last_undegraded":"2024-05-10T08:49:24.608188+0000","last_fullsized":"2024-05-10T08:49:24.608188+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:31.211848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598367+0000","last_change":"2024-05-10T08:49:24.598367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598367+0000","last_undegraded":"2024-05-10T08:49:24.598367+0000","last_fullsized":"2024-05-10T08:49:24.598367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619704+0000","last_change":"2024-05-10T08:49:24.616821+0000","last_active":"2024-05-10T08:49:24.619704+0000","last_peered":"2024-05-10T08:49:24.619704+0000","last_clean":"2024-05-10T08:49:24.619704+0000","last_became_active":"2024-05-10T08:49:24.616451+0000","last_became_peered":"2024-05-10T08:49:24.616451+0000","last_unstale":"2024-05-10T08:49:24.619704+0000","last_undegraded":"2024-05-10T08:49:24.619704+0000","last_fullsized":"2024-05-10T08:49:24.619704+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:32.831419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597883+0000","last_change":"2024-05-10T08:49:24.597883+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597883+0000","last_undegraded":"2024-05-10T08:49:24.597883+0000","last_fullsized":"2024-05-10T08:49:24.597883+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611520+0000","last_change":"2024-05-10T08:49:24.609428+0000","last_active":"2024-05-10T08:49:24.611520+0000","last_peered":"2024-05-10T08:49:24.611520+0000","last_clean":"2024-05-10T08:49:24.611520+0000","last_became_active":"2024-05-10T08:49:24.609148+0000","last_became_peered":"2024-05-10T08:49:24.609148+0000","last_unstale":"2024-05-10T08:49:24.611520+0000","last_undegraded":"2024-05-10T08:49:24.611520+0000","last_fullsized":"2024-05-10T08:49:24.611520+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600696+0000","last_change":"2024-05-10T08:49:24.600696+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600696+0000","last_undegraded":"2024-05-10T08:49:24.600696+0000","last_fullsized":"2024-05-10T08:49:24.600696+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613910+0000","last_change":"2024-05-10T08:49:24.608777+0000","last_active":"2024-05-10T08:49:24.613910+0000","last_peered":"2024-05-10T08:49:24.613910+0000","last_clean":"2024-05-10T08:49:24.613910+0000","last_became_active":"2024-05-10T08:49:24.608491+0000","last_became_peered":"2024-05-10T08:49:24.608491+0000","last_unstale":"2024-05-10T08:49:24.613910+0000","last_undegraded":"2024-05-10T08:49:24.613910+0000","last_fullsized":"2024-05-10T08:49:24.613910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:58.506187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":288,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.602081+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:49:24.602081+0000","last_peered":"2024-05-10T08:49:24.602081+0000","last_clean":"2024-05-10T08:49:24.602081+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:49:24.602081+0000","last_undegraded":"2024-05-10T08:49:24.602081+0000","last_fullsized":"2024-05-10T08:49:24.602081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33148,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338692,"statfs":{"total":96636764160,"available":96602820608,"internally_reserved":0,"allocated":2015232,"data_stored":1249451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2027520,"data_stored":1256118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:49:30.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:49:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.174+0000 7fab913f7640 1 Processor -- start 2024-05-10T08:49:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.174+0000 7fab913f7640 1 -- start start 2024-05-10T08:49:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.174+0000 7fab913f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c072840 0x7fab8c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.174+0000 7fab913f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab8c06e4d0 0x7fab8c0aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.174+0000 7fab913f7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab8c15c920 con 0x7fab8c06e0f0 2024-05-10T08:49:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.174+0000 7fab913f7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fab8c15cc00 con 0x7fab8c06e4d0 2024-05-10T08:49:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.174+0000 7fab913f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fab8c15cee0 con 0x7fab8c072840 2024-05-10T08:49:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab8c06e4d0 0x7fab8c0aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab8c06e4d0 0x7fab8c0aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43540/0 (socket says 172.21.15.37:43540) 2024-05-10T08:49:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8b7fe640 1 -- 172.21.15.37:0/2055420192 learned_addr learned my addr 172.21.15.37:0/2055420192 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8a7fc640 1 --2- 172.21.15.37:0/2055420192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c072840 0x7fab8c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8b7fe640 1 -- 172.21.15.37:0/2055420192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c072840 msgr2=0x7fab8c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8b7fe640 1 --2- 172.21.15.37:0/2055420192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c072840 0x7fab8c15c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8b7fe640 1 -- 172.21.15.37:0/2055420192 >> v1:172.21.15.82:6789/0 conn(0x7fab8c06e0f0 legacy=0x7fab8c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.175+0000 7fab8b7fe640 1 -- 172.21.15.37:0/2055420192 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c15d1c0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab8b7fe640 1 --2- 172.21.15.37:0/2055420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c0aec30 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fab8400d150 tx=0x7fab8402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5031b1d89e2acd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab89ffb640 1 -- 172.21.15.37:0/2055420192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8400b2e0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab89ffb640 1 -- 172.21.15.37:0/2055420192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab84009600 con 0x7fab8c06e4d0 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab89ffb640 1 -- 172.21.15.37:0/2055420192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8400b480 con 0x7fab8c06e4d0 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 -- 172.21.15.37:0/2055420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 msgr2=0x7fab8c0aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 --2- 172.21.15.37:0/2055420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c0aec30 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fab8400d150 tx=0x7fab8402c8e0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 -- 172.21.15.37:0/2055420192 shutdown_connections 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 --2- 172.21.15.37:0/2055420192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c072840 0x7fab8c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 --2- 172.21.15.37:0/2055420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c0aec30 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 -- 172.21.15.37:0/2055420192 >> 172.21.15.37:0/2055420192 conn(0x7fab8c06c3a0 msgr2=0x7fab8c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 -- 172.21.15.37:0/2055420192 shutdown_connections 2024-05-10T08:49:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.176+0000 7fab913f7640 1 -- 172.21.15.37:0/2055420192 wait complete. 2024-05-10T08:49:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.178+0000 7fab913f7640 1 Processor -- start 2024-05-10T08:49:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.178+0000 7fab913f7640 1 -- start start 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab913f7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c06e0f0 0x7fab8c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab913f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab913f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab8c072840 0x7fab8c151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab913f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c0ae7d0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab913f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c0ae650 con 0x7fab8c072840 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab913f7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fab8c1530b0 con 0x7fab8c06e0f0 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43552/0 (socket says 172.21.15.37:43552) 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 -- 172.21.15.37:0/2385163951 learned_addr learned my addr 172.21.15.37:0/2385163951 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8affd640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c06e0f0 0x7fab8c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8b7fe640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab8c072840 0x7fab8c151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 -- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c06e0f0 msgr2=0x7fab8c1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c06e0f0 0x7fab8c1415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 -- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab8c072840 msgr2=0x7fab8c151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab8c072840 0x7fab8c151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 -- 172.21.15.37:0/2385163951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c155930 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab8a7fc640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c151400 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fab8000c7c0 tx=0x7fab8000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.179+0000 7fab737fe640 1 -- 172.21.15.37:0/2385163951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80015070 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.180+0000 7fab737fe640 1 -- 172.21.15.37:0/2385163951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab800077c0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.180+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c155c10 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.180+0000 7fab737fe640 1 -- 172.21.15.37:0/2385163951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80007b70 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.180+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1561d0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.181+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c068cb0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.181+0000 7fab737fe640 1 -- 172.21.15.37:0/2385163951 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab80018070 con 0x7fab8c06e4d0 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.182+0000 7fab737fe640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab780762d0 0x7fab78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.182+0000 7fab737fe640 1 -- 172.21.15.37:0/2385163951 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fab800973a0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.182+0000 7fab8affd640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab780762d0 0x7fab78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.182+0000 7fab8affd640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab780762d0 0x7fab78078790 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fab7c004f60 tx=0x7fab7c007e30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.186+0000 7fab737fe640 1 -- 172.21.15.37:0/2385163951 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fab8c068cb0 con 0x7fab8c06e4d0 2024-05-10T08:49:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.371+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab8c09ea70 con 0x7fab780762d0 2024-05-10T08:49:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.377+0000 7fab737fe640 1 -- 172.21.15.37:0/2385163951 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247074 (secure 0 0 0) 0x7fab8c09ea70 con 0x7fab780762d0 2024-05-10T08:49:30.379 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:30.381 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab780762d0 msgr2=0x7fab78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab780762d0 0x7fab78078790 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fab7c004f60 tx=0x7fab7c007e30 comp rx=0 tx=0).stop 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 msgr2=0x7fab8c151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c151400 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fab8000c7c0 tx=0x7fab8000cc80 comp rx=0 tx=0).stop 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 shutdown_connections 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab780762d0 0x7fab78078790 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab8c072840 0x7fab8c151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c06e4d0 0x7fab8c151400 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 --2- 172.21.15.37:0/2385163951 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab8c06e0f0 0x7fab8c1415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.380+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 >> 172.21.15.37:0/2385163951 conn(0x7fab8c06c3a0 msgr2=0x7fab8c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.381+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 shutdown_connections 2024-05-10T08:49:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.381+0000 7fab913f7640 1 -- 172.21.15.37:0/2385163951 wait complete. 2024-05-10T08:49:30.391 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-10T08:49:29.460175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261776,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712944,"statfs":{"total":773094113280,"available":772826054656,"internally_reserved":0,"allocated":12607488,"data_stored":6480068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.872833"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595077+0000","last_change":"2024-05-10T08:49:24.595077+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595077+0000","last_undegraded":"2024-05-10T08:49:24.595077+0000","last_fullsized":"2024-05-10T08:49:24.595077+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596786+0000","last_change":"2024-05-10T08:49:24.596786+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596786+0000","last_undegraded":"2024-05-10T08:49:24.596786+0000","last_fullsized":"2024-05-10T08:49:24.596786+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596709+0000","last_change":"2024-05-10T08:49:24.596709+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596709+0000","last_undegraded":"2024-05-10T08:49:24.596709+0000","last_fullsized":"2024-05-10T08:49:24.596709+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600049+0000","last_change":"2024-05-10T08:49:24.600049+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600049+0000","last_undegraded":"2024-05-10T08:49:24.600049+0000","last_fullsized":"2024-05-10T08:49:24.600049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596062+0000","last_change":"2024-05-10T08:49:24.596062+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596062+0000","last_undegraded":"2024-05-10T08:49:24.596062+0000","last_fullsized":"2024-05-10T08:49:24.596062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602787+0000","last_change":"2024-05-10T08:49:24.602787+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602787+0000","last_undegraded":"2024-05-10T08:49:24.602787+0000","last_fullsized":"2024-05-10T08:49:24.602787+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604367+0000","last_change":"2024-05-10T08:49:24.604367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604367+0000","last_undegraded":"2024-05-10T08:49:24.604367+0000","last_fullsized":"2024-05-10T08:49:24.604367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.594672+0000","last_change":"2024-05-10T08:49:24.594672+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.594672+0000","last_undegraded":"2024-05-10T08:49:24.594672+0000","last_fullsized":"2024-05-10T08:49:24.594672+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601376+0000","last_change":"2024-05-10T08:49:24.601376+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601376+0000","last_undegraded":"2024-05-10T08:49:24.601376+0000","last_fullsized":"2024-05-10T08:49:24.601376+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600807+0000","last_change":"2024-05-10T08:49:24.600807+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600807+0000","last_undegraded":"2024-05-10T08:49:24.600807+0000","last_fullsized":"2024-05-10T08:49:24.600807+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595613+0000","last_change":"2024-05-10T08:49:24.595613+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595613+0000","last_undegraded":"2024-05-10T08:49:24.595613+0000","last_fullsized":"2024-05-10T08:49:24.595613+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605569+0000","last_change":"2024-05-10T08:49:24.605569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605569+0000","last_undegraded":"2024-05-10T08:49:24.605569+0000","last_fullsized":"2024-05-10T08:49:24.605569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600333+0000","last_change":"2024-05-10T08:49:24.600333+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600333+0000","last_undegraded":"2024-05-10T08:49:24.600333+0000","last_fullsized":"2024-05-10T08:49:24.600333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597790+0000","last_change":"2024-05-10T08:49:24.597790+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597790+0000","last_undegraded":"2024-05-10T08:49:24.597790+0000","last_fullsized":"2024-05-10T08:49:24.597790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596397+0000","last_change":"2024-05-10T08:49:24.596397+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596397+0000","last_undegraded":"2024-05-10T08:49:24.596397+0000","last_fullsized":"2024-05-10T08:49:24.596397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605222+0000","last_change":"2024-05-10T08:49:24.605222+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605222+0000","last_undegraded":"2024-05-10T08:49:24.605222+0000","last_fullsized":"2024-05-10T08:49:24.605222+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599847+0000","last_change":"2024-05-10T08:49:24.599847+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599847+0000","last_undegraded":"2024-05-10T08:49:24.599847+0000","last_fullsized":"2024-05-10T08:49:24.599847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596292+0000","last_change":"2024-05-10T08:49:24.596292+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596292+0000","last_undegraded":"2024-05-10T08:49:24.596292+0000","last_fullsized":"2024-05-10T08:49:24.596292+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598770+0000","last_change":"2024-05-10T08:49:24.598770+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598770+0000","last_undegraded":"2024-05-10T08:49:24.598770+0000","last_fullsized":"2024-05-10T08:49:24.598770+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599557+0000","last_change":"2024-05-10T08:49:24.599557+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599557+0000","last_undegraded":"2024-05-10T08:49:24.599557+0000","last_fullsized":"2024-05-10T08:49:24.599557+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601137+0000","last_change":"2024-05-10T08:49:24.601137+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601137+0000","last_undegraded":"2024-05-10T08:49:24.601137+0000","last_fullsized":"2024-05-10T08:49:24.601137+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595006+0000","last_change":"2024-05-10T08:49:24.595006+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595006+0000","last_undegraded":"2024-05-10T08:49:24.595006+0000","last_fullsized":"2024-05-10T08:49:24.595006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599858+0000","last_change":"2024-05-10T08:49:24.599858+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599858+0000","last_undegraded":"2024-05-10T08:49:24.599858+0000","last_fullsized":"2024-05-10T08:49:24.599858+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600044+0000","last_change":"2024-05-10T08:49:24.600044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600044+0000","last_undegraded":"2024-05-10T08:49:24.600044+0000","last_fullsized":"2024-05-10T08:49:24.600044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601886+0000","last_change":"2024-05-10T08:49:24.601886+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601886+0000","last_undegraded":"2024-05-10T08:49:24.601886+0000","last_fullsized":"2024-05-10T08:49:24.601886+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600569+0000","last_change":"2024-05-10T08:49:24.600569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600569+0000","last_undegraded":"2024-05-10T08:49:24.600569+0000","last_fullsized":"2024-05-10T08:49:24.600569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598326+0000","last_change":"2024-05-10T08:49:24.598326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598326+0000","last_undegraded":"2024-05-10T08:49:24.598326+0000","last_fullsized":"2024-05-10T08:49:24.598326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605130+0000","last_change":"2024-05-10T08:49:24.605130+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605130+0000","last_undegraded":"2024-05-10T08:49:24.605130+0000","last_fullsized":"2024-05-10T08:49:24.605130+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599499+0000","last_change":"2024-05-10T08:49:24.599499+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599499+0000","last_undegraded":"2024-05-10T08:49:24.599499+0000","last_fullsized":"2024-05-10T08:49:24.599499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597368+0000","last_change":"2024-05-10T08:49:24.597368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597368+0000","last_undegraded":"2024-05-10T08:49:24.597368+0000","last_fullsized":"2024-05-10T08:49:24.597368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599992+0000","last_change":"2024-05-10T08:49:24.599992+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599992+0000","last_undegraded":"2024-05-10T08:49:24.599992+0000","last_fullsized":"2024-05-10T08:49:24.599992+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599370+0000","last_change":"2024-05-10T08:49:24.599370+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599370+0000","last_undegraded":"2024-05-10T08:49:24.599370+0000","last_fullsized":"2024-05-10T08:49:24.599370+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599355+0000","last_change":"2024-05-10T08:49:24.599355+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599355+0000","last_undegraded":"2024-05-10T08:49:24.599355+0000","last_fullsized":"2024-05-10T08:49:24.599355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.607022+0000","last_change":"2024-05-10T08:49:24.605641+0000","last_active":"2024-05-10T08:49:24.607022+0000","last_peered":"2024-05-10T08:49:24.607022+0000","last_clean":"2024-05-10T08:49:24.607022+0000","last_became_active":"2024-05-10T08:49:24.605358+0000","last_became_peered":"2024-05-10T08:49:24.605358+0000","last_unstale":"2024-05-10T08:49:24.607022+0000","last_undegraded":"2024-05-10T08:49:24.607022+0000","last_fullsized":"2024-05-10T08:49:24.607022+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.603434+0000","last_change":"2024-05-10T08:49:24.603434+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.603434+0000","last_undegraded":"2024-05-10T08:49:24.603434+0000","last_fullsized":"2024-05-10T08:49:24.603434+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614220+0000","last_change":"2024-05-10T08:49:24.604270+0000","last_active":"2024-05-10T08:49:24.614220+0000","last_peered":"2024-05-10T08:49:24.614220+0000","last_clean":"2024-05-10T08:49:24.614220+0000","last_became_active":"2024-05-10T08:49:24.603998+0000","last_became_peered":"2024-05-10T08:49:24.603998+0000","last_unstale":"2024-05-10T08:49:24.614220+0000","last_undegraded":"2024-05-10T08:49:24.614220+0000","last_fullsized":"2024-05-10T08:49:24.614220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600688+0000","last_change":"2024-05-10T08:49:24.600688+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600688+0000","last_undegraded":"2024-05-10T08:49:24.600688+0000","last_fullsized":"2024-05-10T08:49:24.600688+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616768+0000","last_change":"2024-05-10T08:49:24.615247+0000","last_active":"2024-05-10T08:49:24.616768+0000","last_peered":"2024-05-10T08:49:24.616768+0000","last_clean":"2024-05-10T08:49:24.616768+0000","last_became_active":"2024-05-10T08:49:24.614956+0000","last_became_peered":"2024-05-10T08:49:24.614956+0000","last_unstale":"2024-05-10T08:49:24.616768+0000","last_undegraded":"2024-05-10T08:49:24.616768+0000","last_fullsized":"2024-05-10T08:49:24.616768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600948+0000","last_change":"2024-05-10T08:49:24.600948+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600948+0000","last_undegraded":"2024-05-10T08:49:24.600948+0000","last_fullsized":"2024-05-10T08:49:24.600948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614099+0000","last_change":"2024-05-10T08:49:24.605015+0000","last_active":"2024-05-10T08:49:24.614099+0000","last_peered":"2024-05-10T08:49:24.614099+0000","last_clean":"2024-05-10T08:49:24.614099+0000","last_became_active":"2024-05-10T08:49:24.604737+0000","last_became_peered":"2024-05-10T08:49:24.604737+0000","last_unstale":"2024-05-10T08:49:24.614099+0000","last_undegraded":"2024-05-10T08:49:24.614099+0000","last_fullsized":"2024-05-10T08:49:24.614099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598862+0000","last_change":"2024-05-10T08:49:24.598862+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598862+0000","last_undegraded":"2024-05-10T08:49:24.598862+0000","last_fullsized":"2024-05-10T08:49:24.598862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605913+0000","last_change":"2024-05-10T08:49:24.603241+0000","last_active":"2024-05-10T08:49:24.605913+0000","last_peered":"2024-05-10T08:49:24.605913+0000","last_clean":"2024-05-10T08:49:24.605913+0000","last_became_active":"2024-05-10T08:49:24.602715+0000","last_became_peered":"2024-05-10T08:49:24.602715+0000","last_unstale":"2024-05-10T08:49:24.605913+0000","last_undegraded":"2024-05-10T08:49:24.605913+0000","last_fullsized":"2024-05-10T08:49:24.605913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:38.914133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595047+0000","last_change":"2024-05-10T08:49:24.595047+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595047+0000","last_undegraded":"2024-05-10T08:49:24.595047+0000","last_fullsized":"2024-05-10T08:49:24.595047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614631+0000","last_change":"2024-05-10T08:49:24.611527+0000","last_active":"2024-05-10T08:49:24.614631+0000","last_peered":"2024-05-10T08:49:24.614631+0000","last_clean":"2024-05-10T08:49:24.614631+0000","last_became_active":"2024-05-10T08:49:24.611240+0000","last_became_peered":"2024-05-10T08:49:24.611240+0000","last_unstale":"2024-05-10T08:49:24.614631+0000","last_undegraded":"2024-05-10T08:49:24.614631+0000","last_fullsized":"2024-05-10T08:49:24.614631+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:55.542337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596921+0000","last_change":"2024-05-10T08:49:24.596921+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596921+0000","last_undegraded":"2024-05-10T08:49:24.596921+0000","last_fullsized":"2024-05-10T08:49:24.596921+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608849+0000","last_change":"2024-05-10T08:49:24.607869+0000","last_active":"2024-05-10T08:49:24.608849+0000","last_peered":"2024-05-10T08:49:24.608849+0000","last_clean":"2024-05-10T08:49:24.608849+0000","last_became_active":"2024-05-10T08:49:24.607585+0000","last_became_peered":"2024-05-10T08:49:24.607585+0000","last_unstale":"2024-05-10T08:49:24.608849+0000","last_undegraded":"2024-05-10T08:49:24.608849+0000","last_fullsized":"2024-05-10T08:49:24.608849+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:19.236787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599587+0000","last_change":"2024-05-10T08:49:24.599587+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599587+0000","last_undegraded":"2024-05-10T08:49:24.599587+0000","last_fullsized":"2024-05-10T08:49:24.599587+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619683+0000","last_change":"2024-05-10T08:49:24.616592+0000","last_active":"2024-05-10T08:49:24.619683+0000","last_peered":"2024-05-10T08:49:24.619683+0000","last_clean":"2024-05-10T08:49:24.619683+0000","last_became_active":"2024-05-10T08:49:24.616144+0000","last_became_peered":"2024-05-10T08:49:24.616144+0000","last_unstale":"2024-05-10T08:49:24.619683+0000","last_undegraded":"2024-05-10T08:49:24.619683+0000","last_fullsized":"2024-05-10T08:49:24.619683+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:08.054238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598368+0000","last_change":"2024-05-10T08:49:24.598368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598368+0000","last_undegraded":"2024-05-10T08:49:24.598368+0000","last_fullsized":"2024-05-10T08:49:24.598368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614937+0000","last_change":"2024-05-10T08:49:24.614099+0000","last_active":"2024-05-10T08:49:24.614937+0000","last_peered":"2024-05-10T08:49:24.614937+0000","last_clean":"2024-05-10T08:49:24.614937+0000","last_became_active":"2024-05-10T08:49:24.613780+0000","last_became_peered":"2024-05-10T08:49:24.613780+0000","last_unstale":"2024-05-10T08:49:24.614937+0000","last_undegraded":"2024-05-10T08:49:24.614937+0000","last_fullsized":"2024-05-10T08:49:24.614937+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600801+0000","last_change":"2024-05-10T08:49:24.600801+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600801+0000","last_undegraded":"2024-05-10T08:49:24.600801+0000","last_fullsized":"2024-05-10T08:49:24.600801+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.610588+0000","last_change":"2024-05-10T08:49:24.608713+0000","last_active":"2024-05-10T08:49:24.610588+0000","last_peered":"2024-05-10T08:49:24.610588+0000","last_clean":"2024-05-10T08:49:24.610588+0000","last_became_active":"2024-05-10T08:49:24.608441+0000","last_became_peered":"2024-05-10T08:49:24.608441+0000","last_unstale":"2024-05-10T08:49:24.610588+0000","last_undegraded":"2024-05-10T08:49:24.610588+0000","last_fullsized":"2024-05-10T08:49:24.610588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:29.670353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595073+0000","last_change":"2024-05-10T08:49:24.595073+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595073+0000","last_undegraded":"2024-05-10T08:49:24.595073+0000","last_fullsized":"2024-05-10T08:49:24.595073+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614415+0000","last_change":"2024-05-10T08:49:24.612764+0000","last_active":"2024-05-10T08:49:24.614415+0000","last_peered":"2024-05-10T08:49:24.614415+0000","last_clean":"2024-05-10T08:49:24.614415+0000","last_became_active":"2024-05-10T08:49:24.612363+0000","last_became_peered":"2024-05-10T08:49:24.612363+0000","last_unstale":"2024-05-10T08:49:24.614415+0000","last_undegraded":"2024-05-10T08:49:24.614415+0000","last_fullsized":"2024-05-10T08:49:24.614415+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:21.634515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601493+0000","last_change":"2024-05-10T08:49:24.601493+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601493+0000","last_undegraded":"2024-05-10T08:49:24.601493+0000","last_fullsized":"2024-05-10T08:49:24.601493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.606216+0000","last_change":"2024-05-10T08:49:24.602612+0000","last_active":"2024-05-10T08:49:24.606216+0000","last_peered":"2024-05-10T08:49:24.606216+0000","last_clean":"2024-05-10T08:49:24.606216+0000","last_became_active":"2024-05-10T08:49:24.602252+0000","last_became_peered":"2024-05-10T08:49:24.602252+0000","last_unstale":"2024-05-10T08:49:24.606216+0000","last_undegraded":"2024-05-10T08:49:24.606216+0000","last_fullsized":"2024-05-10T08:49:24.606216+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:59.078558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597711+0000","last_change":"2024-05-10T08:49:24.597711+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597711+0000","last_undegraded":"2024-05-10T08:49:24.597711+0000","last_fullsized":"2024-05-10T08:49:24.597711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608495+0000","last_change":"2024-05-10T08:49:24.607083+0000","last_active":"2024-05-10T08:49:24.608495+0000","last_peered":"2024-05-10T08:49:24.608495+0000","last_clean":"2024-05-10T08:49:24.608495+0000","last_became_active":"2024-05-10T08:49:24.606742+0000","last_became_peered":"2024-05-10T08:49:24.606742+0000","last_unstale":"2024-05-10T08:49:24.608495+0000","last_undegraded":"2024-05-10T08:49:24.608495+0000","last_fullsized":"2024-05-10T08:49:24.608495+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:58.863821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598628+0000","last_change":"2024-05-10T08:49:24.598628+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598628+0000","last_undegraded":"2024-05-10T08:49:24.598628+0000","last_fullsized":"2024-05-10T08:49:24.598628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612086+0000","last_change":"2024-05-10T08:49:24.607947+0000","last_active":"2024-05-10T08:49:24.612086+0000","last_peered":"2024-05-10T08:49:24.612086+0000","last_clean":"2024-05-10T08:49:24.612086+0000","last_became_active":"2024-05-10T08:49:24.606257+0000","last_became_peered":"2024-05-10T08:49:24.606257+0000","last_unstale":"2024-05-10T08:49:24.612086+0000","last_undegraded":"2024-05-10T08:49:24.612086+0000","last_fullsized":"2024-05-10T08:49:24.612086+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:47.247345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598086+0000","last_change":"2024-05-10T08:49:24.598086+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598086+0000","last_undegraded":"2024-05-10T08:49:24.598086+0000","last_fullsized":"2024-05-10T08:49:24.598086+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605220+0000","last_change":"2024-05-10T08:49:24.601162+0000","last_active":"2024-05-10T08:49:24.605220+0000","last_peered":"2024-05-10T08:49:24.605220+0000","last_clean":"2024-05-10T08:49:24.605220+0000","last_became_active":"2024-05-10T08:49:24.600846+0000","last_became_peered":"2024-05-10T08:49:24.600846+0000","last_unstale":"2024-05-10T08:49:24.605220+0000","last_undegraded":"2024-05-10T08:49:24.605220+0000","last_fullsized":"2024-05-10T08:49:24.605220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:16.315391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599451+0000","last_change":"2024-05-10T08:49:24.599451+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599451+0000","last_undegraded":"2024-05-10T08:49:24.599451+0000","last_fullsized":"2024-05-10T08:49:24.599451+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619016+0000","last_change":"2024-05-10T08:49:24.615565+0000","last_active":"2024-05-10T08:49:24.619016+0000","last_peered":"2024-05-10T08:49:24.619016+0000","last_clean":"2024-05-10T08:49:24.619016+0000","last_became_active":"2024-05-10T08:49:24.615280+0000","last_became_peered":"2024-05-10T08:49:24.615280+0000","last_unstale":"2024-05-10T08:49:24.619016+0000","last_undegraded":"2024-05-10T08:49:24.619016+0000","last_fullsized":"2024-05-10T08:49:24.619016+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595074+0000","last_change":"2024-05-10T08:49:24.595074+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595074+0000","last_undegraded":"2024-05-10T08:49:24.595074+0000","last_fullsized":"2024-05-10T08:49:24.595074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616317+0000","last_change":"2024-05-10T08:49:24.613433+0000","last_active":"2024-05-10T08:49:24.616317+0000","last_peered":"2024-05-10T08:49:24.616317+0000","last_clean":"2024-05-10T08:49:24.616317+0000","last_became_active":"2024-05-10T08:49:24.613090+0000","last_became_peered":"2024-05-10T08:49:24.613090+0000","last_unstale":"2024-05-10T08:49:24.616317+0000","last_undegraded":"2024-05-10T08:49:24.616317+0000","last_fullsized":"2024-05-10T08:49:24.616317+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:35:50.740398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604327+0000","last_change":"2024-05-10T08:49:24.604327+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604327+0000","last_undegraded":"2024-05-10T08:49:24.604327+0000","last_fullsized":"2024-05-10T08:49:24.604327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612170+0000","last_change":"2024-05-10T08:49:24.610562+0000","last_active":"2024-05-10T08:49:24.612170+0000","last_peered":"2024-05-10T08:49:24.612170+0000","last_clean":"2024-05-10T08:49:24.612170+0000","last_became_active":"2024-05-10T08:49:24.610152+0000","last_became_peered":"2024-05-10T08:49:24.610152+0000","last_unstale":"2024-05-10T08:49:24.612170+0000","last_undegraded":"2024-05-10T08:49:24.612170+0000","last_fullsized":"2024-05-10T08:49:24.612170+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600889+0000","last_change":"2024-05-10T08:49:24.600889+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600889+0000","last_undegraded":"2024-05-10T08:49:24.600889+0000","last_fullsized":"2024-05-10T08:49:24.600889+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616795+0000","last_change":"2024-05-10T08:49:24.615638+0000","last_active":"2024-05-10T08:49:24.616795+0000","last_peered":"2024-05-10T08:49:24.616795+0000","last_clean":"2024-05-10T08:49:24.616795+0000","last_became_active":"2024-05-10T08:49:24.615399+0000","last_became_peered":"2024-05-10T08:49:24.615399+0000","last_unstale":"2024-05-10T08:49:24.616795+0000","last_undegraded":"2024-05-10T08:49:24.616795+0000","last_fullsized":"2024-05-10T08:49:24.616795+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604768+0000","last_change":"2024-05-10T08:49:24.604768+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604768+0000","last_undegraded":"2024-05-10T08:49:24.604768+0000","last_fullsized":"2024-05-10T08:49:24.604768+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619031+0000","last_change":"2024-05-10T08:49:24.612901+0000","last_active":"2024-05-10T08:49:24.619031+0000","last_peered":"2024-05-10T08:49:24.619031+0000","last_clean":"2024-05-10T08:49:24.619031+0000","last_became_active":"2024-05-10T08:49:24.612581+0000","last_became_peered":"2024-05-10T08:49:24.612581+0000","last_unstale":"2024-05-10T08:49:24.619031+0000","last_undegraded":"2024-05-10T08:49:24.619031+0000","last_fullsized":"2024-05-10T08:49:24.619031+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:29.603142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597260+0000","last_change":"2024-05-10T08:49:24.597260+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597260+0000","last_undegraded":"2024-05-10T08:49:24.597260+0000","last_fullsized":"2024-05-10T08:49:24.597260+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611462+0000","last_change":"2024-05-10T08:49:24.609174+0000","last_active":"2024-05-10T08:49:24.611462+0000","last_peered":"2024-05-10T08:49:24.611462+0000","last_clean":"2024-05-10T08:49:24.611462+0000","last_became_active":"2024-05-10T08:49:24.608853+0000","last_became_peered":"2024-05-10T08:49:24.608853+0000","last_unstale":"2024-05-10T08:49:24.611462+0000","last_undegraded":"2024-05-10T08:49:24.611462+0000","last_fullsized":"2024-05-10T08:49:24.611462+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596476+0000","last_change":"2024-05-10T08:49:24.596476+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596476+0000","last_undegraded":"2024-05-10T08:49:24.596476+0000","last_fullsized":"2024-05-10T08:49:24.596476+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619255+0000","last_change":"2024-05-10T08:49:24.613705+0000","last_active":"2024-05-10T08:49:24.619255+0000","last_peered":"2024-05-10T08:49:24.619255+0000","last_clean":"2024-05-10T08:49:24.619255+0000","last_became_active":"2024-05-10T08:49:24.613437+0000","last_became_peered":"2024-05-10T08:49:24.613437+0000","last_unstale":"2024-05-10T08:49:24.619255+0000","last_undegraded":"2024-05-10T08:49:24.619255+0000","last_fullsized":"2024-05-10T08:49:24.619255+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:54.519083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599831+0000","last_change":"2024-05-10T08:49:24.599831+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599831+0000","last_undegraded":"2024-05-10T08:49:24.599831+0000","last_fullsized":"2024-05-10T08:49:24.599831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615852+0000","last_change":"2024-05-10T08:49:24.614766+0000","last_active":"2024-05-10T08:49:24.615852+0000","last_peered":"2024-05-10T08:49:24.615852+0000","last_clean":"2024-05-10T08:49:24.615852+0000","last_became_active":"2024-05-10T08:49:24.614473+0000","last_became_peered":"2024-05-10T08:49:24.614473+0000","last_unstale":"2024-05-10T08:49:24.615852+0000","last_undegraded":"2024-05-10T08:49:24.615852+0000","last_fullsized":"2024-05-10T08:49:24.615852+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602326+0000","last_change":"2024-05-10T08:49:24.602326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602326+0000","last_undegraded":"2024-05-10T08:49:24.602326+0000","last_fullsized":"2024-05-10T08:49:24.602326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.618963+0000","last_change":"2024-05-10T08:49:24.612126+0000","last_active":"2024-05-10T08:49:24.618963+0000","last_peered":"2024-05-10T08:49:24.618963+0000","last_clean":"2024-05-10T08:49:24.618963+0000","last_became_active":"2024-05-10T08:49:24.611698+0000","last_became_peered":"2024-05-10T08:49:24.611698+0000","last_unstale":"2024-05-10T08:49:24.618963+0000","last_undegraded":"2024-05-10T08:49:24.618963+0000","last_fullsized":"2024-05-10T08:49:24.618963+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:59.540500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598128+0000","last_change":"2024-05-10T08:49:24.598128+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598128+0000","last_undegraded":"2024-05-10T08:49:24.598128+0000","last_fullsized":"2024-05-10T08:49:24.598128+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615041+0000","last_change":"2024-05-10T08:49:24.614157+0000","last_active":"2024-05-10T08:49:24.615041+0000","last_peered":"2024-05-10T08:49:24.615041+0000","last_clean":"2024-05-10T08:49:24.615041+0000","last_became_active":"2024-05-10T08:49:24.613727+0000","last_became_peered":"2024-05-10T08:49:24.613727+0000","last_unstale":"2024-05-10T08:49:24.615041+0000","last_undegraded":"2024-05-10T08:49:24.615041+0000","last_fullsized":"2024-05-10T08:49:24.615041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598271+0000","last_change":"2024-05-10T08:49:24.598271+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598271+0000","last_undegraded":"2024-05-10T08:49:24.598271+0000","last_fullsized":"2024-05-10T08:49:24.598271+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613193+0000","last_change":"2024-05-10T08:49:24.611676+0000","last_active":"2024-05-10T08:49:24.613193+0000","last_peered":"2024-05-10T08:49:24.613193+0000","last_clean":"2024-05-10T08:49:24.613193+0000","last_became_active":"2024-05-10T08:49:24.611373+0000","last_became_peered":"2024-05-10T08:49:24.611373+0000","last_unstale":"2024-05-10T08:49:24.613193+0000","last_undegraded":"2024-05-10T08:49:24.613193+0000","last_fullsized":"2024-05-10T08:49:24.613193+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599090+0000","last_change":"2024-05-10T08:49:24.599090+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599090+0000","last_undegraded":"2024-05-10T08:49:24.599090+0000","last_fullsized":"2024-05-10T08:49:24.599090+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619626+0000","last_change":"2024-05-10T08:49:24.615827+0000","last_active":"2024-05-10T08:49:24.619626+0000","last_peered":"2024-05-10T08:49:24.619626+0000","last_clean":"2024-05-10T08:49:24.619626+0000","last_became_active":"2024-05-10T08:49:24.615518+0000","last_became_peered":"2024-05-10T08:49:24.615518+0000","last_unstale":"2024-05-10T08:49:24.619626+0000","last_undegraded":"2024-05-10T08:49:24.619626+0000","last_fullsized":"2024-05-10T08:49:24.619626+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:18:28.973442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604300+0000","last_change":"2024-05-10T08:49:24.604300+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604300+0000","last_undegraded":"2024-05-10T08:49:24.604300+0000","last_fullsized":"2024-05-10T08:49:24.604300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608142+0000","last_change":"2024-05-10T08:49:24.606919+0000","last_active":"2024-05-10T08:49:24.608142+0000","last_peered":"2024-05-10T08:49:24.608142+0000","last_clean":"2024-05-10T08:49:24.608142+0000","last_became_active":"2024-05-10T08:49:24.606647+0000","last_became_peered":"2024-05-10T08:49:24.606647+0000","last_unstale":"2024-05-10T08:49:24.608142+0000","last_undegraded":"2024-05-10T08:49:24.608142+0000","last_fullsized":"2024-05-10T08:49:24.608142+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:30.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595044+0000","last_change":"2024-05-10T08:49:24.595044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595044+0000","last_undegraded":"2024-05-10T08:49:24.595044+0000","last_fullsized":"2024-05-10T08:49:24.595044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608188+0000","last_change":"2024-05-10T08:49:24.605573+0000","last_active":"2024-05-10T08:49:24.608188+0000","last_peered":"2024-05-10T08:49:24.608188+0000","last_clean":"2024-05-10T08:49:24.608188+0000","last_became_active":"2024-05-10T08:49:24.605298+0000","last_became_peered":"2024-05-10T08:49:24.605298+0000","last_unstale":"2024-05-10T08:49:24.608188+0000","last_undegraded":"2024-05-10T08:49:24.608188+0000","last_fullsized":"2024-05-10T08:49:24.608188+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:31.211848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598367+0000","last_change":"2024-05-10T08:49:24.598367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598367+0000","last_undegraded":"2024-05-10T08:49:24.598367+0000","last_fullsized":"2024-05-10T08:49:24.598367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619704+0000","last_change":"2024-05-10T08:49:24.616821+0000","last_active":"2024-05-10T08:49:24.619704+0000","last_peered":"2024-05-10T08:49:24.619704+0000","last_clean":"2024-05-10T08:49:24.619704+0000","last_became_active":"2024-05-10T08:49:24.616451+0000","last_became_peered":"2024-05-10T08:49:24.616451+0000","last_unstale":"2024-05-10T08:49:24.619704+0000","last_undegraded":"2024-05-10T08:49:24.619704+0000","last_fullsized":"2024-05-10T08:49:24.619704+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:32.831419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597883+0000","last_change":"2024-05-10T08:49:24.597883+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597883+0000","last_undegraded":"2024-05-10T08:49:24.597883+0000","last_fullsized":"2024-05-10T08:49:24.597883+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611520+0000","last_change":"2024-05-10T08:49:24.609428+0000","last_active":"2024-05-10T08:49:24.611520+0000","last_peered":"2024-05-10T08:49:24.611520+0000","last_clean":"2024-05-10T08:49:24.611520+0000","last_became_active":"2024-05-10T08:49:24.609148+0000","last_became_peered":"2024-05-10T08:49:24.609148+0000","last_unstale":"2024-05-10T08:49:24.611520+0000","last_undegraded":"2024-05-10T08:49:24.611520+0000","last_fullsized":"2024-05-10T08:49:24.611520+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600696+0000","last_change":"2024-05-10T08:49:24.600696+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600696+0000","last_undegraded":"2024-05-10T08:49:24.600696+0000","last_fullsized":"2024-05-10T08:49:24.600696+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613910+0000","last_change":"2024-05-10T08:49:24.608777+0000","last_active":"2024-05-10T08:49:24.613910+0000","last_peered":"2024-05-10T08:49:24.613910+0000","last_clean":"2024-05-10T08:49:24.613910+0000","last_became_active":"2024-05-10T08:49:24.608491+0000","last_became_peered":"2024-05-10T08:49:24.608491+0000","last_unstale":"2024-05-10T08:49:24.613910+0000","last_undegraded":"2024-05-10T08:49:24.613910+0000","last_fullsized":"2024-05-10T08:49:24.613910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:58.506187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":288,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.602081+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:49:24.602081+0000","last_peered":"2024-05-10T08:49:24.602081+0000","last_clean":"2024-05-10T08:49:24.602081+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:49:24.602081+0000","last_undegraded":"2024-05-10T08:49:24.602081+0000","last_fullsized":"2024-05-10T08:49:24.602081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33148,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338692,"statfs":{"total":96636764160,"available":96602820608,"internally_reserved":0,"allocated":2015232,"data_stored":1249451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2027520,"data_stored":1256118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:49:30.396 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3f is not active+clean 2024-05-10T08:49:30.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.595077+0000', 'last_change': '2024-05-10T08:49:24.595077+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.595077+0000', 'last_undegraded': '2024-05-10T08:49:24.595077+0000', 'last_fullsized': '2024-05-10T08:49:24.595077+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T08:49:30.397 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3e is not active+clean 2024-05-10T08:49:30.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.596786+0000', 'last_change': '2024-05-10T08:49:24.596786+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.596786+0000', 'last_undegraded': '2024-05-10T08:49:24.596786+0000', 'last_fullsized': '2024-05-10T08:49:24.596786+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.397 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3d is not active+clean 2024-05-10T08:49:30.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.596709+0000', 'last_change': '2024-05-10T08:49:24.596709+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.596709+0000', 'last_undegraded': '2024-05-10T08:49:24.596709+0000', 'last_fullsized': '2024-05-10T08:49:24.596709+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.397 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3c is not active+clean 2024-05-10T08:49:30.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600049+0000', 'last_change': '2024-05-10T08:49:24.600049+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600049+0000', 'last_undegraded': '2024-05-10T08:49:24.600049+0000', 'last_fullsized': '2024-05-10T08:49:24.600049+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.398 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3b is not active+clean 2024-05-10T08:49:30.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.596062+0000', 'last_change': '2024-05-10T08:49:24.596062+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.596062+0000', 'last_undegraded': '2024-05-10T08:49:24.596062+0000', 'last_fullsized': '2024-05-10T08:49:24.596062+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T08:49:30.398 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3a is not active+clean 2024-05-10T08:49:30.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.602787+0000', 'last_change': '2024-05-10T08:49:24.602787+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.602787+0000', 'last_undegraded': '2024-05-10T08:49:24.602787+0000', 'last_fullsized': '2024-05-10T08:49:24.602787+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.399 INFO:tasks.ceph.ceph_manager.ceph:PG 18.39 is not active+clean 2024-05-10T08:49:30.399 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.604367+0000', 'last_change': '2024-05-10T08:49:24.604367+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.604367+0000', 'last_undegraded': '2024-05-10T08:49:24.604367+0000', 'last_fullsized': '2024-05-10T08:49:24.604367+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.399 INFO:tasks.ceph.ceph_manager.ceph:PG 18.38 is not active+clean 2024-05-10T08:49:30.399 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.594672+0000', 'last_change': '2024-05-10T08:49:24.594672+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.594672+0000', 'last_undegraded': '2024-05-10T08:49:24.594672+0000', 'last_fullsized': '2024-05-10T08:49:24.594672+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.400 INFO:tasks.ceph.ceph_manager.ceph:PG 18.37 is not active+clean 2024-05-10T08:49:30.400 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.601376+0000', 'last_change': '2024-05-10T08:49:24.601376+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.601376+0000', 'last_undegraded': '2024-05-10T08:49:24.601376+0000', 'last_fullsized': '2024-05-10T08:49:24.601376+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.400 INFO:tasks.ceph.ceph_manager.ceph:PG 18.36 is not active+clean 2024-05-10T08:49:30.400 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600807+0000', 'last_change': '2024-05-10T08:49:24.600807+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600807+0000', 'last_undegraded': '2024-05-10T08:49:24.600807+0000', 'last_fullsized': '2024-05-10T08:49:24.600807+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.400 INFO:tasks.ceph.ceph_manager.ceph:PG 18.35 is not active+clean 2024-05-10T08:49:30.401 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.595613+0000', 'last_change': '2024-05-10T08:49:24.595613+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.595613+0000', 'last_undegraded': '2024-05-10T08:49:24.595613+0000', 'last_fullsized': '2024-05-10T08:49:24.595613+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T08:49:30.401 INFO:tasks.ceph.ceph_manager.ceph:PG 18.34 is not active+clean 2024-05-10T08:49:30.401 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.605569+0000', 'last_change': '2024-05-10T08:49:24.605569+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.605569+0000', 'last_undegraded': '2024-05-10T08:49:24.605569+0000', 'last_fullsized': '2024-05-10T08:49:24.605569+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.401 INFO:tasks.ceph.ceph_manager.ceph:PG 18.33 is not active+clean 2024-05-10T08:49:30.401 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600333+0000', 'last_change': '2024-05-10T08:49:24.600333+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600333+0000', 'last_undegraded': '2024-05-10T08:49:24.600333+0000', 'last_fullsized': '2024-05-10T08:49:24.600333+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.401 INFO:tasks.ceph.ceph_manager.ceph:PG 18.32 is not active+clean 2024-05-10T08:49:30.402 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.597790+0000', 'last_change': '2024-05-10T08:49:24.597790+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.597790+0000', 'last_undegraded': '2024-05-10T08:49:24.597790+0000', 'last_fullsized': '2024-05-10T08:49:24.597790+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.402 INFO:tasks.ceph.ceph_manager.ceph:PG 18.31 is not active+clean 2024-05-10T08:49:30.402 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.596397+0000', 'last_change': '2024-05-10T08:49:24.596397+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.596397+0000', 'last_undegraded': '2024-05-10T08:49:24.596397+0000', 'last_fullsized': '2024-05-10T08:49:24.596397+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T08:49:30.402 INFO:tasks.ceph.ceph_manager.ceph:PG 18.30 is not active+clean 2024-05-10T08:49:30.402 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.605222+0000', 'last_change': '2024-05-10T08:49:24.605222+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.605222+0000', 'last_undegraded': '2024-05-10T08:49:24.605222+0000', 'last_fullsized': '2024-05-10T08:49:24.605222+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2f is not active+clean 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599847+0000', 'last_change': '2024-05-10T08:49:24.599847+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599847+0000', 'last_undegraded': '2024-05-10T08:49:24.599847+0000', 'last_fullsized': '2024-05-10T08:49:24.599847+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2e is not active+clean 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.596292+0000', 'last_change': '2024-05-10T08:49:24.596292+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.596292+0000', 'last_undegraded': '2024-05-10T08:49:24.596292+0000', 'last_fullsized': '2024-05-10T08:49:24.596292+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2d is not active+clean 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598770+0000', 'last_change': '2024-05-10T08:49:24.598770+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598770+0000', 'last_undegraded': '2024-05-10T08:49:24.598770+0000', 'last_fullsized': '2024-05-10T08:49:24.598770+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2c is not active+clean 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599557+0000', 'last_change': '2024-05-10T08:49:24.599557+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599557+0000', 'last_undegraded': '2024-05-10T08:49:24.599557+0000', 'last_fullsized': '2024-05-10T08:49:24.599557+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2b is not active+clean 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.601137+0000', 'last_change': '2024-05-10T08:49:24.601137+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.601137+0000', 'last_undegraded': '2024-05-10T08:49:24.601137+0000', 'last_fullsized': '2024-05-10T08:49:24.601137+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.403 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2a is not active+clean 2024-05-10T08:49:30.404 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.595006+0000', 'last_change': '2024-05-10T08:49:24.595006+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.595006+0000', 'last_undegraded': '2024-05-10T08:49:24.595006+0000', 'last_fullsized': '2024-05-10T08:49:24.595006+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T08:49:30.404 INFO:tasks.ceph.ceph_manager.ceph:PG 18.29 is not active+clean 2024-05-10T08:49:30.404 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599858+0000', 'last_change': '2024-05-10T08:49:24.599858+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599858+0000', 'last_undegraded': '2024-05-10T08:49:24.599858+0000', 'last_fullsized': '2024-05-10T08:49:24.599858+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.404 INFO:tasks.ceph.ceph_manager.ceph:PG 18.28 is not active+clean 2024-05-10T08:49:30.404 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600044+0000', 'last_change': '2024-05-10T08:49:24.600044+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600044+0000', 'last_undegraded': '2024-05-10T08:49:24.600044+0000', 'last_fullsized': '2024-05-10T08:49:24.600044+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.404 INFO:tasks.ceph.ceph_manager.ceph:PG 18.27 is not active+clean 2024-05-10T08:49:30.404 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.601886+0000', 'last_change': '2024-05-10T08:49:24.601886+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.601886+0000', 'last_undegraded': '2024-05-10T08:49:24.601886+0000', 'last_fullsized': '2024-05-10T08:49:24.601886+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:PG 18.26 is not active+clean 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600569+0000', 'last_change': '2024-05-10T08:49:24.600569+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600569+0000', 'last_undegraded': '2024-05-10T08:49:24.600569+0000', 'last_fullsized': '2024-05-10T08:49:24.600569+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:PG 18.25 is not active+clean 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598326+0000', 'last_change': '2024-05-10T08:49:24.598326+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598326+0000', 'last_undegraded': '2024-05-10T08:49:24.598326+0000', 'last_fullsized': '2024-05-10T08:49:24.598326+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:PG 18.24 is not active+clean 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.605130+0000', 'last_change': '2024-05-10T08:49:24.605130+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.605130+0000', 'last_undegraded': '2024-05-10T08:49:24.605130+0000', 'last_fullsized': '2024-05-10T08:49:24.605130+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:PG 18.23 is not active+clean 2024-05-10T08:49:30.405 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599499+0000', 'last_change': '2024-05-10T08:49:24.599499+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599499+0000', 'last_undegraded': '2024-05-10T08:49:24.599499+0000', 'last_fullsized': '2024-05-10T08:49:24.599499+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:PG 18.22 is not active+clean 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.597368+0000', 'last_change': '2024-05-10T08:49:24.597368+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.597368+0000', 'last_undegraded': '2024-05-10T08:49:24.597368+0000', 'last_fullsized': '2024-05-10T08:49:24.597368+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:PG 18.21 is not active+clean 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599992+0000', 'last_change': '2024-05-10T08:49:24.599992+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599992+0000', 'last_undegraded': '2024-05-10T08:49:24.599992+0000', 'last_fullsized': '2024-05-10T08:49:24.599992+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:PG 18.20 is not active+clean 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599370+0000', 'last_change': '2024-05-10T08:49:24.599370+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599370+0000', 'last_undegraded': '2024-05-10T08:49:24.599370+0000', 'last_fullsized': '2024-05-10T08:49:24.599370+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1c is not active+clean 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599355+0000', 'last_change': '2024-05-10T08:49:24.599355+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599355+0000', 'last_undegraded': '2024-05-10T08:49:24.599355+0000', 'last_fullsized': '2024-05-10T08:49:24.599355+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.406 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1d is not active+clean 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.603434+0000', 'last_change': '2024-05-10T08:49:24.603434+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.603434+0000', 'last_undegraded': '2024-05-10T08:49:24.603434+0000', 'last_fullsized': '2024-05-10T08:49:24.603434+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1e is not active+clean 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600688+0000', 'last_change': '2024-05-10T08:49:24.600688+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600688+0000', 'last_undegraded': '2024-05-10T08:49:24.600688+0000', 'last_fullsized': '2024-05-10T08:49:24.600688+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1f is not active+clean 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600948+0000', 'last_change': '2024-05-10T08:49:24.600948+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600948+0000', 'last_undegraded': '2024-05-10T08:49:24.600948+0000', 'last_fullsized': '2024-05-10T08:49:24.600948+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:PG 18.18 is not active+clean 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598862+0000', 'last_change': '2024-05-10T08:49:24.598862+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598862+0000', 'last_undegraded': '2024-05-10T08:49:24.598862+0000', 'last_fullsized': '2024-05-10T08:49:24.598862+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:PG 18.19 is not active+clean 2024-05-10T08:49:30.407 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.595047+0000', 'last_change': '2024-05-10T08:49:24.595047+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.595047+0000', 'last_undegraded': '2024-05-10T08:49:24.595047+0000', 'last_fullsized': '2024-05-10T08:49:24.595047+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1a is not active+clean 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.596921+0000', 'last_change': '2024-05-10T08:49:24.596921+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.596921+0000', 'last_undegraded': '2024-05-10T08:49:24.596921+0000', 'last_fullsized': '2024-05-10T08:49:24.596921+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1b is not active+clean 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599587+0000', 'last_change': '2024-05-10T08:49:24.599587+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599587+0000', 'last_undegraded': '2024-05-10T08:49:24.599587+0000', 'last_fullsized': '2024-05-10T08:49:24.599587+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:PG 18.14 is not active+clean 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598368+0000', 'last_change': '2024-05-10T08:49:24.598368+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598368+0000', 'last_undegraded': '2024-05-10T08:49:24.598368+0000', 'last_fullsized': '2024-05-10T08:49:24.598368+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:PG 18.15 is not active+clean 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600801+0000', 'last_change': '2024-05-10T08:49:24.600801+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600801+0000', 'last_undegraded': '2024-05-10T08:49:24.600801+0000', 'last_fullsized': '2024-05-10T08:49:24.600801+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.408 INFO:tasks.ceph.ceph_manager.ceph:PG 18.16 is not active+clean 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.595073+0000', 'last_change': '2024-05-10T08:49:24.595073+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.595073+0000', 'last_undegraded': '2024-05-10T08:49:24.595073+0000', 'last_fullsized': '2024-05-10T08:49:24.595073+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:PG 18.17 is not active+clean 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.601493+0000', 'last_change': '2024-05-10T08:49:24.601493+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.601493+0000', 'last_undegraded': '2024-05-10T08:49:24.601493+0000', 'last_fullsized': '2024-05-10T08:49:24.601493+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:PG 18.10 is not active+clean 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.597711+0000', 'last_change': '2024-05-10T08:49:24.597711+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.597711+0000', 'last_undegraded': '2024-05-10T08:49:24.597711+0000', 'last_fullsized': '2024-05-10T08:49:24.597711+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:PG 18.11 is not active+clean 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598628+0000', 'last_change': '2024-05-10T08:49:24.598628+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598628+0000', 'last_undegraded': '2024-05-10T08:49:24.598628+0000', 'last_fullsized': '2024-05-10T08:49:24.598628+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.409 INFO:tasks.ceph.ceph_manager.ceph:PG 18.12 is not active+clean 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598086+0000', 'last_change': '2024-05-10T08:49:24.598086+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598086+0000', 'last_undegraded': '2024-05-10T08:49:24.598086+0000', 'last_fullsized': '2024-05-10T08:49:24.598086+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:PG 18.c is not active+clean 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599451+0000', 'last_change': '2024-05-10T08:49:24.599451+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599451+0000', 'last_undegraded': '2024-05-10T08:49:24.599451+0000', 'last_fullsized': '2024-05-10T08:49:24.599451+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:PG 18.d is not active+clean 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.595074+0000', 'last_change': '2024-05-10T08:49:24.595074+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.595074+0000', 'last_undegraded': '2024-05-10T08:49:24.595074+0000', 'last_fullsized': '2024-05-10T08:49:24.595074+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:PG 18.e is not active+clean 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.604327+0000', 'last_change': '2024-05-10T08:49:24.604327+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.604327+0000', 'last_undegraded': '2024-05-10T08:49:24.604327+0000', 'last_fullsized': '2024-05-10T08:49:24.604327+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.410 INFO:tasks.ceph.ceph_manager.ceph:PG 18.f is not active+clean 2024-05-10T08:49:30.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600889+0000', 'last_change': '2024-05-10T08:49:24.600889+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600889+0000', 'last_undegraded': '2024-05-10T08:49:24.600889+0000', 'last_fullsized': '2024-05-10T08:49:24.600889+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.411 INFO:tasks.ceph.ceph_manager.ceph:PG 18.8 is not active+clean 2024-05-10T08:49:30.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.604768+0000', 'last_change': '2024-05-10T08:49:24.604768+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.604768+0000', 'last_undegraded': '2024-05-10T08:49:24.604768+0000', 'last_fullsized': '2024-05-10T08:49:24.604768+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.411 INFO:tasks.ceph.ceph_manager.ceph:PG 18.9 is not active+clean 2024-05-10T08:49:30.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.597260+0000', 'last_change': '2024-05-10T08:49:24.597260+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.597260+0000', 'last_undegraded': '2024-05-10T08:49:24.597260+0000', 'last_fullsized': '2024-05-10T08:49:24.597260+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.411 INFO:tasks.ceph.ceph_manager.ceph:PG 18.a is not active+clean 2024-05-10T08:49:30.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.596476+0000', 'last_change': '2024-05-10T08:49:24.596476+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.596476+0000', 'last_undegraded': '2024-05-10T08:49:24.596476+0000', 'last_fullsized': '2024-05-10T08:49:24.596476+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.412 INFO:tasks.ceph.ceph_manager.ceph:PG 18.b is not active+clean 2024-05-10T08:49:30.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599831+0000', 'last_change': '2024-05-10T08:49:24.599831+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599831+0000', 'last_undegraded': '2024-05-10T08:49:24.599831+0000', 'last_fullsized': '2024-05-10T08:49:24.599831+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T08:49:30.412 INFO:tasks.ceph.ceph_manager.ceph:PG 18.4 is not active+clean 2024-05-10T08:49:30.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.602326+0000', 'last_change': '2024-05-10T08:49:24.602326+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.602326+0000', 'last_undegraded': '2024-05-10T08:49:24.602326+0000', 'last_fullsized': '2024-05-10T08:49:24.602326+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.412 INFO:tasks.ceph.ceph_manager.ceph:PG 18.5 is not active+clean 2024-05-10T08:49:30.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598128+0000', 'last_change': '2024-05-10T08:49:24.598128+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598128+0000', 'last_undegraded': '2024-05-10T08:49:24.598128+0000', 'last_fullsized': '2024-05-10T08:49:24.598128+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.413 INFO:tasks.ceph.ceph_manager.ceph:PG 18.6 is not active+clean 2024-05-10T08:49:30.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598271+0000', 'last_change': '2024-05-10T08:49:24.598271+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598271+0000', 'last_undegraded': '2024-05-10T08:49:24.598271+0000', 'last_fullsized': '2024-05-10T08:49:24.598271+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.413 INFO:tasks.ceph.ceph_manager.ceph:PG 18.7 is not active+clean 2024-05-10T08:49:30.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.599090+0000', 'last_change': '2024-05-10T08:49:24.599090+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.599090+0000', 'last_undegraded': '2024-05-10T08:49:24.599090+0000', 'last_fullsized': '2024-05-10T08:49:24.599090+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T08:49:30.413 INFO:tasks.ceph.ceph_manager.ceph:PG 18.0 is not active+clean 2024-05-10T08:49:30.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.604300+0000', 'last_change': '2024-05-10T08:49:24.604300+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.604300+0000', 'last_undegraded': '2024-05-10T08:49:24.604300+0000', 'last_fullsized': '2024-05-10T08:49:24.604300+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T08:49:30.414 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1 is not active+clean 2024-05-10T08:49:30.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.595044+0000', 'last_change': '2024-05-10T08:49:24.595044+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.595044+0000', 'last_undegraded': '2024-05-10T08:49:24.595044+0000', 'last_fullsized': '2024-05-10T08:49:24.595044+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T08:49:30.414 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2 is not active+clean 2024-05-10T08:49:30.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.598367+0000', 'last_change': '2024-05-10T08:49:24.598367+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.598367+0000', 'last_undegraded': '2024-05-10T08:49:24.598367+0000', 'last_fullsized': '2024-05-10T08:49:24.598367+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.414 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3 is not active+clean 2024-05-10T08:49:30.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.597883+0000', 'last_change': '2024-05-10T08:49:24.597883+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.597883+0000', 'last_undegraded': '2024-05-10T08:49:24.597883+0000', 'last_fullsized': '2024-05-10T08:49:24.597883+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T08:49:30.414 INFO:tasks.ceph.ceph_manager.ceph:PG 18.13 is not active+clean 2024-05-10T08:49:30.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-05-10T08:49:24.600696+0000', 'last_change': '2024-05-10T08:49:24.600696+0000', 'last_active': '2024-05-10T08:49:24.586497+0000', 'last_peered': '2024-05-10T08:49:24.586497+0000', 'last_clean': '2024-05-10T08:49:24.586497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T08:49:24.600696+0000', 'last_undegraded': '2024-05-10T08:49:24.600696+0000', 'last_fullsized': '2024-05-10T08:49:24.600696+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'last_clean_scrub_stamp': '2024-05-10T08:49:24.586497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T08:49:30.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T08:49:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.538+0000 7f20f9bb6640 1 Processor -- start 2024-05-10T08:49:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.538+0000 7f20f9bb6640 1 -- start start 2024-05-10T08:49:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f9bb6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20f4072840 0x7f20f415c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f9bb6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e4d0 0x7f20f40aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f9bb6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f415c920 con 0x7f20f406e0f0 2024-05-10T08:49:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f9bb6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f20f415cc00 con 0x7f20f4072840 2024-05-10T08:49:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f9bb6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f20f415cee0 con 0x7f20f406e4d0 2024-05-10T08:49:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20f4072840 0x7f20f415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f20f406e0f0 0x7f20f40d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49440/0 (socket says 172.21.15.37:49440) 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20f4072840 0x7f20f415c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43554/0 (socket says 172.21.15.37:43554) 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f37fe640 1 -- 172.21.15.37:0/1146940151 learned_addr learned my addr 172.21.15.37:0/1146940151 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f3fff640 1 --2- 172.21.15.37:0/1146940151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e4d0 0x7f20f40aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f2ffd640 1 -- 172.21.15.37:0/1146940151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e4d0 msgr2=0x7f20f40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f2ffd640 1 --2- 172.21.15.37:0/1146940151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e4d0 0x7f20f40aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.539+0000 7f20f2ffd640 1 -- 172.21.15.37:0/1146940151 >> v1:172.21.15.37:6789/0 conn(0x7f20f406e0f0 legacy=0x7f20f40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.540+0000 7f20f2ffd640 1 -- 172.21.15.37:0/1146940151 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f415d1c0 con 0x7f20f4072840 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.540+0000 7f20f27fc640 1 -- 172.21.15.37:0/1146940151 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479898201 0 0) 0x7f20f415c920 con 0x7f20f406e0f0 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.540+0000 7f20f2ffd640 1 --2- 172.21.15.37:0/1146940151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4072840 0x7f20f415c340 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f20e80097a0 tx=0x7f20e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc495cbf17adee3f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.540+0000 7f20f27fc640 1 -- 172.21.15.37:0/1146940151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8037070 con 0x7f20f4072840 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.540+0000 7f20f27fc640 1 -- 172.21.15.37:0/1146940151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e8032440 con 0x7f20f4072840 2024-05-10T08:49:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.540+0000 7f20f27fc640 1 -- 172.21.15.37:0/1146940151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8032810 con 0x7f20f4072840 2024-05-10T08:49:30.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 -- 172.21.15.37:0/1146940151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4072840 msgr2=0x7f20f415c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/1146940151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4072840 0x7f20f415c340 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f20e80097a0 tx=0x7f20e802a180 comp rx=0 tx=0).stop 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 -- 172.21.15.37:0/1146940151 shutdown_connections 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/1146940151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e4d0 0x7f20f40aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/1146940151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4072840 0x7f20f415c340 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 -- 172.21.15.37:0/1146940151 >> 172.21.15.37:0/1146940151 conn(0x7f20f406c3a0 msgr2=0x7f20f406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 -- 172.21.15.37:0/1146940151 shutdown_connections 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.541+0000 7f20f9bb6640 1 -- 172.21.15.37:0/1146940151 wait complete. 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.542+0000 7f20f9bb6640 1 Processor -- start 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.542+0000 7f20f9bb6640 1 -- start start 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f9bb6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e0f0 0x7f20f40b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f9bb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f406e4d0 0x7f20f4146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f9bb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f4072840 0x7f20f415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f9bb6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20f40ae7d0 con 0x7f20f406e4d0 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f9bb6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20f40ae650 con 0x7f20f4072840 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f9bb6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f20f41530b0 con 0x7f20f406e0f0 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f406e4d0 0x7f20f4146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f406e4d0 0x7f20f4146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43560/0 (socket says 172.21.15.37:43560) 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f2ffd640 1 -- 172.21.15.37:0/2293424706 learned_addr learned my addr 172.21.15.37:0/2293424706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.543+0000 7f20f37fe640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e0f0 0x7f20f40b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f3fff640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f4072840 0x7f20f415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f2ffd640 1 -- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e0f0 msgr2=0x7f20f40b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f2ffd640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e0f0 0x7f20f40b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f2ffd640 1 -- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f4072840 msgr2=0x7f20f415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f2ffd640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f4072840 0x7f20f415ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f2ffd640 1 -- 172.21.15.37:0/2293424706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f41f8470 con 0x7f20f406e4d0 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f3fff640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f4072840 0x7f20f415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f2ffd640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f406e4d0 0x7f20f4146660 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f20e8035040 tx=0x7f20e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20dbfff640 1 -- 172.21.15.37:0/2293424706 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8037050 con 0x7f20f406e4d0 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20dbfff640 1 -- 172.21.15.37:0/2293424706 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e8038040 con 0x7f20f406e4d0 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f41f8750 con 0x7f20f406e4d0 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20dbfff640 1 -- 172.21.15.37:0/2293424706 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8004470 con 0x7f20f406e4d0 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.544+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f41f8d10 con 0x7f20f406e4d0 2024-05-10T08:49:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.545+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f40693f0 con 0x7f20f406e4d0 2024-05-10T08:49:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.546+0000 7f20dbfff640 1 -- 172.21.15.37:0/2293424706 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f20e8030900 con 0x7f20f406e4d0 2024-05-10T08:49:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.546+0000 7f20dbfff640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f20e0076300 0x7f20e00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.546+0000 7f20dbfff640 1 -- 172.21.15.37:0/2293424706 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f20e80b81c0 con 0x7f20f406e4d0 2024-05-10T08:49:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.546+0000 7f20f37fe640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f20e0076300 0x7f20e00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.547+0000 7f20f37fe640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f20e0076300 0x7f20e00787c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000f60 tx=0x7f20e4007b50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.551+0000 7f20dbfff640 1 -- 172.21.15.37:0/2293424706 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f20e8081a20 con 0x7f20f406e4d0 2024-05-10T08:49:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.818+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f20f40affb0 con 0x7f20f406e4d0 2024-05-10T08:49:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.819+0000 7f20dbfff640 1 -- 172.21.15.37:0/2293424706 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1326 (secure 0 0 0) 0x7f20e8081320 con 0x7f20f406e4d0 2024-05-10T08:49:30.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:30.818 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":571,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":117,"num_osds":8,"num_up_osds":8,"osd_up_since":1715330409,"num_in_osds":8,"osd_in_since":1715330401,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":268058624,"bytes_avail":772826054656,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":98,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8052}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-05-10T08:48:49.450255+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-10T08:49:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f20e0076300 msgr2=0x7f20e00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f20e0076300 0x7f20e00787c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000f60 tx=0x7f20e4007b50 comp rx=0 tx=0).stop 2024-05-10T08:49:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f406e4d0 msgr2=0x7f20f4146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f406e4d0 0x7f20f4146660 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f20e8035040 tx=0x7f20e80046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 shutdown_connections 2024-05-10T08:49:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f20e0076300 0x7f20e00787c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20f4072840 0x7f20f415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f406e4d0 0x7f20f4146660 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 --2- 172.21.15.37:0/2293424706 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f20f406e0f0 0x7f20f40b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 >> 172.21.15.37:0/2293424706 conn(0x7f20f406c3a0 msgr2=0x7f20f406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 shutdown_connections 2024-05-10T08:49:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.821+0000 7f20f9bb6640 1 -- 172.21.15.37:0/2293424706 wait complete. 2024-05-10T08:49:30.831 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T08:49:30.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:49:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.936+0000 7fab885da640 1 Processor -- start 2024-05-10T08:49:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.936+0000 7fab885da640 1 -- start start 2024-05-10T08:49:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab885da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab80157540 0x7fab8015e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab885da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab800b48a0 0x7fab800ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab885da640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab8015e550 con 0x7fab8006fc30 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab885da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fab800701d0 con 0x7fab800b48a0 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab885da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fab800b3dc0 con 0x7fab80157540 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab86b77640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab800b48a0 0x7fab800ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab86b77640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab800b48a0 0x7fab800ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43566/0 (socket says 172.21.15.37:43566) 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.937+0000 7fab86b77640 1 -- 172.21.15.37:0/1124224120 learned_addr learned my addr 172.21.15.37:0/1124224120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.938+0000 7fab86376640 1 --2- 172.21.15.37:0/1124224120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab80157540 0x7fab8015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.938+0000 7fab86b77640 1 -- 172.21.15.37:0/1124224120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab80157540 msgr2=0x7fab8015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.938+0000 7fab86b77640 1 --2- 172.21.15.37:0/1124224120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab80157540 0x7fab8015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.938+0000 7fab86b77640 1 -- 172.21.15.37:0/1124224120 >> v1:172.21.15.82:6789/0 conn(0x7fab8006fc30 legacy=0x7fab800af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.938+0000 7fab86b77640 1 -- 172.21.15.37:0/1124224120 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab800b40a0 con 0x7fab800b48a0 2024-05-10T08:49:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.938+0000 7fab86376640 1 --2- 172.21.15.37:0/1124224120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab80157540 0x7fab8015e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.938+0000 7fab86b77640 1 --2- 172.21.15.37:0/1124224120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800b48a0 0x7fab800ced20 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fab78009e50 tx=0x7fab7802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35f4c8e7dbbc176 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab85374640 1 -- 172.21.15.37:0/1124224120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78036070 con 0x7fab800b48a0 2024-05-10T08:49:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab85374640 1 -- 172.21.15.37:0/1124224120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab78031600 con 0x7fab800b48a0 2024-05-10T08:49:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab85374640 1 -- 172.21.15.37:0/1124224120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab780319d0 con 0x7fab800b48a0 2024-05-10T08:49:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 -- 172.21.15.37:0/1124224120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800b48a0 msgr2=0x7fab800ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 --2- 172.21.15.37:0/1124224120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800b48a0 0x7fab800ced20 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fab78009e50 tx=0x7fab7802a6c0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 -- 172.21.15.37:0/1124224120 shutdown_connections 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 --2- 172.21.15.37:0/1124224120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800b48a0 0x7fab800ced20 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 --2- 172.21.15.37:0/1124224120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab80157540 0x7fab8015e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 -- 172.21.15.37:0/1124224120 >> 172.21.15.37:0/1124224120 conn(0x7fab8006c3a0 msgr2=0x7fab8006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 -- 172.21.15.37:0/1124224120 shutdown_connections 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.939+0000 7fab885da640 1 -- 172.21.15.37:0/1124224120 wait complete. 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.940+0000 7fab885da640 1 Processor -- start 2024-05-10T08:49:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.940+0000 7fab885da640 1 -- start start 2024-05-10T08:49:30.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab885da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8006fc30 0x7fab801597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab885da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab800b48a0 0x7fab8014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab885da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab80157540 0x7fab8015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab885da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fab80157aa0 con 0x7fab8006fc30 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab885da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fab80157920 con 0x7fab80157540 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab885da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fab800afe50 con 0x7fab800b48a0 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab86376640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8006fc30 0x7fab801597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab86376640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8006fc30 0x7fab801597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43574/0 (socket says 172.21.15.37:43574) 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab86376640 1 -- 172.21.15.37:0/215541131 learned_addr learned my addr 172.21.15.37:0/215541131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab85b75640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab800b48a0 0x7fab8014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.941+0000 7fab86b77640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab80157540 0x7fab8015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab86376640 1 -- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab800b48a0 msgr2=0x7fab8014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab86376640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab800b48a0 0x7fab8014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab86376640 1 -- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab80157540 msgr2=0x7fab8015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab86376640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab80157540 0x7fab8015c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab86376640 1 -- 172.21.15.37:0/215541131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab801f9710 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab86b77640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab80157540 0x7fab8015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab85b75640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab800b48a0 0x7fab8014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab86376640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8006fc30 0x7fab801597b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c7f0 tx=0x7fab7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab76ffd640 1 -- 172.21.15.37:0/215541131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c015070 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab76ffd640 1 -- 172.21.15.37:0/215541131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c007820 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab76ffd640 1 -- 172.21.15.37:0/215541131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c007bd0 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8014f970 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.942+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab801f8de0 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.943+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab800693f0 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.944+0000 7fab76ffd640 1 -- 172.21.15.37:0/215541131 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab7c018070 con 0x7fab8006fc30 2024-05-10T08:49:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.944+0000 7fab76ffd640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab64076300 0x7fab640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.944+0000 7fab76ffd640 1 -- 172.21.15.37:0/215541131 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fab7c0977b0 con 0x7fab8006fc30 2024-05-10T08:49:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.944+0000 7fab85b75640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab64076300 0x7fab640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.945+0000 7fab85b75640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab64076300 0x7fab640787c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fab80154e60 tx=0x7fab70009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:30.948+0000 7fab76ffd640 1 -- 172.21.15.37:0/215541131 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fab7c061010 con 0x7fab8006fc30 2024-05-10T08:49:31.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.141+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab80072780 con 0x7fab64076300 2024-05-10T08:49:31.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.147+0000 7fab76ffd640 1 -- 172.21.15.37:0/215541131 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247074 (secure 0 0 0) 0x7fab70055540 con 0x7fab64076300 2024-05-10T08:49:31.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:31.150 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab64076300 msgr2=0x7fab640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab64076300 0x7fab640787c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fab80154e60 tx=0x7fab70009040 comp rx=0 tx=0).stop 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8006fc30 msgr2=0x7fab801597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8006fc30 0x7fab801597b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c7f0 tx=0x7fab7c00ccb0 comp rx=0 tx=0).stop 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 shutdown_connections 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fab64076300 0x7fab640787c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab80157540 0x7fab8015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fab800b48a0 0x7fab8014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 --2- 172.21.15.37:0/215541131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8006fc30 0x7fab801597b0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 >> 172.21.15.37:0/215541131 conn(0x7fab8006c3a0 msgr2=0x7fab800b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 shutdown_connections 2024-05-10T08:49:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:31.150+0000 7fab885da640 1 -- 172.21.15.37:0/215541131 wait complete. 2024-05-10T08:49:31.160 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-10T08:49:29.460175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261776,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712944,"statfs":{"total":773094113280,"available":772826054656,"internally_reserved":0,"allocated":12607488,"data_stored":6480068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.872833"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595077+0000","last_change":"2024-05-10T08:49:24.595077+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595077+0000","last_undegraded":"2024-05-10T08:49:24.595077+0000","last_fullsized":"2024-05-10T08:49:24.595077+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596786+0000","last_change":"2024-05-10T08:49:24.596786+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596786+0000","last_undegraded":"2024-05-10T08:49:24.596786+0000","last_fullsized":"2024-05-10T08:49:24.596786+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596709+0000","last_change":"2024-05-10T08:49:24.596709+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596709+0000","last_undegraded":"2024-05-10T08:49:24.596709+0000","last_fullsized":"2024-05-10T08:49:24.596709+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600049+0000","last_change":"2024-05-10T08:49:24.600049+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600049+0000","last_undegraded":"2024-05-10T08:49:24.600049+0000","last_fullsized":"2024-05-10T08:49:24.600049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596062+0000","last_change":"2024-05-10T08:49:24.596062+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596062+0000","last_undegraded":"2024-05-10T08:49:24.596062+0000","last_fullsized":"2024-05-10T08:49:24.596062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602787+0000","last_change":"2024-05-10T08:49:24.602787+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602787+0000","last_undegraded":"2024-05-10T08:49:24.602787+0000","last_fullsized":"2024-05-10T08:49:24.602787+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604367+0000","last_change":"2024-05-10T08:49:24.604367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604367+0000","last_undegraded":"2024-05-10T08:49:24.604367+0000","last_fullsized":"2024-05-10T08:49:24.604367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.594672+0000","last_change":"2024-05-10T08:49:24.594672+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.594672+0000","last_undegraded":"2024-05-10T08:49:24.594672+0000","last_fullsized":"2024-05-10T08:49:24.594672+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601376+0000","last_change":"2024-05-10T08:49:24.601376+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601376+0000","last_undegraded":"2024-05-10T08:49:24.601376+0000","last_fullsized":"2024-05-10T08:49:24.601376+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600807+0000","last_change":"2024-05-10T08:49:24.600807+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600807+0000","last_undegraded":"2024-05-10T08:49:24.600807+0000","last_fullsized":"2024-05-10T08:49:24.600807+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595613+0000","last_change":"2024-05-10T08:49:24.595613+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595613+0000","last_undegraded":"2024-05-10T08:49:24.595613+0000","last_fullsized":"2024-05-10T08:49:24.595613+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605569+0000","last_change":"2024-05-10T08:49:24.605569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605569+0000","last_undegraded":"2024-05-10T08:49:24.605569+0000","last_fullsized":"2024-05-10T08:49:24.605569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600333+0000","last_change":"2024-05-10T08:49:24.600333+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600333+0000","last_undegraded":"2024-05-10T08:49:24.600333+0000","last_fullsized":"2024-05-10T08:49:24.600333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597790+0000","last_change":"2024-05-10T08:49:24.597790+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597790+0000","last_undegraded":"2024-05-10T08:49:24.597790+0000","last_fullsized":"2024-05-10T08:49:24.597790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596397+0000","last_change":"2024-05-10T08:49:24.596397+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596397+0000","last_undegraded":"2024-05-10T08:49:24.596397+0000","last_fullsized":"2024-05-10T08:49:24.596397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605222+0000","last_change":"2024-05-10T08:49:24.605222+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605222+0000","last_undegraded":"2024-05-10T08:49:24.605222+0000","last_fullsized":"2024-05-10T08:49:24.605222+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599847+0000","last_change":"2024-05-10T08:49:24.599847+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599847+0000","last_undegraded":"2024-05-10T08:49:24.599847+0000","last_fullsized":"2024-05-10T08:49:24.599847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596292+0000","last_change":"2024-05-10T08:49:24.596292+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596292+0000","last_undegraded":"2024-05-10T08:49:24.596292+0000","last_fullsized":"2024-05-10T08:49:24.596292+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598770+0000","last_change":"2024-05-10T08:49:24.598770+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598770+0000","last_undegraded":"2024-05-10T08:49:24.598770+0000","last_fullsized":"2024-05-10T08:49:24.598770+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599557+0000","last_change":"2024-05-10T08:49:24.599557+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599557+0000","last_undegraded":"2024-05-10T08:49:24.599557+0000","last_fullsized":"2024-05-10T08:49:24.599557+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601137+0000","last_change":"2024-05-10T08:49:24.601137+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601137+0000","last_undegraded":"2024-05-10T08:49:24.601137+0000","last_fullsized":"2024-05-10T08:49:24.601137+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595006+0000","last_change":"2024-05-10T08:49:24.595006+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595006+0000","last_undegraded":"2024-05-10T08:49:24.595006+0000","last_fullsized":"2024-05-10T08:49:24.595006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599858+0000","last_change":"2024-05-10T08:49:24.599858+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599858+0000","last_undegraded":"2024-05-10T08:49:24.599858+0000","last_fullsized":"2024-05-10T08:49:24.599858+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600044+0000","last_change":"2024-05-10T08:49:24.600044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600044+0000","last_undegraded":"2024-05-10T08:49:24.600044+0000","last_fullsized":"2024-05-10T08:49:24.600044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601886+0000","last_change":"2024-05-10T08:49:24.601886+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601886+0000","last_undegraded":"2024-05-10T08:49:24.601886+0000","last_fullsized":"2024-05-10T08:49:24.601886+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600569+0000","last_change":"2024-05-10T08:49:24.600569+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600569+0000","last_undegraded":"2024-05-10T08:49:24.600569+0000","last_fullsized":"2024-05-10T08:49:24.600569+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598326+0000","last_change":"2024-05-10T08:49:24.598326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598326+0000","last_undegraded":"2024-05-10T08:49:24.598326+0000","last_fullsized":"2024-05-10T08:49:24.598326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.605130+0000","last_change":"2024-05-10T08:49:24.605130+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.605130+0000","last_undegraded":"2024-05-10T08:49:24.605130+0000","last_fullsized":"2024-05-10T08:49:24.605130+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599499+0000","last_change":"2024-05-10T08:49:24.599499+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599499+0000","last_undegraded":"2024-05-10T08:49:24.599499+0000","last_fullsized":"2024-05-10T08:49:24.599499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597368+0000","last_change":"2024-05-10T08:49:24.597368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597368+0000","last_undegraded":"2024-05-10T08:49:24.597368+0000","last_fullsized":"2024-05-10T08:49:24.597368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599992+0000","last_change":"2024-05-10T08:49:24.599992+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599992+0000","last_undegraded":"2024-05-10T08:49:24.599992+0000","last_fullsized":"2024-05-10T08:49:24.599992+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599370+0000","last_change":"2024-05-10T08:49:24.599370+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599370+0000","last_undegraded":"2024-05-10T08:49:24.599370+0000","last_fullsized":"2024-05-10T08:49:24.599370+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599355+0000","last_change":"2024-05-10T08:49:24.599355+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599355+0000","last_undegraded":"2024-05-10T08:49:24.599355+0000","last_fullsized":"2024-05-10T08:49:24.599355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.607022+0000","last_change":"2024-05-10T08:49:24.605641+0000","last_active":"2024-05-10T08:49:24.607022+0000","last_peered":"2024-05-10T08:49:24.607022+0000","last_clean":"2024-05-10T08:49:24.607022+0000","last_became_active":"2024-05-10T08:49:24.605358+0000","last_became_peered":"2024-05-10T08:49:24.605358+0000","last_unstale":"2024-05-10T08:49:24.607022+0000","last_undegraded":"2024-05-10T08:49:24.607022+0000","last_fullsized":"2024-05-10T08:49:24.607022+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.603434+0000","last_change":"2024-05-10T08:49:24.603434+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.603434+0000","last_undegraded":"2024-05-10T08:49:24.603434+0000","last_fullsized":"2024-05-10T08:49:24.603434+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614220+0000","last_change":"2024-05-10T08:49:24.604270+0000","last_active":"2024-05-10T08:49:24.614220+0000","last_peered":"2024-05-10T08:49:24.614220+0000","last_clean":"2024-05-10T08:49:24.614220+0000","last_became_active":"2024-05-10T08:49:24.603998+0000","last_became_peered":"2024-05-10T08:49:24.603998+0000","last_unstale":"2024-05-10T08:49:24.614220+0000","last_undegraded":"2024-05-10T08:49:24.614220+0000","last_fullsized":"2024-05-10T08:49:24.614220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600688+0000","last_change":"2024-05-10T08:49:24.600688+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600688+0000","last_undegraded":"2024-05-10T08:49:24.600688+0000","last_fullsized":"2024-05-10T08:49:24.600688+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616768+0000","last_change":"2024-05-10T08:49:24.615247+0000","last_active":"2024-05-10T08:49:24.616768+0000","last_peered":"2024-05-10T08:49:24.616768+0000","last_clean":"2024-05-10T08:49:24.616768+0000","last_became_active":"2024-05-10T08:49:24.614956+0000","last_became_peered":"2024-05-10T08:49:24.614956+0000","last_unstale":"2024-05-10T08:49:24.616768+0000","last_undegraded":"2024-05-10T08:49:24.616768+0000","last_fullsized":"2024-05-10T08:49:24.616768+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600948+0000","last_change":"2024-05-10T08:49:24.600948+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600948+0000","last_undegraded":"2024-05-10T08:49:24.600948+0000","last_fullsized":"2024-05-10T08:49:24.600948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614099+0000","last_change":"2024-05-10T08:49:24.605015+0000","last_active":"2024-05-10T08:49:24.614099+0000","last_peered":"2024-05-10T08:49:24.614099+0000","last_clean":"2024-05-10T08:49:24.614099+0000","last_became_active":"2024-05-10T08:49:24.604737+0000","last_became_peered":"2024-05-10T08:49:24.604737+0000","last_unstale":"2024-05-10T08:49:24.614099+0000","last_undegraded":"2024-05-10T08:49:24.614099+0000","last_fullsized":"2024-05-10T08:49:24.614099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598862+0000","last_change":"2024-05-10T08:49:24.598862+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598862+0000","last_undegraded":"2024-05-10T08:49:24.598862+0000","last_fullsized":"2024-05-10T08:49:24.598862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605913+0000","last_change":"2024-05-10T08:49:24.603241+0000","last_active":"2024-05-10T08:49:24.605913+0000","last_peered":"2024-05-10T08:49:24.605913+0000","last_clean":"2024-05-10T08:49:24.605913+0000","last_became_active":"2024-05-10T08:49:24.602715+0000","last_became_peered":"2024-05-10T08:49:24.602715+0000","last_unstale":"2024-05-10T08:49:24.605913+0000","last_undegraded":"2024-05-10T08:49:24.605913+0000","last_fullsized":"2024-05-10T08:49:24.605913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:38.914133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595047+0000","last_change":"2024-05-10T08:49:24.595047+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595047+0000","last_undegraded":"2024-05-10T08:49:24.595047+0000","last_fullsized":"2024-05-10T08:49:24.595047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614631+0000","last_change":"2024-05-10T08:49:24.611527+0000","last_active":"2024-05-10T08:49:24.614631+0000","last_peered":"2024-05-10T08:49:24.614631+0000","last_clean":"2024-05-10T08:49:24.614631+0000","last_became_active":"2024-05-10T08:49:24.611240+0000","last_became_peered":"2024-05-10T08:49:24.611240+0000","last_unstale":"2024-05-10T08:49:24.614631+0000","last_undegraded":"2024-05-10T08:49:24.614631+0000","last_fullsized":"2024-05-10T08:49:24.614631+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:55.542337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596921+0000","last_change":"2024-05-10T08:49:24.596921+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596921+0000","last_undegraded":"2024-05-10T08:49:24.596921+0000","last_fullsized":"2024-05-10T08:49:24.596921+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608849+0000","last_change":"2024-05-10T08:49:24.607869+0000","last_active":"2024-05-10T08:49:24.608849+0000","last_peered":"2024-05-10T08:49:24.608849+0000","last_clean":"2024-05-10T08:49:24.608849+0000","last_became_active":"2024-05-10T08:49:24.607585+0000","last_became_peered":"2024-05-10T08:49:24.607585+0000","last_unstale":"2024-05-10T08:49:24.608849+0000","last_undegraded":"2024-05-10T08:49:24.608849+0000","last_fullsized":"2024-05-10T08:49:24.608849+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:19.236787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599587+0000","last_change":"2024-05-10T08:49:24.599587+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599587+0000","last_undegraded":"2024-05-10T08:49:24.599587+0000","last_fullsized":"2024-05-10T08:49:24.599587+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619683+0000","last_change":"2024-05-10T08:49:24.616592+0000","last_active":"2024-05-10T08:49:24.619683+0000","last_peered":"2024-05-10T08:49:24.619683+0000","last_clean":"2024-05-10T08:49:24.619683+0000","last_became_active":"2024-05-10T08:49:24.616144+0000","last_became_peered":"2024-05-10T08:49:24.616144+0000","last_unstale":"2024-05-10T08:49:24.619683+0000","last_undegraded":"2024-05-10T08:49:24.619683+0000","last_fullsized":"2024-05-10T08:49:24.619683+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:08.054238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598368+0000","last_change":"2024-05-10T08:49:24.598368+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598368+0000","last_undegraded":"2024-05-10T08:49:24.598368+0000","last_fullsized":"2024-05-10T08:49:24.598368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614937+0000","last_change":"2024-05-10T08:49:24.614099+0000","last_active":"2024-05-10T08:49:24.614937+0000","last_peered":"2024-05-10T08:49:24.614937+0000","last_clean":"2024-05-10T08:49:24.614937+0000","last_became_active":"2024-05-10T08:49:24.613780+0000","last_became_peered":"2024-05-10T08:49:24.613780+0000","last_unstale":"2024-05-10T08:49:24.614937+0000","last_undegraded":"2024-05-10T08:49:24.614937+0000","last_fullsized":"2024-05-10T08:49:24.614937+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600801+0000","last_change":"2024-05-10T08:49:24.600801+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600801+0000","last_undegraded":"2024-05-10T08:49:24.600801+0000","last_fullsized":"2024-05-10T08:49:24.600801+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.610588+0000","last_change":"2024-05-10T08:49:24.608713+0000","last_active":"2024-05-10T08:49:24.610588+0000","last_peered":"2024-05-10T08:49:24.610588+0000","last_clean":"2024-05-10T08:49:24.610588+0000","last_became_active":"2024-05-10T08:49:24.608441+0000","last_became_peered":"2024-05-10T08:49:24.608441+0000","last_unstale":"2024-05-10T08:49:24.610588+0000","last_undegraded":"2024-05-10T08:49:24.610588+0000","last_fullsized":"2024-05-10T08:49:24.610588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:29.670353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595073+0000","last_change":"2024-05-10T08:49:24.595073+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595073+0000","last_undegraded":"2024-05-10T08:49:24.595073+0000","last_fullsized":"2024-05-10T08:49:24.595073+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.614415+0000","last_change":"2024-05-10T08:49:24.612764+0000","last_active":"2024-05-10T08:49:24.614415+0000","last_peered":"2024-05-10T08:49:24.614415+0000","last_clean":"2024-05-10T08:49:24.614415+0000","last_became_active":"2024-05-10T08:49:24.612363+0000","last_became_peered":"2024-05-10T08:49:24.612363+0000","last_unstale":"2024-05-10T08:49:24.614415+0000","last_undegraded":"2024-05-10T08:49:24.614415+0000","last_fullsized":"2024-05-10T08:49:24.614415+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:21.634515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.601493+0000","last_change":"2024-05-10T08:49:24.601493+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.601493+0000","last_undegraded":"2024-05-10T08:49:24.601493+0000","last_fullsized":"2024-05-10T08:49:24.601493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.606216+0000","last_change":"2024-05-10T08:49:24.602612+0000","last_active":"2024-05-10T08:49:24.606216+0000","last_peered":"2024-05-10T08:49:24.606216+0000","last_clean":"2024-05-10T08:49:24.606216+0000","last_became_active":"2024-05-10T08:49:24.602252+0000","last_became_peered":"2024-05-10T08:49:24.602252+0000","last_unstale":"2024-05-10T08:49:24.606216+0000","last_undegraded":"2024-05-10T08:49:24.606216+0000","last_fullsized":"2024-05-10T08:49:24.606216+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:41:59.078558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597711+0000","last_change":"2024-05-10T08:49:24.597711+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597711+0000","last_undegraded":"2024-05-10T08:49:24.597711+0000","last_fullsized":"2024-05-10T08:49:24.597711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608495+0000","last_change":"2024-05-10T08:49:24.607083+0000","last_active":"2024-05-10T08:49:24.608495+0000","last_peered":"2024-05-10T08:49:24.608495+0000","last_clean":"2024-05-10T08:49:24.608495+0000","last_became_active":"2024-05-10T08:49:24.606742+0000","last_became_peered":"2024-05-10T08:49:24.606742+0000","last_unstale":"2024-05-10T08:49:24.608495+0000","last_undegraded":"2024-05-10T08:49:24.608495+0000","last_fullsized":"2024-05-10T08:49:24.608495+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:58.863821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598628+0000","last_change":"2024-05-10T08:49:24.598628+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598628+0000","last_undegraded":"2024-05-10T08:49:24.598628+0000","last_fullsized":"2024-05-10T08:49:24.598628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612086+0000","last_change":"2024-05-10T08:49:24.607947+0000","last_active":"2024-05-10T08:49:24.612086+0000","last_peered":"2024-05-10T08:49:24.612086+0000","last_clean":"2024-05-10T08:49:24.612086+0000","last_became_active":"2024-05-10T08:49:24.606257+0000","last_became_peered":"2024-05-10T08:49:24.606257+0000","last_unstale":"2024-05-10T08:49:24.612086+0000","last_undegraded":"2024-05-10T08:49:24.612086+0000","last_fullsized":"2024-05-10T08:49:24.612086+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:47.247345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598086+0000","last_change":"2024-05-10T08:49:24.598086+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598086+0000","last_undegraded":"2024-05-10T08:49:24.598086+0000","last_fullsized":"2024-05-10T08:49:24.598086+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.605220+0000","last_change":"2024-05-10T08:49:24.601162+0000","last_active":"2024-05-10T08:49:24.605220+0000","last_peered":"2024-05-10T08:49:24.605220+0000","last_clean":"2024-05-10T08:49:24.605220+0000","last_became_active":"2024-05-10T08:49:24.600846+0000","last_became_peered":"2024-05-10T08:49:24.600846+0000","last_unstale":"2024-05-10T08:49:24.605220+0000","last_undegraded":"2024-05-10T08:49:24.605220+0000","last_fullsized":"2024-05-10T08:49:24.605220+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:16.315391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599451+0000","last_change":"2024-05-10T08:49:24.599451+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599451+0000","last_undegraded":"2024-05-10T08:49:24.599451+0000","last_fullsized":"2024-05-10T08:49:24.599451+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619016+0000","last_change":"2024-05-10T08:49:24.615565+0000","last_active":"2024-05-10T08:49:24.619016+0000","last_peered":"2024-05-10T08:49:24.619016+0000","last_clean":"2024-05-10T08:49:24.619016+0000","last_became_active":"2024-05-10T08:49:24.615280+0000","last_became_peered":"2024-05-10T08:49:24.615280+0000","last_unstale":"2024-05-10T08:49:24.619016+0000","last_undegraded":"2024-05-10T08:49:24.619016+0000","last_fullsized":"2024-05-10T08:49:24.619016+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595074+0000","last_change":"2024-05-10T08:49:24.595074+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595074+0000","last_undegraded":"2024-05-10T08:49:24.595074+0000","last_fullsized":"2024-05-10T08:49:24.595074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616317+0000","last_change":"2024-05-10T08:49:24.613433+0000","last_active":"2024-05-10T08:49:24.616317+0000","last_peered":"2024-05-10T08:49:24.616317+0000","last_clean":"2024-05-10T08:49:24.616317+0000","last_became_active":"2024-05-10T08:49:24.613090+0000","last_became_peered":"2024-05-10T08:49:24.613090+0000","last_unstale":"2024-05-10T08:49:24.616317+0000","last_undegraded":"2024-05-10T08:49:24.616317+0000","last_fullsized":"2024-05-10T08:49:24.616317+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:35:50.740398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604327+0000","last_change":"2024-05-10T08:49:24.604327+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604327+0000","last_undegraded":"2024-05-10T08:49:24.604327+0000","last_fullsized":"2024-05-10T08:49:24.604327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.612170+0000","last_change":"2024-05-10T08:49:24.610562+0000","last_active":"2024-05-10T08:49:24.612170+0000","last_peered":"2024-05-10T08:49:24.612170+0000","last_clean":"2024-05-10T08:49:24.612170+0000","last_became_active":"2024-05-10T08:49:24.610152+0000","last_became_peered":"2024-05-10T08:49:24.610152+0000","last_unstale":"2024-05-10T08:49:24.612170+0000","last_undegraded":"2024-05-10T08:49:24.612170+0000","last_fullsized":"2024-05-10T08:49:24.612170+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:51:12.144862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600889+0000","last_change":"2024-05-10T08:49:24.600889+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600889+0000","last_undegraded":"2024-05-10T08:49:24.600889+0000","last_fullsized":"2024-05-10T08:49:24.600889+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.616795+0000","last_change":"2024-05-10T08:49:24.615638+0000","last_active":"2024-05-10T08:49:24.616795+0000","last_peered":"2024-05-10T08:49:24.616795+0000","last_clean":"2024-05-10T08:49:24.616795+0000","last_became_active":"2024-05-10T08:49:24.615399+0000","last_became_peered":"2024-05-10T08:49:24.615399+0000","last_unstale":"2024-05-10T08:49:24.616795+0000","last_undegraded":"2024-05-10T08:49:24.616795+0000","last_fullsized":"2024-05-10T08:49:24.616795+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604768+0000","last_change":"2024-05-10T08:49:24.604768+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604768+0000","last_undegraded":"2024-05-10T08:49:24.604768+0000","last_fullsized":"2024-05-10T08:49:24.604768+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619031+0000","last_change":"2024-05-10T08:49:24.612901+0000","last_active":"2024-05-10T08:49:24.619031+0000","last_peered":"2024-05-10T08:49:24.619031+0000","last_clean":"2024-05-10T08:49:24.619031+0000","last_became_active":"2024-05-10T08:49:24.612581+0000","last_became_peered":"2024-05-10T08:49:24.612581+0000","last_unstale":"2024-05-10T08:49:24.619031+0000","last_undegraded":"2024-05-10T08:49:24.619031+0000","last_fullsized":"2024-05-10T08:49:24.619031+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:29.603142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597260+0000","last_change":"2024-05-10T08:49:24.597260+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597260+0000","last_undegraded":"2024-05-10T08:49:24.597260+0000","last_fullsized":"2024-05-10T08:49:24.597260+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611462+0000","last_change":"2024-05-10T08:49:24.609174+0000","last_active":"2024-05-10T08:49:24.611462+0000","last_peered":"2024-05-10T08:49:24.611462+0000","last_clean":"2024-05-10T08:49:24.611462+0000","last_became_active":"2024-05-10T08:49:24.608853+0000","last_became_peered":"2024-05-10T08:49:24.608853+0000","last_unstale":"2024-05-10T08:49:24.611462+0000","last_undegraded":"2024-05-10T08:49:24.611462+0000","last_fullsized":"2024-05-10T08:49:24.611462+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:06:18.077006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.596476+0000","last_change":"2024-05-10T08:49:24.596476+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.596476+0000","last_undegraded":"2024-05-10T08:49:24.596476+0000","last_fullsized":"2024-05-10T08:49:24.596476+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619255+0000","last_change":"2024-05-10T08:49:24.613705+0000","last_active":"2024-05-10T08:49:24.619255+0000","last_peered":"2024-05-10T08:49:24.619255+0000","last_clean":"2024-05-10T08:49:24.619255+0000","last_became_active":"2024-05-10T08:49:24.613437+0000","last_became_peered":"2024-05-10T08:49:24.613437+0000","last_unstale":"2024-05-10T08:49:24.619255+0000","last_undegraded":"2024-05-10T08:49:24.619255+0000","last_fullsized":"2024-05-10T08:49:24.619255+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:54.519083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599831+0000","last_change":"2024-05-10T08:49:24.599831+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599831+0000","last_undegraded":"2024-05-10T08:49:24.599831+0000","last_fullsized":"2024-05-10T08:49:24.599831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615852+0000","last_change":"2024-05-10T08:49:24.614766+0000","last_active":"2024-05-10T08:49:24.615852+0000","last_peered":"2024-05-10T08:49:24.615852+0000","last_clean":"2024-05-10T08:49:24.615852+0000","last_became_active":"2024-05-10T08:49:24.614473+0000","last_became_peered":"2024-05-10T08:49:24.614473+0000","last_unstale":"2024-05-10T08:49:24.615852+0000","last_undegraded":"2024-05-10T08:49:24.615852+0000","last_fullsized":"2024-05-10T08:49:24.615852+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.602326+0000","last_change":"2024-05-10T08:49:24.602326+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.602326+0000","last_undegraded":"2024-05-10T08:49:24.602326+0000","last_fullsized":"2024-05-10T08:49:24.602326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.618963+0000","last_change":"2024-05-10T08:49:24.612126+0000","last_active":"2024-05-10T08:49:24.618963+0000","last_peered":"2024-05-10T08:49:24.618963+0000","last_clean":"2024-05-10T08:49:24.618963+0000","last_became_active":"2024-05-10T08:49:24.611698+0000","last_became_peered":"2024-05-10T08:49:24.611698+0000","last_unstale":"2024-05-10T08:49:24.618963+0000","last_undegraded":"2024-05-10T08:49:24.618963+0000","last_fullsized":"2024-05-10T08:49:24.618963+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:59.540500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598128+0000","last_change":"2024-05-10T08:49:24.598128+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598128+0000","last_undegraded":"2024-05-10T08:49:24.598128+0000","last_fullsized":"2024-05-10T08:49:24.598128+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.615041+0000","last_change":"2024-05-10T08:49:24.614157+0000","last_active":"2024-05-10T08:49:24.615041+0000","last_peered":"2024-05-10T08:49:24.615041+0000","last_clean":"2024-05-10T08:49:24.615041+0000","last_became_active":"2024-05-10T08:49:24.613727+0000","last_became_peered":"2024-05-10T08:49:24.613727+0000","last_unstale":"2024-05-10T08:49:24.615041+0000","last_undegraded":"2024-05-10T08:49:24.615041+0000","last_fullsized":"2024-05-10T08:49:24.615041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598271+0000","last_change":"2024-05-10T08:49:24.598271+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598271+0000","last_undegraded":"2024-05-10T08:49:24.598271+0000","last_fullsized":"2024-05-10T08:49:24.598271+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613193+0000","last_change":"2024-05-10T08:49:24.611676+0000","last_active":"2024-05-10T08:49:24.613193+0000","last_peered":"2024-05-10T08:49:24.613193+0000","last_clean":"2024-05-10T08:49:24.613193+0000","last_became_active":"2024-05-10T08:49:24.611373+0000","last_became_peered":"2024-05-10T08:49:24.611373+0000","last_unstale":"2024-05-10T08:49:24.613193+0000","last_undegraded":"2024-05-10T08:49:24.613193+0000","last_fullsized":"2024-05-10T08:49:24.613193+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.599090+0000","last_change":"2024-05-10T08:49:24.599090+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.599090+0000","last_undegraded":"2024-05-10T08:49:24.599090+0000","last_fullsized":"2024-05-10T08:49:24.599090+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619626+0000","last_change":"2024-05-10T08:49:24.615827+0000","last_active":"2024-05-10T08:49:24.619626+0000","last_peered":"2024-05-10T08:49:24.619626+0000","last_clean":"2024-05-10T08:49:24.619626+0000","last_became_active":"2024-05-10T08:49:24.615518+0000","last_became_peered":"2024-05-10T08:49:24.615518+0000","last_unstale":"2024-05-10T08:49:24.619626+0000","last_undegraded":"2024-05-10T08:49:24.619626+0000","last_fullsized":"2024-05-10T08:49:24.619626+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:18:28.973442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.604300+0000","last_change":"2024-05-10T08:49:24.604300+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.604300+0000","last_undegraded":"2024-05-10T08:49:24.604300+0000","last_fullsized":"2024-05-10T08:49:24.604300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608142+0000","last_change":"2024-05-10T08:49:24.606919+0000","last_active":"2024-05-10T08:49:24.608142+0000","last_peered":"2024-05-10T08:49:24.608142+0000","last_clean":"2024-05-10T08:49:24.608142+0000","last_became_active":"2024-05-10T08:49:24.606647+0000","last_became_peered":"2024-05-10T08:49:24.606647+0000","last_unstale":"2024-05-10T08:49:24.608142+0000","last_undegraded":"2024-05-10T08:49:24.608142+0000","last_fullsized":"2024-05-10T08:49:24.608142+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:30.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.595044+0000","last_change":"2024-05-10T08:49:24.595044+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.595044+0000","last_undegraded":"2024-05-10T08:49:24.595044+0000","last_fullsized":"2024-05-10T08:49:24.595044+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.608188+0000","last_change":"2024-05-10T08:49:24.605573+0000","last_active":"2024-05-10T08:49:24.608188+0000","last_peered":"2024-05-10T08:49:24.608188+0000","last_clean":"2024-05-10T08:49:24.608188+0000","last_became_active":"2024-05-10T08:49:24.605298+0000","last_became_peered":"2024-05-10T08:49:24.605298+0000","last_unstale":"2024-05-10T08:49:24.608188+0000","last_undegraded":"2024-05-10T08:49:24.608188+0000","last_fullsized":"2024-05-10T08:49:24.608188+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:31.211848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.598367+0000","last_change":"2024-05-10T08:49:24.598367+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.598367+0000","last_undegraded":"2024-05-10T08:49:24.598367+0000","last_fullsized":"2024-05-10T08:49:24.598367+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.619704+0000","last_change":"2024-05-10T08:49:24.616821+0000","last_active":"2024-05-10T08:49:24.619704+0000","last_peered":"2024-05-10T08:49:24.619704+0000","last_clean":"2024-05-10T08:49:24.619704+0000","last_became_active":"2024-05-10T08:49:24.616451+0000","last_became_peered":"2024-05-10T08:49:24.616451+0000","last_unstale":"2024-05-10T08:49:24.619704+0000","last_undegraded":"2024-05-10T08:49:24.619704+0000","last_fullsized":"2024-05-10T08:49:24.619704+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:32.831419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.597883+0000","last_change":"2024-05-10T08:49:24.597883+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.597883+0000","last_undegraded":"2024-05-10T08:49:24.597883+0000","last_fullsized":"2024-05-10T08:49:24.597883+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.611520+0000","last_change":"2024-05-10T08:49:24.609428+0000","last_active":"2024-05-10T08:49:24.611520+0000","last_peered":"2024-05-10T08:49:24.611520+0000","last_clean":"2024-05-10T08:49:24.611520+0000","last_became_active":"2024-05-10T08:49:24.609148+0000","last_became_peered":"2024-05-10T08:49:24.609148+0000","last_unstale":"2024-05-10T08:49:24.611520+0000","last_undegraded":"2024-05-10T08:49:24.611520+0000","last_fullsized":"2024-05-10T08:49:24.611520+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:49.762296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-05-10T08:49:24.600696+0000","last_change":"2024-05-10T08:49:24.600696+0000","last_active":"2024-05-10T08:49:24.586497+0000","last_peered":"2024-05-10T08:49:24.586497+0000","last_clean":"2024-05-10T08:49:24.586497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T08:49:24.600696+0000","last_undegraded":"2024-05-10T08:49:24.600696+0000","last_fullsized":"2024-05-10T08:49:24.600696+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.613910+0000","last_change":"2024-05-10T08:49:24.608777+0000","last_active":"2024-05-10T08:49:24.613910+0000","last_peered":"2024-05-10T08:49:24.613910+0000","last_clean":"2024-05-10T08:49:24.613910+0000","last_became_active":"2024-05-10T08:49:24.608491+0000","last_became_peered":"2024-05-10T08:49:24.608491+0000","last_unstale":"2024-05-10T08:49:24.613910+0000","last_undegraded":"2024-05-10T08:49:24.613910+0000","last_fullsized":"2024-05-10T08:49:24.613910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:58.506187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":288,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-10T08:49:24.602081+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:49:24.602081+0000","last_peered":"2024-05-10T08:49:24.602081+0000","last_clean":"2024-05-10T08:49:24.602081+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:49:24.602081+0000","last_undegraded":"2024-05-10T08:49:24.602081+0000","last_fullsized":"2024-05-10T08:49:24.602081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33148,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338692,"statfs":{"total":96636764160,"available":96602820608,"internally_reserved":0,"allocated":2015232,"data_stored":1249451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":665750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1421312,"data_stored":659083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2027520,"data_stored":1256118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:49:34.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:49:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.283+0000 7f41c5baf640 1 Processor -- start 2024-05-10T08:49:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.283+0000 7f41c5baf640 1 -- start start 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41c5baf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41c01629b0 0x7f41c006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41c5baf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41c0070d20 0x7f41c00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41c5baf640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c006e110 con 0x7f41c00b2490 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41c5baf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f41c0070a40 con 0x7f41c01629b0 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41c5baf640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f41c006dec0 con 0x7f41c0070d20 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41c01629b0 0x7f41c006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41c01629b0 0x7f41c006eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43580/0 (socket says 172.21.15.37:43580) 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bf7fe640 1 -- 172.21.15.37:0/3099650732 learned_addr learned my addr 172.21.15.37:0/3099650732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bffff640 1 --2- 172.21.15.37:0/3099650732 >> v2:172.21.15.82:3300/0 conn(0x7f41c0070d20 0x7f41c00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bf7fe640 1 -- 172.21.15.37:0/3099650732 >> v2:172.21.15.82:3300/0 conn(0x7f41c0070d20 msgr2=0x7f41c00711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bf7fe640 1 --2- 172.21.15.37:0/3099650732 >> v2:172.21.15.82:3300/0 conn(0x7f41c0070d20 0x7f41c00711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bf7fe640 1 -- 172.21.15.37:0/3099650732 >> v1:172.21.15.82:6789/0 conn(0x7f41c00b2490 legacy=0x7f41c0070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.284+0000 7f41bf7fe640 1 -- 172.21.15.37:0/3099650732 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c006e3f0 con 0x7f41c01629b0 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.285+0000 7f41bffff640 1 --2- 172.21.15.37:0/3099650732 >> v2:172.21.15.82:3300/0 conn(0x7f41c0070d20 0x7f41c00711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.285+0000 7f41bf7fe640 1 --2- 172.21.15.37:0/3099650732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c01629b0 0x7f41c006eed0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f41c0073f60 tx=0x7f41b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6094bf4d08e55e92 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.285+0000 7f41be7fc640 1 -- 172.21.15.37:0/3099650732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0037070 con 0x7f41c01629b0 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.285+0000 7f41be7fc640 1 -- 172.21.15.37:0/3099650732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b0032440 con 0x7f41c01629b0 2024-05-10T08:49:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.285+0000 7f41be7fc640 1 -- 172.21.15.37:0/3099650732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0032810 con 0x7f41c01629b0 2024-05-10T08:49:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 -- 172.21.15.37:0/3099650732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c01629b0 msgr2=0x7f41c006eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 --2- 172.21.15.37:0/3099650732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c01629b0 0x7f41c006eed0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f41c0073f60 tx=0x7f41b002a230 comp rx=0 tx=0).stop 2024-05-10T08:49:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 -- 172.21.15.37:0/3099650732 shutdown_connections 2024-05-10T08:49:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 --2- 172.21.15.37:0/3099650732 >> v2:172.21.15.82:3300/0 conn(0x7f41c0070d20 0x7f41c00711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 --2- 172.21.15.37:0/3099650732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c01629b0 0x7f41c006eed0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 -- 172.21.15.37:0/3099650732 >> 172.21.15.37:0/3099650732 conn(0x7f41c00b49d0 msgr2=0x7f41c00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 -- 172.21.15.37:0/3099650732 shutdown_connections 2024-05-10T08:49:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.286+0000 7f41c5baf640 1 -- 172.21.15.37:0/3099650732 wait complete. 2024-05-10T08:49:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.287+0000 7f41c5baf640 1 Processor -- start 2024-05-10T08:49:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41c5baf640 1 -- start start 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41c5baf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c0070d20 0x7f41c00b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41c5baf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c00b2490 0x7f41c00c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41c5baf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c01629b0 0x7f41c0147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41c5baf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41c006f410 con 0x7f41c0070d20 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41c5baf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41c006e9b0 con 0x7f41c00b2490 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41c5baf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f41c00afcb0 con 0x7f41c01629b0 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41bf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c0070d20 0x7f41c00b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41bf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c0070d20 0x7f41c00b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43594/0 (socket says 172.21.15.37:43594) 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.288+0000 7f41bf7fe640 1 -- 172.21.15.37:0/2099523303 learned_addr learned my addr 172.21.15.37:0/2099523303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41beffd640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c00b2490 0x7f41c00c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41bffff640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c01629b0 0x7f41c0147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41bf7fe640 1 -- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c01629b0 msgr2=0x7f41c0147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41bf7fe640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c01629b0 0x7f41c0147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41bf7fe640 1 -- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c00b2490 msgr2=0x7f41c00c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41bf7fe640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c00b2490 0x7f41c00c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41bf7fe640 1 -- 172.21.15.37:0/2099523303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c01577f0 con 0x7f41c0070d20 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41beffd640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c00b2490 0x7f41c00c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41bf7fe640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c0070d20 0x7f41c00b5ac0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f41b002a270 tx=0x7f41b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41a7fff640 1 -- 172.21.15.37:0/2099523303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0041070 con 0x7f41c0070d20 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41a7fff640 1 -- 172.21.15.37:0/2099523303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b003c870 con 0x7f41c0070d20 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c01480f0 con 0x7f41c0070d20 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41a7fff640 1 -- 172.21.15.37:0/2099523303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0037040 con 0x7f41c0070d20 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.289+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c00b8490 con 0x7f41c0070d20 2024-05-10T08:49:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.290+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c00693f0 con 0x7f41c0070d20 2024-05-10T08:49:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.291+0000 7f41a7fff640 1 -- 172.21.15.37:0/2099523303 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f41b0044070 con 0x7f41c0070d20 2024-05-10T08:49:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.291+0000 7f41a7fff640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f41ac0762d0 0x7f41ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.292+0000 7f41a7fff640 1 -- 172.21.15.37:0/2099523303 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f41b00b82c0 con 0x7f41c0070d20 2024-05-10T08:49:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.292+0000 7f41beffd640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f41ac0762d0 0x7f41ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.292+0000 7f41beffd640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f41ac0762d0 0x7f41ac078790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f41c00b7590 tx=0x7f41b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.296+0000 7f41a7fff640 1 -- 172.21.15.37:0/2099523303 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f41c01577f0 con 0x7f41c0070d20 2024-05-10T08:49:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.482+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41c00b8b50 con 0x7f41ac0762d0 2024-05-10T08:49:34.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.489+0000 7f41a7fff640 1 -- 172.21.15.37:0/2099523303 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252477 (secure 0 0 0) 0x7f41b4056a50 con 0x7f41ac0762d0 2024-05-10T08:49:34.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:34.491 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f41ac0762d0 msgr2=0x7f41ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f41ac0762d0 0x7f41ac078790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f41c00b7590 tx=0x7f41b4009040 comp rx=0 tx=0).stop 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c0070d20 msgr2=0x7f41c00b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c0070d20 0x7f41c00b5ac0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f41b002a270 tx=0x7f41b00046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 shutdown_connections 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f41ac0762d0 0x7f41ac078790 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41c01629b0 0x7f41c0147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c00b2490 0x7f41c00c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 --2- 172.21.15.37:0/2099523303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41c0070d20 0x7f41c00b5ac0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 >> 172.21.15.37:0/2099523303 conn(0x7f41c00b49d0 msgr2=0x7f41c00b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 shutdown_connections 2024-05-10T08:49:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.492+0000 7f41c5baf640 1 -- 172.21.15.37:0/2099523303 wait complete. 2024-05-10T08:49:34.502 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2024-05-10T08:49:33.461152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262084,"kb_used_data":12616,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712636,"statfs":{"total":773094113280,"available":772825739264,"internally_reserved":0,"allocated":12918784,"data_stored":6622428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002016"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.004009+0000","last_change":"2024-05-10T08:49:25.617989+0000","last_active":"2024-05-10T08:49:27.004009+0000","last_peered":"2024-05-10T08:49:27.004009+0000","last_clean":"2024-05-10T08:49:27.004009+0000","last_became_active":"2024-05-10T08:49:25.617650+0000","last_became_peered":"2024-05-10T08:49:25.617650+0000","last_unstale":"2024-05-10T08:49:27.004009+0000","last_undegraded":"2024-05-10T08:49:27.004009+0000","last_fullsized":"2024-05-10T08:49:27.004009+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:27.814774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614798+0000","last_change":"2024-05-10T08:49:25.633158+0000","last_active":"2024-05-10T08:49:26.614798+0000","last_peered":"2024-05-10T08:49:26.614798+0000","last_clean":"2024-05-10T08:49:26.614798+0000","last_became_active":"2024-05-10T08:49:25.632827+0000","last_became_peered":"2024-05-10T08:49:25.632827+0000","last_unstale":"2024-05-10T08:49:26.614798+0000","last_undegraded":"2024-05-10T08:49:26.614798+0000","last_fullsized":"2024-05-10T08:49:26.614798+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:09.059210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614851+0000","last_change":"2024-05-10T08:49:25.628442+0000","last_active":"2024-05-10T08:49:26.614851+0000","last_peered":"2024-05-10T08:49:26.614851+0000","last_clean":"2024-05-10T08:49:26.614851+0000","last_became_active":"2024-05-10T08:49:25.628124+0000","last_became_peered":"2024-05-10T08:49:25.628124+0000","last_unstale":"2024-05-10T08:49:26.614851+0000","last_undegraded":"2024-05-10T08:49:26.614851+0000","last_fullsized":"2024-05-10T08:49:26.614851+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:29:33.836391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909712+0000","last_change":"2024-05-10T08:49:25.627657+0000","last_active":"2024-05-10T08:49:27.909712+0000","last_peered":"2024-05-10T08:49:27.909712+0000","last_clean":"2024-05-10T08:49:27.909712+0000","last_became_active":"2024-05-10T08:49:25.627363+0000","last_became_peered":"2024-05-10T08:49:25.627363+0000","last_unstale":"2024-05-10T08:49:27.909712+0000","last_undegraded":"2024-05-10T08:49:27.909712+0000","last_fullsized":"2024-05-10T08:49:27.909712+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:57.564149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003668+0000","last_change":"2024-05-10T08:49:25.625858+0000","last_active":"2024-05-10T08:49:27.003668+0000","last_peered":"2024-05-10T08:49:27.003668+0000","last_clean":"2024-05-10T08:49:27.003668+0000","last_became_active":"2024-05-10T08:49:25.625599+0000","last_became_peered":"2024-05-10T08:49:25.625599+0000","last_unstale":"2024-05-10T08:49:27.003668+0000","last_undegraded":"2024-05-10T08:49:27.003668+0000","last_fullsized":"2024-05-10T08:49:27.003668+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:18:41.719120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.620874+0000","last_change":"2024-05-10T08:49:25.624050+0000","last_active":"2024-05-10T08:49:27.620874+0000","last_peered":"2024-05-10T08:49:27.620874+0000","last_clean":"2024-05-10T08:49:27.620874+0000","last_became_active":"2024-05-10T08:49:25.623757+0000","last_became_peered":"2024-05-10T08:49:25.623757+0000","last_unstale":"2024-05-10T08:49:27.620874+0000","last_undegraded":"2024-05-10T08:49:27.620874+0000","last_fullsized":"2024-05-10T08:49:27.620874+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:52.924354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.620992+0000","last_change":"2024-05-10T08:49:25.630366+0000","last_active":"2024-05-10T08:49:27.620992+0000","last_peered":"2024-05-10T08:49:27.620992+0000","last_clean":"2024-05-10T08:49:27.620992+0000","last_became_active":"2024-05-10T08:49:25.630091+0000","last_became_peered":"2024-05-10T08:49:25.630091+0000","last_unstale":"2024-05-10T08:49:27.620992+0000","last_undegraded":"2024-05-10T08:49:27.620992+0000","last_fullsized":"2024-05-10T08:49:27.620992+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:27:41.354460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614410+0000","last_change":"2024-05-10T08:49:25.626054+0000","last_active":"2024-05-10T08:49:26.614410+0000","last_peered":"2024-05-10T08:49:26.614410+0000","last_clean":"2024-05-10T08:49:26.614410+0000","last_became_active":"2024-05-10T08:49:25.625670+0000","last_became_peered":"2024-05-10T08:49:25.625670+0000","last_unstale":"2024-05-10T08:49:26.614410+0000","last_undegraded":"2024-05-10T08:49:26.614410+0000","last_fullsized":"2024-05-10T08:49:26.614410+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:56.547309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.910027+0000","last_change":"2024-05-10T08:49:25.635434+0000","last_active":"2024-05-10T08:49:27.910027+0000","last_peered":"2024-05-10T08:49:27.910027+0000","last_clean":"2024-05-10T08:49:27.910027+0000","last_became_active":"2024-05-10T08:49:25.635052+0000","last_became_peered":"2024-05-10T08:49:25.635052+0000","last_unstale":"2024-05-10T08:49:27.910027+0000","last_undegraded":"2024-05-10T08:49:27.910027+0000","last_fullsized":"2024-05-10T08:49:27.910027+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:57:39.727980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613967+0000","last_change":"2024-05-10T08:49:25.630740+0000","last_active":"2024-05-10T08:49:26.613967+0000","last_peered":"2024-05-10T08:49:26.613967+0000","last_clean":"2024-05-10T08:49:26.613967+0000","last_became_active":"2024-05-10T08:49:25.630314+0000","last_became_peered":"2024-05-10T08:49:25.630314+0000","last_unstale":"2024-05-10T08:49:26.613967+0000","last_undegraded":"2024-05-10T08:49:26.613967+0000","last_fullsized":"2024-05-10T08:49:26.613967+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:37.384056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003927+0000","last_change":"2024-05-10T08:49:25.620906+0000","last_active":"2024-05-10T08:49:27.003927+0000","last_peered":"2024-05-10T08:49:27.003927+0000","last_clean":"2024-05-10T08:49:27.003927+0000","last_became_active":"2024-05-10T08:49:25.620622+0000","last_became_peered":"2024-05-10T08:49:25.620622+0000","last_unstale":"2024-05-10T08:49:27.003927+0000","last_undegraded":"2024-05-10T08:49:27.003927+0000","last_fullsized":"2024-05-10T08:49:27.003927+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:08:58.017622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621259+0000","last_change":"2024-05-10T08:49:25.621522+0000","last_active":"2024-05-10T08:49:27.621259+0000","last_peered":"2024-05-10T08:49:27.621259+0000","last_clean":"2024-05-10T08:49:27.621259+0000","last_became_active":"2024-05-10T08:49:25.621244+0000","last_became_peered":"2024-05-10T08:49:25.621244+0000","last_unstale":"2024-05-10T08:49:27.621259+0000","last_undegraded":"2024-05-10T08:49:27.621259+0000","last_fullsized":"2024-05-10T08:49:27.621259+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:28.056567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613490+0000","last_change":"2024-05-10T08:49:25.623077+0000","last_active":"2024-05-10T08:49:26.613490+0000","last_peered":"2024-05-10T08:49:26.613490+0000","last_clean":"2024-05-10T08:49:26.613490+0000","last_became_active":"2024-05-10T08:49:25.622730+0000","last_became_peered":"2024-05-10T08:49:25.622730+0000","last_unstale":"2024-05-10T08:49:26.613490+0000","last_undegraded":"2024-05-10T08:49:26.613490+0000","last_fullsized":"2024-05-10T08:49:26.613490+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:59.868793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614986+0000","last_change":"2024-05-10T08:49:25.626940+0000","last_active":"2024-05-10T08:49:26.614986+0000","last_peered":"2024-05-10T08:49:26.614986+0000","last_clean":"2024-05-10T08:49:26.614986+0000","last_became_active":"2024-05-10T08:49:25.626169+0000","last_became_peered":"2024-05-10T08:49:25.626169+0000","last_unstale":"2024-05-10T08:49:26.614986+0000","last_undegraded":"2024-05-10T08:49:26.614986+0000","last_fullsized":"2024-05-10T08:49:26.614986+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:01.793056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003490+0000","last_change":"2024-05-10T08:49:25.620231+0000","last_active":"2024-05-10T08:49:27.003490+0000","last_peered":"2024-05-10T08:49:27.003490+0000","last_clean":"2024-05-10T08:49:27.003490+0000","last_became_active":"2024-05-10T08:49:25.619954+0000","last_became_peered":"2024-05-10T08:49:25.619954+0000","last_unstale":"2024-05-10T08:49:27.003490+0000","last_undegraded":"2024-05-10T08:49:27.003490+0000","last_fullsized":"2024-05-10T08:49:27.003490+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:15.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.620728+0000","last_change":"2024-05-10T08:49:25.621152+0000","last_active":"2024-05-10T08:49:27.620728+0000","last_peered":"2024-05-10T08:49:27.620728+0000","last_clean":"2024-05-10T08:49:27.620728+0000","last_became_active":"2024-05-10T08:49:25.620816+0000","last_became_peered":"2024-05-10T08:49:25.620816+0000","last_unstale":"2024-05-10T08:49:27.620728+0000","last_undegraded":"2024-05-10T08:49:27.620728+0000","last_fullsized":"2024-05-10T08:49:27.620728+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:29.034372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613705+0000","last_change":"2024-05-10T08:49:25.622686+0000","last_active":"2024-05-10T08:49:26.613705+0000","last_peered":"2024-05-10T08:49:26.613705+0000","last_clean":"2024-05-10T08:49:26.613705+0000","last_became_active":"2024-05-10T08:49:25.622394+0000","last_became_peered":"2024-05-10T08:49:25.622394+0000","last_unstale":"2024-05-10T08:49:26.613705+0000","last_undegraded":"2024-05-10T08:49:26.613705+0000","last_fullsized":"2024-05-10T08:49:26.613705+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:54.341144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614775+0000","last_change":"2024-05-10T08:49:25.627463+0000","last_active":"2024-05-10T08:49:26.614775+0000","last_peered":"2024-05-10T08:49:26.614775+0000","last_clean":"2024-05-10T08:49:26.614775+0000","last_became_active":"2024-05-10T08:49:25.626853+0000","last_became_peered":"2024-05-10T08:49:25.626853+0000","last_unstale":"2024-05-10T08:49:26.614775+0000","last_undegraded":"2024-05-10T08:49:26.614775+0000","last_fullsized":"2024-05-10T08:49:26.614775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:18:29.978414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618655+0000","last_change":"2024-05-10T08:49:25.633796+0000","last_active":"2024-05-10T08:49:27.618655+0000","last_peered":"2024-05-10T08:49:27.618655+0000","last_clean":"2024-05-10T08:49:27.618655+0000","last_became_active":"2024-05-10T08:49:25.633504+0000","last_became_peered":"2024-05-10T08:49:25.633504+0000","last_unstale":"2024-05-10T08:49:27.618655+0000","last_undegraded":"2024-05-10T08:49:27.618655+0000","last_fullsized":"2024-05-10T08:49:27.618655+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:00.083530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.189200+0000","last_change":"2024-05-10T08:49:25.617701+0000","last_active":"2024-05-10T08:49:27.189200+0000","last_peered":"2024-05-10T08:49:27.189200+0000","last_clean":"2024-05-10T08:49:27.189200+0000","last_became_active":"2024-05-10T08:49:25.617434+0000","last_became_peered":"2024-05-10T08:49:25.617434+0000","last_unstale":"2024-05-10T08:49:27.189200+0000","last_undegraded":"2024-05-10T08:49:27.189200+0000","last_fullsized":"2024-05-10T08:49:27.189200+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:09:07.627348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909617+0000","last_change":"2024-05-10T08:49:25.629269+0000","last_active":"2024-05-10T08:49:27.909617+0000","last_peered":"2024-05-10T08:49:27.909617+0000","last_clean":"2024-05-10T08:49:27.909617+0000","last_became_active":"2024-05-10T08:49:25.628866+0000","last_became_peered":"2024-05-10T08:49:25.628866+0000","last_unstale":"2024-05-10T08:49:27.909617+0000","last_undegraded":"2024-05-10T08:49:27.909617+0000","last_fullsized":"2024-05-10T08:49:27.909617+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:54.341144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003720+0000","last_change":"2024-05-10T08:49:25.615547+0000","last_active":"2024-05-10T08:49:27.003720+0000","last_peered":"2024-05-10T08:49:27.003720+0000","last_clean":"2024-05-10T08:49:27.003720+0000","last_became_active":"2024-05-10T08:49:25.614556+0000","last_became_peered":"2024-05-10T08:49:25.614556+0000","last_unstale":"2024-05-10T08:49:27.003720+0000","last_undegraded":"2024-05-10T08:49:27.003720+0000","last_fullsized":"2024-05-10T08:49:27.003720+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:08:51.557126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909748+0000","last_change":"2024-05-10T08:49:25.635792+0000","last_active":"2024-05-10T08:49:27.909748+0000","last_peered":"2024-05-10T08:49:27.909748+0000","last_clean":"2024-05-10T08:49:27.909748+0000","last_became_active":"2024-05-10T08:49:25.634943+0000","last_became_peered":"2024-05-10T08:49:25.634943+0000","last_unstale":"2024-05-10T08:49:27.909748+0000","last_undegraded":"2024-05-10T08:49:27.909748+0000","last_fullsized":"2024-05-10T08:49:27.909748+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:37.384056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614232+0000","last_change":"2024-05-10T08:49:25.626608+0000","last_active":"2024-05-10T08:49:26.614232+0000","last_peered":"2024-05-10T08:49:26.614232+0000","last_clean":"2024-05-10T08:49:26.614232+0000","last_became_active":"2024-05-10T08:49:25.626359+0000","last_became_peered":"2024-05-10T08:49:25.626359+0000","last_unstale":"2024-05-10T08:49:26.614232+0000","last_undegraded":"2024-05-10T08:49:26.614232+0000","last_fullsized":"2024-05-10T08:49:26.614232+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:52.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614774+0000","last_change":"2024-05-10T08:49:25.620093+0000","last_active":"2024-05-10T08:49:26.614774+0000","last_peered":"2024-05-10T08:49:26.614774+0000","last_clean":"2024-05-10T08:49:26.614774+0000","last_became_active":"2024-05-10T08:49:25.619681+0000","last_became_peered":"2024-05-10T08:49:25.619681+0000","last_unstale":"2024-05-10T08:49:26.614774+0000","last_undegraded":"2024-05-10T08:49:26.614774+0000","last_fullsized":"2024-05-10T08:49:26.614774+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:27.814774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.189267+0000","last_change":"2024-05-10T08:49:25.618763+0000","last_active":"2024-05-10T08:49:27.189267+0000","last_peered":"2024-05-10T08:49:27.189267+0000","last_clean":"2024-05-10T08:49:27.189267+0000","last_became_active":"2024-05-10T08:49:25.618476+0000","last_became_peered":"2024-05-10T08:49:25.618476+0000","last_unstale":"2024-05-10T08:49:27.189267+0000","last_undegraded":"2024-05-10T08:49:27.189267+0000","last_fullsized":"2024-05-10T08:49:27.189267+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:35:41.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618726+0000","last_change":"2024-05-10T08:49:25.633171+0000","last_active":"2024-05-10T08:49:27.618726+0000","last_peered":"2024-05-10T08:49:27.618726+0000","last_clean":"2024-05-10T08:49:27.618726+0000","last_became_active":"2024-05-10T08:49:25.632906+0000","last_became_peered":"2024-05-10T08:49:25.632906+0000","last_unstale":"2024-05-10T08:49:27.618726+0000","last_undegraded":"2024-05-10T08:49:27.618726+0000","last_fullsized":"2024-05-10T08:49:27.618726+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:59.868793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621345+0000","last_change":"2024-05-10T08:49:25.624134+0000","last_active":"2024-05-10T08:49:27.621345+0000","last_peered":"2024-05-10T08:49:27.621345+0000","last_clean":"2024-05-10T08:49:27.621345+0000","last_became_active":"2024-05-10T08:49:25.623854+0000","last_became_peered":"2024-05-10T08:49:25.623854+0000","last_unstale":"2024-05-10T08:49:27.621345+0000","last_undegraded":"2024-05-10T08:49:27.621345+0000","last_fullsized":"2024-05-10T08:49:27.621345+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:20.405448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.189237+0000","last_change":"2024-05-10T08:49:25.611044+0000","last_active":"2024-05-10T08:49:27.189237+0000","last_peered":"2024-05-10T08:49:27.189237+0000","last_clean":"2024-05-10T08:49:27.189237+0000","last_became_active":"2024-05-10T08:49:25.610695+0000","last_became_peered":"2024-05-10T08:49:25.610695+0000","last_unstale":"2024-05-10T08:49:27.189237+0000","last_undegraded":"2024-05-10T08:49:27.189237+0000","last_fullsized":"2024-05-10T08:49:27.189237+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:09.810357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.615068+0000","last_change":"2024-05-10T08:49:25.611344+0000","last_active":"2024-05-10T08:49:26.615068+0000","last_peered":"2024-05-10T08:49:26.615068+0000","last_clean":"2024-05-10T08:49:26.615068+0000","last_became_active":"2024-05-10T08:49:25.610979+0000","last_became_peered":"2024-05-10T08:49:25.610979+0000","last_unstale":"2024-05-10T08:49:26.615068+0000","last_undegraded":"2024-05-10T08:49:26.615068+0000","last_fullsized":"2024-05-10T08:49:26.615068+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.333404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614672+0000","last_change":"2024-05-10T08:49:25.620902+0000","last_active":"2024-05-10T08:49:26.614672+0000","last_peered":"2024-05-10T08:49:26.614672+0000","last_clean":"2024-05-10T08:49:26.614672+0000","last_became_active":"2024-05-10T08:49:25.620536+0000","last_became_peered":"2024-05-10T08:49:25.620536+0000","last_unstale":"2024-05-10T08:49:26.614672+0000","last_undegraded":"2024-05-10T08:49:26.614672+0000","last_fullsized":"2024-05-10T08:49:26.614672+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:08:58.017622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614242+0000","last_change":"2024-05-10T08:49:25.625926+0000","last_active":"2024-05-10T08:49:26.614242+0000","last_peered":"2024-05-10T08:49:26.614242+0000","last_clean":"2024-05-10T08:49:26.614242+0000","last_became_active":"2024-05-10T08:49:25.625592+0000","last_became_peered":"2024-05-10T08:49:25.625592+0000","last_unstale":"2024-05-10T08:49:26.614242+0000","last_undegraded":"2024-05-10T08:49:26.614242+0000","last_fullsized":"2024-05-10T08:49:26.614242+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:15.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613742+0000","last_change":"2024-05-10T08:49:25.632860+0000","last_active":"2024-05-10T08:49:26.613742+0000","last_peered":"2024-05-10T08:49:26.613742+0000","last_clean":"2024-05-10T08:49:26.613742+0000","last_became_active":"2024-05-10T08:49:25.632566+0000","last_became_peered":"2024-05-10T08:49:25.632566+0000","last_unstale":"2024-05-10T08:49:26.613742+0000","last_undegraded":"2024-05-10T08:49:26.613742+0000","last_fullsized":"2024-05-10T08:49:26.613742+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:57.564149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"116'4","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618635+0000","last_change":"2024-05-10T08:49:24.605641+0000","last_active":"2024-05-10T08:49:27.618635+0000","last_peered":"2024-05-10T08:49:27.618635+0000","last_clean":"2024-05-10T08:49:27.618635+0000","last_became_active":"2024-05-10T08:49:24.605358+0000","last_became_peered":"2024-05-10T08:49:24.605358+0000","last_unstale":"2024-05-10T08:49:27.618635+0000","last_undegraded":"2024-05-10T08:49:27.618635+0000","last_fullsized":"2024-05-10T08:49:27.618635+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:51.090644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621335+0000","last_change":"2024-05-10T08:49:25.625567+0000","last_active":"2024-05-10T08:49:27.621335+0000","last_peered":"2024-05-10T08:49:27.621335+0000","last_clean":"2024-05-10T08:49:27.621335+0000","last_became_active":"2024-05-10T08:49:25.624935+0000","last_became_peered":"2024-05-10T08:49:25.624935+0000","last_unstale":"2024-05-10T08:49:27.621335+0000","last_undegraded":"2024-05-10T08:49:27.621335+0000","last_fullsized":"2024-05-10T08:49:27.621335+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:37:39.177918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613910+0000","last_change":"2024-05-10T08:49:24.604270+0000","last_active":"2024-05-10T08:49:26.613910+0000","last_peered":"2024-05-10T08:49:26.613910+0000","last_clean":"2024-05-10T08:49:26.613910+0000","last_became_active":"2024-05-10T08:49:24.603998+0000","last_became_peered":"2024-05-10T08:49:24.603998+0000","last_unstale":"2024-05-10T08:49:26.613910+0000","last_undegraded":"2024-05-10T08:49:26.613910+0000","last_fullsized":"2024-05-10T08:49:26.613910+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:35.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614508+0000","last_change":"2024-05-10T08:49:25.631322+0000","last_active":"2024-05-10T08:49:26.614508+0000","last_peered":"2024-05-10T08:49:26.614508+0000","last_clean":"2024-05-10T08:49:26.614508+0000","last_became_active":"2024-05-10T08:49:25.631033+0000","last_became_peered":"2024-05-10T08:49:25.631033+0000","last_unstale":"2024-05-10T08:49:26.614508+0000","last_undegraded":"2024-05-10T08:49:26.614508+0000","last_fullsized":"2024-05-10T08:49:26.614508+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:08:51.557126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909950+0000","last_change":"2024-05-10T08:49:24.615247+0000","last_active":"2024-05-10T08:49:27.909950+0000","last_peered":"2024-05-10T08:49:27.909950+0000","last_clean":"2024-05-10T08:49:27.909950+0000","last_became_active":"2024-05-10T08:49:24.614956+0000","last_became_peered":"2024-05-10T08:49:24.614956+0000","last_unstale":"2024-05-10T08:49:27.909950+0000","last_undegraded":"2024-05-10T08:49:27.909950+0000","last_fullsized":"2024-05-10T08:49:27.909950+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:08:50.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.910026+0000","last_change":"2024-05-10T08:49:25.634338+0000","last_active":"2024-05-10T08:49:27.910026+0000","last_peered":"2024-05-10T08:49:27.910026+0000","last_clean":"2024-05-10T08:49:27.910026+0000","last_became_active":"2024-05-10T08:49:25.633909+0000","last_became_peered":"2024-05-10T08:49:25.633909+0000","last_unstale":"2024-05-10T08:49:27.910026+0000","last_undegraded":"2024-05-10T08:49:27.910026+0000","last_fullsized":"2024-05-10T08:49:27.910026+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:42.934129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613725+0000","last_change":"2024-05-10T08:49:24.605015+0000","last_active":"2024-05-10T08:49:26.613725+0000","last_peered":"2024-05-10T08:49:26.613725+0000","last_clean":"2024-05-10T08:49:26.613725+0000","last_became_active":"2024-05-10T08:49:24.604737+0000","last_became_peered":"2024-05-10T08:49:24.604737+0000","last_unstale":"2024-05-10T08:49:26.613725+0000","last_undegraded":"2024-05-10T08:49:26.613725+0000","last_fullsized":"2024-05-10T08:49:26.613725+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:47.810488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613364+0000","last_change":"2024-05-10T08:49:25.626318+0000","last_active":"2024-05-10T08:49:26.613364+0000","last_peered":"2024-05-10T08:49:26.613364+0000","last_clean":"2024-05-10T08:49:26.613364+0000","last_became_active":"2024-05-10T08:49:25.626055+0000","last_became_peered":"2024-05-10T08:49:25.626055+0000","last_unstale":"2024-05-10T08:49:26.613364+0000","last_undegraded":"2024-05-10T08:49:26.613364+0000","last_fullsized":"2024-05-10T08:49:26.613364+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:17.320363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003589+0000","last_change":"2024-05-10T08:49:24.603241+0000","last_active":"2024-05-10T08:49:27.003589+0000","last_peered":"2024-05-10T08:49:27.003589+0000","last_clean":"2024-05-10T08:49:27.003589+0000","last_became_active":"2024-05-10T08:49:24.602715+0000","last_became_peered":"2024-05-10T08:49:24.602715+0000","last_unstale":"2024-05-10T08:49:27.003589+0000","last_undegraded":"2024-05-10T08:49:27.003589+0000","last_fullsized":"2024-05-10T08:49:27.003589+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:01.321183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003579+0000","last_change":"2024-05-10T08:49:25.626453+0000","last_active":"2024-05-10T08:49:27.003579+0000","last_peered":"2024-05-10T08:49:27.003579+0000","last_clean":"2024-05-10T08:49:27.003579+0000","last_became_active":"2024-05-10T08:49:25.626193+0000","last_became_peered":"2024-05-10T08:49:25.626193+0000","last_unstale":"2024-05-10T08:49:27.003579+0000","last_undegraded":"2024-05-10T08:49:27.003579+0000","last_fullsized":"2024-05-10T08:49:27.003579+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:48:13.335439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621011+0000","last_change":"2024-05-10T08:49:24.611527+0000","last_active":"2024-05-10T08:49:27.621011+0000","last_peered":"2024-05-10T08:49:27.621011+0000","last_clean":"2024-05-10T08:49:27.621011+0000","last_became_active":"2024-05-10T08:49:24.611240+0000","last_became_peered":"2024-05-10T08:49:24.611240+0000","last_unstale":"2024-05-10T08:49:27.621011+0000","last_undegraded":"2024-05-10T08:49:27.621011+0000","last_fullsized":"2024-05-10T08:49:27.621011+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:00.788084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.615183+0000","last_change":"2024-05-10T08:49:25.622997+0000","last_active":"2024-05-10T08:49:26.615183+0000","last_peered":"2024-05-10T08:49:26.615183+0000","last_clean":"2024-05-10T08:49:26.615183+0000","last_became_active":"2024-05-10T08:49:25.622410+0000","last_became_peered":"2024-05-10T08:49:25.622410+0000","last_unstale":"2024-05-10T08:49:26.615183+0000","last_undegraded":"2024-05-10T08:49:26.615183+0000","last_fullsized":"2024-05-10T08:49:26.615183+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:02.956595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614614+0000","last_change":"2024-05-10T08:49:24.607869+0000","last_active":"2024-05-10T08:49:26.614614+0000","last_peered":"2024-05-10T08:49:26.614614+0000","last_clean":"2024-05-10T08:49:26.614614+0000","last_became_active":"2024-05-10T08:49:24.607585+0000","last_became_peered":"2024-05-10T08:49:24.607585+0000","last_unstale":"2024-05-10T08:49:26.614614+0000","last_undegraded":"2024-05-10T08:49:26.614614+0000","last_fullsized":"2024-05-10T08:49:26.614614+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:05.441507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613533+0000","last_change":"2024-05-10T08:49:25.623493+0000","last_active":"2024-05-10T08:49:26.613533+0000","last_peered":"2024-05-10T08:49:26.613533+0000","last_clean":"2024-05-10T08:49:26.613533+0000","last_became_active":"2024-05-10T08:49:25.623146+0000","last_became_peered":"2024-05-10T08:49:25.623146+0000","last_unstale":"2024-05-10T08:49:26.613533+0000","last_undegraded":"2024-05-10T08:49:26.613533+0000","last_fullsized":"2024-05-10T08:49:26.613533+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:48.252317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621102+0000","last_change":"2024-05-10T08:49:24.616592+0000","last_active":"2024-05-10T08:49:27.621102+0000","last_peered":"2024-05-10T08:49:27.621102+0000","last_clean":"2024-05-10T08:49:27.621102+0000","last_became_active":"2024-05-10T08:49:24.616144+0000","last_became_peered":"2024-05-10T08:49:24.616144+0000","last_unstale":"2024-05-10T08:49:27.621102+0000","last_undegraded":"2024-05-10T08:49:27.621102+0000","last_fullsized":"2024-05-10T08:49:27.621102+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:47:43.253093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618533+0000","last_change":"2024-05-10T08:49:25.625942+0000","last_active":"2024-05-10T08:49:27.618533+0000","last_peered":"2024-05-10T08:49:27.618533+0000","last_clean":"2024-05-10T08:49:27.618533+0000","last_became_active":"2024-05-10T08:49:25.625646+0000","last_became_peered":"2024-05-10T08:49:25.625646+0000","last_unstale":"2024-05-10T08:49:27.618533+0000","last_undegraded":"2024-05-10T08:49:27.618533+0000","last_fullsized":"2024-05-10T08:49:27.618533+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:17.320363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618633+0000","last_change":"2024-05-10T08:49:24.614099+0000","last_active":"2024-05-10T08:49:27.618633+0000","last_peered":"2024-05-10T08:49:27.618633+0000","last_clean":"2024-05-10T08:49:27.618633+0000","last_became_active":"2024-05-10T08:49:24.613780+0000","last_became_peered":"2024-05-10T08:49:24.613780+0000","last_unstale":"2024-05-10T08:49:27.618633+0000","last_undegraded":"2024-05-10T08:49:27.618633+0000","last_fullsized":"2024-05-10T08:49:27.618633+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:48:12.330467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614684+0000","last_change":"2024-05-10T08:49:25.622207+0000","last_active":"2024-05-10T08:49:26.614684+0000","last_peered":"2024-05-10T08:49:26.614684+0000","last_clean":"2024-05-10T08:49:26.614684+0000","last_became_active":"2024-05-10T08:49:25.621936+0000","last_became_peered":"2024-05-10T08:49:25.621936+0000","last_unstale":"2024-05-10T08:49:26.614684+0000","last_undegraded":"2024-05-10T08:49:26.614684+0000","last_fullsized":"2024-05-10T08:49:26.614684+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:33.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614480+0000","last_change":"2024-05-10T08:49:24.608713+0000","last_active":"2024-05-10T08:49:26.614480+0000","last_peered":"2024-05-10T08:49:26.614480+0000","last_clean":"2024-05-10T08:49:26.614480+0000","last_became_active":"2024-05-10T08:49:24.608441+0000","last_became_peered":"2024-05-10T08:49:24.608441+0000","last_unstale":"2024-05-10T08:49:26.614480+0000","last_undegraded":"2024-05-10T08:49:26.614480+0000","last_fullsized":"2024-05-10T08:49:26.614480+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:28:38.914133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614943+0000","last_change":"2024-05-10T08:49:25.627681+0000","last_active":"2024-05-10T08:49:26.614943+0000","last_peered":"2024-05-10T08:49:26.614943+0000","last_clean":"2024-05-10T08:49:26.614943+0000","last_became_active":"2024-05-10T08:49:25.627214+0000","last_became_peered":"2024-05-10T08:49:25.627214+0000","last_unstale":"2024-05-10T08:49:26.614943+0000","last_undegraded":"2024-05-10T08:49:26.614943+0000","last_fullsized":"2024-05-10T08:49:26.614943+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:33:27.674300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"116'3","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614639+0000","last_change":"2024-05-10T08:49:24.612764+0000","last_active":"2024-05-10T08:49:26.614639+0000","last_peered":"2024-05-10T08:49:26.614639+0000","last_clean":"2024-05-10T08:49:26.614639+0000","last_became_active":"2024-05-10T08:49:24.612363+0000","last_became_peered":"2024-05-10T08:49:24.612363+0000","last_unstale":"2024-05-10T08:49:26.614639+0000","last_undegraded":"2024-05-10T08:49:26.614639+0000","last_fullsized":"2024-05-10T08:49:26.614639+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:31.211848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614865+0000","last_change":"2024-05-10T08:49:25.624349+0000","last_active":"2024-05-10T08:49:26.614865+0000","last_peered":"2024-05-10T08:49:26.614865+0000","last_clean":"2024-05-10T08:49:26.614865+0000","last_became_active":"2024-05-10T08:49:25.623968+0000","last_became_peered":"2024-05-10T08:49:25.623968+0000","last_unstale":"2024-05-10T08:49:26.614865+0000","last_undegraded":"2024-05-10T08:49:26.614865+0000","last_fullsized":"2024-05-10T08:49:26.614865+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:22.282403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"116'6","reported_seq":20,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614641+0000","last_change":"2024-05-10T08:49:24.602612+0000","last_active":"2024-05-10T08:49:26.614641+0000","last_peered":"2024-05-10T08:49:26.614641+0000","last_clean":"2024-05-10T08:49:26.614641+0000","last_became_active":"2024-05-10T08:49:24.602252+0000","last_became_peered":"2024-05-10T08:49:24.602252+0000","last_unstale":"2024-05-10T08:49:26.614641+0000","last_undegraded":"2024-05-10T08:49:26.614641+0000","last_fullsized":"2024-05-10T08:49:26.614641+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:43.494591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618289+0000","last_change":"2024-05-10T08:49:25.624783+0000","last_active":"2024-05-10T08:49:27.618289+0000","last_peered":"2024-05-10T08:49:27.618289+0000","last_clean":"2024-05-10T08:49:27.618289+0000","last_became_active":"2024-05-10T08:49:25.624501+0000","last_became_peered":"2024-05-10T08:49:25.624501+0000","last_unstale":"2024-05-10T08:49:27.618289+0000","last_undegraded":"2024-05-10T08:49:27.618289+0000","last_fullsized":"2024-05-10T08:49:27.618289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:22.282403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614659+0000","last_change":"2024-05-10T08:49:24.607083+0000","last_active":"2024-05-10T08:49:26.614659+0000","last_peered":"2024-05-10T08:49:26.614659+0000","last_clean":"2024-05-10T08:49:26.614659+0000","last_became_active":"2024-05-10T08:49:24.606742+0000","last_became_peered":"2024-05-10T08:49:24.606742+0000","last_unstale":"2024-05-10T08:49:26.614659+0000","last_undegraded":"2024-05-10T08:49:26.614659+0000","last_fullsized":"2024-05-10T08:49:26.614659+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:04.189499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613447+0000","last_change":"2024-05-10T08:49:25.630575+0000","last_active":"2024-05-10T08:49:26.613447+0000","last_peered":"2024-05-10T08:49:26.613447+0000","last_clean":"2024-05-10T08:49:26.613447+0000","last_became_active":"2024-05-10T08:49:25.630298+0000","last_became_peered":"2024-05-10T08:49:25.630298+0000","last_unstale":"2024-05-10T08:49:26.613447+0000","last_undegraded":"2024-05-10T08:49:26.613447+0000","last_fullsized":"2024-05-10T08:49:26.613447+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:00.083530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.615248+0000","last_change":"2024-05-10T08:49:24.607947+0000","last_active":"2024-05-10T08:49:26.615248+0000","last_peered":"2024-05-10T08:49:26.615248+0000","last_clean":"2024-05-10T08:49:26.615248+0000","last_became_active":"2024-05-10T08:49:24.606257+0000","last_became_peered":"2024-05-10T08:49:24.606257+0000","last_unstale":"2024-05-10T08:49:26.615248+0000","last_undegraded":"2024-05-10T08:49:26.615248+0000","last_fullsized":"2024-05-10T08:49:26.615248+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:08.668759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.189073+0000","last_change":"2024-05-10T08:49:25.610729+0000","last_active":"2024-05-10T08:49:27.189073+0000","last_peered":"2024-05-10T08:49:27.189073+0000","last_clean":"2024-05-10T08:49:27.189073+0000","last_became_active":"2024-05-10T08:49:25.610387+0000","last_became_peered":"2024-05-10T08:49:25.610387+0000","last_unstale":"2024-05-10T08:49:27.189073+0000","last_undegraded":"2024-05-10T08:49:27.189073+0000","last_fullsized":"2024-05-10T08:49:27.189073+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:59:54.695832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614566+0000","last_change":"2024-05-10T08:49:24.601162+0000","last_active":"2024-05-10T08:49:26.614566+0000","last_peered":"2024-05-10T08:49:26.614566+0000","last_clean":"2024-05-10T08:49:26.614566+0000","last_became_active":"2024-05-10T08:49:24.600846+0000","last_became_peered":"2024-05-10T08:49:24.600846+0000","last_unstale":"2024-05-10T08:49:26.614566+0000","last_undegraded":"2024-05-10T08:49:26.614566+0000","last_fullsized":"2024-05-10T08:49:26.614566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:21:56.559177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614476+0000","last_change":"2024-05-10T08:49:25.632044+0000","last_active":"2024-05-10T08:49:26.614476+0000","last_peered":"2024-05-10T08:49:26.614476+0000","last_clean":"2024-05-10T08:49:26.614476+0000","last_became_active":"2024-05-10T08:49:25.631735+0000","last_became_peered":"2024-05-10T08:49:25.631735+0000","last_unstale":"2024-05-10T08:49:26.614476+0000","last_undegraded":"2024-05-10T08:49:26.614476+0000","last_fullsized":"2024-05-10T08:49:26.614476+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:48:13.335439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613716+0000","last_change":"2024-05-10T08:49:24.615565+0000","last_active":"2024-05-10T08:49:26.613716+0000","last_peered":"2024-05-10T08:49:26.613716+0000","last_clean":"2024-05-10T08:49:26.613716+0000","last_became_active":"2024-05-10T08:49:24.615280+0000","last_became_peered":"2024-05-10T08:49:24.615280+0000","last_unstale":"2024-05-10T08:49:26.613716+0000","last_undegraded":"2024-05-10T08:49:26.613716+0000","last_fullsized":"2024-05-10T08:49:26.613716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:16:02.055668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003947+0000","last_change":"2024-05-10T08:49:25.612425+0000","last_active":"2024-05-10T08:49:27.003947+0000","last_peered":"2024-05-10T08:49:27.003947+0000","last_clean":"2024-05-10T08:49:27.003947+0000","last_became_active":"2024-05-10T08:49:25.612103+0000","last_became_peered":"2024-05-10T08:49:25.612103+0000","last_unstale":"2024-05-10T08:49:27.003947+0000","last_undegraded":"2024-05-10T08:49:27.003947+0000","last_fullsized":"2024-05-10T08:49:27.003947+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:33.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.189298+0000","last_change":"2024-05-10T08:49:24.613433+0000","last_active":"2024-05-10T08:49:27.189298+0000","last_peered":"2024-05-10T08:49:27.189298+0000","last_clean":"2024-05-10T08:49:27.189298+0000","last_became_active":"2024-05-10T08:49:24.613090+0000","last_became_peered":"2024-05-10T08:49:24.613090+0000","last_unstale":"2024-05-10T08:49:27.189298+0000","last_undegraded":"2024-05-10T08:49:27.189298+0000","last_fullsized":"2024-05-10T08:49:27.189298+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:58.738400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621477+0000","last_change":"2024-05-10T08:49:25.628703+0000","last_active":"2024-05-10T08:49:27.621477+0000","last_peered":"2024-05-10T08:49:27.621477+0000","last_clean":"2024-05-10T08:49:27.621477+0000","last_became_active":"2024-05-10T08:49:25.627768+0000","last_became_peered":"2024-05-10T08:49:25.627768+0000","last_unstale":"2024-05-10T08:49:27.621477+0000","last_undegraded":"2024-05-10T08:49:27.621477+0000","last_fullsized":"2024-05-10T08:49:27.621477+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:00.017359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.910039+0000","last_change":"2024-05-10T08:49:24.610562+0000","last_active":"2024-05-10T08:49:27.910039+0000","last_peered":"2024-05-10T08:49:27.910039+0000","last_clean":"2024-05-10T08:49:27.910039+0000","last_became_active":"2024-05-10T08:49:24.610152+0000","last_became_peered":"2024-05-10T08:49:24.610152+0000","last_unstale":"2024-05-10T08:49:27.910039+0000","last_undegraded":"2024-05-10T08:49:27.910039+0000","last_fullsized":"2024-05-10T08:49:27.910039+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:08:57.012650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614915+0000","last_change":"2024-05-10T08:49:25.629246+0000","last_active":"2024-05-10T08:49:26.614915+0000","last_peered":"2024-05-10T08:49:26.614915+0000","last_clean":"2024-05-10T08:49:26.614915+0000","last_became_active":"2024-05-10T08:49:25.628903+0000","last_became_peered":"2024-05-10T08:49:25.628903+0000","last_unstale":"2024-05-10T08:49:26.614915+0000","last_undegraded":"2024-05-10T08:49:26.614915+0000","last_fullsized":"2024-05-10T08:49:26.614915+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:47:17.320363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909739+0000","last_change":"2024-05-10T08:49:24.615638+0000","last_active":"2024-05-10T08:49:27.909739+0000","last_peered":"2024-05-10T08:49:27.909739+0000","last_clean":"2024-05-10T08:49:27.909739+0000","last_became_active":"2024-05-10T08:49:24.615399+0000","last_became_peered":"2024-05-10T08:49:24.615399+0000","last_unstale":"2024-05-10T08:49:27.909739+0000","last_undegraded":"2024-05-10T08:49:27.909739+0000","last_fullsized":"2024-05-10T08:49:27.909739+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:18:40.714148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.620856+0000","last_change":"2024-05-10T08:49:25.633092+0000","last_active":"2024-05-10T08:49:27.620856+0000","last_peered":"2024-05-10T08:49:27.620856+0000","last_clean":"2024-05-10T08:49:27.620856+0000","last_became_active":"2024-05-10T08:49:25.632738+0000","last_became_peered":"2024-05-10T08:49:25.632738+0000","last_unstale":"2024-05-10T08:49:27.620856+0000","last_undegraded":"2024-05-10T08:49:27.620856+0000","last_fullsized":"2024-05-10T08:49:27.620856+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:03:44.844696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.620999+0000","last_change":"2024-05-10T08:49:24.612901+0000","last_active":"2024-05-10T08:49:27.620999+0000","last_peered":"2024-05-10T08:49:27.620999+0000","last_clean":"2024-05-10T08:49:27.620999+0000","last_became_active":"2024-05-10T08:49:24.612581+0000","last_became_peered":"2024-05-10T08:49:24.612581+0000","last_unstale":"2024-05-10T08:49:27.620999+0000","last_undegraded":"2024-05-10T08:49:27.620999+0000","last_fullsized":"2024-05-10T08:49:27.620999+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:08.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614449+0000","last_change":"2024-05-10T08:49:25.620550+0000","last_active":"2024-05-10T08:49:26.614449+0000","last_peered":"2024-05-10T08:49:26.614449+0000","last_clean":"2024-05-10T08:49:26.614449+0000","last_became_active":"2024-05-10T08:49:25.620049+0000","last_became_peered":"2024-05-10T08:49:25.620049+0000","last_unstale":"2024-05-10T08:49:26.614449+0000","last_undegraded":"2024-05-10T08:49:26.614449+0000","last_fullsized":"2024-05-10T08:49:26.614449+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:00.545472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909465+0000","last_change":"2024-05-10T08:49:24.609174+0000","last_active":"2024-05-10T08:49:27.909465+0000","last_peered":"2024-05-10T08:49:27.909465+0000","last_clean":"2024-05-10T08:49:27.909465+0000","last_became_active":"2024-05-10T08:49:24.608853+0000","last_became_peered":"2024-05-10T08:49:24.608853+0000","last_unstale":"2024-05-10T08:49:27.909465+0000","last_undegraded":"2024-05-10T08:49:27.909465+0000","last_fullsized":"2024-05-10T08:49:27.909465+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:14.202426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.615203+0000","last_change":"2024-05-10T08:49:25.627721+0000","last_active":"2024-05-10T08:49:26.615203+0000","last_peered":"2024-05-10T08:49:26.615203+0000","last_clean":"2024-05-10T08:49:26.615203+0000","last_became_active":"2024-05-10T08:49:25.627439+0000","last_became_peered":"2024-05-10T08:49:25.627439+0000","last_unstale":"2024-05-10T08:49:26.615203+0000","last_undegraded":"2024-05-10T08:49:26.615203+0000","last_fullsized":"2024-05-10T08:49:26.615203+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:34:25.458875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614663+0000","last_change":"2024-05-10T08:49:24.613705+0000","last_active":"2024-05-10T08:49:26.614663+0000","last_peered":"2024-05-10T08:49:26.614663+0000","last_clean":"2024-05-10T08:49:26.614663+0000","last_became_active":"2024-05-10T08:49:24.613437+0000","last_became_peered":"2024-05-10T08:49:24.613437+0000","last_unstale":"2024-05-10T08:49:26.614663+0000","last_undegraded":"2024-05-10T08:49:26.614663+0000","last_fullsized":"2024-05-10T08:49:26.614663+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:38:36.379084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614481+0000","last_change":"2024-05-10T08:49:25.622476+0000","last_active":"2024-05-10T08:49:26.614481+0000","last_peered":"2024-05-10T08:49:26.614481+0000","last_clean":"2024-05-10T08:49:26.614481+0000","last_became_active":"2024-05-10T08:49:25.622211+0000","last_became_peered":"2024-05-10T08:49:25.622211+0000","last_unstale":"2024-05-10T08:49:26.614481+0000","last_undegraded":"2024-05-10T08:49:26.614481+0000","last_fullsized":"2024-05-10T08:49:26.614481+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:18:41.719120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909312+0000","last_change":"2024-05-10T08:49:24.614766+0000","last_active":"2024-05-10T08:49:27.909312+0000","last_peered":"2024-05-10T08:49:27.909312+0000","last_clean":"2024-05-10T08:49:27.909312+0000","last_became_active":"2024-05-10T08:49:24.614473+0000","last_became_peered":"2024-05-10T08:49:24.614473+0000","last_unstale":"2024-05-10T08:49:27.909312+0000","last_undegraded":"2024-05-10T08:49:27.909312+0000","last_fullsized":"2024-05-10T08:49:27.909312+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:56:51.090644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621560+0000","last_change":"2024-05-10T08:49:25.619745+0000","last_active":"2024-05-10T08:49:27.621560+0000","last_peered":"2024-05-10T08:49:27.621560+0000","last_clean":"2024-05-10T08:49:27.621560+0000","last_became_active":"2024-05-10T08:49:25.619449+0000","last_became_peered":"2024-05-10T08:49:25.619449+0000","last_unstale":"2024-05-10T08:49:27.621560+0000","last_undegraded":"2024-05-10T08:49:27.621560+0000","last_fullsized":"2024-05-10T08:49:27.621560+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:15.136873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621511+0000","last_change":"2024-05-10T08:49:24.612126+0000","last_active":"2024-05-10T08:49:27.621511+0000","last_peered":"2024-05-10T08:49:27.621511+0000","last_clean":"2024-05-10T08:49:27.621511+0000","last_became_active":"2024-05-10T08:49:24.611698+0000","last_became_peered":"2024-05-10T08:49:24.611698+0000","last_unstale":"2024-05-10T08:49:27.621511+0000","last_undegraded":"2024-05-10T08:49:27.621511+0000","last_fullsized":"2024-05-10T08:49:27.621511+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:34:24.453903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613573+0000","last_change":"2024-05-10T08:49:25.627358+0000","last_active":"2024-05-10T08:49:26.613573+0000","last_peered":"2024-05-10T08:49:26.613573+0000","last_clean":"2024-05-10T08:49:26.613573+0000","last_became_active":"2024-05-10T08:49:25.627041+0000","last_became_peered":"2024-05-10T08:49:25.627041+0000","last_unstale":"2024-05-10T08:49:26.613573+0000","last_undegraded":"2024-05-10T08:49:26.613573+0000","last_fullsized":"2024-05-10T08:49:26.613573+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:14:59.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"117'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618666+0000","last_change":"2024-05-10T08:49:24.614157+0000","last_active":"2024-05-10T08:49:27.618666+0000","last_peered":"2024-05-10T08:49:27.618666+0000","last_clean":"2024-05-10T08:49:27.618666+0000","last_became_active":"2024-05-10T08:49:24.613727+0000","last_became_peered":"2024-05-10T08:49:24.613727+0000","last_unstale":"2024-05-10T08:49:27.618666+0000","last_undegraded":"2024-05-10T08:49:27.618666+0000","last_fullsized":"2024-05-10T08:49:27.618666+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:18:40.714148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909913+0000","last_change":"2024-05-10T08:49:25.630425+0000","last_active":"2024-05-10T08:49:27.909913+0000","last_peered":"2024-05-10T08:49:27.909913+0000","last_clean":"2024-05-10T08:49:27.909913+0000","last_became_active":"2024-05-10T08:49:25.629318+0000","last_became_peered":"2024-05-10T08:49:25.629318+0000","last_unstale":"2024-05-10T08:49:27.909913+0000","last_undegraded":"2024-05-10T08:49:27.909913+0000","last_fullsized":"2024-05-10T08:49:27.909913+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:30:44.499563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.618748+0000","last_change":"2024-05-10T08:49:24.611676+0000","last_active":"2024-05-10T08:49:27.618748+0000","last_peered":"2024-05-10T08:49:27.618748+0000","last_clean":"2024-05-10T08:49:27.618748+0000","last_became_active":"2024-05-10T08:49:24.611373+0000","last_became_peered":"2024-05-10T08:49:24.611373+0000","last_unstale":"2024-05-10T08:49:27.618748+0000","last_undegraded":"2024-05-10T08:49:27.618748+0000","last_fullsized":"2024-05-10T08:49:27.618748+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:14.202426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.189399+0000","last_change":"2024-05-10T08:49:25.621193+0000","last_active":"2024-05-10T08:49:27.189399+0000","last_peered":"2024-05-10T08:49:27.189399+0000","last_clean":"2024-05-10T08:49:27.189399+0000","last_became_active":"2024-05-10T08:49:25.620888+0000","last_became_peered":"2024-05-10T08:49:25.620888+0000","last_unstale":"2024-05-10T08:49:27.189399+0000","last_undegraded":"2024-05-10T08:49:27.189399+0000","last_fullsized":"2024-05-10T08:49:27.189399+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:00.610910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.621505+0000","last_change":"2024-05-10T08:49:24.615827+0000","last_active":"2024-05-10T08:49:27.621505+0000","last_peered":"2024-05-10T08:49:27.621505+0000","last_clean":"2024-05-10T08:49:27.621505+0000","last_became_active":"2024-05-10T08:49:24.615518+0000","last_became_peered":"2024-05-10T08:49:24.615518+0000","last_unstale":"2024-05-10T08:49:27.621505+0000","last_undegraded":"2024-05-10T08:49:27.621505+0000","last_fullsized":"2024-05-10T08:49:27.621505+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:33:32.889161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.620964+0000","last_change":"2024-05-10T08:49:25.618107+0000","last_active":"2024-05-10T08:49:27.620964+0000","last_peered":"2024-05-10T08:49:27.620964+0000","last_clean":"2024-05-10T08:49:27.620964+0000","last_became_active":"2024-05-10T08:49:25.617828+0000","last_became_peered":"2024-05-10T08:49:25.617828+0000","last_unstale":"2024-05-10T08:49:27.620964+0000","last_undegraded":"2024-05-10T08:49:27.620964+0000","last_fullsized":"2024-05-10T08:49:27.620964+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:20.351586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003709+0000","last_change":"2024-05-10T08:49:24.606919+0000","last_active":"2024-05-10T08:49:27.003709+0000","last_peered":"2024-05-10T08:49:27.003709+0000","last_clean":"2024-05-10T08:49:27.003709+0000","last_became_active":"2024-05-10T08:49:24.606647+0000","last_became_peered":"2024-05-10T08:49:24.606647+0000","last_unstale":"2024-05-10T08:49:27.003709+0000","last_undegraded":"2024-05-10T08:49:27.003709+0000","last_fullsized":"2024-05-10T08:49:27.003709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:13.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614516+0000","last_change":"2024-05-10T08:49:25.626954+0000","last_active":"2024-05-10T08:49:26.614516+0000","last_peered":"2024-05-10T08:49:26.614516+0000","last_clean":"2024-05-10T08:49:26.614516+0000","last_became_active":"2024-05-10T08:49:25.626684+0000","last_became_peered":"2024-05-10T08:49:25.626684+0000","last_unstale":"2024-05-10T08:49:26.614516+0000","last_undegraded":"2024-05-10T08:49:26.614516+0000","last_fullsized":"2024-05-10T08:49:26.614516+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:23:30.608114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.003711+0000","last_change":"2024-05-10T08:49:24.605573+0000","last_active":"2024-05-10T08:49:27.003711+0000","last_peered":"2024-05-10T08:49:27.003711+0000","last_clean":"2024-05-10T08:49:27.003711+0000","last_became_active":"2024-05-10T08:49:24.605298+0000","last_became_peered":"2024-05-10T08:49:24.605298+0000","last_unstale":"2024-05-10T08:49:27.003711+0000","last_undegraded":"2024-05-10T08:49:27.003711+0000","last_fullsized":"2024-05-10T08:49:27.003711+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:53.635774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909654+0000","last_change":"2024-05-10T08:49:25.632088+0000","last_active":"2024-05-10T08:49:27.909654+0000","last_peered":"2024-05-10T08:49:27.909654+0000","last_clean":"2024-05-10T08:49:27.909654+0000","last_became_active":"2024-05-10T08:49:25.631794+0000","last_became_peered":"2024-05-10T08:49:25.631794+0000","last_unstale":"2024-05-10T08:49:27.909654+0000","last_undegraded":"2024-05-10T08:49:27.909654+0000","last_fullsized":"2024-05-10T08:49:27.909654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:05.194471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.620767+0000","last_change":"2024-05-10T08:49:24.616821+0000","last_active":"2024-05-10T08:49:27.620767+0000","last_peered":"2024-05-10T08:49:27.620767+0000","last_clean":"2024-05-10T08:49:27.620767+0000","last_became_active":"2024-05-10T08:49:24.616451+0000","last_became_peered":"2024-05-10T08:49:24.616451+0000","last_unstale":"2024-05-10T08:49:27.620767+0000","last_undegraded":"2024-05-10T08:49:27.620767+0000","last_fullsized":"2024-05-10T08:49:27.620767+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:01.951623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.613658+0000","last_change":"2024-05-10T08:49:25.631203+0000","last_active":"2024-05-10T08:49:26.613658+0000","last_peered":"2024-05-10T08:49:26.613658+0000","last_clean":"2024-05-10T08:49:26.613658+0000","last_became_active":"2024-05-10T08:49:25.630822+0000","last_became_peered":"2024-05-10T08:49:25.630822+0000","last_unstale":"2024-05-10T08:49:26.613658+0000","last_undegraded":"2024-05-10T08:49:26.613658+0000","last_fullsized":"2024-05-10T08:49:26.613658+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:41:55.524055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909321+0000","last_change":"2024-05-10T08:49:24.609428+0000","last_active":"2024-05-10T08:49:27.909321+0000","last_peered":"2024-05-10T08:49:27.909321+0000","last_clean":"2024-05-10T08:49:27.909321+0000","last_became_active":"2024-05-10T08:49:24.609148+0000","last_became_peered":"2024-05-10T08:49:24.609148+0000","last_unstale":"2024-05-10T08:49:27.909321+0000","last_undegraded":"2024-05-10T08:49:27.909321+0000","last_fullsized":"2024-05-10T08:49:27.909321+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:48:12.330467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909765+0000","last_change":"2024-05-10T08:49:25.630002+0000","last_active":"2024-05-10T08:49:27.909765+0000","last_peered":"2024-05-10T08:49:27.909765+0000","last_clean":"2024-05-10T08:49:27.909765+0000","last_became_active":"2024-05-10T08:49:25.627736+0000","last_became_peered":"2024-05-10T08:49:25.627736+0000","last_unstale":"2024-05-10T08:49:27.909765+0000","last_undegraded":"2024-05-10T08:49:27.909765+0000","last_fullsized":"2024-05-10T08:49:27.909765+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:24.586497+0000","last_clean_scrub_stamp":"2024-05-10T08:49:24.586497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:09.673731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"116'8","reported_seq":22,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:26.614398+0000","last_change":"2024-05-10T08:49:24.608777+0000","last_active":"2024-05-10T08:49:26.614398+0000","last_peered":"2024-05-10T08:49:26.614398+0000","last_clean":"2024-05-10T08:49:26.614398+0000","last_became_active":"2024-05-10T08:49:24.608491+0000","last_became_peered":"2024-05-10T08:49:24.608491+0000","last_unstale":"2024-05-10T08:49:26.614398+0000","last_undegraded":"2024-05-10T08:49:26.614398+0000","last_fullsized":"2024-05-10T08:49:26.614398+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:49:23.581525+0000","last_clean_scrub_stamp":"2024-05-10T08:49:23.581525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:05:53.336172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":292,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-05-10T08:49:27.909475+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:49:27.909475+0000","last_peered":"2024-05-10T08:49:27.909475+0000","last_clean":"2024-05-10T08:49:27.909475+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:49:27.909475+0000","last_undegraded":"2024-05-10T08:49:27.909475+0000","last_fullsized":"2024-05-10T08:49:27.909475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1270753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":680191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1466368,"data_stored":679769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":681221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1474560,"data_stored":681255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1458176,"data_stored":679609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1462272,"data_stored":679631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2056192,"data_stored":1269999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:49:34.506 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:49:34.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T08:49:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.655+0000 7fc6ef2cf640 1 Processor -- start 2024-05-10T08:49:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.655+0000 7fc6ef2cf640 1 -- start start 2024-05-10T08:49:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ef2cf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6e815ccb0 0x7fc6e815d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ef2cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6e8070b90 0x7fc6e8071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ef2cf640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e80718c0 con 0x7fc6e80d2ce0 2024-05-10T08:49:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ef2cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e80afba0 con 0x7fc6e8070b90 2024-05-10T08:49:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ef2cf640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e8071ba0 con 0x7fc6e815ccb0 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ed86c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6e8070b90 0x7fc6e8071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ec86a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6e80d2ce0 0x7fc6e80d3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49456/0 (socket says 172.21.15.37:49456) 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ec86a640 1 -- 172.21.15.37:0/2021593304 learned_addr learned my addr 172.21.15.37:0/2021593304 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ed06b640 1 --2- 172.21.15.37:0/2021593304 >> v2:172.21.15.82:3300/0 conn(0x7fc6e815ccb0 0x7fc6e815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ed86c640 1 -- 172.21.15.37:0/2021593304 >> v2:172.21.15.82:3300/0 conn(0x7fc6e815ccb0 msgr2=0x7fc6e815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ed86c640 1 --2- 172.21.15.37:0/2021593304 >> v2:172.21.15.82:3300/0 conn(0x7fc6e815ccb0 0x7fc6e815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ed86c640 1 -- 172.21.15.37:0/2021593304 >> v1:172.21.15.37:6789/0 conn(0x7fc6e80d2ce0 legacy=0x7fc6e80d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6ed86c640 1 -- 172.21.15.37:0/2021593304 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e8071e80 con 0x7fc6e8070b90 2024-05-10T08:49:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.656+0000 7fc6dffff640 1 -- 172.21.15.37:0/2021593304 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045651397 0 0) 0x7fc6e80718c0 con 0x7fc6e80d2ce0 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.657+0000 7fc6ed86c640 1 --2- 172.21.15.37:0/2021593304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e8070b90 0x7fc6e8071000 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc6e806ff90 tx=0x7fc6e002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17657e0fb2dcd31 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.657+0000 7fc6dffff640 1 -- 172.21.15.37:0/2021593304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0007740 con 0x7fc6e8070b90 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.657+0000 7fc6dffff640 1 -- 172.21.15.37:0/2021593304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e00078e0 con 0x7fc6e8070b90 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.657+0000 7fc6dffff640 1 -- 172.21.15.37:0/2021593304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0007cb0 con 0x7fc6e8070b90 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/2021593304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e8070b90 msgr2=0x7fc6e8071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/2021593304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e8070b90 0x7fc6e8071000 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc6e806ff90 tx=0x7fc6e002a5f0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/2021593304 shutdown_connections 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/2021593304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e8070b90 0x7fc6e8071000 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/2021593304 >> v2:172.21.15.82:3300/0 conn(0x7fc6e815ccb0 0x7fc6e815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/2021593304 >> 172.21.15.37:0/2021593304 conn(0x7fc6e809ba40 msgr2=0x7fc6e809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:34.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/2021593304 shutdown_connections 2024-05-10T08:49:34.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.658+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/2021593304 wait complete. 2024-05-10T08:49:34.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.659+0000 7fc6ef2cf640 1 Processor -- start 2024-05-10T08:49:34.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.659+0000 7fc6ef2cf640 1 -- start start 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ef2cf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6e8070b90 0x7fc6e80b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ef2cf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6e80d2ce0 0x7fc6e814e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ef2cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e815ccb0 0x7fc6e815fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ef2cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80cf980 con 0x7fc6e815ccb0 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ef2cf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e8071540 con 0x7fc6e80d2ce0 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ef2cf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80cfb00 con 0x7fc6e8070b90 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e815ccb0 0x7fc6e815fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e815ccb0 0x7fc6e815fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43614/0 (socket says 172.21.15.37:43614) 2024-05-10T08:49:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 -- 172.21.15.37:0/1131733546 learned_addr learned my addr 172.21.15.37:0/1131733546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ec86a640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6e80d2ce0 0x7fc6e814e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed06b640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6e8070b90 0x7fc6e80b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 -- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6e8070b90 msgr2=0x7fc6e80b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6e8070b90 0x7fc6e80b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 -- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6e80d2ce0 msgr2=0x7fc6e814e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6e80d2ce0 0x7fc6e814e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.660+0000 7fc6ed86c640 1 -- 172.21.15.37:0/1131733546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e815f020 con 0x7fc6e815ccb0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.661+0000 7fc6ed86c640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e815ccb0 0x7fc6e815fac0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc6e002abe0 tx=0x7fc6e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.661+0000 7fc6ddffb640 1 -- 172.21.15.37:0/1131733546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e003f070 con 0x7fc6e815ccb0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.661+0000 7fc6ddffb640 1 -- 172.21.15.37:0/1131733546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e0031bc0 con 0x7fc6e815ccb0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.661+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e815e630 con 0x7fc6e815ccb0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.661+0000 7fc6ddffb640 1 -- 172.21.15.37:0/1131733546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0044460 con 0x7fc6e815ccb0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.661+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e815f2c0 con 0x7fc6e815ccb0 2024-05-10T08:49:34.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.662+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e8069b00 con 0x7fc6e815ccb0 2024-05-10T08:49:34.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.663+0000 7fc6ddffb640 1 -- 172.21.15.37:0/1131733546 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6e0007790 con 0x7fc6e815ccb0 2024-05-10T08:49:34.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.663+0000 7fc6ddffb640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6cc0762d0 0x7fc6cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:34.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.663+0000 7fc6ddffb640 1 -- 172.21.15.37:0/1131733546 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fc6e00b8eb0 con 0x7fc6e815ccb0 2024-05-10T08:49:34.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.664+0000 7fc6ed06b640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6cc0762d0 0x7fc6cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:34.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.664+0000 7fc6ed06b640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6cc0762d0 0x7fc6cc078790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4006fd0 tx=0x7fc6e4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:34.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.668+0000 7fc6ddffb640 1 -- 172.21.15.37:0/1131733546 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc6e0082030 con 0x7fc6e815ccb0 2024-05-10T08:49:34.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.939+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc6e80b31d0 con 0x7fc6e815ccb0 2024-05-10T08:49:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.942+0000 7fc6ddffb640 1 -- 172.21.15.37:0/1131733546 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fc6e0086330 con 0x7fc6e815ccb0 2024-05-10T08:49:34.940 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-10T08:49:34.941 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA93T1mtYs2IxAAAyU5k4ihcn3r/tx7WwUy6A== 2024-05-10T08:49:34.941 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-10T08:49:34.941 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-10T08:49:34.941 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T08:49:34.941 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-10T08:49:34.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6cc0762d0 msgr2=0x7fc6cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6cc0762d0 0x7fc6cc078790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4006fd0 tx=0x7fc6e4008040 comp rx=0 tx=0).stop 2024-05-10T08:49:34.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e815ccb0 msgr2=0x7fc6e815fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:34.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e815ccb0 0x7fc6e815fac0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc6e002abe0 tx=0x7fc6e0004a40 comp rx=0 tx=0).stop 2024-05-10T08:49:34.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 shutdown_connections 2024-05-10T08:49:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc6cc0762d0 0x7fc6cc078790 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e815ccb0 0x7fc6e815fac0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6e80d2ce0 0x7fc6e814e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 --2- 172.21.15.37:0/1131733546 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc6e8070b90 0x7fc6e80b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 >> 172.21.15.37:0/1131733546 conn(0x7fc6e809ba40 msgr2=0x7fc6e80b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 shutdown_connections 2024-05-10T08:49:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:34.944+0000 7fc6ef2cf640 1 -- 172.21.15.37:0/1131733546 wait complete. 2024-05-10T08:49:34.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.059+0000 7f55128dc640 1 Processor -- start 2024-05-10T08:49:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.059+0000 7f55128dc640 1 -- start start 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f55128dc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f550c06e0f0 0x7f550c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f55128dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f550c072840 0x7f550c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f55128dc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f550c0d14b0 con 0x7f550c06e4d0 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f55128dc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f550c15c920 con 0x7f550c072840 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f55128dc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f550c15cc00 con 0x7f550c06e0f0 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f5503fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f550c072840 0x7f550c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f5503fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f550c072840 0x7f550c0d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43628/0 (socket says 172.21.15.37:43628) 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f5503fff640 1 -- 172.21.15.37:0/1504193081 learned_addr learned my addr 172.21.15.37:0/1504193081 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f5503fff640 1 -- 172.21.15.37:0/1504193081 >> v2:172.21.15.82:3300/0 conn(0x7f550c06e0f0 msgr2=0x7f550c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f550bfff640 1 --2- 172.21.15.37:0/1504193081 >> v2:172.21.15.82:3300/0 conn(0x7f550c06e0f0 0x7f550c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f5503fff640 1 --2- 172.21.15.37:0/1504193081 >> v2:172.21.15.82:3300/0 conn(0x7f550c06e0f0 0x7f550c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f5503fff640 1 -- 172.21.15.37:0/1504193081 >> v1:172.21.15.82:6789/0 conn(0x7f550c06e4d0 legacy=0x7f550c0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f5503fff640 1 -- 172.21.15.37:0/1504193081 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c15cee0 con 0x7f550c072840 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.060+0000 7f550bfff640 1 --2- 172.21.15.37:0/1504193081 >> v2:172.21.15.82:3300/0 conn(0x7f550c06e0f0 0x7f550c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.061+0000 7f5503fff640 1 --2- 172.21.15.37:0/1504193081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c072840 0x7f550c0d0f70 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f550c0d1cf0 tx=0x7f54f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e337057dd5ba89fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.061+0000 7f550b7fe640 1 -- 172.21.15.37:0/1504193081 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4037070 con 0x7f550c072840 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.061+0000 7f550b7fe640 1 -- 172.21.15.37:0/1504193081 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4032440 con 0x7f550c072840 2024-05-10T08:49:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.061+0000 7f550b7fe640 1 -- 172.21.15.37:0/1504193081 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4032810 con 0x7f550c072840 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 -- 172.21.15.37:0/1504193081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c072840 msgr2=0x7f550c0d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 --2- 172.21.15.37:0/1504193081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c072840 0x7f550c0d0f70 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f550c0d1cf0 tx=0x7f54f402a230 comp rx=0 tx=0).stop 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 -- 172.21.15.37:0/1504193081 shutdown_connections 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 --2- 172.21.15.37:0/1504193081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c072840 0x7f550c0d0f70 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 --2- 172.21.15.37:0/1504193081 >> v2:172.21.15.82:3300/0 conn(0x7f550c06e0f0 0x7f550c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 -- 172.21.15.37:0/1504193081 >> 172.21.15.37:0/1504193081 conn(0x7f550c06c3a0 msgr2=0x7f550c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 -- 172.21.15.37:0/1504193081 shutdown_connections 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.062+0000 7f55128dc640 1 -- 172.21.15.37:0/1504193081 wait complete. 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.063+0000 7f55128dc640 1 Processor -- start 2024-05-10T08:49:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.063+0000 7f55128dc640 1 -- start start 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f55128dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f550c06e0f0 0x7f550c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f55128dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c06e4d0 0x7f550c1f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f55128dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c072840 0x7f550c1f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f55128dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0ae650 con 0x7f550c06e4d0 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f55128dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f550c06e960 con 0x7f550c072840 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f55128dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f550c0ae7d0 con 0x7f550c06e0f0 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c06e4d0 0x7f550c1f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c06e4d0 0x7f550c1f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43644/0 (socket says 172.21.15.37:43644) 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 -- 172.21.15.37:0/3370472643 learned_addr learned my addr 172.21.15.37:0/3370472643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5510e79640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c072840 0x7f550c1f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f550bfff640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f550c06e0f0 0x7f550c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 -- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f550c06e0f0 msgr2=0x7f550c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f550c06e0f0 0x7f550c158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 -- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c072840 msgr2=0x7f550c1f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c072840 0x7f550c1f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5503fff640 1 -- 172.21.15.37:0/3370472643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c0cece0 con 0x7f550c06e4d0 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f5510e79640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c072840 0x7f550c1f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.064+0000 7f550bfff640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f550c06e0f0 0x7f550c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.065+0000 7f5503fff640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c06e4d0 0x7f550c1f58c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f54f40090b0 tx=0x7f54f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.065+0000 7f55097fa640 1 -- 172.21.15.37:0/3370472643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4037040 con 0x7f550c06e4d0 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.065+0000 7f55097fa640 1 -- 172.21.15.37:0/3370472643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4042070 con 0x7f550c06e4d0 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.065+0000 7f55097fa640 1 -- 172.21.15.37:0/3370472643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4030bd0 con 0x7f550c06e4d0 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.065+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c0cefc0 con 0x7f550c06e4d0 2024-05-10T08:49:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.065+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c0cf580 con 0x7f550c06e4d0 2024-05-10T08:49:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.066+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550c0693f0 con 0x7f550c06e4d0 2024-05-10T08:49:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.066+0000 7f55097fa640 1 -- 172.21.15.37:0/3370472643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f54f4047460 con 0x7f550c06e4d0 2024-05-10T08:49:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.067+0000 7f55097fa640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f54ec0762d0 0x7f54ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.067+0000 7f55097fa640 1 -- 172.21.15.37:0/3370472643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f54f40b8450 con 0x7f550c06e4d0 2024-05-10T08:49:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.067+0000 7f550bfff640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f54ec0762d0 0x7f54ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.068+0000 7f550bfff640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f54ec0762d0 0x7f54ec078790 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006fd0 tx=0x7f54fc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.071+0000 7f55097fa640 1 -- 172.21.15.37:0/3370472643 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f54f4081c20 con 0x7f550c06e4d0 2024-05-10T08:49:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.304+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f550c0b39a0 con 0x7f550c06e4d0 2024-05-10T08:49:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.305+0000 7f55097fa640 1 -- 172.21.15.37:0/3370472643 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5180 (secure 0 0 0) 0x7f54f4081520 con 0x7f550c06e4d0 2024-05-10T08:49:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:35.304 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":98,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/202078248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":202078248},{"type":"v1","addr":"172.21.15.37:6835","nonce":202078248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:28.004653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2344331780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2344331780},{"type":"v1","addr":"172.21.15.82:6837","nonce":2344331780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8052,"qdb_cluster":[8052]},"id":8}]} 2024-05-10T08:49:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 98 2024-05-10T08:49:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f54ec0762d0 msgr2=0x7f54ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f54ec0762d0 0x7f54ec078790 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006fd0 tx=0x7f54fc008040 comp rx=0 tx=0).stop 2024-05-10T08:49:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c06e4d0 msgr2=0x7f550c1f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c06e4d0 0x7f550c1f58c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f54f40090b0 tx=0x7f54f40046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 shutdown_connections 2024-05-10T08:49:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f54ec0762d0 0x7f54ec078790 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c072840 0x7f550c1f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c06e4d0 0x7f550c1f58c0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 --2- 172.21.15.37:0/3370472643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f550c06e0f0 0x7f550c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 >> 172.21.15.37:0/3370472643 conn(0x7f550c06c3a0 msgr2=0x7f550c15b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 shutdown_connections 2024-05-10T08:49:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.307+0000 7f55128dc640 1 -- 172.21.15.37:0/3370472643 wait complete. 2024-05-10T08:49:35.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:49:25.024575+0000', 'modified': '2024-05-10T08:49:28.004653+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8052': {'gid': 8052, 'name': 'd', 'rank': 0, 'incarnation': 94, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2344331780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 2344331780}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2344331780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8052, 'qdb_cluster': [8052]} 2024-05-10T08:49:35.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:49:35.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-10T08:49:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.830+0000 7f1b5a01c640 1 Processor -- start 2024-05-10T08:49:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.830+0000 7f1b5a01c640 1 -- start start 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b5a01c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b540b2490 0x7f1b54070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b5a01c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b54070d20 0x7f1b540711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b5a01c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5406e110 con 0x7f1b541629b0 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b5a01c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5406dec0 con 0x7f1b54070d20 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b5a01c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5406e3f0 con 0x7f1b540b2490 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b53fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b54070d20 0x7f1b540711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b53fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b54070d20 0x7f1b540711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43660/0 (socket says 172.21.15.37:43660) 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b53fff640 1 -- 172.21.15.37:0/2663334928 learned_addr learned my addr 172.21.15.37:0/2663334928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.831+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2663334928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b540b2490 0x7f1b54070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b53fff640 1 -- 172.21.15.37:0/2663334928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b540b2490 msgr2=0x7f1b54070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b53fff640 1 --2- 172.21.15.37:0/2663334928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b540b2490 0x7f1b54070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b53fff640 1 -- 172.21.15.37:0/2663334928 >> v1:172.21.15.82:6789/0 conn(0x7f1b541629b0 legacy=0x7f1b5406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b53fff640 1 -- 172.21.15.37:0/2663334928 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5406e6d0 con 0x7f1b54070d20 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2663334928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b540b2490 0x7f1b54070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b53fff640 1 --2- 172.21.15.37:0/2663334928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b54070d20 0x7f1b540711a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009e50 tx=0x7f1b4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13e576342c04253 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b527fc640 1 -- 172.21.15.37:0/2663334928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c036070 con 0x7f1b54070d20 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.832+0000 7f1b527fc640 1 -- 172.21.15.37:0/2663334928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c031600 con 0x7f1b54070d20 2024-05-10T08:49:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b527fc640 1 -- 172.21.15.37:0/2663334928 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0319d0 con 0x7f1b54070d20 2024-05-10T08:49:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 -- 172.21.15.37:0/2663334928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b54070d20 msgr2=0x7f1b540711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/2663334928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b54070d20 0x7f1b540711a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009e50 tx=0x7f1b4c02a730 comp rx=0 tx=0).stop 2024-05-10T08:49:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 -- 172.21.15.37:0/2663334928 shutdown_connections 2024-05-10T08:49:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/2663334928 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b540b2490 0x7f1b54070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/2663334928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b54070d20 0x7f1b540711a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 -- 172.21.15.37:0/2663334928 >> 172.21.15.37:0/2663334928 conn(0x7f1b540b49d0 msgr2=0x7f1b540b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 -- 172.21.15.37:0/2663334928 shutdown_connections 2024-05-10T08:49:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.833+0000 7f1b5a01c640 1 -- 172.21.15.37:0/2663334928 wait complete. 2024-05-10T08:49:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.834+0000 7f1b5a01c640 1 Processor -- start 2024-05-10T08:49:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.834+0000 7f1b5a01c640 1 -- start start 2024-05-10T08:49:35.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b5a01c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b54070d20 0x7f1b540cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b5a01c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b540b2490 0x7f1b54147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b5a01c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b541629b0 0x7f1b5414a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b5a01c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b540709f0 con 0x7f1b541629b0 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b5a01c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b54070870 con 0x7f1b540b2490 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b5a01c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b540afcb0 con 0x7f1b54070d20 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b541629b0 0x7f1b5414a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b541629b0 0x7f1b5414a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43668/0 (socket says 172.21.15.37:43668) 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b53fff640 1 -- 172.21.15.37:0/253209066 learned_addr learned my addr 172.21.15.37:0/253209066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b540b2490 0x7f1b54147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.835+0000 7f1b537fe640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b54070d20 0x7f1b540cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b53fff640 1 -- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b54070d20 msgr2=0x7f1b540cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b53fff640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b54070d20 0x7f1b540cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b53fff640 1 -- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b540b2490 msgr2=0x7f1b54147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b53fff640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b540b2490 0x7f1b54147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b53fff640 1 -- 172.21.15.37:0/253209066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b540cf7b0 con 0x7f1b541629b0 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b537fe640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b54070d20 0x7f1b540cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b53fff640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b541629b0 0x7f1b5414a2e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009e50 tx=0x7f1b4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b3bfff640 1 -- 172.21.15.37:0/253209066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c036050 con 0x7f1b541629b0 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b3bfff640 1 -- 172.21.15.37:0/253209066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c042070 con 0x7f1b541629b0 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b540cfa50 con 0x7f1b541629b0 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b3bfff640 1 -- 172.21.15.37:0/253209066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c009510 con 0x7f1b541629b0 2024-05-10T08:49:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.836+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b540d0010 con 0x7f1b541629b0 2024-05-10T08:49:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.838+0000 7f1b3bfff640 1 -- 172.21.15.37:0/253209066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b4c007bf0 con 0x7f1b541629b0 2024-05-10T08:49:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.838+0000 7f1b3bfff640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b400762d0 0x7f1b40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.838+0000 7f1b3bfff640 1 -- 172.21.15.37:0/253209066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f1b4c0b85b0 con 0x7f1b541629b0 2024-05-10T08:49:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.838+0000 7f1b537fe640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b400762d0 0x7f1b40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.839+0000 7f1b5ce1b740 1 Processor -- start 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.839+0000 7f1b5ce1b740 1 -- start start 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.839+0000 7f1b537fe640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b400762d0 0x7f1b40078790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001660 tx=0x7f1b44009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc6f50 0x5589fffc9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fffc9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fff99bb0 0x5589fff9d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5589fff038d0 con 0x5589fff99bb0 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5589ffebcc10 con 0x5589fffc6f50 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5589ffeff890 con 0x5589fffc7330 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fff99bb0 0x5589fff9d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fff99bb0 0x5589fff9d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43680/0 (socket says 172.21.15.37:43680) 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 -- 172.21.15.37:0/603817023 learned_addr learned my addr 172.21.15.37:0/603817023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b537fe640 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc6f50 0x5589fffc9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fffc9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 -- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 msgr2=0x5589fffc9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fffc9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 -- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc6f50 msgr2=0x5589fffc9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc6f50 0x5589fffc9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 -- 172.21.15.37:0/603817023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ffec45d0 con 0x5589fff99bb0 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fffc9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b53fff640 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fff99bb0 0x5589fff9d3c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c07dc70 tx=0x7f1b4c07dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f5a0474a07b301 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b397fa640 1 -- 172.21.15.37:0/603817023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c080df0 con 0x5589fff99bb0 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b397fa640 1 -- 172.21.15.37:0/603817023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c037040 con 0x5589fff99bb0 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.840+0000 7f1b397fa640 1 -- 172.21.15.37:0/603817023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c086dc0 con 0x5589fff99bb0 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/603817023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fff99bb0 msgr2=0x5589fff9d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fff99bb0 0x5589fff9d3c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c07dc70 tx=0x7f1b4c07dda0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/603817023 shutdown_connections 2024-05-10T08:49:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fff99bb0 0x5589fff9d3c0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fffc9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/603817023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc6f50 0x5589fffc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/603817023 >> 172.21.15.37:0/603817023 conn(0x5589fff9be20 msgr2=0x5589fffe4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/603817023 shutdown_connections 2024-05-10T08:49:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.841+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/603817023 wait complete. 2024-05-10T08:49:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.842+0000 7f1b5ce1b740 1 -- start start 2024-05-10T08:49:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.842+0000 7f1b5ce1b740 1 Processor -- start 2024-05-10T08:49:35.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fffe7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589ffff8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589ffff8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5589fff038d0 con 0x5589fffc6f50 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5589ffec0760 con 0x5589fffec680 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5589fff9efd0 con 0x5589fffc7330 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 10 client.0 _ll_register_callbacks cb 0x5589ffef9cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fffe7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fffe7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43692/0 (socket says 172.21.15.37:43692) 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 -- 172.21.15.37:0/2183388101 learned_addr learned my addr 172.21.15.37:0/2183388101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b53fff640 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589ffff8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589ffff8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 -- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 msgr2=0x5589ffff8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589ffff8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 -- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 msgr2=0x5589ffff8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589ffff8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 -- 172.21.15.37:0/2183388101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ffc152d0 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b537fe640 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fffe7280 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400eac0 tx=0x7f1b44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5442f3579de17ad2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b327fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b327fc640 1 -- 172.21.15.37:0/2183388101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44027060 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b327fc640 1 -- 172.21.15.37:0/2183388101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f1b44010040 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.843+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b4c037040 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b327fc640 1 -- 172.21.15.37:0/2183388101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f1b44005480 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 10 client.8205 fetch_fsmap learned FSMap version 98 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5589ffcdf6b0 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b327fc640 1 -- 172.21.15.37:0/2183388101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c037040 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b327fc640 1 -- 172.21.15.37:0/2183388101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 98) ==== 3494+0+0 (secure 0 0 0) 0x7f1b44013420 con 0x5589fffc6f50 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 10 client.8205 fetch_fsmap finished waiting for FSMap version 98 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 10 client.8205 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 20 client.8205 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:35.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5589fffb1d80 0x5589fffeab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 4 client.8205 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 --> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589ffe87760 con 0x5589fffb1d80 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.844+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5589fffb1d80 0x5589fffeab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.845+0000 7f1b327fc640 10 client.8205 ms_handle_connect on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.845+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5589fffb1d80 0x5589fffeab80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69821f0415afb92 server_cookie=93377a007179e832 in_seq=0 out_seq=0 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.845+0000 7f1b327fc640 1 -- 172.21.15.37:0/2183388101 <== mds.0 v2:172.21.15.82:6835/2344331780 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5589ffe87760 con 0x5589fffb1d80 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.845+0000 7f1b327fc640 10 client.8205 handle_command_reply: tid=0 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.845+0000 7f1b5ce1b740 1 client.8205 shutdown 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 msgr2=0x5589fffe7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fffe7280 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400eac0 tx=0x7f1b44000ed0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 shutdown_connections 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5589fffb1d80 0x5589fffeab80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589ffff8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589ffff8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2183388101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fffe7280 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b327fc640 0 client.8205 ms_handle_reset on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:35.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 >> 172.21.15.37:0/2183388101 conn(0x5589fff99bb0 msgr2=0x5589fffc17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 shutdown_connections 2024-05-10T08:49:35.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2183388101 wait complete. 2024-05-10T08:49:35.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.846+0000 7f1b5ce1b740 20 client.8205 trim_cache size 0 max 16384 2024-05-10T08:49:35.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 Processor -- start 2024-05-10T08:49:35.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 -- start start 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc6f50 0x5589fffc9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc7330 0x5589fff99650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffec680 0x5589fff9a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b54200e80 con 0x5589fffec680 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b54160e90 con 0x5589fffc7330 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.865+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1b54200830 con 0x5589fffc6f50 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffec680 0x5589fff9a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffec680 0x5589fff9a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43702/0 (socket says 172.21.15.37:43702) 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 -- 172.21.15.37:0/3093879552 learned_addr learned my addr 172.21.15.37:0/3093879552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 -- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc6f50 msgr2=0x5589fffc9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b537fe640 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc6f50 0x5589fffc9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc7330 0x5589fff99650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc6f50 0x5589fffc9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 -- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc7330 msgr2=0x5589fff99650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc7330 0x5589fff99650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 -- 172.21.15.37:0/3093879552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589fff9b8d0 con 0x5589fffec680 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b53fff640 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffec680 0x5589fff9a550 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c081610 tx=0x7f1b4c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fc0b6c28b7a35f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b38ff9640 1 -- 172.21.15.37:0/3093879552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c07dcd0 con 0x5589fffec680 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b38ff9640 1 -- 172.21.15.37:0/3093879552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c0b5070 con 0x5589fffec680 2024-05-10T08:49:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.866+0000 7f1b38ff9640 1 -- 172.21.15.37:0/3093879552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c086de0 con 0x5589fffec680 2024-05-10T08:49:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/3093879552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffec680 msgr2=0x5589fff9a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffec680 0x5589fff9a550 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c081610 tx=0x7f1b4c03e000 comp rx=0 tx=0).stop 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/3093879552 shutdown_connections 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffec680 0x5589fff9a550 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffc7330 0x5589fff99650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/3093879552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc6f50 0x5589fffc9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/3093879552 >> 172.21.15.37:0/3093879552 conn(0x5589fff99bb0 msgr2=0x5589fffc0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/3093879552 shutdown_connections 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/3093879552 wait complete. 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.867+0000 7f1b5ce1b740 1 -- start start 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 1 Processor -- start 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fff9e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fff9e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589fffda580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5589fffb1c00 con 0x5589fffc6f50 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5589fffebc60 con 0x5589fffec680 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5589fffc0330 con 0x5589fffc7330 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b5ce1b740 10 client.0 _ll_register_callbacks cb 0x7f1b44001d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fff9e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fff9e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43706/0 (socket says 172.21.15.37:43706) 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.868+0000 7f1b537fe640 1 -- 172.21.15.37:0/2599259270 learned_addr learned my addr 172.21.15.37:0/2599259270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b537fe640 1 -- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 msgr2=0x5589fff9e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fff9e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b53fff640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589fffda580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b537fe640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fff9e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b537fe640 1 -- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 msgr2=0x5589fffda580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b537fe640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589fffda580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b537fe640 1 -- 172.21.15.37:0/2599259270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589fffe86a0 con 0x5589fffc6f50 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fff9e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b53fff640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589fffda580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b537fe640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fff9e120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f1b44005620 tx=0x7f1b44013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8147d49920c93f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b327fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b327fc640 1 -- 172.21.15.37:0/2599259270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440012e0 con 0x5589fffc6f50 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b327fc640 1 -- 172.21.15.37:0/2599259270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f1b44010040 con 0x5589fffc6f50 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b4c0b5070 con 0x5589fffc6f50 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b327fc640 1 -- 172.21.15.37:0/2599259270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f1b44013970 con 0x5589fffc6f50 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 10 client.8211 fetch_fsmap learned FSMap version 98 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5589fffcc9a0 con 0x5589fffc6f50 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b327fc640 1 -- 172.21.15.37:0/2599259270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c0b5070 con 0x5589fffc6f50 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b327fc640 1 -- 172.21.15.37:0/2599259270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 98) ==== 3494+0+0 (secure 0 0 0) 0x7f1b44013b10 con 0x5589fffc6f50 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 10 client.8211 fetch_fsmap finished waiting for FSMap version 98 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 10 client.8211 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 20 client.8211 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x558a00065f40 0x558a00066320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 4 client.8211 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.869+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 --> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] -- command(tid 0: {"prefix": "status"}) -- 0x5589fff114e0 con 0x558a00065f40 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x558a00065f40 0x558a00066320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b52ffd640 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x558a00065f40 0x558a00066320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=573a56669114cd33 server_cookie=e397791f4cc79b8c in_seq=0 out_seq=0 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b327fc640 10 client.8211 ms_handle_connect on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b327fc640 1 -- 172.21.15.37:0/2599259270 <== mds.0 v2:172.21.15.82:6835/2344331780 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5589fff114e0 con 0x558a00065f40 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b327fc640 10 client.8211 handle_command_reply: tid=0 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 client.8211 shutdown 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 msgr2=0x5589fff9e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fff9e120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f1b44005620 tx=0x7f1b44013000 comp rx=0 tx=0).stop 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 shutdown_connections 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x558a00065f40 0x558a00066320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589fffec680 0x5589fffda580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5589fffc7330 0x5589fff9e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 --2- 172.21.15.37:0/2599259270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589fffc6f50 0x5589fff9e120 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b327fc640 0 client.8211 ms_handle_reset on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.870+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 >> 172.21.15.37:0/2599259270 conn(0x5589fff99bb0 msgr2=0x5589fff99fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 shutdown_connections 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5ce1b740 1 -- 172.21.15.37:0/2599259270 wait complete. 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5ce1b740 20 client.8211 trim_cache size 0 max 16384 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8052, 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:49:35.875 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:49:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:49:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.260097765999999, 2024-05-10T08:49:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 98, 2024-05-10T08:49:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 117, 2024-05-10T08:49:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 117, 2024-05-10T08:49:35.876 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.235483036 2024-05-10T08:49:35.876 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b400762d0 msgr2=0x7f1b40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b400762d0 0x7f1b40078790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001660 tx=0x7f1b44009040 comp rx=0 tx=0).stop 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b541629b0 msgr2=0x7f1b5414a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b541629b0 0x7f1b5414a2e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009e50 tx=0x7f1b4c004a40 comp rx=0 tx=0).stop 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 shutdown_connections 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f1b400762d0 0x7f1b40078790 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b541629b0 0x7f1b5414a2e0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b540b2490 0x7f1b54147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 --2- 172.21.15.37:0/253209066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1b54070d20 0x7f1b540cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 >> 172.21.15.37:0/253209066 conn(0x7f1b540b49d0 msgr2=0x7f1b540b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 shutdown_connections 2024-05-10T08:49:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.871+0000 7f1b5a01c640 1 -- 172.21.15.37:0/253209066 wait complete. 2024-05-10T08:49:35.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:49:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.986+0000 7f921aa74640 1 Processor -- start 2024-05-10T08:49:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.986+0000 7f921aa74640 1 -- start start 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f921aa74640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f921406eaa0 0x7f9214073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f921aa74640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140b4590 con 0x7f92141524f0 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f921aa74640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140b4870 con 0x7f921415bc80 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f921aa74640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f92140b51a0 con 0x7f921406eaa0 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f9218810640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f92141524f0 0x7f92140b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49472/0 (socket says 172.21.15.37:49472) 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f9219011640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f921406eaa0 0x7f9214073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f9218810640 1 -- 172.21.15.37:0/442227182 learned_addr learned my addr 172.21.15.37:0/442227182 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f9219011640 1 -- 172.21.15.37:0/442227182 >> v1:172.21.15.82:6789/0 conn(0x7f921415bc80 legacy=0x7f921406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f9219011640 1 -- 172.21.15.37:0/442227182 >> v1:172.21.15.37:6789/0 conn(0x7f92141524f0 legacy=0x7f92140b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f9219011640 1 -- 172.21.15.37:0/442227182 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140b4b50 con 0x7f921406eaa0 2024-05-10T08:49:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.987+0000 7f92137fe640 1 -- 172.21.15.37:0/442227182 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3222437255 0 0) 0x7f92140b4590 con 0x7f92141524f0 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.988+0000 7f9219011640 1 --2- 172.21.15.37:0/442227182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921406eaa0 0x7f9214073700 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f920c009d90 tx=0x7f920c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e866def9d42a42 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.988+0000 7f92137fe640 1 -- 172.21.15.37:0/442227182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c007740 con 0x7f921406eaa0 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.988+0000 7f92137fe640 1 -- 172.21.15.37:0/442227182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c0078e0 con 0x7f921406eaa0 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.988+0000 7f92137fe640 1 -- 172.21.15.37:0/442227182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c007cb0 con 0x7f921406eaa0 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.989+0000 7f921aa74640 1 -- 172.21.15.37:0/442227182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921406eaa0 msgr2=0x7f9214073700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.989+0000 7f921aa74640 1 --2- 172.21.15.37:0/442227182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921406eaa0 0x7f9214073700 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f920c009d90 tx=0x7f920c02a6f0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.989+0000 7f921aa74640 1 -- 172.21.15.37:0/442227182 shutdown_connections 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.989+0000 7f921aa74640 1 --2- 172.21.15.37:0/442227182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921406eaa0 0x7f9214073700 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.989+0000 7f921aa74640 1 -- 172.21.15.37:0/442227182 >> 172.21.15.37:0/442227182 conn(0x7f921406c3a0 msgr2=0x7f921406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.989+0000 7f921aa74640 1 -- 172.21.15.37:0/442227182 shutdown_connections 2024-05-10T08:49:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.989+0000 7f921aa74640 1 -- 172.21.15.37:0/442227182 wait complete. 2024-05-10T08:49:35.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.990+0000 7f921aa74640 1 Processor -- start 2024-05-10T08:49:35.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.990+0000 7f921aa74640 1 -- start start 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f921aa74640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f921406eaa0 0x7f92140b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f921aa74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92141524f0 0x7f92140cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f921aa74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921415bc80 0x7f921415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f921aa74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92140b4330 con 0x7f921415bc80 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f921aa74640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9214073450 con 0x7f92141524f0 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f921aa74640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f92141528d0 con 0x7f921406eaa0 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921415bc80 0x7f921415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921415bc80 0x7f921415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43712/0 (socket says 172.21.15.37:43712) 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 -- 172.21.15.37:0/2722587141 learned_addr learned my addr 172.21.15.37:0/2722587141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9218810640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f921406eaa0 0x7f92140b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9213fff640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92141524f0 0x7f92140cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 -- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f921406eaa0 msgr2=0x7f92140b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f921406eaa0 0x7f92140b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 -- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92141524f0 msgr2=0x7f92140cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92141524f0 0x7f92140cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.991+0000 7f9219011640 1 -- 172.21.15.37:0/2722587141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921406e3d0 con 0x7f921415bc80 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.992+0000 7f9219011640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921415bc80 0x7f921415f100 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f920c009eb0 tx=0x7f920c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.992+0000 7f92117fa640 1 -- 172.21.15.37:0/2722587141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c040070 con 0x7f921415bc80 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.992+0000 7f92117fa640 1 -- 172.21.15.37:0/2722587141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c031c90 con 0x7f921415bc80 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.992+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92141f6590 con 0x7f921415bc80 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.992+0000 7f92117fa640 1 -- 172.21.15.37:0/2722587141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c03c640 con 0x7f921415bc80 2024-05-10T08:49:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.992+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92141f6e30 con 0x7f921415bc80 2024-05-10T08:49:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.993+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92140693f0 con 0x7f921415bc80 2024-05-10T08:49:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.994+0000 7f92117fa640 1 -- 172.21.15.37:0/2722587141 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f920c039040 con 0x7f921415bc80 2024-05-10T08:49:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.994+0000 7f92117fa640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92000762d0 0x7f9200078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.994+0000 7f92117fa640 1 -- 172.21.15.37:0/2722587141 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f920c0b8db0 con 0x7f921415bc80 2024-05-10T08:49:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.994+0000 7f9218810640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92000762d0 0x7f9200078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.995+0000 7f9218810640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92000762d0 0x7f9200078790 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9204000f60 tx=0x7f9204007b90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:35.998+0000 7f92117fa640 1 -- 172.21.15.37:0/2722587141 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f920c082640 con 0x7f921415bc80 2024-05-10T08:49:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.226+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f921415ca20 con 0x7f921415bc80 2024-05-10T08:49:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.226+0000 7f92117fa640 1 -- 172.21.15.37:0/2722587141 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) ==== 53+0+73 (secure 0 0 0) 0x7f920c081f40 con 0x7f921415bc80 2024-05-10T08:49:36.228 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:49:36.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92000762d0 msgr2=0x7f9200078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:36.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92000762d0 0x7f9200078790 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9204000f60 tx=0x7f9204007b90 comp rx=0 tx=0).stop 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921415bc80 msgr2=0x7f921415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921415bc80 0x7f921415f100 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f920c009eb0 tx=0x7f920c004a40 comp rx=0 tx=0).stop 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 shutdown_connections 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92000762d0 0x7f9200078790 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921415bc80 0x7f921415f100 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92141524f0 0x7f92140cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 --2- 172.21.15.37:0/2722587141 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f921406eaa0 0x7f92140b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 >> 172.21.15.37:0/2722587141 conn(0x7f921406c3a0 msgr2=0x7f92140aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 shutdown_connections 2024-05-10T08:49:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36.228+0000 7f921aa74640 1 -- 172.21.15.37:0/2722587141 wait complete. 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:49:36.238 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:36.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:36.239 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:36.255 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42185sec preferred_lft 42185sec 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:49:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:36.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:36.258 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:49:36.320 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:49:36.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:36.321 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:49:36.378 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:49:36.379 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:49:36.379 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:49:36.379 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:49:36.379 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:49:36.379 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:49:36.379 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:49:36.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:49:36.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:49:36.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:49:36.379 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:49:36.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:49:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:36.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:36.509 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:49:36.524 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:49:36.525 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:49:36.525 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:36.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:36.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:49:36.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:36.590 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:36.646 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:36.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:36.646 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:36.702 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:49:36.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:36.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:36.787 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:36.788 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:36.788 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:36.802 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:36.802 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:36.802 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:36.802 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:49:36.803 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:49:36.805 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:49:36.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:36.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:36.831 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:49:36.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:49:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:client8223 2024-05-10T08:49:36.936 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:36.936 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> parent = os.path.join(mount_point, "parent") 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> os.mkdir(parent) 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> flushed = os.path.join(parent, "flushed") 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> os.mkdir(flushed) 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> for f in ["alpha", "bravo", "charlie"]: 2024-05-10T08:49:36.953 DEBUG:teuthology.orchestra.run.smithi037:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-05-10T08:49:36.954 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:37.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:37.080 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T08:49:37.142 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2024-05-10T08:49:37.142 INFO:teuthology.orchestra.run.smithi037.stdout:./parent 2024-05-10T08:49:37.142 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed 2024-05-10T08:49:37.143 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/charlie 2024-05-10T08:49:37.143 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/alpha 2024-05-10T08:49:37.143 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/bravo 2024-05-10T08:49:37.143 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:37.143 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:37.143 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:37.143 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:37.143 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T08:49:37.143 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:37.250 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:49:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:37.259 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:37.259 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:37.259 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:37.259 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:37.259 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-05-10T08:49:37.260 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:37.367 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2024-05-10T08:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:37.376 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:37.376 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:37.376 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:37.376 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:37.376 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-05-10T08:49:37.376 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:37.484 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2024-05-10T08:49:37.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:37.494 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:37.494 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:37.494 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:37.494 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:37.494 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-05-10T08:49:37.494 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:37.601 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2024-05-10T08:49:37.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:37.610 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:37.610 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:37.610 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:37.610 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:37.610 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-05-10T08:49:37.610 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:37.718 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2024-05-10T08:49:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:37.727 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:37.727 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:37.727 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:37.727 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:37.727 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-05-10T08:49:37.727 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:37.835 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628279 2024-05-10T08:49:37.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:37.844 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:37.844 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:37.901 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:37.901 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:37.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:49:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.103+0000 7f64cdd46640 1 Processor -- start 2024-05-10T08:49:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.103+0000 7f64cdd46640 1 -- start start 2024-05-10T08:49:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64cdd46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c815f420 0x7f64c80d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64cdd46640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64c80d3ca0 0x7f64c80d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64cdd46640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c81630b0 con 0x7f64c80d1eb0 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64cdd46640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f64c80d22f0 con 0x7f64c80d3ca0 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64cdd46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f64c80d2550 con 0x7f64c815f420 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64c6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64c80d3ca0 0x7f64c80d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64c7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f64c80d1eb0 0x7f64c80d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47720/0 (socket says 172.21.15.37:47720) 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.104+0000 7f64c7fff640 1 -- 172.21.15.37:0/3265209128 learned_addr learned my addr 172.21.15.37:0/3265209128 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c77fe640 1 --2- 172.21.15.37:0/3265209128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c815f420 0x7f64c80d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c6ffd640 1 -- 172.21.15.37:0/3265209128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c815f420 msgr2=0x7f64c80d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c6ffd640 1 --2- 172.21.15.37:0/3265209128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c815f420 0x7f64c80d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c6ffd640 1 -- 172.21.15.37:0/3265209128 >> v1:172.21.15.37:6789/0 conn(0x7f64c80d1eb0 legacy=0x7f64c80d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c6ffd640 1 -- 172.21.15.37:0/3265209128 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c80d2c80 con 0x7f64c80d3ca0 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c77fe640 1 --2- 172.21.15.37:0/3265209128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c815f420 0x7f64c80d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c67fc640 1 -- 172.21.15.37:0/3265209128 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431399146 0 0) 0x7f64c0001490 con 0x7f64c80d1eb0 2024-05-10T08:49:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.105+0000 7f64c6ffd640 1 --2- 172.21.15.37:0/3265209128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80d3ca0 0x7f64c80d1970 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0097a0 tx=0x7f64bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578ed51e665996ba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64c67fc640 1 -- 172.21.15.37:0/3265209128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc037070 con 0x7f64c80d3ca0 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64c67fc640 1 -- 172.21.15.37:0/3265209128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64bc032440 con 0x7f64c80d3ca0 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64c67fc640 1 -- 172.21.15.37:0/3265209128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc032810 con 0x7f64c80d3ca0 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 -- 172.21.15.37:0/3265209128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80d3ca0 msgr2=0x7f64c80d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 --2- 172.21.15.37:0/3265209128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80d3ca0 0x7f64c80d1970 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0097a0 tx=0x7f64bc02a180 comp rx=0 tx=0).stop 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 -- 172.21.15.37:0/3265209128 shutdown_connections 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 --2- 172.21.15.37:0/3265209128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80d3ca0 0x7f64c80d1970 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 --2- 172.21.15.37:0/3265209128 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c815f420 0x7f64c80d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 -- 172.21.15.37:0/3265209128 >> 172.21.15.37:0/3265209128 conn(0x7f64c808eac0 msgr2=0x7f64c809e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 -- 172.21.15.37:0/3265209128 shutdown_connections 2024-05-10T08:49:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.106+0000 7f64cdd46640 1 -- 172.21.15.37:0/3265209128 wait complete. 2024-05-10T08:49:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.107+0000 7f64cdd46640 1 Processor -- start 2024-05-10T08:49:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64cdd46640 1 -- start start 2024-05-10T08:49:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64cdd46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c80d1eb0 0x7f64c815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64cdd46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80ba220 0x7f64c80b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64cdd46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64c80b8c10 0x7f64c80d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64cdd46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80d2830 con 0x7f64c80ba220 2024-05-10T08:49:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64cdd46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80d3240 con 0x7f64c80b8c10 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64cdd46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f64c80d53d0 con 0x7f64c80d1eb0 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.108+0000 7f64c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80ba220 0x7f64c80b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80ba220 0x7f64c80b86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59352/0 (socket says 172.21.15.37:59352) 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 -- 172.21.15.37:0/2473387730 learned_addr learned my addr 172.21.15.37:0/2473387730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c77fe640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c80d1eb0 0x7f64c815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c7fff640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64c80b8c10 0x7f64c80d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 -- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c80d1eb0 msgr2=0x7f64c815d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c80d1eb0 0x7f64c815d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 -- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64c80b8c10 msgr2=0x7f64c80d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64c80b8c10 0x7f64c80d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 -- 172.21.15.37:0/2473387730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c80b7c30 con 0x7f64c80ba220 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64c6ffd640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80ba220 0x7f64c80b86d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0098c0 tx=0x7f64bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64affff640 1 -- 172.21.15.37:0/2473387730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc037040 con 0x7f64c80ba220 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64affff640 1 -- 172.21.15.37:0/2473387730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64bc030770 con 0x7f64c80ba220 2024-05-10T08:49:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c80cb630 con 0x7f64c80ba220 2024-05-10T08:49:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64affff640 1 -- 172.21.15.37:0/2473387730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc030b60 con 0x7f64c80ba220 2024-05-10T08:49:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.109+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c80b81b0 con 0x7f64c80ba220 2024-05-10T08:49:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.110+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c80693f0 con 0x7f64c80ba220 2024-05-10T08:49:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.111+0000 7f64affff640 1 -- 172.21.15.37:0/2473387730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64bc044020 con 0x7f64c80ba220 2024-05-10T08:49:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.111+0000 7f64affff640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f64b40762d0 0x7f64b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.111+0000 7f64affff640 1 -- 172.21.15.37:0/2473387730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f64bc0b7b70 con 0x7f64c80ba220 2024-05-10T08:49:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.112+0000 7f64c77fe640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f64b40762d0 0x7f64b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.112+0000 7f64c77fe640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f64b40762d0 0x7f64b4078790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64c815eb30 tx=0x7f64b8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.116+0000 7f64affff640 1 -- 172.21.15.37:0/2473387730 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f64bc032e20 con 0x7f64c80ba220 2024-05-10T08:49:38.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.320+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f64c80b4c50 con 0x7f64c80ba220 2024-05-10T08:49:38.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.321+0000 7f64affff640 1 -- 172.21.15.37:0/2473387730 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7f64bc089290 con 0x7f64c80ba220 2024-05-10T08:49:38.319 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:49:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f64b40762d0 msgr2=0x7f64b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f64b40762d0 0x7f64b4078790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64c815eb30 tx=0x7f64b8008040 comp rx=0 tx=0).stop 2024-05-10T08:49:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80ba220 msgr2=0x7f64c80b86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80ba220 0x7f64c80b86d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0098c0 tx=0x7f64bc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 shutdown_connections 2024-05-10T08:49:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f64b40762d0 0x7f64b4078790 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64c80b8c10 0x7f64c80d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c80ba220 0x7f64c80b86d0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 --2- 172.21.15.37:0/2473387730 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64c80d1eb0 0x7f64c815d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 >> 172.21.15.37:0/2473387730 conn(0x7f64c808eac0 msgr2=0x7f64c80b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 shutdown_connections 2024-05-10T08:49:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.323+0000 7f64cdd46640 1 -- 172.21.15.37:0/2473387730 wait complete. 2024-05-10T08:49:38.333 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:49:38.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:38.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:38.389 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:49:38.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:38.389 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:49:38.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-05-10T08:49:38.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.558+0000 7fe72da6d640 1 Processor -- start 2024-05-10T08:49:38.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.558+0000 7fe72da6d640 1 -- start start 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe72da6d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 0x7fe7280b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe72da6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7280b14e0 con 0x7fe72806c3a0 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe72da6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe728162e00 con 0x7fe7281638e0 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe72da6d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe728163450 con 0x7fe72815f0c0 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe727fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe72806c3a0 0x7fe72815f4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47726/0 (socket says 172.21.15.37:47726) 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe727fff640 1 -- 172.21.15.37:0/1253308419 learned_addr learned my addr 172.21.15.37:0/1253308419 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050361871 0 0) 0x7fe7280b14e0 con 0x7fe72806c3a0 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe710003520 con 0x7fe72806c3a0 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.559+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 0x7fe7280b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1323800702 0 0) 0x7fe710003520 con 0x7fe72806c3a0 2024-05-10T08:49:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 msgr2=0x7fe7280b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 0x7fe7280b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 >> v1:172.21.15.82:6789/0 conn(0x7fe7281638e0 legacy=0x7fe7280b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7281630e0 con 0x7fe72806c3a0 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fe7200019f0 con 0x7fe72806c3a0 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 >> v1:172.21.15.37:6789/0 conn(0x7fe72806c3a0 legacy=0x7fe72815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7100039e0 0x7fe710003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 0x7fe710004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe710004d40 0x7fe7100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe728163450 con 0x7fe7100039e0 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe71000ba70 con 0x7fe710004d40 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe71000bc70 con 0x7fe72815f0c0 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7100039e0 0x7fe710003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe726ffd640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 0x7fe710004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe727fff640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe710004d40 0x7fe7100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7277fe640 1 -- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 msgr2=0x7fe710004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe72815f0c0 0x7fe710004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7277fe640 1 -- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe710004d40 msgr2=0x7fe7100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe710004d40 0x7fe7100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.560+0000 7fe7277fe640 1 -- 172.21.15.37:0/1253308419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe710003520 con 0x7fe7100039e0 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.561+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7100039e0 0x7fe710003e20 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fe718009a90 tx=0x7fe710005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5727ce1b0ffac4cd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.561+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718036070 con 0x7fe7100039e0 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.561+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe718031400 con 0x7fe7100039e0 2024-05-10T08:49:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.561+0000 7fe7267fc640 1 -- 172.21.15.37:0/1253308419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718009690 con 0x7fe7100039e0 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.562+0000 7fe72da6d640 1 -- 172.21.15.37:0/1253308419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7100039e0 msgr2=0x7fe710003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.562+0000 7fe72da6d640 1 --2- 172.21.15.37:0/1253308419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7100039e0 0x7fe710003e20 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fe718009a90 tx=0x7fe710005830 comp rx=0 tx=0).stop 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.562+0000 7fe727fff640 1 -- 172.21.15.37:0/1253308419 reap_dead start 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.562+0000 7fe72da6d640 1 -- 172.21.15.37:0/1253308419 shutdown_connections 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.562+0000 7fe72da6d640 1 -- 172.21.15.37:0/1253308419 >> 172.21.15.37:0/1253308419 conn(0x7fe7280b3b10 msgr2=0x7fe7280b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.562+0000 7fe72da6d640 1 -- 172.21.15.37:0/1253308419 shutdown_connections 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.562+0000 7fe72da6d640 1 -- 172.21.15.37:0/1253308419 wait complete. 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.563+0000 7fe72da6d640 1 Processor -- start 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.563+0000 7fe72da6d640 1 -- start start 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe72da6d640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7100039e0 0x7fe728154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe72da6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7280aedf0 0x7fe728155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe72da6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe728156530 0x7fe7281569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe72da6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280b70c0 con 0x7fe7280aedf0 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe72da6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280b6f40 con 0x7fe728156530 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe72da6d640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe7280b7240 con 0x7fe7100039e0 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7280aedf0 0x7fe728155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7280aedf0 0x7fe728155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59374/0 (socket says 172.21.15.37:59374) 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 -- 172.21.15.37:0/1987224504 learned_addr learned my addr 172.21.15.37:0/1987224504 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 -- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7100039e0 msgr2=0x7fe728154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7100039e0 0x7fe728154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 -- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe728156530 msgr2=0x7fe7281569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe727fff640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe728156530 0x7fe7281569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe728156530 0x7fe7281569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe726ffd640 1 -- 172.21.15.37:0/1987224504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe728158de0 con 0x7fe7280aedf0 2024-05-10T08:49:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.564+0000 7fe727fff640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe728156530 0x7fe7281569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.565+0000 7fe726ffd640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7280aedf0 0x7fe728155ff0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00f850 tx=0x7fe71c00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.565+0000 7fe70ffff640 1 -- 172.21.15.37:0/1987224504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00fe40 con 0x7fe7280aedf0 2024-05-10T08:49:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.565+0000 7fe70ffff640 1 -- 172.21.15.37:0/1987224504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c018070 con 0x7fe7280aedf0 2024-05-10T08:49:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.565+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe728155880 con 0x7fe7280aedf0 2024-05-10T08:49:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.565+0000 7fe70ffff640 1 -- 172.21.15.37:0/1987224504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00d730 con 0x7fe7280aedf0 2024-05-10T08:49:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.565+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe728159360 con 0x7fe7280aedf0 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.567+0000 7fe70ffff640 1 -- 172.21.15.37:0/1987224504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe71c00d8d0 con 0x7fe7280aedf0 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.567+0000 7fe70ffff640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe714076300 0x7fe7140787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.568+0000 7fe70ffff640 1 -- 172.21.15.37:0/1987224504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fe71c097630 con 0x7fe7280aedf0 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.568+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe714076300 0x7fe7140787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.568+0000 7fe730785740 1 Processor -- start 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.568+0000 7fe730785740 1 -- start start 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.568+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe714076300 0x7fe7140787c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe718033000 tx=0x7fe71802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9d8faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9dc0280 0x5623e9dbf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe730785740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dbfb40 0x5623e9d94950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe730785740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5623e9d5c690 con 0x5623e9dbfb40 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623e9cf9f30 con 0x5623e9dc0280 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5623e9cb2b20 con 0x5623e9ddd160 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dbfb40 0x5623e9d94950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dbfb40 0x5623e9d94950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59388/0 (socket says 172.21.15.37:59388) 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 -- 172.21.15.37:0/386098813 learned_addr learned my addr 172.21.15.37:0/386098813 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe7277fe640 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9d8faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe726ffd640 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9dc0280 0x5623e9dbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 -- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 msgr2=0x5623e9d8faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9d8faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 -- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9dc0280 msgr2=0x5623e9dbf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9dc0280 0x5623e9dbf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.569+0000 7fe727fff640 1 -- 172.21.15.37:0/386098813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e9caae60 con 0x5623e9dbfb40 2024-05-10T08:49:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe727fff640 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dbfb40 0x5623e9d94950 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe720004df0 tx=0x7fe72000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f1bfc47703a78c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe70d7fa640 1 -- 172.21.15.37:0/386098813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720007620 con 0x5623e9dbfb40 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe70d7fa640 1 -- 172.21.15.37:0/386098813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720019070 con 0x5623e9dbfb40 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe70d7fa640 1 -- 172.21.15.37:0/386098813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720007a00 con 0x5623e9dbfb40 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe730785740 1 -- 172.21.15.37:0/386098813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dbfb40 msgr2=0x5623e9d94950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe730785740 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dbfb40 0x5623e9d94950 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe720004df0 tx=0x7fe72000a060 comp rx=0 tx=0).stop 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe730785740 1 -- 172.21.15.37:0/386098813 shutdown_connections 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe730785740 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dbfb40 0x5623e9d94950 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe730785740 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9dc0280 0x5623e9dbf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe730785740 1 --2- 172.21.15.37:0/386098813 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9d8faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.570+0000 7fe730785740 1 -- 172.21.15.37:0/386098813 >> 172.21.15.37:0/386098813 conn(0x5623e9d91d60 msgr2=0x5623e9dda600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.571+0000 7fe730785740 1 -- 172.21.15.37:0/386098813 shutdown_connections 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.571+0000 7fe730785740 1 -- 172.21.15.37:0/386098813 wait complete. 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.571+0000 7fe730785740 1 -- start start 2024-05-10T08:49:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.571+0000 7fe730785740 1 Processor -- start 2024-05-10T08:49:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe730785740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dd12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9ddb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe730785740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5623e9cb65e0 con 0x5623e9dc0280 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623e9cf5ef0 con 0x5623e9db0160 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5623e9d93f10 con 0x5623e9ddd160 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe730785740 10 client.0 _ll_register_callbacks cb 0x5623e9cb1320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dd12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dd12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59404/0 (socket says 172.21.15.37:59404) 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 -- 172.21.15.37:0/1379662377 learned_addr learned my addr 172.21.15.37:0/1379662377 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe727fff640 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe726ffd640 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9ddb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 -- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 msgr2=0x5623e9ddb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9ddb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 -- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 msgr2=0x5623e9ddbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.572+0000 7fe7277fe640 1 -- 172.21.15.37:0/1379662377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e9ad57d0 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe7277fe640 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dd12c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe718009b80 tx=0x7fe7180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ee38d6e7f5cfb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe7067fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe7067fc640 1 -- 172.21.15.37:0/1379662377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718036040 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe7067fc640 1 -- 172.21.15.37:0/1379662377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fe718003de0 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe720019070 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe7067fc640 1 -- 172.21.15.37:0/1379662377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fe718005990 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 10 client.8244 fetch_fsmap learned FSMap version 98 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5623e9a0b3f0 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe7067fc640 1 -- 172.21.15.37:0/1379662377 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720019070 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe7067fc640 1 -- 172.21.15.37:0/1379662377 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 98) ==== 3494+0+0 (secure 0 0 0) 0x7fe718059080 con 0x5623e9dc0280 2024-05-10T08:49:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 10 client.8244 fetch_fsmap finished waiting for FSMap version 98 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 10 client.8244 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 20 client.8244 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dc0c40 0x5623e9dc1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 4 client.8244 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 --> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623e9d07b40 con 0x5623e9dc0c40 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.573+0000 7fe726ffd640 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dc0c40 0x5623e9dc1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.574+0000 7fe726ffd640 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dc0c40 0x5623e9dc1020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12c36d8d6dba8a7 server_cookie=35c1faa9cd582d95 in_seq=0 out_seq=0 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.574+0000 7fe7067fc640 10 client.8244 ms_handle_connect on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.574+0000 7fe7067fc640 1 -- 172.21.15.37:0/1379662377 <== mds.0 v2:172.21.15.82:6835/2344331780 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5623e9d07b40 con 0x5623e9dc0c40 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.574+0000 7fe7067fc640 10 client.8244 handle_command_reply: tid=0 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 client.8244 shutdown 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 msgr2=0x5623e9dd12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dd12c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe718009b80 tx=0x7fe7180046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 shutdown_connections 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dc0c40 0x5623e9dc1020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9ddd160 0x5623e9ddb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 --2- 172.21.15.37:0/1379662377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dd12c0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe7067fc640 0 client.8244 ms_handle_reset on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 >> 172.21.15.37:0/1379662377 conn(0x5623e9dbfb40 msgr2=0x5623e9d8f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 shutdown_connections 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 1 -- 172.21.15.37:0/1379662377 wait complete. 2024-05-10T08:49:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.575+0000 7fe730785740 20 client.8244 trim_cache size 0 max 16384 2024-05-10T08:49:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.590+0000 7fe730785740 1 Processor -- start 2024-05-10T08:49:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.590+0000 7fe730785740 1 -- start start 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9db0160 0x5623e9dbaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe730785740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dde1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9ddd160 0x5623e9decf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe730785740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7282025e0 con 0x5623e9dc0280 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe728201620 con 0x5623e9ddd160 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe728200980 con 0x5623e9db0160 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dde1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dde1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59420/0 (socket says 172.21.15.37:59420) 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe726ffd640 1 -- 172.21.15.37:0/3396872151 learned_addr learned my addr 172.21.15.37:0/3396872151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe7277fe640 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9db0160 0x5623e9dbaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe727fff640 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9ddd160 0x5623e9decf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe726ffd640 1 -- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9db0160 msgr2=0x5623e9dbaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe726ffd640 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9db0160 0x5623e9dbaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe726ffd640 1 -- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9ddd160 msgr2=0x5623e9decf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.591+0000 7fe726ffd640 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9ddd160 0x5623e9decf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe726ffd640 1 -- 172.21.15.37:0/3396872151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e9d92ea0 con 0x5623e9dc0280 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe727fff640 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9ddd160 0x5623e9decf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe726ffd640 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dde1c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe71c060400 tx=0x7fe71c063040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3c3789e3d66ac7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe70cff9640 1 -- 172.21.15.37:0/3396872151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c079e60 con 0x5623e9dc0280 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe70cff9640 1 -- 172.21.15.37:0/3396872151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c060210 con 0x5623e9dc0280 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe70cff9640 1 -- 172.21.15.37:0/3396872151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c060e00 con 0x5623e9dc0280 2024-05-10T08:49:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 -- 172.21.15.37:0/3396872151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 msgr2=0x5623e9dde1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dde1c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe71c060400 tx=0x7fe71c063040 comp rx=0 tx=0).stop 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 -- 172.21.15.37:0/3396872151 shutdown_connections 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9ddd160 0x5623e9decf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9dc0280 0x5623e9dde1c0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 --2- 172.21.15.37:0/3396872151 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9db0160 0x5623e9dbaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 -- 172.21.15.37:0/3396872151 >> 172.21.15.37:0/3396872151 conn(0x5623e9dbfb40 msgr2=0x5623e9ddda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.592+0000 7fe730785740 1 -- 172.21.15.37:0/3396872151 shutdown_connections 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.593+0000 7fe730785740 1 -- 172.21.15.37:0/3396872151 wait complete. 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.593+0000 7fe730785740 1 -- start start 2024-05-10T08:49:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.593+0000 7fe730785740 1 Processor -- start 2024-05-10T08:49:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe730785740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9dc0280 0x5623e9dddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe730785740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9ddd160 0x5623e9e3eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe730785740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5623e9dbb310 con 0x5623e9ddd160 2024-05-10T08:49:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe728200fd0 con 0x5623e9db0160 2024-05-10T08:49:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe730785740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5623e9dd3200 con 0x5623e9dc0280 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe730785740 10 client.0 _ll_register_callbacks cb 0x7fe7100036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9ddd160 0x5623e9e3eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9ddd160 0x5623e9e3eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59434/0 (socket says 172.21.15.37:59434) 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 -- 172.21.15.37:0/2291038606 learned_addr learned my addr 172.21.15.37:0/2291038606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe7277fe640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe726ffd640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9dc0280 0x5623e9dddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 -- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9dc0280 msgr2=0x5623e9dddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9dc0280 0x5623e9dddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 -- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 msgr2=0x5623e9ddda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe727fff640 1 -- 172.21.15.37:0/2291038606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e99cb0f0 con 0x5623e9ddd160 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.594+0000 7fe7277fe640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe727fff640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9ddd160 0x5623e9e3eaa0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe720007c30 tx=0x7fe7281633c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f675d57d8a76214 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe7067fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe7067fc640 1 -- 172.21.15.37:0/2291038606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72002e060 con 0x5623e9ddd160 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe7067fc640 1 -- 172.21.15.37:0/2291038606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fe7200206e0 con 0x5623e9ddd160 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe71c060210 con 0x5623e9ddd160 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe7067fc640 1 -- 172.21.15.37:0/2291038606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fe720034050 con 0x5623e9ddd160 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 10 client.8250 fetch_fsmap learned FSMap version 98 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5623e9e3f810 con 0x5623e9ddd160 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe7067fc640 1 -- 172.21.15.37:0/2291038606 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c060210 con 0x5623e9ddd160 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe7067fc640 1 -- 172.21.15.37:0/2291038606 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 98) ==== 3494+0+0 (secure 0 0 0) 0x7fe720037020 con 0x5623e9ddd160 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 10 client.8250 fetch_fsmap finished waiting for FSMap version 98 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 10 client.8250 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 20 client.8250 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dbb5d0 0x5623e9e3efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 4 client.8250 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T08:49:38.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 --> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623e9d019b0 con 0x5623e9dbb5d0 2024-05-10T08:49:38.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.595+0000 7fe7277fe640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dbb5d0 0x5623e9e3efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.596+0000 7fe7277fe640 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dbb5d0 0x5623e9e3efe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34bf457b1fd8bff5 server_cookie=5eb3fedcfb742a9f in_seq=0 out_seq=0 2024-05-10T08:49:38.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.596+0000 7fe7067fc640 10 client.8250 ms_handle_connect on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe7067fc640 1 -- 172.21.15.37:0/2291038606 <== mds.0 v2:172.21.15.82:6835/2344331780 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623e9d019b0 con 0x5623e9dbb5d0 2024-05-10T08:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe7067fc640 10 client.8250 handle_command_reply: tid=0 2024-05-10T08:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 client.8250 shutdown 2024-05-10T08:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9ddd160 msgr2=0x5623e9e3eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9ddd160 0x5623e9e3eaa0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe720007c30 tx=0x7fe7281633c0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 shutdown_connections 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:6835/2344331780,v1:172.21.15.82:6837/2344331780] conn(0x5623e9dbb5d0 0x5623e9e3efe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623e9ddd160 0x5623e9e3eaa0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x5623e9dc0280 0x5623e9dddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe7067fc640 0 client.8250 ms_handle_reset on v2:172.21.15.82:6835/2344331780 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 --2- 172.21.15.37:0/2291038606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e9db0160 0x5623e9ddda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 >> 172.21.15.37:0/2291038606 conn(0x5623e9dbfb40 msgr2=0x5623e9decf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 shutdown_connections 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 1 -- 172.21.15.37:0/2291038606 wait complete. 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.612+0000 7fe730785740 20 client.8250 trim_cache size 0 max 16384 2024-05-10T08:49:38.612 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:38.613 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2024-05-10T08:49:38.613 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0 2024-05-10T08:49:38.613 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe714076300 msgr2=0x7fe7140787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe714076300 0x7fe7140787c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe718033000 tx=0x7fe71802e000 comp rx=0 tx=0).stop 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7280aedf0 msgr2=0x7fe728155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7280aedf0 0x7fe728155ff0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00f850 tx=0x7fe71c00fd10 comp rx=0 tx=0).stop 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 shutdown_connections 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe714076300 0x7fe7140787c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe728156530 0x7fe7281569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7280aedf0 0x7fe728155ff0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 --2- 172.21.15.37:0/1987224504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe7100039e0 0x7fe728154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 >> 172.21.15.37:0/1987224504 conn(0x7fe7280b3b10 msgr2=0x7fe728160960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 shutdown_connections 2024-05-10T08:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.613+0000 7fe72da6d640 1 -- 172.21.15.37:0/1987224504 wait complete. 2024-05-10T08:49:38.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:49:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.727+0000 7f233df5f640 1 Processor -- start 2024-05-10T08:49:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.727+0000 7f233df5f640 1 -- start start 2024-05-10T08:49:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f233df5f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233815c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f233df5f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f233806e4d0 0x7f23380aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f233df5f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f233815c920 con 0x7f2338072840 2024-05-10T08:49:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f233df5f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f233815cc00 con 0x7f233806e4d0 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f233df5f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f233815cee0 con 0x7f233806e0f0 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f2337fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f233806e4d0 0x7f23380aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f2336ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2338072840 0x7f23380d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47734/0 (socket says 172.21.15.37:47734) 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f2336ffd640 1 -- 172.21.15.37:0/64586459 learned_addr learned my addr 172.21.15.37:0/64586459 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f23377fe640 1 --2- 172.21.15.37:0/64586459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f2337fff640 1 -- 172.21.15.37:0/64586459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 msgr2=0x7f233815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f2337fff640 1 --2- 172.21.15.37:0/64586459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233815c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f2337fff640 1 -- 172.21.15.37:0/64586459 >> v1:172.21.15.37:6789/0 conn(0x7f2338072840 legacy=0x7f23380d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.728+0000 7f2337fff640 1 -- 172.21.15.37:0/64586459 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233815d1c0 con 0x7f233806e4d0 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.729+0000 7f2337fff640 1 --2- 172.21.15.37:0/64586459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380aec30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2330009d90 tx=0x7f233002c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852e9f71db137f76 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.729+0000 7f23367fc640 1 -- 172.21.15.37:0/64586459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330032770 con 0x7f233806e4d0 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.729+0000 7f23367fc640 1 -- 172.21.15.37:0/64586459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2330038070 con 0x7f233806e4d0 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.729+0000 7f23367fc640 1 -- 172.21.15.37:0/64586459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330032b30 con 0x7f233806e4d0 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 -- 172.21.15.37:0/64586459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 msgr2=0x7f23380aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 --2- 172.21.15.37:0/64586459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380aec30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2330009d90 tx=0x7f233002c870 comp rx=0 tx=0).stop 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 -- 172.21.15.37:0/64586459 shutdown_connections 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 --2- 172.21.15.37:0/64586459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380aec30 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 --2- 172.21.15.37:0/64586459 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 -- 172.21.15.37:0/64586459 >> 172.21.15.37:0/64586459 conn(0x7f233806c3a0 msgr2=0x7f233806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 -- 172.21.15.37:0/64586459 shutdown_connections 2024-05-10T08:49:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.730+0000 7f233df5f640 1 -- 172.21.15.37:0/64586459 wait complete. 2024-05-10T08:49:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.731+0000 7f233df5f640 1 Processor -- start 2024-05-10T08:49:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.731+0000 7f233df5f640 1 -- start start 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f233df5f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f233df5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f233df5f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338072840 0x7f23380cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f233df5f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f23380ae7d0 con 0x7f233806e4d0 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f233df5f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f23380ae650 con 0x7f2338072840 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f233df5f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f23381530b0 con 0x7f233806e0f0 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59452/0 (socket says 172.21.15.37:59452) 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 -- 172.21.15.37:0/2876043506 learned_addr learned my addr 172.21.15.37:0/2876043506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f23377fe640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2337fff640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338072840 0x7f23380cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 -- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 msgr2=0x7f233814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 -- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338072840 msgr2=0x7f23380cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338072840 0x7f23380cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.732+0000 7f2336ffd640 1 -- 172.21.15.37:0/2876043506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380b0fb0 con 0x7f233806e4d0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.733+0000 7f2336ffd640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380b0a70 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f232c00c470 tx=0x7f232c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.733+0000 7f231ffff640 1 -- 172.21.15.37:0/2876043506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c017070 con 0x7f233806e4d0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.733+0000 7f231ffff640 1 -- 172.21.15.37:0/2876043506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232c005ce0 con 0x7f233806e4d0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.733+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23381e47b0 con 0x7f233806e4d0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.733+0000 7f231ffff640 1 -- 172.21.15.37:0/2876043506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c0072d0 con 0x7f233806e4d0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.733+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23381e4d70 con 0x7f233806e4d0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.734+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23380693f0 con 0x7f233806e4d0 2024-05-10T08:49:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.734+0000 7f231ffff640 1 -- 172.21.15.37:0/2876043506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f232c01a070 con 0x7f233806e4d0 2024-05-10T08:49:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.735+0000 7f231ffff640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23240762d0 0x7f2324078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.735+0000 7f231ffff640 1 -- 172.21.15.37:0/2876043506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f232c096880 con 0x7f233806e4d0 2024-05-10T08:49:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.735+0000 7f23377fe640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23240762d0 0x7f2324078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.736+0000 7f23377fe640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23240762d0 0x7f2324078790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2328006fd0 tx=0x7f2328008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.739+0000 7f231ffff640 1 -- 172.21.15.37:0/2876043506 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f232c05fa90 con 0x7f233806e4d0 2024-05-10T08:49:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.968+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f23380cd130 con 0x7f233806e4d0 2024-05-10T08:49:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.968+0000 7f231ffff640 1 -- 172.21.15.37:0/2876043506 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) ==== 53+0+73 (secure 0 0 0) 0x7f232c063d90 con 0x7f233806e4d0 2024-05-10T08:49:38.967 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:49:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23240762d0 msgr2=0x7f2324078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23240762d0 0x7f2324078790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2328006fd0 tx=0x7f2328008040 comp rx=0 tx=0).stop 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 msgr2=0x7f23380b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380b0a70 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f232c00c470 tx=0x7f232c00c930 comp rx=0 tx=0).stop 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 shutdown_connections 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23240762d0 0x7f2324078790 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338072840 0x7f23380cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f233806e4d0 0x7f23380b0a70 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 --2- 172.21.15.37:0/2876043506 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f233806e0f0 0x7f233814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.970+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 >> 172.21.15.37:0/2876043506 conn(0x7f233806c3a0 msgr2=0x7f233806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.971+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 shutdown_connections 2024-05-10T08:49:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:38.971+0000 7f233df5f640 1 -- 172.21.15.37:0/2876043506 wait complete. 2024-05-10T08:49:38.980 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:49:38.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:49:38.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:49:38.981 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:49:38.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:38.981 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:49:38.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:49:38.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:49:38.981 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:38.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:38.981 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:38.998 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42183sec preferred_lft 42183sec 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:49:38.999 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:49:39.000 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:39.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.001 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:49:39.063 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:49:39.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.065 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:49:39.121 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:49:39.121 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:49:39.121 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:49:39.121 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:49:39.121 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:49:39.122 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:49:39.122 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:49:39.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:49:39.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:49:39.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:49:39.122 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:49:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:49:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:39.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.251 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:49:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:49:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:49:39.267 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:39.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:49:39.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:39.333 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:39.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:39.390 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:39.445 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:49:39.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:39.530 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:39.530 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:39.530 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:39.550 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:39.550 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:39.550 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:39.550 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:39.550 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:39.550 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:49:39.551 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:49:39.551 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:49:39.551 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:49:39.551 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:49:39.551 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:49:39.551 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:49:39.551 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:49:39.553 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:49:39.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:39.619 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:49:39.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:49:39.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:client8262 2024-05-10T08:49:39.718 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:39.718 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:39.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.735 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-05-10T08:49:39.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:39.796 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-05-10T08:49:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:8+0 records in 2024-05-10T08:49:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:8+0 records out 2024-05-10T08:49:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0237337 s, 353 MB/s 2024-05-10T08:49:39.877 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:39.877 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:39.877 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:39.877 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:39.877 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-05-10T08:49:39.877 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:39.986 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627779 2024-05-10T08:49:39.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:39.995 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:39.995 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:39.996 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:39.996 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:39.996 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-05-10T08:49:39.996 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:40.103 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627780 2024-05-10T08:49:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:40.112 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:40.112 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:40.169 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:40.169 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:40.226 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:49:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.370+0000 7f98dbd66640 1 Processor -- start 2024-05-10T08:49:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.371+0000 7f98dbd66640 1 -- start start 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.371+0000 7f98dbd66640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98d4070d30 0x7f98d40d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.371+0000 7f98dbd66640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98d4071110 0x7f98d406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98dbd66640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d40d1300 con 0x7f98d4163920 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98dbd66640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f98d40d10d0 con 0x7f98d4070d30 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98dbd66640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f98d4163db0 con 0x7f98d4071110 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98d9301640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98d4163920 0x7f98d40703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47748/0 (socket says 172.21.15.37:47748) 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98d9b02640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98d4070d30 0x7f98d40d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98d9301640 1 -- 172.21.15.37:0/3003092023 learned_addr learned my addr 172.21.15.37:0/3003092023 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98da303640 1 --2- 172.21.15.37:0/3003092023 >> v2:172.21.15.82:3300/0 conn(0x7f98d4071110 0x7f98d406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98d9b02640 1 -- 172.21.15.37:0/3003092023 >> v2:172.21.15.82:3300/0 conn(0x7f98d4071110 msgr2=0x7f98d406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98d9b02640 1 --2- 172.21.15.37:0/3003092023 >> v2:172.21.15.82:3300/0 conn(0x7f98d4071110 0x7f98d406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98d9b02640 1 -- 172.21.15.37:0/3003092023 >> v1:172.21.15.37:6789/0 conn(0x7f98d4163920 legacy=0x7f98d40703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.372+0000 7f98d9b02640 1 -- 172.21.15.37:0/3003092023 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d40d15e0 con 0x7f98d4070d30 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98d9b02640 1 --2- 172.21.15.37:0/3003092023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d40d20c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f98d4073540 tx=0x7f98d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b8df6a61c46c38 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98d8b00640 1 -- 172.21.15.37:0/3003092023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0037070 con 0x7f98d4070d30 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98d8b00640 1 -- 172.21.15.37:0/3003092023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d0032440 con 0x7f98d4070d30 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98d8b00640 1 -- 172.21.15.37:0/3003092023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0032810 con 0x7f98d4070d30 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98dbd66640 1 -- 172.21.15.37:0/3003092023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 msgr2=0x7f98d40d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98dbd66640 1 --2- 172.21.15.37:0/3003092023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d40d20c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f98d4073540 tx=0x7f98d002a1a0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98dbd66640 1 -- 172.21.15.37:0/3003092023 shutdown_connections 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.373+0000 7f98dbd66640 1 --2- 172.21.15.37:0/3003092023 >> v2:172.21.15.82:3300/0 conn(0x7f98d4071110 0x7f98d406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.374+0000 7f98dbd66640 1 --2- 172.21.15.37:0/3003092023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d40d20c0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.374+0000 7f98dbd66640 1 -- 172.21.15.37:0/3003092023 >> 172.21.15.37:0/3003092023 conn(0x7f98d40d2e90 msgr2=0x7f98d40d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:40.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.374+0000 7f98dbd66640 1 -- 172.21.15.37:0/3003092023 shutdown_connections 2024-05-10T08:49:40.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.374+0000 7f98dbd66640 1 -- 172.21.15.37:0/3003092023 wait complete. 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.375+0000 7f98dbd66640 1 Processor -- start 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.375+0000 7f98dbd66640 1 -- start start 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d415d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d4071110 0x7f98d415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98d4163920 0x7f98d415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98d40d1c30 con 0x7f98d4070d30 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f98d4070b80 con 0x7f98d4071110 2024-05-10T08:49:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f98d4071560 con 0x7f98d4163920 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d415d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d415d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59466/0 (socket says 172.21.15.37:59466) 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 -- 172.21.15.37:0/89710336 learned_addr learned my addr 172.21.15.37:0/89710336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9301640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d4071110 0x7f98d415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98da303640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98d4163920 0x7f98d415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 -- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98d4163920 msgr2=0x7f98d415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98d4163920 0x7f98d415e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 -- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d4071110 msgr2=0x7f98d415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d4071110 0x7f98d415dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 -- 172.21.15.37:0/89710336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d415ea50 con 0x7f98d4070d30 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98d9b02640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d415d500 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f98d0000c00 tx=0x7f98d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98ca7fc640 1 -- 172.21.15.37:0/89710336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0037040 con 0x7f98d4070d30 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98ca7fc640 1 -- 172.21.15.37:0/89710336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d0042070 con 0x7f98d4070d30 2024-05-10T08:49:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d40b5d80 con 0x7f98d4070d30 2024-05-10T08:49:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98ca7fc640 1 -- 172.21.15.37:0/89710336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0030bd0 con 0x7f98d4070d30 2024-05-10T08:49:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.376+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d40b6340 con 0x7f98d4070d30 2024-05-10T08:49:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.377+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d406fc30 con 0x7f98d4070d30 2024-05-10T08:49:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.378+0000 7f98ca7fc640 1 -- 172.21.15.37:0/89710336 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f98d0047460 con 0x7f98d4070d30 2024-05-10T08:49:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.379+0000 7f98ca7fc640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f98b80762d0 0x7f98b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:40.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.379+0000 7f98ca7fc640 1 -- 172.21.15.37:0/89710336 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f98d00b83f0 con 0x7f98d4070d30 2024-05-10T08:49:40.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.379+0000 7f98d9301640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f98b80762d0 0x7f98b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:40.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.379+0000 7f98d9301640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f98b80762d0 0x7f98b8078790 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f98d40b58a0 tx=0x7f98c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.383+0000 7f98ca7fc640 1 -- 172.21.15.37:0/89710336 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f98d406fc30 con 0x7f98d4070d30 2024-05-10T08:49:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.585+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f98d40d3d70 con 0x7f98d4070d30 2024-05-10T08:49:40.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.585+0000 7f98ca7fc640 1 -- 172.21.15.37:0/89710336 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7f98d0032e20 con 0x7f98d4070d30 2024-05-10T08:49:40.584 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-10T08:49:40.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f98b80762d0 msgr2=0x7f98b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:40.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f98b80762d0 0x7f98b8078790 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f98d40b58a0 tx=0x7f98c4009040 comp rx=0 tx=0).stop 2024-05-10T08:49:40.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 msgr2=0x7f98d415d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:40.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d415d500 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f98d0000c00 tx=0x7f98d00046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 shutdown_connections 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f98b80762d0 0x7f98b8078790 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98d4163920 0x7f98d415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d4071110 0x7f98d415dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 --2- 172.21.15.37:0/89710336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98d4070d30 0x7f98d415d500 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 >> 172.21.15.37:0/89710336 conn(0x7f98d40d2e90 msgr2=0x7f98d40b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 shutdown_connections 2024-05-10T08:49:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:40.587+0000 7f98dbd66640 1 -- 172.21.15.37:0/89710336 wait complete. 2024-05-10T08:49:40.597 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:49:40.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:40.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:40.659 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:49:40.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:40.731 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:49:40.747 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:40.748 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:40.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:49:40.803 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:49:40.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:40.804 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:49:40.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:49:40.859 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-10T08:49:40.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:49:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.006+0000 7fe912ddd640 1 Processor -- start 2024-05-10T08:49:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.006+0000 7fe912ddd640 1 -- start start 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe912ddd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90c1524f0 0x7fe90c0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe912ddd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90c0b4590 con 0x7fe90c06eaa0 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe912ddd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90c0b4870 con 0x7fe90c15bc80 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe912ddd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe90c0b51a0 con 0x7fe90c1524f0 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe910b79640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90c1524f0 0x7fe90c0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe91137a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe90c06eaa0 0x7fe90c073700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47758/0 (socket says 172.21.15.37:47758) 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe91137a640 1 -- 172.21.15.37:0/658683344 learned_addr learned my addr 172.21.15.37:0/658683344 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.007+0000 7fe910b79640 1 -- 172.21.15.37:0/658683344 >> v1:172.21.15.82:6789/0 conn(0x7fe90c15bc80 legacy=0x7fe90c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.008+0000 7fe910b79640 1 -- 172.21.15.37:0/658683344 >> v1:172.21.15.37:6789/0 conn(0x7fe90c06eaa0 legacy=0x7fe90c073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.008+0000 7fe90b7fe640 1 -- 172.21.15.37:0/658683344 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201054789 0 0) 0x7fe90c0b4590 con 0x7fe90c06eaa0 2024-05-10T08:49:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.008+0000 7fe910b79640 1 -- 172.21.15.37:0/658683344 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c0b4b50 con 0x7fe90c1524f0 2024-05-10T08:49:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.008+0000 7fe910b79640 1 --2- 172.21.15.37:0/658683344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c1524f0 0x7fe90c0b3c20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00a940 tx=0x7fe8fc02b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d93fa5f2611eae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.008+0000 7fe90b7fe640 1 -- 172.21.15.37:0/658683344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00b040 con 0x7fe90c1524f0 2024-05-10T08:49:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.008+0000 7fe90b7fe640 1 -- 172.21.15.37:0/658683344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8fc030710 con 0x7fe90c1524f0 2024-05-10T08:49:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.008+0000 7fe90b7fe640 1 -- 172.21.15.37:0/658683344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc030ae0 con 0x7fe90c1524f0 2024-05-10T08:49:41.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.009+0000 7fe912ddd640 1 -- 172.21.15.37:0/658683344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c1524f0 msgr2=0x7fe90c0b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.009+0000 7fe912ddd640 1 --2- 172.21.15.37:0/658683344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c1524f0 0x7fe90c0b3c20 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00a940 tx=0x7fe8fc02b5a0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.009+0000 7fe912ddd640 1 -- 172.21.15.37:0/658683344 shutdown_connections 2024-05-10T08:49:41.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.009+0000 7fe912ddd640 1 --2- 172.21.15.37:0/658683344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c1524f0 0x7fe90c0b3c20 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.009+0000 7fe912ddd640 1 -- 172.21.15.37:0/658683344 >> 172.21.15.37:0/658683344 conn(0x7fe90c06c3a0 msgr2=0x7fe90c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:41.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.009+0000 7fe912ddd640 1 -- 172.21.15.37:0/658683344 shutdown_connections 2024-05-10T08:49:41.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.009+0000 7fe912ddd640 1 -- 172.21.15.37:0/658683344 wait complete. 2024-05-10T08:49:41.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.010+0000 7fe912ddd640 1 Processor -- start 2024-05-10T08:49:41.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.010+0000 7fe912ddd640 1 -- start start 2024-05-10T08:49:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe912ddd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c06eaa0 0x7fe90c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe912ddd640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c1524f0 0x7fe90c158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe912ddd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c15bc80 0x7fe90c0cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe912ddd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c1528d0 con 0x7fe90c06eaa0 2024-05-10T08:49:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe912ddd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c073450 con 0x7fe90c15bc80 2024-05-10T08:49:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe912ddd640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c0b5630 con 0x7fe90c1524f0 2024-05-10T08:49:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe910b79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c06eaa0 0x7fe90c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe910b79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c06eaa0 0x7fe90c156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59474/0 (socket says 172.21.15.37:59474) 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe910b79640 1 -- 172.21.15.37:0/1694681142 learned_addr learned my addr 172.21.15.37:0/1694681142 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe91137a640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c15bc80 0x7fe90c0cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.011+0000 7fe90bfff640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c1524f0 0x7fe90c158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe910b79640 1 -- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c1524f0 msgr2=0x7fe90c158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe910b79640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c1524f0 0x7fe90c158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe910b79640 1 -- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c15bc80 msgr2=0x7fe90c0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe910b79640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c15bc80 0x7fe90c0cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe910b79640 1 -- 172.21.15.37:0/1694681142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c14db20 con 0x7fe90c06eaa0 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe910b79640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c06eaa0 0x7fe90c156ae0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00a940 tx=0x7fe8fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe9097fa640 1 -- 172.21.15.37:0/1694681142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc03f030 con 0x7fe90c06eaa0 2024-05-10T08:49:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe9097fa640 1 -- 172.21.15.37:0/1694681142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8fc030510 con 0x7fe90c06eaa0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90c1f6b50 con 0x7fe90c06eaa0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe9097fa640 1 -- 172.21.15.37:0/1694681142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc03b430 con 0x7fe90c06eaa0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.012+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90c1f7110 con 0x7fe90c06eaa0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.013+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c0693f0 con 0x7fe90c06eaa0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.013+0000 7fe9097fa640 1 -- 172.21.15.37:0/1694681142 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8fc042030 con 0x7fe90c06eaa0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.014+0000 7fe9097fa640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8f80762d0 0x7fe8f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.014+0000 7fe9097fa640 1 -- 172.21.15.37:0/1694681142 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7fe8fc0b7f00 con 0x7fe90c06eaa0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.014+0000 7fe90bfff640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8f80762d0 0x7fe8f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.015+0000 7fe90bfff640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8f80762d0 0x7fe8f8078790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe90c1f6980 tx=0x7fe900009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.019+0000 7fe9097fa640 1 -- 172.21.15.37:0/1694681142 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe8fc081110 con 0x7fe90c06eaa0 2024-05-10T08:49:41.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.250+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe90c072220 con 0x7fe90c06eaa0 2024-05-10T08:49:41.249 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:49:41.250+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:49:41.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.252+0000 7fe9097fa640 1 -- 172.21.15.37:0/1694681142 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) ==== 161+0+0 (secure 0 0 0) 0x7fe8fc085410 con 0x7fe90c06eaa0 2024-05-10T08:49:41.250 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8f80762d0 msgr2=0x7fe8f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8f80762d0 0x7fe8f8078790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe90c1f6980 tx=0x7fe900009060 comp rx=0 tx=0).stop 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c06eaa0 msgr2=0x7fe90c156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c06eaa0 0x7fe90c156ae0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00a940 tx=0x7fe8fc0046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 shutdown_connections 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe8f80762d0 0x7fe8f8078790 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90c15bc80 0x7fe90c0cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe90c1524f0 0x7fe90c158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 --2- 172.21.15.37:0/1694681142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c06eaa0 0x7fe90c156ae0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 >> 172.21.15.37:0/1694681142 conn(0x7fe90c06c3a0 msgr2=0x7fe90c15e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.255+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 shutdown_connections 2024-05-10T08:49:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.256+0000 7fe912ddd640 1 -- 172.21.15.37:0/1694681142 wait complete. 2024-05-10T08:49:41.257 INFO:tasks.ceph.mds.d.smithi082.stderr: -9655> 2024-05-10T08:49:20.634+0000 7f0b47488640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T08:49:41.257 INFO:tasks.ceph.mds.d.smithi082.stderr: -9654> 2024-05-10T08:49:20.635+0000 7f0b47488640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2024-05-10T08:49:41.258 INFO:tasks.ceph.mds.d.smithi082.stderr: -8507> 2024-05-10T08:49:27.587+0000 7f0b4147c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:49:41.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:41.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:41.294 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-05-10T08:49:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-05-10T08:49:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-05-10T08:49:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-05-10T08:49:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-05-10T08:49:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-10T08:49:41.322 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-05-10T08:49:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-05-10T08:49:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = False 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.327 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-05-10T08:49:41.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-05-10T08:49:41.329 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:41.330 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.331 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2024-05-10T08:49:41.332 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:41.333 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.334 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: mon down mkfs grace = 300 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-05-10T08:49:41.336 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-05-10T08:49:41.337 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2024-05-10T08:49:41.338 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-05-10T08:49:41.338 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = False 2024-05-10T08:49:41.338 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:41.338 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.338 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:41.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-05-10T08:49:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-05-10T08:49:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-05-10T08:49:41.433 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = False 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = False 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:41.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.436 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-05-10T08:49:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-05-10T08:49:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-05-10T08:49:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: mon down mkfs grace = 300 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T08:49:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = False 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = False 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:41.448 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-05-10T08:49:41.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.533+0000 7fec5af86f40 1 Processor -- start 2024-05-10T08:49:41.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.533+0000 7fec5af86f40 1 -- start start 2024-05-10T08:49:41.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5af86f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6315a5f60 0x55b631675640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5af86f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315ee990 0x55b63167d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5af86f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b63167e6d0 0x55b6315ed780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5af86f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b6315a8800 con 0x55b6315a5f60 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5af86f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b6315a63d0 con 0x55b63167e6d0 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5af86f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b6315a8ae0 con 0x55b6315ee990 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6315a5f60 0x55b631675640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6315a5f60 0x55b631675640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59496/0 (socket says 172.21.15.37:59496) 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 -- 172.21.15.37:0/2161013866 learned_addr learned my addr 172.21.15.37:0/2161013866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 -- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315ee990 msgr2=0x55b63167d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315ee990 0x55b63167d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 -- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b63167e6d0 msgr2=0x55b6315ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec59281640 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b63167e6d0 0x55b6315ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b63167e6d0 0x55b6315ed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 -- 172.21.15.37:0/2161013866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b631510350 con 0x55b6315a5f60 2024-05-10T08:49:41.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec59281640 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b63167e6d0 0x55b6315ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec58a80640 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6315a5f60 0x55b631675640 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fec48045ed0 tx=0x7fec48051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b4658d441f33ca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5727d640 1 -- 172.21.15.37:0/2161013866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48062070 con 0x55b6315a5f60 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.534+0000 7fec5727d640 1 -- 172.21.15.37:0/2161013866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec48054970 con 0x55b6315a5f60 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5727d640 1 -- 172.21.15.37:0/2161013866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48054d20 con 0x55b6315a5f60 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 -- 172.21.15.37:0/2161013866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6315a5f60 msgr2=0x55b631675640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6315a5f60 0x55b631675640 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fec48045ed0 tx=0x7fec48051000 comp rx=0 tx=0).stop 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 -- 172.21.15.37:0/2161013866 shutdown_connections 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b63167e6d0 0x55b6315ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315ee990 0x55b63167d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 --2- 172.21.15.37:0/2161013866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6315a5f60 0x55b631675640 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 -- 172.21.15.37:0/2161013866 >> 172.21.15.37:0/2161013866 conn(0x55b6315a6b30 msgr2=0x55b631680ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 -- 172.21.15.37:0/2161013866 shutdown_connections 2024-05-10T08:49:41.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.535+0000 7fec5af86f40 1 -- 172.21.15.37:0/2161013866 wait complete. 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 Processor -- start 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 -- start start 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315a5f60 0x55b63167abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6315ee990 0x55b631676360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b63167e6d0 0x55b6316768a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b6315d37f0 con 0x55b63167e6d0 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b6316818f0 con 0x55b6315ee990 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.536+0000 7fec5af86f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b6315d30d0 con 0x55b6315a5f60 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b63167e6d0 0x55b6316768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b63167e6d0 0x55b6316768a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59510/0 (socket says 172.21.15.37:59510) 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 -- 172.21.15.37:0/1998901709 learned_addr learned my addr 172.21.15.37:0/1998901709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec58a80640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315a5f60 0x55b63167abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec5827f640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6315ee990 0x55b631676360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 -- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315a5f60 msgr2=0x55b63167abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b6315a5f60 0x55b63167abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 -- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6315ee990 msgr2=0x55b631676360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6315ee990 0x55b631676360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 -- 172.21.15.37:0/1998901709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b631718550 con 0x55b63167e6d0 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec59281640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b63167e6d0 0x55b6316768a0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fec50005f80 tx=0x7fec500085b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec5627b640 1 -- 172.21.15.37:0/1998901709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50016020 con 0x55b63167e6d0 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec5627b640 1 -- 172.21.15.37:0/1998901709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec50012410 con 0x55b63167e6d0 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b631718830 con 0x55b63167e6d0 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec5627b640 1 -- 172.21.15.37:0/1998901709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5000e040 con 0x55b63167e6d0 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.537+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b631718df0 con 0x55b63167e6d0 2024-05-10T08:49:41.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.539+0000 7fec5627b640 1 -- 172.21.15.37:0/1998901709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec50019020 con 0x55b63167e6d0 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.539+0000 7fec5627b640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec44074ce0 0x7fec440771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.539+0000 7fec5627b640 1 -- 172.21.15.37:0/1998901709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7fec50095fd0 con 0x55b63167e6d0 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.539+0000 7fec58a80640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec44074ce0 0x7fec440771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.540+0000 7fec5af86f40 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55b631674a50 0x55b631674e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.540+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) -- 0x55b6316753a0 con 0x55b631674a50 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.540+0000 7fec5827f640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55b631674a50 0x55b631674e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.540+0000 7fec58a80640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec44074ce0 0x7fec440771a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fec48066000 tx=0x7fec48069040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.540+0000 7fec5827f640 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55b631674a50 0x55b631674e60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.543+0000 7fec5827f640 1 -- 172.21.15.37:0/1998901709 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v118'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec4c0098b0 con 0x55b631674a50 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.543+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55b631674a50 msgr2=0x55b631674e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.543+0000 7fec5af86f40 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x55b631674a50 0x55b631674e60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec44074ce0 msgr2=0x7fec440771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec44074ce0 0x7fec440771a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fec48066000 tx=0x7fec48069040 comp rx=0 tx=0).stop 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b63167e6d0 msgr2=0x55b6316768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 --2- 172.21.15.37:0/1998901709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b63167e6d0 0x55b6316768a0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fec50005f80 tx=0x7fec500085b0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec59281640 1 -- 172.21.15.37:0/1998901709 reap_dead start 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 shutdown_connections 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 >> 172.21.15.37:0/1998901709 conn(0x55b6315a6b30 msgr2=0x55b6315f1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 shutdown_connections 2024-05-10T08:49:41.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.544+0000 7fec5af86f40 1 -- 172.21.15.37:0/1998901709 wait complete. 2024-05-10T08:49:41.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T08:49:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.656+0000 7f5886966640 1 Processor -- start 2024-05-10T08:49:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.656+0000 7f5886966640 1 -- start start 2024-05-10T08:49:41.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.656+0000 7f5886966640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f588015f4e0 0x7f58800cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.656+0000 7f5886966640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58800d56b0 0x7f58800d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.656+0000 7f5886966640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58800d0320 con 0x7f58800d3aa0 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.656+0000 7f5886966640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f58800d0600 con 0x7f58800d56b0 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.656+0000 7f5886966640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f58800d08e0 con 0x7f588015f4e0 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f5877fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58800d3aa0 0x7f58800d4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47762/0 (socket says 172.21.15.37:47762) 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f5877fff640 1 -- 172.21.15.37:0/1988400728 learned_addr learned my addr 172.21.15.37:0/1988400728 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f587ffff640 1 --2- 172.21.15.37:0/1988400728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f588015f4e0 0x7f58800cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f5884f03640 1 --2- 172.21.15.37:0/1988400728 >> v2:172.21.15.82:3300/0 conn(0x7f58800d56b0 0x7f58800d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f587f7fe640 1 -- 172.21.15.37:0/1988400728 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1822296193 0 0) 0x7f58800d0320 con 0x7f58800d3aa0 2024-05-10T08:49:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f587f7fe640 1 -- 172.21.15.37:0/1988400728 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f586c003520 con 0x7f58800d3aa0 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f587ffff640 1 -- 172.21.15.37:0/1988400728 >> v2:172.21.15.82:3300/0 conn(0x7f58800d56b0 msgr2=0x7f58800d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f587ffff640 1 --2- 172.21.15.37:0/1988400728 >> v2:172.21.15.82:3300/0 conn(0x7f58800d56b0 0x7f58800d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f587ffff640 1 -- 172.21.15.37:0/1988400728 >> v1:172.21.15.37:6789/0 conn(0x7f58800d3aa0 legacy=0x7f58800d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f587ffff640 1 -- 172.21.15.37:0/1988400728 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58800d0bc0 con 0x7f588015f4e0 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.657+0000 7f5884f03640 1 --2- 172.21.15.37:0/1988400728 >> v2:172.21.15.82:3300/0 conn(0x7f58800d56b0 0x7f58800d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.658+0000 7f587ffff640 1 --2- 172.21.15.37:0/1988400728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f588015f4e0 0x7f58800cfcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58700097a0 tx=0x7f587002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40880b66c52a07eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.658+0000 7f587f7fe640 1 -- 172.21.15.37:0/1988400728 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870037070 con 0x7f588015f4e0 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.658+0000 7f587f7fe640 1 -- 172.21.15.37:0/1988400728 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5870032440 con 0x7f588015f4e0 2024-05-10T08:49:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.658+0000 7f587f7fe640 1 -- 172.21.15.37:0/1988400728 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870032810 con 0x7f588015f4e0 2024-05-10T08:49:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.658+0000 7f5886966640 1 -- 172.21.15.37:0/1988400728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f588015f4e0 msgr2=0x7f58800cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.658+0000 7f5886966640 1 --2- 172.21.15.37:0/1988400728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f588015f4e0 0x7f58800cfcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58700097a0 tx=0x7f587002a180 comp rx=0 tx=0).stop 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.659+0000 7f5886966640 1 -- 172.21.15.37:0/1988400728 shutdown_connections 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.659+0000 7f5886966640 1 --2- 172.21.15.37:0/1988400728 >> v2:172.21.15.82:3300/0 conn(0x7f58800d56b0 0x7f58800d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.659+0000 7f5886966640 1 --2- 172.21.15.37:0/1988400728 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f588015f4e0 0x7f58800cfcd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.659+0000 7f5886966640 1 -- 172.21.15.37:0/1988400728 >> 172.21.15.37:0/1988400728 conn(0x7f588008eac0 msgr2=0x7f588009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.659+0000 7f5886966640 1 -- 172.21.15.37:0/1988400728 shutdown_connections 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.659+0000 7f5886966640 1 -- 172.21.15.37:0/1988400728 wait complete. 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.660+0000 7f5886966640 1 Processor -- start 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.660+0000 7f5886966640 1 -- start start 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5886966640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58800d3aa0 0x7f58801f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5886966640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58800d56b0 0x7f58800ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5886966640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f588015f4e0 0x7f58800ba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5886966640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58800d3f00 con 0x7f58800d56b0 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5886966640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f588015f8c0 con 0x7f588015f4e0 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5886966640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f58800d4080 con 0x7f58800d3aa0 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58800d56b0 0x7f58800ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f587ffff640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58800d3aa0 0x7f58801f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58800d56b0 0x7f58800ba1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59526/0 (socket says 172.21.15.37:59526) 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 -- 172.21.15.37:0/476887374 learned_addr learned my addr 172.21.15.37:0/476887374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5884f03640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f588015f4e0 0x7f58800ba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 -- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58800d3aa0 msgr2=0x7f58801f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58800d3aa0 0x7f58801f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 -- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f588015f4e0 msgr2=0x7f58800ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f588015f4e0 0x7f58800ba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 -- 172.21.15.37:0/476887374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58801f5610 con 0x7f58800d56b0 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f587ffff640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58800d3aa0 0x7f58801f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5884f03640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f588015f4e0 0x7f58800ba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5877fff640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58800d56b0 0x7f58800ba1b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f586800c500 tx=0x7f586800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f587d7fa640 1 -- 172.21.15.37:0/476887374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868017070 con 0x7f58800d56b0 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f587d7fa640 1 -- 172.21.15.37:0/476887374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5868005ce0 con 0x7f58800d56b0 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f587d7fa640 1 -- 172.21.15.37:0/476887374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58680072b0 con 0x7f58800d56b0 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.661+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58801f58f0 con 0x7f58800d56b0 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.662+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58801f61b0 con 0x7f58800d56b0 2024-05-10T08:49:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.663+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58801f5ac0 con 0x7f58800d56b0 2024-05-10T08:49:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.663+0000 7f587d7fa640 1 -- 172.21.15.37:0/476887374 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f586801a070 con 0x7f58800d56b0 2024-05-10T08:49:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.664+0000 7f587d7fa640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58600762d0 0x7f5860078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.664+0000 7f587d7fa640 1 -- 172.21.15.37:0/476887374 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f58680969e0 con 0x7f58800d56b0 2024-05-10T08:49:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.664+0000 7f587ffff640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58600762d0 0x7f5860078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.664+0000 7f587ffff640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58600762d0 0x7f5860078790 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5870034000 tx=0x7f587002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.668+0000 7f587d7fa640 1 -- 172.21.15.37:0/476887374 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f586805fc60 con 0x7f58800d56b0 2024-05-10T08:49:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:41.901+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f58800693f0 con 0x7f58800d56b0 2024-05-10T08:49:42.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.256+0000 7f587d7fa640 1 -- 172.21.15.37:0/476887374 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v100) ==== 162+0+0 (secure 0 0 0) 0x7f5868063f60 con 0x7f58800d56b0 2024-05-10T08:49:42.255 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58600762d0 msgr2=0x7f5860078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58600762d0 0x7f5860078790 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5870034000 tx=0x7f587002e000 comp rx=0 tx=0).stop 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58800d56b0 msgr2=0x7f58800ba1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58800d56b0 0x7f58800ba1b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f586800c500 tx=0x7f586800c900 comp rx=0 tx=0).stop 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 shutdown_connections 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f58600762d0 0x7f5860078790 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f588015f4e0 0x7f58800ba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58800d56b0 0x7f58800ba1b0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 --2- 172.21.15.37:0/476887374 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f58800d3aa0 0x7f58801f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 >> 172.21.15.37:0/476887374 conn(0x7f588008eac0 msgr2=0x7f58800b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 shutdown_connections 2024-05-10T08:49:42.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.260+0000 7f5886966640 1 -- 172.21.15.37:0/476887374 wait complete. 2024-05-10T08:49:42.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.380+0000 7efccc9f0640 1 Processor -- start 2024-05-10T08:49:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.380+0000 7efccc9f0640 1 -- start start 2024-05-10T08:49:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efccc9f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcc8070d30 0x7efcc80d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efccc9f0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efccc9f0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc8163d80 con 0x7efcc8071110 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efccc9f0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efcc80d10d0 con 0x7efcc8070d30 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efccc9f0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efcc8070b80 con 0x7efcc8163920 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcc8070d30 0x7efcc80d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcc8070d30 0x7efcc80d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59536/0 (socket says 172.21.15.37:59536) 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc659c640 1 -- 172.21.15.37:0/2544159458 learned_addr learned my addr 172.21.15.37:0/2544159458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc659c640 1 -- 172.21.15.37:0/2544159458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 msgr2=0x7efcc80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc5d9b640 1 --2- 172.21.15.37:0/2544159458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc659c640 1 --2- 172.21.15.37:0/2544159458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc659c640 1 -- 172.21.15.37:0/2544159458 >> v1:172.21.15.82:6789/0 conn(0x7efcc8071110 legacy=0x7efcc806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc659c640 1 -- 172.21.15.37:0/2544159458 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80708e0 con 0x7efcc8070d30 2024-05-10T08:49:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.381+0000 7efcc5d9b640 1 --2- 172.21.15.37:0/2544159458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.382+0000 7efcc659c640 1 --2- 172.21.15.37:0/2544159458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8070d30 0x7efcc80d20c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009870 tx=0x7efcb802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b813f8bb6e170bf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.382+0000 7efcc559a640 1 -- 172.21.15.37:0/2544159458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8037070 con 0x7efcc8070d30 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.382+0000 7efcc559a640 1 -- 172.21.15.37:0/2544159458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb8032440 con 0x7efcc8070d30 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.382+0000 7efcc559a640 1 -- 172.21.15.37:0/2544159458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8032810 con 0x7efcc8070d30 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 -- 172.21.15.37:0/2544159458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8070d30 msgr2=0x7efcc80d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2544159458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8070d30 0x7efcc80d20c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009870 tx=0x7efcb802a200 comp rx=0 tx=0).stop 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 -- 172.21.15.37:0/2544159458 shutdown_connections 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2544159458 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2544159458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8070d30 0x7efcc80d20c0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 -- 172.21.15.37:0/2544159458 >> 172.21.15.37:0/2544159458 conn(0x7efcc80d2e90 msgr2=0x7efcc80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:42.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 -- 172.21.15.37:0/2544159458 shutdown_connections 2024-05-10T08:49:42.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.383+0000 7efccc9f0640 1 -- 172.21.15.37:0/2544159458 wait complete. 2024-05-10T08:49:42.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.384+0000 7efccc9f0640 1 Processor -- start 2024-05-10T08:49:42.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.384+0000 7efccc9f0640 1 -- start start 2024-05-10T08:49:42.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efccc9f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcc8070d30 0x7efcc81f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:42.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efccc9f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8071110 0x7efcc80c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:42.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efccc9f0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:42.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efccc9f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80d15e0 con 0x7efcc8071110 2024-05-10T08:49:42.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efccc9f0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80d1c30 con 0x7efcc8070d30 2024-05-10T08:49:42.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efccc9f0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efcc80d18c0 con 0x7efcc8163920 2024-05-10T08:49:42.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efcc5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8071110 0x7efcc80c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efcc5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8071110 0x7efcc80c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59538/0 (socket says 172.21.15.37:59538) 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efcc5d9b640 1 -- 172.21.15.37:0/2051297475 learned_addr learned my addr 172.21.15.37:0/2051297475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efcc659c640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcc8070d30 0x7efcc81f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.385+0000 7efcc6d9d640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcc5d9b640 1 -- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 msgr2=0x7efcc80b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcc5d9b640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcc5d9b640 1 -- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcc8070d30 msgr2=0x7efcc81f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcc5d9b640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcc8070d30 0x7efcc81f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcc5d9b640 1 -- 172.21.15.37:0/2051297475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80c9050 con 0x7efcc8071110 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcc5d9b640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8071110 0x7efcc80c7080 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c7f0 tx=0x7efcbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:42.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcb6ffd640 1 -- 172.21.15.37:0/2051297475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc015070 con 0x7efcc8071110 2024-05-10T08:49:42.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcb6ffd640 1 -- 172.21.15.37:0/2051297475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc007a30 con 0x7efcc8071110 2024-05-10T08:49:42.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc80c9330 con 0x7efcc8071110 2024-05-10T08:49:42.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efcb6ffd640 1 -- 172.21.15.37:0/2051297475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc007e00 con 0x7efcc8071110 2024-05-10T08:49:42.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.386+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc80c8cd0 con 0x7efcc8071110 2024-05-10T08:49:42.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.387+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc80c9850 con 0x7efcc8071110 2024-05-10T08:49:42.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.388+0000 7efcb6ffd640 1 -- 172.21.15.37:0/2051297475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcbc018070 con 0x7efcc8071110 2024-05-10T08:49:42.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.388+0000 7efcb6ffd640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca80762d0 0x7efca8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:42.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.388+0000 7efcb6ffd640 1 -- 172.21.15.37:0/2051297475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7efcbc0976d0 con 0x7efcc8071110 2024-05-10T08:49:42.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.389+0000 7efcc659c640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca80762d0 0x7efca8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:42.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.389+0000 7efcc659c640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca80762d0 0x7efca8078790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7efcb8034000 tx=0x7efcb802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:42.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.393+0000 7efcb6ffd640 1 -- 172.21.15.37:0/2051297475 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efcc80c9850 con 0x7efcc8071110 2024-05-10T08:49:42.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.621+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcc8068c40 con 0x7efcc8071110 2024-05-10T08:49:42.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.622+0000 7efcb6ffd640 1 -- 172.21.15.37:0/2051297475 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5179 (secure 0 0 0) 0x7efcc8068c40 con 0x7efcc8071110 2024-05-10T08:49:42.621 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:42.621 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:42.260165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8046":{"gid":8046,"name":"c","rank":0,"incarnation":101,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6835/202078248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":202078248},{"type":"v1","addr":"172.21.15.37:6835","nonce":202078248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T08:49:42.621 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 101 2024-05-10T08:49:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.623+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca80762d0 msgr2=0x7efca8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.623+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca80762d0 0x7efca8078790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7efcb8034000 tx=0x7efcb802e000 comp rx=0 tx=0).stop 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.623+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8071110 msgr2=0x7efcc80c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.623+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8071110 0x7efcc80c7080 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c7f0 tx=0x7efcbc00cbf0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 shutdown_connections 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efca80762d0 0x7efca8078790 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efcc8163920 0x7efcc80b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc8071110 0x7efcc80c7080 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 --2- 172.21.15.37:0/2051297475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcc8070d30 0x7efcc81f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 >> 172.21.15.37:0/2051297475 conn(0x7efcc80d2e90 msgr2=0x7efcc81609f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 shutdown_connections 2024-05-10T08:49:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:42.624+0000 7efccc9f0640 1 -- 172.21.15.37:0/2051297475 wait complete. 2024-05-10T08:49:43.036 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:49:25.024575+0000', 'modified': '2024-05-10T08:49:42.260165+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8046}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8046': {'gid': 8046, 'name': 'c', 'rank': 0, 'incarnation': 101, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6835/202078248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 202078248}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 202078248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:49:43.036 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8046:up:replay 2024-05-10T08:49:44.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:44.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.157+0000 7f8b43aa0640 1 Processor -- start 2024-05-10T08:49:44.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.157+0000 7f8b43aa0640 1 -- start start 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.158+0000 7f8b43aa0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b3c1629a0 0x7f8b3c0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.158+0000 7f8b43aa0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b3c0d3330 con 0x7f8b3c0d2dc0 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.158+0000 7f8b43aa0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b3c0d2170 con 0x7f8b3c0d0cb0 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.158+0000 7f8b43aa0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8b3c0d2450 con 0x7f8b3c1629a0 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.158+0000 7f8b4183c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b3c1629a0 0x7f8b3c0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.158+0000 7f8b4103b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b3c0d2dc0 0x7f8b3c0c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47774/0 (socket says 172.21.15.37:47774) 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.159+0000 7f8b4103b640 1 -- 172.21.15.37:0/189641300 learned_addr learned my addr 172.21.15.37:0/189641300 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.159+0000 7f8b4183c640 1 -- 172.21.15.37:0/189641300 >> v1:172.21.15.82:6789/0 conn(0x7f8b3c0d0cb0 legacy=0x7f8b3c0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.159+0000 7f8b4183c640 1 -- 172.21.15.37:0/189641300 >> v1:172.21.15.37:6789/0 conn(0x7f8b3c0d2dc0 legacy=0x7f8b3c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.159+0000 7f8b4183c640 1 -- 172.21.15.37:0/189641300 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c0d2730 con 0x7f8b3c1629a0 2024-05-10T08:49:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b4183c640 1 --2- 172.21.15.37:0/189641300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0d35c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f8b340097a0 tx=0x7f8b3402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3fe99b9507cc7b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b4083a640 1 -- 172.21.15.37:0/189641300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34037070 con 0x7f8b3c1629a0 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b4083a640 1 -- 172.21.15.37:0/189641300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3402adc0 con 0x7f8b3c1629a0 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b4083a640 1 -- 172.21.15.37:0/189641300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34032660 con 0x7f8b3c1629a0 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b43aa0640 1 -- 172.21.15.37:0/189641300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 msgr2=0x7f8b3c0d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/189641300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0d35c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f8b340097a0 tx=0x7f8b3402a0b0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b43aa0640 1 -- 172.21.15.37:0/189641300 shutdown_connections 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/189641300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0d35c0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b43aa0640 1 -- 172.21.15.37:0/189641300 >> 172.21.15.37:0/189641300 conn(0x7f8b3c0d4fe0 msgr2=0x7f8b3c0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b43aa0640 1 -- 172.21.15.37:0/189641300 shutdown_connections 2024-05-10T08:49:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.160+0000 7f8b43aa0640 1 -- 172.21.15.37:0/189641300 wait complete. 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 Processor -- start 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 -- start start 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0d0cb0 0x7f8b3c0ba7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3c0d2dc0 0x7f8b3c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0cf440 con 0x7f8b3c1629a0 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0cf2c0 con 0x7f8b3c0d0cb0 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.162+0000 7f8b43aa0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3c0d3b00 con 0x7f8b3c0d2dc0 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59568/0 (socket says 172.21.15.37:59568) 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 -- 172.21.15.37:0/1787521651 learned_addr learned my addr 172.21.15.37:0/1787521651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4183c640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0d0cb0 0x7f8b3c0ba7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4103b640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3c0d2dc0 0x7f8b3c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 -- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3c0d2dc0 msgr2=0x7f8b3c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3c0d2dc0 0x7f8b3c0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 -- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0d0cb0 msgr2=0x7f8b3c0ba7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0d0cb0 0x7f8b3c0ba7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 -- 172.21.15.37:0/1787521651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c0b7ca0 con 0x7f8b3c1629a0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4183c640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0d0cb0 0x7f8b3c0ba7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b4203d640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0ce190 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c7b0 tx=0x7f8b2c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b3a7fc640 1 -- 172.21.15.37:0/1787521651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c004b60 con 0x7f8b3c1629a0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b3a7fc640 1 -- 172.21.15.37:0/1787521651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b2c004d00 con 0x7f8b3c1629a0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3c0b7f80 con 0x7f8b3c1629a0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b3a7fc640 1 -- 172.21.15.37:0/1787521651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c00aa90 con 0x7f8b3c1629a0 2024-05-10T08:49:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.163+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3c0b8540 con 0x7f8b3c1629a0 2024-05-10T08:49:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.164+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3c0693f0 con 0x7f8b3c1629a0 2024-05-10T08:49:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.165+0000 7f8b3a7fc640 1 -- 172.21.15.37:0/1787521651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b2c00ac30 con 0x7f8b3c1629a0 2024-05-10T08:49:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.166+0000 7f8b3a7fc640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b28076300 0x7f8b280787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.166+0000 7f8b3a7fc640 1 -- 172.21.15.37:0/1787521651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f8b2c097d70 con 0x7f8b3c1629a0 2024-05-10T08:49:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.166+0000 7f8b4183c640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b28076300 0x7f8b280787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.167+0000 7f8b4183c640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b28076300 0x7f8b280787c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8b34034000 tx=0x7f8b3402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.170+0000 7f8b3a7fc640 1 -- 172.21.15.37:0/1787521651 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8b2c061460 con 0x7f8b3c1629a0 2024-05-10T08:49:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.400+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b3c15aa40 con 0x7f8b3c1629a0 2024-05-10T08:49:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.400+0000 7f8b3a7fc640 1 -- 172.21.15.37:0/1787521651 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5179 (secure 0 0 0) 0x7f8b2c060d60 con 0x7f8b3c1629a0 2024-05-10T08:49:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:44.400 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":103,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:43.264993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8046":{"gid":8046,"name":"c","rank":0,"incarnation":101,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.37:6835/202078248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":202078248},{"type":"v1","addr":"172.21.15.37:6835","nonce":202078248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T08:49:44.400 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 103 2024-05-10T08:49:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b28076300 msgr2=0x7f8b280787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b28076300 0x7f8b280787c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8b34034000 tx=0x7f8b3402e000 comp rx=0 tx=0).stop 2024-05-10T08:49:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 msgr2=0x7f8b3c0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0ce190 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c7b0 tx=0x7f8b2c00cc70 comp rx=0 tx=0).stop 2024-05-10T08:49:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 shutdown_connections 2024-05-10T08:49:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b28076300 0x7f8b280787c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b3c1629a0 0x7f8b3c0ce190 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b3c0d2dc0 0x7f8b3c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 --2- 172.21.15.37:0/1787521651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0d0cb0 0x7f8b3c0ba7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 >> 172.21.15.37:0/1787521651 conn(0x7f8b3c0d4fe0 msgr2=0x7f8b3c0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 shutdown_connections 2024-05-10T08:49:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:44.403+0000 7f8b43aa0640 1 -- 172.21.15.37:0/1787521651 wait complete. 2024-05-10T08:49:44.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:49:25.024575+0000', 'modified': '2024-05-10T08:49:43.264993+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8046}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8046': {'gid': 8046, 'name': 'c', 'rank': 0, 'incarnation': 101, 'state': 'up:rejoin', 'state_seq': 8, 'addr': '172.21.15.37:6835/202078248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 202078248}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 202078248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:49:44.815 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8046:up:rejoin 2024-05-10T08:49:45.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.935+0000 7f901f52b640 1 Processor -- start 2024-05-10T08:49:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.935+0000 7f901f52b640 1 -- start start 2024-05-10T08:49:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901f52b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f901815f0c0 0x7f90180b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901f52b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90181638e0 0x7f90180b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901f52b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f901806c3a0 0x7f901806c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901f52b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9018163450 con 0x7f901815f0c0 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901f52b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f90180b1260 con 0x7f901806c3a0 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901f52b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f90180b14e0 con 0x7f90181638e0 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901d2c7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f901815f0c0 0x7f90180b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901d2c7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f901815f0c0 0x7f90180b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59582/0 (socket says 172.21.15.37:59582) 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.936+0000 7f901d2c7640 1 -- 172.21.15.37:0/2408724985 learned_addr learned my addr 172.21.15.37:0/2408724985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901cac6640 1 --2- 172.21.15.37:0/2408724985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90181638e0 0x7f90180b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901dac8640 1 --2- 172.21.15.37:0/2408724985 >> v2:172.21.15.82:3300/0 conn(0x7f901806c3a0 0x7f901806c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901d2c7640 1 -- 172.21.15.37:0/2408724985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90181638e0 msgr2=0x7f90180b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901d2c7640 1 --2- 172.21.15.37:0/2408724985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90181638e0 0x7f90180b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901d2c7640 1 -- 172.21.15.37:0/2408724985 >> v2:172.21.15.82:3300/0 conn(0x7f901806c3a0 msgr2=0x7f901806c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901d2c7640 1 --2- 172.21.15.37:0/2408724985 >> v2:172.21.15.82:3300/0 conn(0x7f901806c3a0 0x7f901806c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901d2c7640 1 -- 172.21.15.37:0/2408724985 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9018162e00 con 0x7f901815f0c0 2024-05-10T08:49:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901cac6640 1 --2- 172.21.15.37:0/2408724985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90181638e0 0x7f90180b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901dac8640 1 --2- 172.21.15.37:0/2408724985 >> v2:172.21.15.82:3300/0 conn(0x7f901806c3a0 0x7f901806c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.937+0000 7f901d2c7640 1 --2- 172.21.15.37:0/2408724985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901815f0c0 0x7f90180b6f40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f90180d1d80 tx=0x7f901402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b4427c3a224af9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f900ffff640 1 -- 172.21.15.37:0/2408724985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014037070 con 0x7f901815f0c0 2024-05-10T08:49:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f900ffff640 1 -- 172.21.15.37:0/2408724985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9014032440 con 0x7f901815f0c0 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f900ffff640 1 -- 172.21.15.37:0/2408724985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014032810 con 0x7f901815f0c0 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 -- 172.21.15.37:0/2408724985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901815f0c0 msgr2=0x7f90180b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 --2- 172.21.15.37:0/2408724985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901815f0c0 0x7f90180b6f40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f90180d1d80 tx=0x7f901402a1e0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 -- 172.21.15.37:0/2408724985 shutdown_connections 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 --2- 172.21.15.37:0/2408724985 >> v2:172.21.15.82:3300/0 conn(0x7f901806c3a0 0x7f901806c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 --2- 172.21.15.37:0/2408724985 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f90181638e0 0x7f90180b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 --2- 172.21.15.37:0/2408724985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901815f0c0 0x7f90180b6f40 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 -- 172.21.15.37:0/2408724985 >> 172.21.15.37:0/2408724985 conn(0x7f90180b3b10 msgr2=0x7f90180b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 -- 172.21.15.37:0/2408724985 shutdown_connections 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.938+0000 7f901f52b640 1 -- 172.21.15.37:0/2408724985 wait complete. 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 Processor -- start 2024-05-10T08:49:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 -- start start 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901806c3a0 0x7f901815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f901815f0c0 0x7f90181f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90181638e0 0x7f90181f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9018073170 con 0x7f90181638e0 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90180b17c0 con 0x7f901806c3a0 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901f52b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f90180732f0 con 0x7f901815f0c0 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901dac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90181638e0 0x7f90181f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901dac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90181638e0 0x7f90181f4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59584/0 (socket says 172.21.15.37:59584) 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.940+0000 7f901dac8640 1 -- 172.21.15.37:0/2369395192 learned_addr learned my addr 172.21.15.37:0/2369395192 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901d2c7640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901806c3a0 0x7f901815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901cac6640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f901815f0c0 0x7f90181f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901dac8640 1 -- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f901815f0c0 msgr2=0x7f90181f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901dac8640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f901815f0c0 0x7f90181f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901dac8640 1 -- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901806c3a0 msgr2=0x7f901815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901dac8640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901806c3a0 0x7f901815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901dac8640 1 -- 172.21.15.37:0/2369395192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901815aed0 con 0x7f90181638e0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901dac8640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90181638e0 0x7f90181f4e60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f901000cf20 tx=0x7f901000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f900dffb640 1 -- 172.21.15.37:0/2369395192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901001a070 con 0x7f90181638e0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f900dffb640 1 -- 172.21.15.37:0/2369395192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901000d840 con 0x7f90181638e0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f900dffb640 1 -- 172.21.15.37:0/2369395192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901000dc30 con 0x7f90181638e0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.941+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90181f5700 con 0x7f90181638e0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.942+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90181f5cc0 con 0x7f90181638e0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.942+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90180693f0 con 0x7f90181638e0 2024-05-10T08:49:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.943+0000 7f900dffb640 1 -- 172.21.15.37:0/2369395192 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f901001d070 con 0x7f90181638e0 2024-05-10T08:49:45.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.944+0000 7f900dffb640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ffc0762d0 0x7f8ffc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:45.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.944+0000 7f900dffb640 1 -- 172.21.15.37:0/2369395192 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f9010097ec0 con 0x7f90181638e0 2024-05-10T08:49:45.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.944+0000 7f901d2c7640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ffc0762d0 0x7f8ffc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:45.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.944+0000 7f901d2c7640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ffc0762d0 0x7f8ffc078790 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9014034000 tx=0x7f901402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:45.948+0000 7f900dffb640 1 -- 172.21.15.37:0/2369395192 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9010061080 con 0x7f90181638e0 2024-05-10T08:49:46.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.184+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f901815d600 con 0x7f90181638e0 2024-05-10T08:49:46.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.184+0000 7f900dffb640 1 -- 172.21.15.37:0/2369395192 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5186 (secure 0 0 0) 0x7f9010065380 con 0x7f90181638e0 2024-05-10T08:49:46.183 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:46.183 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":104,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:45.271166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8046":{"gid":8046,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":9,"addr":"172.21.15.37:6835/202078248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":202078248},{"type":"v1","addr":"172.21.15.37:6835","nonce":202078248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8046,"qdb_cluster":[8046]},"id":8}]} 2024-05-10T08:49:46.183 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 104 2024-05-10T08:49:46.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ffc0762d0 msgr2=0x7f8ffc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ffc0762d0 0x7f8ffc078790 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9014034000 tx=0x7f901402e000 comp rx=0 tx=0).stop 2024-05-10T08:49:46.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90181638e0 msgr2=0x7f90181f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90181638e0 0x7f90181f4e60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f901000cf20 tx=0x7f901000a710 comp rx=0 tx=0).stop 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 shutdown_connections 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ffc0762d0 0x7f8ffc078790 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90181638e0 0x7f90181f4e60 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f901815f0c0 0x7f90181f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 --2- 172.21.15.37:0/2369395192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901806c3a0 0x7f901815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 >> 172.21.15.37:0/2369395192 conn(0x7f90180b3b10 msgr2=0x7f9018070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 shutdown_connections 2024-05-10T08:49:46.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.187+0000 7f901f52b640 1 -- 172.21.15.37:0/2369395192 wait complete. 2024-05-10T08:49:46.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:49:25.024575+0000', 'modified': '2024-05-10T08:49:45.271166+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8046}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8046': {'gid': 8046, 'name': 'c', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.37:6835/202078248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 202078248}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 202078248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8046, 'qdb_cluster': [8046]} 2024-05-10T08:49:46.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:49:46.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:49:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.708+0000 7fa8a0114640 1 Processor -- start 2024-05-10T08:49:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.708+0000 7fa8a0114640 1 -- start start 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa8a0114640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8980d20c0 0x7fa898163920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa8a0114640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa898071110 0x7fa89806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa8a0114640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8980d1300 con 0x7fa898070d30 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa8a0114640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa8980d10d0 con 0x7fa898071110 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa8a0114640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa898070b80 con 0x7fa8980d20c0 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89e6b1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa898071110 0x7fa89806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89deb0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa898070d30 0x7fa8980703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47790/0 (socket says 172.21.15.37:47790) 2024-05-10T08:49:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89deb0640 1 -- 172.21.15.37:0/1500551931 learned_addr learned my addr 172.21.15.37:0/1500551931 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1500551931 >> v2:172.21.15.82:3300/0 conn(0x7fa8980d20c0 0x7fa898163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89e6b1640 1 -- 172.21.15.37:0/1500551931 >> v2:172.21.15.82:3300/0 conn(0x7fa8980d20c0 msgr2=0x7fa898163920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1500551931 >> v2:172.21.15.82:3300/0 conn(0x7fa8980d20c0 0x7fa898163920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89e6b1640 1 -- 172.21.15.37:0/1500551931 >> v1:172.21.15.37:6789/0 conn(0x7fa898070d30 legacy=0x7fa8980703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89e6b1640 1 -- 172.21.15.37:0/1500551931 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8980d15e0 con 0x7fa898071110 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.709+0000 7fa89ceae640 1 -- 172.21.15.37:0/1500551931 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616649511 0 0) 0x7fa8980d1300 con 0x7fa898070d30 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.710+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1500551931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa89806d4b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa89806f610 tx=0x7fa89002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de30be0dab5b8e73 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.710+0000 7fa89ceae640 1 -- 172.21.15.37:0/1500551931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890007740 con 0x7fa898071110 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.710+0000 7fa89ceae640 1 -- 172.21.15.37:0/1500551931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8900078e0 con 0x7fa898071110 2024-05-10T08:49:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.710+0000 7fa89ceae640 1 -- 172.21.15.37:0/1500551931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890007cb0 con 0x7fa898071110 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 -- 172.21.15.37:0/1500551931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 msgr2=0x7fa89806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1500551931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa89806d4b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa89806f610 tx=0x7fa89002a680 comp rx=0 tx=0).stop 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 -- 172.21.15.37:0/1500551931 shutdown_connections 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1500551931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa89806d4b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1500551931 >> v2:172.21.15.82:3300/0 conn(0x7fa8980d20c0 0x7fa898163920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 -- 172.21.15.37:0/1500551931 >> 172.21.15.37:0/1500551931 conn(0x7fa8980d2e90 msgr2=0x7fa8980d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 -- 172.21.15.37:0/1500551931 shutdown_connections 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.711+0000 7fa8a0114640 1 -- 172.21.15.37:0/1500551931 wait complete. 2024-05-10T08:49:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.712+0000 7fa8a0114640 1 Processor -- start 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.712+0000 7fa8a0114640 1 -- start start 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa8a0114640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa898070d30 0x7fa89814aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa8a0114640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa8981591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa8a0114640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8980d20c0 0x7fa8980cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa8a0114640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa898071520 con 0x7fa898071110 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa8a0114640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa8980d1c30 con 0x7fa8980d20c0 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa8a0114640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa8980716a0 con 0x7fa898070d30 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa8981591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa8981591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59608/0 (socket says 172.21.15.37:59608) 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 -- 172.21.15.37:0/1155408371 learned_addr learned my addr 172.21.15.37:0/1155408371 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8980d20c0 0x7fa8980cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa898070d30 0x7fa89814aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 -- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa898070d30 msgr2=0x7fa89814aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa898070d30 0x7fa89814aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 -- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8980d20c0 msgr2=0x7fa8980cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8980d20c0 0x7fa8980cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 -- 172.21.15.37:0/1155408371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8980ce900 con 0x7fa898071110 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8980d20c0 0x7fa8980cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.713+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa8981591b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fa88800d830 tx=0x7fa88800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.714+0000 7fa88e7fc640 1 -- 172.21.15.37:0/1155408371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88800b6c0 con 0x7fa898071110 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.714+0000 7fa88e7fc640 1 -- 172.21.15.37:0/1155408371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa888019070 con 0x7fa898071110 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.714+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8980cebe0 con 0x7fa898071110 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.714+0000 7fa88e7fc640 1 -- 172.21.15.37:0/1155408371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88800ba80 con 0x7fa898071110 2024-05-10T08:49:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.714+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8980cf1a0 con 0x7fa898071110 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.715+0000 7fa88e7fc640 1 -- 172.21.15.37:0/1155408371 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa88800bc20 con 0x7fa898071110 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.716+0000 7fa88e7fc640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa87c0762d0 0x7fa87c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.716+0000 7fa88e7fc640 1 -- 172.21.15.37:0/1155408371 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7fa888097d60 con 0x7fa898071110 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.716+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa87c0762d0 0x7fa87c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.717+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa87c0762d0 0x7fa87c078790 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa894000f60 tx=0x7fa894007c00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.717+0000 7fa8a2e2d740 1 Processor -- start 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.717+0000 7fa8a2e2d740 1 -- start start 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b38760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b38ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b08bb0 0x55d443b0c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d443a728d0 con 0x55d443b08bb0 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d443a2bc10 con 0x55d443b36330 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d443a6e890 con 0x55d443b35f50 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b08bb0 0x55d443b0c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b08bb0 0x55d443b0c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59616/0 (socket says 172.21.15.37:59616) 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 -- 172.21.15.37:0/1209796086 learned_addr learned my addr 172.21.15.37:0/1209796086 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b38ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b38760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 -- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 msgr2=0x55d443b38760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b38760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 -- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 msgr2=0x55d443b38ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b38ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 -- 172.21.15.37:0/1209796086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d443a335d0 con 0x55d443b08bb0 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b38760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.718+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b08bb0 0x55d443b0c3c0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa890009e80 tx=0x7fa89002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51093c79269ebfb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa87b7fe640 1 -- 172.21.15.37:0/1209796086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890003c90 con 0x55d443b08bb0 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa87b7fe640 1 -- 172.21.15.37:0/1209796086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa890040070 con 0x55d443b08bb0 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa87b7fe640 1 -- 172.21.15.37:0/1209796086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890004240 con 0x55d443b08bb0 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1209796086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b08bb0 msgr2=0x55d443b0c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b08bb0 0x55d443b0c3c0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa890009e80 tx=0x7fa89002e000 comp rx=0 tx=0).stop 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1209796086 shutdown_connections 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b08bb0 0x55d443b0c3c0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b38ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1209796086 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b38760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1209796086 >> 172.21.15.37:0/1209796086 conn(0x55d443b0ae20 msgr2=0x55d443b53760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1209796086 shutdown_connections 2024-05-10T08:49:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.719+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1209796086 wait complete. 2024-05-10T08:49:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.720+0000 7fa8a2e2d740 1 -- start start 2024-05-10T08:49:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.720+0000 7fa8a2e2d740 1 Processor -- start 2024-05-10T08:49:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b2c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b36330 0x55d443b2e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b3a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d443b0dfd0 con 0x55d443b3a480 2024-05-10T08:49:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d443a2f760 con 0x55d443b35f50 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d443b0e2b0 con 0x55d443b36330 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa8a2e2d740 10 client.0 _ll_register_callbacks cb 0x55d443a68cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b3a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89deb0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b2c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b3a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59628/0 (socket says 172.21.15.37:59628) 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3857453815 learned_addr learned my addr 172.21.15.37:0/3857453815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89d6af640 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b36330 0x55d443b2e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b36330 msgr2=0x55d443b2e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b36330 0x55d443b2e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 msgr2=0x55d443b2c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b2c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3857453815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4437842d0 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.721+0000 7fa89deb0640 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b2c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b3a8e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa890009e50 tx=0x7fa890004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd585a3d31bb01d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa878ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa878ff9640 1 -- 172.21.15.37:0/3857453815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890045670 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa878ff9640 1 -- 172.21.15.37:0/3857453815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7fa890045810 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa890040070 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa878ff9640 1 -- 172.21.15.37:0/3857453815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fa890057050 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 10 client.8337 fetch_fsmap learned FSMap version 104 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55d44384e6b0 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa878ff9640 1 -- 172.21.15.37:0/3857453815 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa890040070 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa878ff9640 1 -- 172.21.15.37:0/3857453815 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 104) ==== 3494+0+0 (secure 0 0 0) 0x7fa89004d020 con 0x55d443b3a480 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 10 client.8337 fetch_fsmap finished waiting for FSMap version 104 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 10 client.8337 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:49:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 20 client.8337 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b56300 0x55d443b566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 4 client.8337 mds_command: new command op to 8046 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 --> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4439f6760 con 0x55d443b56300 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.722+0000 7fa89deb0640 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b56300 0x55d443b566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.723+0000 7fa89deb0640 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b56300 0x55d443b566e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b8b4b887dec75ed server_cookie=78e2a797ed48fe2e in_seq=0 out_seq=0 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.723+0000 7fa878ff9640 10 client.8337 ms_handle_connect on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.723+0000 7fa878ff9640 1 -- 172.21.15.37:0/3857453815 <== mds.0 v2:172.21.15.37:6833/202078248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d4439f6760 con 0x55d443b56300 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.723+0000 7fa878ff9640 10 client.8337 handle_command_reply: tid=0 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.723+0000 7fa8a2e2d740 1 client.8337 shutdown 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 msgr2=0x55d443b3a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b3a8e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa890009e50 tx=0x7fa890004ab0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 shutdown_connections 2024-05-10T08:49:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b56300 0x55d443b566e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b3a8e0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b36330 0x55d443b2e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa878ff9640 0 client.8337 ms_handle_reset on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3857453815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b2c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 >> 172.21.15.37:0/3857453815 conn(0x55d443b08bb0 msgr2=0x55d443b345d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 shutdown_connections 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3857453815 wait complete. 2024-05-10T08:49:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.724+0000 7fa8a2e2d740 20 client.8337 trim_cache size 0 max 16384 2024-05-10T08:49:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 Processor -- start 2024-05-10T08:49:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 -- start start 2024-05-10T08:49:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b39460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b35470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b359b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa898201c10 con 0x55d443b3a480 2024-05-10T08:49:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa898200cb0 con 0x55d443b36330 2024-05-10T08:49:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.743+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa898200040 con 0x55d443b35f50 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b359b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59636/0 (socket says 172.21.15.37:59636) 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3440576496 learned_addr learned my addr 172.21.15.37:0/3440576496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89deb0640 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b39460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89d6af640 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b35470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 msgr2=0x55d443b39460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b39460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 msgr2=0x55d443b35470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b35470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 -- 172.21.15.37:0/3440576496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d443b2e7e0 con 0x55d443b3a480 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89d6af640 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b35470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b359b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fa890002230 tx=0x7fa890048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a395d2747403282a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa87affd640 1 -- 172.21.15.37:0/3440576496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890045670 con 0x55d443b3a480 2024-05-10T08:49:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa87affd640 1 -- 172.21.15.37:0/3440576496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa890040070 con 0x55d443b3a480 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.744+0000 7fa87affd640 1 -- 172.21.15.37:0/3440576496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89004f440 con 0x55d443b3a480 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3440576496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 msgr2=0x55d443b359b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b359b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fa890002230 tx=0x7fa890048040 comp rx=0 tx=0).stop 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3440576496 shutdown_connections 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b3a480 0x55d443b359b0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b36330 0x55d443b35470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/3440576496 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b35f50 0x55d443b39460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3440576496 >> 172.21.15.37:0/3440576496 conn(0x55d443b08bb0 msgr2=0x55d443b3ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3440576496 shutdown_connections 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/3440576496 wait complete. 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 -- start start 2024-05-10T08:49:46.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.745+0000 7fa8a2e2d740 1 Processor -- start 2024-05-10T08:49:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b3a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b36330 0x55d443bd0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa8a2e2d740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b3a480 0x55d443b777e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d443b0dfd0 con 0x55d443b36330 2024-05-10T08:49:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa898200660 con 0x55d443b35f50 2024-05-10T08:49:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa8a2e2d740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d443b39f60 con 0x55d443b3a480 2024-05-10T08:49:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa8a2e2d740 10 client.0 _ll_register_callbacks cb 0x7fa88805d390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa89d6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b36330 0x55d443bd0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa89d6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b36330 0x55d443bd0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59644/0 (socket says 172.21.15.37:59644) 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa89d6af640 1 -- 172.21.15.37:0/1041701170 learned_addr learned my addr 172.21.15.37:0/1041701170 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b3a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.746+0000 7fa89e6b1640 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b3a480 0x55d443b777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa89d6af640 1 -- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b3a480 msgr2=0x55d443b777e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b3a480 0x55d443b777e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa89d6af640 1 -- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 msgr2=0x55d443b3a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b3a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa89d6af640 1 -- 172.21.15.37:0/1041701170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d443b54d50 con 0x55d443b36330 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa89d6af640 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b36330 0x55d443bd0b20 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa888006fd0 tx=0x7fa888060700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ca2cf9c9780c18 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa878ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa878ff9640 1 -- 172.21.15.37:0/1041701170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888078040 con 0x55d443b36330 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa878ff9640 1 -- 172.21.15.37:0/1041701170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7fa888095cd0 con 0x55d443b36330 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa890040070 con 0x55d443b36330 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa878ff9640 1 -- 172.21.15.37:0/1041701170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fa888069450 con 0x55d443b36330 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 10 client.8343 fetch_fsmap learned FSMap version 104 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55d443bd1180 con 0x55d443b36330 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa878ff9640 1 -- 172.21.15.37:0/1041701170 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa890040070 con 0x55d443b36330 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa878ff9640 1 -- 172.21.15.37:0/1041701170 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 104) ==== 3494+0+0 (secure 0 0 0) 0x7fa888092070 con 0x55d443b36330 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 10 client.8343 fetch_fsmap finished waiting for FSMap version 104 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 10 client.8343 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 20 client.8343 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b26c60 0x55d443b53760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 4 client.8343 mds_command: new command op to 8046 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.747+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 --> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] -- command(tid 0: {"prefix": "status"}) -- 0x55d443b576a0 con 0x55d443b26c60 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b26c60 0x55d443b53760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa878ff9640 10 client.8343 ms_handle_connect on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa89deb0640 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b26c60 0x55d443b53760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6330992f0a710293 server_cookie=c7e26b0c243d72fd in_seq=0 out_seq=0 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa878ff9640 1 -- 172.21.15.37:0/1041701170 <== mds.0 v2:172.21.15.37:6833/202078248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55d443b576a0 con 0x55d443b26c60 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa878ff9640 10 client.8343 handle_command_reply: tid=0 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 client.8343 shutdown 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b36330 msgr2=0x55d443bd0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b36330 0x55d443bd0b20 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa888006fd0 tx=0x7fa888060700 comp rx=0 tx=0).stop 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 shutdown_connections 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55d443b26c60 0x55d443b53760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d443b3a480 0x55d443b777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d443b36330 0x55d443bd0b20 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 --2- 172.21.15.37:0/1041701170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d443b35f50 0x55d443b3a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa878ff9640 0 client.8343 ms_handle_reset on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 >> 172.21.15.37:0/1041701170 conn(0x55d443b08bb0 msgr2=0x55d443b394f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 shutdown_connections 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.748+0000 7fa8a2e2d740 1 -- 172.21.15.37:0/1041701170 wait complete. 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a2e2d740 20 client.8343 trim_cache size 0 max 16384 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8046, 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:49:46.754 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:49:46.755 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.4877498859999996, 2024-05-10T08:49:46.755 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 104, 2024-05-10T08:49:46.755 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 118, 2024-05-10T08:49:46.755 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 118, 2024-05-10T08:49:46.755 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 26.120004764000001 2024-05-10T08:49:46.755 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa87c0762d0 msgr2=0x7fa87c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa87c0762d0 0x7fa87c078790 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa894000f60 tx=0x7fa894007c00 comp rx=0 tx=0).stop 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 msgr2=0x7fa8981591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa8981591b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fa88800d830 tx=0x7fa88800dcf0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 shutdown_connections 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa87c0762d0 0x7fa87c078790 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8980d20c0 0x7fa8980cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898071110 0x7fa8981591b0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 --2- 172.21.15.37:0/1155408371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa898070d30 0x7fa89814aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 >> 172.21.15.37:0/1155408371 conn(0x7fa8980d2e90 msgr2=0x7fa8981636e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 shutdown_connections 2024-05-10T08:49:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.749+0000 7fa8a0114640 1 -- 172.21.15.37:0/1155408371 wait complete. 2024-05-10T08:49:46.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:49:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.863+0000 7f9d48b5f640 1 Processor -- start 2024-05-10T08:49:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.864+0000 7f9d48b5f640 1 -- start start 2024-05-10T08:49:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d48b5f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440d1970 0x7f9d440d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d48b5f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d440d4cc0 0x7f9d440d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d48b5f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d441630b0 con 0x7f9d4415f420 2024-05-10T08:49:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d48b5f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9d440d2330 con 0x7f9d440d4cc0 2024-05-10T08:49:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d48b5f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9d440d3e70 con 0x7f9d440d1970 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d4259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d4415f420 0x7f9d440d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47804/0 (socket says 172.21.15.37:47804) 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d4259c640 1 -- 172.21.15.37:0/2544709230 learned_addr learned my addr 172.21.15.37:0/2544709230 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d42d9d640 1 --2- 172.21.15.37:0/2544709230 >> v2:172.21.15.82:3300/0 conn(0x7f9d440d4cc0 0x7f9d440d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d41d9b640 1 --2- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440d1970 0x7f9d440d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d4159a640 1 -- 172.21.15.37:0/2544709230 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454592958 0 0) 0x7f9d34001490 con 0x7f9d4415f420 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d4159a640 1 -- 172.21.15.37:0/2544709230 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d30003520 con 0x7f9d4415f420 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d4159a640 1 -- 172.21.15.37:0/2544709230 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1067916097 0 0) 0x7f9d30003520 con 0x7f9d4415f420 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d42d9d640 1 -- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440d1970 msgr2=0x7f9d440d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d42d9d640 1 --2- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440d1970 0x7f9d440d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d42d9d640 1 -- 172.21.15.37:0/2544709230 >> v1:172.21.15.37:6789/0 conn(0x7f9d4415f420 legacy=0x7f9d440d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d42d9d640 1 -- 172.21.15.37:0/2544709230 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d440d5670 con 0x7f9d440d4cc0 2024-05-10T08:49:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.865+0000 7f9d41d9b640 1 --2- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440d1970 0x7f9d440d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.866+0000 7f9d42d9d640 1 --2- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 0x7f9d440d5130 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0097a0 tx=0x7f9d3c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a098b2320f55ca60 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.866+0000 7f9d4159a640 1 -- 172.21.15.37:0/2544709230 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c037070 con 0x7f9d440d4cc0 2024-05-10T08:49:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.866+0000 7f9d4159a640 1 -- 172.21.15.37:0/2544709230 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3c02aba0 con 0x7f9d440d4cc0 2024-05-10T08:49:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.866+0000 7f9d4159a640 1 -- 172.21.15.37:0/2544709230 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34001be0 con 0x7f9d440d4cc0 2024-05-10T08:49:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 -- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 msgr2=0x7f9d440d5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 0x7f9d440d5130 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0097a0 tx=0x7f9d3c02a110 comp rx=0 tx=0).stop 2024-05-10T08:49:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 -- 172.21.15.37:0/2544709230 shutdown_connections 2024-05-10T08:49:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 0x7f9d440d5130 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/2544709230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440d1970 0x7f9d440d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 -- 172.21.15.37:0/2544709230 >> 172.21.15.37:0/2544709230 conn(0x7f9d4408eac0 msgr2=0x7f9d4409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 -- 172.21.15.37:0/2544709230 shutdown_connections 2024-05-10T08:49:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.867+0000 7f9d48b5f640 1 -- 172.21.15.37:0/2544709230 wait complete. 2024-05-10T08:49:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.868+0000 7f9d48b5f640 1 Processor -- start 2024-05-10T08:49:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.868+0000 7f9d48b5f640 1 -- start start 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d48b5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d440d1970 0x7f9d4415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d48b5f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 0x7f9d440ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d48b5f640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440c9510 0x7f9d440ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d48b5f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440d2f60 con 0x7f9d440d1970 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d48b5f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440d2c80 con 0x7f9d440d4cc0 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d48b5f640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9d440d3240 con 0x7f9d440c9510 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d4259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d440d1970 0x7f9d4415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d4259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d440d1970 0x7f9d4415e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59656/0 (socket says 172.21.15.37:59656) 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d4259c640 1 -- 172.21.15.37:0/724963981 learned_addr learned my addr 172.21.15.37:0/724963981 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d41d9b640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 0x7f9d440ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.869+0000 7f9d42d9d640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440c9510 0x7f9d440ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d4259c640 1 -- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440c9510 msgr2=0x7f9d440ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d4259c640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440c9510 0x7f9d440ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d4259c640 1 -- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 msgr2=0x7f9d440ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d4259c640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 0x7f9d440ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d4259c640 1 -- 172.21.15.37:0/724963981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d440c9a40 con 0x7f9d440d1970 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d42d9d640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440c9510 0x7f9d440ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d4259c640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d440d1970 0x7f9d4415e650 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400cac0 tx=0x7f9d3400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d3affd640 1 -- 172.21.15.37:0/724963981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34018070 con 0x7f9d440d1970 2024-05-10T08:49:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d3affd640 1 -- 172.21.15.37:0/724963981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3400a5e0 con 0x7f9d440d1970 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d440c9d20 con 0x7f9d440d1970 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d3affd640 1 -- 172.21.15.37:0/724963981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400a9d0 con 0x7f9d440d1970 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.870+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d440ca2e0 con 0x7f9d440d1970 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.871+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d440693f0 con 0x7f9d440d1970 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.871+0000 7f9d3affd640 1 -- 172.21.15.37:0/724963981 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9d3401b070 con 0x7f9d440d1970 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.872+0000 7f9d3affd640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d24076300 0x7f9d240787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.872+0000 7f9d3affd640 1 -- 172.21.15.37:0/724963981 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f9d34096f00 con 0x7f9d440d1970 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.872+0000 7f9d41d9b640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d24076300 0x7f9d240787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.873+0000 7f9d41d9b640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d24076300 0x7f9d240787c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009560 tx=0x7f9d2c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:46.876+0000 7f9d3affd640 1 -- 172.21.15.37:0/724963981 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9d441630b0 con 0x7f9d440d1970 2024-05-10T08:49:47.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.109+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9d440b4c50 con 0x7f9d440d1970 2024-05-10T08:49:47.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.109+0000 7f9d3affd640 1 -- 172.21.15.37:0/724963981 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) ==== 53+0+73 (secure 0 0 0) 0x7f9d34060670 con 0x7f9d440d1970 2024-05-10T08:49:47.108 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d24076300 msgr2=0x7f9d240787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d24076300 0x7f9d240787c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009560 tx=0x7f9d2c008040 comp rx=0 tx=0).stop 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d440d1970 msgr2=0x7f9d4415e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d440d1970 0x7f9d4415e650 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400cac0 tx=0x7f9d3400cf80 comp rx=0 tx=0).stop 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 shutdown_connections 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9d24076300 0x7f9d240787c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9d440c9510 0x7f9d440ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d440d4cc0 0x7f9d440ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 --2- 172.21.15.37:0/724963981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d440d1970 0x7f9d4415e650 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:47.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 >> 172.21.15.37:0/724963981 conn(0x7f9d4408eac0 msgr2=0x7f9d440d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:47.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 shutdown_connections 2024-05-10T08:49:47.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47.111+0000 7f9d48b5f640 1 -- 172.21.15.37:0/724963981 wait complete. 2024-05-10T08:49:47.120 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:49:47.121 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:47.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.121 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:47.138 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42175sec preferred_lft 42175sec 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:49:47.139 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:49:47.140 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:47.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.141 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:49:47.202 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:49:47.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.204 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:49:47.261 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:49:47.261 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:49:47.261 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:49:47.261 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:49:47.261 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:49:47.262 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:49:47.262 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:49:47.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:49:47.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:49:47.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:49:47.262 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:49:47.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:49:47.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:47.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.392 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:49:47.408 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:49:47.408 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:49:47.408 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:47.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:49:47.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:47.475 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:47.530 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:47.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:47.531 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:47.584 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:49:47.586+0000 7fe66c372640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:49:47.586 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:49:47.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:47.670 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:47.670 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:47.670 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:47.679 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:47.679 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:47.679 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:47.679 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:47.679 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:47.687 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:47.687 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:47.687 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:47.687 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:47.688 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:47.688 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:49:47.688 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:49:47.688 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:49:47.688 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:49:47.688 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:49:47.688 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:49:47.689 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:49:47.689 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:49:47.690 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:49:47.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:47.715 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:49:47.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:49:47.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:47.813 INFO:teuthology.orchestra.run.smithi037.stdout:client8352 2024-05-10T08:49:47.814 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:47.814 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:47.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:47.830 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T08:49:47.889 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2024-05-10T08:49:47.890 INFO:teuthology.orchestra.run.smithi037.stdout:./parent 2024-05-10T08:49:47.890 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed 2024-05-10T08:49:47.890 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/charlie 2024-05-10T08:49:47.890 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/alpha 2024-05-10T08:49:47.890 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed 2024-05-10T08:49:47.890 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed/jfile 2024-05-10T08:49:47.890 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:47.890 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:47.890 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:47.891 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:47.891 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T08:49:47.891 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:47.997 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:49:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:48.006 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:48.006 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:48.006 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:48.006 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:48.007 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-05-10T08:49:48.007 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:48.114 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2024-05-10T08:49:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:48.124 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:48.124 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:48.124 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:48.124 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:48.124 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-05-10T08:49:48.124 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:48.232 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2024-05-10T08:49:48.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:48.241 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:48.241 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:48.241 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:48.241 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:48.241 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-05-10T08:49:48.241 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:48.349 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2024-05-10T08:49:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:48.358 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:48.358 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:48.358 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:48.358 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:48.358 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-05-10T08:49:48.358 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:48.466 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2024-05-10T08:49:48.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:48.475 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:48.475 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:48.476 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:48.476 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:48.476 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-05-10T08:49:48.476 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:48.583 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627779 2024-05-10T08:49:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:48.592 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:48.592 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:48.592 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:48.592 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:48.592 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-05-10T08:49:48.592 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:48.700 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627780 2024-05-10T08:49:48.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:48.709 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:48.709 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:48.766 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:48.767 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:48.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:49:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.969+0000 7f5df0cc8640 1 Processor -- start 2024-05-10T08:49:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.969+0000 7f5df0cc8640 1 -- start start 2024-05-10T08:49:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5df0cc8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec1629b0 0x7f5dec06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5df0cc8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5dec0b2490 0x7f5dec070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5df0cc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dec070d20 0x7f5dec0711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5df0cc8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5dec06dec0 con 0x7f5dec070d20 2024-05-10T08:49:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5df0cc8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5dec06e110 con 0x7f5dec0b2490 2024-05-10T08:49:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5df0cc8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec06e3f0 con 0x7f5dec1629b0 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5dead9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dec070d20 0x7f5dec0711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5dead9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dec070d20 0x7f5dec0711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48400/0 (socket says 172.21.15.37:48400) 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5dead9d640 1 -- 172.21.15.37:0/1563827579 learned_addr learned my addr 172.21.15.37:0/1563827579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5de9d9b640 1 --2- 172.21.15.37:0/1563827579 >> v2:172.21.15.82:3300/0 conn(0x7f5dec0b2490 0x7f5dec070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.970+0000 7f5dea59c640 1 --2- 172.21.15.37:0/1563827579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec1629b0 0x7f5dec06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.971+0000 7f5dead9d640 1 -- 172.21.15.37:0/1563827579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec1629b0 msgr2=0x7f5dec06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.971+0000 7f5dead9d640 1 --2- 172.21.15.37:0/1563827579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec1629b0 0x7f5dec06eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.971+0000 7f5dead9d640 1 -- 172.21.15.37:0/1563827579 >> v2:172.21.15.82:3300/0 conn(0x7f5dec0b2490 msgr2=0x7f5dec070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.971+0000 7f5dead9d640 1 --2- 172.21.15.37:0/1563827579 >> v2:172.21.15.82:3300/0 conn(0x7f5dec0b2490 0x7f5dec070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.971+0000 7f5dead9d640 1 -- 172.21.15.37:0/1563827579 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec06e6d0 con 0x7f5dec070d20 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.971+0000 7f5dead9d640 1 --2- 172.21.15.37:0/1563827579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0711a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f5dec06aa60 tx=0x7f5de402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e9e39c3d16efe5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.971+0000 7f5de959a640 1 -- 172.21.15.37:0/1563827579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4036070 con 0x7f5dec070d20 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5de959a640 1 -- 172.21.15.37:0/1563827579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de4031600 con 0x7f5dec070d20 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5de959a640 1 -- 172.21.15.37:0/1563827579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40319d0 con 0x7f5dec070d20 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 -- 172.21.15.37:0/1563827579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 msgr2=0x7f5dec0711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/1563827579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0711a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f5dec06aa60 tx=0x7f5de402a6a0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 -- 172.21.15.37:0/1563827579 shutdown_connections 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/1563827579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0711a0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/1563827579 >> v2:172.21.15.82:3300/0 conn(0x7f5dec0b2490 0x7f5dec070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/1563827579 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec1629b0 0x7f5dec06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 -- 172.21.15.37:0/1563827579 >> 172.21.15.37:0/1563827579 conn(0x7f5dec0b49d0 msgr2=0x7f5dec0b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 -- 172.21.15.37:0/1563827579 shutdown_connections 2024-05-10T08:49:48.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.972+0000 7f5df0cc8640 1 -- 172.21.15.37:0/1563827579 wait complete. 2024-05-10T08:49:48.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.973+0000 7f5df0cc8640 1 Processor -- start 2024-05-10T08:49:48.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5df0cc8640 1 -- start start 2024-05-10T08:49:48.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5df0cc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:48.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5df0cc8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec0b2490 0x7f5dec1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:48.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5df0cc8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dec1629b0 0x7f5dec1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5df0cc8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec070870 con 0x7f5dec070d20 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5df0cc8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec06f410 con 0x7f5dec1629b0 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5df0cc8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec0709f0 con 0x7f5dec0b2490 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5dea59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5dea59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48404/0 (socket says 172.21.15.37:48404) 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.974+0000 7f5dea59c640 1 -- 172.21.15.37:0/2430351400 learned_addr learned my addr 172.21.15.37:0/2430351400 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5de9d9b640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec0b2490 0x7f5dec1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5dead9d640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dec1629b0 0x7f5dec1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5dea59c640 1 -- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec0b2490 msgr2=0x7f5dec1f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5dea59c640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec0b2490 0x7f5dec1f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5dea59c640 1 -- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dec1629b0 msgr2=0x7f5dec1f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5dea59c640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dec1629b0 0x7f5dec1f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5dea59c640 1 -- 172.21.15.37:0/2430351400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec1f64a0 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5dea59c640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0c9030 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00e9b0 tx=0x7f5ddc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5ddaffd640 1 -- 172.21.15.37:0/2430351400 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc017070 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5ddaffd640 1 -- 172.21.15.37:0/2430351400 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00c9a0 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec1f5a00 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5ddaffd640 1 -- 172.21.15.37:0/2430351400 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00cd90 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.975+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec0c6d20 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.976+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec0693f0 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.977+0000 7f5ddaffd640 1 -- 172.21.15.37:0/2430351400 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5ddc01a070 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.977+0000 7f5ddaffd640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5dcc0762d0 0x7f5dcc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.977+0000 7f5ddaffd640 1 -- 172.21.15.37:0/2430351400 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f5ddc097830 con 0x7f5dec070d20 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.978+0000 7f5de9d9b640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5dcc0762d0 0x7f5dcc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.978+0000 7f5de9d9b640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5dcc0762d0 0x7f5dcc078790 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5dec1f5e30 tx=0x7f5de0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:48.982+0000 7f5ddaffd640 1 -- 172.21.15.37:0/2430351400 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5ddc060fa0 con 0x7f5dec070d20 2024-05-10T08:49:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.185+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5dec161e50 con 0x7f5dec070d20 2024-05-10T08:49:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.186+0000 7f5ddaffd640 1 -- 172.21.15.37:0/2430351400 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v118) ==== 80+0+122 (secure 0 0 0) 0x7f5ddc0608a0 con 0x7f5dec070d20 2024-05-10T08:49:49.185 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.82:6837/2344331780 2024-05-11T08:49:41.251599+0000 2024-05-10T08:49:49.185 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.82:6835/2344331780 2024-05-11T08:49:41.251599+0000 2024-05-10T08:49:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:listed 2 entries 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5dcc0762d0 msgr2=0x7f5dcc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5dcc0762d0 0x7f5dcc078790 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5dec1f5e30 tx=0x7f5de0008040 comp rx=0 tx=0).stop 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 msgr2=0x7f5dec0c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0c9030 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00e9b0 tx=0x7f5ddc00ee70 comp rx=0 tx=0).stop 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 shutdown_connections 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f5dcc0762d0 0x7f5dcc078790 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dec1629b0 0x7f5dec1f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5dec0b2490 0x7f5dec1f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 --2- 172.21.15.37:0/2430351400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec070d20 0x7f5dec0c9030 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 >> 172.21.15.37:0/2430351400 conn(0x7f5dec0b49d0 msgr2=0x7f5dec071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 shutdown_connections 2024-05-10T08:49:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.188+0000 7f5df0cc8640 1 -- 172.21.15.37:0/2430351400 wait complete. 2024-05-10T08:49:49.197 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:49:49.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:49.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:49.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:49:49.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:49.227 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:49:49.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.429+0000 7fc374093640 1 Processor -- start 2024-05-10T08:49:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc374093640 1 -- start start 2024-05-10T08:49:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc374093640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc36c15f420 0x7fc36c0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc374093640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc36c0d3ca0 0x7fc36c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc374093640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36c1630b0 con 0x7fc36c0d1eb0 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc374093640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc36c0d2550 con 0x7fc36c15f420 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc374093640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc36c0d2c80 con 0x7fc36c0d3ca0 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc371e2f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc36c15f420 0x7fc36c0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.430+0000 7fc371e2f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc36c15f420 0x7fc36c0d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48412/0 (socket says 172.21.15.37:48412) 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.431+0000 7fc371e2f640 1 -- 172.21.15.37:0/812399011 learned_addr learned my addr 172.21.15.37:0/812399011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.431+0000 7fc37162e640 1 --2- 172.21.15.37:0/812399011 >> v2:172.21.15.82:3300/0 conn(0x7fc36c0d3ca0 0x7fc36c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.431+0000 7fc371e2f640 1 -- 172.21.15.37:0/812399011 >> v2:172.21.15.82:3300/0 conn(0x7fc36c0d3ca0 msgr2=0x7fc36c0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.431+0000 7fc371e2f640 1 --2- 172.21.15.37:0/812399011 >> v2:172.21.15.82:3300/0 conn(0x7fc36c0d3ca0 0x7fc36c0d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.431+0000 7fc371e2f640 1 -- 172.21.15.37:0/812399011 >> v1:172.21.15.82:6789/0 conn(0x7fc36c0d1eb0 legacy=0x7fc36c0d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.431+0000 7fc371e2f640 1 -- 172.21.15.37:0/812399011 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c0d2f60 con 0x7fc36c15f420 2024-05-10T08:49:49.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.431+0000 7fc37162e640 1 --2- 172.21.15.37:0/812399011 >> v2:172.21.15.82:3300/0 conn(0x7fc36c0d3ca0 0x7fc36c0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:49.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc371e2f640 1 --2- 172.21.15.37:0/812399011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c15f420 0x7fc36c0d3760 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fc36c08f380 tx=0x7fc36402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0e0d9c8d090df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc370e2d640 1 -- 172.21.15.37:0/812399011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364037070 con 0x7fc36c15f420 2024-05-10T08:49:49.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc370e2d640 1 -- 172.21.15.37:0/812399011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc364032440 con 0x7fc36c15f420 2024-05-10T08:49:49.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc370e2d640 1 -- 172.21.15.37:0/812399011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364032810 con 0x7fc36c15f420 2024-05-10T08:49:49.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 -- 172.21.15.37:0/812399011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c15f420 msgr2=0x7fc36c0d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 --2- 172.21.15.37:0/812399011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c15f420 0x7fc36c0d3760 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fc36c08f380 tx=0x7fc36402a230 comp rx=0 tx=0).stop 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 -- 172.21.15.37:0/812399011 shutdown_connections 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 --2- 172.21.15.37:0/812399011 >> v2:172.21.15.82:3300/0 conn(0x7fc36c0d3ca0 0x7fc36c0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 --2- 172.21.15.37:0/812399011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c15f420 0x7fc36c0d3760 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 -- 172.21.15.37:0/812399011 >> 172.21.15.37:0/812399011 conn(0x7fc36c08eac0 msgr2=0x7fc36c09e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 -- 172.21.15.37:0/812399011 shutdown_connections 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.432+0000 7fc374093640 1 -- 172.21.15.37:0/812399011 wait complete. 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 Processor -- start 2024-05-10T08:49:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 -- start start 2024-05-10T08:49:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0d1eb0 0x7fc36c157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c0c8b00 0x7fc36c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c0caf80 0x7fc36c0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c0d53d0 con 0x7fc36c0caf80 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c0d2830 con 0x7fc36c0d1eb0 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc374093640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c0d5550 con 0x7fc36c0c8b00 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc372630640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c0caf80 0x7fc36c0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc372630640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c0caf80 0x7fc36c0cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48418/0 (socket says 172.21.15.37:48418) 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.434+0000 7fc372630640 1 -- 172.21.15.37:0/1459332676 learned_addr learned my addr 172.21.15.37:0/1459332676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc371e2f640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0d1eb0 0x7fc36c157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc37162e640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c0c8b00 0x7fc36c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc372630640 1 -- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c0c8b00 msgr2=0x7fc36c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc372630640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c0c8b00 0x7fc36c0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc372630640 1 -- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0d1eb0 msgr2=0x7fc36c157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc372630640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0d1eb0 0x7fc36c157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc372630640 1 -- 172.21.15.37:0/1459332676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c0ca5f0 con 0x7fc36c0caf80 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc372630640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c0caf80 0x7fc36c0cb400 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00b9d0 tx=0x7fc35c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc36a7fc640 1 -- 172.21.15.37:0/1459332676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c019070 con 0x7fc36c0caf80 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc36a7fc640 1 -- 172.21.15.37:0/1459332676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c00cb70 con 0x7fc36c0caf80 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c158180 con 0x7fc36c0caf80 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc36a7fc640 1 -- 172.21.15.37:0/1459332676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c014440 con 0x7fc36c0caf80 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.435+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c0c9830 con 0x7fc36c0caf80 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.436+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36c0693f0 con 0x7fc36c0caf80 2024-05-10T08:49:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.437+0000 7fc36a7fc640 1 -- 172.21.15.37:0/1459332676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc35c01c070 con 0x7fc36c0caf80 2024-05-10T08:49:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.438+0000 7fc36a7fc640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.438+0000 7fc36a7fc640 1 -- 172.21.15.37:0/1459332676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7fc35c0974b0 con 0x7fc36c0caf80 2024-05-10T08:49:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.438+0000 7fc371e2f640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.439+0000 7fc371e2f640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc364034000 tx=0x7fc36402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.442+0000 7fc36a7fc640 1 -- 172.21.15.37:0/1459332676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc35c060c30 con 0x7fc36c0caf80 2024-05-10T08:49:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.674+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc36c0b4c50 con 0x7fc36c0caf80 2024-05-10T08:49:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.675+0000 7fc36a7fc640 1 -- 172.21.15.37:0/1459332676 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5186 (secure 0 0 0) 0x7fc35c060530 con 0x7fc36c0caf80 2024-05-10T08:49:49.674 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:49.674 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":104,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:45.271166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8046":{"gid":8046,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":9,"addr":"172.21.15.37:6835/202078248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":202078248},{"type":"v1","addr":"172.21.15.37:6835","nonce":202078248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8046,"qdb_cluster":[8046]},"id":8}]} 2024-05-10T08:49:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 104 2024-05-10T08:49:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 msgr2=0x7fc358078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc364034000 tx=0x7fc36402e000 comp rx=0 tx=0).stop 2024-05-10T08:49:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c0caf80 msgr2=0x7fc36c0cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c0caf80 0x7fc36c0cb400 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00b9d0 tx=0x7fc35c00be90 comp rx=0 tx=0).stop 2024-05-10T08:49:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 shutdown_connections 2024-05-10T08:49:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc3580762d0 0x7fc358078790 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc36c0caf80 0x7fc36c0cb400 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc36c0c8b00 0x7fc36c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 --2- 172.21.15.37:0/1459332676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc36c0d1eb0 0x7fc36c157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 >> 172.21.15.37:0/1459332676 conn(0x7fc36c08eac0 msgr2=0x7fc36c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 shutdown_connections 2024-05-10T08:49:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.677+0000 7fc374093640 1 -- 172.21.15.37:0/1459332676 wait complete. 2024-05-10T08:49:49.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parent mytag123 2024-05-10T08:49:49.813 INFO:teuthology.orchestra.run.smithi037.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-05-10T08:49:49.814 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-05-10T08:49:49.814 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-05-10T08:49:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 Processor -- start 2024-05-10T08:49:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 -- start start 2024-05-10T08:49:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 0x563fc6e9c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e7aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e7af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563fc6d6bf50 con 0x563fc6e7dd60 2024-05-10T08:49:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563fc6d6ff90 con 0x7f4c640022a0 2024-05-10T08:49:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.861+0000 7f4c7f120f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563fc6e7c180 con 0x563fc6e7b590 2024-05-10T08:49:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e7aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e7aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48432/0 (socket says 172.21.15.37:48432) 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 -- 172.21.15.37:0/840999296 learned_addr learned my addr 172.21.15.37:0/840999296 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7c2ff640 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 0x563fc6e9c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7cb00640 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e7af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 -- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 msgr2=0x563fc6e7af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e7af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 -- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 msgr2=0x563fc6e9c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 0x563fc6e9c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 -- 172.21.15.37:0/840999296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc6e9cbe0 con 0x563fc6e7dd60 2024-05-10T08:49:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7cb00640 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e7af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7bafe640 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e7aa30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000d6f0 tx=0x7f4c7000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8266f8bc6346116 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7aafc640 1 -- 172.21.15.37:0/840999296 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70013070 con 0x563fc6e7dd60 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7aafc640 1 -- 172.21.15.37:0/840999296 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7000b8d0 con 0x563fc6e7dd60 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.862+0000 7f4c7aafc640 1 -- 172.21.15.37:0/840999296 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000bcc0 con 0x563fc6e7dd60 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 -- 172.21.15.37:0/840999296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 msgr2=0x563fc6e7aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e7aa30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000d6f0 tx=0x7f4c7000dbb0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 -- 172.21.15.37:0/840999296 shutdown_connections 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e7af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e7aa30 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/840999296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 0x563fc6e9c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 -- 172.21.15.37:0/840999296 >> 172.21.15.37:0/840999296 conn(0x563fc6dc37e0 msgr2=0x563fc6e7ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 -- 172.21.15.37:0/840999296 shutdown_connections 2024-05-10T08:49:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 -- 172.21.15.37:0/840999296 wait complete. 2024-05-10T08:49:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 Processor -- start 2024-05-10T08:49:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.863+0000 7f4c7f120f40 1 -- start start 2024-05-10T08:49:49.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:49:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7f120f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e924c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7f120f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e76c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7f120f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 0x563fc6e77160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7f120f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563fc6e7e190 con 0x563fc6e7dd60 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7f120f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563fc6dc6500 con 0x7f4c640022a0 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7f120f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x563fc6e7e310 con 0x563fc6e7b590 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7bafe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e76c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7bafe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e76c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48442/0 (socket says 172.21.15.37:48442) 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7bafe640 1 -- 172.21.15.37:0/1893543583 learned_addr learned my addr 172.21.15.37:0/1893543583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7c2ff640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.864+0000 7f4c7cb00640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 0x563fc6e77160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7bafe640 1 -- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 msgr2=0x563fc6e924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7bafe640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x563fc6e7b590 0x563fc6e924c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7bafe640 1 -- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 msgr2=0x563fc6e77160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7bafe640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c640022a0 0x563fc6e77160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7bafe640 1 -- 172.21.15.37:0/1893543583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc6e96840 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7bafe640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e76c20 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000dbf0 tx=0x7f4c70001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c79afa640 1 -- 172.21.15.37:0/1893543583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70028070 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c79afa640 1 -- 172.21.15.37:0/1893543583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70018cb0 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fc6e96b20 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c79afa640 1 -- 172.21.15.37:0/1893543583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70013050 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.865+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc6e970e0 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.866+0000 7f4c79afa640 1 -- 172.21.15.37:0/1893543583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c7002b070 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.867+0000 7f4c79afa640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4c68074cb0 0x7f4c68077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.867+0000 7f4c79afa640 1 -- 172.21.15.37:0/1893543583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f4c700983d0 con 0x563fc6e7dd60 2024-05-10T08:49:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.867+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x563fc6e92dd0 0x563fc6e79db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.867+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x563fc6e7a2f0 con 0x563fc6e92dd0 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.867+0000 7f4c7c2ff640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4c68074cb0 0x7f4c68077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.867+0000 7f4c7cb00640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x563fc6e92dd0 0x563fc6e79db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7cb00640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x563fc6e92dd0 0x563fc6e79db0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7c2ff640 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4c68074cb0 0x7f4c68077170 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c058000 tx=0x7f4c6c053000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7cb00640 1 -- 172.21.15.37:0/1893543583 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f4c7400e040 con 0x563fc6e92dd0 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x563fc6e92dd0 msgr2=0x563fc6e79db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x563fc6e92dd0 0x563fc6e79db0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4c68074cb0 msgr2=0x7f4c68077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f4c68074cb0 0x7f4c68077170 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c058000 tx=0x7f4c6c053000 comp rx=0 tx=0).stop 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 msgr2=0x563fc6e76c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 --2- 172.21.15.37:0/1893543583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563fc6e7dd60 0x563fc6e76c20 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000dbf0 tx=0x7f4c70001a40 comp rx=0 tx=0).stop 2024-05-10T08:49:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7cb00640 1 -- 172.21.15.37:0/1893543583 reap_dead start 2024-05-10T08:49:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 shutdown_connections 2024-05-10T08:49:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 >> 172.21.15.37:0/1893543583 conn(0x563fc6dc37e0 msgr2=0x563fc6dc5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 shutdown_connections 2024-05-10T08:49:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.868+0000 7f4c7f120f40 1 -- 172.21.15.37:0/1893543583 wait complete. 2024-05-10T08:49:49.873 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-05-10T08:49:49.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 Processor -- start 2024-05-10T08:49:49.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 -- start start 2024-05-10T08:49:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 0x55a2282bc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a228199f50 con 0x55a2282c66d0 2024-05-10T08:49:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a22819df90 con 0x55a2282c0700 2024-05-10T08:49:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b7701f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55a2281f3ae0 con 0x7f68a40030f0 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.920+0000 7f68b49fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48448/0 (socket says 172.21.15.37:48448) 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 -- 172.21.15.37:0/609001530 learned_addr learned my addr 172.21.15.37:0/609001530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b51fb640 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 0x55a2282bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b59fc640 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 -- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 msgr2=0x55a2282bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 0x55a2282bc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 -- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 msgr2=0x55a2282c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 -- 172.21.15.37:0/609001530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22821fc20 con 0x55a2282c66d0 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b59fc640 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68b49fa640 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282c7ec0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009760 tx=0x7f68a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9cf9ddd93e190 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68af7fe640 1 -- 172.21.15.37:0/609001530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0068070 con 0x55a2282c66d0 2024-05-10T08:49:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68af7fe640 1 -- 172.21.15.37:0/609001530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a004fb40 con 0x55a2282c66d0 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.921+0000 7f68af7fe640 1 -- 172.21.15.37:0/609001530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0063470 con 0x55a2282c66d0 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 -- 172.21.15.37:0/609001530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 msgr2=0x55a2282c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282c7ec0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009760 tx=0x7f68a0051000 comp rx=0 tx=0).stop 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 -- 172.21.15.37:0/609001530 shutdown_connections 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282c7ec0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 --2- 172.21.15.37:0/609001530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 0x55a2282bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 -- 172.21.15.37:0/609001530 >> 172.21.15.37:0/609001530 conn(0x55a2281f1b30 msgr2=0x55a228238150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 -- 172.21.15.37:0/609001530 shutdown_connections 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 -- 172.21.15.37:0/609001530 wait complete. 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 Processor -- start 2024-05-10T08:49:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.922+0000 7f68b7701f40 1 -- start start 2024-05-10T08:49:49.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b7701f40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282bba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b7701f40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b7701f40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 0x55a2282cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b7701f40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2282c6ff0 con 0x55a2282c66d0 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b7701f40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a2282c6da0 con 0x55a2282c0700 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b7701f40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55a228238a70 con 0x7f68a40030f0 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48452/0 (socket says 172.21.15.37:48452) 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 -- 172.21.15.37:0/1678704188 learned_addr learned my addr 172.21.15.37:0/1678704188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b51fb640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b59fc640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 0x55a2282cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 -- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 msgr2=0x55a2282cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f68a40030f0 0x55a2282cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 -- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 msgr2=0x55a2282bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2282c0700 0x55a2282bba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.923+0000 7f68b49fa640 1 -- 172.21.15.37:0/1678704188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22835af00 con 0x55a2282c66d0 2024-05-10T08:49:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.924+0000 7f68b49fa640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282b7db0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f68a0025e30 tx=0x7f68a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.924+0000 7f68ae7fc640 1 -- 172.21.15.37:0/1678704188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0071070 con 0x55a2282c66d0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.924+0000 7f68ae7fc640 1 -- 172.21.15.37:0/1678704188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a0063690 con 0x55a2282c66d0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.924+0000 7f68ae7fc640 1 -- 172.21.15.37:0/1678704188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0068040 con 0x55a2282c66d0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.924+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2282cbce0 con 0x55a2282c66d0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.924+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2282cbf80 con 0x55a2282c66d0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.925+0000 7f68ae7fc640 1 -- 172.21.15.37:0/1678704188 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f68a0074070 con 0x55a2282c66d0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.926+0000 7f68ae7fc640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6898074cb0 0x7f6898077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.926+0000 7f68ae7fc640 1 -- 172.21.15.37:0/1678704188 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f68a00db090 con 0x55a2282c66d0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.926+0000 7f68b51fb640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6898074cb0 0x7f6898077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.926+0000 7f68b7701f40 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55a2282beac0 0x55a228359ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.926+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:1 18.12 18:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x55a228359480 con 0x55a2282beac0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.926+0000 7f68b59fc640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55a2282beac0 0x55a228359ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b51fb640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6898074cb0 0x7f6898077170 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55a228363dc0 tx=0x7f68a80068f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b59fc640 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55a2282beac0 0x55a228359ff0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b59fc640 1 -- 172.21.15.37:0/1678704188 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f68b0009040 con 0x55a2282beac0 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55a2282beac0 msgr2=0x55a228359ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x55a2282beac0 0x55a228359ff0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6898074cb0 msgr2=0x7f6898077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6898074cb0 0x7f6898077170 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55a228363dc0 tx=0x7f68a80068f0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 msgr2=0x55a2282b7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 --2- 172.21.15.37:0/1678704188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2282c66d0 0x55a2282b7db0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f68a0025e30 tx=0x7f68a0002fb0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b59fc640 1 -- 172.21.15.37:0/1678704188 reap_dead start 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 shutdown_connections 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 >> 172.21.15.37:0/1678704188 conn(0x55a2281f1b30 msgr2=0x55a228238150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 shutdown_connections 2024-05-10T08:49:49.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.927+0000 7f68b7701f40 1 -- 172.21.15.37:0/1678704188 wait complete. 2024-05-10T08:49:49.931 INFO:teuthology.orchestra.run.smithi037.stdout:mytag123 2024-05-10T08:49:49.932 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-05-10T08:49:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.978+0000 7fa54f0edf40 1 Processor -- start 2024-05-10T08:49:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.978+0000 7fa54f0edf40 1 -- start start 2024-05-10T08:49:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54f0edf40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d4e1f50 0x55b46d4f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54f0edf40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587560 0x55b46d4f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54f0edf40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d587940 0x55b46d589eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54f0edf40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b46d4b4ff0 con 0x55b46d587940 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54f0edf40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b46d459f50 con 0x55b46d4e1f50 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54f0edf40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b46d4b5de0 con 0x55b46d587560 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d587940 0x55b46d589eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d587940 0x55b46d589eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48466/0 (socket says 172.21.15.37:48466) 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 -- 172.21.15.37:0/1206811252 learned_addr learned my addr 172.21.15.37:0/1206811252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54cbe7640 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d4e1f50 0x55b46d4f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa547fff640 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587560 0x55b46d4f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 -- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587560 msgr2=0x55b46d4f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587560 0x55b46d4f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 -- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d4e1f50 msgr2=0x55b46d4f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d4e1f50 0x55b46d4f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 -- 172.21.15.37:0/1206811252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46d4f2e50 con 0x55b46d587940 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa54d3e8640 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d587940 0x55b46d589eb0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa5480015d0 tx=0x7fa548001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae8ca8426ee1e1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa546ffd640 1 -- 172.21.15.37:0/1206811252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548013620 con 0x55b46d587940 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa546ffd640 1 -- 172.21.15.37:0/1206811252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5480137c0 con 0x55b46d587940 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.979+0000 7fa546ffd640 1 -- 172.21.15.37:0/1206811252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548013bb0 con 0x55b46d587940 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 -- 172.21.15.37:0/1206811252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d587940 msgr2=0x55b46d589eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d587940 0x55b46d589eb0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa5480015d0 tx=0x7fa548001a90 comp rx=0 tx=0).stop 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 -- 172.21.15.37:0/1206811252 shutdown_connections 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d587940 0x55b46d589eb0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587560 0x55b46d4f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/1206811252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d4e1f50 0x55b46d4f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 -- 172.21.15.37:0/1206811252 >> 172.21.15.37:0/1206811252 conn(0x55b46d4dfb40 msgr2=0x55b46d4df1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 -- 172.21.15.37:0/1206811252 shutdown_connections 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 -- 172.21.15.37:0/1206811252 wait complete. 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.980+0000 7fa54f0edf40 1 Processor -- start 2024-05-10T08:49:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54f0edf40 1 -- start start 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54f0edf40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d4e1f50 0x55b46d57b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54f0edf40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d587560 0x55b46d617df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54f0edf40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587940 0x55b46d589eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54f0edf40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b46d4f3740 con 0x55b46d4e1f50 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54f0edf40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b46d4f9f10 con 0x55b46d587560 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54f0edf40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55b46d4f4df0 con 0x55b46d587940 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54cbe7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d4e1f50 0x55b46d57b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54cbe7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d4e1f50 0x55b46d57b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48476/0 (socket says 172.21.15.37:48476) 2024-05-10T08:49:49.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54cbe7640 1 -- 172.21.15.37:0/301605748 learned_addr learned my addr 172.21.15.37:0/301605748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa54d3e8640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587940 0x55b46d589eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.981+0000 7fa547fff640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d587560 0x55b46d617df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54cbe7640 1 -- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587940 msgr2=0x55b46d589eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54cbe7640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55b46d587940 0x55b46d589eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54cbe7640 1 -- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d587560 msgr2=0x55b46d617df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54cbe7640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d587560 0x55b46d617df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54cbe7640 1 -- 172.21.15.37:0/301605748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46d583c60 con 0x55b46d4e1f50 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa547fff640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46d587560 0x55b46d617df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54cbe7640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d4e1f50 0x55b46d57b050 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa540009f70 tx=0x7fa5400084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa545ffb640 1 -- 172.21.15.37:0/301605748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540015660 con 0x55b46d4e1f50 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa545ffb640 1 -- 172.21.15.37:0/301605748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54001a070 con 0x55b46d4e1f50 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa545ffb640 1 -- 172.21.15.37:0/301605748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540015a20 con 0x55b46d4e1f50 2024-05-10T08:49:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b46d618790 con 0x55b46d4e1f50 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.982+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46d618d50 con 0x55b46d4e1f50 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.984+0000 7fa545ffb640 1 -- 172.21.15.37:0/301605748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa540013030 con 0x55b46d4e1f50 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.984+0000 7fa545ffb640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa530074cb0 0x7fa530077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.984+0000 7fa545ffb640 1 -- 172.21.15.37:0/301605748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7fa5400963a0 con 0x55b46d4e1f50 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.984+0000 7fa547fff640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa530074cb0 0x7fa530077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.984+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55b46d584140 0x55b46d584520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.984+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:1 18.19 18:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x55b46d618330 con 0x55b46d584140 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54d3e8640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55b46d584140 0x55b46d584520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa547fff640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa530074cb0 0x7fa530077170 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa538057000 tx=0x7fa538052000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54d3e8640 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55b46d584140 0x55b46d584520 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54d3e8640 1 -- 172.21.15.37:0/301605748 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fa54801b040 con 0x55b46d584140 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55b46d584140 msgr2=0x55b46d584520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x55b46d584140 0x55b46d584520 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa530074cb0 msgr2=0x7fa530077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa530074cb0 0x7fa530077170 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa538057000 tx=0x7fa538052000 comp rx=0 tx=0).stop 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d4e1f50 msgr2=0x55b46d57b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 --2- 172.21.15.37:0/301605748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b46d4e1f50 0x55b46d57b050 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa540009f70 tx=0x7fa5400084c0 comp rx=0 tx=0).stop 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54d3e8640 1 -- 172.21.15.37:0/301605748 reap_dead start 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 shutdown_connections 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.985+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 >> 172.21.15.37:0/301605748 conn(0x55b46d4dfb40 msgr2=0x55b46d57f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.986+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 shutdown_connections 2024-05-10T08:49:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:49.986+0000 7fa54f0edf40 1 -- 172.21.15.37:0/301605748 wait complete. 2024-05-10T08:49:49.989 INFO:teuthology.orchestra.run.smithi037.stdout:mytag123 2024-05-10T08:49:49.989 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-05-10T08:49:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.035+0000 7fb2fe11df40 1 Processor -- start 2024-05-10T08:49:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.035+0000 7fb2fe11df40 1 -- start start 2024-05-10T08:49:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fe11df40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25cc1e130 0x55c25cc4d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fe11df40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cc4deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fe11df40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25ccf66d0 0x55c25cc652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fe11df40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c25cc20800 con 0x55c25cc1e130 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fe11df40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c25cbc6f50 con 0x55c25cc66990 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fe11df40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c25cc20ae0 con 0x55c25ccf66d0 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25cc1e130 0x55c25cc4d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25cc1e130 0x55c25cc4d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48492/0 (socket says 172.21.15.37:48492) 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 -- 172.21.15.37:0/2402660839 learned_addr learned my addr 172.21.15.37:0/2402660839 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2f29d1640 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cc4deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb9d3640 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25ccf66d0 0x55c25cc652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 -- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25ccf66d0 msgr2=0x55c25cc652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25ccf66d0 0x55c25cc652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 -- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 msgr2=0x55c25cc4deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cc4deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 -- 172.21.15.37:0/2402660839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c25cc642f0 con 0x55c25cc1e130 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2f29d1640 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cc4deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb9d3640 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25ccf66d0 0x55c25cc652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.036+0000 7fb2fb1d2640 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25cc1e130 0x55c25cc4d970 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c00 tx=0x7fb2ec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39d61d774935ad1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fa1d0640 1 -- 172.21.15.37:0/2402660839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec056230 con 0x55c25cc1e130 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fa1d0640 1 -- 172.21.15.37:0/2402660839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ec056930 con 0x55c25cc1e130 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fa1d0640 1 -- 172.21.15.37:0/2402660839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec056d20 con 0x55c25cc1e130 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 -- 172.21.15.37:0/2402660839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25cc1e130 msgr2=0x55c25cc4d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25cc1e130 0x55c25cc4d970 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c00 tx=0x7fb2ec051000 comp rx=0 tx=0).stop 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 -- 172.21.15.37:0/2402660839 shutdown_connections 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25ccf66d0 0x55c25cc652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cc4deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/2402660839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25cc1e130 0x55c25cc4d970 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 -- 172.21.15.37:0/2402660839 >> 172.21.15.37:0/2402660839 conn(0x55c25cc1eb30 msgr2=0x55c25ccf55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 -- 172.21.15.37:0/2402660839 shutdown_connections 2024-05-10T08:49:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.037+0000 7fb2fe11df40 1 -- 172.21.15.37:0/2402660839 wait complete. 2024-05-10T08:49:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 Processor -- start 2024-05-10T08:49:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 -- start start 2024-05-10T08:49:50.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25cc1e130 0x55c25cce15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cce4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25ccf66d0 0x55c25ccf6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c25ccf3420 con 0x55c25ccf66d0 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c25cced660 con 0x55c25cc66990 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.038+0000 7fb2fe11df40 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c25cc4e3f0 con 0x55c25cc1e130 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25ccf66d0 0x55c25ccf6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25ccf66d0 0x55c25ccf6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48498/0 (socket says 172.21.15.37:48498) 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 -- 172.21.15.37:0/142432535 learned_addr learned my addr 172.21.15.37:0/142432535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb1d2640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25cc1e130 0x55c25cce15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2f29d1640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cce4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 -- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25cc1e130 msgr2=0x55c25cce15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c25cc1e130 0x55c25cce15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 -- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 msgr2=0x55c25cce4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c25cc66990 0x55c25cce4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 -- 172.21.15.37:0/142432535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c25cc63810 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fb9d3640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25ccf66d0 0x55c25ccf6ab0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400a260 tx=0x7fb2f400a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2f91ce640 1 -- 172.21.15.37:0/142432535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4015020 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2f91ce640 1 -- 172.21.15.37:0/142432535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4011870 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c25ccf9510 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2f91ce640 1 -- 172.21.15.37:0/142432535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4011ca0 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.039+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c25cced0e0 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.041+0000 7fb2f91ce640 1 -- 172.21.15.37:0/142432535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2f4018020 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.041+0000 7fb2f91ce640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2dc074cb0 0x7fb2dc077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.041+0000 7fb2f91ce640 1 -- 172.21.15.37:0/142432535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7fb2f4096880 con 0x55c25ccf66d0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.041+0000 7fb2fb1d2640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2dc074cb0 0x7fb2dc077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55c25ccf3af0 0x55c25ccf3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 18.5 18:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) -- 0x55c25ccdff70 con 0x55c25ccf3af0 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2f29d1640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55c25ccf3af0 0x55c25ccf3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fb1d2640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2dc074cb0 0x7fb2dc077170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec045a00 tx=0x7fb2ec053000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2f29d1640 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55c25ccf3af0 0x55c25ccf3ed0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2f29d1640 1 -- 172.21.15.37:0/142432535 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fb2e400f880 con 0x55c25ccf3af0 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55c25ccf3af0 msgr2=0x55c25ccf3ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x55c25ccf3af0 0x55c25ccf3ed0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2dc074cb0 msgr2=0x7fb2dc077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb2dc074cb0 0x7fb2dc077170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec045a00 tx=0x7fb2ec053000 comp rx=0 tx=0).stop 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25ccf66d0 msgr2=0x55c25ccf6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fe11df40 1 --2- 172.21.15.37:0/142432535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c25ccf66d0 0x55c25ccf6ab0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400a260 tx=0x7fb2f400a720 comp rx=0 tx=0).stop 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.042+0000 7fb2fb9d3640 1 -- 172.21.15.37:0/142432535 reap_dead start 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.043+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 shutdown_connections 2024-05-10T08:49:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.043+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 >> 172.21.15.37:0/142432535 conn(0x55c25cc1eb30 msgr2=0x55c25cc4d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.043+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 shutdown_connections 2024-05-10T08:49:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.043+0000 7fb2fe11df40 1 -- 172.21.15.37:0/142432535 wait complete. 2024-05-10T08:49:50.046 INFO:teuthology.orchestra.run.smithi037.stdout:mytag123 2024-05-10T08:49:50.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-05-10T08:49:50.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.154+0000 7f239650a640 1 Processor -- start 2024-05-10T08:49:50.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.154+0000 7f239650a640 1 -- start start 2024-05-10T08:49:50.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f239650a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2390072840 0x7f239015c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f239650a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f239006e4d0 0x7f23900aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f239650a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239015c920 con 0x7f239006e0f0 2024-05-10T08:49:50.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f239650a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f239015cc00 con 0x7f239006e4d0 2024-05-10T08:49:50.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f239650a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f239015cee0 con 0x7f2390072840 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2394aa7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f239006e4d0 0x7f23900aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2394aa7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f239006e4d0 0x7f23900aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48502/0 (socket says 172.21.15.37:48502) 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2394aa7640 1 -- 172.21.15.37:0/1149271158 learned_addr learned my addr 172.21.15.37:0/1149271158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2394aa7640 1 -- 172.21.15.37:0/1149271158 >> v2:172.21.15.82:3300/0 conn(0x7f2390072840 msgr2=0x7f239015c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2387fff640 1 --2- 172.21.15.37:0/1149271158 >> v2:172.21.15.82:3300/0 conn(0x7f2390072840 0x7f239015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2394aa7640 1 --2- 172.21.15.37:0/1149271158 >> v2:172.21.15.82:3300/0 conn(0x7f2390072840 0x7f239015c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2394aa7640 1 -- 172.21.15.37:0/1149271158 >> v1:172.21.15.82:6789/0 conn(0x7f239006e0f0 legacy=0x7f23900d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.155+0000 7f2394aa7640 1 -- 172.21.15.37:0/1149271158 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239015d1c0 con 0x7f239006e4d0 2024-05-10T08:49:50.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.156+0000 7f2394aa7640 1 --2- 172.21.15.37:0/1149271158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f23900aec30 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f23900727d0 tx=0x7f238802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1e7d5c66f75127 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.156+0000 7f238f7fe640 1 -- 172.21.15.37:0/1149271158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388036070 con 0x7f239006e4d0 2024-05-10T08:49:50.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.156+0000 7f238f7fe640 1 -- 172.21.15.37:0/1149271158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388031600 con 0x7f239006e4d0 2024-05-10T08:49:50.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.156+0000 7f238f7fe640 1 -- 172.21.15.37:0/1149271158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880319d0 con 0x7f239006e4d0 2024-05-10T08:49:50.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 -- 172.21.15.37:0/1149271158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 msgr2=0x7f23900aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 --2- 172.21.15.37:0/1149271158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f23900aec30 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f23900727d0 tx=0x7f238802a6f0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 -- 172.21.15.37:0/1149271158 shutdown_connections 2024-05-10T08:49:50.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 --2- 172.21.15.37:0/1149271158 >> v2:172.21.15.82:3300/0 conn(0x7f2390072840 0x7f239015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 --2- 172.21.15.37:0/1149271158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f23900aec30 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 -- 172.21.15.37:0/1149271158 >> 172.21.15.37:0/1149271158 conn(0x7f239006c3a0 msgr2=0x7f239006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 -- 172.21.15.37:0/1149271158 shutdown_connections 2024-05-10T08:49:50.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.157+0000 7f239650a640 1 -- 172.21.15.37:0/1149271158 wait complete. 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.158+0000 7f239650a640 1 Processor -- start 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.158+0000 7f239650a640 1 -- start start 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f239650a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f239006e0f0 0x7f2390159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f239650a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f239015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f239650a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2390072840 0x7f2390156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f239650a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f23900ae7d0 con 0x7f239006e4d0 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f239650a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f23900ae650 con 0x7f2390072840 2024-05-10T08:49:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f239650a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f23901530b0 con 0x7f239006e0f0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f2387fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f239015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f2387fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f239015ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48516/0 (socket says 172.21.15.37:48516) 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f2387fff640 1 -- 172.21.15.37:0/110755247 learned_addr learned my addr 172.21.15.37:0/110755247 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f2394aa7640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2390072840 0x7f2390156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.159+0000 7f238ffff640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f239006e0f0 0x7f2390159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f2387fff640 1 -- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f239006e0f0 msgr2=0x7f2390159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f2387fff640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f239006e0f0 0x7f2390159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f2387fff640 1 -- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2390072840 msgr2=0x7f2390156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f2387fff640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2390072840 0x7f2390156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f2387fff640 1 -- 172.21.15.37:0/110755247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2390159610 con 0x7f239006e4d0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f2387fff640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f239015ece0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f237800c7f0 tx=0x7f237800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f238d7fa640 1 -- 172.21.15.37:0/110755247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378015070 con 0x7f239006e4d0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f238d7fa640 1 -- 172.21.15.37:0/110755247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2378007820 con 0x7f239006e4d0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23901598f0 con 0x7f239006e4d0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f238d7fa640 1 -- 172.21.15.37:0/110755247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378007bd0 con 0x7f239006e4d0 2024-05-10T08:49:50.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.160+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239009cce0 con 0x7f239006e4d0 2024-05-10T08:49:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.162+0000 7f238d7fa640 1 -- 172.21.15.37:0/110755247 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2378018070 con 0x7f239006e4d0 2024-05-10T08:49:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.162+0000 7f238d7fa640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23700762d0 0x7f2370078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.162+0000 7f238d7fa640 1 -- 172.21.15.37:0/110755247 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f23780973f0 con 0x7f239006e4d0 2024-05-10T08:49:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.162+0000 7f238ffff640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23700762d0 0x7f2370078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.163+0000 7f2399229740 1 Processor -- start 2024-05-10T08:49:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.163+0000 7f2399229740 1 -- start start 2024-05-10T08:49:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.163+0000 7f238ffff640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23700762d0 0x7f2370078790 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2380004ea0 tx=0x7f2380009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467c69af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2399229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c99600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c99b40 0x55c467c6e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2399229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c467c36690 con 0x55c467c9a280 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c467bd3f30 con 0x55c467c99b40 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c467b8cb20 con 0x55c467cb7160 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c99600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c99600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48530/0 (socket says 172.21.15.37:48530) 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 -- 172.21.15.37:0/1495861773 learned_addr learned my addr 172.21.15.37:0/1495861773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f238ffff640 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467c69af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2394aa7640 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c99b40 0x55c467c6e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 -- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 msgr2=0x55c467c69af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467c69af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 -- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c99b40 msgr2=0x55c467c6e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c99b40 0x55c467c6e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 -- 172.21.15.37:0/1495861773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c467b84e60 con 0x55c467c9a280 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2387fff640 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c99600 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f2378095740 tx=0x7f23780600c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486a13b2b6bf59f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2385ffb640 1 -- 172.21.15.37:0/1495861773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237801f040 con 0x55c467c9a280 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2385ffb640 1 -- 172.21.15.37:0/1495861773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23780648b0 con 0x55c467c9a280 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.164+0000 7f2385ffb640 1 -- 172.21.15.37:0/1495861773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23780692d0 con 0x55c467c9a280 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 -- 172.21.15.37:0/1495861773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 msgr2=0x55c467c99600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c99600 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f2378095740 tx=0x7f23780600c0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 -- 172.21.15.37:0/1495861773 shutdown_connections 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c99b40 0x55c467c6e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c99600 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 --2- 172.21.15.37:0/1495861773 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467c69af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 -- 172.21.15.37:0/1495861773 >> 172.21.15.37:0/1495861773 conn(0x55c467c6bd60 msgr2=0x55c467cb4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 -- 172.21.15.37:0/1495861773 shutdown_connections 2024-05-10T08:49:50.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 -- 172.21.15.37:0/1495861773 wait complete. 2024-05-10T08:49:50.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.165+0000 7f2399229740 1 -- start start 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.166+0000 7f2399229740 1 Processor -- start 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.166+0000 7f2399229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c9a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.166+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb7160 0x55c467cb3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.166+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467cb4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.166+0000 7f2399229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c467b905e0 con 0x55c467c9a280 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.166+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c467bcfef0 con 0x55c467cb7160 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.166+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c467c6df10 con 0x55c467cb0c70 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f2399229740 10 client.0 _ll_register_callbacks cb 0x55c467b8b320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c9a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c9a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48536/0 (socket says 172.21.15.37:48536) 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 -- 172.21.15.37:0/3034967184 learned_addr learned my addr 172.21.15.37:0/3034967184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f2387fff640 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb7160 0x55c467cb3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f2394aa7640 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467cb4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 -- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 msgr2=0x55c467cb4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467cb4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 -- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb7160 msgr2=0x55c467cb3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb7160 0x55c467cb3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 -- 172.21.15.37:0/3034967184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4679af7d0 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f238ffff640 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c9a770 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f238000eed0 tx=0x7f2380003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669ec97c6b02a4ff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f236effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f236effd640 1 -- 172.21.15.37:0/3034967184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380025020 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f236effd640 1 -- 172.21.15.37:0/3034967184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f2380010040 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23780648b0 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f236effd640 1 -- 172.21.15.37:0/3034967184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f238002f050 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.167+0000 7f2399229740 10 client.8412 fetch_fsmap learned FSMap version 104 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55c4678e53f0 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f236effd640 1 -- 172.21.15.37:0/3034967184 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23780648b0 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f236effd640 1 -- 172.21.15.37:0/3034967184 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 104) ==== 3494+0+0 (secure 0 0 0) 0x7f2380032020 con 0x55c467c9a280 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2399229740 10 client.8412 fetch_fsmap finished waiting for FSMap version 104 2024-05-10T08:49:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2399229740 10 client.8412 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2399229740 20 client.8412 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2399229740 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb1050 0x55c467c9b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2399229740 4 client.8412 mds_command: new command op to 8046 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 --> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c467be1b40 con 0x55c467cb1050 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2387fff640 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb1050 0x55c467c9b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f236effd640 10 client.8412 ms_handle_connect on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.168+0000 7f2387fff640 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb1050 0x55c467c9b580 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48903e40c98e512c server_cookie=8f0bd152658a179f in_seq=0 out_seq=0 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f236effd640 1 -- 172.21.15.37:0/3034967184 <== mds.0 v2:172.21.15.37:6833/202078248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c467be1b40 con 0x55c467cb1050 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f236effd640 10 client.8412 handle_command_reply: tid=0 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 client.8412 shutdown 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 msgr2=0x55c467c9a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c9a770 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f238000eed0 tx=0x7f2380003760 comp rx=0 tx=0).stop 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 shutdown_connections 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb1050 0x55c467c9b580 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467cb4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb7160 0x55c467cb3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f236effd640 0 client.8412 ms_handle_reset on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:50.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 --2- 172.21.15.37:0/3034967184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c9a770 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 >> 172.21.15.37:0/3034967184 conn(0x55c467c99b40 msgr2=0x55c467c69230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 shutdown_connections 2024-05-10T08:49:50.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 1 -- 172.21.15.37:0/3034967184 wait complete. 2024-05-10T08:49:50.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.169+0000 7f2399229740 20 client.8412 trim_cache size 0 max 16384 2024-05-10T08:49:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.184+0000 7f2399229740 1 Processor -- start 2024-05-10T08:49:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.184+0000 7f2399229740 1 -- start start 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2399229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c65270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb0c70 0x55c467cc6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467cd7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2399229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2390201fa0 con 0x55c467c9a280 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2390200fa0 con 0x55c467cb0c70 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f239009df10 con 0x55c467cb7160 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c65270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c65270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48540/0 (socket says 172.21.15.37:48540) 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 -- 172.21.15.37:0/776571906 learned_addr learned my addr 172.21.15.37:0/776571906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2387fff640 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb0c70 0x55c467cc6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2394aa7640 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467cd7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 -- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 msgr2=0x55c467cd7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467cd7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 -- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb0c70 msgr2=0x55c467cc6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb0c70 0x55c467cc6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 -- 172.21.15.37:0/776571906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c467c6cea0 con 0x55c467c9a280 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f2394aa7640 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467cd7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.185+0000 7f238ffff640 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c65270 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f238000e920 tx=0x7f2380021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9715cc1f53c38620 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f23857fa640 1 -- 172.21.15.37:0/776571906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380025030 con 0x55c467c9a280 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f23857fa640 1 -- 172.21.15.37:0/776571906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2380015c90 con 0x55c467c9a280 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f23857fa640 1 -- 172.21.15.37:0/776571906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238002a650 con 0x55c467c9a280 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 -- 172.21.15.37:0/776571906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 msgr2=0x55c467c65270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c65270 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f238000e920 tx=0x7f2380021000 comp rx=0 tx=0).stop 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 -- 172.21.15.37:0/776571906 shutdown_connections 2024-05-10T08:49:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb7160 0x55c467cd7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467cb0c70 0x55c467cc6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 --2- 172.21.15.37:0/776571906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467c9a280 0x55c467c65270 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 -- 172.21.15.37:0/776571906 >> 172.21.15.37:0/776571906 conn(0x55c467c99b40 msgr2=0x55c467c9d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 -- 172.21.15.37:0/776571906 shutdown_connections 2024-05-10T08:49:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.186+0000 7f2399229740 1 -- 172.21.15.37:0/776571906 wait complete. 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.187+0000 7f2399229740 1 -- start start 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.187+0000 7f2399229740 1 Processor -- start 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c9a280 0x55c467c694e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2399229740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467c6f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2399229740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467cb7160 0x55c467c6f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2399229740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2390200950 con 0x55c467cb7160 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c467c657b0 con 0x55c467c9a280 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2399229740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55c467d32b20 con 0x55c467cb0c70 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2399229740 10 client.0 _ll_register_callbacks cb 0x7f2380005500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467cb7160 0x55c467c6f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467cb7160 0x55c467c6f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48542/0 (socket says 172.21.15.37:48542) 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f238ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c9a280 0x55c467c694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 -- 172.21.15.37:0/2043338868 learned_addr learned my addr 172.21.15.37:0/2043338868 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2387fff640 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467c6f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 -- 172.21.15.37:0/2043338868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 msgr2=0x55c467c6f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467c6f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 -- 172.21.15.37:0/2043338868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c9a280 msgr2=0x55c467c694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c9a280 0x55c467c694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 -- 172.21.15.37:0/2043338868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4678a50f0 con 0x55c467cb7160 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f2394aa7640 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467cb7160 0x55c467c6f850 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f238802a730 tx=0x7f2388004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fbab992f919a9f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.188+0000 7f236effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f236effd640 1 -- 172.21.15.37:0/2043338868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388036040 con 0x55c467cb7160 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f236effd640 1 -- 172.21.15.37:0/2043338868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f2388047c80 con 0x55c467cb7160 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2380015c90 con 0x55c467cb7160 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f236effd640 1 -- 172.21.15.37:0/2043338868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f2388047e80 con 0x55c467cb7160 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 10 client.8418 fetch_fsmap learned FSMap version 104 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55c467d32860 con 0x55c467cb7160 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f236effd640 1 -- 172.21.15.37:0/2043338868 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2380015c90 con 0x55c467cb7160 2024-05-10T08:49:50.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f236effd640 1 -- 172.21.15.37:0/2043338868 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 104) ==== 3494+0+0 (secure 0 0 0) 0x7f2388045070 con 0x55c467cb7160 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 10 client.8418 fetch_fsmap finished waiting for FSMap version 104 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 10 client.8418 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 20 client.8418 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb3470 0x55c467d31cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 4 client.8418 mds_command: new command op to 8046 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 --> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c467bdb9b0 con 0x55c467cb3470 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.189+0000 7f238ffff640 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb3470 0x55c467d31cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.190+0000 7f238ffff640 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb3470 0x55c467d31cc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efadc3a5b35c0653 server_cookie=23a5af6816ab2b1 in_seq=0 out_seq=0 2024-05-10T08:49:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.190+0000 7f236effd640 10 client.8418 ms_handle_connect on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f236effd640 1 -- 172.21.15.37:0/2043338868 <== mds.0 v2:172.21.15.37:6833/202078248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c467bdb9b0 con 0x55c467cb3470 2024-05-10T08:49:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f236effd640 10 client.8418 handle_command_reply: tid=0 2024-05-10T08:49:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 client.8418 shutdown 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467cb7160 msgr2=0x55c467c6f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467cb7160 0x55c467c6f850 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f238802a730 tx=0x7f2388004ab0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 shutdown_connections 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:6833/202078248,v1:172.21.15.37:6835/202078248] conn(0x55c467cb3470 0x55c467d31cc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c467cb7160 0x55c467c6f850 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55c467cb0c70 0x55c467c6f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 --2- 172.21.15.37:0/2043338868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c467c9a280 0x55c467c694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f236effd640 0 client.8418 ms_handle_reset on v2:172.21.15.37:6833/202078248 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 >> 172.21.15.37:0/2043338868 conn(0x55c467c99b40 msgr2=0x55c467cb7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 shutdown_connections 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 1 -- 172.21.15.37:0/2043338868 wait complete. 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.199+0000 7f2399229740 20 client.8418 trim_cache size 0 max 16384 2024-05-10T08:49:50.199 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:50.200 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2024-05-10T08:49:50.200 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0 2024-05-10T08:49:50.200 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:50.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23700762d0 msgr2=0x7f2370078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23700762d0 0x7f2370078790 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2380004ea0 tx=0x7f2380009040 comp rx=0 tx=0).stop 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 msgr2=0x7f239015ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f239015ece0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f237800c7f0 tx=0x7f237800ccb0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 shutdown_connections 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f23700762d0 0x7f2370078790 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2390072840 0x7f2390156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f239006e4d0 0x7f239015ece0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 --2- 172.21.15.37:0/110755247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f239006e0f0 0x7f2390159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 >> 172.21.15.37:0/110755247 conn(0x7f239006c3a0 msgr2=0x7f23900aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 shutdown_connections 2024-05-10T08:49:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.200+0000 7f239650a640 1 -- 172.21.15.37:0/110755247 wait complete. 2024-05-10T08:49:50.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:49:50.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.316+0000 7f0dbf978640 1 Processor -- start 2024-05-10T08:49:50.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.316+0000 7f0dbf978640 1 -- start start 2024-05-10T08:49:50.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbf978640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0db81629a0 0x7f0db80d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbf978640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db80d2dc0 0x7f0db80d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbf978640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0db80c8ed0 0x7f0db80c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbf978640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0db80d3330 con 0x7f0db81629a0 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbf978640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0db80d2170 con 0x7f0db80c8ed0 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbf978640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0db80d2450 con 0x7f0db80d2dc0 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbd714640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0db81629a0 0x7f0db80d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbd714640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0db81629a0 0x7f0db80d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48550/0 (socket says 172.21.15.37:48550) 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.317+0000 7f0dbd714640 1 -- 172.21.15.37:0/2255305347 learned_addr learned my addr 172.21.15.37:0/2255305347 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbdf15640 1 --2- 172.21.15.37:0/2255305347 >> v2:172.21.15.82:3300/0 conn(0x7f0db80c8ed0 0x7f0db80c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbcf13640 1 --2- 172.21.15.37:0/2255305347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db80d2dc0 0x7f0db80d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbd714640 1 -- 172.21.15.37:0/2255305347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db80d2dc0 msgr2=0x7f0db80d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbd714640 1 --2- 172.21.15.37:0/2255305347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db80d2dc0 0x7f0db80d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbd714640 1 -- 172.21.15.37:0/2255305347 >> v2:172.21.15.82:3300/0 conn(0x7f0db80c8ed0 msgr2=0x7f0db80c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbd714640 1 --2- 172.21.15.37:0/2255305347 >> v2:172.21.15.82:3300/0 conn(0x7f0db80c8ed0 0x7f0db80c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbd714640 1 -- 172.21.15.37:0/2255305347 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db80d2730 con 0x7f0db81629a0 2024-05-10T08:49:50.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbdf15640 1 --2- 172.21.15.37:0/2255305347 >> v2:172.21.15.82:3300/0 conn(0x7f0db80c8ed0 0x7f0db80c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:50.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.318+0000 7f0dbd714640 1 --2- 172.21.15.37:0/2255305347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db81629a0 0x7f0db80d35c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0db808e4c0 tx=0x7f0db002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153d7ae619a98fec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0db7fff640 1 -- 172.21.15.37:0/2255305347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0037070 con 0x7f0db81629a0 2024-05-10T08:49:50.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0db7fff640 1 -- 172.21.15.37:0/2255305347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db002ae00 con 0x7f0db81629a0 2024-05-10T08:49:50.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0db7fff640 1 -- 172.21.15.37:0/2255305347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0032660 con 0x7f0db81629a0 2024-05-10T08:49:50.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 -- 172.21.15.37:0/2255305347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db81629a0 msgr2=0x7f0db80d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 --2- 172.21.15.37:0/2255305347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db81629a0 0x7f0db80d35c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0db808e4c0 tx=0x7f0db002a0b0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 -- 172.21.15.37:0/2255305347 shutdown_connections 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 --2- 172.21.15.37:0/2255305347 >> v2:172.21.15.82:3300/0 conn(0x7f0db80c8ed0 0x7f0db80c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 --2- 172.21.15.37:0/2255305347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db80d2dc0 0x7f0db80d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 --2- 172.21.15.37:0/2255305347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db81629a0 0x7f0db80d35c0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 -- 172.21.15.37:0/2255305347 >> 172.21.15.37:0/2255305347 conn(0x7f0db80d4fe0 msgr2=0x7f0db80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 -- 172.21.15.37:0/2255305347 shutdown_connections 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.319+0000 7f0dbf978640 1 -- 172.21.15.37:0/2255305347 wait complete. 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 Processor -- start 2024-05-10T08:49:50.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 -- start start 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db80c8ed0 0x7f0db815fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0db80d2dc0 0x7f0db809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db81629a0 0x7f0db80a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0db80cf440 con 0x7f0db80c8ed0 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0db80cf2c0 con 0x7f0db80d2dc0 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbf978640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0db80c98a0 con 0x7f0db81629a0 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbd714640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db80c8ed0 0x7f0db815fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.321+0000 7f0dbd714640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db80c8ed0 0x7f0db815fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48566/0 (socket says 172.21.15.37:48566) 2024-05-10T08:49:50.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbd714640 1 -- 172.21.15.37:0/3891375654 learned_addr learned my addr 172.21.15.37:0/3891375654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbcf13640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0db80d2dc0 0x7f0db809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbdf15640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db81629a0 0x7f0db80a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbd714640 1 -- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db81629a0 msgr2=0x7f0db80a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbd714640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db81629a0 0x7f0db80a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbd714640 1 -- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0db80d2dc0 msgr2=0x7f0db809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbd714640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0db80d2dc0 0x7f0db809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbd714640 1 -- 172.21.15.37:0/3891375654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db80cc2c0 con 0x7f0db80c8ed0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbdf15640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db81629a0 0x7f0db80a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbcf13640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0db80d2dc0 0x7f0db809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbd714640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db80c8ed0 0x7f0db815fc40 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f0db0000c00 tx=0x7f0db00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0db5ffb640 1 -- 172.21.15.37:0/3891375654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0042070 con 0x7f0db80c8ed0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0db5ffb640 1 -- 172.21.15.37:0/3891375654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db003e670 con 0x7f0db80c8ed0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0db5ffb640 1 -- 172.21.15.37:0/3891375654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0037040 con 0x7f0db80c8ed0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db80cc5a0 con 0x7f0db80c8ed0 2024-05-10T08:49:50.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.322+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db80ccb60 con 0x7f0db80c8ed0 2024-05-10T08:49:50.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.323+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db80693f0 con 0x7f0db80c8ed0 2024-05-10T08:49:50.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.324+0000 7f0db5ffb640 1 -- 172.21.15.37:0/3891375654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0db003a040 con 0x7f0db80c8ed0 2024-05-10T08:49:50.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.325+0000 7f0db5ffb640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0da40762d0 0x7f0da4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.325+0000 7f0db5ffb640 1 -- 172.21.15.37:0/3891375654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6187+0+0 (secure 0 0 0) 0x7f0db00b7a80 con 0x7f0db80c8ed0 2024-05-10T08:49:50.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.325+0000 7f0dbcf13640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0da40762d0 0x7f0da4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.326+0000 7f0dbcf13640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0da40762d0 0x7f0da4078790 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0db8069c90 tx=0x7f0dac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.329+0000 7f0db5ffb640 1 -- 172.21.15.37:0/3891375654 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0db00b9e20 con 0x7f0db80c8ed0 2024-05-10T08:49:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.558+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0db80d1680 con 0x7f0db80c8ed0 2024-05-10T08:49:50.558 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:49:50.559+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:49:50.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.560+0000 7f0db5ffb640 1 -- 172.21.15.37:0/3891375654 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) ==== 161+0+0 (secure 0 0 0) 0x7f0db00811f0 con 0x7f0db80c8ed0 2024-05-10T08:49:50.559 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0da40762d0 msgr2=0x7f0da4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0da40762d0 0x7f0da4078790 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0db8069c90 tx=0x7f0dac008040 comp rx=0 tx=0).stop 2024-05-10T08:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db80c8ed0 msgr2=0x7f0db815fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db80c8ed0 0x7f0db815fc40 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f0db0000c00 tx=0x7f0db00046c0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 shutdown_connections 2024-05-10T08:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0da40762d0 0x7f0da4078790 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0db81629a0 0x7f0db80a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0db80d2dc0 0x7f0db809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 --2- 172.21.15.37:0/3891375654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db80c8ed0 0x7f0db815fc40 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 >> 172.21.15.37:0/3891375654 conn(0x7f0db80d4fe0 msgr2=0x7f0db80d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 shutdown_connections 2024-05-10T08:49:50.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.563+0000 7f0dbf978640 1 -- 172.21.15.37:0/3891375654 wait complete. 2024-05-10T08:49:50.564 INFO:tasks.ceph.mds.c.smithi037.stderr: -1647> 2024-05-10T08:49:47.586+0000 7fe66c372640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:49:50.573 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-05-10T08:49:50.591 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:49:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.618+0000 7fbc91d30280 1 -- start start 2024-05-10T08:49:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.618+0000 7fbc91d30280 1 Processor -- start 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109cb20c00 0x56109d8fc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109cb21800 0x56109d8fc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109cb21c00 0x56109d8fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc91d30280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56109d8be600 con 0x56109cb21800 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56109d8be480 con 0x56109cb20c00 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56109d8be300 con 0x56109cb21c00 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc8fcdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109cb21800 0x56109d8fc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc8fcdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109cb21800 0x56109d8fc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48578/0 (socket says 172.21.15.37:48578) 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/599806474 learned_addr learned my addr 172.21.15.37:0/599806474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc904de640 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109cb20c00 0x56109d8fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.619+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109cb21c00 0x56109d8fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109cb21c00 msgr2=0x56109d8fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109cb21c00 0x56109d8fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109cb20c00 msgr2=0x56109d8fc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109cb20c00 0x56109d8fc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/599806474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109cb56780 con 0x56109cb21800 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc904de640 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109cb20c00 0x56109d8fc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109cb21c00 0x56109d8fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109cb21800 0x56109d8fc580 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x56109d94f8c0 tx=0x56109d8c2b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b00a5a3a305a18 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8dcd9640 1 -- 172.21.15.37:0/599806474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109cb46680 con 0x56109cb21800 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8dcd9640 1 -- 172.21.15.37:0/599806474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56109cb4c700 con 0x56109cb21800 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8dcd9640 1 -- 172.21.15.37:0/599806474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109cb469c0 con 0x56109cb21800 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc91d30280 1 -- 172.21.15.37:0/599806474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109cb57680 con 0x56109cb21800 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc91d30280 1 -- 172.21.15.37:0/599806474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56109cb56000 con 0x56109cb21800 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc91d30280 4 waiting for MDS map... 2024-05-10T08:49:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8dcd9640 1 -- 172.21.15.37:0/599806474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x56109da04600 con 0x56109cb21800 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc8dcd9640 1 -- 172.21.15.37:0/599806474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 105) ==== 2885+0+0 (secure 0 0 0) 0x56109cb7b180 con 0x56109cb21800 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc91d30280 4 Got MDS map 105 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc91d30280 10 main: JournalTool::main 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.620+0000 7fbc91d30280 4 main: JournalTool: connecting to RADOS... 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 Processor -- start 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 -- start start 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56109d8be180 con 0x56109da07400 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56109cb82480 con 0x56109da07c00 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.621+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56109cb82900 con 0x56109da07800 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48594/0 (socket says 172.21.15.37:48594) 2024-05-10T08:49:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 -- 172.21.15.37:0/2736913136 learned_addr learned my addr 172.21.15.37:0/2736913136 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc904de640 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 -- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07800 msgr2=0x56109d8fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 -- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07c00 msgr2=0x56109d8fdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 -- 172.21.15.37:0/2736913136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109cb563c0 con 0x56109da07400 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07400 0x56109d8fd080 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x56109da1e5a0 tx=0x56109d8c08a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7bb7ca56d32039 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc8bcd5640 1 -- 172.21.15.37:0/2736913136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109cb46680 con 0x56109da07400 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc8bcd5640 1 -- 172.21.15.37:0/2736913136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56109cb4ce00 con 0x56109da07400 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.622+0000 7fbc8bcd5640 1 -- 172.21.15.37:0/2736913136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109cb469c0 con 0x56109da07400 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 -- 172.21.15.37:0/2736913136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07400 msgr2=0x56109d8fd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07400 0x56109d8fd080 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x56109da1e5a0 tx=0x56109d8c08a0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 -- 172.21.15.37:0/2736913136 shutdown_connections 2024-05-10T08:49:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 --2- 172.21.15.37:0/2736913136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 -- 172.21.15.37:0/2736913136 >> 172.21.15.37:0/2736913136 conn(0x56109da07000 msgr2=0x56109cc18800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 -- 172.21.15.37:0/2736913136 shutdown_connections 2024-05-10T08:49:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 -- 172.21.15.37:0/2736913136 wait complete. 2024-05-10T08:49:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 Processor -- start 2024-05-10T08:49:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.623+0000 7fbc91d30280 1 -- start start 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc91d30280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56109d8bf200 con 0x56109da07800 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56109d8be180 con 0x56109da07400 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56109d8bf380 con 0x56109da07c00 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48608/0 (socket says 172.21.15.37:48608) 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 -- 172.21.15.37:0/3608379903 learned_addr learned my addr 172.21.15.37:0/3608379903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 -- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07c00 msgr2=0x56109d8fdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 -- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07400 msgr2=0x56109d8fd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 -- 172.21.15.37:0/3608379903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109cb56780 con 0x56109da07800 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc904de640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07800 0x56109d8fd600 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x56109da1f920 tx=0x56109da258c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc8a4d2640 1 -- 172.21.15.37:0/3608379903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109cb46680 con 0x56109da07800 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc8a4d2640 1 -- 172.21.15.37:0/3608379903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56109cb4c1c0 con 0x56109da07800 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56109cb57680 con 0x56109da07800 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.624+0000 7fbc8a4d2640 1 -- 172.21.15.37:0/3608379903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109cb469c0 con 0x56109da07800 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.625+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109cb56960 con 0x56109da07800 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.625+0000 7fbc91d30280 4 main: JournalTool: resolving pool 17 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.626+0000 7fbc8a4d2640 1 -- 172.21.15.37:0/3608379903 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x56109da74c00 con 0x56109da07800 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.626+0000 7fbc8a4d2640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56109d934c00 0x56109d8fe100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.626+0000 7fbc8a4d2640 1 -- 172.21.15.37:0/3608379903 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x56109da72c00 con 0x56109da07800 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.626+0000 7fbc91d30280 4 main: JournalTool: creating IoCtx.. 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.626+0000 7fbc91d30280 4 main: Executing for rank 0 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.626+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56109d934c00 0x56109d8fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56109d934c00 0x56109d8fe100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56109da1e5a0 tx=0x56109d8c1f20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 -- start start 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 Processor -- start 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109d935400 0x56109d8fe680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109d935800 0x56109d8fec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109d935c00 0x56109d8ff180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56109d8bf680 con 0x56109d935800 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56109d8bf800 con 0x56109d935c00 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.627+0000 7fbc91d30280 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56109cb82900 con 0x56109d935400 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109d935800 0x56109d8fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109d935800 0x56109d8fec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48610/0 (socket says 172.21.15.37:48610) 2024-05-10T08:49:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 -- 172.21.15.37:0/273221704 learned_addr learned my addr 172.21.15.37:0/273221704 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109d935c00 0x56109d8ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109d935400 0x56109d8fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109d935400 msgr2=0x56109d8fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109d935400 0x56109d8fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109d935c00 msgr2=0x56109d8ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109d935c00 0x56109d8ff180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109cb57860 con 0x56109d935800 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc904de640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109d935800 0x56109d8fec00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x56109da9f980 tx=0x56109ce46240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c740154ce36fec21 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc874cc640 1 -- 172.21.15.37:0/273221704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109ce45860 con 0x56109d935800 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc874cc640 1 -- 172.21.15.37:0/273221704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56109cb4c8c0 con 0x56109d935800 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc874cc640 1 -- 172.21.15.37:0/273221704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56109ce45a00 con 0x56109d935800 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109cb574a0 con 0x56109d935800 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56109cb56780 con 0x56109d935800 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc91d30280 4 waiting for MDS map... 2024-05-10T08:49:50.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc874cc640 1 -- 172.21.15.37:0/273221704 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x56109cf1c600 con 0x56109d935800 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc874cc640 1 -- 172.21.15.37:0/273221704 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 105) ==== 2885+0+0 (secure 0 0 0) 0x56109cb7b500 con 0x56109d935800 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.628+0000 7fbc91d30280 4 Got MDS map 105 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.629+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56109cf34400 0x56109d8ff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.629+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:1 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf34800 con 0x56109cf34400 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.629+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56109cf34400 0x56109d8ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.629+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56109cf34400 0x56109d8ff700 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=c8c60198dc10de03 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.632+0000 7fbc90cdf640 1 -- 172.21.15.37:0/273221704 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v119'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e000 con 0x56109cf34400 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.632+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56109cf34c00 0x56109cf44000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.632+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:2 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf35000 con 0x56109cf34c00 2024-05-10T08:49:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.632+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56109cf34c00 0x56109cf44000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.633+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56109cf34c00 0x56109cf44000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=fba446f14dcdea91 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/273221704 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v119'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e500 con 0x56109cf34c00 2024-05-10T08:49:50.636 INFO:teuthology.orchestra.run.smithi037.stdout:writing EResetJournal entry 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:3 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf35400 con 0x56109cf34c00 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56109cf35800 0x56109cf44580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:4 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf35c00 con 0x56109cf35800 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56109cf4c000 0x56109cf44b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:5 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf4c400 con 0x56109cf4c000 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56109cf4c800 0x56109cf45080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:6 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf4cc00 con 0x56109cf4c800 2024-05-10T08:49:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:7 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf4d000 con 0x56109cf4c000 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.636+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:8 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109cf4d400 con 0x56109cf34400 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.637+0000 7fbc904de640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56109cf4c000 0x56109cf44b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.637+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56109cf35800 0x56109cf44580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.637+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56109cf4c800 0x56109cf45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.637+0000 7fbc904de640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56109cf4c000 0x56109cf44b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=87d1252ac87bd4a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.637+0000 7fbc8fcdd640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56109cf4c800 0x56109cf45080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=6a369460a1b88b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.638+0000 7fbc90cdf640 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56109cf35800 0x56109cf44580 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=c8384be72f2083a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.638+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/273221704 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== osd_op_reply(3 200.00000001 [delete] v119'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e500 con 0x56109cf34c00 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.638+0000 7fbc90cdf640 1 -- 172.21.15.37:0/273221704 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== osd_op_reply(8 200.00000006 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e000 con 0x56109cf34400 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.638+0000 7fbc904de640 1 -- 172.21.15.37:0/273221704 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(5 200.00000003 [delete] v119'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e780 con 0x56109cf4c000 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.639+0000 7fbc904de640 1 -- 172.21.15.37:0/273221704 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(7 200.00000005 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e780 con 0x56109cf4c000 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.639+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/273221704 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(6 200.00000004 [delete] v119'9 uv8 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e500 con 0x56109cf4c800 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.639+0000 7fbc90cdf640 1 -- 172.21.15.37:0/273221704 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(4 200.00000002 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e000 con 0x56109cf35800 2024-05-10T08:49:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.639+0000 7fbc85cc9640 1 -- 172.21.15.37:0/273221704 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:9 17.14 17:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56109d915400 con 0x56109cf34c00 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/273221704 <== osd.3 v2:172.21.15.37:6824/1264356154 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v119'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56109cc2e500 con 0x56109cf34c00 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56109cf4c000 msgr2=0x56109cf44b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56109cf4c000 0x56109cf44b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56109cf34400 msgr2=0x56109d8ff700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56109cf34400 0x56109d8ff700 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56109cf34c00 msgr2=0x56109cf44000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56109cf34c00 0x56109cf44000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56109cf35800 msgr2=0x56109cf44580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56109cf35800 0x56109cf44580 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56109cf4c800 msgr2=0x56109cf45080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/273221704 reap_dead start 2024-05-10T08:49:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56109cf4c800 0x56109cf45080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc8fcdd640 1 -- 172.21.15.37:0/273221704 reap_dead start 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109d935800 msgr2=0x56109d8fec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109d935800 0x56109d8fec00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x56109da9f980 tx=0x56109ce46240 comp rx=0 tx=0).stop 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 shutdown_connections 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 --2- 172.21.15.37:0/273221704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109d935800 0x56109d8fec00 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 >> 172.21.15.37:0/273221704 conn(0x56109d935000 msgr2=0x56109cc18000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 shutdown_connections 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.640+0000 7fbc91d30280 1 -- 172.21.15.37:0/273221704 wait complete. 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56109d934c00 msgr2=0x56109d8fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56109d934c00 0x56109d8fe100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56109da1e5a0 tx=0x56109d8c1f20 comp rx=0 tx=0).stop 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07800 msgr2=0x56109d8fd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07800 0x56109d8fd600 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x56109da1f920 tx=0x56109da258c0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 shutdown_connections 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56109d934c00 0x56109d8fe100 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109da07c00 0x56109d8fdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109da07800 0x56109d8fd600 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/3608379903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109da07400 0x56109d8fd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 >> 172.21.15.37:0/3608379903 conn(0x56109da07000 msgr2=0x56109cc18800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 shutdown_connections 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/3608379903 wait complete. 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/599806474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109cb21800 msgr2=0x56109d8fc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109cb21800 0x56109d8fc580 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x56109d94f8c0 tx=0x56109d8c2b40 comp rx=0 tx=0).stop 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/599806474 shutdown_connections 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56109cb21c00 0x56109d8fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56109cb21800 0x56109d8fc580 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 --2- 172.21.15.37:0/599806474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109cb20c00 0x56109d8fc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/599806474 >> 172.21.15.37:0/599806474 conn(0x56109cb21000 msgr2=0x56109cc19000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/599806474 shutdown_connections 2024-05-10T08:49:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.641+0000 7fbc91d30280 1 -- 172.21.15.37:0/599806474 wait complete. 2024-05-10T08:49:50.645 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.072430, result: writing EResetJournal entry 2024-05-10T08:49:50.646 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-05-10T08:49:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.726+0000 7fb872a10740 1 -- start start 2024-05-10T08:49:50.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.726+0000 7fb872a10740 1 Processor -- start 2024-05-10T08:49:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb872a10740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201ee44c00 0x56201fc14000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb872a10740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201ee45800 0x56201fc14580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb872a10740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201ee45c00 0x56201fc14b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb872a10740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56201fc30600 con 0x56201ee45800 2024-05-10T08:49:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb872a10740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56201fc30480 con 0x56201ee44c00 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb872a10740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56201fc30300 con 0x56201ee45c00 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201ee45800 0x56201fc14580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201ee45800 0x56201fc14580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48612/0 (socket says 172.21.15.37:48612) 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3072598672 learned_addr learned my addr 172.21.15.37:0/3072598672 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb87076c640 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201ee44c00 0x56201fc14000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201ee45c00 0x56201fc14b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201ee45c00 msgr2=0x56201fc14b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201ee45c00 0x56201fc14b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201ee44c00 msgr2=0x56201fc14000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201ee44c00 0x56201fc14000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.727+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3072598672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201ee71680 con 0x56201ee45800 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201ee45800 0x56201fc14580 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x56201fc6bf50 tx=0x56201ef14120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d68315a1168cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb86df67640 1 -- 172.21.15.37:0/3072598672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56201ee6a680 con 0x56201ee45800 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb86df67640 1 -- 172.21.15.37:0/3072598672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56201ee8cc40 con 0x56201ee45800 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb86df67640 1 -- 172.21.15.37:0/3072598672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56201ee6ab60 con 0x56201ee45800 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb872a10740 1 -- 172.21.15.37:0/3072598672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201ee71860 con 0x56201ee45800 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb872a10740 1 -- 172.21.15.37:0/3072598672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56201ee712c0 con 0x56201ee45800 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb872a10740 4 waiting for MDS map... 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb86df67640 1 -- 172.21.15.37:0/3072598672 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x56201fc26a00 con 0x56201ee45800 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb86df67640 1 -- 172.21.15.37:0/3072598672 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 105) ==== 2885+0+0 (secure 0 0 0) 0x56201ee9d180 con 0x56201ee45800 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb872a10740 4 Got MDS map 105 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb872a10740 4 datascan.main: Using metadata pool output 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.728+0000 7fb872a10740 4 datascan.main: connecting to RADOS... 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 Processor -- start 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 -- start start 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11c00 0x56201fc15b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56201fc30180 con 0x56201fd11400 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56201eea4480 con 0x56201fd11800 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.729+0000 7fb872a10740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56201eea4900 con 0x56201fd11c00 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb87076c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb87076c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.37:55082/0 (socket says 172.21.15.37:55082) 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48620/0 (socket says 172.21.15.37:48620) 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb87076c640 1 -- 172.21.15.37:0/2573783617 learned_addr learned my addr 172.21.15.37:0/2573783617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11c00 0x56201fc15b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 -- 172.21.15.37:0/2573783617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11c00 msgr2=0x56201fc15b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11c00 0x56201fc15b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 -- 172.21.15.37:0/2573783617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11800 msgr2=0x56201fc15600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 -- 172.21.15.37:0/2573783617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201ee714a0 con 0x56201fd11400 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb870f6d640 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x56201fd133b0 tx=0x56201fd39800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a2c1756a0c5a7e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb86bf63640 1 -- 172.21.15.37:0/2573783617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56201ee6a680 con 0x56201fd11400 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb86bf63640 1 -- 172.21.15.37:0/2573783617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56201ee8c1c0 con 0x56201fd11400 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.730+0000 7fb86bf63640 1 -- 172.21.15.37:0/2573783617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56201ee6ab60 con 0x56201fd11400 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 -- 172.21.15.37:0/2573783617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 msgr2=0x56201fc15080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x56201fd133b0 tx=0x56201fd39800 comp rx=0 tx=0).stop 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 -- 172.21.15.37:0/2573783617 shutdown_connections 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11c00 0x56201fc15b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 --2- 172.21.15.37:0/2573783617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 -- 172.21.15.37:0/2573783617 >> 172.21.15.37:0/2573783617 conn(0x56201fd11000 msgr2=0x56201fbc0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 -- 172.21.15.37:0/2573783617 shutdown_connections 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 -- 172.21.15.37:0/2573783617 wait complete. 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 Processor -- start 2024-05-10T08:49:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.731+0000 7fb872a10740 1 -- start start 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb872a10740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb872a10740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb872a10740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11c00 0x56201fc15b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb872a10740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56201fc31380 con 0x56201fd11400 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb872a10740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56201fc30180 con 0x56201fd11c00 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb872a10740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x56201fc31500 con 0x56201fd11800 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48622/0 (socket says 172.21.15.37:48622) 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 learned_addr learned my addr 172.21.15.37:0/3971777815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb87076c640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11c00 0x56201fc15b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11800 msgr2=0x56201fc15600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201fd11800 0x56201fc15600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11c00 msgr2=0x56201fc15b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201fd11c00 0x56201fc15b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201ee71680 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x56201fd9c090 tx=0x56201fbebf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.732+0000 7fb86a760640 1 -- 172.21.15.37:0/3971777815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56201ee6a4e0 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.733+0000 7fb86a760640 1 -- 172.21.15.37:0/3971777815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56201ee8d340 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.733+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56201ee71860 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.733+0000 7fb86a760640 1 -- 172.21.15.37:0/3971777815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56201ee6a680 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.733+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201ee712c0 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.733+0000 7fb872a10740 4 datascan.init: resolving metadata pool 17 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb86a760640 1 -- 172.21.15.37:0/3971777815 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x56201fc52c00 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb86a760640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56201fc4ac00 0x56201fc16100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb86a760640 1 -- 172.21.15.37:0/3971777815 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x56201fc4ca00 con 0x56201fd11400 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb872a10740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb872a10740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-05-10T08:49:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb872a10740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T08:49:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56201fc4b000 0x56201fc16680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb87076c640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56201fc4ac00 0x56201fc16100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.734+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc4b400 con 0x56201fc4b000 2024-05-10T08:49:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.735+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56201fc4b000 0x56201fc16680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.735+0000 7fb87076c640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56201fc4ac00 0x56201fc16100 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56201fc6b3b0 tx=0x56201fbeaa20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.735+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56201fc4b000 0x56201fc16680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.735+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(1 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.735+0000 7fb86b762640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56201f1f4000 0x56201f1fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.735+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:2 18.20 18:04000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f4400 con 0x56201f1f4000 2024-05-10T08:49:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.735+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56201f1f4000 0x56201f1fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.736+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56201f1f4000 0x56201f1fa000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.738+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(2 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.738+0000 7fb86bf63640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56201f1f4c00 0x56201f1fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.738+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:3 18.10 18:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5000 con 0x56201f1f4c00 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.738+0000 7fb87076c640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56201f1f4c00 0x56201f1fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.738+0000 7fb87076c640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56201f1f4c00 0x56201f1fa580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.739+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(3 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201f1f4c00 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.739+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:4 18.30 18:0c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f4800 con 0x56201fc4b000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.739+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(4 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.739+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:5 18.8 18:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5400 con 0x56201fc4b000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.739+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 3 ==== osd_op_reply(5 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.739+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:6 18.28 18:14000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5800 con 0x56201f1f4000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.739+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== osd_op_reply(6 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb86bf63640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56201f202000 0x56201f1fab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:7 18.18 18:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202400 con 0x56201f202000 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56201f202000 0x56201f1fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56201f202000 0x56201f1fab00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(7 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb86b762640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56201f1f5c00 0x56201f1fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:8 18.38 18:1c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f4800 con 0x56201f1f5c00 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.740+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56201f1f5c00 0x56201f1fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.741+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56201f1f5c00 0x56201f1fb600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.741+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== osd_op_reply(8 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.741+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:9 18.4 18:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202800 con 0x56201fc4b000 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.741+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 4 ==== osd_op_reply(9 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.741+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:10 18.24 18:24000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5400 con 0x56201fc4b000 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.741+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 5 ==== osd_op_reply(10 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.741+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:11 18.14 18:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202400 con 0x56201f1f4c00 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(11 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201f1f4c00 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:12 18.34 18:2c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc4b400 con 0x56201fc4b000 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 6 ==== osd_op_reply(12 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:13 18.c 18:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202c00 con 0x56201f1f4000 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 3 ==== osd_op_reply(13 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb86b762640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x56201fd10800 0x56201f1fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:14 18.2c 18:34000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202c00 con 0x56201fd10800 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.742+0000 7fb87076c640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x56201fd10800 0x56201f1fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.743+0000 7fb87076c640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x56201fd10800 0x56201f1fbb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.743+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== osd_op_reply(14 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201fd10800 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.743+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:15 18.1c 18:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203000 con 0x56201f202000 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.743+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== osd_op_reply(15 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.743+0000 7fb86b762640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56201f203800 0x56201f1fc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.743+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:16 18.3c 18:3c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f4400 con 0x56201f203800 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.743+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56201f203800 0x56201f1fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.744+0000 7fb86ff6b640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56201f203800 0x56201f1fc100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.744+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(16 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.744+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:17 18.2 18:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203400 con 0x56201f203800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.744+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== osd_op_reply(17 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.744+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:18 18.22 18:44000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5800 con 0x56201f1f5c00 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.745+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== osd_op_reply(18 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.745+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:19 18.12 18:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5400 con 0x56201fd10800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.745+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== osd_op_reply(19 [pgnls start_epoch 119 out=81b] v118'22 uv22 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x56201fbd6780 con 0x56201fd10800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.745+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:20 18.12 18:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56201fc4b800 con 0x56201fd10800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.745+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.2 v2:172.21.15.37:6808/2438867251 3 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x56201fbd6780 con 0x56201fd10800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.745+0000 7fb872a10740 10 datascan.operator(): handling object 1099511627778.0 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.745+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:21 18.12 18:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56201fc4bc00 con 0x56201fd10800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.2 v2:172.21.15.37:6808/2438867251 4 ==== osd_op_reply(21 10000000002.00000000 [call] v119'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56201fbd6780 con 0x56201fd10800 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:22 18.32 18:4c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202800 con 0x56201f1f5c00 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 3 ==== osd_op_reply(22 [pgnls start_epoch 119 out=49b] v117'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:23 18.a 18:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f4400 con 0x56201f1f5c00 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 4 ==== osd_op_reply(23 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb86b762640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56201f1f4800 0x56201f1fc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:24 18.2a 18:54000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203c00 con 0x56201f1f4800 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.747+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56201f1f4800 0x56201f1fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.748+0000 7fb870f6d640 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56201f1f4800 0x56201f1fc680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.748+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(24 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.748+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:25 18.1a 18:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc33400 con 0x56201f1f5c00 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.748+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 5 ==== osd_op_reply(25 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.748+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:26 18.3a 18:5c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc33400 con 0x56201fc4b000 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.748+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 7 ==== osd_op_reply(26 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.748+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:27 18.6 18:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc33000 con 0x56201f203800 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.749+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 3 ==== osd_op_reply(27 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.749+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:28 18.26 18:64000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202800 con 0x56201fd10800 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.749+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.2 v2:172.21.15.37:6808/2438867251 5 ==== osd_op_reply(28 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201fd10800 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.749+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:29 18.16 18:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc4b400 con 0x56201f1f5c00 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.749+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 6 ==== osd_op_reply(29 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.749+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:30 18.36 18:6c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203c00 con 0x56201f202000 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.750+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 3 ==== osd_op_reply(30 [pgnls start_epoch 119 out=81b] v117'33 uv17 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.750+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:31 18.36 18:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56201f203000 con 0x56201f202000 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.750+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 4 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.750+0000 7fb872a10740 10 datascan.operator(): handling object 1099511628279.0 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.750+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:32 18.36 18:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56201f203400 con 0x56201f202000 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.751+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 5 ==== osd_op_reply(32 100000001f7.00000000 [call] v119'34 uv34 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.751+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:33 18.e 18:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202400 con 0x56201fc4b000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.751+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 8 ==== osd_op_reply(33 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.751+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:34 18.2e 18:74000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5800 con 0x56201f1f5c00 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.751+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 7 ==== osd_op_reply(34 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.751+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:35 18.1e 18:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224000 con 0x56201f1f4000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.752+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 4 ==== osd_op_reply(35 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.752+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:36 18.3e 18:7c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f4400 con 0x56201f1f5c00 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.752+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 8 ==== osd_op_reply(36 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.752+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:37 18.1 18:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224400 con 0x56201f1f5c00 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.752+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 9 ==== osd_op_reply(37 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.752+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:38 18.21 18:84000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225800 con 0x56201f1f4000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.753+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 5 ==== osd_op_reply(38 [pgnls start_epoch 119 out=49b] v117'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.753+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:39 18.11 18:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224800 con 0x56201f202000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.753+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 6 ==== osd_op_reply(39 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.753+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:40 18.31 18:8c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225c00 con 0x56201f1f4800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.753+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== osd_op_reply(40 [pgnls start_epoch 119 out=81b] v117'15 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.753+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:41 18.31 18:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56201f202c00 con 0x56201f1f4800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.754+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 3 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.754+0000 7fb872a10740 10 datascan.operator(): handling object 1099511627780.1 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.754+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:42 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5000 con 0x56201f202000 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.755+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 7 ==== osd_op_reply(42 10000000004.00000000 [call] v119'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.755+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:43 18.9 18:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc4b400 con 0x56201f1f5c00 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.755+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 10 ==== osd_op_reply(43 [pgnls start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.755+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:44 18.29 18:94000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224800 con 0x56201f203800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.755+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 4 ==== osd_op_reply(44 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.755+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:45 18.19 18:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224c00 con 0x56201f1f4800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.756+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 4 ==== osd_op_reply(45 [pgnls start_epoch 119 out=81b] v118'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.756+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:46 18.19 18:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56201f203c00 con 0x56201f1f4800 2024-05-10T08:49:50.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.756+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 5 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.756+0000 7fb872a10740 10 datascan.operator(): handling object 1099511628280.0 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.756+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:47 18.19 18:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56201f203000 con 0x56201f1f4800 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.757+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 6 ==== osd_op_reply(47 100000001f8.00000000 [call] v119'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:48 18.39 18:9c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203400 con 0x56201fc4b000 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 9 ==== osd_op_reply(48 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:49 18.5 18:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225000 con 0x56201f202000 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 8 ==== osd_op_reply(49 [pgnls start_epoch 119 out=81b] v119'14 uv14 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:50 18.5 18:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x56201f202400 con 0x56201f202000 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 9 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb872a10740 10 datascan.operator(): handling object 1099511627780.0 2024-05-10T08:49:50.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.758+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:51 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x56201fc33400 con 0x56201f202000 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.759+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 10 ==== osd_op_reply(51 10000000004.00000000 [call] v119'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.760+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:52 18.25 18:a4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc33000 con 0x56201f1f4c00 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.760+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(52 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201f1f4c00 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.760+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:53 18.15 18:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225400 con 0x56201f1f4000 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.760+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 6 ==== osd_op_reply(53 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.760+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:54 18.35 18:ac000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224000 con 0x56201f1f4800 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.761+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 7 ==== osd_op_reply(54 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.761+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:55 18.d 18:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225c00 con 0x56201f1f4800 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.761+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 8 ==== osd_op_reply(55 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.761+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:56 18.2d 18:b4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224400 con 0x56201f1f4c00 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.761+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.6 v2:172.21.15.82:6824/3522580642 4 ==== osd_op_reply(56 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201f1f4c00 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.761+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:57 18.1d 18:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224c00 con 0x56201fc4b000 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.0 v2:172.21.15.37:6811/38998236 10 ==== osd_op_reply(57 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201fc4b000 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:58 18.3d 18:bc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225800 con 0x56201f1f5c00 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.3 v2:172.21.15.37:6824/1264356154 11 ==== osd_op_reply(58 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f5c00 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:59 18.3 18:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225400 con 0x56201f202000 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 11 ==== osd_op_reply(59 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:60 18.23 18:c4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f5800 con 0x56201fd10800 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.2 v2:172.21.15.37:6808/2438867251 6 ==== osd_op_reply(60 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201fd10800 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.762+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:61 18.13 18:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202c00 con 0x56201f203800 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.763+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 5 ==== osd_op_reply(61 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.763+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:62 18.33 18:cc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f1f4400 con 0x56201f202000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.763+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 12 ==== osd_op_reply(62 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.763+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:63 18.b 18:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203c00 con 0x56201f1f4000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.764+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 7 ==== osd_op_reply(63 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.764+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:64 18.2b 18:d4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224800 con 0x56201f203800 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.764+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 6 ==== osd_op_reply(64 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.764+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:65 18.1b 18:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203000 con 0x56201f202000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.764+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 13 ==== osd_op_reply(65 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.764+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:66 18.3b 18:dc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc33400 con 0x56201f1f4800 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 9 ==== osd_op_reply(66 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:67 18.7 18:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc4b400 con 0x56201fd10800 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 <== osd.2 v2:172.21.15.37:6808/2438867251 7 ==== osd_op_reply(67 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6780 con 0x56201fd10800 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:68 18.27 18:e4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201fc33000 con 0x56201f1f4000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 8 ==== osd_op_reply(68 [pgnls start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:69 18.17 18:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225000 con 0x56201f1f4000 2024-05-10T08:49:50.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 9 ==== osd_op_reply(69 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.765+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:70 18.37 18:ec000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f203400 con 0x56201f203800 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.766+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 7 ==== osd_op_reply(70 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.766+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:71 18.f 18:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f224c00 con 0x56201f1f4000 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.766+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.5 v2:172.21.15.82:6800/3184821053 10 ==== osd_op_reply(71 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4000 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.766+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:72 18.2f 18:f4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202400 con 0x56201f202000 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.766+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.1 v2:172.21.15.37:6800/1334168884 14 ==== osd_op_reply(72 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f202000 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.766+0000 7fb86bf63640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:73 18.1f 18:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f225400 con 0x56201f203800 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb86ff6b640 1 -- 172.21.15.37:0/3971777815 <== osd.7 v2:172.21.15.82:6816/1827186019 8 ==== osd_op_reply(73 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6000 con 0x56201f203800 2024-05-10T08:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb86b762640 1 -- 172.21.15.37:0/3971777815 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:74 18.3f 18:fc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x56201f202800 con 0x56201f1f4800 2024-05-10T08:49:50.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb870f6d640 1 -- 172.21.15.37:0/3971777815 <== osd.4 v2:172.21.15.82:6808/3594167095 10 ==== osd_op_reply(74 [pgnls start_epoch 119 out=49b] v117'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x56201fbd6500 con 0x56201f1f4800 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56201fc4b000 msgr2=0x56201fc16680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x56201fc4b000 0x56201fc16680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56201f202000 msgr2=0x56201f1fab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x56201f202000 0x56201f1fab00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x56201fd10800 msgr2=0x56201f1fbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x56201fd10800 0x56201f1fbb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56201f1f5c00 msgr2=0x56201f1fb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 reap_dead start 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x56201f1f5c00 0x56201f1fb600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56201f1f4800 msgr2=0x56201f1fc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x56201f1f4800 0x56201f1fc680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56201f1f4000 msgr2=0x56201f1fa000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x56201f1f4000 0x56201f1fa000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56201f1f4c00 msgr2=0x56201f1fa580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x56201f1f4c00 0x56201f1fa580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56201f203800 msgr2=0x56201f1fc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x56201f203800 0x56201f1fc100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb87076c640 1 -- 172.21.15.37:0/3971777815 reap_dead start 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56201fc4ac00 msgr2=0x56201fc16100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56201fc4ac00 0x56201fc16100 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56201fc6b3b0 tx=0x56201fbeaa20 comp rx=0 tx=0).stop 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 msgr2=0x56201fc15080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x56201fd9c090 tx=0x56201fbebf80 comp rx=0 tx=0).stop 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 shutdown_connections 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x56201fc4ac00 0x56201fc16100 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 --2- 172.21.15.37:0/3971777815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201fd11400 0x56201fc15080 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 >> 172.21.15.37:0/3971777815 conn(0x56201fd11000 msgr2=0x56201fbc0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 shutdown_connections 2024-05-10T08:49:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.767+0000 7fb872a10740 1 -- 172.21.15.37:0/3971777815 wait complete. 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 -- 172.21.15.37:0/3072598672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201ee45800 msgr2=0x56201fc14580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201ee45800 0x56201fc14580 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x56201fc6bf50 tx=0x56201ef14120 comp rx=0 tx=0).stop 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 -- 172.21.15.37:0/3072598672 shutdown_connections 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x56201ee45c00 0x56201fc14b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56201ee45800 0x56201fc14580 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 --2- 172.21.15.37:0/3072598672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56201ee44c00 0x56201fc14000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 -- 172.21.15.37:0/3072598672 >> 172.21.15.37:0/3072598672 conn(0x56201ee45000 msgr2=0x56201fbc1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 -- 172.21.15.37:0/3072598672 shutdown_connections 2024-05-10T08:49:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.768+0000 7fb872a10740 1 -- 172.21.15.37:0/3072598672 wait complete. 2024-05-10T08:49:50.773 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.127660, result: 2024-05-10T08:49:50.774 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-05-10T08:49:50.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.857+0000 7fdffb922740 1 -- start start 2024-05-10T08:49:50.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.857+0000 7fdffb922740 1 Processor -- start 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.857+0000 7fdffb922740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb1f62c00 0x556cb2d36000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.857+0000 7fdffb922740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb1f63800 0x556cb2d36580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.857+0000 7fdffb922740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb1f63c00 0x556cb2d36b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdffb922740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556cb2d4a600 con 0x556cb1f63800 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdffb922740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556cb2d4a480 con 0x556cb1f63c00 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdffb922740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556cb2d4a300 con 0x556cb1f62c00 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb1f63800 0x556cb2d36580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb1f63800 0x556cb2d36580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48624/0 (socket says 172.21.15.37:48624) 2024-05-10T08:49:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 -- 172.21.15.37:0/310971660 learned_addr learned my addr 172.21.15.37:0/310971660 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff988d640 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb1f62c00 0x556cb2d36000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdffa08e640 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb1f63c00 0x556cb2d36b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 -- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb1f62c00 msgr2=0x556cb2d36000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb1f62c00 0x556cb2d36000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 -- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb1f63c00 msgr2=0x556cb2d36b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb1f63c00 0x556cb2d36b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 -- 172.21.15.37:0/310971660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb1f8f680 con 0x556cb1f63800 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff988d640 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb1f62c00 0x556cb2d36000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff908c640 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb1f63800 0x556cb2d36580 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x556cb2d89b60 tx=0x556cb2d08a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b87ec290324a356 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff7088640 1 -- 172.21.15.37:0/310971660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x556cb1f889c0 con 0x556cb1f63800 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff7088640 1 -- 172.21.15.37:0/310971660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556cb1faac40 con 0x556cb1f63800 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdffb922740 1 -- 172.21.15.37:0/310971660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb1f8f860 con 0x556cb1f63800 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff7088640 1 -- 172.21.15.37:0/310971660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x556cb1f88680 con 0x556cb1f63800 2024-05-10T08:49:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdffb922740 1 -- 172.21.15.37:0/310971660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x556cb1f8f2c0 con 0x556cb1f63800 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdffb922740 4 waiting for MDS map... 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.858+0000 7fdff7088640 1 -- 172.21.15.37:0/310971660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x556cb2e44200 con 0x556cb1f63800 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.859+0000 7fdff7088640 1 -- 172.21.15.37:0/310971660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 105) ==== 2885+0+0 (secure 0 0 0) 0x556cb1fbb180 con 0x556cb1f63800 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.859+0000 7fdffb922740 4 Got MDS map 105 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.859+0000 7fdffb922740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.859+0000 7fdffb922740 4 datascan.main: Using metadata pool output 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.859+0000 7fdffb922740 4 datascan.main: connecting to RADOS... 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.859+0000 7fdffb922740 1 Processor -- start 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.859+0000 7fdffb922740 1 -- start start 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdffb922740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdffb922740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92400 0x556cb2d37600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdffb922740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 0x556cb2d37b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdffb922740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556cb2d4a180 con 0x556cb2e92400 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdffb922740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556cb1fc2480 con 0x556cb2e92800 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdffb922740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556cb1fc2900 con 0x556cb2e92000 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92400 0x556cb2d37600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92400 0x556cb2d37600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48628/0 (socket says 172.21.15.37:48628) 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 -- 172.21.15.37:0/3895948503 learned_addr learned my addr 172.21.15.37:0/3895948503 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdffa08e640 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff908c640 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 0x556cb2d37b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 -- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92000 msgr2=0x556cb2d37080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 -- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 msgr2=0x556cb2d37b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 0x556cb2d37b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 -- 172.21.15.37:0/3895948503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb1f8f4a0 con 0x556cb2e92400 2024-05-10T08:49:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff988d640 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92400 0x556cb2d37600 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x556cb2e333b0 tx=0x556cb2e52c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6710b5a95806695 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.860+0000 7fdff5084640 1 -- 172.21.15.37:0/3895948503 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x556cb1f889c0 con 0x556cb2e92400 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdff5084640 1 -- 172.21.15.37:0/3895948503 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556cb1fab340 con 0x556cb2e92400 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdff5084640 1 -- 172.21.15.37:0/3895948503 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x556cb1f88680 con 0x556cb2e92400 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 -- 172.21.15.37:0/3895948503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92400 msgr2=0x556cb2d37600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92400 0x556cb2d37600 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x556cb2e333b0 tx=0x556cb2e52c00 comp rx=0 tx=0).stop 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 -- 172.21.15.37:0/3895948503 shutdown_connections 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 0x556cb2d37b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92400 0x556cb2d37600 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 --2- 172.21.15.37:0/3895948503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 -- 172.21.15.37:0/3895948503 >> 172.21.15.37:0/3895948503 conn(0x556cb2d4dc00 msgr2=0x556cb2cde800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 -- 172.21.15.37:0/3895948503 shutdown_connections 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 -- 172.21.15.37:0/3895948503 wait complete. 2024-05-10T08:49:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.861+0000 7fdffb922740 1 Processor -- start 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffb922740 1 -- start start 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffb922740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffb922740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92400 0x556cb2d37600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffb922740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 0x556cb2d37b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffb922740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556cb2d4b380 con 0x556cb2e92000 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffb922740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556cb2d4a180 con 0x556cb2e92800 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffb922740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x556cb2d4b500 con 0x556cb2e92400 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffa08e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffa08e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48634/0 (socket says 172.21.15.37:48634) 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 learned_addr learned my addr 172.21.15.37:0/2870436664 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdff908c640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 0x556cb2d37b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdff988d640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92400 0x556cb2d37600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92400 msgr2=0x556cb2d37600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.862+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb2e92400 0x556cb2d37600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 msgr2=0x556cb2d37b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb2e92800 0x556cb2d37b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb1f8f0e0 con 0x556cb2e92000 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92000 0x556cb2d37080 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x556cb2eb40c0 tx=0x556cb2e52d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdff3881640 1 -- 172.21.15.37:0/2870436664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x556cb1f889c0 con 0x556cb2e92000 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdff3881640 1 -- 172.21.15.37:0/2870436664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556cb1faa1c0 con 0x556cb2e92000 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cb1f8fa40 con 0x556cb2e92000 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdff3881640 1 -- 172.21.15.37:0/2870436664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x556cb1f88680 con 0x556cb2e92000 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb1f8e3c0 con 0x556cb2e92000 2024-05-10T08:49:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.863+0000 7fdffb922740 4 datascan.init: resolving metadata pool 17 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.864+0000 7fdff3881640 1 -- 172.21.15.37:0/2870436664 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x556cb2eb0c00 con 0x556cb2e92000 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdff3881640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x556cb2eb6c00 0x556cb2d38100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdff3881640 1 -- 172.21.15.37:0/2870436664 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x556cb2e99a00 con 0x556cb2e92000 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdffb922740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdffb922740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdffb922740 4 datascan.main: opening data pool 'cephfs_data' 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x556cb2e92c00 0x556cb2d38680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x556cb2e93000 con 0x556cb2e92c00 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdff988d640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x556cb2eb6c00 0x556cb2d38100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdff908c640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x556cb2e92c00 0x556cb2d38680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdff908c640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x556cb2e92c00 0x556cb2d38680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdff988d640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x556cb2eb6c00 0x556cb2d38100 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x556cb2e333b0 tx=0x556cb2d08720 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.865+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv33 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.866+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x556cb2eb7000 0x556cb2d38c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.866+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x556cb2eb7400 con 0x556cb2eb7000 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.866+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x556cb2eb7000 0x556cb2d38c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.866+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x556cb2eb7000 0x556cb2d38c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.866+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2eb7000 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.866+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x556cb2eb7800 0x556cb2d39180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.866+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2eb7c00 con 0x556cb2eb7800 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.867+0000 7fdff988d640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x556cb2eb7800 0x556cb2d39180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.867+0000 7fdff988d640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x556cb2eb7800 0x556cb2d39180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.867+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.867+0000 7fdff4883640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x556cb2318000 0x556cb231e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.867+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318400 con 0x556cb2318000 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.867+0000 7fdff908c640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x556cb2318000 0x556cb231e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.868+0000 7fdff908c640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x556cb2318000 0x556cb231e000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.868+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.868+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:5 18.10 18:08000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318c00 con 0x556cb2eb7000 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.868+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2eb7000 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.868+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:6 18.30 18:0c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318800 con 0x556cb2eb7800 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:7 18.8 18:10000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319000 con 0x556cb2eb7800 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 3 ==== osd_op_reply(7 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:8 18.28 18:14000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318800 con 0x556cb2318000 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdff5084640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x556cb2319400 0x556cb231e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:9 18.18 18:18000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319000 con 0x556cb2319400 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.869+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x556cb2319400 0x556cb231e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.870+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x556cb2319400 0x556cb231e580 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.870+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.870+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2eb7c00 con 0x556cb2e92c00 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.870+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.870+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319800 con 0x556cb2eb7800 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.870+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.870+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2e93c00 con 0x556cb2eb7800 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.871+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 5 ==== osd_op_reply(12 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.871+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319c00 con 0x556cb2eb7000 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.871+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(13 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2eb7000 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.871+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318c00 con 0x556cb2eb7800 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.871+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 6 ==== osd_op_reply(14 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.871+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328000 con 0x556cb2318000 2024-05-10T08:49:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.872+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.872+0000 7fdff4883640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x556cb2319000 0x556cb231eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.872+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319c00 con 0x556cb2319000 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.872+0000 7fdff988d640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x556cb2319000 0x556cb231eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.872+0000 7fdff988d640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x556cb2319000 0x556cb231eb00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.872+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2319000 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.872+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328400 con 0x556cb2319400 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.873+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.873+0000 7fdff4883640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x556cb2eb7400 0x556cb231f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.873+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328000 con 0x556cb2eb7400 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.873+0000 7fdff908c640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x556cb2eb7400 0x556cb231f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.873+0000 7fdff908c640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x556cb2eb7400 0x556cb231f080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328800 con 0x556cb2eb7400 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2eb7c00 con 0x556cb2e92c00 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328c00 con 0x556cb2319000 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 119 out=81b] v119'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2319000 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.874+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:22 18.0 18:00000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328c00 con 0x556cb2eb7800 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.875+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.875+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:23 18.20 18:04000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2329800 con 0x556cb2318000 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.875+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.875+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:24 18.10 18:08000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318400 con 0x556cb2eb7000 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.875+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.6 v2:172.21.15.82:6824/3522580642 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2eb7000 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.875+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:25 18.30 18:0c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2329c00 con 0x556cb2eb7800 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.876+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 8 ==== osd_op_reply(25 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.876+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:26 18.8 18:10000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318800 con 0x556cb2eb7800 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.876+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 9 ==== osd_op_reply(26 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.876+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:27 18.28 18:14000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a000 con 0x556cb2318000 2024-05-10T08:49:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.876+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 5 ==== osd_op_reply(27 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.876+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:28 18.18 18:18000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2e93000 con 0x556cb2319400 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:29 18.38 18:1c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a400 con 0x556cb2e92c00 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 4 ==== osd_op_reply(29 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:30 18.4 18:20000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a000 con 0x556cb2eb7800 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 10 ==== osd_op_reply(30 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:31 18.24 18:24000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a800 con 0x556cb2eb7800 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 11 ==== osd_op_reply(31 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.877+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:32 18.14 18:28000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a400 con 0x556cb2eb7000 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.878+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.6 v2:172.21.15.82:6824/3522580642 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2eb7000 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.878+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:33 18.34 18:2c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233ac00 con 0x556cb2eb7800 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.878+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 12 ==== osd_op_reply(33 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.878+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:34 18.c 18:30000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328000 con 0x556cb2318000 2024-05-10T08:49:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.878+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.878+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:35 18.2c 18:34000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b000 con 0x556cb2319000 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.879+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.2 v2:172.21.15.37:6808/2438867251 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2319000 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.879+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:36 18.1c 18:38000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328800 con 0x556cb2319400 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.879+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.879+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:37 18.3c 18:3c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b400 con 0x556cb2eb7400 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.879+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 3 ==== osd_op_reply(37 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.879+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:38 18.2 18:40000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2329800 con 0x556cb2eb7400 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.879+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.880+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:39 18.22 18:44000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318400 con 0x556cb2e92c00 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.880+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.880+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:40 18.12 18:48000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2eb7c00 con 0x556cb2319000 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.880+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.2 v2:172.21.15.37:6808/2438867251 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 119 out=49b] v119'23 uv23 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2319000 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.880+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:41 18.32 18:4c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318800 con 0x556cb2e92c00 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.880+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 119 out=49b] v117'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.880+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:42 18.a 18:50000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a400 con 0x556cb2e92c00 2024-05-10T08:49:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.881+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 7 ==== osd_op_reply(42 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.881+0000 7fdff5084640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x556cb2328400 0x556cb231f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.881+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:43 18.2a 18:54000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328800 con 0x556cb2328400 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.881+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x556cb2328400 0x556cb231f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.881+0000 7fdffa08e640 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x556cb2328400 0x556cb231f600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(43 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2328400 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:44 18.1a 18:58000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a000 con 0x556cb2e92c00 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 8 ==== osd_op_reply(44 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:45 18.3a 18:5c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328c00 con 0x556cb2eb7800 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 13 ==== osd_op_reply(45 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:46 18.6 18:60000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a800 con 0x556cb2eb7400 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 5 ==== osd_op_reply(46 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.882+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:47 18.26 18:64000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2329c00 con 0x556cb2319000 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.2 v2:172.21.15.37:6808/2438867251 5 ==== osd_op_reply(47 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2319000 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:48 18.16 18:68000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233ac00 con 0x556cb2e92c00 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:49 18.36 18:6c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2e93000 con 0x556cb2319400 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 119 out=81b] v119'34 uv34 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdffb922740 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdffb922740 10 datascan.operator(): handling object 100000001f7.0 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.883+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:50 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x556cb2329400 con 0x556cb2319400 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 6 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) ==== 416+0+194 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:51 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319800 con 0x556cb2eb7800 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 14 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:52 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318c00 con 0x556cb2e92c00 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 10 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=585b] v0'0 uv12 ondisk = 0) ==== 164+0+585 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-05-10T08:49:50.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 20 datascan.get_frag_of: frag is * 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:53 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319c00 con 0x556cb2eb7800 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 15 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.884+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:54 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x556cb2e93c00 con 0x556cb2eb7800 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.885+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 16 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.885+0000 7fdffb922740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.885+0000 7fdffb922740 20 datascan.read_dentry: bravo_head not found in result 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.885+0000 7fdffb922740 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-05-10T08:49:50.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.885+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:55 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319800 con 0x556cb2eb7800 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.886+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 17 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v119'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.886+0000 7fdffb922740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.886+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:56 18.e 18:70000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2319c00 con 0x556cb2eb7800 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.886+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 18 ==== osd_op_reply(56 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.886+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:57 18.2e 18:74000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b000 con 0x556cb2e92c00 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.887+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 11 ==== osd_op_reply(57 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.887+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:58 18.1e 18:78000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b800 con 0x556cb2318000 2024-05-10T08:49:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.887+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.887+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:59 18.3e 18:7c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b400 con 0x556cb2e92c00 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.887+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 12 ==== osd_op_reply(59 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.887+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:60 18.1 18:80000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233bc00 con 0x556cb2e92c00 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.887+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 13 ==== osd_op_reply(60 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.888+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:61 18.21 18:84000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a400 con 0x556cb2318000 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.888+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 8 ==== osd_op_reply(61 [pgnls-filter start_epoch 119 out=49b] v117'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.888+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:62 18.11 18:88000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a800 con 0x556cb2319400 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.888+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 7 ==== osd_op_reply(62 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.888+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:63 18.31 18:8c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a000 con 0x556cb2328400 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.889+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== osd_op_reply(63 [pgnls-filter start_epoch 119 out=49b] v117'15 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2328400 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.889+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:64 18.9 18:90000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233ac00 con 0x556cb2e92c00 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.889+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 14 ==== osd_op_reply(64 [pgnls-filter start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.889+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:65 18.29 18:94000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318400 con 0x556cb2eb7400 2024-05-10T08:49:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.889+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.889+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:66 18.19 18:98000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b000 con 0x556cb2328400 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.4 v2:172.21.15.82:6808/3594167095 3 ==== osd_op_reply(66 [pgnls-filter start_epoch 119 out=49b] v119'24 uv24 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2328400 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:67 18.39 18:9c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318800 con 0x556cb2eb7800 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 19 ==== osd_op_reply(67 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:68 18.5 18:a0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b800 con 0x556cb2319400 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 8 ==== osd_op_reply(68 [pgnls-filter start_epoch 119 out=49b] v119'15 uv15 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:69 18.25 18:a4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a800 con 0x556cb2eb7000 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.6 v2:172.21.15.82:6824/3522580642 6 ==== osd_op_reply(69 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2eb7000 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.890+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:70 18.15 18:a8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b400 con 0x556cb2318000 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.891+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.891+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:71 18.35 18:ac000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a000 con 0x556cb2328400 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.891+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.4 v2:172.21.15.82:6808/3594167095 4 ==== osd_op_reply(71 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2328400 2024-05-10T08:49:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.891+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:72 18.d 18:b0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233bc00 con 0x556cb2328400 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.892+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.4 v2:172.21.15.82:6808/3594167095 5 ==== osd_op_reply(72 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2328400 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.892+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:73 18.2d 18:b4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328800 con 0x556cb2eb7000 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.892+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.6 v2:172.21.15.82:6824/3522580642 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2eb7000 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.892+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:74 18.1d 18:b8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a400 con 0x556cb2eb7800 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.892+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.0 v2:172.21.15.37:6811/38998236 20 ==== osd_op_reply(74 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2eb7800 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.892+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:75 18.3d 18:bc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2329400 con 0x556cb2e92c00 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.893+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.3 v2:172.21.15.37:6824/1264356154 15 ==== osd_op_reply(75 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2e92c00 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.893+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:76 18.3 18:c0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318c00 con 0x556cb2319400 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.893+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 9 ==== osd_op_reply(76 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.893+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:77 18.23 18:c4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2329000 con 0x556cb2319000 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.893+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.2 v2:172.21.15.37:6808/2438867251 6 ==== osd_op_reply(77 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2319000 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.893+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:78 18.13 18:c8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2318c00 con 0x556cb2eb7400 2024-05-10T08:49:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.894+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.894+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:79 18.33 18:cc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2e93000 con 0x556cb2319400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.894+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 10 ==== osd_op_reply(79 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.894+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:80 18.b 18:d0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2328800 con 0x556cb2318000 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.894+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 10 ==== osd_op_reply(80 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.894+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:81 18.2b 18:d4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2350000 con 0x556cb2eb7400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:82 18.1b 18:d8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b000 con 0x556cb2319400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:83 18.3b 18:dc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2350400 con 0x556cb2328400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.4 v2:172.21.15.82:6808/3594167095 6 ==== osd_op_reply(83 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2328400 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:84 18.7 18:e0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233b800 con 0x556cb2319000 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 <== osd.2 v2:172.21.15.37:6808/2438867251 7 ==== osd_op_reply(84 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4780 con 0x556cb2319000 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.895+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:85 18.27 18:e4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2350800 con 0x556cb2318000 2024-05-10T08:49:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.896+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 11 ==== osd_op_reply(85 [pgnls-filter start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.896+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:86 18.17 18:e8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a800 con 0x556cb2318000 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.896+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 12 ==== osd_op_reply(86 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.896+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:87 18.37 18:ec000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2350c00 con 0x556cb2eb7400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.896+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 9 ==== osd_op_reply(87 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.896+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:88 18.f 18:f0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233a000 con 0x556cb2318000 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.897+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.5 v2:172.21.15.82:6800/3184821053 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2318000 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.897+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:89 18.2f 18:f4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2351000 con 0x556cb2319400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.897+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.1 v2:172.21.15.37:6800/1334168884 12 ==== osd_op_reply(89 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2319400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.897+0000 7fdff4883640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:90 18.1f 18:f8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb233bc00 con 0x556cb2eb7400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdff908c640 1 -- 172.21.15.37:0/2870436664 <== osd.7 v2:172.21.15.82:6816/1827186019 10 ==== osd_op_reply(90 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4000 con 0x556cb2eb7400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdff5084640 1 -- 172.21.15.37:0/2870436664 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:91 18.3f 18:fc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x556cb2351400 con 0x556cb2328400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffa08e640 1 -- 172.21.15.37:0/2870436664 <== osd.4 v2:172.21.15.82:6808/3594167095 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 119 out=49b] v117'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x556cb2cf4500 con 0x556cb2328400 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x556cb2eb7800 msgr2=0x556cb2d39180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x556cb2eb7800 0x556cb2d39180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x556cb2319400 msgr2=0x556cb231e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x556cb2319400 0x556cb231e580 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x556cb2319000 msgr2=0x556cb231eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x556cb2319000 0x556cb231eb00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x556cb2e92c00 msgr2=0x556cb2d38680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x556cb2e92c00 0x556cb2d38680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x556cb2328400 msgr2=0x556cb231f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x556cb2328400 0x556cb231f600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x556cb2318000 msgr2=0x556cb231e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x556cb2318000 0x556cb231e000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 reap_dead start 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdff988d640 1 -- 172.21.15.37:0/2870436664 reap_dead start 2024-05-10T08:49:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x556cb2eb7000 msgr2=0x556cb2d38c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x556cb2eb7000 0x556cb2d38c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x556cb2eb7400 msgr2=0x556cb231f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x556cb2eb7400 0x556cb231f080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x556cb2eb6c00 msgr2=0x556cb2d38100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x556cb2eb6c00 0x556cb2d38100 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x556cb2e333b0 tx=0x556cb2d08720 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92000 msgr2=0x556cb2d37080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92000 0x556cb2d37080 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x556cb2eb40c0 tx=0x556cb2e52d20 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 shutdown_connections 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x556cb2eb7000 0x556cb2d38c00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x556cb2eb7400 0x556cb231f080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x556cb2eb6c00 0x556cb2d38100 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 --2- 172.21.15.37:0/2870436664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb2e92000 0x556cb2d37080 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 >> 172.21.15.37:0/2870436664 conn(0x556cb2d4dc00 msgr2=0x556cb2cde800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 shutdown_connections 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.898+0000 7fdffb922740 1 -- 172.21.15.37:0/2870436664 wait complete. 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 -- 172.21.15.37:0/310971660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb1f63800 msgr2=0x556cb2d36580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb1f63800 0x556cb2d36580 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x556cb2d89b60 tx=0x556cb2d08a20 comp rx=0 tx=0).stop 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 -- 172.21.15.37:0/310971660 shutdown_connections 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556cb1f63c00 0x556cb2d36b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556cb1f63800 0x556cb2d36580 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 --2- 172.21.15.37:0/310971660 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x556cb1f62c00 0x556cb2d36000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 -- 172.21.15.37:0/310971660 >> 172.21.15.37:0/310971660 conn(0x556cb1f63000 msgr2=0x556cb2cdf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 -- 172.21.15.37:0/310971660 shutdown_connections 2024-05-10T08:49:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.899+0000 7fdffb922740 1 -- 172.21.15.37:0/310971660 wait complete. 2024-05-10T08:49:50.912 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.138946, result: 2024-05-10T08:49:50.913 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-05-10T08:49:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.955+0000 7f0acb9dc740 1 -- start start 2024-05-10T08:49:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.955+0000 7f0acb9dc740 1 Processor -- start 2024-05-10T08:49:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f942f4c00 0x562f950c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f942f5800 0x562f950c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f942f5c00 0x562f950c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562f950ec600 con 0x562f942f5c00 2024-05-10T08:49:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f950ec480 con 0x562f942f4c00 2024-05-10T08:49:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x562f950ec300 con 0x562f942f5800 2024-05-10T08:49:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0aca98b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f942f5c00 0x562f950c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0aca98b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f942f5c00 0x562f950c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48650/0 (socket says 172.21.15.37:48650) 2024-05-10T08:49:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0aca98b640 1 -- 172.21.15.37:0/855475558 learned_addr learned my addr 172.21.15.37:0/855475558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0ac9989640 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f942f5800 0x562f950c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.956+0000 7f0aca18a640 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f942f4c00 0x562f950c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0aca98b640 1 -- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f942f5800 msgr2=0x562f950c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0aca98b640 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f942f5800 0x562f950c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0aca98b640 1 -- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f942f4c00 msgr2=0x562f950c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0aca98b640 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f942f4c00 0x562f950c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0aca98b640 1 -- 172.21.15.37:0/855475558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f94321680 con 0x562f942f5c00 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0aca98b640 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f942f5c00 0x562f950c4b00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x562f95121b90 tx=0x562f943c4180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9767b327d751fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0ac7985640 1 -- 172.21.15.37:0/855475558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f9431a680 con 0x562f942f5c00 2024-05-10T08:49:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0ac7985640 1 -- 172.21.15.37:0/855475558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562f9433c540 con 0x562f942f5c00 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0ac7985640 1 -- 172.21.15.37:0/855475558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f9431ab60 con 0x562f942f5c00 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0acb9dc740 1 -- 172.21.15.37:0/855475558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f943214a0 con 0x562f942f5c00 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0acb9dc740 1 -- 172.21.15.37:0/855475558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562f94321a40 con 0x562f942f5c00 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0acb9dc740 4 waiting for MDS map... 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0ac7985640 1 -- 172.21.15.37:0/855475558 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x562f951da600 con 0x562f942f5c00 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0ac7985640 1 -- 172.21.15.37:0/855475558 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 105) ==== 2885+0+0 (secure 0 0 0) 0x562f9434d180 con 0x562f942f5c00 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0acb9dc740 4 Got MDS map 105 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0acb9dc740 4 datascan.main: Using metadata pool output 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.957+0000 7f0acb9dc740 4 datascan.main: connecting to RADOS... 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 Processor -- start 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 -- start start 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7400 0x562f950c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7800 0x562f950c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 0x562f950c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562f950ec180 con 0x562f951d7400 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f950ec900 con 0x562f951d7800 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.958+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x562f94354900 con 0x562f951d7c00 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7400 0x562f950c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7400 0x562f950c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48664/0 (socket says 172.21.15.37:48664) 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 -- 172.21.15.37:0/1835109020 learned_addr learned my addr 172.21.15.37:0/1835109020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0aca18a640 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7800 0x562f950c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 0x562f950c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 -- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 msgr2=0x562f950c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 0x562f950c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 -- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7800 msgr2=0x562f950c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7800 0x562f950c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 -- 172.21.15.37:0/1835109020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f94321860 con 0x562f951d7400 2024-05-10T08:49:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac9989640 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7400 0x562f950c5080 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x562f951d50b0 tx=0x562f9509aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211b028ee41e4df2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac5981640 1 -- 172.21.15.37:0/1835109020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f9431a9c0 con 0x562f951d7400 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac5981640 1 -- 172.21.15.37:0/1835109020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562f9433ce00 con 0x562f951d7400 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0ac5981640 1 -- 172.21.15.37:0/1835109020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f9431a680 con 0x562f951d7400 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0acb9dc740 1 -- 172.21.15.37:0/1835109020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7400 msgr2=0x562f950c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.959+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7400 0x562f950c5080 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x562f951d50b0 tx=0x562f9509aa80 comp rx=0 tx=0).stop 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 -- 172.21.15.37:0/1835109020 shutdown_connections 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 0x562f950c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7800 0x562f950c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/1835109020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7400 0x562f950c5080 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 -- 172.21.15.37:0/1835109020 >> 172.21.15.37:0/1835109020 conn(0x562f951d7000 msgr2=0x562f95073000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 -- 172.21.15.37:0/1835109020 shutdown_connections 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 -- 172.21.15.37:0/1835109020 wait complete. 2024-05-10T08:49:50.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 Processor -- start 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.960+0000 7f0acb9dc740 1 -- start start 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7400 0x562f950c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7800 0x562f950c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0acb9dc740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 0x562f950c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562f950ec180 con 0x562f951d7800 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f950ec900 con 0x562f951d7400 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0acb9dc740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x562f950ed380 con 0x562f951d7c00 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7800 0x562f950c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7800 0x562f950c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48672/0 (socket says 172.21.15.37:48672) 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 learned_addr learned my addr 172.21.15.37:0/2165636620 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7400 0x562f950c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 0x562f950c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 msgr2=0x562f950c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f951d7c00 0x562f950c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7400 msgr2=0x562f950c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f951d7400 0x562f950c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f94321680 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7800 0x562f950c5600 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x562f951d5dd0 tx=0x562f951f1800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0ac417e640 1 -- 172.21.15.37:0/2165636620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f9431a9c0 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0ac417e640 1 -- 172.21.15.37:0/2165636620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562f9433ce00 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.961+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f943214a0 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.962+0000 7f0ac417e640 1 -- 172.21.15.37:0/2165636620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f9431a680 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.962+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f94321a40 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.962+0000 7f0acb9dc740 4 datascan.init: resolving metadata pool 17 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0ac417e640 1 -- 172.21.15.37:0/2165636620 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x562f9524ec00 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0ac417e640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x562f95108c00 0x562f950c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0ac417e640 1 -- 172.21.15.37:0/2165636620 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x562f95258a00 con 0x562f951d7800 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0acb9dc740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0acb9dc740 4 datascan.main: resolving metadata pool 17 2024-05-10T08:49:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x562f95109000 0x562f950c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x562f95108c00 0x562f950c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.963+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f95109400 con 0x562f95109000 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.964+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x562f95109000 0x562f950c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.964+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x562f95108c00 0x562f950c6100 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x562f951d52c0 tx=0x562f9509a720 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.964+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x562f95109000 0x562f950c6680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.964+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== osd_op_reply(1 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.964+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x562f95109400 0x562f946a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.964+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f950ef000 con 0x562f95109400 2024-05-10T08:49:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.964+0000 7f0aca98b640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x562f95109400 0x562f946a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.965+0000 7f0aca98b640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x562f95109400 0x562f946a6000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.965+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== osd_op_reply(2 [pgnls start_epoch 119 out=177b] v118'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.965+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f950ef000 con 0x562f95109000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.965+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== osd_op_reply(3 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.965+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x562f950ef000 0x562f946a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.965+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f950ef400 con 0x562f950ef000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.965+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x562f950ef000 0x562f946a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.966+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x562f950ef000 0x562f946a6580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.966+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== osd_op_reply(4 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.966+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f950ef400 con 0x562f950ef000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.966+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== osd_op_reply(5 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.966+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f950ef400 con 0x562f95109400 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== osd_op_reply(6 [pgnls start_epoch 119 out=149b] v119'40 uv40 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f950ef400 con 0x562f95109000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 3 ==== osd_op_reply(7 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x562f950ef400 0x562f946a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e000 con 0x562f950ef400 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x562f950ef400 0x562f946a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x562f950ef400 0x562f946a6b00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.967+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== osd_op_reply(8 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.968+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x562f9461e000 0x562f946a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.968+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e400 con 0x562f9461e000 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.968+0000 7f0aca98b640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x562f9461e000 0x562f946a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.968+0000 7f0aca98b640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x562f9461e000 0x562f946a7080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.968+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== osd_op_reply(9 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f9461e000 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.968+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e400 con 0x562f95109400 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.969+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 3 ==== osd_op_reply(10 [pgnls start_epoch 119 out=81b] v118'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.969+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e400 con 0x562f95109000 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.969+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 4 ==== osd_op_reply(11 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.969+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e400 con 0x562f950ef000 2024-05-10T08:49:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.969+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 3 ==== osd_op_reply(12 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.969+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x562f9461e400 0x562f946a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.969+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461f000 con 0x562f9461e400 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.970+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x562f9461e400 0x562f946a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.970+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x562f9461e400 0x562f946a8100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.970+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== osd_op_reply(13 [pgnls start_epoch 119 out=77b] v118'8 uv8 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.970+0000 7f0aca18a640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x562f9461f000 0x562f946a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.970+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461f400 con 0x562f9461f000 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.970+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x562f9461f000 0x562f946a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.971+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x562f9461f000 0x562f946a8680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.971+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== osd_op_reply(14 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.971+0000 7f0ac9989640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x562f9461f400 0x562f946a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.971+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461f400 2024-05-10T08:49:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.971+0000 7f0aca98b640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x562f9461f400 0x562f946a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.971+0000 7f0aca98b640 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x562f9461f400 0x562f946a7600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== osd_op_reply(15 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086500 con 0x562f9461f400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f950ef400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== osd_op_reply(16 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f950ef000 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 4 ==== osd_op_reply(17 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f95109400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 4 ==== osd_op_reply(18 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.972+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f95109400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.973+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 5 ==== osd_op_reply(19 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.973+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461f000 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.973+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== osd_op_reply(20 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.973+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461e400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.973+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== osd_op_reply(21 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:50.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.973+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461f000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.974+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 3 ==== osd_op_reply(22 [pgnls start_epoch 119 out=97b] v118'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.974+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f95109000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.974+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 5 ==== osd_op_reply(23 [pgnls start_epoch 119 out=74b] v116'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.974+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f95109000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 6 ==== osd_op_reply(24 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461e000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== osd_op_reply(25 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f9461e000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f95109400 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 6 ==== osd_op_reply(26 [pgnls start_epoch 119 out=98b] v118'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f950ef000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 5 ==== osd_op_reply(27 [pgnls start_epoch 119 out=76b] v119'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.975+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461e000 2024-05-10T08:49:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.976+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.4 v2:172.21.15.82:6808/3594167095 3 ==== osd_op_reply(28 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f9461e000 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.976+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f950ef000 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.976+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 6 ==== osd_op_reply(29 [pgnls start_epoch 119 out=105b] v119'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.976+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461e400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.976+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 3 ==== osd_op_reply(30 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.976+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f950ef400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 3 ==== osd_op_reply(31 [pgnls start_epoch 119 out=73b] v119'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f9461e400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 4 ==== osd_op_reply(32 [pgnls start_epoch 119 out=101b] v119'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109800 con 0x562f95109400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 7 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.977+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109c00 con 0x562f95109400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 8 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f9461fc00 con 0x562f95109400 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 9 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca000 con 0x562f95109400 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 10 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.978+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca400 con 0x562f95109400 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 11 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T08:49:50.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca800 con 0x562f95109400 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 12 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv35 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cac00 con 0x562f950ef400 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 4 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:40 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cb000 con 0x562f95109400 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 13 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.979+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:41 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cb400 con 0x562f9461f400 2024-05-10T08:49:50.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f9461f400 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cb800 con 0x562f9461f000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.980+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca000 con 0x562f95109000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 7 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-05-10T08:49:50.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cbc00 con 0x562f95109400 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 14 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.981+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:45 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f9461fc00 con 0x562f950ef000 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109800 con 0x562f950ef000 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 20 datascan.scan_links: injected ino detected 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T08:49:50.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109c00 con 0x562f9461e400 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 5 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.982+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.983+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 8 ==== osd_op_reply(48 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.983+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109400 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.983+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 15 ==== osd_op_reply(49 [pgnls start_epoch 119 out=177b] v118'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.983+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.983+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 9 ==== osd_op_reply(50 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.983+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.984+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 9 ==== osd_op_reply(51 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.984+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.984+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 10 ==== osd_op_reply(52 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.984+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109400 2024-05-10T08:49:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.984+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 16 ==== osd_op_reply(53 [pgnls start_epoch 119 out=149b] v119'40 uv40 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.984+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109000 2024-05-10T08:49:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.985+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 10 ==== osd_op_reply(54 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:50.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.985+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef400 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.985+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 5 ==== osd_op_reply(55 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.985+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461e000 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.4 v2:172.21.15.82:6808/3594167095 4 ==== osd_op_reply(56 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f9461e000 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109400 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 17 ==== osd_op_reply(57 [pgnls start_epoch 119 out=81b] v118'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109000 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 11 ==== osd_op_reply(58 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef000 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 11 ==== osd_op_reply(59 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.986+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461e400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.987+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 6 ==== osd_op_reply(60 [pgnls start_epoch 119 out=77b] v118'8 uv8 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.987+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461f000 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.987+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 5 ==== osd_op_reply(61 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.987+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461f400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.987+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.2 v2:172.21.15.37:6808/2438867251 3 ==== osd_op_reply(62 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086500 con 0x562f9461f400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.987+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 6 ==== osd_op_reply(63 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef000 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 12 ==== osd_op_reply(64 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 18 ==== osd_op_reply(65 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109400 2024-05-10T08:49:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 19 ==== osd_op_reply(66 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.988+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461f000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.989+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 6 ==== osd_op_reply(67 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.989+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461e400 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.989+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 7 ==== osd_op_reply(68 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.989+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461f000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.989+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 7 ==== osd_op_reply(69 [pgnls start_epoch 119 out=97b] v118'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.989+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.990+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 12 ==== osd_op_reply(70 [pgnls start_epoch 119 out=74b] v116'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.990+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.990+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 13 ==== osd_op_reply(71 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.990+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461e000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.990+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.4 v2:172.21.15.82:6808/3594167095 5 ==== osd_op_reply(72 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f9461e000 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.990+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f95109400 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 20 ==== osd_op_reply(73 [pgnls start_epoch 119 out=98b] v118'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef000 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 13 ==== osd_op_reply(74 [pgnls start_epoch 119 out=76b] v119'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461e000 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.4 v2:172.21.15.82:6808/3594167095 6 ==== osd_op_reply(75 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086500 con 0x562f9461e000 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef000 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 14 ==== osd_op_reply(76 [pgnls start_epoch 119 out=105b] v119'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461e400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.991+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 8 ==== osd_op_reply(77 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f950ef400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 7 ==== osd_op_reply(78 [pgnls start_epoch 119 out=73b] v119'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) -- 0x562f951d6800 con 0x562f9461e400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 9 ==== osd_op_reply(79 [pgnls start_epoch 119 out=101b] v119'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109800 con 0x562f95109400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 21 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.992+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109c00 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 22 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f9461f800 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 23 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f9461e800 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 24 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.993+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f9461fc00 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 25 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-05-10T08:49:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f9461f800 con 0x562f95109400 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 26 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv35 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109800 con 0x562f950ef400 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.1 v2:172.21.15.37:6800/1334168884 8 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086000 con 0x562f950ef400 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:87 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109c00 con 0x562f95109400 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 27 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-05-10T08:49:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.994+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- osd_op(unknown.0.0:88 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cbc00 con 0x562f9461f400 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.995+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.2 v2:172.21.15.37:6808/2438867251 4 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086500 con 0x562f9461f400 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.995+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.995+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cb400 con 0x562f9461f000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.995+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.5 v2:172.21.15.82:6800/3184821053 8 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086000 con 0x562f9461f000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cb000 con 0x562f95109000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 14 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-05-10T08:49:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca800 con 0x562f95109400 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 28 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.996+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:92 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca400 con 0x562f950ef000 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 15 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:93 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cac00 con 0x562f950ef000 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 16 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 20 datascan.scan_links: injected ino detected 2024-05-10T08:49:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946cb800 con 0x562f9461e400 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.6 v2:172.21.15.82:6824/3522580642 10 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x562f95086780 con 0x562f9461e400 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: processing 1 injected_inos 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.997+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:95 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca000 con 0x562f950ef000 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.998+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 17 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.998+0000 7f0acb9dc740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.998+0000 7f0acb9dc740 20 datascan.scan_links: first is now 2 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.998+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- osd_op(unknown.0.0:96 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x562f946cb400 con 0x562f950ef000 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 <== osd.0 v2:172.21.15.37:6811/38998236 18 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v119'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562f95086780 con 0x562f950ef000 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0acb9dc740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0acb9dc740 10 datascan.scan_links: updating inotable 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:97 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f95109800 con 0x562f95109400 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 29 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0acb9dc740 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0acb9dc740 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:50.999+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- osd_op(unknown.0.0:98 17.13 17:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) -- 0x562f9461ec00 con 0x562f95109400 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.000+0000 7f0aca98b640 1 -- 172.21.15.37:0/2165636620 <== osd.3 v2:172.21.15.37:6824/1264356154 30 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v119'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x562f95086500 con 0x562f95109400 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.000+0000 7f0acb9dc740 10 datascan.scan_links: updating snaptable 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.000+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- osd_op(unknown.0.0:99 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) -- 0x562f946ca400 con 0x562f95109000 2024-05-10T08:49:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0ac9989640 1 -- 172.21.15.37:0/2165636620 <== osd.7 v2:172.21.15.82:6816/1827186019 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x562f95086000 con 0x562f95109000 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x562f950ef000 msgr2=0x562f946a6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x562f950ef000 0x562f946a6580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x562f950ef400 msgr2=0x562f946a6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x562f950ef400 0x562f946a6b00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x562f9461f400 msgr2=0x562f946a7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x562f9461f400 0x562f946a7600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x562f95109400 msgr2=0x562f946a6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x562f95109400 0x562f946a6000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x562f9461e000 msgr2=0x562f946a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x562f9461e000 0x562f946a7080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 reap_dead start 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x562f9461f000 msgr2=0x562f946a8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x562f9461f000 0x562f946a8680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x562f9461e400 msgr2=0x562f946a8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x562f9461e400 0x562f946a8100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x562f95109000 msgr2=0x562f950c6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x562f95109000 0x562f950c6680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x562f95108c00 msgr2=0x562f950c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x562f95108c00 0x562f950c6100 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x562f951d52c0 tx=0x562f9509a720 comp rx=0 tx=0).stop 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7800 msgr2=0x562f950c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/2165636620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f951d7800 0x562f950c5600 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x562f951d5dd0 tx=0x562f951f1800 comp rx=0 tx=0).stop 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 reap_dead start 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0aca18a640 1 -- 172.21.15.37:0/2165636620 reap_dead start 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 shutdown_connections 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 >> 172.21.15.37:0/2165636620 conn(0x562f951d7000 msgr2=0x562f95073000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 shutdown_connections 2024-05-10T08:49:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.001+0000 7f0acb9dc740 1 -- 172.21.15.37:0/2165636620 wait complete. 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 -- 172.21.15.37:0/855475558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f942f5c00 msgr2=0x562f950c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f942f5c00 0x562f950c4b00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x562f95121b90 tx=0x562f943c4180 comp rx=0 tx=0).stop 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 -- 172.21.15.37:0/855475558 shutdown_connections 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562f942f5c00 0x562f950c4b00 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x562f942f5800 0x562f950c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 --2- 172.21.15.37:0/855475558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f942f4c00 0x562f950c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 -- 172.21.15.37:0/855475558 >> 172.21.15.37:0/855475558 conn(0x562f942f5000 msgr2=0x562f95072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 -- 172.21.15.37:0/855475558 shutdown_connections 2024-05-10T08:49:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.002+0000 7f0acb9dc740 1 -- 172.21.15.37:0/855475558 wait complete. 2024-05-10T08:49:51.019 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.106698, result: 2024-05-10T08:49:51.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:51.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:51.093 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-05-10T08:49:51.093 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-05-10T08:49:51.093 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:51.093 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:51.094 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2024-05-10T08:49:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-05-10T08:49:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-05-10T08:49:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-05-10T08:49:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-05-10T08:49:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = False 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.104 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.105 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:51.106 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:51.107 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-05-10T08:49:51.108 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:51.110 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.111 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:51.112 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: mon down mkfs grace = 300 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:51.113 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T08:49:51.114 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = False 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:51.159 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T08:49:51.201 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.204 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-05-10T08:49:51.205 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-05-10T08:49:51.206 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:51.207 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-05-10T08:49:51.208 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-05-10T08:49:51.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-05-10T08:49:51.210 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.211 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-05-10T08:49:51.212 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-05-10T08:49:51.213 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-05-10T08:49:51.214 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.37,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 5ef49677-880e-4a90-bdff-f8e0a7cb5aaa 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-05-10T08:49:51.215 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-05-10T08:49:51.216 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.217 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-05-10T08:49:51.218 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.219 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: mon down mkfs grace = 300 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-05-10T08:49:51.220 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T08:49:51.221 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T08:49:51.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-10T08:49:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.371+0000 7f8c0aa33640 1 Processor -- start 2024-05-10T08:49:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.372+0000 7f8c0aa33640 1 -- start start 2024-05-10T08:49:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.372+0000 7f8c0aa33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c0416a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.372+0000 7f8c0aa33640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c040d0320 con 0x7f8c040cfcd0 2024-05-10T08:49:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.372+0000 7f8c0aa33640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c040d0600 con 0x7f8c0415f4e0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.372+0000 7f8c0aa33640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c040d41b0 con 0x7f8c040d56b0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c037fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8c040cfcd0 0x7f8c040d4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55224/0 (socket says 172.21.15.37:55224) 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c037fe640 1 -- 172.21.15.37:0/2189646770 learned_addr learned my addr 172.21.15.37:0/2189646770 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c08fd0640 1 --2- 172.21.15.37:0/2189646770 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c0416a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c02ffd640 1 -- 172.21.15.37:0/2189646770 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151713643 0 0) 0x7f8c040d0320 con 0x7f8c040cfcd0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c02ffd640 1 -- 172.21.15.37:0/2189646770 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bec003520 con 0x7f8c040cfcd0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c02ffd640 1 -- 172.21.15.37:0/2189646770 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869601682 0 0) 0x7f8c040d0600 con 0x7f8c0415f4e0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c02ffd640 1 -- 172.21.15.37:0/2189646770 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c040d0320 con 0x7f8c0415f4e0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c08fd0640 1 -- 172.21.15.37:0/2189646770 >> v1:172.21.15.82:6789/0 conn(0x7f8c0415f4e0 legacy=0x7f8c040d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c08fd0640 1 -- 172.21.15.37:0/2189646770 >> v1:172.21.15.37:6789/0 conn(0x7f8c040cfcd0 legacy=0x7f8c040d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.373+0000 7f8c08fd0640 1 -- 172.21.15.37:0/2189646770 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c040d08e0 con 0x7f8c040d56b0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c08fd0640 1 --2- 172.21.15.37:0/2189646770 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c0416a080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009dc0 tx=0x7f8bfc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e447f7f4d0b38678 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c02ffd640 1 -- 172.21.15.37:0/2189646770 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc007740 con 0x7f8c040d56b0 2024-05-10T08:49:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c02ffd640 1 -- 172.21.15.37:0/2189646770 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0078e0 con 0x7f8c040d56b0 2024-05-10T08:49:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c02ffd640 1 -- 172.21.15.37:0/2189646770 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc007c90 con 0x7f8c040d56b0 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c0aa33640 1 -- 172.21.15.37:0/2189646770 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 msgr2=0x7f8c0416a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/2189646770 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c0416a080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009dc0 tx=0x7f8bfc02a6d0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c0aa33640 1 -- 172.21.15.37:0/2189646770 shutdown_connections 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/2189646770 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c0416a080 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c0aa33640 1 -- 172.21.15.37:0/2189646770 >> 172.21.15.37:0/2189646770 conn(0x7f8c0408eac0 msgr2=0x7f8c0409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c0aa33640 1 -- 172.21.15.37:0/2189646770 shutdown_connections 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.374+0000 7f8c0aa33640 1 -- 172.21.15.37:0/2189646770 wait complete. 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.376+0000 7f8c0aa33640 1 Processor -- start 2024-05-10T08:49:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.376+0000 7f8c0aa33640 1 -- start start 2024-05-10T08:49:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.376+0000 7f8c0aa33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040cfcd0 0x7f8c040cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.376+0000 7f8c0aa33640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c040ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.376+0000 7f8c0aa33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0415f4e0 0x7f8c040ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.376+0000 7f8c0aa33640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0415f8c0 con 0x7f8c040cfcd0 2024-05-10T08:49:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c0aa33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c040d0ea0 con 0x7f8c0415f4e0 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c0aa33640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8c040d23d0 con 0x7f8c040d56b0 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040cfcd0 0x7f8c040cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040cfcd0 0x7f8c040cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48678/0 (socket says 172.21.15.37:48678) 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c037fe640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c040ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 -- 172.21.15.37:0/3876388350 learned_addr learned my addr 172.21.15.37:0/3876388350 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c08fd0640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0415f4e0 0x7f8c040ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 -- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 msgr2=0x7f8c040ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c040ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 -- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0415f4e0 msgr2=0x7f8c040ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0415f4e0 0x7f8c040ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 -- 172.21.15.37:0/3876388350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c040cee90 con 0x7f8c040cfcd0 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c037fe640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c040ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:49:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c03fff640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040cfcd0 0x7f8c040cc7a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c430 tx=0x7f8bf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c00ff9640 1 -- 172.21.15.37:0/3876388350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4017070 con 0x7f8c040cfcd0 2024-05-10T08:49:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c00ff9640 1 -- 172.21.15.37:0/3876388350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40052f0 con 0x7f8c040cfcd0 2024-05-10T08:49:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c040cf170 con 0x7f8c040cfcd0 2024-05-10T08:49:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c00ff9640 1 -- 172.21.15.37:0/3876388350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4003830 con 0x7f8c040cfcd0 2024-05-10T08:49:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.377+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c041609b0 con 0x7f8c040cfcd0 2024-05-10T08:49:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.378+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c040693f0 con 0x7f8c040cfcd0 2024-05-10T08:49:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.379+0000 7f8c00ff9640 1 -- 172.21.15.37:0/3876388350 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8bf401a070 con 0x7f8c040cfcd0 2024-05-10T08:49:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.380+0000 7f8c00ff9640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf00762d0 0x7f8bf0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.380+0000 7f8c00ff9640 1 -- 172.21.15.37:0/3876388350 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f8bf4096b20 con 0x7f8c040cfcd0 2024-05-10T08:49:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.380+0000 7f8c037fe640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf00762d0 0x7f8bf0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.380+0000 7f8c037fe640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf00762d0 0x7f8bf0078790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8c04162c90 tx=0x7f8bf8007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:51.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.384+0000 7f8c00ff9640 1 -- 172.21.15.37:0/3876388350 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8bf405fbf0 con 0x7f8c040cfcd0 2024-05-10T08:49:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:51.613+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f8c040d5e60 con 0x7f8c040cfcd0 2024-05-10T08:49:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.567+0000 7f8c00ff9640 1 -- 172.21.15.37:0/3876388350 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v107) ==== 162+0+0 (secure 0 0 0) 0x7f8bf4068230 con 0x7f8c040cfcd0 2024-05-10T08:49:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.569+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf00762d0 msgr2=0x7f8bf0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.569+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf00762d0 0x7f8bf0078790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8c04162c90 tx=0x7f8bf8007d50 comp rx=0 tx=0).stop 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.569+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040cfcd0 msgr2=0x7f8c040cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.569+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040cfcd0 0x7f8c040cc7a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c430 tx=0x7f8bf400c8f0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 shutdown_connections 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8bf00762d0 0x7f8bf0078790 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c0415f4e0 0x7f8c040ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8c040d56b0 0x7f8c040ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 --2- 172.21.15.37:0/3876388350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040cfcd0 0x7f8c040cc7a0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 >> 172.21.15.37:0/3876388350 conn(0x7f8c0408eac0 msgr2=0x7f8c0406e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:52.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 shutdown_connections 2024-05-10T08:49:52.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.570+0000 7f8c0aa33640 1 -- 172.21.15.37:0/3876388350 wait complete. 2024-05-10T08:49:52.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:52.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.697+0000 7fb207faf640 1 Processor -- start 2024-05-10T08:49:52.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.697+0000 7fb207faf640 1 -- start start 2024-05-10T08:49:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb207faf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb20006e0f0 0x7fb2000cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb207faf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2000d0360 0x7fb2000b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb207faf640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb20015d2a0 con 0x7fb20006f060 2024-05-10T08:49:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb207faf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb20006f440 con 0x7fb2000d0360 2024-05-10T08:49:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb207faf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb2001609b0 con 0x7fb20006e0f0 2024-05-10T08:49:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20654c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2000d0360 0x7fb2000b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20654c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2000d0360 0x7fb2000b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48692/0 (socket says 172.21.15.37:48692) 2024-05-10T08:49:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20654c640 1 -- 172.21.15.37:0/1542066778 learned_addr learned my addr 172.21.15.37:0/1542066778 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20554a640 1 --2- 172.21.15.37:0/1542066778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb20006e0f0 0x7fb2000cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20654c640 1 -- 172.21.15.37:0/1542066778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb20006e0f0 msgr2=0x7fb2000cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20654c640 1 --2- 172.21.15.37:0/1542066778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb20006e0f0 0x7fb2000cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20654c640 1 -- 172.21.15.37:0/1542066778 >> v1:172.21.15.82:6789/0 conn(0x7fb20006f060 legacy=0x7fb20006fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20654c640 1 -- 172.21.15.37:0/1542066778 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb200160c90 con 0x7fb2000d0360 2024-05-10T08:49:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.698+0000 7fb20554a640 1 --2- 172.21.15.37:0/1542066778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb20006e0f0 0x7fb2000cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:52.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.699+0000 7fb20654c640 1 --2- 172.21.15.37:0/1542066778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2000d0360 0x7fb2000b3f00 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009e50 tx=0x7fb1f802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694b6ca208660114 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.699+0000 7fb204d49640 1 -- 172.21.15.37:0/1542066778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8036070 con 0x7fb2000d0360 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.699+0000 7fb204d49640 1 -- 172.21.15.37:0/1542066778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f8031600 con 0x7fb2000d0360 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.699+0000 7fb204d49640 1 -- 172.21.15.37:0/1542066778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80319d0 con 0x7fb2000d0360 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 -- 172.21.15.37:0/1542066778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2000d0360 msgr2=0x7fb2000b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 --2- 172.21.15.37:0/1542066778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2000d0360 0x7fb2000b3f00 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009e50 tx=0x7fb1f802a710 comp rx=0 tx=0).stop 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 -- 172.21.15.37:0/1542066778 shutdown_connections 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 --2- 172.21.15.37:0/1542066778 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb20006e0f0 0x7fb2000cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 --2- 172.21.15.37:0/1542066778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2000d0360 0x7fb2000b3f00 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 -- 172.21.15.37:0/1542066778 >> 172.21.15.37:0/1542066778 conn(0x7fb20006c3a0 msgr2=0x7fb20006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 -- 172.21.15.37:0/1542066778 shutdown_connections 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.700+0000 7fb207faf640 1 -- 172.21.15.37:0/1542066778 wait complete. 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.701+0000 7fb207faf640 1 Processor -- start 2024-05-10T08:49:52.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.701+0000 7fb207faf640 1 -- start start 2024-05-10T08:49:52.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb207faf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20006e0f0 0x7fb200152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:52.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb207faf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20006f060 0x7fb2001576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:52.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb207faf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2000d0360 0x7fb20009dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb207faf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb200161530 con 0x7fb20006f060 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb207faf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb200161250 con 0x7fb20006e0f0 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb207faf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb200161810 con 0x7fb2000d0360 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20006f060 0x7fb2001576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20006f060 0x7fb2001576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48702/0 (socket says 172.21.15.37:48702) 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 -- 172.21.15.37:0/650401817 learned_addr learned my addr 172.21.15.37:0/650401817 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 -- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2000d0360 msgr2=0x7fb20009dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2000d0360 0x7fb20009dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 -- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20006e0f0 msgr2=0x7fb200152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb205d4b640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20006e0f0 0x7fb200152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20006e0f0 0x7fb200152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 -- 172.21.15.37:0/650401817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb200072d70 con 0x7fb20006f060 2024-05-10T08:49:52.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.702+0000 7fb20554a640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20006f060 0x7fb2001576f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000e760 tx=0x7fb1f000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:52.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.703+0000 7fb1f67fc640 1 -- 172.21.15.37:0/650401817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000f040 con 0x7fb20006f060 2024-05-10T08:49:52.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.703+0000 7fb1f67fc640 1 -- 172.21.15.37:0/650401817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f0004230 con 0x7fb20006f060 2024-05-10T08:49:52.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.703+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb200073050 con 0x7fb20006f060 2024-05-10T08:49:52.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.703+0000 7fb1f67fc640 1 -- 172.21.15.37:0/650401817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000ee70 con 0x7fb20006f060 2024-05-10T08:49:52.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.703+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2000b0c10 con 0x7fb20006f060 2024-05-10T08:49:52.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.704+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20015dfe0 con 0x7fb20006f060 2024-05-10T08:49:52.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.704+0000 7fb1f67fc640 1 -- 172.21.15.37:0/650401817 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb1f000c6d0 con 0x7fb20006f060 2024-05-10T08:49:52.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.705+0000 7fb1f67fc640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e40762d0 0x7fb1e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:52.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.705+0000 7fb1f67fc640 1 -- 172.21.15.37:0/650401817 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7fb1f00975b0 con 0x7fb20006f060 2024-05-10T08:49:52.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.705+0000 7fb205d4b640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e40762d0 0x7fb1e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:52.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.706+0000 7fb205d4b640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e40762d0 0x7fb1e4078790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0015a0 tx=0x7fb1fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:52.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.709+0000 7fb1f67fc640 1 -- 172.21.15.37:0/650401817 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb20015dfe0 con 0x7fb20006f060 2024-05-10T08:49:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.940+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb20006c820 con 0x7fb20006f060 2024-05-10T08:49:52.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.941+0000 7fb1f67fc640 1 -- 172.21.15.37:0/650401817 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5182 (secure 0 0 0) 0x7fb1f0017020 con 0x7fb20006f060 2024-05-10T08:49:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:52.940 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":108,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:52.570309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":108,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6835/1002841422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1002841422},{"type":"v1","addr":"172.21.15.37:6835","nonce":1002841422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T08:49:52.940 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 108 2024-05-10T08:49:52.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e40762d0 msgr2=0x7fb1e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e40762d0 0x7fb1e4078790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0015a0 tx=0x7fb1fc009040 comp rx=0 tx=0).stop 2024-05-10T08:49:52.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20006f060 msgr2=0x7fb2001576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:52.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20006f060 0x7fb2001576f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000e760 tx=0x7fb1f000ec20 comp rx=0 tx=0).stop 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 shutdown_connections 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb1e40762d0 0x7fb1e4078790 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb2000d0360 0x7fb20009dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb20006f060 0x7fb2001576f0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 --2- 172.21.15.37:0/650401817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20006e0f0 0x7fb200152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 >> 172.21.15.37:0/650401817 conn(0x7fb20006c3a0 msgr2=0x7fb20006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 shutdown_connections 2024-05-10T08:49:52.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:52.943+0000 7fb207faf640 1 -- 172.21.15.37:0/650401817 wait complete. 2024-05-10T08:49:53.355 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 108, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:49:25.024575+0000', 'modified': '2024-05-10T08:49:52.570309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8433': {'gid': 8433, 'name': 'c', 'rank': 0, 'incarnation': 108, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6835/1002841422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 1002841422}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 1002841422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:49:53.356 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8433:up:replay 2024-05-10T08:49:54.356 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.474+0000 7fec5ac85640 1 Processor -- start 2024-05-10T08:49:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.474+0000 7fec5ac85640 1 -- start start 2024-05-10T08:49:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec5ac85640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fec541629b0 0x7fec5406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec5ac85640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5406e110 con 0x7fec540b2490 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec5ac85640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5406e3f0 con 0x7fec54070d20 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec5ac85640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fec54070a40 con 0x7fec541629b0 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec540b2490 0x7fec54070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55228/0 (socket says 172.21.15.37:55228) 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4bfff640 1 -- 172.21.15.37:0/2210690159 learned_addr learned my addr 172.21.15.37:0/2210690159 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec58a21640 1 --2- 172.21.15.37:0/2210690159 >> v2:172.21.15.82:3300/0 conn(0x7fec541629b0 0x7fec5406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167623165 0 0) 0x7fec5406e110 con 0x7fec540b2490 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c003520 con 0x7fec540b2490 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 854530836 0 0) 0x7fec3c003520 con 0x7fec540b2490 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 >> v2:172.21.15.82:3300/0 conn(0x7fec541629b0 msgr2=0x7fec5406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 --2- 172.21.15.37:0/2210690159 >> v2:172.21.15.82:3300/0 conn(0x7fec541629b0 0x7fec5406eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 >> v1:172.21.15.82:6789/0 conn(0x7fec54070d20 legacy=0x7fec540afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5406e6d0 con 0x7fec540b2490 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.475+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fec44001670 con 0x7fec540b2490 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 >> v1:172.21.15.37:6789/0 conn(0x7fec540b2490 legacy=0x7fec54070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4b7fe640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec3c0039b0 0x7fec3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4b7fe640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c004800 0x7fec3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4b7fe640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec3c0051c0 0x7fec3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec54070a40 con 0x7fec3c0051c0 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c00c060 con 0x7fec3c004800 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fec3c00c260 con 0x7fec3c0039b0 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec59222640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec3c0051c0 0x7fec3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec4bfff640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c004800 0x7fec3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec58a21640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec3c0039b0 0x7fec3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec59222640 1 -- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec3c0039b0 msgr2=0x7fec3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec59222640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec3c0039b0 0x7fec3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec59222640 1 -- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c004800 msgr2=0x7fec3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec59222640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c004800 0x7fec3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.476+0000 7fec59222640 1 -- 172.21.15.37:0/2210690159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c003520 con 0x7fec3c0051c0 2024-05-10T08:49:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.477+0000 7fec59222640 1 -- 172.21.15.37:0/2210690159 reap_dead start 2024-05-10T08:49:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.477+0000 7fec59222640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec3c0051c0 0x7fec3c00b9c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fec4c001e50 tx=0x7fec3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514c50830d43a8db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.477+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c001a70 con 0x7fec3c0051c0 2024-05-10T08:49:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.477+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c003970 con 0x7fec3c0051c0 2024-05-10T08:49:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.477+0000 7fec4b7fe640 1 -- 172.21.15.37:0/2210690159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c003d60 con 0x7fec3c0051c0 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.477+0000 7fec5ac85640 1 -- 172.21.15.37:0/2210690159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec3c0051c0 msgr2=0x7fec3c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.477+0000 7fec5ac85640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec3c0051c0 0x7fec3c00b9c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fec4c001e50 tx=0x7fec3c005830 comp rx=0 tx=0).stop 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.478+0000 7fec5ac85640 1 -- 172.21.15.37:0/2210690159 shutdown_connections 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.478+0000 7fec5ac85640 1 --2- 172.21.15.37:0/2210690159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec3c0051c0 0x7fec3c00b9c0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.478+0000 7fec5ac85640 1 -- 172.21.15.37:0/2210690159 >> 172.21.15.37:0/2210690159 conn(0x7fec540b49d0 msgr2=0x7fec540b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.478+0000 7fec5ac85640 1 -- 172.21.15.37:0/2210690159 shutdown_connections 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.478+0000 7fec5ac85640 1 -- 172.21.15.37:0/2210690159 wait complete. 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.479+0000 7fec5ac85640 1 Processor -- start 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.479+0000 7fec5ac85640 1 -- start start 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec5ac85640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c0051c0 0x7fec540b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec5ac85640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec5414a970 0x7fec5414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec5ac85640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec540afd20 0x7fec540b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec5ac85640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec540711d0 con 0x7fec540afd20 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec5ac85640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec5406dec0 con 0x7fec3c0051c0 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec5ac85640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fec54071350 con 0x7fec5414a970 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec540afd20 0x7fec540b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec540afd20 0x7fec540b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48722/0 (socket says 172.21.15.37:48722) 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 -- 172.21.15.37:0/1653528059 learned_addr learned my addr 172.21.15.37:0/1653528059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec58a21640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c0051c0 0x7fec540b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec4bfff640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec5414a970 0x7fec5414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 -- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec5414a970 msgr2=0x7fec5414adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec5414a970 0x7fec5414adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 -- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c0051c0 msgr2=0x7fec540b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c0051c0 0x7fec540b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 -- 172.21.15.37:0/1653528059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec540b0a50 con 0x7fec540afd20 2024-05-10T08:49:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec58a21640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c0051c0 0x7fec540b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec4bfff640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec5414a970 0x7fec5414adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.480+0000 7fec59222640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec540afd20 0x7fec540b0180 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fec4c001f70 tx=0x7fec4c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.481+0000 7fec497fa640 1 -- 172.21.15.37:0/1653528059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c001a70 con 0x7fec540afd20 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.481+0000 7fec497fa640 1 -- 172.21.15.37:0/1653528059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c02ac70 con 0x7fec540afd20 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.481+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec540b0d30 con 0x7fec540afd20 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.481+0000 7fec497fa640 1 -- 172.21.15.37:0/1653528059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c006d70 con 0x7fec540afd20 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.481+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec540b12f0 con 0x7fec540afd20 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.482+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec540693f0 con 0x7fec540afd20 2024-05-10T08:49:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.482+0000 7fec497fa640 1 -- 172.21.15.37:0/1653528059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec4c007030 con 0x7fec540afd20 2024-05-10T08:49:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.483+0000 7fec497fa640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec40076300 0x7fec400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.483+0000 7fec497fa640 1 -- 172.21.15.37:0/1653528059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7fec4c0b7070 con 0x7fec540afd20 2024-05-10T08:49:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.483+0000 7fec58a21640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec40076300 0x7fec400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.484+0000 7fec58a21640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec40076300 0x7fec400787c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fec500093d0 tx=0x7fec50008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:54.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.488+0000 7fec497fa640 1 -- 172.21.15.37:0/1653528059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fec4c043060 con 0x7fec540afd20 2024-05-10T08:49:54.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.721+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec54161d20 con 0x7fec540afd20 2024-05-10T08:49:54.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.722+0000 7fec497fa640 1 -- 172.21.15.37:0/1653528059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5182 (secure 0 0 0) 0x7fec4c0806f0 con 0x7fec540afd20 2024-05-10T08:49:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:54.721 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":110,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:53.582633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":108,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.37:6835/1002841422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1002841422},{"type":"v1","addr":"172.21.15.37:6835","nonce":1002841422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-05-10T08:49:54.721 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 110 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec40076300 msgr2=0x7fec400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec40076300 0x7fec400787c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fec500093d0 tx=0x7fec50008040 comp rx=0 tx=0).stop 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec540afd20 msgr2=0x7fec540b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec540afd20 0x7fec540b0180 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fec4c001f70 tx=0x7fec4c0014a0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 shutdown_connections 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fec40076300 0x7fec400787c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec540afd20 0x7fec540b0180 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fec5414a970 0x7fec5414adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 --2- 172.21.15.37:0/1653528059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c0051c0 0x7fec540b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 >> 172.21.15.37:0/1653528059 conn(0x7fec540b49d0 msgr2=0x7fec5415fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 shutdown_connections 2024-05-10T08:49:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:54.724+0000 7fec5ac85640 1 -- 172.21.15.37:0/1653528059 wait complete. 2024-05-10T08:49:54.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:49:54.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:49:55.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 110, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:49:25.024575+0000', 'modified': '2024-05-10T08:49:53.582633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8433': {'gid': 8433, 'name': 'c', 'rank': 0, 'incarnation': 108, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.37:6835/1002841422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 1002841422}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 1002841422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-10T08:49:55.136 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8433:up:rejoin 2024-05-10T08:49:56.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:49:56.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.258+0000 7fe788179640 1 Processor -- start 2024-05-10T08:49:56.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.258+0000 7fe788179640 1 -- start start 2024-05-10T08:49:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.259+0000 7fe788179640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 0x7fe7800d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.259+0000 7fe788179640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7800d1760 con 0x7fe7800d3cd0 2024-05-10T08:49:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.259+0000 7fe788179640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7800d1a40 con 0x7fe7800d0cf0 2024-05-10T08:49:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.259+0000 7fe788179640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe7800d30f0 con 0x7fe78015f380 2024-05-10T08:49:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.259+0000 7fe786716640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe7800d3cd0 0x7fe7800b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55230/0 (socket says 172.21.15.37:55230) 2024-05-10T08:49:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.259+0000 7fe786716640 1 -- 172.21.15.37:0/2624726315 learned_addr learned my addr 172.21.15.37:0/2624726315 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe785f15640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 0x7fe7800d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399538002 0 0) 0x7fe7800d1760 con 0x7fe7800d3cd0 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe76c003520 con 0x7fe7800d3cd0 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758399376 0 0) 0x7fe7800d1a40 con 0x7fe7800d0cf0 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7800d1760 con 0x7fe7800d0cf0 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4184592548 0 0) 0x7fe76c003520 con 0x7fe7800d3cd0 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 msgr2=0x7fe7800d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 0x7fe7800d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 >> v1:172.21.15.82:6789/0 conn(0x7fe7800d0cf0 legacy=0x7fe7800d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7800d1d20 con 0x7fe7800d3cd0 2024-05-10T08:49:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7fe7780019f0 con 0x7fe7800d3cd0 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 >> v1:172.21.15.37:6789/0 conn(0x7fe7800d3cd0 legacy=0x7fe7800b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76c003b70 0x7fe76c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c004800 0x7fe76c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 0x7fe76c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7800d30f0 con 0x7fe76c003b70 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c00ba70 con 0x7fe76c004800 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe76c00bc70 con 0x7fe78015f380 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe785f15640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76c003b70 0x7fe76c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe785714640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c004800 0x7fe76c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.260+0000 7fe786716640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 0x7fe76c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.261+0000 7fe785f15640 1 -- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 msgr2=0x7fe76c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.261+0000 7fe785f15640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe78015f380 0x7fe76c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.261+0000 7fe785f15640 1 -- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c004800 msgr2=0x7fe76c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.261+0000 7fe785f15640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c004800 0x7fe76c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.261+0000 7fe785f15640 1 -- 172.21.15.37:0/2624726315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c003520 con 0x7fe76c003b70 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.261+0000 7fe785f15640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76c003b70 0x7fe76c003f70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009ac0 tx=0x7fe76c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e582e79457100f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.261+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c036070 con 0x7fe76c003b70 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c031400 con 0x7fe76c003b70 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe784f13640 1 -- 172.21.15.37:0/2624726315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c009690 con 0x7fe76c003b70 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe788179640 1 -- 172.21.15.37:0/2624726315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76c003b70 msgr2=0x7fe76c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe788179640 1 --2- 172.21.15.37:0/2624726315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76c003b70 0x7fe76c003f70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009ac0 tx=0x7fe76c005830 comp rx=0 tx=0).stop 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe786716640 1 -- 172.21.15.37:0/2624726315 reap_dead start 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe788179640 1 -- 172.21.15.37:0/2624726315 shutdown_connections 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe788179640 1 -- 172.21.15.37:0/2624726315 >> 172.21.15.37:0/2624726315 conn(0x7fe7800d4fe0 msgr2=0x7fe7800d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe788179640 1 -- 172.21.15.37:0/2624726315 shutdown_connections 2024-05-10T08:49:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.262+0000 7fe788179640 1 -- 172.21.15.37:0/2624726315 wait complete. 2024-05-10T08:49:56.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.263+0000 7fe788179640 1 Processor -- start 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe788179640 1 -- start start 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe788179640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c003b70 0x7fe7801586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe788179640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe780157bf0 0x7fe78015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe788179640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7801f50b0 0x7fe7800cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe788179640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7800d2370 con 0x7fe7801f50b0 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe788179640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe78015f760 con 0x7fe76c003b70 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe788179640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe7800d2800 con 0x7fe780157bf0 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe786716640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7801f50b0 0x7fe7800cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe786716640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7801f50b0 0x7fe7800cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48742/0 (socket says 172.21.15.37:48742) 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.264+0000 7fe786716640 1 -- 172.21.15.37:0/1589220751 learned_addr learned my addr 172.21.15.37:0/1589220751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe785f15640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c003b70 0x7fe7801586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe785714640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe780157bf0 0x7fe78015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe786716640 1 -- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe780157bf0 msgr2=0x7fe78015b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe786716640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe780157bf0 0x7fe78015b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe786716640 1 -- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c003b70 msgr2=0x7fe7801586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe786716640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c003b70 0x7fe7801586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe786716640 1 -- 172.21.15.37:0/1589220751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7801584d0 con 0x7fe7801f50b0 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe785f15640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c003b70 0x7fe7801586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe785714640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe780157bf0 0x7fe78015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe786716640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7801f50b0 0x7fe7800cace0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe778007970 tx=0x7fe77800a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe7767fc640 1 -- 172.21.15.37:0/1589220751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77800ac30 con 0x7fe7801f50b0 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe7767fc640 1 -- 172.21.15.37:0/1589220751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe778018070 con 0x7fe7801f50b0 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78015bdd0 con 0x7fe7801f50b0 2024-05-10T08:49:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe7767fc640 1 -- 172.21.15.37:0/1589220751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7780133f0 con 0x7fe7801f50b0 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.265+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7800cd920 con 0x7fe7801f50b0 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.266+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7800693f0 con 0x7fe7801f50b0 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.267+0000 7fe7767fc640 1 -- 172.21.15.37:0/1589220751 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe778013590 con 0x7fe7801f50b0 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.267+0000 7fe7767fc640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7640762d0 0x7fe764078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.268+0000 7fe7767fc640 1 -- 172.21.15.37:0/1589220751 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7fe778097d80 con 0x7fe7801f50b0 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.268+0000 7fe785f15640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7640762d0 0x7fe764078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.268+0000 7fe785f15640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7640762d0 0x7fe764078790 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe77c033000 tx=0x7fe77c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.272+0000 7fe7767fc640 1 -- 172.21.15.37:0/1589220751 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe7780615f0 con 0x7fe7801f50b0 2024-05-10T08:49:56.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.501+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe78008cfd0 con 0x7fe7801f50b0 2024-05-10T08:49:56.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.501+0000 7fe7767fc640 1 -- 172.21.15.37:0/1589220751 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+5189 (secure 0 0 0) 0x7fe778060ef0 con 0x7fe7801f50b0 2024-05-10T08:49:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:49:56.500 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:55.588583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/1002841422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1002841422},{"type":"v1","addr":"172.21.15.37:6835","nonce":1002841422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8433,"qdb_cluster":[8433]},"id":8}]} 2024-05-10T08:49:56.500 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 111 2024-05-10T08:49:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7640762d0 msgr2=0x7fe764078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7640762d0 0x7fe764078790 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe77c033000 tx=0x7fe77c008030 comp rx=0 tx=0).stop 2024-05-10T08:49:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7801f50b0 msgr2=0x7fe7800cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7801f50b0 0x7fe7800cace0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe778007970 tx=0x7fe77800a600 comp rx=0 tx=0).stop 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 shutdown_connections 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe7640762d0 0x7fe764078790 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7801f50b0 0x7fe7800cace0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe780157bf0 0x7fe78015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 --2- 172.21.15.37:0/1589220751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c003b70 0x7fe7801586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 >> 172.21.15.37:0/1589220751 conn(0x7fe7800d4fe0 msgr2=0x7fe7800b8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 shutdown_connections 2024-05-10T08:49:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:56.503+0000 7fe788179640 1 -- 172.21.15.37:0/1589220751 wait complete. 2024-05-10T08:49:56.566 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-10T08:49:56.567+0000 7f6855796640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:49:56.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T08:49:25.024575+0000', 'modified': '2024-05-10T08:49:55.588583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8433': {'gid': 8433, 'name': 'c', 'rank': 0, 'incarnation': 108, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6835/1002841422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 1002841422}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 1002841422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8433, 'qdb_cluster': [8433]} 2024-05-10T08:49:56.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T08:49:56.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T08:49:57.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.027+0000 7eff606a2640 1 Processor -- start 2024-05-10T08:49:57.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.027+0000 7eff606a2640 1 -- start start 2024-05-10T08:49:57.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff606a2640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff581629b0 0x7eff5806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff606a2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff580b2490 0x7eff58070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff606a2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5806e110 con 0x7eff58070d20 2024-05-10T08:49:57.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff606a2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7eff5806dec0 con 0x7eff580b2490 2024-05-10T08:49:57.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff606a2640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7eff5806e3f0 con 0x7eff581629b0 2024-05-10T08:49:57.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff5dc3d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff580b2490 0x7eff58070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff5ec3f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7eff58070d20 0x7eff580afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55240/0 (socket says 172.21.15.37:55240) 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff5dc3d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff580b2490 0x7eff58070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48748/0 (socket says 172.21.15.37:48748) 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.028+0000 7eff5ec3f640 1 -- 172.21.15.37:0/644094000 learned_addr learned my addr 172.21.15.37:0/644094000 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.029+0000 7eff5e43e640 1 --2- 172.21.15.37:0/644094000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff581629b0 0x7eff5806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.029+0000 7eff5dc3d640 1 -- 172.21.15.37:0/644094000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff581629b0 msgr2=0x7eff5806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.029+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/644094000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff581629b0 0x7eff5806eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.029+0000 7eff5dc3d640 1 -- 172.21.15.37:0/644094000 >> v1:172.21.15.37:6789/0 conn(0x7eff58070d20 legacy=0x7eff580afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.029+0000 7eff5d43c640 1 -- 172.21.15.37:0/644094000 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324712555 0 0) 0x7eff5806e110 con 0x7eff58070d20 2024-05-10T08:49:57.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.029+0000 7eff5dc3d640 1 -- 172.21.15.37:0/644094000 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5806e6d0 con 0x7eff580b2490 2024-05-10T08:49:57.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.029+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/644094000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff580b2490 0x7eff58070330 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0097a0 tx=0x7eff4c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bc5782f13d16c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff5d43c640 1 -- 172.21.15.37:0/644094000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c037070 con 0x7eff580b2490 2024-05-10T08:49:57.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff5d43c640 1 -- 172.21.15.37:0/644094000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c032440 con 0x7eff580b2490 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff5d43c640 1 -- 172.21.15.37:0/644094000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c032810 con 0x7eff580b2490 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 -- 172.21.15.37:0/644094000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff580b2490 msgr2=0x7eff58070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 --2- 172.21.15.37:0/644094000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff580b2490 0x7eff58070330 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0097a0 tx=0x7eff4c02a180 comp rx=0 tx=0).stop 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 -- 172.21.15.37:0/644094000 shutdown_connections 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 --2- 172.21.15.37:0/644094000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff580b2490 0x7eff58070330 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 --2- 172.21.15.37:0/644094000 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff581629b0 0x7eff5806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 -- 172.21.15.37:0/644094000 >> 172.21.15.37:0/644094000 conn(0x7eff580b49d0 msgr2=0x7eff580b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 -- 172.21.15.37:0/644094000 shutdown_connections 2024-05-10T08:49:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.030+0000 7eff606a2640 1 -- 172.21.15.37:0/644094000 wait complete. 2024-05-10T08:49:57.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.031+0000 7eff606a2640 1 Processor -- start 2024-05-10T08:49:57.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.031+0000 7eff606a2640 1 -- start start 2024-05-10T08:49:57.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff606a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58070d20 0x7eff580ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff606a2640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff580b2490 0x7eff581f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff606a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff581629b0 0x7eff581f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff606a2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff58070870 con 0x7eff581629b0 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff606a2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff5806f410 con 0x7eff58070d20 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff606a2640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7eff580709f0 con 0x7eff580b2490 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff5ec3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff581629b0 0x7eff581f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff5ec3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff581629b0 0x7eff581f8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48758/0 (socket says 172.21.15.37:48758) 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1322551700 learned_addr learned my addr 172.21.15.37:0/1322551700 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff5e43e640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58070d20 0x7eff580ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.032+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff580b2490 0x7eff581f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff580b2490 msgr2=0x7eff581f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff580b2490 0x7eff581f8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58070d20 msgr2=0x7eff580ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58070d20 0x7eff580ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1322551700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff580cf190 con 0x7eff581629b0 2024-05-10T08:49:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff581629b0 0x7eff581f8980 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c480 tx=0x7eff5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff56ffd640 1 -- 172.21.15.37:0/1322551700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50018070 con 0x7eff581629b0 2024-05-10T08:49:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff56ffd640 1 -- 172.21.15.37:0/1322551700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff50007500 con 0x7eff581629b0 2024-05-10T08:49:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff580cf470 con 0x7eff581629b0 2024-05-10T08:49:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff56ffd640 1 -- 172.21.15.37:0/1322551700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50004a20 con 0x7eff581629b0 2024-05-10T08:49:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.033+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff580cfa30 con 0x7eff581629b0 2024-05-10T08:49:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.035+0000 7eff56ffd640 1 -- 172.21.15.37:0/1322551700 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff5001b070 con 0x7eff581629b0 2024-05-10T08:49:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.035+0000 7eff56ffd640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7eff44076300 0x7eff440787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.035+0000 7eff56ffd640 1 -- 172.21.15.37:0/1322551700 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7eff50096a90 con 0x7eff581629b0 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.035+0000 7eff5e43e640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7eff44076300 0x7eff440787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.036+0000 7eff633bd740 1 Processor -- start 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.036+0000 7eff5e43e640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7eff44076300 0x7eff440787c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7eff480070b0 tx=0x7eff48007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.036+0000 7eff633bd740 1 -- start start 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a28760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a28ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff633bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557659f8bb0 0x5557659fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff633bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5557659628d0 con 0x5557659f8bb0 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55576591bc10 con 0x555765a26330 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55576595e890 con 0x555765a25f50 2024-05-10T08:49:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557659f8bb0 0x5557659fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5e43e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a28760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557659f8bb0 0x5557659fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48774/0 (socket says 172.21.15.37:48774) 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1783548634 learned_addr learned my addr 172.21.15.37:0/1783548634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a28ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1783548634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 msgr2=0x555765a28760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a28760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1783548634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 msgr2=0x555765a28ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a28ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 -- 172.21.15.37:0/1783548634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557659235d0 con 0x5557659f8bb0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557659f8bb0 0x5557659fc3c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7eff5005fad0 tx=0x7eff5005f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1a513d012f6aca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff3ffff640 1 -- 172.21.15.37:0/1783548634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5005fb40 con 0x5557659f8bb0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff3ffff640 1 -- 172.21.15.37:0/1783548634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff50063ef0 con 0x5557659f8bb0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.037+0000 7eff3ffff640 1 -- 172.21.15.37:0/1783548634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50068910 con 0x5557659f8bb0 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 -- 172.21.15.37:0/1783548634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557659f8bb0 msgr2=0x5557659fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557659f8bb0 0x5557659fc3c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7eff5005fad0 tx=0x7eff5005f370 comp rx=0 tx=0).stop 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 -- 172.21.15.37:0/1783548634 shutdown_connections 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557659f8bb0 0x5557659fc3c0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a28ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 --2- 172.21.15.37:0/1783548634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a28760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 -- 172.21.15.37:0/1783548634 >> 172.21.15.37:0/1783548634 conn(0x5557659fae20 msgr2=0x555765a43760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 -- 172.21.15.37:0/1783548634 shutdown_connections 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.038+0000 7eff633bd740 1 -- 172.21.15.37:0/1783548634 wait complete. 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.039+0000 7eff633bd740 1 -- start start 2024-05-10T08:49:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.039+0000 7eff633bd740 1 Processor -- start 2024-05-10T08:49:57.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff633bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a45ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a1f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x555765a1fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff633bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5557659628d0 con 0x555765a25f50 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55576591f760 con 0x555765a26330 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x5557659fdfd0 con 0x555765a1f6f0 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff633bd740 10 client.0 _ll_register_callbacks cb 0x555765958cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a45ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a45ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48778/0 (socket says 172.21.15.37:48778) 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 -- 172.21.15.37:0/1430199413 learned_addr learned my addr 172.21.15.37:0/1430199413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a1f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x555765a1fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 -- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 msgr2=0x555765a1fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x555765a1fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 -- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 msgr2=0x555765a1f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a1f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 -- 172.21.15.37:0/1430199413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557656742d0 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a1f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x555765a1fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff5e43e640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a45ce0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7eff48004410 tx=0x7eff48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6152eb20904b44f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.040+0000 7eff3d7fa640 1 -- 172.21.15.37:0/1430199413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48024020 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff3d7fa640 1 -- 172.21.15.37:0/1430199413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7eff48011c00 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff50063ef0 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff3d7fa640 1 -- 172.21.15.37:0/1430199413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7eff4802e050 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 10 client.8520 fetch_fsmap learned FSMap version 111 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) -- 0x55576573e6b0 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff3d7fa640 1 -- 172.21.15.37:0/1430199413 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff50063ef0 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff3d7fa640 1 -- 172.21.15.37:0/1430199413 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 111) ==== 3494+0+0 (secure 0 0 0) 0x7eff48031020 con 0x555765a25f50 2024-05-10T08:49:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 10 client.8520 fetch_fsmap finished waiting for FSMap version 111 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 10 client.8520 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 20 client.8520 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a2bb90 0x555765a2bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 4 client.8520 mds_command: new command op to 8433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 --> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557658e6760 con 0x555765a2bb90 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a2bb90 0x555765a2bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff3d7fa640 10 client.8520 ms_handle_connect on v2:172.21.15.37:6833/1002841422 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.041+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a2bb90 0x555765a2bf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0f571d1604bc78 server_cookie=bd09960b0c9010ec in_seq=0 out_seq=0 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff3d7fa640 1 -- 172.21.15.37:0/1430199413 <== mds.0 v2:172.21.15.37:6833/1002841422 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5557658e6760 con 0x555765a2bb90 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff3d7fa640 10 client.8520 handle_command_reply: tid=0 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 client.8520 shutdown 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 msgr2=0x555765a45ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a45ce0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7eff48004410 tx=0x7eff48004a40 comp rx=0 tx=0).stop 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 shutdown_connections 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x555765a1fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a1f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a2bb90 0x555765a2bf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 --2- 172.21.15.37:0/1430199413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a45ce0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff3d7fa640 0 client.8520 ms_handle_reset on v2:172.21.15.37:6833/1002841422 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 >> 172.21.15.37:0/1430199413 conn(0x5557659f8bb0 msgr2=0x555765a207c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 shutdown_connections 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.042+0000 7eff633bd740 1 -- 172.21.15.37:0/1430199413 wait complete. 2024-05-10T08:49:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.043+0000 7eff633bd740 20 client.8520 trim_cache size 0 max 16384 2024-05-10T08:49:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.061+0000 7eff633bd740 1 Processor -- start 2024-05-10T08:49:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.061+0000 7eff633bd740 1 -- start start 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x5557659f7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff633bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a25800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff633bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff58201f90 con 0x555765a25f50 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff580b8780 con 0x555765a26330 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7eff580b6f00 con 0x555765a1f6f0 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48788/0 (socket says 172.21.15.37:48788) 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 -- 172.21.15.37:0/4238649835 learned_addr learned my addr 172.21.15.37:0/4238649835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a25800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5e43e640 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x5557659f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 -- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 msgr2=0x5557659f7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x5557659f7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 -- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 msgr2=0x555765a25800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a25800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5dc3d640 1 -- 172.21.15.37:0/4238649835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555765a488d0 con 0x555765a25f50 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5e43e640 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x5557659f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.062+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a25800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a252c0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7eff4c02a770 tx=0x7eff4c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9093081187a3a966 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff3f7fe640 1 -- 172.21.15.37:0/4238649835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c037040 con 0x555765a25f50 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff3f7fe640 1 -- 172.21.15.37:0/4238649835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c004380 con 0x555765a25f50 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff3f7fe640 1 -- 172.21.15.37:0/4238649835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c032a80 con 0x555765a25f50 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 -- 172.21.15.37:0/4238649835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 msgr2=0x555765a252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a252c0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7eff4c02a770 tx=0x7eff4c02c000 comp rx=0 tx=0).stop 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 -- 172.21.15.37:0/4238649835 shutdown_connections 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a25800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a25f50 0x555765a252c0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 --2- 172.21.15.37:0/4238649835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a1f6f0 0x5557659f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 -- 172.21.15.37:0/4238649835 >> 172.21.15.37:0/4238649835 conn(0x5557659f8bb0 msgr2=0x555765a43760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.063+0000 7eff633bd740 1 -- 172.21.15.37:0/4238649835 shutdown_connections 2024-05-10T08:49:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.064+0000 7eff633bd740 1 -- 172.21.15.37:0/4238649835 wait complete. 2024-05-10T08:49:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.064+0000 7eff633bd740 1 -- start start 2024-05-10T08:49:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.064+0000 7eff633bd740 1 Processor -- start 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff633bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a1f6f0 0x555765a1afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a2c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff633bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a252a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff633bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555765a46270 con 0x555765a1f6f0 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff580b8130 con 0x555765a26330 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff633bd740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x555765a46da0 con 0x555765a25f50 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff633bd740 10 client.0 _ll_register_callbacks cb 0x7eff4800ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a1f6f0 0x555765a1afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a1f6f0 0x555765a1afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48798/0 (socket says 172.21.15.37:48798) 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 -- 172.21.15.37:0/482492628 learned_addr learned my addr 172.21.15.37:0/482492628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5ec3f640 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a2c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 -- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 msgr2=0x555765a2c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a2c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 -- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 msgr2=0x555765a252a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a252a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.065+0000 7eff5e43e640 1 -- 172.21.15.37:0/482492628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555765a42d70 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff5e43e640 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a1f6f0 0x555765a1afa0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7eff4800ebd0 tx=0x7eff48013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d401119dd4565ba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff3d7fa640 1 -- 172.21.15.37:0/482492628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48024040 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff3d7fa640 1 -- 172.21.15.37:0/482492628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7eff48009040 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff4c004380 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff3d7fa640 1 -- 172.21.15.37:0/482492628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7eff48040050 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 10 client.8526 fetch_fsmap learned FSMap version 111 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) -- 0x555765a42a90 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff3d7fa640 1 -- 172.21.15.37:0/482492628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c004380 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff3d7fa640 1 -- 172.21.15.37:0/482492628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 111) ==== 3494+0+0 (secure 0 0 0) 0x7eff48043020 con 0x555765a1f6f0 2024-05-10T08:49:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 10 client.8526 fetch_fsmap finished waiting for FSMap version 111 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 10 client.8526 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 20 client.8526 populate_metadata read hostname 'smithi037' 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a257e0 0x555765a55420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 4 client.8526 mds_command: new command op to 8433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 --> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] -- command(tid 0: {"prefix": "status"}) -- 0x5557659704e0 con 0x555765a257e0 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.066+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a257e0 0x555765a55420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff3d7fa640 10 client.8526 ms_handle_connect on v2:172.21.15.37:6833/1002841422 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff5dc3d640 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a257e0 0x555765a55420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3e61a275fe8ddb4 server_cookie=91dd90a58b12e181 in_seq=0 out_seq=0 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff3d7fa640 1 -- 172.21.15.37:0/482492628 <== mds.0 v2:172.21.15.37:6833/1002841422 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5557659704e0 con 0x555765a257e0 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff3d7fa640 10 client.8526 handle_command_reply: tid=0 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 client.8526 shutdown 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a1f6f0 msgr2=0x555765a1afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a1f6f0 0x555765a1afa0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7eff4800ebd0 tx=0x7eff48013000 comp rx=0 tx=0).stop 2024-05-10T08:49:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 shutdown_connections 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555765a26330 0x555765a252a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x555765a25f50 0x555765a2c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:6833/1002841422,v1:172.21.15.37:6835/1002841422] conn(0x555765a257e0 0x555765a55420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 --2- 172.21.15.37:0/482492628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555765a1f6f0 0x555765a1afa0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 >> 172.21.15.37:0/482492628 conn(0x5557659f8bb0 msgr2=0x5557659ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff3d7fa640 0 client.8526 ms_handle_reset on v2:172.21.15.37:6833/1002841422 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 shutdown_connections 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 1 -- 172.21.15.37:0/482492628 wait complete. 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.067+0000 7eff633bd740 20 client.8526 trim_cache size 0 max 16384 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "5ef49677-880e-4a90-bdff-f8e0a7cb5aaa", 2024-05-10T08:49:57.072 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8433, 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.4961355799999998, 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 111, 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 119, 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 119, 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 6.4731177720000002 2024-05-10T08:49:57.073 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:49:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7eff44076300 msgr2=0x7eff440787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7eff44076300 0x7eff440787c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7eff480070b0 tx=0x7eff48007040 comp rx=0 tx=0).stop 2024-05-10T08:49:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff581629b0 msgr2=0x7eff581f8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff581629b0 0x7eff581f8980 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c480 tx=0x7eff5000c940 comp rx=0 tx=0).stop 2024-05-10T08:49:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 shutdown_connections 2024-05-10T08:49:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7eff44076300 0x7eff440787c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff581629b0 0x7eff581f8980 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff580b2490 0x7eff581f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 --2- 172.21.15.37:0/1322551700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58070d20 0x7eff580ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 >> 172.21.15.37:0/1322551700 conn(0x7eff580b49d0 msgr2=0x7eff580d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 shutdown_connections 2024-05-10T08:49:57.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.068+0000 7eff606a2640 1 -- 172.21.15.37:0/1322551700 wait complete. 2024-05-10T08:49:57.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T08:49:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.182+0000 7f136e751640 1 Processor -- start 2024-05-10T08:49:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.183+0000 7f136e751640 1 -- start start 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.183+0000 7f136e751640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680d3cd0 0x7f13680cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.183+0000 7f136e751640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13680c9ee0 0x7f13680d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.183+0000 7f136e751640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13680d3330 con 0x7f13681629a0 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.183+0000 7f136e751640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f13680d2170 con 0x7f13680c9ee0 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.183+0000 7f136e751640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f13680d2450 con 0x7f13680d3cd0 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f1367fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f13681629a0 0x7f13680d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55256/0 (socket says 172.21.15.37:55256) 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f1367fff640 1 -- 172.21.15.37:0/2451862313 learned_addr learned my addr 172.21.15.37:0/2451862313 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f136ccee640 1 --2- 172.21.15.37:0/2451862313 >> v2:172.21.15.82:3300/0 conn(0x7f13680c9ee0 0x7f13680d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f135ffff640 1 --2- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680d3cd0 0x7f13680cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f13677fe640 1 -- 172.21.15.37:0/2451862313 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513715366 0 0) 0x7f13680d3330 con 0x7f13681629a0 2024-05-10T08:49:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f13677fe640 1 -- 172.21.15.37:0/2451862313 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1354003520 con 0x7f13681629a0 2024-05-10T08:49:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f136ccee640 1 -- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680d3cd0 msgr2=0x7f13680cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f136ccee640 1 --2- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680d3cd0 0x7f13680cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f13677fe640 1 -- 172.21.15.37:0/2451862313 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 352561890 0 0) 0x7f1354003520 con 0x7f13681629a0 2024-05-10T08:49:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f136ccee640 1 -- 172.21.15.37:0/2451862313 >> v1:172.21.15.37:6789/0 conn(0x7f13681629a0 legacy=0x7f13680d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.184+0000 7f136ccee640 1 -- 172.21.15.37:0/2451862313 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13680d2730 con 0x7f13680c9ee0 2024-05-10T08:49:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.185+0000 7f136ccee640 1 --2- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680c9ee0 0x7f13680d01e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1360009d90 tx=0x7f136002a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=facb946cabd081e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.185+0000 7f13677fe640 1 -- 172.21.15.37:0/2451862313 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358001670 con 0x7f13680c9ee0 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.185+0000 7f13677fe640 1 -- 172.21.15.37:0/2451862313 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1360007540 con 0x7f13680c9ee0 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.185+0000 7f13677fe640 1 -- 172.21.15.37:0/2451862313 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360007910 con 0x7f13680c9ee0 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 -- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680c9ee0 msgr2=0x7f13680d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 --2- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680c9ee0 0x7f13680d01e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1360009d90 tx=0x7f136002a4d0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 -- 172.21.15.37:0/2451862313 shutdown_connections 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 --2- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680c9ee0 0x7f13680d01e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 --2- 172.21.15.37:0/2451862313 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680d3cd0 0x7f13680cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 -- 172.21.15.37:0/2451862313 >> 172.21.15.37:0/2451862313 conn(0x7f13680d4fe0 msgr2=0x7f13680d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 -- 172.21.15.37:0/2451862313 shutdown_connections 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.186+0000 7f136e751640 1 -- 172.21.15.37:0/2451862313 wait complete. 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.187+0000 7f136e751640 1 Processor -- start 2024-05-10T08:49:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.187+0000 7f136e751640 1 -- start start 2024-05-10T08:49:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136e751640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680c9ee0 0x7f13680cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136e751640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13680d3cd0 0x7f136806e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136e751640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13681629a0 0x7f136806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136e751640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13680cf440 con 0x7f13680d3cd0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136e751640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f13680cf2c0 con 0x7f13681629a0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136e751640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f13680d2dc0 con 0x7f13680c9ee0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13680d3cd0 0x7f136806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13680d3cd0 0x7f136806e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48812/0 (socket says 172.21.15.37:48812) 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 -- 172.21.15.37:0/1461504064 learned_addr learned my addr 172.21.15.37:0/1461504064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136ccee640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13681629a0 0x7f136806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f1367fff640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680c9ee0 0x7f13680cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 -- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680c9ee0 msgr2=0x7f13680cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680c9ee0 0x7f13680cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 -- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13681629a0 msgr2=0x7f136806e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13681629a0 0x7f136806e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 -- 172.21.15.37:0/1461504064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13680cc690 con 0x7f13680d3cd0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f135ffff640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13680d3cd0 0x7f136806e040 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f135000e9e0 tx=0x7f135000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f13657fa640 1 -- 172.21.15.37:0/1461504064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350017070 con 0x7f13680d3cd0 2024-05-10T08:49:57.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f13657fa640 1 -- 172.21.15.37:0/1461504064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135000c9d0 con 0x7f13680d3cd0 2024-05-10T08:49:57.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13680cc970 con 0x7f13680d3cd0 2024-05-10T08:49:57.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.188+0000 7f13657fa640 1 -- 172.21.15.37:0/1461504064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135000cdc0 con 0x7f13680d3cd0 2024-05-10T08:49:57.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.189+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13680ccf30 con 0x7f13680d3cd0 2024-05-10T08:49:57.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.190+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13680693f0 con 0x7f13680d3cd0 2024-05-10T08:49:57.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.190+0000 7f13657fa640 1 -- 172.21.15.37:0/1461504064 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f135001a070 con 0x7f13680d3cd0 2024-05-10T08:49:57.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.191+0000 7f13657fa640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13480762d0 0x7f1348078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:57.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.191+0000 7f13657fa640 1 -- 172.21.15.37:0/1461504064 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f1350097b40 con 0x7f13680d3cd0 2024-05-10T08:49:57.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.191+0000 7f1367fff640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13480762d0 0x7f1348078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:57.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.192+0000 7f1367fff640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13480762d0 0x7f1348078790 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1358005880 tx=0x7f13580057f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:57.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.195+0000 7f13657fa640 1 -- 172.21.15.37:0/1461504064 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1350060c10 con 0x7f13680d3cd0 2024-05-10T08:49:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.429+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1368160420 con 0x7f13680d3cd0 2024-05-10T08:49:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.429+0000 7f13657fa640 1 -- 172.21.15.37:0/1461504064 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v111) ==== 53+0+73 (secure 0 0 0) 0x7f1350064f10 con 0x7f13680d3cd0 2024-05-10T08:49:57.428 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T08:49:57.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13480762d0 msgr2=0x7f1348078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13480762d0 0x7f1348078790 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1358005880 tx=0x7f13580057f0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13680d3cd0 msgr2=0x7f136806e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13680d3cd0 0x7f136806e040 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f135000e9e0 tx=0x7f135000eea0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 shutdown_connections 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f13480762d0 0x7f1348078790 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13681629a0 0x7f136806e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13680d3cd0 0x7f136806e040 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 --2- 172.21.15.37:0/1461504064 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f13680c9ee0 0x7f13680cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 >> 172.21.15.37:0/1461504064 conn(0x7f13680d4fe0 msgr2=0x7f13680b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 shutdown_connections 2024-05-10T08:49:57.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57.431+0000 7f136e751640 1 -- 172.21.15.37:0/1461504064 wait complete. 2024-05-10T08:49:57.441 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T08:49:57.441 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T08:49:57.441 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-10T08:49:57.441 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T08:49:57.441 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:57.442 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T08:49:57.442 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T08:49:57.442 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T08:49:57.442 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:57.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:57.442 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-10T08:49:57.458 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T08:49:57.458 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T08:49:57.458 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T08:49:57.458 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42164sec preferred_lft 42164sec 2024-05-10T08:49:57.459 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4448:c9ff:fee7:be9d/64 scope link 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether ba:f8:ef:48:c4:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b8f8:efff:fe48:c4b3/64 scope link 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:57.460 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T08:49:57.461 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 9a:4b:e5:d2:a7:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:49:57.461 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::984b:e5ff:fed2:a7eb/64 scope link 2024-05-10T08:49:57.461 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-10T08:49:57.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:57.461 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T08:49:57.523 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:49:57.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:57.524 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-10T08:49:57.581 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-10T08:49:57.582 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T08:49:57.582 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T08:49:57.582 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T08:49:57.582 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T08:49:57.582 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T08:49:57.582 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-10T08:49:57.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T08:49:57.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T08:49:57.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T08:49:57.583 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-10T08:49:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T08:49:57.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:57.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:57.713 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:49:57.729 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:49:57.729 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:49:57.729 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:57.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:57.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-10T08:49:57.796 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:57.796 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:57.851 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T08:49:57.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T08:49:57.852 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:57.907 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T08:49:57.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:57.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:57.992 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:57.992 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:57.992 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:58.001 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:58.001 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:58.001 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:58.001 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:58.001 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:58.006 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T08:49:58.006 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T08:49:58.006 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-05-10T08:49:58.006 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-05-10T08:49:58.006 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ef49677-880e-4a90-bdff-f8e0a7cb5aaa" will pass to kernel 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T08:49:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T08:49:58.008 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T08:49:58.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:58.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:58.034 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T08:49:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T08:49:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:58.132 INFO:teuthology.orchestra.run.smithi037.stdout:client8535 2024-05-10T08:49:58.132 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:58.132 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:58.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:58.149 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-05-10T08:49:58.208 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2024-05-10T08:49:58.208 INFO:teuthology.orchestra.run.smithi037.stdout:./parent 2024-05-10T08:49:58.209 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed 2024-05-10T08:49:58.209 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/charlie 2024-05-10T08:49:58.209 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/alpha 2024-05-10T08:49:58.209 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/bravo 2024-05-10T08:49:58.209 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed 2024-05-10T08:49:58.209 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed/jfile 2024-05-10T08:49:58.210 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:58.210 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:58.210 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:58.210 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:58.210 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-05-10T08:49:58.210 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:58.318 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-10T08:49:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:58.327 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:58.327 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:58.327 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:58.327 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:58.327 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-05-10T08:49:58.327 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:58.434 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2024-05-10T08:49:58.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:58.443 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:58.443 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:58.443 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:58.444 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:58.444 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-05-10T08:49:58.444 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:58.551 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2024-05-10T08:49:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:58.560 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:58.560 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:58.560 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:58.560 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:58.560 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-05-10T08:49:58.560 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:58.668 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2024-05-10T08:49:58.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:58.677 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:58.677 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:58.677 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:58.678 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:58.678 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-05-10T08:49:58.678 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:58.785 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2024-05-10T08:49:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:58.794 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:58.794 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:58.794 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:58.794 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:58.794 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-05-10T08:49:58.794 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:58.903 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628279 2024-05-10T08:49:58.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:58.912 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:58.913 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:58.913 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:58.913 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:58.913 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-05-10T08:49:58.913 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:59.020 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627779 2024-05-10T08:49:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:59.029 DEBUG:teuthology.orchestra.run.smithi037:> stdin-killer -- python3 -c ' 2024-05-10T08:49:59.030 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-05-10T08:49:59.030 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2024-05-10T08:49:59.030 DEBUG:teuthology.orchestra.run.smithi037:> 2024-05-10T08:49:59.030 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-05-10T08:49:59.030 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-05-10T08:49:59.137 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627780 2024-05-10T08:49:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T08:49:59.146 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T08:49:59.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:49:59.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T08:49:59.270 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T08:49:59.270 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:59.270 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:59.270 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:59.286 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:59.286 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:59.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T08:49:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.490+0000 7f76a92a7640 1 Processor -- start 2024-05-10T08:49:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.490+0000 7f76a92a7640 1 -- start start 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a92a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76a415f420 0x7f76a40d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a92a7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76a40d2080 0x7f76a40d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a92a7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a41630b0 con 0x7f76a40d3ca0 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a92a7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f76a40d2550 con 0x7f76a415f420 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a92a7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f76a40d2c80 con 0x7f76a40d2080 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76a415f420 0x7f76a40d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f769bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f76a40d3ca0 0x7f76a40d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40330/0 (socket says 172.21.15.37:40330) 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f769bfff640 1 -- 172.21.15.37:0/2861770232 learned_addr learned my addr 172.21.15.37:0/2861770232 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:49:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a37fe640 1 --2- 172.21.15.37:0/2861770232 >> v2:172.21.15.82:3300/0 conn(0x7f76a40d2080 0x7f76a40d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a2ffd640 1 -- 172.21.15.37:0/2861770232 >> v2:172.21.15.82:3300/0 conn(0x7f76a40d2080 msgr2=0x7f76a40d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:49:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a2ffd640 1 --2- 172.21.15.37:0/2861770232 >> v2:172.21.15.82:3300/0 conn(0x7f76a40d2080 0x7f76a40d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a2ffd640 1 -- 172.21.15.37:0/2861770232 >> v1:172.21.15.37:6789/0 conn(0x7f76a40d3ca0 legacy=0x7f76a40d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a2ffd640 1 -- 172.21.15.37:0/2861770232 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a40d2f60 con 0x7f76a415f420 2024-05-10T08:49:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a27fc640 1 -- 172.21.15.37:0/2861770232 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887545861 0 0) 0x7f768c001110 con 0x7f76a40d3ca0 2024-05-10T08:49:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.491+0000 7f76a37fe640 1 --2- 172.21.15.37:0/2861770232 >> v2:172.21.15.82:3300/0 conn(0x7f76a40d2080 0x7f76a40d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:49:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.492+0000 7f76a2ffd640 1 --2- 172.21.15.37:0/2861770232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a415f420 0x7f76a40d3760 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f76a40d5e90 tx=0x7f769402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb35e2f710bbc3cd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.492+0000 7f76a27fc640 1 -- 172.21.15.37:0/2861770232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694037070 con 0x7f76a415f420 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.492+0000 7f76a27fc640 1 -- 172.21.15.37:0/2861770232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7694032440 con 0x7f76a415f420 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.492+0000 7f76a27fc640 1 -- 172.21.15.37:0/2861770232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694032810 con 0x7f76a415f420 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.492+0000 7f76a92a7640 1 -- 172.21.15.37:0/2861770232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a415f420 msgr2=0x7f76a40d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.493+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2861770232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a415f420 0x7f76a40d3760 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f76a40d5e90 tx=0x7f769402a1a0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.493+0000 7f76a92a7640 1 -- 172.21.15.37:0/2861770232 shutdown_connections 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.493+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2861770232 >> v2:172.21.15.82:3300/0 conn(0x7f76a40d2080 0x7f76a40d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.493+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2861770232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a415f420 0x7f76a40d3760 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.493+0000 7f76a92a7640 1 -- 172.21.15.37:0/2861770232 >> 172.21.15.37:0/2861770232 conn(0x7f76a408eac0 msgr2=0x7f76a409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.493+0000 7f76a92a7640 1 -- 172.21.15.37:0/2861770232 shutdown_connections 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.493+0000 7f76a92a7640 1 -- 172.21.15.37:0/2861770232 wait complete. 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.494+0000 7f76a92a7640 1 Processor -- start 2024-05-10T08:49:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.494+0000 7f76a92a7640 1 -- start start 2024-05-10T08:49:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.494+0000 7f76a92a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76a40d2080 0x7f76a40ba390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a92a7640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76a4161610 0x7f76a4161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a92a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40c8b20 0x7f76a40c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a92a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40d5200 con 0x7f76a40c8b20 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a92a7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40d2830 con 0x7f76a40d2080 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a92a7640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f76a40d5380 con 0x7f76a4161610 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40c8b20 0x7f76a40c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40c8b20 0x7f76a40c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59528/0 (socket says 172.21.15.37:59528) 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 -- 172.21.15.37:0/2000808419 learned_addr learned my addr 172.21.15.37:0/2000808419 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a2ffd640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76a40d2080 0x7f76a40ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f769bfff640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76a4161610 0x7f76a4161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 -- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76a4161610 msgr2=0x7f76a4161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76a4161610 0x7f76a4161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 -- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76a40d2080 msgr2=0x7f76a40ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76a40d2080 0x7f76a40ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 -- 172.21.15.37:0/2000808419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4161f90 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a37fe640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40c8b20 0x7f76a40c8fa0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f769c007ef0 tx=0x7f769c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f769b7fe640 1 -- 172.21.15.37:0/2000808419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c01a070 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f769b7fe640 1 -- 172.21.15.37:0/2000808419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c003b90 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a40b95d0 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f769b7fe640 1 -- 172.21.15.37:0/2000808419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c00de80 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.495+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a40b9b90 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.496+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a40693f0 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.497+0000 7f769b7fe640 1 -- 172.21.15.37:0/2000808419 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f769c01d070 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.497+0000 7f769b7fe640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7684076300 0x7f76840787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.497+0000 7f769b7fe640 1 -- 172.21.15.37:0/2000808419 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f769c097970 con 0x7f76a40c8b20 2024-05-10T08:49:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.498+0000 7f76a2ffd640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7684076300 0x7f76840787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:49:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.498+0000 7f76a2ffd640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7684076300 0x7f76840787c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7694034000 tx=0x7f769402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:49:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.502+0000 7f769b7fe640 1 -- 172.21.15.37:0/2000808419 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f769c010070 con 0x7f76a40c8b20 2024-05-10T08:49:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.707+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76a40b4c50 con 0x7f76a40c8b20 2024-05-10T08:49:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.708+0000 7f769b7fe640 1 -- 172.21.15.37:0/2000808419 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v119) ==== 80+0+242 (secure 0 0 0) 0x7f769c060a40 con 0x7f76a40c8b20 2024-05-10T08:49:59.707 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6833/202078248 2024-05-11T08:49:50.560178+0000 2024-05-10T08:49:59.707 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.82:6837/2344331780 2024-05-11T08:49:41.251599+0000 2024-05-10T08:49:59.707 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6835/202078248 2024-05-11T08:49:50.560178+0000 2024-05-10T08:49:59.707 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.82:6835/2344331780 2024-05-11T08:49:41.251599+0000 2024-05-10T08:49:59.707 INFO:teuthology.orchestra.run.smithi037.stderr:listed 4 entries 2024-05-10T08:49:59.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7684076300 msgr2=0x7f76840787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:59.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7684076300 0x7f76840787c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7694034000 tx=0x7f769402e000 comp rx=0 tx=0).stop 2024-05-10T08:49:59.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40c8b20 msgr2=0x7f76a40c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:49:59.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40c8b20 0x7f76a40c8fa0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f769c007ef0 tx=0x7f769c00d4a0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 shutdown_connections 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7684076300 0x7f76840787c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40c8b20 0x7f76a40c8fa0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f76a4161610 0x7f76a4161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 --2- 172.21.15.37:0/2000808419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76a40d2080 0x7f76a40ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 >> 172.21.15.37:0/2000808419 conn(0x7f76a408eac0 msgr2=0x7f76a40d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 shutdown_connections 2024-05-10T08:49:59.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:49:59.710+0000 7f76a92a7640 1 -- 172.21.15.37:0/2000808419 wait complete. 2024-05-10T08:49:59.720 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T08:49:59.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:59.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T08:49:59.748 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:49:59.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:49:59.749 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T08:49:59.805 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:59.806 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:49:59.806 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:59.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:49:59.825 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:59.825 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:49:59.825 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:59.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:49:59.861 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T08:49:59.861 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:49:59.862 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:49:59.883 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:49:59.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:50:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.006+0000 7f6b6ee23640 1 Processor -- start 2024-05-10T08:50:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.006+0000 7f6b6ee23640 1 -- start start 2024-05-10T08:50:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6ee23640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6b68070d30 0x7f6b680d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6ee23640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68163920 0x7f6b680703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6ee23640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b68071110 0x7f6b6806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6ee23640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6b680d10d0 con 0x7f6b68070d30 2024-05-10T08:50:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6ee23640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68070b80 con 0x7f6b68071110 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6ee23640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680d1c30 con 0x7f6b68163920 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6cbbf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6b68070d30 0x7f6b680d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6cbbf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6b68070d30 0x7f6b680d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59540/0 (socket says 172.21.15.37:59540) 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.007+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3546980291 learned_addr learned my addr 172.21.15.37:0/3546980291 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b67fff640 1 --2- 172.21.15.37:0/3546980291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68163920 0x7f6b680703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6d3c0640 1 --2- 172.21.15.37:0/3546980291 >> v2:172.21.15.82:3300/0 conn(0x7f6b68071110 0x7f6b6806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3546980291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68163920 msgr2=0x7f6b680703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6cbbf640 1 --2- 172.21.15.37:0/3546980291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68163920 0x7f6b680703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3546980291 >> v2:172.21.15.82:3300/0 conn(0x7f6b68071110 msgr2=0x7f6b6806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6cbbf640 1 --2- 172.21.15.37:0/3546980291 >> v2:172.21.15.82:3300/0 conn(0x7f6b68071110 0x7f6b6806d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3546980291 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68163d80 con 0x7f6b68070d30 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b67fff640 1 --2- 172.21.15.37:0/3546980291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68163920 0x7f6b680703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6d3c0640 1 --2- 172.21.15.37:0/3546980291 >> v2:172.21.15.82:3300/0 conn(0x7f6b68071110 0x7f6b6806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.008+0000 7f6b6cbbf640 1 --2- 172.21.15.37:0/3546980291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680d20c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f6b68073310 tx=0x7f6b5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda5621c5306b7a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b677fe640 1 -- 172.21.15.37:0/3546980291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c037070 con 0x7f6b68070d30 2024-05-10T08:50:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b677fe640 1 -- 172.21.15.37:0/3546980291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c032440 con 0x7f6b68070d30 2024-05-10T08:50:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b677fe640 1 -- 172.21.15.37:0/3546980291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c032810 con 0x7f6b68070d30 2024-05-10T08:50:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3546980291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 msgr2=0x7f6b680d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3546980291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680d20c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f6b68073310 tx=0x7f6b5c02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3546980291 shutdown_connections 2024-05-10T08:50:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3546980291 >> v2:172.21.15.82:3300/0 conn(0x7f6b68071110 0x7f6b6806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3546980291 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68163920 0x7f6b680703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3546980291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680d20c0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3546980291 >> 172.21.15.37:0/3546980291 conn(0x7f6b680d2e90 msgr2=0x7f6b680d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3546980291 shutdown_connections 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.009+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3546980291 wait complete. 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.010+0000 7f6b6ee23640 1 Processor -- start 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.010+0000 7f6b6ee23640 1 -- start start 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6ee23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6ee23640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68071110 0x7f6b680cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6ee23640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b68163920 0x7f6b680cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6ee23640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d15e0 con 0x7f6b68070d30 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6ee23640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680708e0 con 0x7f6b68163920 2024-05-10T08:50:00.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6ee23640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680d18c0 con 0x7f6b68071110 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6cbbf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6cbbf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59544/0 (socket says 172.21.15.37:59544) 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.011+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3244423798 learned_addr learned my addr 172.21.15.37:0/3244423798 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68071110 msgr2=0x7f6b680cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6cbbf640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68071110 0x7f6b680cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b68163920 msgr2=0x7f6b680cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6cbbf640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b68163920 0x7f6b680cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6cbbf640 1 -- 172.21.15.37:0/3244423798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680c7470 con 0x7f6b68070d30 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6cbbf640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680cb700 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c000c00 tx=0x7f6b5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b657fa640 1 -- 172.21.15.37:0/3244423798 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c037040 con 0x7f6b68070d30 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b657fa640 1 -- 172.21.15.37:0/3244423798 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c042070 con 0x7f6b68070d30 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b657fa640 1 -- 172.21.15.37:0/3244423798 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c030bb0 con 0x7f6b68070d30 2024-05-10T08:50:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b680c7750 con 0x7f6b68070d30 2024-05-10T08:50:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.012+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b680c7d10 con 0x7f6b68070d30 2024-05-10T08:50:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.013+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b680693f0 con 0x7f6b68070d30 2024-05-10T08:50:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.014+0000 7f6b657fa640 1 -- 172.21.15.37:0/3244423798 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b5c047460 con 0x7f6b68070d30 2024-05-10T08:50:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.014+0000 7f6b657fa640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b4c0762d0 0x7f6b4c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.014+0000 7f6b657fa640 1 -- 172.21.15.37:0/3244423798 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f6b5c0b8430 con 0x7f6b68070d30 2024-05-10T08:50:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.015+0000 7f6b67fff640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b4c0762d0 0x7f6b4c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.015+0000 7f6b67fff640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b4c0762d0 0x7f6b4c078790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6b54006fd0 tx=0x7f6b54008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.019+0000 7f6b657fa640 1 -- 172.21.15.37:0/3244423798 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6b5c081b50 con 0x7f6b68070d30 2024-05-10T08:50:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.248+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b680d06f0 con 0x7f6b68070d30 2024-05-10T08:50:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.248+0000 7f6b657fa640 1 -- 172.21.15.37:0/3244423798 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+5189 (secure 0 0 0) 0x7f6b5c081450 con 0x7f6b68070d30 2024-05-10T08:50:00.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:00.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:55.588583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/1002841422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1002841422},{"type":"v1","addr":"172.21.15.37:6835","nonce":1002841422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8433,"qdb_cluster":[8433]},"id":8}]} 2024-05-10T08:50:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 111 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b4c0762d0 msgr2=0x7f6b4c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b4c0762d0 0x7f6b4c078790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6b54006fd0 tx=0x7f6b54008040 comp rx=0 tx=0).stop 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 msgr2=0x7f6b680cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680cb700 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c000c00 tx=0x7f6b5c0046c0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 shutdown_connections 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f6b4c0762d0 0x7f6b4c078790 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b68163920 0x7f6b680cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.250+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b68071110 0x7f6b680cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.251+0000 7f6b6ee23640 1 --2- 172.21.15.37:0/3244423798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b68070d30 0x7f6b680cb700 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.251+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 >> 172.21.15.37:0/3244423798 conn(0x7f6b680d2e90 msgr2=0x7f6b68160e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.251+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 shutdown_connections 2024-05-10T08:50:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.251+0000 7f6b6ee23640 1 -- 172.21.15.37:0/3244423798 wait complete. 2024-05-10T08:50:00.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:50:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.367+0000 7f80130c8640 1 Processor -- start 2024-05-10T08:50:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.367+0000 7f80130c8640 1 -- start start 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f80130c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f800c072840 0x7f800c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f80130c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800c15c920 con 0x7f800c06e0f0 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f80130c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f800c15cc00 con 0x7f800c06e4d0 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f80130c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f800c15cee0 con 0x7f800c072840 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f8010e64640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f800c06e0f0 0x7f800c0d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40338/0 (socket says 172.21.15.37:40338) 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f8010e64640 1 -- 172.21.15.37:0/1361625630 learned_addr learned my addr 172.21.15.37:0/1361625630 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f800bfff640 1 --2- 172.21.15.37:0/1361625630 >> v2:172.21.15.82:3300/0 conn(0x7f800c072840 0x7f800c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f800b7fe640 1 -- 172.21.15.37:0/1361625630 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215594662 0 0) 0x7f800c15c920 con 0x7f800c06e0f0 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f800b7fe640 1 -- 172.21.15.37:0/1361625630 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff8003520 con 0x7f800c06e0f0 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f800bfff640 1 -- 172.21.15.37:0/1361625630 >> v1:172.21.15.82:6789/0 conn(0x7f800c06e4d0 legacy=0x7f800c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f800bfff640 1 -- 172.21.15.37:0/1361625630 >> v1:172.21.15.37:6789/0 conn(0x7f800c06e0f0 legacy=0x7f800c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f800b7fe640 1 -- 172.21.15.37:0/1361625630 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3937320449 0 0) 0x7f7ff8003520 con 0x7f800c06e0f0 2024-05-10T08:50:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.368+0000 7f800bfff640 1 -- 172.21.15.37:0/1361625630 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c15d1c0 con 0x7f800c072840 2024-05-10T08:50:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.369+0000 7f800bfff640 1 --2- 172.21.15.37:0/1361625630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 0x7f800c15c340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009d90 tx=0x7f7ffc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0efbe9a53ffe57 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.369+0000 7f800b7fe640 1 -- 172.21.15.37:0/1361625630 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4001670 con 0x7f800c072840 2024-05-10T08:50:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.369+0000 7f800b7fe640 1 -- 172.21.15.37:0/1361625630 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ffc007540 con 0x7f800c072840 2024-05-10T08:50:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.369+0000 7f800b7fe640 1 -- 172.21.15.37:0/1361625630 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0078f0 con 0x7f800c072840 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.370+0000 7f80130c8640 1 -- 172.21.15.37:0/1361625630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 msgr2=0x7f800c15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.370+0000 7f80130c8640 1 --2- 172.21.15.37:0/1361625630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 0x7f800c15c340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009d90 tx=0x7f7ffc02a680 comp rx=0 tx=0).stop 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.370+0000 7f80130c8640 1 -- 172.21.15.37:0/1361625630 shutdown_connections 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.370+0000 7f80130c8640 1 --2- 172.21.15.37:0/1361625630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 0x7f800c15c340 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.370+0000 7f80130c8640 1 -- 172.21.15.37:0/1361625630 >> 172.21.15.37:0/1361625630 conn(0x7f800c06c3a0 msgr2=0x7f800c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.370+0000 7f80130c8640 1 -- 172.21.15.37:0/1361625630 shutdown_connections 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.370+0000 7f80130c8640 1 -- 172.21.15.37:0/1361625630 wait complete. 2024-05-10T08:50:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.371+0000 7f80130c8640 1 Processor -- start 2024-05-10T08:50:00.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.371+0000 7f80130c8640 1 -- start start 2024-05-10T08:50:00.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f80130c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c06e0f0 0x7f800c151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f80130c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06e4d0 0x7f800c0cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f80130c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 0x7f800c09dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f80130c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f800c0ae7d0 con 0x7f800c06e0f0 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f80130c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f800c0ae650 con 0x7f800c072840 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f80130c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f800c1530b0 con 0x7f800c06e4d0 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f8010e64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c06e0f0 0x7f800c151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f8010e64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c06e0f0 0x7f800c151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59556/0 (socket says 172.21.15.37:59556) 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.372+0000 7f8010e64640 1 -- 172.21.15.37:0/3287980582 learned_addr learned my addr 172.21.15.37:0/3287980582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f800bfff640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06e4d0 0x7f800c0cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f8011665640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 0x7f800c09dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f8010e64640 1 -- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06e4d0 msgr2=0x7f800c0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f8010e64640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06e4d0 0x7f800c0cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f8010e64640 1 -- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 msgr2=0x7f800c09dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f8010e64640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 0x7f800c09dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f8010e64640 1 -- 172.21.15.37:0/3287980582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c0ce4b0 con 0x7f800c06e0f0 2024-05-10T08:50:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f8010e64640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c06e0f0 0x7f800c151660 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c780 tx=0x7f7ff400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f80097fa640 1 -- 172.21.15.37:0/3287980582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4017070 con 0x7f800c06e0f0 2024-05-10T08:50:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c0ce790 con 0x7f800c06e0f0 2024-05-10T08:50:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f80097fa640 1 -- 172.21.15.37:0/3287980582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff4005ad0 con 0x7f800c06e0f0 2024-05-10T08:50:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f80097fa640 1 -- 172.21.15.37:0/3287980582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4007070 con 0x7f800c06e0f0 2024-05-10T08:50:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.373+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c151ba0 con 0x7f800c06e0f0 2024-05-10T08:50:00.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.374+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c0ceb80 con 0x7f800c06e0f0 2024-05-10T08:50:00.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.375+0000 7f80097fa640 1 -- 172.21.15.37:0/3287980582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ff401a070 con 0x7f800c06e0f0 2024-05-10T08:50:00.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.375+0000 7f80097fa640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7fec0762d0 0x7f7fec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.375+0000 7f80097fa640 1 -- 172.21.15.37:0/3287980582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f7ff4096d00 con 0x7f800c06e0f0 2024-05-10T08:50:00.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.375+0000 7f800bfff640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7fec0762d0 0x7f7fec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.376+0000 7f800bfff640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7fec0762d0 0x7f7fec078790 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc034000 tx=0x7f7ffc02f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.379+0000 7f80097fa640 1 -- 172.21.15.37:0/3287980582 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7ff405fd50 con 0x7f800c06e0f0 2024-05-10T08:50:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.609+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f800c0693f0 con 0x7f800c06e0f0 2024-05-10T08:50:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.609+0000 7f80097fa640 1 -- 172.21.15.37:0/3287980582 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+5189 (secure 0 0 0) 0x7f7ff4064050 con 0x7f800c06e0f0 2024-05-10T08:50:00.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:55.588583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/1002841422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1002841422},{"type":"v1","addr":"172.21.15.37:6835","nonce":1002841422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8433,"qdb_cluster":[8433]},"id":8}]} 2024-05-10T08:50:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 111 2024-05-10T08:50:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7fec0762d0 msgr2=0x7f7fec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7fec0762d0 0x7f7fec078790 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc034000 tx=0x7f7ffc02f000 comp rx=0 tx=0).stop 2024-05-10T08:50:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c06e0f0 msgr2=0x7f800c151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c06e0f0 0x7f800c151660 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c780 tx=0x7f7ff400cc40 comp rx=0 tx=0).stop 2024-05-10T08:50:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 shutdown_connections 2024-05-10T08:50:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7fec0762d0 0x7f7fec078790 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f800c072840 0x7f800c09dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f800c06e4d0 0x7f800c0cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 --2- 172.21.15.37:0/3287980582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c06e0f0 0x7f800c151660 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 >> 172.21.15.37:0/3287980582 conn(0x7f800c06c3a0 msgr2=0x7f800c0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 shutdown_connections 2024-05-10T08:50:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.611+0000 7f80130c8640 1 -- 172.21.15.37:0/3287980582 wait complete. 2024-05-10T08:50:00.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:50:00.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.726+0000 7f34e99c1640 1 Processor -- start 2024-05-10T08:50:00.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.727+0000 7f34e99c1640 1 -- start start 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.727+0000 7f34e99c1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34e40c9ee0 0x7f34e40d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.727+0000 7f34e99c1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e40d3330 con 0x7f34e40d3cd0 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.727+0000 7f34e99c1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e40d2170 con 0x7f34e41629a0 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.727+0000 7f34e99c1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f34e40d2450 con 0x7f34e40c9ee0 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.727+0000 7f34e27fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f34e40d3cd0 0x7f34e40cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40346/0 (socket says 172.21.15.37:40346) 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e27fc640 1 -- 172.21.15.37:0/142176446 learned_addr learned my addr 172.21.15.37:0/142176446 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e37fe640 1 --2- 172.21.15.37:0/142176446 >> v2:172.21.15.82:3300/0 conn(0x7f34e40c9ee0 0x7f34e40d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277534561 0 0) 0x7f34e40d3330 con 0x7f34e40d3cd0 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34d0003520 con 0x7f34e40d3cd0 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3045107931 0 0) 0x7f34d0003520 con 0x7f34e40d3cd0 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 >> v2:172.21.15.82:3300/0 conn(0x7f34e40c9ee0 msgr2=0x7f34e40d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 --2- 172.21.15.37:0/142176446 >> v2:172.21.15.82:3300/0 conn(0x7f34e40c9ee0 0x7f34e40d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 >> v1:172.21.15.82:6789/0 conn(0x7f34e41629a0 legacy=0x7f34e40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e40d2730 con 0x7f34e40d3cd0 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f34cc001670 con 0x7f34e40d3cd0 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 >> v1:172.21.15.37:6789/0 conn(0x7f34e40d3cd0 legacy=0x7f34e40cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d00039b0 0x7f34d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34d0004800 0x7f34d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d00052e0 0x7f34d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34e40d2450 con 0x7f34d0004800 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34d000c1b0 con 0x7f34d00039b0 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34d000c3b0 con 0x7f34d00052e0 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e27fc640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34d0004800 0x7f34d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e2ffd640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d00039b0 0x7f34d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.728+0000 7f34e37fe640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d00052e0 0x7f34d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e27fc640 1 -- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d00052e0 msgr2=0x7f34d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e27fc640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34d00052e0 0x7f34d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e27fc640 1 -- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d00039b0 msgr2=0x7f34d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e27fc640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d00039b0 0x7f34d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e27fc640 1 -- 172.21.15.37:0/142176446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d0003520 con 0x7f34d0004800 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e37fe640 1 -- 172.21.15.37:0/142176446 reap_dead start 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e27fc640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34d0004800 0x7f34d0004c80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c210 tx=0x7f34d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60694023ba77c40 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.729+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc007cf0 con 0x7f34d0004800 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc005af0 con 0x7f34d0004800 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e1ffb640 1 -- 172.21.15.37:0/142176446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc007070 con 0x7f34d0004800 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e99c1640 1 -- 172.21.15.37:0/142176446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34d0004800 msgr2=0x7f34d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e99c1640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34d0004800 0x7f34d0004c80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c210 tx=0x7f34d0005830 comp rx=0 tx=0).stop 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e99c1640 1 -- 172.21.15.37:0/142176446 shutdown_connections 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e99c1640 1 --2- 172.21.15.37:0/142176446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34d0004800 0x7f34d0004c80 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e99c1640 1 -- 172.21.15.37:0/142176446 >> 172.21.15.37:0/142176446 conn(0x7f34e40d4fe0 msgr2=0x7f34e40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e99c1640 1 -- 172.21.15.37:0/142176446 shutdown_connections 2024-05-10T08:50:00.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.730+0000 7f34e99c1640 1 -- 172.21.15.37:0/142176446 wait complete. 2024-05-10T08:50:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.731+0000 7f34e99c1640 1 Processor -- start 2024-05-10T08:50:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e99c1640 1 -- start start 2024-05-10T08:50:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e99c1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d0004800 0x7f34e41f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e99c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e40cd100 0x7f34e40ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e99c1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34e40a1f60 0x7f34e40a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e99c1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34e40cf440 con 0x7f34e40cd100 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e99c1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34e40cf2c0 con 0x7f34d0004800 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e99c1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34e40d2dc0 con 0x7f34e40a1f60 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e40cd100 0x7f34e40ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e40cd100 0x7f34e40ba4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59578/0 (socket says 172.21.15.37:59578) 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.732+0000 7f34e27fc640 1 -- 172.21.15.37:0/3816430843 learned_addr learned my addr 172.21.15.37:0/3816430843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e37fe640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34e40a1f60 0x7f34e40a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e2ffd640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d0004800 0x7f34e41f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e27fc640 1 -- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34e40a1f60 msgr2=0x7f34e40a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e27fc640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34e40a1f60 0x7f34e40a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e27fc640 1 -- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d0004800 msgr2=0x7f34e41f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e27fc640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d0004800 0x7f34e41f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e27fc640 1 -- 172.21.15.37:0/3816430843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e41f5d60 con 0x7f34e40cd100 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e37fe640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34e40a1f60 0x7f34e40a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e27fc640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e40cd100 0x7f34e40ba4c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c210 tx=0x7f34e40d2340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34dbfff640 1 -- 172.21.15.37:0/3816430843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc037040 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34dbfff640 1 -- 172.21.15.37:0/3816430843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc001470 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34dbfff640 1 -- 172.21.15.37:0/3816430843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0049e0 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e40cd910 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.733+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e40cded0 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.734+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e40693f0 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.735+0000 7f34dbfff640 1 -- 172.21.15.37:0/3816430843 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f34cc004b80 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.735+0000 7f34dbfff640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34c4076300 0x7f34c40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.735+0000 7f34dbfff640 1 -- 172.21.15.37:0/3816430843 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f34cc0b77f0 con 0x7f34e40cd100 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.735+0000 7f34e2ffd640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34c4076300 0x7f34c40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.736+0000 7f34e2ffd640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34c4076300 0x7f34c40787c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000c00 tx=0x7f34d4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.740+0000 7f34dbfff640 1 -- 172.21.15.37:0/3816430843 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f34e41f5d60 con 0x7f34e40cd100 2024-05-10T08:50:00.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.932+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34e40763f0 con 0x7f34e40cd100 2024-05-10T08:50:00.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.933+0000 7f34dbfff640 1 -- 172.21.15.37:0/3816430843 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+17149 (secure 0 0 0) 0x7f34cc080ff0 con 0x7f34e40cd100 2024-05-10T08:50:00.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:00.933 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":119,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:50.560201+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:49:22.646272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T08:49:23.934335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6833/202078248":"2024-05-11T08:49:50.560178+0000","172.21.15.82:6837/2344331780":"2024-05-11T08:49:41.251599+0000","172.21.15.37:6835/202078248":"2024-05-11T08:49:50.560178+0000","172.21.15.82:6835/2344331780":"2024-05-11T08:49:41.251599+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34c4076300 msgr2=0x7f34c40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34c4076300 0x7f34c40787c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000c00 tx=0x7f34d4009040 comp rx=0 tx=0).stop 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e40cd100 msgr2=0x7f34e40ba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e40cd100 0x7f34e40ba4c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c210 tx=0x7f34e40d2340 comp rx=0 tx=0).stop 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 shutdown_connections 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f34c4076300 0x7f34c40787c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34e40a1f60 0x7f34e40a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e40cd100 0x7f34e40ba4c0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 --2- 172.21.15.37:0/3816430843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d0004800 0x7f34e41f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 >> 172.21.15.37:0/3816430843 conn(0x7f34e40d4fe0 msgr2=0x7f34e406e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 shutdown_connections 2024-05-10T08:50:00.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:00.936+0000 7f34e99c1640 1 -- 172.21.15.37:0/3816430843 wait complete. 2024-05-10T08:50:00.946 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:50:00.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:50:01.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.052+0000 7fdf0b046640 1 Processor -- start 2024-05-10T08:50:01.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.052+0000 7fdf0b046640 1 -- start start 2024-05-10T08:50:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf0b046640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf041629b0 0x7fdf0406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf0b046640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf040b2490 0x7fdf04070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf0b046640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0406e110 con 0x7fdf04070d20 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf0b046640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0406dec0 con 0x7fdf041629b0 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf0b046640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0406e3f0 con 0x7fdf040b2490 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf08de2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf041629b0 0x7fdf0406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf095e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdf04070d20 0x7fdf040afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40350/0 (socket says 172.21.15.37:40350) 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf095e3640 1 -- 172.21.15.37:0/2460087963 learned_addr learned my addr 172.21.15.37:0/2460087963 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf03fff640 1 --2- 172.21.15.37:0/2460087963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf040b2490 0x7fdf04070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf08de2640 1 -- 172.21.15.37:0/2460087963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf040b2490 msgr2=0x7fdf04070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf08de2640 1 --2- 172.21.15.37:0/2460087963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf040b2490 0x7fdf04070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.053+0000 7fdf08de2640 1 -- 172.21.15.37:0/2460087963 >> v1:172.21.15.37:6789/0 conn(0x7fdf04070d20 legacy=0x7fdf040afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.054+0000 7fdf08de2640 1 -- 172.21.15.37:0/2460087963 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0406e6d0 con 0x7fdf041629b0 2024-05-10T08:50:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.054+0000 7fdf037fe640 1 -- 172.21.15.37:0/2460087963 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066594703 0 0) 0x7fdf0406e110 con 0x7fdf04070d20 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.054+0000 7fdf08de2640 1 --2- 172.21.15.37:0/2460087963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf041629b0 0x7fdf0406eed0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fdef80097a0 tx=0x7fdef802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8778c667f672e891 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.054+0000 7fdf037fe640 1 -- 172.21.15.37:0/2460087963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8037070 con 0x7fdf041629b0 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.054+0000 7fdf037fe640 1 -- 172.21.15.37:0/2460087963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef8032440 con 0x7fdf041629b0 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.054+0000 7fdf037fe640 1 -- 172.21.15.37:0/2460087963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8032810 con 0x7fdf041629b0 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 -- 172.21.15.37:0/2460087963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf041629b0 msgr2=0x7fdf0406eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 --2- 172.21.15.37:0/2460087963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf041629b0 0x7fdf0406eed0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fdef80097a0 tx=0x7fdef802a180 comp rx=0 tx=0).stop 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 -- 172.21.15.37:0/2460087963 shutdown_connections 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 --2- 172.21.15.37:0/2460087963 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf040b2490 0x7fdf04070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 --2- 172.21.15.37:0/2460087963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf041629b0 0x7fdf0406eed0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 -- 172.21.15.37:0/2460087963 >> 172.21.15.37:0/2460087963 conn(0x7fdf040b49d0 msgr2=0x7fdf040b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:01.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 -- 172.21.15.37:0/2460087963 shutdown_connections 2024-05-10T08:50:01.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.055+0000 7fdf0b046640 1 -- 172.21.15.37:0/2460087963 wait complete. 2024-05-10T08:50:01.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.056+0000 7fdf0b046640 1 Processor -- start 2024-05-10T08:50:01.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.056+0000 7fdf0b046640 1 -- start start 2024-05-10T08:50:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf0b046640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf04070d20 0x7fdf040c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf0b046640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf040b2490 0x7fdf040cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf0b046640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf041629b0 0x7fdf040c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf0b046640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04070870 con 0x7fdf040b2490 2024-05-10T08:50:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf0b046640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0406f410 con 0x7fdf041629b0 2024-05-10T08:50:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf0b046640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdf040709f0 con 0x7fdf04070d20 2024-05-10T08:50:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf040b2490 0x7fdf040cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf040b2490 0x7fdf040cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59598/0 (socket says 172.21.15.37:59598) 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 -- 172.21.15.37:0/1659803634 learned_addr learned my addr 172.21.15.37:0/1659803634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf08de2640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf04070d20 0x7fdf040c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf095e3640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf041629b0 0x7fdf040c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 -- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf04070d20 msgr2=0x7fdf040c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf04070d20 0x7fdf040c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 -- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf041629b0 msgr2=0x7fdf040c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf041629b0 0x7fdf040c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.057+0000 7fdf03fff640 1 -- 172.21.15.37:0/1659803634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf040c8130 con 0x7fdf040b2490 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.058+0000 7fdf095e3640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf041629b0 0x7fdf040c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.058+0000 7fdf03fff640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf040b2490 0x7fdf040cd6e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e9b0 tx=0x7fdef000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.058+0000 7fdf017fa640 1 -- 172.21.15.37:0/1659803634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0017070 con 0x7fdf040b2490 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.058+0000 7fdf017fa640 1 -- 172.21.15.37:0/1659803634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef000c9a0 con 0x7fdf040b2490 2024-05-10T08:50:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.058+0000 7fdf017fa640 1 -- 172.21.15.37:0/1659803634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef000cd90 con 0x7fdf040b2490 2024-05-10T08:50:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.058+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf040c8410 con 0x7fdf040b2490 2024-05-10T08:50:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.058+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf040c89d0 con 0x7fdf040b2490 2024-05-10T08:50:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.059+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf040693f0 con 0x7fdf040b2490 2024-05-10T08:50:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.060+0000 7fdf017fa640 1 -- 172.21.15.37:0/1659803634 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdef001a070 con 0x7fdf040b2490 2024-05-10T08:50:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.060+0000 7fdf017fa640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdee80762d0 0x7fdee8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.060+0000 7fdf017fa640 1 -- 172.21.15.37:0/1659803634 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7fdef0097be0 con 0x7fdf040b2490 2024-05-10T08:50:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.061+0000 7fdf08de2640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdee80762d0 0x7fdee8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.061+0000 7fdf08de2640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdee80762d0 0x7fdee8078790 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdef8034000 tx=0x7fdef802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.065+0000 7fdf017fa640 1 -- 172.21.15.37:0/1659803634 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fdef0060c20 con 0x7fdf040b2490 2024-05-10T08:50:01.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.293+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf040d08f0 con 0x7fdf040b2490 2024-05-10T08:50:01.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.294+0000 7fdf017fa640 1 -- 172.21.15.37:0/1659803634 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+5189 (secure 0 0 0) 0x7fdef0064f20 con 0x7fdf040b2490 2024-05-10T08:50:01.293 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:01.293 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:55.588583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/1002841422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1002841422},{"type":"v1","addr":"172.21.15.37:6835","nonce":1002841422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8433,"qdb_cluster":[8433]},"id":8}]} 2024-05-10T08:50:01.293 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 111 2024-05-10T08:50:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdee80762d0 msgr2=0x7fdee8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdee80762d0 0x7fdee8078790 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdef8034000 tx=0x7fdef802e000 comp rx=0 tx=0).stop 2024-05-10T08:50:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf040b2490 msgr2=0x7fdf040cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf040b2490 0x7fdf040cd6e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e9b0 tx=0x7fdef000ee70 comp rx=0 tx=0).stop 2024-05-10T08:50:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 shutdown_connections 2024-05-10T08:50:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fdee80762d0 0x7fdee8078790 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf041629b0 0x7fdf040c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf040b2490 0x7fdf040cd6e0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 --2- 172.21.15.37:0/1659803634 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fdf04070d20 0x7fdf040c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 >> 172.21.15.37:0/1659803634 conn(0x7fdf040b49d0 msgr2=0x7fdf040b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 shutdown_connections 2024-05-10T08:50:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.296+0000 7fdf0b046640 1 -- 172.21.15.37:0/1659803634 wait complete. 2024-05-10T08:50:01.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:50:01.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.412+0000 7f45bf833640 1 Processor -- start 2024-05-10T08:50:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.412+0000 7f45bf833640 1 -- start start 2024-05-10T08:50:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45bf833640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 0x7f45b8070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45bf833640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b806e110 con 0x7f45b81629b0 2024-05-10T08:50:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45bf833640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b806e3f0 con 0x7f45b8070d20 2024-05-10T08:50:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45bf833640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45b806dec0 con 0x7f45b80b2490 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45bd5cf640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f45b81629b0 0x7f45b806eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40366/0 (socket says 172.21.15.37:40366) 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1057510801 learned_addr learned my addr 172.21.15.37:0/1057510801 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935753084 0 0) 0x7f45b806e110 con 0x7f45b81629b0 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45bcdce640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 0x7f45b8070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a4003520 con 0x7f45b81629b0 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2344100053 0 0) 0x7f45a4003520 con 0x7f45b81629b0 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 msgr2=0x7f45b8070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 0x7f45b8070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 >> v1:172.21.15.82:6789/0 conn(0x7f45b8070d20 legacy=0x7f45b80afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b806e6d0 con 0x7f45b81629b0 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f45b40019f0 con 0x7f45b81629b0 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 >> v1:172.21.15.37:6789/0 conn(0x7f45b81629b0 legacy=0x7f45b806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.413+0000 7f45affff640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45affff640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 0x7f45a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45affff640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a4004d40 0x7f45a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45b806dec0 con 0x7f45a40039e0 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45a400b9c0 con 0x7f45a4004d40 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45a400bbc0 con 0x7f45b80b2490 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bd5cf640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bcdce640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 0x7f45a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bddd0640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a4004d40 0x7f45a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 msgr2=0x7f45a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bd5cf640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b80b2490 0x7f45a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a4004d40 msgr2=0x7f45a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bd5cf640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45a4004d40 0x7f45a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.414+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1057510801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4003520 con 0x7f45a40039e0 2024-05-10T08:50:01.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45bd5cf640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45a4003dc0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f45b400a920 tx=0x7f45a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef44eafd6e31fde server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b400a4c0 con 0x7f45a40039e0 2024-05-10T08:50:01.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b402f070 con 0x7f45a40039e0 2024-05-10T08:50:01.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45affff640 1 -- 172.21.15.37:0/1057510801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b402bc50 con 0x7f45a40039e0 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45bf833640 1 -- 172.21.15.37:0/1057510801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 msgr2=0x7f45a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45bf833640 1 --2- 172.21.15.37:0/1057510801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45a4003dc0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f45b400a920 tx=0x7f45a4005830 comp rx=0 tx=0).stop 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45bddd0640 1 -- 172.21.15.37:0/1057510801 reap_dead start 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45bf833640 1 -- 172.21.15.37:0/1057510801 shutdown_connections 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45bf833640 1 -- 172.21.15.37:0/1057510801 >> 172.21.15.37:0/1057510801 conn(0x7f45b80b49d0 msgr2=0x7f45b80b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.415+0000 7f45bf833640 1 -- 172.21.15.37:0/1057510801 shutdown_connections 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.416+0000 7f45bf833640 1 -- 172.21.15.37:0/1057510801 wait complete. 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 Processor -- start 2024-05-10T08:50:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 -- start start 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45b814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b81f7f10 0x7f45b81f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b81f88d0 0x7f45b81504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80b0540 con 0x7f45a40039e0 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80b03c0 con 0x7f45b81f7f10 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.417+0000 7f45bf833640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45b80b06c0 con 0x7f45b81f88d0 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45b814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45b814dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59612/0 (socket says 172.21.15.37:59612) 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1629354567 learned_addr learned my addr 172.21.15.37:0/1629354567 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bddd0640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b81f88d0 0x7f45b81504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bcdce640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b81f7f10 0x7f45b81f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b81f88d0 msgr2=0x7f45b81504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b81f88d0 0x7f45b81504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b81f7f10 msgr2=0x7f45b81f8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b81f7f10 0x7f45b81f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 -- 172.21.15.37:0/1629354567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b81f8d50 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bddd0640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b81f88d0 0x7f45b81504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bd5cf640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45b814dc10 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f45b402b4a0 tx=0x7f45b4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45adffb640 1 -- 172.21.15.37:0/1629354567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b400a4c0 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45adffb640 1 -- 172.21.15.37:0/1629354567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b4004d60 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b814e150 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45adffb640 1 -- 172.21.15.37:0/1629354567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4005220 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.418+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b80c8f70 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.419+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b80693f0 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.420+0000 7f45adffb640 1 -- 172.21.15.37:0/1629354567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f45b40053c0 con 0x7f45a40039e0 2024-05-10T08:50:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.420+0000 7f45adffb640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f459c0762d0 0x7f459c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.420+0000 7f45adffb640 1 -- 172.21.15.37:0/1629354567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f45b40b7df0 con 0x7f45a40039e0 2024-05-10T08:50:01.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.421+0000 7f45bcdce640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f459c0762d0 0x7f459c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.421+0000 7f45bcdce640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f459c0762d0 0x7f459c078790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f45b806d170 tx=0x7f45a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.425+0000 7f45adffb640 1 -- 172.21.15.37:0/1629354567 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f45b4081480 con 0x7f45a40039e0 2024-05-10T08:50:01.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.657+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45b80d0830 con 0x7f45a40039e0 2024-05-10T08:50:01.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.658+0000 7f45adffb640 1 -- 172.21.15.37:0/1629354567 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) ==== 95+0+5189 (secure 0 0 0) 0x7f45b4080d80 con 0x7f45a40039e0 2024-05-10T08:50:01.657 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:01.657 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T08:49:25.024575+0000","modified":"2024-05-10T08:49:55.588583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/1002841422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1002841422},{"type":"v1","addr":"172.21.15.37:6835","nonce":1002841422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8433,"qdb_cluster":[8433]},"id":8}]} 2024-05-10T08:50:01.657 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 111 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f459c0762d0 msgr2=0x7f459c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f459c0762d0 0x7f459c078790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f45b806d170 tx=0x7f45a8008040 comp rx=0 tx=0).stop 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 msgr2=0x7f45b814dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45b814dc10 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f45b402b4a0 tx=0x7f45b4001dc0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 shutdown_connections 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f459c0762d0 0x7f459c078790 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45b81f88d0 0x7f45b81504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b81f7f10 0x7f45b81f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 --2- 172.21.15.37:0/1629354567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a40039e0 0x7f45b814dc10 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 >> 172.21.15.37:0/1629354567 conn(0x7f45b80b49d0 msgr2=0x7f45b80afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 shutdown_connections 2024-05-10T08:50:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.660+0000 7f45bf833640 1 -- 172.21.15.37:0/1629354567 wait complete. 2024-05-10T08:50:01.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:50:01.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.774+0000 7fbed0baf640 1 Processor -- start 2024-05-10T08:50:01.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.774+0000 7fbed0baf640 1 -- start start 2024-05-10T08:50:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbed0baf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbecc0c9ee0 0x7fbecc0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbed0baf640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbecc0d3330 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbed0baf640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbecc0d2170 con 0x7fbecc1629a0 2024-05-10T08:50:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbed0baf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbecc0d2450 con 0x7fbecc0c9ee0 2024-05-10T08:50:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbecad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbecc0c9ee0 0x7fbecc0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbec3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbecc0d3cd0 0x7fbecc0cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40380/0 (socket says 172.21.15.37:40380) 2024-05-10T08:50:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbecad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbecc0c9ee0 0x7fbecc0d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59614/0 (socket says 172.21.15.37:59614) 2024-05-10T08:50:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.775+0000 7fbec3fff640 1 -- 172.21.15.37:0/3811517937 learned_addr learned my addr 172.21.15.37:0/3811517937 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.776+0000 7fbecad9d640 1 -- 172.21.15.37:0/3811517937 >> v1:172.21.15.82:6789/0 conn(0x7fbecc1629a0 legacy=0x7fbecc0d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.776+0000 7fbecad9d640 1 -- 172.21.15.37:0/3811517937 >> v1:172.21.15.37:6789/0 conn(0x7fbecc0d3cd0 legacy=0x7fbecc0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.776+0000 7fbecad9d640 1 -- 172.21.15.37:0/3811517937 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc0d2730 con 0x7fbecc0c9ee0 2024-05-10T08:50:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.776+0000 7fbecad9d640 1 --2- 172.21.15.37:0/3811517937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0c9ee0 0x7fbecc0d03b0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009d90 tx=0x7fbec402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330ff37aec350a3b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbec9d9b640 1 -- 172.21.15.37:0/3811517937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4031600 con 0x7fbecc0c9ee0 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbec9d9b640 1 -- 172.21.15.37:0/3811517937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec40317a0 con 0x7fbecc0c9ee0 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbec9d9b640 1 -- 172.21.15.37:0/3811517937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4031b70 con 0x7fbecc0c9ee0 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbed0baf640 1 -- 172.21.15.37:0/3811517937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0c9ee0 msgr2=0x7fbecc0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbed0baf640 1 --2- 172.21.15.37:0/3811517937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0c9ee0 0x7fbecc0d03b0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009d90 tx=0x7fbec402a5d0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbed0baf640 1 -- 172.21.15.37:0/3811517937 shutdown_connections 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbed0baf640 1 --2- 172.21.15.37:0/3811517937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0c9ee0 0x7fbecc0d03b0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbed0baf640 1 -- 172.21.15.37:0/3811517937 >> 172.21.15.37:0/3811517937 conn(0x7fbecc0d4fe0 msgr2=0x7fbecc0d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbed0baf640 1 -- 172.21.15.37:0/3811517937 shutdown_connections 2024-05-10T08:50:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.777+0000 7fbed0baf640 1 -- 172.21.15.37:0/3811517937 wait complete. 2024-05-10T08:50:01.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.778+0000 7fbed0baf640 1 Processor -- start 2024-05-10T08:50:01.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbed0baf640 1 -- start start 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbed0baf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc0c9ee0 0x7fbecc0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbed0baf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0d3cd0 0x7fbecc0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbed0baf640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbecc1629a0 0x7fbecc0b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbed0baf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc0cf440 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbed0baf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc0cf2c0 con 0x7fbecc0c9ee0 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbed0baf640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc0d2dc0 con 0x7fbecc1629a0 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbec3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0d3cd0 0x7fbecc0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbec3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0d3cd0 0x7fbecc0cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59626/0 (socket says 172.21.15.37:59626) 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.779+0000 7fbec3fff640 1 -- 172.21.15.37:0/2043346910 learned_addr learned my addr 172.21.15.37:0/2043346910 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbeca59c640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc0c9ee0 0x7fbecc0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbecad9d640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbecc1629a0 0x7fbecc0b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec3fff640 1 -- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbecc1629a0 msgr2=0x7fbecc0b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec3fff640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbecc1629a0 0x7fbecc0b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec3fff640 1 -- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc0c9ee0 msgr2=0x7fbecc0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec3fff640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc0c9ee0 0x7fbecc0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec3fff640 1 -- 172.21.15.37:0/2043346910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc1f2740 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec3fff640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0d3cd0 0x7fbecc0cd100 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c4a0 tx=0x7fbeb400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec2ffd640 1 -- 172.21.15.37:0/2043346910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4017070 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec2ffd640 1 -- 172.21.15.37:0/2043346910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb4005ce0 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc0cd800 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbec2ffd640 1 -- 172.21.15.37:0/2043346910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4007270 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.780+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc0cddc0 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.781+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc0693f0 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.782+0000 7fbec2ffd640 1 -- 172.21.15.37:0/2043346910 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbeb401a070 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.782+0000 7fbec2ffd640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.783+0000 7fbec2ffd640 1 -- 172.21.15.37:0/2043346910 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7fbeb4096a00 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.783+0000 7fbeca59c640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.783+0000 7fbeca59c640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbebc007fd0 tx=0x7fbebc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:01.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.787+0000 7fbec2ffd640 1 -- 172.21.15.37:0/2043346910 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fbeb405fb60 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.980+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbecc160cd0 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.981+0000 7fbec2ffd640 1 -- 172.21.15.37:0/2043346910 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+17149 (secure 0 0 0) 0x7fbeb4063e60 con 0x7fbecc0d3cd0 2024-05-10T08:50:01.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:01.980 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":119,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:49:50.560201+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-10T08:49:22.646272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-10T08:49:23.934335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6833/202078248":"2024-05-11T08:49:50.560178+0000","172.21.15.82:6837/2344331780":"2024-05-11T08:49:41.251599+0000","172.21.15.37:6835/202078248":"2024-05-11T08:49:50.560178+0000","172.21.15.82:6835/2344331780":"2024-05-11T08:49:41.251599+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:50:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 msgr2=0x7fbeac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbebc007fd0 tx=0x7fbebc009040 comp rx=0 tx=0).stop 2024-05-10T08:50:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0d3cd0 msgr2=0x7fbecc0cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0d3cd0 0x7fbecc0cd100 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c4a0 tx=0x7fbeb400c960 comp rx=0 tx=0).stop 2024-05-10T08:50:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 shutdown_connections 2024-05-10T08:50:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fbeac0762d0 0x7fbeac078790 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbecc1629a0 0x7fbecc0b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbecc0d3cd0 0x7fbecc0cd100 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 --2- 172.21.15.37:0/2043346910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc0c9ee0 0x7fbecc0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 >> 172.21.15.37:0/2043346910 conn(0x7fbecc0d4fe0 msgr2=0x7fbecc0d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 shutdown_connections 2024-05-10T08:50:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:01.983+0000 7fbed0baf640 1 -- 172.21.15.37:0/2043346910 wait complete. 2024-05-10T08:50:01.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T08:50:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.100+0000 7f36ca30a640 1 Processor -- start 2024-05-10T08:50:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.100+0000 7f36ca30a640 1 -- start start 2024-05-10T08:50:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36ca30a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36c41629a0 0x7f36c40d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36ca30a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40d2dc0 0x7f36c40d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36ca30a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36c40c8ed0 0x7f36c40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36ca30a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f36c40d3330 con 0x7f36c40c8ed0 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36ca30a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f36c40d2170 con 0x7f36c41629a0 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36ca30a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f36c40d2450 con 0x7f36c40d2dc0 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36c40c8ed0 0x7f36c40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36c40c8ed0 0x7f36c40c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59642/0 (socket says 172.21.15.37:59642) 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 -- 172.21.15.37:0/1337413167 learned_addr learned my addr 172.21.15.37:0/1337413167 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c37fe640 1 --2- 172.21.15.37:0/1337413167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40d2dc0 0x7f36c40d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c3fff640 1 --2- 172.21.15.37:0/1337413167 >> v2:172.21.15.82:3300/0 conn(0x7f36c41629a0 0x7f36c40d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 -- 172.21.15.37:0/1337413167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40d2dc0 msgr2=0x7f36c40d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 --2- 172.21.15.37:0/1337413167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40d2dc0 0x7f36c40d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 -- 172.21.15.37:0/1337413167 >> v2:172.21.15.82:3300/0 conn(0x7f36c41629a0 msgr2=0x7f36c40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 --2- 172.21.15.37:0/1337413167 >> v2:172.21.15.82:3300/0 conn(0x7f36c41629a0 0x7f36c40d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c88a7640 1 -- 172.21.15.37:0/1337413167 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c40d2730 con 0x7f36c40c8ed0 2024-05-10T08:50:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c37fe640 1 --2- 172.21.15.37:0/1337413167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40d2dc0 0x7f36c40d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.101+0000 7f36c3fff640 1 --2- 172.21.15.37:0/1337413167 >> v2:172.21.15.82:3300/0 conn(0x7f36c41629a0 0x7f36c40d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.102+0000 7f36c88a7640 1 --2- 172.21.15.37:0/1337413167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40c8ed0 0x7f36c40c9360 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f36c40768a0 tx=0x7f36bc02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c613d71468cf0518 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.102+0000 7f36c2ffd640 1 -- 172.21.15.37:0/1337413167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc036070 con 0x7f36c40c8ed0 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.102+0000 7f36c2ffd640 1 -- 172.21.15.37:0/1337413167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc031600 con 0x7f36c40c8ed0 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.102+0000 7f36c2ffd640 1 -- 172.21.15.37:0/1337413167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0319d0 con 0x7f36c40c8ed0 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 -- 172.21.15.37:0/1337413167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40c8ed0 msgr2=0x7f36c40c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1337413167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40c8ed0 0x7f36c40c9360 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f36c40768a0 tx=0x7f36bc02a570 comp rx=0 tx=0).stop 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 -- 172.21.15.37:0/1337413167 shutdown_connections 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1337413167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40c8ed0 0x7f36c40c9360 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1337413167 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40d2dc0 0x7f36c40d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1337413167 >> v2:172.21.15.82:3300/0 conn(0x7f36c41629a0 0x7f36c40d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 -- 172.21.15.37:0/1337413167 >> 172.21.15.37:0/1337413167 conn(0x7f36c40d4fe0 msgr2=0x7f36c40d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 -- 172.21.15.37:0/1337413167 shutdown_connections 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.103+0000 7f36ca30a640 1 -- 172.21.15.37:0/1337413167 wait complete. 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.104+0000 7f36ca30a640 1 Processor -- start 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.104+0000 7f36ca30a640 1 -- start start 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36ca30a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40c8ed0 0x7f36c41554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36ca30a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40d2dc0 0x7f36c40d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36ca30a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36c41629a0 0x7f36c40d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36ca30a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f36c40cf440 con 0x7f36c40d2dc0 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36ca30a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36c40cf2c0 con 0x7f36c41629a0 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36ca30a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f36c40c98a0 con 0x7f36c40c8ed0 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40d2dc0 0x7f36c40d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40d2dc0 0x7f36c40d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59648/0 (socket says 172.21.15.37:59648) 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 -- 172.21.15.37:0/1723374530 learned_addr learned my addr 172.21.15.37:0/1723374530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c3fff640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40c8ed0 0x7f36c41554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 -- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40c8ed0 msgr2=0x7f36c41554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c88a7640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36c41629a0 0x7f36c40d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40c8ed0 0x7f36c41554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 -- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36c41629a0 msgr2=0x7f36c40d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36c41629a0 0x7f36c40d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.105+0000 7f36c37fe640 1 -- 172.21.15.37:0/1723374530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c409f790 con 0x7f36c40d2dc0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36c3fff640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40c8ed0 0x7f36c41554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36c88a7640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36c41629a0 0x7f36c40d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36c37fe640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40d2dc0 0x7f36c40d0180 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c7f0 tx=0x7f36b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36c0ff9640 1 -- 172.21.15.37:0/1723374530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8015070 con 0x7f36c40d2dc0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36c0ff9640 1 -- 172.21.15.37:0/1723374530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b8007a30 con 0x7f36c40d2dc0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c409fa50 con 0x7f36c40d2dc0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36c0ff9640 1 -- 172.21.15.37:0/1723374530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8007e00 con 0x7f36c40d2dc0 2024-05-10T08:50:02.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.106+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c40b86b0 con 0x7f36c40d2dc0 2024-05-10T08:50:02.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.107+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c40d4df0 con 0x7f36c40d2dc0 2024-05-10T08:50:02.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.108+0000 7f36c0ff9640 1 -- 172.21.15.37:0/1723374530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36b8018070 con 0x7f36c40d2dc0 2024-05-10T08:50:02.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.108+0000 7f36c0ff9640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36b00762d0 0x7f36b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.108+0000 7f36c0ff9640 1 -- 172.21.15.37:0/1723374530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6273+0+0 (secure 0 0 0) 0x7f36b80976e0 con 0x7f36c40d2dc0 2024-05-10T08:50:02.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.108+0000 7f36c3fff640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36b00762d0 0x7f36b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.109+0000 7f36c3fff640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36b00762d0 0x7f36b0078790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006fd0 tx=0x7f36b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.112+0000 7f36c0ff9640 1 -- 172.21.15.37:0/1723374530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f36b8060e10 con 0x7f36c40d2dc0 2024-05-10T08:50:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.343+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f36c40cfc60 con 0x7f36c40d2dc0 2024-05-10T08:50:02.342 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-10T08:50:02.344+0000 7fdeb095f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T08:50:02.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.345+0000 7f36c0ff9640 1 -- 172.21.15.37:0/1723374530 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v112) ==== 161+0+0 (secure 0 0 0) 0x7f36b8060710 con 0x7f36c40d2dc0 2024-05-10T08:50:02.344 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T08:50:02.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36b00762d0 msgr2=0x7f36b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36b00762d0 0x7f36b0078790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006fd0 tx=0x7f36b4008040 comp rx=0 tx=0).stop 2024-05-10T08:50:02.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40d2dc0 msgr2=0x7f36c40d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40d2dc0 0x7f36c40d0180 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c7f0 tx=0x7f36b800ccb0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 shutdown_connections 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f36b00762d0 0x7f36b0078790 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36c41629a0 0x7f36c40d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36c40d2dc0 0x7f36c40d0180 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 --2- 172.21.15.37:0/1723374530 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f36c40c8ed0 0x7f36c41554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 >> 172.21.15.37:0/1723374530 conn(0x7f36c40d4fe0 msgr2=0x7f36c40b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 shutdown_connections 2024-05-10T08:50:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.348+0000 7f36ca30a640 1 -- 172.21.15.37:0/1723374530 wait complete. 2024-05-10T08:50:02.349 INFO:tasks.ceph.mds.c.smithi037.stderr: -1196> 2024-05-10T08:49:56.567+0000 7f6855796640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T08:50:02.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T08:50:02.374 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-10T08:50:02.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.466+0000 7efe25c83640 1 Processor -- start 2024-05-10T08:50:02.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.466+0000 7efe25c83640 1 -- start start 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.467+0000 7efe25c83640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe200d1970 0x7efe200d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.467+0000 7efe25c83640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe201630b0 con 0x7efe200d4cc0 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.467+0000 7efe25c83640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe200d3e70 con 0x7efe2015f420 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.467+0000 7efe25c83640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efe200d2550 con 0x7efe200d1970 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.467+0000 7efe1ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efe200d4cc0 0x7efe200d50e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40386/0 (socket says 172.21.15.37:40386) 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.467+0000 7efe1ffff640 1 -- 172.21.15.37:0/2759977174 learned_addr learned my addr 172.21.15.37:0/2759977174 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.468+0000 7efe1effd640 1 --2- 172.21.15.37:0/2759977174 >> v2:172.21.15.82:3300/0 conn(0x7efe200d1970 0x7efe200d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.468+0000 7efe1e7fc640 1 -- 172.21.15.37:0/2759977174 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526506446 0 0) 0x7efe18001490 con 0x7efe200d4cc0 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.468+0000 7efe1e7fc640 1 -- 172.21.15.37:0/2759977174 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe08003520 con 0x7efe200d4cc0 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.468+0000 7efe1effd640 1 -- 172.21.15.37:0/2759977174 >> v1:172.21.15.82:6789/0 conn(0x7efe2015f420 legacy=0x7efe200d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.468+0000 7efe1effd640 1 -- 172.21.15.37:0/2759977174 >> v1:172.21.15.37:6789/0 conn(0x7efe200d4cc0 legacy=0x7efe200d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.468+0000 7efe1effd640 1 -- 172.21.15.37:0/2759977174 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe200d2c80 con 0x7efe200d1970 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe1effd640 1 --2- 172.21.15.37:0/2759977174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d1970 0x7efe200d1e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efe140097a0 tx=0x7efe1402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d17d0d358bf599a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe1e7fc640 1 -- 172.21.15.37:0/2759977174 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14037070 con 0x7efe200d1970 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe1e7fc640 1 -- 172.21.15.37:0/2759977174 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe14032440 con 0x7efe200d1970 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe1e7fc640 1 -- 172.21.15.37:0/2759977174 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140327f0 con 0x7efe200d1970 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe25c83640 1 -- 172.21.15.37:0/2759977174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d1970 msgr2=0x7efe200d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe25c83640 1 --2- 172.21.15.37:0/2759977174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d1970 0x7efe200d1e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efe140097a0 tx=0x7efe1402a230 comp rx=0 tx=0).stop 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe25c83640 1 -- 172.21.15.37:0/2759977174 shutdown_connections 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe25c83640 1 --2- 172.21.15.37:0/2759977174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d1970 0x7efe200d1e20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe25c83640 1 -- 172.21.15.37:0/2759977174 >> 172.21.15.37:0/2759977174 conn(0x7efe2008eac0 msgr2=0x7efe2009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe25c83640 1 -- 172.21.15.37:0/2759977174 shutdown_connections 2024-05-10T08:50:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.469+0000 7efe25c83640 1 -- 172.21.15.37:0/2759977174 wait complete. 2024-05-10T08:50:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.471+0000 7efe25c83640 1 Processor -- start 2024-05-10T08:50:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.471+0000 7efe25c83640 1 -- start start 2024-05-10T08:50:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe25c83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe200d1970 0x7efe20160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe25c83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d4cc0 0x7efe200cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe25c83640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe20162140 0x7efe20158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe25c83640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe200d2830 con 0x7efe200d1970 2024-05-10T08:50:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe25c83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efe200d3240 con 0x7efe200d4cc0 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe25c83640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efe200cfb20 con 0x7efe20162140 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe200d1970 0x7efe20160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe200d1970 0x7efe20160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59662/0 (socket says 172.21.15.37:59662) 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 -- 172.21.15.37:0/3172107046 learned_addr learned my addr 172.21.15.37:0/3172107046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1effd640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d4cc0 0x7efe200cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1ffff640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe20162140 0x7efe20158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 -- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe20162140 msgr2=0x7efe20158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe20162140 0x7efe20158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 -- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d4cc0 msgr2=0x7efe200cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d4cc0 0x7efe200cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 -- 172.21.15.37:0/3172107046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe20161820 con 0x7efe200d1970 2024-05-10T08:50:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe1f7fe640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe200d1970 0x7efe20160bf0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c3c0 tx=0x7efe1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe07fff640 1 -- 172.21.15.37:0/3172107046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100052d0 con 0x7efe200d1970 2024-05-10T08:50:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe07fff640 1 -- 172.21.15.37:0/3172107046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe10005490 con 0x7efe200d1970 2024-05-10T08:50:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe07fff640 1 -- 172.21.15.37:0/3172107046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe10007260 con 0x7efe200d1970 2024-05-10T08:50:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.472+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe20161b00 con 0x7efe200d1970 2024-05-10T08:50:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.473+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe201603f0 con 0x7efe200d1970 2024-05-10T08:50:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.474+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe200693f0 con 0x7efe200d1970 2024-05-10T08:50:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.474+0000 7efe07fff640 1 -- 172.21.15.37:0/3172107046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe10007400 con 0x7efe200d1970 2024-05-10T08:50:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.475+0000 7efe07fff640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe0c0762d0 0x7efe0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.475+0000 7efe07fff640 1 -- 172.21.15.37:0/3172107046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6359+0+0 (secure 0 0 0) 0x7efe10096c40 con 0x7efe200d1970 2024-05-10T08:50:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.475+0000 7efe1effd640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe0c0762d0 0x7efe0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.475+0000 7efe1effd640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe0c0762d0 0x7efe0c078790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efe14034000 tx=0x7efe1402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.479+0000 7efe07fff640 1 -- 172.21.15.37:0/3172107046 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7efe1005fcd0 con 0x7efe200d1970 2024-05-10T08:50:02.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:02.707+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efe200b4c50 con 0x7efe200d1970 2024-05-10T08:50:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.347+0000 7efe07fff640 1 -- 172.21.15.37:0/3172107046 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v113) ==== 104+0+0 (secure 0 0 0) 0x7efe10063fd0 con 0x7efe200d1970 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe0c0762d0 msgr2=0x7efe0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe0c0762d0 0x7efe0c078790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efe14034000 tx=0x7efe1402e000 comp rx=0 tx=0).stop 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe200d1970 msgr2=0x7efe20160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe200d1970 0x7efe20160bf0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c3c0 tx=0x7efe1000c880 comp rx=0 tx=0).stop 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 shutdown_connections 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7efe0c0762d0 0x7efe0c078790 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe20162140 0x7efe20158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe200d4cc0 0x7efe200cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 --2- 172.21.15.37:0/3172107046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe200d1970 0x7efe20160bf0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 >> 172.21.15.37:0/3172107046 conn(0x7efe2008eac0 msgr2=0x7efe20163390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:03.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 shutdown_connections 2024-05-10T08:50:03.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.350+0000 7efe25c83640 1 -- 172.21.15.37:0/3172107046 wait complete. 2024-05-10T08:50:03.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T08:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.521+0000 7f0d6ec47640 1 Processor -- start 2024-05-10T08:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.521+0000 7f0d6ec47640 1 -- start start 2024-05-10T08:50:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.522+0000 7f0d6ec47640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d680cf8f0 0x7f0d68070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.522+0000 7f0d6ec47640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d68169b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.522+0000 7f0d6ec47640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d680d2030 con 0x7f0d680d3920 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.522+0000 7f0d6ec47640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0d6815f8d0 con 0x7f0d680cf8f0 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.522+0000 7f0d6ec47640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0d680d22b0 con 0x7f0d680cef40 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.522+0000 7f0d6d1e4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d68169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d6c9e3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d680cf8f0 0x7f0d68070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d5ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0d680d3920 0x7f0d68070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:47056/0 (socket says 172.21.15.37:47056) 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d5ffff640 1 -- 172.21.15.37:0/2219831879 learned_addr learned my addr 172.21.15.37:0/2219831879 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d6c9e3640 1 -- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 msgr2=0x7f0d68169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d6c9e3640 1 --2- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d68169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d6c9e3640 1 -- 172.21.15.37:0/2219831879 >> v1:172.21.15.82:6789/0 conn(0x7f0d680d3920 legacy=0x7f0d68070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d6c9e3640 1 -- 172.21.15.37:0/2219831879 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d680d2590 con 0x7f0d680cf8f0 2024-05-10T08:50:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.523+0000 7f0d6d1e4640 1 --2- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d68169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6c9e3640 1 --2- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d68070500 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d640097a0 tx=0x7f0d6402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52b799cd5cc7f959 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d5f7fe640 1 -- 172.21.15.37:0/2219831879 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64037070 con 0x7f0d680cf8f0 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d5f7fe640 1 -- 172.21.15.37:0/2219831879 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d64032440 con 0x7f0d680cf8f0 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d5f7fe640 1 -- 172.21.15.37:0/2219831879 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64032810 con 0x7f0d680cf8f0 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 -- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 msgr2=0x7f0d68070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d68070500 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d640097a0 tx=0x7f0d6402a210 comp rx=0 tx=0).stop 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 -- 172.21.15.37:0/2219831879 shutdown_connections 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d68169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/2219831879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d68070500 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 -- 172.21.15.37:0/2219831879 >> 172.21.15.37:0/2219831879 conn(0x7f0d680d2e00 msgr2=0x7f0d680d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 -- 172.21.15.37:0/2219831879 shutdown_connections 2024-05-10T08:50:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.524+0000 7f0d6ec47640 1 -- 172.21.15.37:0/2219831879 wait complete. 2024-05-10T08:50:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 Processor -- start 2024-05-10T08:50:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 -- start start 2024-05-10T08:50:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d681f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d680cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d680d3920 0x7f0d680c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680cda10 con 0x7f0d680d3920 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680cd730 con 0x7f0d680cf8f0 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.526+0000 7f0d6ec47640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0d68071610 con 0x7f0d680cef40 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d680d3920 0x7f0d680c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d680d3920 0x7f0d680c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59670/0 (socket says 172.21.15.37:59670) 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d5ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d680cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 -- 172.21.15.37:0/1897913949 learned_addr learned my addr 172.21.15.37:0/1897913949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6c9e3640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d681f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 -- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 msgr2=0x7f0d681f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d681f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 -- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 msgr2=0x7f0d680cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d680cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 -- 172.21.15.37:0/1897913949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d680c7300 con 0x7f0d680d3920 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d5ffff640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d680cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6c9e3640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d681f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6d1e4640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d680d3920 0x7f0d680c9ed0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000efc0 tx=0x7f0d6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d5d7fa640 1 -- 172.21.15.37:0/1897913949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60018020 con 0x7f0d680d3920 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d5d7fa640 1 -- 172.21.15.37:0/1897913949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d60014480 con 0x7f0d680d3920 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d680c75a0 con 0x7f0d680d3920 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d5d7fa640 1 -- 172.21.15.37:0/1897913949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60014870 con 0x7f0d680d3920 2024-05-10T08:50:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.527+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d680c7b60 con 0x7f0d680d3920 2024-05-10T08:50:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.528+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d680693f0 con 0x7f0d680d3920 2024-05-10T08:50:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.529+0000 7f0d5d7fa640 1 -- 172.21.15.37:0/1897913949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d60005d10 con 0x7f0d680d3920 2024-05-10T08:50:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.530+0000 7f0d5d7fa640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d540762d0 0x7f0d54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.530+0000 7f0d5d7fa640 1 -- 172.21.15.37:0/1897913949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6359+0+0 (secure 0 0 0) 0x7f0d60098550 con 0x7f0d680d3920 2024-05-10T08:50:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.530+0000 7f0d6c9e3640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d540762d0 0x7f0d54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.530+0000 7f0d6c9e3640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d540762d0 0x7f0d54078790 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0d64034000 tx=0x7f0d6402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.534+0000 7f0d5d7fa640 1 -- 172.21.15.37:0/1897913949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f0d60022030 con 0x7f0d680d3920 2024-05-10T08:50:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:03.730+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0d680b1f90 con 0x7f0d680d3920 2024-05-10T08:50:04.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.623+0000 7f0d5d7fa640 1 -- 172.21.15.37:0/1897913949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) ==== 181+0+0 (secure 0 0 0) 0x7f0d60010040 con 0x7f0d680d3920 2024-05-10T08:50:04.622 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-10T08:50:04.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.626+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d540762d0 msgr2=0x7f0d54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:04.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.626+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d540762d0 0x7f0d54078790 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0d64034000 tx=0x7f0d6402e000 comp rx=0 tx=0).stop 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.626+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d680d3920 msgr2=0x7f0d680c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.626+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d680d3920 0x7f0d680c9ed0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000efc0 tx=0x7f0d6000c490 comp rx=0 tx=0).stop 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 shutdown_connections 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f0d540762d0 0x7f0d54078790 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d680d3920 0x7f0d680c9ed0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d680cf8f0 0x7f0d680cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 --2- 172.21.15.37:0/1897913949 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0d680cef40 0x7f0d681f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 >> 172.21.15.37:0/1897913949 conn(0x7f0d680d2e00 msgr2=0x7f0d68070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 shutdown_connections 2024-05-10T08:50:04.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.627+0000 7f0d6ec47640 1 -- 172.21.15.37:0/1897913949 wait complete. 2024-05-10T08:50:04.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T08:50:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.756+0000 7f8f04cb0640 1 Processor -- start 2024-05-10T08:50:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.756+0000 7f8f04cb0640 1 -- start start 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.756+0000 7f8f04cb0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d3670 0x7f8f000b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.756+0000 7f8f04cb0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8f000d3a50 0x7f8f000d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.756+0000 7f8f04cb0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f000cfc00 con 0x7f8f000d0e80 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.756+0000 7f8f04cb0640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8f000d2a10 con 0x7f8f000d3a50 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.756+0000 7f8f04cb0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8f000d04b0 con 0x7f8f000d3670 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8f000d0e80 0x7f8f000d19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40388/0 (socket says 172.21.15.37:40388) 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efed9d640 1 -- 172.21.15.37:0/3635441211 learned_addr learned my addr 172.21.15.37:0/3635441211 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efe59c640 1 --2- 172.21.15.37:0/3635441211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d3670 0x7f8f000b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8ef7fff640 1 --2- 172.21.15.37:0/3635441211 >> v2:172.21.15.82:3300/0 conn(0x7f8f000d3a50 0x7f8f000d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efdd9b640 1 -- 172.21.15.37:0/3635441211 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034839490 0 0) 0x7f8f000cfc00 con 0x7f8f000d0e80 2024-05-10T08:50:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efdd9b640 1 -- 172.21.15.37:0/3635441211 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eec003520 con 0x7f8f000d0e80 2024-05-10T08:50:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efe59c640 1 -- 172.21.15.37:0/3635441211 >> v2:172.21.15.82:3300/0 conn(0x7f8f000d3a50 msgr2=0x7f8f000d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efe59c640 1 --2- 172.21.15.37:0/3635441211 >> v2:172.21.15.82:3300/0 conn(0x7f8f000d3a50 0x7f8f000d0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efe59c640 1 -- 172.21.15.37:0/3635441211 >> v1:172.21.15.37:6789/0 conn(0x7f8f000d0e80 legacy=0x7f8f000d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.757+0000 7f8efe59c640 1 -- 172.21.15.37:0/3635441211 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000cfea0 con 0x7f8f000d3670 2024-05-10T08:50:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.758+0000 7f8efe59c640 1 --2- 172.21.15.37:0/3635441211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d3670 0x7f8f000b49c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8f000d0630 tx=0x7f8ef002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=758ef3d42219b81c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.758+0000 7f8efdd9b640 1 -- 172.21.15.37:0/3635441211 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0037070 con 0x7f8f000d3670 2024-05-10T08:50:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.758+0000 7f8efdd9b640 1 -- 172.21.15.37:0/3635441211 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef0032440 con 0x7f8f000d3670 2024-05-10T08:50:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.758+0000 7f8efdd9b640 1 -- 172.21.15.37:0/3635441211 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00327f0 con 0x7f8f000d3670 2024-05-10T08:50:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 -- 172.21.15.37:0/3635441211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d3670 msgr2=0x7f8f000b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/3635441211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d3670 0x7f8f000b49c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8f000d0630 tx=0x7f8ef002a180 comp rx=0 tx=0).stop 2024-05-10T08:50:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 -- 172.21.15.37:0/3635441211 shutdown_connections 2024-05-10T08:50:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/3635441211 >> v2:172.21.15.82:3300/0 conn(0x7f8f000d3a50 0x7f8f000d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/3635441211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d3670 0x7f8f000b49c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 -- 172.21.15.37:0/3635441211 >> 172.21.15.37:0/3635441211 conn(0x7f8f0009e390 msgr2=0x7f8f000d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 -- 172.21.15.37:0/3635441211 shutdown_connections 2024-05-10T08:50:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.759+0000 7f8f04cb0640 1 -- 172.21.15.37:0/3635441211 wait complete. 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.760+0000 7f8f04cb0640 1 Processor -- start 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.760+0000 7f8f04cb0640 1 -- start start 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8f04cb0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d0e80 0x7f8f00159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8f04cb0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f000d3670 0x7f8f000cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8f04cb0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f000d3a50 0x7f8f0015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8f04cb0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000d0140 con 0x7f8f000d3670 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8f04cb0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000d2730 con 0x7f8f000d3a50 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8f04cb0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8f000b4f00 con 0x7f8f000d0e80 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f000d3670 0x7f8f000cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f000d3670 0x7f8f000cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59672/0 (socket says 172.21.15.37:59672) 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 -- 172.21.15.37:0/2726272419 learned_addr learned my addr 172.21.15.37:0/2726272419 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8efe59c640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d0e80 0x7f8f00159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8efed9d640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f000d3a50 0x7f8f0015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 -- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d0e80 msgr2=0x7f8f00159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d0e80 0x7f8f00159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 -- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f000d3a50 msgr2=0x7f8f0015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f000d3a50 0x7f8f0015bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.761+0000 7f8ef7fff640 1 -- 172.21.15.37:0/2726272419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000ccb10 con 0x7f8f000d3670 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.762+0000 7f8ef7fff640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f000d3670 0x7f8f000cc130 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800e870 tx=0x7f8ee800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.762+0000 7f8ef6ffd640 1 -- 172.21.15.37:0/2726272419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8017070 con 0x7f8f000d3670 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.762+0000 7f8ef6ffd640 1 -- 172.21.15.37:0/2726272419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee800c940 con 0x7f8f000d3670 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.762+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f000ccdf0 con 0x7f8f000d3670 2024-05-10T08:50:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.762+0000 7f8ef6ffd640 1 -- 172.21.15.37:0/2726272419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800cd30 con 0x7f8f000d3670 2024-05-10T08:50:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.762+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f000cd3b0 con 0x7f8f000d3670 2024-05-10T08:50:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.763+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f000693f0 con 0x7f8f000d3670 2024-05-10T08:50:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.764+0000 7f8ef6ffd640 1 -- 172.21.15.37:0/2726272419 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ee801a070 con 0x7f8f000d3670 2024-05-10T08:50:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.764+0000 7f8ef6ffd640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ee0076300 0x7f8ee00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.764+0000 7f8ef6ffd640 1 -- 172.21.15.37:0/2726272419 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5921+0+0 (secure 0 0 0) 0x7f8ee80978d0 con 0x7f8f000d3670 2024-05-10T08:50:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.764+0000 7f8efe59c640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ee0076300 0x7f8ee00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.765+0000 7f8efe59c640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ee0076300 0x7f8ee00787c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0034000 tx=0x7f8ef002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:04.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.769+0000 7f8ef6ffd640 1 -- 172.21.15.37:0/2726272419 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8ee8060a80 con 0x7f8f000d3670 2024-05-10T08:50:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:04.958+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8f0015d6c0 con 0x7f8f000d3670 2024-05-10T08:50:05.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.628+0000 7f8ef6ffd640 1 -- 172.21.15.37:0/2726272419 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) ==== 169+0+0 (secure 0 0 0) 0x7f8ee8064d80 con 0x7f8f000d3670 2024-05-10T08:50:05.627 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.632+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ee0076300 msgr2=0x7f8ee00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.632+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ee0076300 0x7f8ee00787c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0034000 tx=0x7f8ef002e000 comp rx=0 tx=0).stop 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.632+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f000d3670 msgr2=0x7f8f000cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.632+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f000d3670 0x7f8f000cc130 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800e870 tx=0x7f8ee800ed30 comp rx=0 tx=0).stop 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 shutdown_connections 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8ee0076300 0x7f8ee00787c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f000d3a50 0x7f8f0015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f000d3670 0x7f8f000cc130 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 --2- 172.21.15.37:0/2726272419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f000d0e80 0x7f8f00159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 >> 172.21.15.37:0/2726272419 conn(0x7f8f0009e390 msgr2=0x7f8f000b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 shutdown_connections 2024-05-10T08:50:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.633+0000 7f8f04cb0640 1 -- 172.21.15.37:0/2726272419 wait complete. 2024-05-10T08:50:05.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T08:50:05.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.759+0000 7f87b73da640 1 Processor -- start 2024-05-10T08:50:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.759+0000 7f87b73da640 1 -- start start 2024-05-10T08:50:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b73da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b01629b0 0x7f87b006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b73da640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f87b00b2490 0x7f87b0070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b73da640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b006e110 con 0x7f87b0070d20 2024-05-10T08:50:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b73da640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f87b006dec0 con 0x7f87b00b2490 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b73da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f87b006e3f0 con 0x7f87b01629b0 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b5176640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b01629b0 0x7f87b006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b4975640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f87b00b2490 0x7f87b0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b5176640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b01629b0 0x7f87b006eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:39512/0 (socket says 172.21.15.37:39512) 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.760+0000 7f87b5176640 1 -- 172.21.15.37:0/921448045 learned_addr learned my addr 172.21.15.37:0/921448045 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.761+0000 7f87b5176640 1 -- 172.21.15.37:0/921448045 >> v2:172.21.15.82:3300/0 conn(0x7f87b00b2490 msgr2=0x7f87b0070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.761+0000 7f87b5176640 1 --2- 172.21.15.37:0/921448045 >> v2:172.21.15.82:3300/0 conn(0x7f87b00b2490 0x7f87b0070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.761+0000 7f87b5176640 1 -- 172.21.15.37:0/921448045 >> v1:172.21.15.82:6789/0 conn(0x7f87b0070d20 legacy=0x7f87b00afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.761+0000 7f87b5176640 1 -- 172.21.15.37:0/921448045 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b006e6d0 con 0x7f87b01629b0 2024-05-10T08:50:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b5176640 1 --2- 172.21.15.37:0/921448045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b01629b0 0x7f87b006eed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009870 tx=0x7f87ac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abaa7b515c651756 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87a7fff640 1 -- 172.21.15.37:0/921448045 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac037070 con 0x7f87b01629b0 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87a7fff640 1 -- 172.21.15.37:0/921448045 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac032440 con 0x7f87b01629b0 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87a7fff640 1 -- 172.21.15.37:0/921448045 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac032810 con 0x7f87b01629b0 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 -- 172.21.15.37:0/921448045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b01629b0 msgr2=0x7f87b006eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 --2- 172.21.15.37:0/921448045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b01629b0 0x7f87b006eed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009870 tx=0x7f87ac02a270 comp rx=0 tx=0).stop 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 -- 172.21.15.37:0/921448045 shutdown_connections 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 --2- 172.21.15.37:0/921448045 >> v2:172.21.15.82:3300/0 conn(0x7f87b00b2490 0x7f87b0070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 --2- 172.21.15.37:0/921448045 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b01629b0 0x7f87b006eed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 -- 172.21.15.37:0/921448045 >> 172.21.15.37:0/921448045 conn(0x7f87b00b49d0 msgr2=0x7f87b00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 -- 172.21.15.37:0/921448045 shutdown_connections 2024-05-10T08:50:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.762+0000 7f87b73da640 1 -- 172.21.15.37:0/921448045 wait complete. 2024-05-10T08:50:05.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 Processor -- start 2024-05-10T08:50:05.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 -- start start 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b0070d20 0x7f87b00c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b00b2490 0x7f87b00ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87b01629b0 0x7f87b00c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0070870 con 0x7f87b00b2490 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87b006f410 con 0x7f87b01629b0 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.764+0000 7f87b73da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f87b00709f0 con 0x7f87b0070d20 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b00b2490 0x7f87b00ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b00b2490 0x7f87b00ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59674/0 (socket says 172.21.15.37:59674) 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 -- 172.21.15.37:0/2994830322 learned_addr learned my addr 172.21.15.37:0/2994830322 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b5977640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87b01629b0 0x7f87b00c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b5176640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b0070d20 0x7f87b00c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 -- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b0070d20 msgr2=0x7f87b00c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b0070d20 0x7f87b00c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 -- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87b01629b0 msgr2=0x7f87b00c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87b01629b0 0x7f87b00c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 -- 172.21.15.37:0/2994830322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b00ceee0 con 0x7f87b00b2490 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b4975640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b00b2490 0x7f87b00ce440 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f87a000e9b0 tx=0x7f87a000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87a5ffb640 1 -- 172.21.15.37:0/2994830322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0017070 con 0x7f87b00b2490 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87a5ffb640 1 -- 172.21.15.37:0/2994830322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a000c9a0 con 0x7f87b00b2490 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b00cf1c0 con 0x7f87b00b2490 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.765+0000 7f87a5ffb640 1 -- 172.21.15.37:0/2994830322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a000cd90 con 0x7f87b00b2490 2024-05-10T08:50:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.766+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b00cf780 con 0x7f87b00b2490 2024-05-10T08:50:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.767+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b00693f0 con 0x7f87b00b2490 2024-05-10T08:50:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.767+0000 7f87a5ffb640 1 -- 172.21.15.37:0/2994830322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f87a001a070 con 0x7f87b00b2490 2024-05-10T08:50:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.768+0000 7f87a5ffb640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f87940762d0 0x7f8794078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.768+0000 7f87a5ffb640 1 -- 172.21.15.37:0/2994830322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f87a00978f0 con 0x7f87b00b2490 2024-05-10T08:50:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.768+0000 7f87b5176640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f87940762d0 0x7f8794078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:05.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.769+0000 7f87b5176640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f87940762d0 0x7f8794078790 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87ac034000 tx=0x7f87ac02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:05.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.772+0000 7f87a5ffb640 1 -- 172.21.15.37:0/2994830322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f87a0061310 con 0x7f87b00b2490 2024-05-10T08:50:05.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.964+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f87b00d2050 con 0x7f87b00b2490 2024-05-10T08:50:05.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.967+0000 7f87a5ffb640 1 -- 172.21.15.37:0/2994830322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f87a0060c10 con 0x7f87b00b2490 2024-05-10T08:50:05.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f87940762d0 msgr2=0x7f8794078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f87940762d0 0x7f8794078790 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87ac034000 tx=0x7f87ac02e000 comp rx=0 tx=0).stop 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b00b2490 msgr2=0x7f87b00ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b00b2490 0x7f87b00ce440 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f87a000e9b0 tx=0x7f87a000ee70 comp rx=0 tx=0).stop 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 shutdown_connections 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f87940762d0 0x7f8794078790 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87b01629b0 0x7f87b00c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b00b2490 0x7f87b00ce440 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 --2- 172.21.15.37:0/2994830322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f87b0070d20 0x7f87b00c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 >> 172.21.15.37:0/2994830322 conn(0x7f87b00b49d0 msgr2=0x7f87b0161150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 shutdown_connections 2024-05-10T08:50:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:05.970+0000 7f87b73da640 1 -- 172.21.15.37:0/2994830322 wait complete. 2024-05-10T08:50:05.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-05-10T08:50:06.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.084+0000 7f289c6e1640 1 Processor -- start 2024-05-10T08:50:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.084+0000 7f289c6e1640 1 -- start start 2024-05-10T08:50:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f289c6e1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f28941629a0 0x7f28940d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f289c6e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d0cb0 0x7f28940d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f289c6e1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28940d3330 con 0x7f28940d2dc0 2024-05-10T08:50:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f289c6e1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f28940d2170 con 0x7f28941629a0 2024-05-10T08:50:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f289c6e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f28940d2450 con 0x7f28940d0cb0 2024-05-10T08:50:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f2899c7c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f28940d2dc0 0x7f28940c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.37:47080/0 (socket says 172.21.15.37:47080) 2024-05-10T08:50:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f289a47d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f28941629a0 0x7f28940d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f2899c7c640 1 -- 172.21.15.37:0/3997197199 learned_addr learned my addr 172.21.15.37:0/3997197199 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.085+0000 7f289ac7e640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d0cb0 0x7f28940d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.086+0000 7f289947b640 1 -- 172.21.15.37:0/3997197199 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54278400 0 0) 0x7f28940d3330 con 0x7f28940d2dc0 2024-05-10T08:50:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.086+0000 7f289947b640 1 -- 172.21.15.37:0/3997197199 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2880003520 con 0x7f28940d2dc0 2024-05-10T08:50:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.086+0000 7f289a47d640 1 -- 172.21.15.37:0/3997197199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d0cb0 msgr2=0x7f28940d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.086+0000 7f289a47d640 1 --2- 172.21.15.37:0/3997197199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d0cb0 0x7f28940d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.086+0000 7f289a47d640 1 -- 172.21.15.37:0/3997197199 >> v1:172.21.15.82:6789/0 conn(0x7f28940d2dc0 legacy=0x7f28940c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.086+0000 7f289a47d640 1 -- 172.21.15.37:0/3997197199 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28940d2730 con 0x7f28941629a0 2024-05-10T08:50:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.086+0000 7f289a47d640 1 --2- 172.21.15.37:0/3997197199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28941629a0 0x7f28940d35c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f28900097a0 tx=0x7f289002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa89d239d295301 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289947b640 1 -- 172.21.15.37:0/3997197199 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890037070 con 0x7f28941629a0 2024-05-10T08:50:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289947b640 1 -- 172.21.15.37:0/3997197199 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289002adb0 con 0x7f28941629a0 2024-05-10T08:50:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289947b640 1 -- 172.21.15.37:0/3997197199 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890032660 con 0x7f28941629a0 2024-05-10T08:50:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 -- 172.21.15.37:0/3997197199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28941629a0 msgr2=0x7f28940d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 --2- 172.21.15.37:0/3997197199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28941629a0 0x7f28940d35c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f28900097a0 tx=0x7f289002a060 comp rx=0 tx=0).stop 2024-05-10T08:50:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 -- 172.21.15.37:0/3997197199 shutdown_connections 2024-05-10T08:50:06.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 --2- 172.21.15.37:0/3997197199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d0cb0 0x7f28940d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 --2- 172.21.15.37:0/3997197199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28941629a0 0x7f28940d35c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 -- 172.21.15.37:0/3997197199 >> 172.21.15.37:0/3997197199 conn(0x7f28940d4fe0 msgr2=0x7f28940d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 -- 172.21.15.37:0/3997197199 shutdown_connections 2024-05-10T08:50:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.087+0000 7f289c6e1640 1 -- 172.21.15.37:0/3997197199 wait complete. 2024-05-10T08:50:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.088+0000 7f289c6e1640 1 Processor -- start 2024-05-10T08:50:06.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289c6e1640 1 -- start start 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289c6e1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28940d0cb0 0x7f289415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289c6e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d2dc0 0x7f28940b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289c6e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28941629a0 0x7f289415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289c6e1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28940cf440 con 0x7f28941629a0 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289c6e1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f28940cf2c0 con 0x7f28940d0cb0 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289c6e1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f28940c95e0 con 0x7f28940d2dc0 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289ac7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28941629a0 0x7f289415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289ac7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28941629a0 0x7f289415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59676/0 (socket says 172.21.15.37:59676) 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.089+0000 7f289ac7e640 1 -- 172.21.15.37:0/345021996 learned_addr learned my addr 172.21.15.37:0/345021996 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f2899c7c640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d2dc0 0x7f28940b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289a47d640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28940d0cb0 0x7f289415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289ac7e640 1 -- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d2dc0 msgr2=0x7f28940b8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289ac7e640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d2dc0 0x7f28940b8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289ac7e640 1 -- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28940d0cb0 msgr2=0x7f289415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289ac7e640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28940d0cb0 0x7f289415daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289ac7e640 1 -- 172.21.15.37:0/345021996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28940b9190 con 0x7f28941629a0 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289ac7e640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28941629a0 0x7f289415e550 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f288c009dd0 tx=0x7f288c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f288affd640 1 -- 172.21.15.37:0/345021996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c018020 con 0x7f28941629a0 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f288affd640 1 -- 172.21.15.37:0/345021996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c014480 con 0x7f28941629a0 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28940b9430 con 0x7f28941629a0 2024-05-10T08:50:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f288affd640 1 -- 172.21.15.37:0/345021996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c014870 con 0x7f28941629a0 2024-05-10T08:50:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.090+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28940b99f0 con 0x7f28941629a0 2024-05-10T08:50:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.091+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28940693f0 con 0x7f28941629a0 2024-05-10T08:50:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.092+0000 7f288affd640 1 -- 172.21.15.37:0/345021996 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f288c005d10 con 0x7f28941629a0 2024-05-10T08:50:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.092+0000 7f288affd640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f28780762d0 0x7f2878078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.092+0000 7f288affd640 1 -- 172.21.15.37:0/345021996 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f288c0981c0 con 0x7f28941629a0 2024-05-10T08:50:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.093+0000 7f289a47d640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f28780762d0 0x7f2878078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.093+0000 7f289a47d640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f28780762d0 0x7f2878078790 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2890034000 tx=0x7f289002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:06.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.097+0000 7f288affd640 1 -- 172.21.15.37:0/345021996 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f288c022030 con 0x7f28941629a0 2024-05-10T08:50:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.363+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7f28940d5610 con 0x7f28941629a0 2024-05-10T08:50:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.630+0000 7f288affd640 1 -- 172.21.15.37:0/345021996 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v457) ==== 144+0+0 (secure 0 0 0) 0x7f288c010040 con 0x7f28941629a0 2024-05-10T08:50:06.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f28780762d0 msgr2=0x7f2878078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:06.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f28780762d0 0x7f2878078790 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2890034000 tx=0x7f289002e000 comp rx=0 tx=0).stop 2024-05-10T08:50:06.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28941629a0 msgr2=0x7f289415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:06.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28941629a0 0x7f289415e550 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f288c009dd0 tx=0x7f288c00c490 comp rx=0 tx=0).stop 2024-05-10T08:50:06.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 shutdown_connections 2024-05-10T08:50:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f28780762d0 0x7f2878078790 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28941629a0 0x7f289415e550 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f28940d2dc0 0x7f28940b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 --2- 172.21.15.37:0/345021996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28940d0cb0 0x7f289415daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 >> 172.21.15.37:0/345021996 conn(0x7f28940d4fe0 msgr2=0x7f28941612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 shutdown_connections 2024-05-10T08:50:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:06.632+0000 7f289c6e1640 1 -- 172.21.15.37:0/345021996 wait complete. 2024-05-10T08:50:06.643 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-05-10T08:50:06.643 INFO:tasks.cephfs_test_runner: 2024-05-10T08:50:06.643 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-10T08:50:06.644 INFO:tasks.cephfs_test_runner:Ran 7 tests in 561.454s 2024-05-10T08:50:06.644 INFO:tasks.cephfs_test_runner: 2024-05-10T08:50:06.644 INFO:tasks.cephfs_test_runner:OK 2024-05-10T08:50:06.644 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-10T08:50:06.654 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-10T08:50:06.662 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T08:50:06.662 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:50:06.662 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:50:06.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:50:06.679 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-10T08:50:06.679 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:50:06.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15811 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T08:50:06.736 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:50:06.736 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:50:06.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:50:06.755 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T08:50:06.755 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T08:50:06.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248820k,nr_inodes=812205,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497648k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T08:50:06.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:06.814 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:50:06.830 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T08:50:06.830 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T08:50:06.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:06.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T08:50:06.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:06.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T08:50:06.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:06.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-10T08:50:07.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.060 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-10T08:50:07.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-10T08:50:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-05-10T08:50:07.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:50:07.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.148 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T08:50:07.167 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-10T08:50:07.167 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T08:50:07.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T08:50:07.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T08:50:07.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T08:50:07.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.427 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T08:50:07.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T08:50:07.443 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T08:50:07.512 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-05-10T08:50:07.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:50:07.513 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T08:50:07.522 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T08:50:07.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:50:07.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.632+0000 7f8b85659640 1 Processor -- start 2024-05-10T08:50:07.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.632+0000 7f8b85659640 1 -- start start 2024-05-10T08:50:07.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.632+0000 7f8b85659640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b801524f0 0x7f8b800b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b85659640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b800b4590 con 0x7f8b8015bc80 2024-05-10T08:50:07.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b85659640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b800b4870 con 0x7f8b8006eaa0 2024-05-10T08:50:07.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b85659640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800b51a0 con 0x7f8b801524f0 2024-05-10T08:50:07.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b7e7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b8015bc80 0x7f8b8006e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40390/0 (socket says 172.21.15.37:40390) 2024-05-10T08:50:07.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b7e7fc640 1 -- 172.21.15.37:0/3108462103 learned_addr learned my addr 172.21.15.37:0/3108462103 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:07.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b7effd640 1 --2- 172.21.15.37:0/3108462103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b801524f0 0x7f8b800b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b7effd640 1 -- 172.21.15.37:0/3108462103 >> v1:172.21.15.82:6789/0 conn(0x7f8b8006eaa0 legacy=0x7f8b80073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b7effd640 1 -- 172.21.15.37:0/3108462103 >> v1:172.21.15.37:6789/0 conn(0x7f8b8015bc80 legacy=0x7f8b8006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.633+0000 7f8b7effd640 1 -- 172.21.15.37:0/3108462103 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b800b4b50 con 0x7f8b801524f0 2024-05-10T08:50:07.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.634+0000 7f8b7effd640 1 --2- 172.21.15.37:0/3108462103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b801524f0 0x7f8b800b3c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b800b5320 tx=0x7f8b7002b340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d423f914badf292a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.634+0000 7f8b7dffb640 1 -- 172.21.15.37:0/3108462103 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70038070 con 0x7f8b801524f0 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.634+0000 7f8b7dffb640 1 -- 172.21.15.37:0/3108462103 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7002be50 con 0x7f8b801524f0 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.634+0000 7f8b7dffb640 1 -- 172.21.15.37:0/3108462103 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70033860 con 0x7f8b801524f0 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.635+0000 7f8b85659640 1 -- 172.21.15.37:0/3108462103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b801524f0 msgr2=0x7f8b800b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.635+0000 7f8b85659640 1 --2- 172.21.15.37:0/3108462103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b801524f0 0x7f8b800b3c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b800b5320 tx=0x7f8b7002b340 comp rx=0 tx=0).stop 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.635+0000 7f8b85659640 1 -- 172.21.15.37:0/3108462103 shutdown_connections 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.635+0000 7f8b85659640 1 --2- 172.21.15.37:0/3108462103 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b801524f0 0x7f8b800b3c20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.635+0000 7f8b85659640 1 -- 172.21.15.37:0/3108462103 >> 172.21.15.37:0/3108462103 conn(0x7f8b8006c3a0 msgr2=0x7f8b8006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:07.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.635+0000 7f8b85659640 1 -- 172.21.15.37:0/3108462103 shutdown_connections 2024-05-10T08:50:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.635+0000 7f8b85659640 1 -- 172.21.15.37:0/3108462103 wait complete. 2024-05-10T08:50:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.636+0000 7f8b85659640 1 Processor -- start 2024-05-10T08:50:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.636+0000 7f8b85659640 1 -- start start 2024-05-10T08:50:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b85659640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8006eaa0 0x7f8b80153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b85659640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b801524f0 0x7f8b80155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b85659640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b8015bc80 0x7f8b801f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b85659640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801528d0 con 0x7f8b8006eaa0 2024-05-10T08:50:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b85659640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80073450 con 0x7f8b801524f0 2024-05-10T08:50:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b85659640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800b5630 con 0x7f8b8015bc80 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8006eaa0 0x7f8b80153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8006eaa0 0x7f8b80153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59692/0 (socket says 172.21.15.37:59692) 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b7effd640 1 -- 172.21.15.37:0/2866318642 learned_addr learned my addr 172.21.15.37:0/2866318642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b7e7fc640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b801524f0 0x7f8b80155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.637+0000 7f8b7f7fe640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b8015bc80 0x7f8b801f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b7effd640 1 -- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b8015bc80 msgr2=0x7f8b801f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b7effd640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b8015bc80 0x7f8b801f61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b7effd640 1 -- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b801524f0 msgr2=0x7f8b80155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b7effd640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b801524f0 0x7f8b80155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b7effd640 1 -- 172.21.15.37:0/2866318642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b801f66f0 con 0x7f8b8006eaa0 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b7effd640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8006eaa0 0x7f8b80153940 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8b700097d0 tx=0x7f8b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b677fe640 1 -- 172.21.15.37:0/2866318642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70042020 con 0x7f8b8006eaa0 2024-05-10T08:50:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b677fe640 1 -- 172.21.15.37:0/2866318642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7003e700 con 0x7f8b8006eaa0 2024-05-10T08:50:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b800cf5c0 con 0x7f8b8006eaa0 2024-05-10T08:50:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b677fe640 1 -- 172.21.15.37:0/2866318642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70038040 con 0x7f8b8006eaa0 2024-05-10T08:50:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.638+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b800cfb80 con 0x7f8b8006eaa0 2024-05-10T08:50:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.640+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b800693f0 con 0x7f8b8006eaa0 2024-05-10T08:50:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.640+0000 7f8b677fe640 1 -- 172.21.15.37:0/2866318642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b70045020 con 0x7f8b8006eaa0 2024-05-10T08:50:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.641+0000 7f8b677fe640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b6c076300 0x7f8b6c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.641+0000 7f8b677fe640 1 -- 172.21.15.37:0/2866318642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f8b700b7b70 con 0x7f8b8006eaa0 2024-05-10T08:50:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.641+0000 7f8b7e7fc640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b6c076300 0x7f8b6c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.641+0000 7f8b7e7fc640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b6c076300 0x7f8b6c0787c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8b801531e0 tx=0x7f8b74009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.645+0000 7f8b677fe640 1 -- 172.21.15.37:0/2866318642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8b7004c030 con 0x7f8b8006eaa0 2024-05-10T08:50:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.833+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b801535c0 con 0x7f8b6c076300 2024-05-10T08:50:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.834+0000 7f8b677fe640 1 -- 172.21.15.37:0/2866318642 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13435 (secure 0 0 0) 0x7f8b801535c0 con 0x7f8b6c076300 2024-05-10T08:50:07.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:50:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b6c076300 msgr2=0x7f8b6c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b6c076300 0x7f8b6c0787c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8b801531e0 tx=0x7f8b74009040 comp rx=0 tx=0).stop 2024-05-10T08:50:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8006eaa0 msgr2=0x7f8b80153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8006eaa0 0x7f8b80153940 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8b700097d0 tx=0x7f8b700046c0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 shutdown_connections 2024-05-10T08:50:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8b6c076300 0x7f8b6c0787c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b8015bc80 0x7f8b801f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b801524f0 0x7f8b80155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 --2- 172.21.15.37:0/2866318642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8006eaa0 0x7f8b80153940 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 >> 172.21.15.37:0/2866318642 conn(0x7f8b8006c3a0 msgr2=0x7f8b80072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 shutdown_connections 2024-05-10T08:50:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.836+0000 7f8b85659640 1 -- 172.21.15.37:0/2866318642 wait complete. 2024-05-10T08:50:07.846 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-05-10T08:50:07.469793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278780,"kb_used_data":29340,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754695940,"statfs":{"total":773094113280,"available":772808642560,"internally_reserved":0,"allocated":30044160,"data_stored":23574644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-171,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001828"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-05-10T08:50:04.627804+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:50:04.627804+0000","last_peered":"2024-05-10T08:50:04.627804+0000","last_clean":"2024-05-10T08:50:04.627804+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:50:04.627804+0000","last_undegraded":"2024-05-10T08:50:04.627804+0000","last_fullsized":"2024-05-10T08:50:04.627804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2109440,"data_stored":1290437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":5560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":5693440,"data_stored":4894172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":5564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":5697536,"data_stored":4893750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":5713920,"data_stored":4900169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":700437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1499136,"data_stored":699291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":5576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":5709824,"data_stored":4900162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2109440,"data_stored":1296226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:50:07.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:50:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.951+0000 7fb918e2c640 1 Processor -- start 2024-05-10T08:50:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.951+0000 7fb918e2c640 1 -- start start 2024-05-10T08:50:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb918e2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb914070d30 0x7fb9140d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb918e2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb914163920 0x7fb9140703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb918e2c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914071110 0x7fb91406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb918e2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb9140d10d0 con 0x7fb914070d30 2024-05-10T08:50:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb918e2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb914163db0 con 0x7fb914163920 2024-05-10T08:50:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb918e2c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb914070b80 con 0x7fb914071110 2024-05-10T08:50:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb91259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb914070d30 0x7fb9140d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb91259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb914070d30 0x7fb9140d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33402/0 (socket says 172.21.15.37:33402) 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb91259c640 1 -- 172.21.15.37:0/3692430558 learned_addr learned my addr 172.21.15.37:0/3692430558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb912d9d640 1 --2- 172.21.15.37:0/3692430558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914071110 0x7fb91406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.952+0000 7fb911d9b640 1 --2- 172.21.15.37:0/3692430558 >> v2:172.21.15.82:3300/0 conn(0x7fb914163920 0x7fb9140703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.953+0000 7fb91259c640 1 -- 172.21.15.37:0/3692430558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914071110 msgr2=0x7fb91406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.953+0000 7fb91259c640 1 --2- 172.21.15.37:0/3692430558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914071110 0x7fb91406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.953+0000 7fb91259c640 1 -- 172.21.15.37:0/3692430558 >> v2:172.21.15.82:3300/0 conn(0x7fb914163920 msgr2=0x7fb9140703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.953+0000 7fb91259c640 1 --2- 172.21.15.37:0/3692430558 >> v2:172.21.15.82:3300/0 conn(0x7fb914163920 0x7fb9140703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.953+0000 7fb91259c640 1 -- 172.21.15.37:0/3692430558 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9140708e0 con 0x7fb914070d30 2024-05-10T08:50:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.953+0000 7fb91259c640 1 --2- 172.21.15.37:0/3692430558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914070d30 0x7fb9140d20c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fb914073710 tx=0x7fb90c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c524e160dc00e21a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb91159a640 1 -- 172.21.15.37:0/3692430558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c037070 con 0x7fb914070d30 2024-05-10T08:50:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb91159a640 1 -- 172.21.15.37:0/3692430558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c032440 con 0x7fb914070d30 2024-05-10T08:50:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb91159a640 1 -- 172.21.15.37:0/3692430558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c032810 con 0x7fb914070d30 2024-05-10T08:50:07.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 -- 172.21.15.37:0/3692430558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914070d30 msgr2=0x7fb9140d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 --2- 172.21.15.37:0/3692430558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914070d30 0x7fb9140d20c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fb914073710 tx=0x7fb90c02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 -- 172.21.15.37:0/3692430558 shutdown_connections 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 --2- 172.21.15.37:0/3692430558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914071110 0x7fb91406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 --2- 172.21.15.37:0/3692430558 >> v2:172.21.15.82:3300/0 conn(0x7fb914163920 0x7fb9140703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 --2- 172.21.15.37:0/3692430558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914070d30 0x7fb9140d20c0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 -- 172.21.15.37:0/3692430558 >> 172.21.15.37:0/3692430558 conn(0x7fb9140d2e90 msgr2=0x7fb9140d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 -- 172.21.15.37:0/3692430558 shutdown_connections 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.954+0000 7fb918e2c640 1 -- 172.21.15.37:0/3692430558 wait complete. 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 Processor -- start 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 -- start start 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914070d30 0x7fb9141f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914071110 0x7fb9140b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb914163920 0x7fb9140b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140d15e0 con 0x7fb914071110 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140d1c30 con 0x7fb914163920 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb918e2c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb9140d18c0 con 0x7fb914070d30 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb911d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914071110 0x7fb9140b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.956+0000 7fb911d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914071110 0x7fb9140b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33414/0 (socket says 172.21.15.37:33414) 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb911d9b640 1 -- 172.21.15.37:0/2515002013 learned_addr learned my addr 172.21.15.37:0/2515002013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb91259c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914070d30 0x7fb9141f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb912d9d640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb914163920 0x7fb9140b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb911d9b640 1 -- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914070d30 msgr2=0x7fb9141f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb911d9b640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914070d30 0x7fb9141f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb911d9b640 1 -- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb914163920 msgr2=0x7fb9140b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb911d9b640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb914163920 0x7fb9140b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb911d9b640 1 -- 172.21.15.37:0/2515002013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9140b77d0 con 0x7fb914071110 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb911d9b640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914071110 0x7fb9140b6b50 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00e9b0 tx=0x7fb8fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb90affd640 1 -- 172.21.15.37:0/2515002013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc017070 con 0x7fb914071110 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb90affd640 1 -- 172.21.15.37:0/2515002013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00c9a0 con 0x7fb914071110 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9140b7ab0 con 0x7fb914071110 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb90affd640 1 -- 172.21.15.37:0/2515002013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00cd90 con 0x7fb914071110 2024-05-10T08:50:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.957+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9140b8070 con 0x7fb914071110 2024-05-10T08:50:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.958+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9140693f0 con 0x7fb914071110 2024-05-10T08:50:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.959+0000 7fb90affd640 1 -- 172.21.15.37:0/2515002013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8fc01a070 con 0x7fb914071110 2024-05-10T08:50:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.959+0000 7fb90affd640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f4076300 0x7fb8f40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.960+0000 7fb90affd640 1 -- 172.21.15.37:0/2515002013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7fb8fc097400 con 0x7fb914071110 2024-05-10T08:50:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.960+0000 7fb91259c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f4076300 0x7fb8f40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.960+0000 7fb91259c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f4076300 0x7fb8f40787c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb90c034000 tx=0x7fb90c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:07.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:07.964+0000 7fb90affd640 1 -- 172.21.15.37:0/2515002013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb8fc060860 con 0x7fb914071110 2024-05-10T08:50:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.149+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb91406d140 con 0x7fb8f4076300 2024-05-10T08:50:08.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.151+0000 7fb90affd640 1 -- 172.21.15.37:0/2515002013 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13435 (secure 0 0 0) 0x7fb91406d140 con 0x7fb8f4076300 2024-05-10T08:50:08.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:08.150 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:50:08.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.152+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f4076300 msgr2=0x7fb8f40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.152+0000 7fb918e2c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f4076300 0x7fb8f40787c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb90c034000 tx=0x7fb90c02e000 comp rx=0 tx=0).stop 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.152+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914071110 msgr2=0x7fb9140b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.152+0000 7fb918e2c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914071110 0x7fb9140b6b50 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00e9b0 tx=0x7fb8fc00ee70 comp rx=0 tx=0).stop 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 shutdown_connections 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb8f4076300 0x7fb8f40787c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb914163920 0x7fb9140b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb914071110 0x7fb9140b6b50 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 --2- 172.21.15.37:0/2515002013 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb914070d30 0x7fb9141f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 >> 172.21.15.37:0/2515002013 conn(0x7fb9140d2e90 msgr2=0x7fb914161d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 shutdown_connections 2024-05-10T08:50:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.153+0000 7fb918e2c640 1 -- 172.21.15.37:0/2515002013 wait complete. 2024-05-10T08:50:08.162 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-05-10T08:50:07.469793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278780,"kb_used_data":29340,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754695940,"statfs":{"total":773094113280,"available":772808642560,"internally_reserved":0,"allocated":30044160,"data_stored":23574644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-171,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001828"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-05-10T08:50:04.627804+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:50:04.627804+0000","last_peered":"2024-05-10T08:50:04.627804+0000","last_clean":"2024-05-10T08:50:04.627804+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:50:04.627804+0000","last_undegraded":"2024-05-10T08:50:04.627804+0000","last_fullsized":"2024-05-10T08:50:04.627804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2109440,"data_stored":1290437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":5560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":5693440,"data_stored":4894172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":5564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":5697536,"data_stored":4893750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":5713920,"data_stored":4900169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":700437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1499136,"data_stored":699291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":5576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":5709824,"data_stored":4900162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2109440,"data_stored":1296226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:50:08.163 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T08:50:08.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:50:08.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.269+0000 7f92d6d2b640 1 Processor -- start 2024-05-10T08:50:08.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.269+0000 7f92d6d2b640 1 -- start start 2024-05-10T08:50:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92d6d2b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92d015ccb0 0x7f92d015d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92d6d2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d0071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92d6d2b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d00718c0 con 0x7f92d00d2ce0 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92d6d2b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f92d00afba0 con 0x7f92d015ccb0 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92d6d2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f92d0071ba0 con 0x7f92d0070b90 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92cffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f92d00d2ce0 0x7f92d00d3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33600/0 (socket says 172.21.15.37:33600) 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92cffff640 1 -- 172.21.15.37:0/2907219382 learned_addr learned my addr 172.21.15.37:0/2907219382 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92d4ac7640 1 --2- 172.21.15.37:0/2907219382 >> v2:172.21.15.82:3300/0 conn(0x7f92d015ccb0 0x7f92d015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92d52c8640 1 --2- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92cf7fe640 1 -- 172.21.15.37:0/2907219382 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028500057 0 0) 0x7f92d00718c0 con 0x7f92d00d2ce0 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.270+0000 7f92cf7fe640 1 -- 172.21.15.37:0/2907219382 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c0003520 con 0x7f92d00d2ce0 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.271+0000 7f92d4ac7640 1 -- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 msgr2=0x7f92d0071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.271+0000 7f92d4ac7640 1 --2- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d0071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.271+0000 7f92cf7fe640 1 -- 172.21.15.37:0/2907219382 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3859331377 0 0) 0x7f92c0003520 con 0x7f92d00d2ce0 2024-05-10T08:50:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.271+0000 7f92d4ac7640 1 -- 172.21.15.37:0/2907219382 >> v1:172.21.15.37:6789/0 conn(0x7f92d00d2ce0 legacy=0x7f92d00d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.271+0000 7f92d4ac7640 1 -- 172.21.15.37:0/2907219382 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d0071e80 con 0x7f92d015ccb0 2024-05-10T08:50:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.271+0000 7f92d52c8640 1 --2- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d0071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.271+0000 7f92d4ac7640 1 --2- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 0x7f92d015d090 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f92c40097a0 tx=0x7f92c402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc298a2445c5a29 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92cf7fe640 1 -- 172.21.15.37:0/2907219382 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4037070 con 0x7f92d015ccb0 2024-05-10T08:50:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92cf7fe640 1 -- 172.21.15.37:0/2907219382 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c402aba0 con 0x7f92d015ccb0 2024-05-10T08:50:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92cf7fe640 1 -- 172.21.15.37:0/2907219382 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc001670 con 0x7f92d015ccb0 2024-05-10T08:50:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 -- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 msgr2=0x7f92d015d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 0x7f92d015d090 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f92c40097a0 tx=0x7f92c402a110 comp rx=0 tx=0).stop 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 -- 172.21.15.37:0/2907219382 shutdown_connections 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d0071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/2907219382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 0x7f92d015d090 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 -- 172.21.15.37:0/2907219382 >> 172.21.15.37:0/2907219382 conn(0x7f92d009ba40 msgr2=0x7f92d009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 -- 172.21.15.37:0/2907219382 shutdown_connections 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.272+0000 7f92d6d2b640 1 -- 172.21.15.37:0/2907219382 wait complete. 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.273+0000 7f92d6d2b640 1 Processor -- start 2024-05-10T08:50:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.274+0000 7f92d6d2b640 1 -- start start 2024-05-10T08:50:08.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.274+0000 7f92d6d2b640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d01f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.274+0000 7f92d6d2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92d00d2ce0 0x7f92d00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.274+0000 7f92d6d2b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 0x7f92d015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.274+0000 7f92d6d2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92d00cf980 con 0x7f92d00d2ce0 2024-05-10T08:50:08.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.274+0000 7f92d6d2b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92d0071560 con 0x7f92d015ccb0 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.274+0000 7f92d6d2b640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f92d00cfb00 con 0x7f92d0070b90 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92d00d2ce0 0x7f92d00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92d00d2ce0 0x7f92d00ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33426/0 (socket says 172.21.15.37:33426) 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 -- 172.21.15.37:0/1584993753 learned_addr learned my addr 172.21.15.37:0/1584993753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92d4ac7640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d01f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92d52c8640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 0x7f92d015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 -- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 msgr2=0x7f92d01f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d01f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 -- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 msgr2=0x7f92d015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 0x7f92d015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 -- 172.21.15.37:0/1584993753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d015e980 con 0x7f92d00d2ce0 2024-05-10T08:50:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cffff640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92d00d2ce0 0x7f92d00ccac0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c780 tx=0x7f92bc00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cd7fa640 1 -- 172.21.15.37:0/1584993753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc017070 con 0x7f92d00d2ce0 2024-05-10T08:50:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cd7fa640 1 -- 172.21.15.37:0/1584993753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc005ad0 con 0x7f92d00d2ce0 2024-05-10T08:50:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92cd7fa640 1 -- 172.21.15.37:0/1584993753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc007070 con 0x7f92d00d2ce0 2024-05-10T08:50:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d015d8e0 con 0x7f92d00d2ce0 2024-05-10T08:50:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.275+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d015dea0 con 0x7f92d00d2ce0 2024-05-10T08:50:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.276+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d0069b00 con 0x7f92d00d2ce0 2024-05-10T08:50:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.277+0000 7f92cd7fa640 1 -- 172.21.15.37:0/1584993753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92bc01a070 con 0x7f92d00d2ce0 2024-05-10T08:50:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.278+0000 7f92cd7fa640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92b40762d0 0x7f92b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.278+0000 7f92cd7fa640 1 -- 172.21.15.37:0/1584993753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f92bc0969e0 con 0x7f92d00d2ce0 2024-05-10T08:50:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.278+0000 7f92d4ac7640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92b40762d0 0x7f92b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.278+0000 7f92d4ac7640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92b40762d0 0x7f92b4078790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f92c4034000 tx=0x7f92c402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.286+0000 7f92cd7fa640 1 -- 172.21.15.37:0/1584993753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f92bc05fd30 con 0x7f92d00d2ce0 2024-05-10T08:50:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.473+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92d0070380 con 0x7f92b40762d0 2024-05-10T08:50:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.474+0000 7f92cd7fa640 1 -- 172.21.15.37:0/1584993753 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13435 (secure 0 0 0) 0x7f92d0070380 con 0x7f92b40762d0 2024-05-10T08:50:08.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:50:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92b40762d0 msgr2=0x7f92b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92b40762d0 0x7f92b4078790 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f92c4034000 tx=0x7f92c402e000 comp rx=0 tx=0).stop 2024-05-10T08:50:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92d00d2ce0 msgr2=0x7f92d00ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92d00d2ce0 0x7f92d00ccac0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c780 tx=0x7f92bc00cb80 comp rx=0 tx=0).stop 2024-05-10T08:50:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 shutdown_connections 2024-05-10T08:50:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f92b40762d0 0x7f92b4078790 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92d015ccb0 0x7f92d015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92d00d2ce0 0x7f92d00ccac0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 --2- 172.21.15.37:0/1584993753 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92d0070b90 0x7f92d01f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 >> 172.21.15.37:0/1584993753 conn(0x7f92d009ba40 msgr2=0x7f92d00b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 shutdown_connections 2024-05-10T08:50:08.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.476+0000 7f92d6d2b640 1 -- 172.21.15.37:0/1584993753 wait complete. 2024-05-10T08:50:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-05-10T08:50:07.469793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278780,"kb_used_data":29340,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754695940,"statfs":{"total":773094113280,"available":772808642560,"internally_reserved":0,"allocated":30044160,"data_stored":23574644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-171,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001828"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":300,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-05-10T08:50:04.627804+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:50:04.627804+0000","last_peered":"2024-05-10T08:50:04.627804+0000","last_clean":"2024-05-10T08:50:04.627804+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:50:04.627804+0000","last_undegraded":"2024-05-10T08:50:04.627804+0000","last_fullsized":"2024-05-10T08:50:04.627804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2109440,"data_stored":1290437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":5560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":5693440,"data_stored":4894172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":5564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":5697536,"data_stored":4893750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":5713920,"data_stored":4900169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":700437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1499136,"data_stored":699291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":5576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":5709824,"data_stored":4900162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2109440,"data_stored":1296226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:50:08.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T08:50:08.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.593+0000 7f25a502a640 1 Processor -- start 2024-05-10T08:50:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.594+0000 7f25a502a640 1 -- start start 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.594+0000 7f25a502a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25a015f420 0x7f25a00d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.594+0000 7f25a502a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a01630b0 con 0x7f25a00d2080 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.594+0000 7f25a502a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a00d2550 con 0x7f25a00d3ca0 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.594+0000 7f25a502a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f25a00d2c80 con 0x7f25a015f420 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259f59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f25a00d2080 0x7f25a00d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33616/0 (socket says 172.21.15.37:33616) 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259f59e640 1 -- 172.21.15.37:0/2052217351 learned_addr learned my addr 172.21.15.37:0/2052217351 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259ed9d640 1 --2- 172.21.15.37:0/2052217351 >> v2:172.21.15.82:3300/0 conn(0x7f25a015f420 0x7f25a00d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259dd9b640 1 -- 172.21.15.37:0/2052217351 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430741609 0 0) 0x7f2598001490 con 0x7f25a00d2080 2024-05-10T08:50:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259dd9b640 1 -- 172.21.15.37:0/2052217351 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258c003520 con 0x7f25a00d2080 2024-05-10T08:50:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259ed9d640 1 -- 172.21.15.37:0/2052217351 >> v1:172.21.15.82:6789/0 conn(0x7f25a00d3ca0 legacy=0x7f25a00d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259dd9b640 1 -- 172.21.15.37:0/2052217351 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002137802 0 0) 0x7f25a00d2550 con 0x7f25a00d3ca0 2024-05-10T08:50:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259ed9d640 1 -- 172.21.15.37:0/2052217351 >> v1:172.21.15.37:6789/0 conn(0x7f25a00d2080 legacy=0x7f25a00d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.595+0000 7f259ed9d640 1 -- 172.21.15.37:0/2052217351 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00d2f60 con 0x7f25a015f420 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.596+0000 7f259ed9d640 1 --2- 172.21.15.37:0/2052217351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a015f420 0x7f25a00d3760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f25900097a0 tx=0x7f259002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc2a0896068e9f45 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.596+0000 7f259dd9b640 1 -- 172.21.15.37:0/2052217351 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590037070 con 0x7f25a015f420 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.596+0000 7f259dd9b640 1 -- 172.21.15.37:0/2052217351 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2590032440 con 0x7f25a015f420 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.596+0000 7f259dd9b640 1 -- 172.21.15.37:0/2052217351 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590032810 con 0x7f25a015f420 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.597+0000 7f25a502a640 1 -- 172.21.15.37:0/2052217351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a015f420 msgr2=0x7f25a00d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.597+0000 7f25a502a640 1 --2- 172.21.15.37:0/2052217351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a015f420 0x7f25a00d3760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f25900097a0 tx=0x7f259002a230 comp rx=0 tx=0).stop 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.597+0000 7f25a502a640 1 -- 172.21.15.37:0/2052217351 shutdown_connections 2024-05-10T08:50:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.597+0000 7f25a502a640 1 --2- 172.21.15.37:0/2052217351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a015f420 0x7f25a00d3760 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.597+0000 7f25a502a640 1 -- 172.21.15.37:0/2052217351 >> 172.21.15.37:0/2052217351 conn(0x7f25a008eac0 msgr2=0x7f25a009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.597+0000 7f25a502a640 1 -- 172.21.15.37:0/2052217351 shutdown_connections 2024-05-10T08:50:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.597+0000 7f25a502a640 1 -- 172.21.15.37:0/2052217351 wait complete. 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.598+0000 7f25a502a640 1 Processor -- start 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.598+0000 7f25a502a640 1 -- start start 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f25a502a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25a00d2080 0x7f25a0162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f25a502a640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25a00cb6a0 0x7f25a00c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f25a502a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a00b5c30 0x7f25a00b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f25a502a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00d53d0 con 0x7f25a00d2080 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f25a502a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00d2830 con 0x7f25a00b5c30 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f25a502a640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00d5550 con 0x7f25a00cb6a0 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25a00d2080 0x7f25a0162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25a00d2080 0x7f25a0162100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33434/0 (socket says 172.21.15.37:33434) 2024-05-10T08:50:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259ed9d640 1 -- 172.21.15.37:0/965887955 learned_addr learned my addr 172.21.15.37:0/965887955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259ed9d640 1 -- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25a00cb6a0 msgr2=0x7f25a00c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259ed9d640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25a00cb6a0 0x7f25a00c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259ed9d640 1 -- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a00b5c30 msgr2=0x7f25a00b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259f59e640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a00b5c30 0x7f25a00b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.599+0000 7f259ed9d640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a00b5c30 0x7f25a00b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.600+0000 7f259ed9d640 1 -- 172.21.15.37:0/965887955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00b8130 con 0x7f25a00d2080 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.600+0000 7f259ed9d640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25a00d2080 0x7f25a0162100 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f259002a270 tx=0x7f25900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.600+0000 7f25977fe640 1 -- 172.21.15.37:0/965887955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590041070 con 0x7f25a00d2080 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.600+0000 7f25977fe640 1 -- 172.21.15.37:0/965887955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259003c890 con 0x7f25a00d2080 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.600+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a00b8410 con 0x7f25a00d2080 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.600+0000 7f25977fe640 1 -- 172.21.15.37:0/965887955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590037040 con 0x7f25a00d2080 2024-05-10T08:50:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.600+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a00b89d0 con 0x7f25a00d2080 2024-05-10T08:50:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.601+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a00693f0 con 0x7f25a00d2080 2024-05-10T08:50:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.602+0000 7f25977fe640 1 -- 172.21.15.37:0/965887955 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2590044070 con 0x7f25a00d2080 2024-05-10T08:50:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.602+0000 7f25977fe640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25800762d0 0x7f2580078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.602+0000 7f25977fe640 1 -- 172.21.15.37:0/965887955 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f25900b7e90 con 0x7f25a00d2080 2024-05-10T08:50:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.602+0000 7f259e59c640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25800762d0 0x7f2580078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.603+0000 7f259e59c640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25800762d0 0x7f2580078790 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f25a00b7f90 tx=0x7f2588007910 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:08.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.607+0000 7f25977fe640 1 -- 172.21.15.37:0/965887955 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2590081940 con 0x7f25a00d2080 2024-05-10T08:50:08.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.800+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25a00b4c50 con 0x7f25a00d2080 2024-05-10T08:50:08.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.802+0000 7f25977fe640 1 -- 172.21.15.37:0/965887955 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+13501 (secure 0 0 0) 0x7f2590081240 con 0x7f25a00d2080 2024-05-10T08:50:08.801 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:08.801 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":122,"fsid":"5ef49677-880e-4a90-bdff-f8e0a7cb5aaa","created":"2024-05-10T08:39:58.901416+0000","modified":"2024-05-10T08:50:05.624241+0000","last_up_change":"2024-05-10T08:40:09.395056+0000","last_in_change":"2024-05-10T08:40:01.055251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T08:40:11.341540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c9a4718-2633-4784-ab71-04c7aa89d0eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6813","nonce":38998236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6817","nonce":38998236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6823","nonce":38998236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":38998236},{"type":"v1","addr":"172.21.15.37:6821","nonce":38998236}]},"public_addr":"172.21.15.37:6813/38998236","cluster_addr":"172.21.15.37:6817/38998236","heartbeat_back_addr":"172.21.15.37:6823/38998236","heartbeat_front_addr":"172.21.15.37:6821/38998236","state":["exists","up"]},{"osd":1,"uuid":"ff9011a7-9ccc-497a-85ec-3aea18474d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6801","nonce":1334168884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6803","nonce":1334168884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6807","nonce":1334168884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1334168884},{"type":"v1","addr":"172.21.15.37:6805","nonce":1334168884}]},"public_addr":"172.21.15.37:6801/1334168884","cluster_addr":"172.21.15.37:6803/1334168884","heartbeat_back_addr":"172.21.15.37:6807/1334168884","heartbeat_front_addr":"172.21.15.37:6805/1334168884","state":["exists","up"]},{"osd":2,"uuid":"26b62cbb-3dfe-4b00-9677-5bcd1de28b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6809","nonce":2438867251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6812","nonce":2438867251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6820","nonce":2438867251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2438867251},{"type":"v1","addr":"172.21.15.37:6816","nonce":2438867251}]},"public_addr":"172.21.15.37:6809/2438867251","cluster_addr":"172.21.15.37:6812/2438867251","heartbeat_back_addr":"172.21.15.37:6820/2438867251","heartbeat_front_addr":"172.21.15.37:6816/2438867251","state":["exists","up"]},{"osd":3,"uuid":"63928d05-b063-47f9-81b1-4b0122a8a15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6825","nonce":1264356154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6827","nonce":1264356154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6831","nonce":1264356154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1264356154},{"type":"v1","addr":"172.21.15.37:6829","nonce":1264356154}]},"public_addr":"172.21.15.37:6825/1264356154","cluster_addr":"172.21.15.37:6827/1264356154","heartbeat_back_addr":"172.21.15.37:6831/1264356154","heartbeat_front_addr":"172.21.15.37:6829/1264356154","state":["exists","up"]},{"osd":4,"uuid":"51a5fd27-b892-46cf-b930-6e3aba97c2a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6809","nonce":3594167095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6811","nonce":3594167095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6815","nonce":3594167095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3594167095},{"type":"v1","addr":"172.21.15.82:6813","nonce":3594167095}]},"public_addr":"172.21.15.82:6809/3594167095","cluster_addr":"172.21.15.82:6811/3594167095","heartbeat_back_addr":"172.21.15.82:6815/3594167095","heartbeat_front_addr":"172.21.15.82:6813/3594167095","state":["exists","up"]},{"osd":5,"uuid":"de4214e4-0bc7-478d-8662-1add521cf7b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6801","nonce":3184821053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6803","nonce":3184821053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6807","nonce":3184821053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3184821053},{"type":"v1","addr":"172.21.15.82:6805","nonce":3184821053}]},"public_addr":"172.21.15.82:6801/3184821053","cluster_addr":"172.21.15.82:6803/3184821053","heartbeat_back_addr":"172.21.15.82:6807/3184821053","heartbeat_front_addr":"172.21.15.82:6805/3184821053","state":["exists","up"]},{"osd":6,"uuid":"04f4a5ee-892a-4376-a7c9-b0f1c24e7936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6825","nonce":3522580642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6827","nonce":3522580642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6831","nonce":3522580642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3522580642},{"type":"v1","addr":"172.21.15.82:6829","nonce":3522580642}]},"public_addr":"172.21.15.82:6825/3522580642","cluster_addr":"172.21.15.82:6827/3522580642","heartbeat_back_addr":"172.21.15.82:6831/3522580642","heartbeat_front_addr":"172.21.15.82:6829/3522580642","state":["exists","up"]},{"osd":7,"uuid":"d695235e-80d9-4065-853a-7f96a9b1dfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6817","nonce":1827186019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6819","nonce":1827186019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6823","nonce":1827186019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1827186019},{"type":"v1","addr":"172.21.15.82:6821","nonce":1827186019}]},"public_addr":"172.21.15.82:6817/1827186019","cluster_addr":"172.21.15.82:6819/1827186019","heartbeat_back_addr":"172.21.15.82:6823/1827186019","heartbeat_front_addr":"172.21.15.82:6821/1827186019","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.255666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.168358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.224643+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.257684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.166764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.318250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T08:40:06.240392+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/1002841422":"2024-05-11T08:50:02.344847+0000","172.21.15.37:6833/1002841422":"2024-05-11T08:50:02.344847+0000","172.21.15.37:6833/202078248":"2024-05-11T08:49:50.560178+0000","172.21.15.82:6837/2344331780":"2024-05-11T08:49:41.251599+0000","172.21.15.37:6835/202078248":"2024-05-11T08:49:50.560178+0000","172.21.15.82:6835/2344331780":"2024-05-11T08:49:41.251599+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T08:50:08.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25800762d0 msgr2=0x7f2580078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25800762d0 0x7f2580078790 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f25a00b7f90 tx=0x7f2588007910 comp rx=0 tx=0).stop 2024-05-10T08:50:08.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25a00d2080 msgr2=0x7f25a0162100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:08.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25a00d2080 0x7f25a0162100 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f259002a270 tx=0x7f25900046c0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 shutdown_connections 2024-05-10T08:50:08.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f25800762d0 0x7f2580078790 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a00b5c30 0x7f25a00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f25a00cb6a0 0x7f25a00c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 --2- 172.21.15.37:0/965887955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25a00d2080 0x7f25a0162100 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:08.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 >> 172.21.15.37:0/965887955 conn(0x7f25a008eac0 msgr2=0x7f25a0163290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:08.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 shutdown_connections 2024-05-10T08:50:08.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:08.804+0000 7f25a502a640 1 -- 172.21.15.37:0/965887955 wait complete. 2024-05-10T08:50:09.815 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T08:50:09.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:09.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.929+0000 7f97a3d1c640 1 Processor -- start 2024-05-10T08:50:09.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.930+0000 7f97a3d1c640 1 -- start start 2024-05-10T08:50:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.930+0000 7f97a3d1c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f979c0d3670 0x7f979c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.930+0000 7f97a3d1c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d3a50 0x7f979c0d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.930+0000 7f97a3d1c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979c0cfc00 con 0x7f979c0d0e80 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.930+0000 7f97a3d1c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f979c0d2a10 con 0x7f979c0d3670 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.930+0000 7f97a3d1c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f979c0d04b0 con 0x7f979c0d3a50 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f979c0d3670 0x7f979c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f979c0d3670 0x7f979c0b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33438/0 (socket says 172.21.15.37:33438) 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 -- 172.21.15.37:0/2048294682 learned_addr learned my addr 172.21.15.37:0/2048294682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 -- 172.21.15.37:0/2048294682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d3a50 msgr2=0x7f979c0d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 --2- 172.21.15.37:0/2048294682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d3a50 0x7f979c0d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 -- 172.21.15.37:0/2048294682 >> v1:172.21.15.82:6789/0 conn(0x7f979c0d0e80 legacy=0x7f979c0d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 -- 172.21.15.37:0/2048294682 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c0cfea0 con 0x7f979c0d3670 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.931+0000 7f97a1ab8640 1 --2- 172.21.15.37:0/2048294682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c0b49c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f979c0d0630 tx=0x7f979802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e691ec67533f7d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a0ab6640 1 -- 172.21.15.37:0/2048294682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798037070 con 0x7f979c0d3670 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a0ab6640 1 -- 172.21.15.37:0/2048294682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9798032440 con 0x7f979c0d3670 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a0ab6640 1 -- 172.21.15.37:0/2048294682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798032810 con 0x7f979c0d3670 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 -- 172.21.15.37:0/2048294682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 msgr2=0x7f979c0b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 --2- 172.21.15.37:0/2048294682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c0b49c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f979c0d0630 tx=0x7f979802a200 comp rx=0 tx=0).stop 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 -- 172.21.15.37:0/2048294682 shutdown_connections 2024-05-10T08:50:09.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 --2- 172.21.15.37:0/2048294682 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d3a50 0x7f979c0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:09.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 --2- 172.21.15.37:0/2048294682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c0b49c0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:09.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 -- 172.21.15.37:0/2048294682 >> 172.21.15.37:0/2048294682 conn(0x7f979c09e390 msgr2=0x7f979c0d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:09.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 -- 172.21.15.37:0/2048294682 shutdown_connections 2024-05-10T08:50:09.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.932+0000 7f97a3d1c640 1 -- 172.21.15.37:0/2048294682 wait complete. 2024-05-10T08:50:09.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.933+0000 7f97a3d1c640 1 Processor -- start 2024-05-10T08:50:09.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a3d1c640 1 -- start start 2024-05-10T08:50:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a3d1c640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d0e80 0x7f979c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a3d1c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a3d1c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0d3a50 0x7f979c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a3d1c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f979c0d0140 con 0x7f979c0d3670 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a3d1c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f979c0d2730 con 0x7f979c0d3a50 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a3d1c640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f979c0b4f00 con 0x7f979c0d0e80 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a12b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a12b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33448/0 (socket says 172.21.15.37:33448) 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.934+0000 7f97a12b7640 1 -- 172.21.15.37:0/1356721079 learned_addr learned my addr 172.21.15.37:0/1356721079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a1ab8640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d0e80 0x7f979c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a22b9640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0d3a50 0x7f979c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a12b7640 1 -- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d0e80 msgr2=0x7f979c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a12b7640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d0e80 0x7f979c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a12b7640 1 -- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0d3a50 msgr2=0x7f979c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a12b7640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0d3a50 0x7f979c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a12b7640 1 -- 172.21.15.37:0/1356721079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c0cd180 con 0x7f979c0d3670 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a1ab8640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f979c0d0e80 0x7f979c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a22b9640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979c0d3a50 0x7f979c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a12b7640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c150f20 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b410 tx=0x7f978c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c015020 con 0x7f979c0d3670 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c011850 con 0x7f979c0d3670 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c011c40 con 0x7f979c0d3670 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c1517c0 con 0x7f979c0d3670 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.935+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c151d80 con 0x7f979c0d3670 2024-05-10T08:50:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.936+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f979c0693f0 con 0x7f979c0d3670 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f978c018020 con 0x7f979c0d3670 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97927fc640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9780076300 0x7f97800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f978c097420 con 0x7f979c0d3670 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97927fc640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f978007c8e0 0x7f978007ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f978c00de50 con 0x7f978007c8e0 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f978c09e050 con 0x7f979c0d3670 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97a1ab8640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9780076300 0x7f97800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.937+0000 7f97a22b9640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f978007c8e0 0x7f978007ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.938+0000 7f97a22b9640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f978007c8e0 0x7f978007ed20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.938+0000 7f97a1ab8640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9780076300 0x7f97800787c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9798034000 tx=0x7f979802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.938+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== osd.0 v2:172.21.15.37:6811/38998236 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f978c00de50 con 0x7f978007c8e0 2024-05-10T08:50:09.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 --> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f979c15db00 con 0x7f978007c8e0 2024-05-10T08:50:09.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97927fc640 1 -- 172.21.15.37:0/1356721079 <== osd.0 v2:172.21.15.37:6811/38998236 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f979c15db00 con 0x7f978007c8e0 2024-05-10T08:50:09.951 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:09.951 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:09.951 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f978007c8e0 msgr2=0x7f978007ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:6811/38998236,v1:172.21.15.37:6813/38998236] conn(0x7f978007c8e0 0x7f978007ed20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9780076300 msgr2=0x7f97800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9780076300 0x7f97800787c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9798034000 tx=0x7f979802e000 comp rx=0 tx=0).stop 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 msgr2=0x7f979c150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 --2- 172.21.15.37:0/1356721079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f979c0d3670 0x7f979c150f20 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b410 tx=0x7f978c00b8d0 comp rx=0 tx=0).stop 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a22b9640 1 -- 172.21.15.37:0/1356721079 reap_dead start 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 shutdown_connections 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 >> 172.21.15.37:0/1356721079 conn(0x7f979c09e390 msgr2=0x7f979c15cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 shutdown_connections 2024-05-10T08:50:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:09.952+0000 7f97a3d1c640 1 -- 172.21.15.37:0/1356721079 wait complete. 2024-05-10T08:50:09.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T08:50:10.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.067+0000 7fa48d4fc640 1 Processor -- start 2024-05-10T08:50:10.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.067+0000 7fa48d4fc640 1 -- start start 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa48d4fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa488070d20 0x7fa4880711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa48d4fc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48806e110 con 0x7fa4881629b0 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa48d4fc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48806e3f0 con 0x7fa4880b2490 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa48d4fc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa488070a40 con 0x7fa488070d20 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa4877fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa488070d20 0x7fa4880711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa486ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa4881629b0 0x7fa48806eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33626/0 (socket says 172.21.15.37:33626) 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa486ffd640 1 -- 172.21.15.37:0/2680744017 learned_addr learned my addr 172.21.15.37:0/2680744017 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa4877fe640 1 -- 172.21.15.37:0/2680744017 >> v1:172.21.15.82:6789/0 conn(0x7fa4880b2490 legacy=0x7fa488070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa4877fe640 1 -- 172.21.15.37:0/2680744017 >> v1:172.21.15.37:6789/0 conn(0x7fa4881629b0 legacy=0x7fa48806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.068+0000 7fa4877fe640 1 -- 172.21.15.37:0/2680744017 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48806e6d0 con 0x7fa488070d20 2024-05-10T08:50:10.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.069+0000 7fa4877fe640 1 --2- 172.21.15.37:0/2680744017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880711d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e20c12b5879ac1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.069+0000 7fa4867fc640 1 -- 172.21.15.37:0/2680744017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480007740 con 0x7fa488070d20 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.069+0000 7fa4867fc640 1 -- 172.21.15.37:0/2680744017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4800078e0 con 0x7fa488070d20 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.069+0000 7fa4867fc640 1 -- 172.21.15.37:0/2680744017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480007cb0 con 0x7fa488070d20 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.070+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2680744017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 msgr2=0x7fa4880711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.070+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2680744017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880711d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48002a6f0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.070+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2680744017 shutdown_connections 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.070+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2680744017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880711d0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.070+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2680744017 >> 172.21.15.37:0/2680744017 conn(0x7fa4880b49d0 msgr2=0x7fa4880b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.070+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2680744017 shutdown_connections 2024-05-10T08:50:10.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.070+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2680744017 wait complete. 2024-05-10T08:50:10.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.071+0000 7fa48d4fc640 1 Processor -- start 2024-05-10T08:50:10.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.071+0000 7fa48d4fc640 1 -- start start 2024-05-10T08:50:10.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4880b2490 0x7fa4880caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881629b0 0x7fa4880c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880afcb0 con 0x7fa488070d20 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa48806dec0 con 0x7fa4880b2490 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa4880afe30 con 0x7fa4881629b0 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33474/0 (socket says 172.21.15.37:33474) 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 -- 172.21.15.37:0/2955010709 learned_addr learned my addr 172.21.15.37:0/2955010709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 -- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881629b0 msgr2=0x7fa4880c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881629b0 0x7fa4880c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 -- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4880b2490 msgr2=0x7fa4880caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4880b2490 0x7fa4880caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 -- 172.21.15.37:0/2955010709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4880cc220 con 0x7fa488070d20 2024-05-10T08:50:10.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa486ffd640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880caab0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c480 tx=0x7fa47800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa47f7fe640 1 -- 172.21.15.37:0/2955010709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478017070 con 0x7fa488070d20 2024-05-10T08:50:10.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa47f7fe640 1 -- 172.21.15.37:0/2955010709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478005ce0 con 0x7fa488070d20 2024-05-10T08:50:10.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4880cb6a0 con 0x7fa488070d20 2024-05-10T08:50:10.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa47f7fe640 1 -- 172.21.15.37:0/2955010709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4780072f0 con 0x7fa488070d20 2024-05-10T08:50:10.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.072+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4880cbc60 con 0x7fa488070d20 2024-05-10T08:50:10.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.073+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4880693f0 con 0x7fa488070d20 2024-05-10T08:50:10.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.074+0000 7fa47f7fe640 1 -- 172.21.15.37:0/2955010709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa47801a070 con 0x7fa488070d20 2024-05-10T08:50:10.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.074+0000 7fa47f7fe640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4680762d0 0x7fa468078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.075+0000 7fa47f7fe640 1 -- 172.21.15.37:0/2955010709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7fa478096810 con 0x7fa488070d20 2024-05-10T08:50:10.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.075+0000 7fa47ffff640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4680762d0 0x7fa468078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.075+0000 7fa47ffff640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4680762d0 0x7fa468078790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa470000f60 tx=0x7fa4700079d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.079+0000 7fa47f7fe640 1 -- 172.21.15.37:0/2955010709 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa47805fbd0 con 0x7fa488070d20 2024-05-10T08:50:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.269+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fa488161b80 con 0x7fa4680762d0 2024-05-10T08:50:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.269+0000 7fa47f7fe640 1 -- 172.21.15.37:0/2955010709 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa488161b80 con 0x7fa4680762d0 2024-05-10T08:50:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4680762d0 msgr2=0x7fa468078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4680762d0 0x7fa468078790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa470000f60 tx=0x7fa4700079d0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 msgr2=0x7fa4880caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880caab0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c480 tx=0x7fa47800c940 comp rx=0 tx=0).stop 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 shutdown_connections 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fa4680762d0 0x7fa468078790 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa4881629b0 0x7fa4880c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4880b2490 0x7fa4880caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 --2- 172.21.15.37:0/2955010709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa488070d20 0x7fa4880caab0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 >> 172.21.15.37:0/2955010709 conn(0x7fa4880b49d0 msgr2=0x7fa4880711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 shutdown_connections 2024-05-10T08:50:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.272+0000 7fa48d4fc640 1 -- 172.21.15.37:0/2955010709 wait complete. 2024-05-10T08:50:10.282 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T08:50:10.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.392+0000 7f7ad4538640 1 Processor -- start 2024-05-10T08:50:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.392+0000 7f7ad4538640 1 -- start start 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad4538640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7acc0d3a00 0x7f7acc0cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad4538640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7acc070f70 0x7f7acc071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad4538640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7acc0d0f30 con 0x7f7acc0d13e0 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad4538640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7acc0afb10 con 0x7f7acc070f70 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad4538640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7acc070ae0 con 0x7f7acc0d3a00 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad2ad5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7acc070f70 0x7f7acc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad22d4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7acc0d13e0 0x7f7acc0d17c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33634/0 (socket says 172.21.15.37:33634) 2024-05-10T08:50:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad22d4640 1 -- 172.21.15.37:0/3242075334 learned_addr learned my addr 172.21.15.37:0/3242075334 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad1ad3640 1 --2- 172.21.15.37:0/3242075334 >> v2:172.21.15.82:3300/0 conn(0x7f7acc0d3a00 0x7f7acc0cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad2ad5640 1 -- 172.21.15.37:0/3242075334 >> v2:172.21.15.82:3300/0 conn(0x7f7acc0d3a00 msgr2=0x7f7acc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad2ad5640 1 --2- 172.21.15.37:0/3242075334 >> v2:172.21.15.82:3300/0 conn(0x7f7acc0d3a00 0x7f7acc0cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad2ad5640 1 -- 172.21.15.37:0/3242075334 >> v1:172.21.15.37:6789/0 conn(0x7f7acc0d13e0 legacy=0x7f7acc0d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad12d2640 1 -- 172.21.15.37:0/3242075334 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5706100 0 0) 0x7f7acc0d0f30 con 0x7f7acc0d13e0 2024-05-10T08:50:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad2ad5640 1 -- 172.21.15.37:0/3242075334 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc070490 con 0x7f7acc070f70 2024-05-10T08:50:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.393+0000 7f7ad1ad3640 1 --2- 172.21.15.37:0/3242075334 >> v2:172.21.15.82:3300/0 conn(0x7f7acc0d3a00 0x7f7acc0cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.394+0000 7f7ad2ad5640 1 --2- 172.21.15.37:0/3242075334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc070f70 0x7f7acc071380 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f7acc073380 tx=0x7f7ac402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18b2a41e8dd74eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.394+0000 7f7ad12d2640 1 -- 172.21.15.37:0/3242075334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4007740 con 0x7f7acc070f70 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.394+0000 7f7ad12d2640 1 -- 172.21.15.37:0/3242075334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac40078e0 con 0x7f7acc070f70 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.394+0000 7f7ad12d2640 1 -- 172.21.15.37:0/3242075334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4007cb0 con 0x7f7acc070f70 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 -- 172.21.15.37:0/3242075334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc070f70 msgr2=0x7f7acc071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 --2- 172.21.15.37:0/3242075334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc070f70 0x7f7acc071380 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f7acc073380 tx=0x7f7ac402a710 comp rx=0 tx=0).stop 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 -- 172.21.15.37:0/3242075334 shutdown_connections 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 --2- 172.21.15.37:0/3242075334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc070f70 0x7f7acc071380 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 --2- 172.21.15.37:0/3242075334 >> v2:172.21.15.82:3300/0 conn(0x7f7acc0d3a00 0x7f7acc0cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 -- 172.21.15.37:0/3242075334 >> 172.21.15.37:0/3242075334 conn(0x7f7acc0d2e00 msgr2=0x7f7acc0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 -- 172.21.15.37:0/3242075334 shutdown_connections 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.395+0000 7f7ad4538640 1 -- 172.21.15.37:0/3242075334 wait complete. 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.396+0000 7f7ad4538640 1 Processor -- start 2024-05-10T08:50:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.396+0000 7f7ad4538640 1 -- start start 2024-05-10T08:50:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad4538640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7acc070f70 0x7f7acc09ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad4538640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc0d13e0 0x7f7acc153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad4538640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7acc0d3a00 0x7f7acc1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad4538640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc0d0be0 con 0x7f7acc0d13e0 2024-05-10T08:50:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad4538640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc15d660 con 0x7f7acc070f70 2024-05-10T08:50:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad4538640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc0718c0 con 0x7f7acc0d3a00 2024-05-10T08:50:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc0d13e0 0x7f7acc153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc0d13e0 0x7f7acc153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33494/0 (socket says 172.21.15.37:33494) 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 -- 172.21.15.37:0/2133654139 learned_addr learned my addr 172.21.15.37:0/2133654139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 -- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7acc0d3a00 msgr2=0x7f7acc1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7acc0d3a00 0x7f7acc1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 -- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7acc070f70 msgr2=0x7f7acc09ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7acc070f70 0x7f7acc09ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 -- 172.21.15.37:0/2133654139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc154800 con 0x7f7acc0d13e0 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ad1ad3640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc0d13e0 0x7f7acc153d80 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00d7d0 tx=0x7f7abc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.397+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc004030 con 0x7f7acc0d13e0 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.398+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7abc0041d0 con 0x7f7acc0d13e0 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.398+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7acc1f3b70 con 0x7f7acc0d13e0 2024-05-10T08:50:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.398+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0096a0 con 0x7f7acc0d13e0 2024-05-10T08:50:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.398+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7acc1f68d0 con 0x7f7acc0d13e0 2024-05-10T08:50:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.398+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7acc15cb50 con 0x7f7acc0d13e0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.399+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7abc009840 con 0x7f7acc0d13e0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ac2ffd640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab00762d0 0x7f7ab0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f7abc0977e0 con 0x7f7acc0d13e0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ac2ffd640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f7ab007c8b0 0x7f7ab007ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7abc01ee50 con 0x7f7ab007c8b0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f7abc09c2c0 con 0x7f7acc0d13e0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ad22d4640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab00762d0 0x7f7ab0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ad2ad5640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f7ab007c8b0 0x7f7ab007ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ad2ad5640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f7ab007c8b0 0x7f7ab007ecf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.400+0000 7f7ad22d4640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab00762d0 0x7f7ab0078790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8007fd0 tx=0x7f7ac8007920 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.401+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== osd.1 v2:172.21.15.37:6800/1334168884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7abc01ee50 con 0x7f7ab007c8b0 2024-05-10T08:50:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.414+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 --> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7acc0693f0 con 0x7f7ab007c8b0 2024-05-10T08:50:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/2133654139 <== osd.1 v2:172.21.15.37:6800/1334168884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7acc0693f0 con 0x7f7ab007c8b0 2024-05-10T08:50:10.413 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:10.413 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:10.414 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f7ab007c8b0 msgr2=0x7f7ab007ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:6800/1334168884,v1:172.21.15.37:6801/1334168884] conn(0x7f7ab007c8b0 0x7f7ab007ecf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab00762d0 msgr2=0x7f7ab0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f7ab00762d0 0x7f7ab0078790 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8007fd0 tx=0x7f7ac8007920 comp rx=0 tx=0).stop 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc0d13e0 msgr2=0x7f7acc153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 --2- 172.21.15.37:0/2133654139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc0d13e0 0x7f7acc153d80 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00d7d0 tx=0x7f7abc00dc90 comp rx=0 tx=0).stop 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad2ad5640 1 -- 172.21.15.37:0/2133654139 reap_dead start 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 shutdown_connections 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 >> 172.21.15.37:0/2133654139 conn(0x7f7acc0d2e00 msgr2=0x7f7acc0d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 shutdown_connections 2024-05-10T08:50:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.415+0000 7f7ad4538640 1 -- 172.21.15.37:0/2133654139 wait complete. 2024-05-10T08:50:10.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T08:50:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.530+0000 7f4546093640 1 Processor -- start 2024-05-10T08:50:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f4546093640 1 -- start start 2024-05-10T08:50:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f4546093640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f454015f420 0x7f45400d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f4546093640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f45400d3ca0 0x7f45400d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f4546093640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45400d1eb0 0x7f45400d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f4546093640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f45400d22f0 con 0x7f45400d1eb0 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f4546093640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f45401630b0 con 0x7f45400d3ca0 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f4546093640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45400d2550 con 0x7f454015f420 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.531+0000 7f453ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45400d1eb0 0x7f45400d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45400d1eb0 0x7f45400d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33500/0 (socket says 172.21.15.37:33500) 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453ffff640 1 -- 172.21.15.37:0/1890598822 learned_addr learned my addr 172.21.15.37:0/1890598822 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453effd640 1 --2- 172.21.15.37:0/1890598822 >> v2:172.21.15.82:3300/0 conn(0x7f45400d3ca0 0x7f45400d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453f7fe640 1 --2- 172.21.15.37:0/1890598822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f454015f420 0x7f45400d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453ffff640 1 -- 172.21.15.37:0/1890598822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f454015f420 msgr2=0x7f45400d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453ffff640 1 --2- 172.21.15.37:0/1890598822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f454015f420 0x7f45400d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453ffff640 1 -- 172.21.15.37:0/1890598822 >> v2:172.21.15.82:3300/0 conn(0x7f45400d3ca0 msgr2=0x7f45400d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453ffff640 1 --2- 172.21.15.37:0/1890598822 >> v2:172.21.15.82:3300/0 conn(0x7f45400d3ca0 0x7f45400d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453ffff640 1 -- 172.21.15.37:0/1890598822 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45400d2c80 con 0x7f45400d1eb0 2024-05-10T08:50:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.532+0000 7f453effd640 1 --2- 172.21.15.37:0/1890598822 >> v2:172.21.15.82:3300/0 conn(0x7f45400d3ca0 0x7f45400d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f453ffff640 1 --2- 172.21.15.37:0/1890598822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45400d1eb0 0x7f45400d4cc0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f45400b7b90 tx=0x7f453802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc504b4785be2785 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f453e7fc640 1 -- 172.21.15.37:0/1890598822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538036070 con 0x7f45400d1eb0 2024-05-10T08:50:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f453e7fc640 1 -- 172.21.15.37:0/1890598822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4538031600 con 0x7f45400d1eb0 2024-05-10T08:50:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f453e7fc640 1 -- 172.21.15.37:0/1890598822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45380319d0 con 0x7f45400d1eb0 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 -- 172.21.15.37:0/1890598822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45400d1eb0 msgr2=0x7f45400d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 --2- 172.21.15.37:0/1890598822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45400d1eb0 0x7f45400d4cc0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f45400b7b90 tx=0x7f453802a6a0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 -- 172.21.15.37:0/1890598822 shutdown_connections 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 --2- 172.21.15.37:0/1890598822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45400d1eb0 0x7f45400d4cc0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 --2- 172.21.15.37:0/1890598822 >> v2:172.21.15.82:3300/0 conn(0x7f45400d3ca0 0x7f45400d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 --2- 172.21.15.37:0/1890598822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f454015f420 0x7f45400d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 -- 172.21.15.37:0/1890598822 >> 172.21.15.37:0/1890598822 conn(0x7f454008eac0 msgr2=0x7f454009e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 -- 172.21.15.37:0/1890598822 shutdown_connections 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.533+0000 7f4546093640 1 -- 172.21.15.37:0/1890598822 wait complete. 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 Processor -- start 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 -- start start 2024-05-10T08:50:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45400d1eb0 0x7f45400ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454015a260 0x7f45400cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45401f5b60 0x7f45400b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45400d2830 con 0x7f454015a260 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45400d3240 con 0x7f45401f5b60 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.535+0000 7f4546093640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45400d5200 con 0x7f45400d1eb0 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454015a260 0x7f45400cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454015a260 0x7f45400cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33512/0 (socket says 172.21.15.37:33512) 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 -- 172.21.15.37:0/3280602600 learned_addr learned my addr 172.21.15.37:0/3280602600 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453f7fe640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45400d1eb0 0x7f45400ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453ffff640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45401f5b60 0x7f45400b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 -- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45400d1eb0 msgr2=0x7f45400ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45400d1eb0 0x7f45400ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 -- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45401f5b60 msgr2=0x7f45400b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45401f5b60 0x7f45400b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 -- 172.21.15.37:0/3280602600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454015a6c0 con 0x7f454015a260 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f453effd640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454015a260 0x7f45400cd9f0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f453400e870 tx=0x7f453400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f4527fff640 1 -- 172.21.15.37:0/3280602600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453400f040 con 0x7f454015a260 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f4527fff640 1 -- 172.21.15.37:0/3280602600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4534004230 con 0x7f454015a260 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45400cdf30 con 0x7f454015a260 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f4527fff640 1 -- 172.21.15.37:0/3280602600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534009e30 con 0x7f454015a260 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.536+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45400cec80 con 0x7f454015a260 2024-05-10T08:50:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.537+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45400693f0 con 0x7f454015a260 2024-05-10T08:50:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.538+0000 7f4527fff640 1 -- 172.21.15.37:0/3280602600 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f453400c670 con 0x7f454015a260 2024-05-10T08:50:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.538+0000 7f4527fff640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f452c0762d0 0x7f452c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.538+0000 7f4527fff640 1 -- 172.21.15.37:0/3280602600 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f45340970b0 con 0x7f454015a260 2024-05-10T08:50:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.539+0000 7f453f7fe640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f452c0762d0 0x7f452c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.539+0000 7f453f7fe640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f452c0762d0 0x7f452c078790 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f45300079a0 tx=0x7f4530008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.543+0000 7f4527fff640 1 -- 172.21.15.37:0/3280602600 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f4534017020 con 0x7f454015a260 2024-05-10T08:50:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.732+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f45400b4c50 con 0x7f452c0762d0 2024-05-10T08:50:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.733+0000 7f4527fff640 1 -- 172.21.15.37:0/3280602600 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45400b4c50 con 0x7f452c0762d0 2024-05-10T08:50:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f452c0762d0 msgr2=0x7f452c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f452c0762d0 0x7f452c078790 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f45300079a0 tx=0x7f4530008040 comp rx=0 tx=0).stop 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454015a260 msgr2=0x7f45400cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454015a260 0x7f45400cd9f0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f453400e870 tx=0x7f453400ed30 comp rx=0 tx=0).stop 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 shutdown_connections 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f452c0762d0 0x7f452c078790 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45401f5b60 0x7f45400b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454015a260 0x7f45400cd9f0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 --2- 172.21.15.37:0/3280602600 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45400d1eb0 0x7f45400ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 >> 172.21.15.37:0/3280602600 conn(0x7f454008eac0 msgr2=0x7f45400b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 shutdown_connections 2024-05-10T08:50:10.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.735+0000 7f4546093640 1 -- 172.21.15.37:0/3280602600 wait complete. 2024-05-10T08:50:10.744 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T08:50:10.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:10.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.854+0000 7f38f3eb4640 1 Processor -- start 2024-05-10T08:50:10.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.854+0000 7f38f3eb4640 1 -- start start 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f3eb4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38ec06ff10 0x7f38ec0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f3eb4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 0x7f38ec15d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f3eb4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38ec0af740 0x7f38ec0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f3eb4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f38ec15dc80 con 0x7f38ec0af740 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f3eb4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f38ec0b4b70 con 0x7f38ec06ff10 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f3eb4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec15dec0 con 0x7f38ec15d2c0 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38ec0af740 0x7f38ec0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38ec0af740 0x7f38ec0afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33518/0 (socket says 172.21.15.37:33518) 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 -- 172.21.15.37:0/4285270340 learned_addr learned my addr 172.21.15.37:0/4285270340 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f1c50640 1 --2- 172.21.15.37:0/4285270340 >> v2:172.21.15.82:3300/0 conn(0x7f38ec06ff10 0x7f38ec0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f144f640 1 --2- 172.21.15.37:0/4285270340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 0x7f38ec15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 -- 172.21.15.37:0/4285270340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 msgr2=0x7f38ec15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 --2- 172.21.15.37:0/4285270340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 0x7f38ec15d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 -- 172.21.15.37:0/4285270340 >> v2:172.21.15.82:3300/0 conn(0x7f38ec06ff10 msgr2=0x7f38ec0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 --2- 172.21.15.37:0/4285270340 >> v2:172.21.15.82:3300/0 conn(0x7f38ec06ff10 0x7f38ec0b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f2451640 1 -- 172.21.15.37:0/4285270340 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec15e1a0 con 0x7f38ec0af740 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.855+0000 7f38f1c50640 1 --2- 172.21.15.37:0/4285270340 >> v2:172.21.15.82:3300/0 conn(0x7f38ec06ff10 0x7f38ec0b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.856+0000 7f38f2451640 1 --2- 172.21.15.37:0/4285270340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0af740 0x7f38ec0afbb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0743b0 tx=0x7f38e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3f1b8be958f7ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.856+0000 7f38f0c4e640 1 -- 172.21.15.37:0/4285270340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4036070 con 0x7f38ec0af740 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.856+0000 7f38f0c4e640 1 -- 172.21.15.37:0/4285270340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e4031600 con 0x7f38ec0af740 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.856+0000 7f38f0c4e640 1 -- 172.21.15.37:0/4285270340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e40319d0 con 0x7f38ec0af740 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 -- 172.21.15.37:0/4285270340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0af740 msgr2=0x7f38ec0afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 --2- 172.21.15.37:0/4285270340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0af740 0x7f38ec0afbb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0743b0 tx=0x7f38e402a6a0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 -- 172.21.15.37:0/4285270340 shutdown_connections 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 --2- 172.21.15.37:0/4285270340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0af740 0x7f38ec0afbb0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 --2- 172.21.15.37:0/4285270340 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 0x7f38ec15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 --2- 172.21.15.37:0/4285270340 >> v2:172.21.15.82:3300/0 conn(0x7f38ec06ff10 0x7f38ec0b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 -- 172.21.15.37:0/4285270340 >> 172.21.15.37:0/4285270340 conn(0x7f38ec06c3a0 msgr2=0x7f38ec06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 -- 172.21.15.37:0/4285270340 shutdown_connections 2024-05-10T08:50:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.857+0000 7f38f3eb4640 1 -- 172.21.15.37:0/4285270340 wait complete. 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.858+0000 7f38f3eb4640 1 Processor -- start 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.858+0000 7f38f3eb4640 1 -- start start 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f3eb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec06ff10 0x7f38ec15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f3eb4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38ec0af740 0x7f38ec147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f3eb4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 0x7f38ec1f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f3eb4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0b00f0 con 0x7f38ec06ff10 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f3eb4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0b4110 con 0x7f38ec0af740 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f3eb4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec0702f0 con 0x7f38ec15d2c0 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec06ff10 0x7f38ec15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec06ff10 0x7f38ec15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33524/0 (socket says 172.21.15.37:33524) 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 -- 172.21.15.37:0/2323215070 learned_addr learned my addr 172.21.15.37:0/2323215070 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f2451640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 0x7f38ec1f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f144f640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38ec0af740 0x7f38ec147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 -- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 msgr2=0x7f38ec1f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38ec15d2c0 0x7f38ec1f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 -- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38ec0af740 msgr2=0x7f38ec147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38ec0af740 0x7f38ec147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f1c50640 1 -- 172.21.15.37:0/2323215070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec147bb0 con 0x7f38ec06ff10 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.859+0000 7f38f144f640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38ec0af740 0x7f38ec147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.860+0000 7f38f1c50640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec06ff10 0x7f38ec15a4a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f38e800e7e0 tx=0x7f38e800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.860+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e800f040 con 0x7f38ec06ff10 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.860+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e8004030 con 0x7f38ec06ff10 2024-05-10T08:50:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.860+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec1541c0 con 0x7f38ec06ff10 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.860+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8004400 con 0x7f38ec06ff10 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.860+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec154780 con 0x7f38ec06ff10 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.861+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38ec153f70 con 0x7f38ec06ff10 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38e800c6d0 con 0x7f38ec06ff10 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38e27fc640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38d0076300 0x7f38d00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f38e8097730 con 0x7f38ec06ff10 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38e27fc640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f38d007c8e0 0x7f38d007ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38e8008eb0 con 0x7f38d007c8e0 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f38e8097bc0 con 0x7f38ec06ff10 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38f144f640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38d0076300 0x7f38d00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.862+0000 7f38f2451640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f38d007c8e0 0x7f38d007ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.863+0000 7f38f2451640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f38d007c8e0 0x7f38d007ed20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.863+0000 7f38f144f640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38d0076300 0x7f38d00787c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f38dc006fd0 tx=0x7f38dc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.863+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== osd.2 v2:172.21.15.37:6808/2438867251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38e8008eb0 con 0x7f38d007c8e0 2024-05-10T08:50:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.876+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 --> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f38ec0693f0 con 0x7f38d007c8e0 2024-05-10T08:50:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38e27fc640 1 -- 172.21.15.37:0/2323215070 <== osd.2 v2:172.21.15.37:6808/2438867251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f38ec0693f0 con 0x7f38d007c8e0 2024-05-10T08:50:10.875 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:10.876 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:10.876 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f38d007c8e0 msgr2=0x7f38d007ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:6808/2438867251,v1:172.21.15.37:6809/2438867251] conn(0x7f38d007c8e0 0x7f38d007ed20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38d0076300 msgr2=0x7f38d00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f38d0076300 0x7f38d00787c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f38dc006fd0 tx=0x7f38dc008040 comp rx=0 tx=0).stop 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec06ff10 msgr2=0x7f38ec15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 --2- 172.21.15.37:0/2323215070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec06ff10 0x7f38ec15a4a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f38e800e7e0 tx=0x7f38e800eca0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f2451640 1 -- 172.21.15.37:0/2323215070 reap_dead start 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 shutdown_connections 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 >> 172.21.15.37:0/2323215070 conn(0x7f38ec06c3a0 msgr2=0x7f38ec15f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 shutdown_connections 2024-05-10T08:50:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.877+0000 7f38f3eb4640 1 -- 172.21.15.37:0/2323215070 wait complete. 2024-05-10T08:50:10.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T08:50:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.992+0000 7f2db95da640 1 Processor -- start 2024-05-10T08:50:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.992+0000 7f2db95da640 1 -- start start 2024-05-10T08:50:10.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db95da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2db415f2d0 0x7f2db40b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db95da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40d5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db95da640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db41606c0 con 0x7f2db40d4fc0 2024-05-10T08:50:10.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db95da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2db40d2780 con 0x7f2db415f2d0 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db95da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2db40d5960 con 0x7f2db40d2310 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2db415f2d0 0x7f2db40b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2db415f2d0 0x7f2db40b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33528/0 (socket says 172.21.15.37:33528) 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.993+0000 7f2db2ffd640 1 -- 172.21.15.37:0/3830785038 learned_addr learned my addr 172.21.15.37:0/3830785038 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db37fe640 1 --2- 172.21.15.37:0/3830785038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db1ffb640 1 -- 172.21.15.37:0/3830785038 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696664105 0 0) 0x7f2db41606c0 con 0x7f2db40d4fc0 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db1ffb640 1 -- 172.21.15.37:0/3830785038 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2da0003520 con 0x7f2db40d4fc0 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db2ffd640 1 -- 172.21.15.37:0/3830785038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 msgr2=0x7f2db40d5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db2ffd640 1 --2- 172.21.15.37:0/3830785038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40d5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db2ffd640 1 -- 172.21.15.37:0/3830785038 >> v1:172.21.15.37:6789/0 conn(0x7f2db40d4fc0 legacy=0x7f2db40d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db2ffd640 1 -- 172.21.15.37:0/3830785038 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db40b4f00 con 0x7f2db415f2d0 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.994+0000 7f2db2ffd640 1 --2- 172.21.15.37:0/3830785038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db415f2d0 0x7f2db40b5ca0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009e50 tx=0x7f2da402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d64db3fdb59e2c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db1ffb640 1 -- 172.21.15.37:0/3830785038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4036070 con 0x7f2db415f2d0 2024-05-10T08:50:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db1ffb640 1 -- 172.21.15.37:0/3830785038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da4031600 con 0x7f2db415f2d0 2024-05-10T08:50:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db1ffb640 1 -- 172.21.15.37:0/3830785038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da40319d0 con 0x7f2db415f2d0 2024-05-10T08:50:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 -- 172.21.15.37:0/3830785038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db415f2d0 msgr2=0x7f2db40b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 --2- 172.21.15.37:0/3830785038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db415f2d0 0x7f2db40b5ca0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009e50 tx=0x7f2da402a710 comp rx=0 tx=0).stop 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 -- 172.21.15.37:0/3830785038 shutdown_connections 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 --2- 172.21.15.37:0/3830785038 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40d5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 --2- 172.21.15.37:0/3830785038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db415f2d0 0x7f2db40b5ca0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 -- 172.21.15.37:0/3830785038 >> 172.21.15.37:0/3830785038 conn(0x7f2db40746d0 msgr2=0x7f2db409e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 -- 172.21.15.37:0/3830785038 shutdown_connections 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.995+0000 7f2db95da640 1 -- 172.21.15.37:0/3830785038 wait complete. 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 Processor -- start 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 -- start start 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40d4fc0 0x7f2db40b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db415f2d0 0x7f2db415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2db40b54a0 con 0x7f2db40d4fc0 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2db40b5810 con 0x7f2db415f2d0 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db95da640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2db40d2c00 con 0x7f2db40d2310 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40d4fc0 0x7f2db40b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40d4fc0 0x7f2db40b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33544/0 (socket says 172.21.15.37:33544) 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.997+0000 7f2db27fc640 1 -- 172.21.15.37:0/1258949535 learned_addr learned my addr 172.21.15.37:0/1258949535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db37fe640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db415f2d0 0x7f2db415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db2ffd640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db27fc640 1 -- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 msgr2=0x7f2db40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db27fc640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db27fc640 1 -- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db415f2d0 msgr2=0x7f2db415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db27fc640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db415f2d0 0x7f2db415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db27fc640 1 -- 172.21.15.37:0/1258949535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db40cd130 con 0x7f2db40d4fc0 2024-05-10T08:50:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db27fc640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40d4fc0 0x7f2db40b3610 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c500 tx=0x7f2d9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2dab7fe640 1 -- 172.21.15.37:0/1258949535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0052d0 con 0x7f2db40d4fc0 2024-05-10T08:50:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2dab7fe640 1 -- 172.21.15.37:0/1258949535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9c005490 con 0x7f2db40d4fc0 2024-05-10T08:50:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2dab7fe640 1 -- 172.21.15.37:0/1258949535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c012870 con 0x7f2db40d4fc0 2024-05-10T08:50:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db40cd410 con 0x7f2db40d4fc0 2024-05-10T08:50:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.998+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db40cd9d0 con 0x7f2db40d4fc0 2024-05-10T08:50:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:10.999+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db4069b00 con 0x7f2db40d4fc0 2024-05-10T08:50:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.000+0000 7f2dab7fe640 1 -- 172.21.15.37:0/1258949535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d9c012a10 con 0x7f2db40d4fc0 2024-05-10T08:50:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.000+0000 7f2dab7fe640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d940762d0 0x7f2d94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.000+0000 7f2dab7fe640 1 -- 172.21.15.37:0/1258949535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f2d9c097170 con 0x7f2db40d4fc0 2024-05-10T08:50:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.001+0000 7f2db2ffd640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d940762d0 0x7f2d94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.001+0000 7f2db2ffd640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d940762d0 0x7f2d94078790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2da4033000 tx=0x7f2da4009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.005+0000 7f2dab7fe640 1 -- 172.21.15.37:0/1258949535 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2d9c0604b0 con 0x7f2db40d4fc0 2024-05-10T08:50:11.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.195+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2db40b4b60 con 0x7f2d940762d0 2024-05-10T08:50:11.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.196+0000 7f2dab7fe640 1 -- 172.21.15.37:0/1258949535 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2db40b4b60 con 0x7f2d940762d0 2024-05-10T08:50:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d940762d0 msgr2=0x7f2d94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d940762d0 0x7f2d94078790 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2da4033000 tx=0x7f2da4009000 comp rx=0 tx=0).stop 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40d4fc0 msgr2=0x7f2db40b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40d4fc0 0x7f2db40b3610 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c500 tx=0x7f2d9c00c9c0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 shutdown_connections 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2d940762d0 0x7f2d94078790 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db415f2d0 0x7f2db415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40d4fc0 0x7f2db40b3610 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 --2- 172.21.15.37:0/1258949535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2db40d2310 0x7f2db40ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 >> 172.21.15.37:0/1258949535 conn(0x7f2db40746d0 msgr2=0x7f2db40cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 shutdown_connections 2024-05-10T08:50:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.198+0000 7f2db95da640 1 -- 172.21.15.37:0/1258949535 wait complete. 2024-05-10T08:50:11.207 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T08:50:11.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:11.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.316+0000 7f33539af640 1 Processor -- start 2024-05-10T08:50:11.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.317+0000 7f33539af640 1 -- start start 2024-05-10T08:50:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.317+0000 7f33539af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 0x7f334c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.317+0000 7f33539af640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f334c0d22f0 0x7f334c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.317+0000 7f33539af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334c0cd610 con 0x7f334c15f710 2024-05-10T08:50:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.317+0000 7f33539af640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f334c0d2840 con 0x7f334c0d22f0 2024-05-10T08:50:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.317+0000 7f33539af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f334c0cd880 con 0x7f334c0cfeb0 2024-05-10T08:50:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f335174b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f334c15f710 0x7f334c0cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33656/0 (socket says 172.21.15.37:33656) 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f335174b640 1 -- 172.21.15.37:0/3637450292 learned_addr learned my addr 172.21.15.37:0/3637450292 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f3351f4c640 1 --2- 172.21.15.37:0/3637450292 >> v2:172.21.15.82:3300/0 conn(0x7f334c0d22f0 0x7f334c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f3350f4a640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 0x7f334c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368651354 0 0) 0x7f334c0cd610 con 0x7f334c15f710 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3334003520 con 0x7f334c15f710 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3154500482 0 0) 0x7f3334003520 con 0x7f334c15f710 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 msgr2=0x7f334c0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 0x7f334c0d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 >> v2:172.21.15.82:3300/0 conn(0x7f334c0d22f0 msgr2=0x7f334c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 --2- 172.21.15.37:0/3637450292 >> v2:172.21.15.82:3300/0 conn(0x7f334c0d22f0 0x7f334c0ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c0cdb60 con 0x7f334c15f710 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f3344001670 con 0x7f334c15f710 2024-05-10T08:50:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f3351f4c640 1 --2- 172.21.15.37:0/3637450292 >> v2:172.21.15.82:3300/0 conn(0x7f334c0d22f0 0x7f334c0ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 >> v1:172.21.15.37:6789/0 conn(0x7f334c15f710 legacy=0x7f334c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 0x7f33340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3334003f30 0x7f3334004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3334004d40 0x7f33340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f334c0d2840 con 0x7f3334004d40 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f334c0cd880 con 0x7f3334003f30 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f333400b9c0 con 0x7f334c0cfeb0 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f3351f4c640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3334004d40 0x7f33340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f335174b640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 0x7f33340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.318+0000 7f3350f4a640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3334003f30 0x7f3334004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.319+0000 7f3351f4c640 1 -- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 msgr2=0x7f33340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.319+0000 7f3351f4c640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c0cfeb0 0x7f33340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.319+0000 7f3351f4c640 1 -- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3334003f30 msgr2=0x7f3334004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.319+0000 7f3351f4c640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3334003f30 0x7f3334004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.319+0000 7f3351f4c640 1 -- 172.21.15.37:0/3637450292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3334003520 con 0x7f3334004d40 2024-05-10T08:50:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.319+0000 7f3351f4c640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3334004d40 0x7f33340051c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f333c00e350 tx=0x7f3334005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febf89e126f01721 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.319+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c009de0 con 0x7f3334004d40 2024-05-10T08:50:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333c02e650 con 0x7f3334004d40 2024-05-10T08:50:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f334bfff640 1 -- 172.21.15.37:0/3637450292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c02ea00 con 0x7f3334004d40 2024-05-10T08:50:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f33539af640 1 -- 172.21.15.37:0/3637450292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3334004d40 msgr2=0x7f33340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f33539af640 1 --2- 172.21.15.37:0/3637450292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3334004d40 0x7f33340051c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f333c00e350 tx=0x7f3334005830 comp rx=0 tx=0).stop 2024-05-10T08:50:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f3351f4c640 1 -- 172.21.15.37:0/3637450292 reap_dead start 2024-05-10T08:50:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f33539af640 1 -- 172.21.15.37:0/3637450292 shutdown_connections 2024-05-10T08:50:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f33539af640 1 -- 172.21.15.37:0/3637450292 >> 172.21.15.37:0/3637450292 conn(0x7f334c0d2f20 msgr2=0x7f334c0d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f33539af640 1 -- 172.21.15.37:0/3637450292 shutdown_connections 2024-05-10T08:50:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.320+0000 7f33539af640 1 -- 172.21.15.37:0/3637450292 wait complete. 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.321+0000 7f33539af640 1 Processor -- start 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.321+0000 7f33539af640 1 -- start start 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f33539af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f334c1eeff0 0x7f334c1f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f33539af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f334c0c6980 0x7f334c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f33539af640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c15ab70 0x7f334c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f33539af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f334c06e970 con 0x7f334c1eeff0 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f33539af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f334c06e7f0 con 0x7f334c0c6980 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f33539af640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f334c0d1320 con 0x7f334c15ab70 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f335174b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f334c1eeff0 0x7f334c1f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f335174b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f334c1eeff0 0x7f334c1f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33552/0 (socket says 172.21.15.37:33552) 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f335174b640 1 -- 172.21.15.37:0/2885932514 learned_addr learned my addr 172.21.15.37:0/2885932514 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f3350f4a640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f334c0c6980 0x7f334c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f3351f4c640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c15ab70 0x7f334c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f335174b640 1 -- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c15ab70 msgr2=0x7f334c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f335174b640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c15ab70 0x7f334c0b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f335174b640 1 -- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f334c0c6980 msgr2=0x7f334c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.322+0000 7f335174b640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f334c0c6980 0x7f334c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f335174b640 1 -- 172.21.15.37:0/2885932514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c1f6070 con 0x7f334c1eeff0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f3351f4c640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f334c15ab70 0x7f334c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f335174b640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f334c1eeff0 0x7f334c1f5b30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f33440072c0 tx=0x7f3344007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334401a070 con 0x7f334c1eeff0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334400fa20 con 0x7f334c1eeff0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c0c6f00 con 0x7f334c1eeff0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334400fe10 con 0x7f334c1eeff0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.323+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c0c74c0 con 0x7f334c1eeff0 2024-05-10T08:50:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.324+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f334c069b00 con 0x7f334c1eeff0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.324+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f334401d070 con 0x7f334c1eeff0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.325+0000 7f3349ffb640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3338076300 0x7f33380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.325+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f3344096fb0 con 0x7f334c1eeff0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.325+0000 7f3350f4a640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3338076300 0x7f33380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.325+0000 7f3349ffb640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7f333807c8e0 0x7f333807ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.325+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3344019ec0 con 0x7f333807c8e0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.325+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f334409e050 con 0x7f334c1eeff0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.326+0000 7f3351f4c640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7f333807c8e0 0x7f333807ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.326+0000 7f3350f4a640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3338076300 0x7f33380787c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f334c0719c0 tx=0x7f3340008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.326+0000 7f3351f4c640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7f333807c8e0 0x7f333807ed20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.326+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== osd.3 v2:172.21.15.37:6824/1264356154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3344019ec0 con 0x7f333807c8e0 2024-05-10T08:50:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 --> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f334c0b2660 con 0x7f333807c8e0 2024-05-10T08:50:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f3349ffb640 1 -- 172.21.15.37:0/2885932514 <== osd.3 v2:172.21.15.37:6824/1264356154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f334c0b2660 con 0x7f333807c8e0 2024-05-10T08:50:11.339 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:11.339 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:11.339 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7f333807c8e0 msgr2=0x7f333807ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:6824/1264356154,v1:172.21.15.37:6825/1264356154] conn(0x7f333807c8e0 0x7f333807ed20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3338076300 msgr2=0x7f33380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f3338076300 0x7f33380787c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f334c0719c0 tx=0x7f3340008040 comp rx=0 tx=0).stop 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f334c1eeff0 msgr2=0x7f334c1f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 --2- 172.21.15.37:0/2885932514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f334c1eeff0 0x7f334c1f5b30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f33440072c0 tx=0x7f3344007780 comp rx=0 tx=0).stop 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f3351f4c640 1 -- 172.21.15.37:0/2885932514 reap_dead start 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 shutdown_connections 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 >> 172.21.15.37:0/2885932514 conn(0x7f334c0d2f20 msgr2=0x7f334c0d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 shutdown_connections 2024-05-10T08:50:11.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.340+0000 7f33539af640 1 -- 172.21.15.37:0/2885932514 wait complete. 2024-05-10T08:50:11.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T08:50:11.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.456+0000 7f02006d3640 1 Processor -- start 2024-05-10T08:50:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.456+0000 7f02006d3640 1 -- start start 2024-05-10T08:50:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f02006d3640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f815f380 0x7f01f80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f02006d3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01f80d3cd0 0x7f01f80b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f02006d3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f80d1760 con 0x7f01f80d0cf0 2024-05-10T08:50:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f02006d3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f01f80d30f0 con 0x7f01f80d3cd0 2024-05-10T08:50:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f02006d3640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f01f80d1150 con 0x7f01f815f380 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f01fec70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01f80d3cd0 0x7f01f80b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f01fdc6e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f01f80d0cf0 0x7f01f80d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33660/0 (socket says 172.21.15.37:33660) 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f01fec70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01f80d3cd0 0x7f01f80b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33554/0 (socket says 172.21.15.37:33554) 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.457+0000 7f01fdc6e640 1 -- 172.21.15.37:0/2239604268 learned_addr learned my addr 172.21.15.37:0/2239604268 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.458+0000 7f01fe46f640 1 --2- 172.21.15.37:0/2239604268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f815f380 0x7f01f80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.458+0000 7f01fec70640 1 -- 172.21.15.37:0/2239604268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f815f380 msgr2=0x7f01f80d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.458+0000 7f01fec70640 1 --2- 172.21.15.37:0/2239604268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f815f380 0x7f01f80d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.458+0000 7f01fec70640 1 -- 172.21.15.37:0/2239604268 >> v1:172.21.15.37:6789/0 conn(0x7f01f80d0cf0 legacy=0x7f01f80d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.458+0000 7f01fd46d640 1 -- 172.21.15.37:0/2239604268 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796886501 0 0) 0x7f01f80d1760 con 0x7f01f80d0cf0 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.458+0000 7f01fec70640 1 -- 172.21.15.37:0/2239604268 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f80d1a40 con 0x7f01f80d3cd0 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.458+0000 7f01fec70640 1 --2- 172.21.15.37:0/2239604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f80b7e30 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097a0 tx=0x7f01f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21469a82bfaea8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f01fd46d640 1 -- 172.21.15.37:0/2239604268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0037070 con 0x7f01f80d3cd0 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f01fd46d640 1 -- 172.21.15.37:0/2239604268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f0032440 con 0x7f01f80d3cd0 2024-05-10T08:50:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f01fd46d640 1 -- 172.21.15.37:0/2239604268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0032810 con 0x7f01f80d3cd0 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 -- 172.21.15.37:0/2239604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 msgr2=0x7f01f80b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 --2- 172.21.15.37:0/2239604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f80b7e30 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097a0 tx=0x7f01f002a180 comp rx=0 tx=0).stop 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 -- 172.21.15.37:0/2239604268 shutdown_connections 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 --2- 172.21.15.37:0/2239604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f80b7e30 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 --2- 172.21.15.37:0/2239604268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f815f380 0x7f01f80d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 -- 172.21.15.37:0/2239604268 >> 172.21.15.37:0/2239604268 conn(0x7f01f80d4fe0 msgr2=0x7f01f80d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 -- 172.21.15.37:0/2239604268 shutdown_connections 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.459+0000 7f02006d3640 1 -- 172.21.15.37:0/2239604268 wait complete. 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.460+0000 7f02006d3640 1 Processor -- start 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.460+0000 7f02006d3640 1 -- start start 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f02006d3640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f80d0cf0 0x7f01f81f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f02006d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f81534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f02006d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f815f380 0x7f01f81f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f02006d3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80d2000 con 0x7f01f80d3cd0 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f02006d3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80d2370 con 0x7f01f815f380 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f02006d3640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f01f815f760 con 0x7f01f80d0cf0 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f01fdc6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f81534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f01fdc6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f81534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33562/0 (socket says 172.21.15.37:33562) 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.461+0000 7f01fdc6e640 1 -- 172.21.15.37:0/2576664699 learned_addr learned my addr 172.21.15.37:0/2576664699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fec70640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f815f380 0x7f01f81f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fe46f640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f80d0cf0 0x7f01f81f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fdc6e640 1 -- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f80d0cf0 msgr2=0x7f01f81f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fdc6e640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f80d0cf0 0x7f01f81f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fdc6e640 1 -- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f815f380 msgr2=0x7f01f81f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fdc6e640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f815f380 0x7f01f81f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fdc6e640 1 -- 172.21.15.37:0/2576664699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f81f5e20 con 0x7f01f80d3cd0 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fec70640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f815f380 0x7f01f81f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01fdc6e640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f81534d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f01e800c500 tx=0x7f01e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01eeffd640 1 -- 172.21.15.37:0/2576664699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8018070 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01eeffd640 1 -- 172.21.15.37:0/2576664699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e8007580 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f8153a10 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f01eeffd640 1 -- 172.21.15.37:0/2576664699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004a20 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.462+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f809f150 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.463+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f809fee0 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.464+0000 7f01eeffd640 1 -- 172.21.15.37:0/2576664699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f01e801b070 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.464+0000 7f01eeffd640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f01dc0762d0 0x7f01dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.464+0000 7f01eeffd640 1 -- 172.21.15.37:0/2576664699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f01e8096820 con 0x7f01f80d3cd0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.464+0000 7f01fe46f640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f01dc0762d0 0x7f01dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.465+0000 7f01fe46f640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f01dc0762d0 0x7f01dc078790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009e90 tx=0x7f01f400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.468+0000 7f01eeffd640 1 -- 172.21.15.37:0/2576664699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f01f81f5e20 con 0x7f01f80d3cd0 2024-05-10T08:50:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.660+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f01f80693f0 con 0x7f01dc0762d0 2024-05-10T08:50:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.660+0000 7f01eeffd640 1 -- 172.21.15.37:0/2576664699 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f01f80693f0 con 0x7f01dc0762d0 2024-05-10T08:50:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T08:50:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f01dc0762d0 msgr2=0x7f01dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f01dc0762d0 0x7f01dc078790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009e90 tx=0x7f01f400b040 comp rx=0 tx=0).stop 2024-05-10T08:50:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 msgr2=0x7f01f81534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f81534d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f01e800c500 tx=0x7f01e800c9c0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 shutdown_connections 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f01dc0762d0 0x7f01dc078790 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f815f380 0x7f01f81f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f80d3cd0 0x7f01f81534d0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 --2- 172.21.15.37:0/2576664699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f01f80d0cf0 0x7f01f81f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.662+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 >> 172.21.15.37:0/2576664699 conn(0x7f01f80d4fe0 msgr2=0x7f01f80d53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.663+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 shutdown_connections 2024-05-10T08:50:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.663+0000 7f02006d3640 1 -- 172.21.15.37:0/2576664699 wait complete. 2024-05-10T08:50:11.672 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T08:50:11.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:11.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.782+0000 7ffbccce1640 1 Processor -- start 2024-05-10T08:50:11.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.782+0000 7ffbccce1640 1 -- start start 2024-05-10T08:50:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbccce1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffbc80d5750 0x7ffbc80d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbccce1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc80d5cc0 con 0x7ffbc80d3620 2024-05-10T08:50:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbccce1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc80cfcf0 con 0x7ffbc815f680 2024-05-10T08:50:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbccce1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc80d0620 con 0x7ffbc80d5750 2024-05-10T08:50:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffbc80d3620 0x7ffbc80d3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33662/0 (socket says 172.21.15.37:33662) 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc659c640 1 -- 172.21.15.37:0/301807468 learned_addr learned my addr 172.21.15.37:0/301807468 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/301807468 >> v2:172.21.15.82:3300/0 conn(0x7ffbc80d5750 0x7ffbc80d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273041396 0 0) 0x7ffbc80d5cc0 con 0x7ffbc80d3620 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbb4003520 con 0x7ffbc80d3620 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375856868 0 0) 0x7ffbc80cfcf0 con 0x7ffbc815f680 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc80d5cc0 con 0x7ffbc815f680 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1504337082 0 0) 0x7ffbb4003520 con 0x7ffbc80d3620 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 >> v2:172.21.15.82:3300/0 conn(0x7ffbc80d5750 msgr2=0x7ffbc80d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 --2- 172.21.15.37:0/301807468 >> v2:172.21.15.82:3300/0 conn(0x7ffbc80d5750 0x7ffbc80d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 >> v1:172.21.15.82:6789/0 conn(0x7ffbc815f680 legacy=0x7ffbc80b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc80cffd0 con 0x7ffbc80d3620 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7ffbb8001670 con 0x7ffbc80d3620 2024-05-10T08:50:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 >> v1:172.21.15.37:6789/0 conn(0x7ffbc80d3620 legacy=0x7ffbc80d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb4003b40 0x7ffbb4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbb4004800 0x7ffbb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb40051c0 0x7ffbb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc80d0620 con 0x7ffbb40051c0 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb400c040 con 0x7ffbb4003b40 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb400c240 con 0x7ffbb4004800 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.783+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb40051c0 0x7ffbb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc659c640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb4003b40 0x7ffbb4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbbdd9b640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbb4004800 0x7ffbb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbb4004800 msgr2=0x7ffbb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbb4004800 0x7ffbb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb4003b40 msgr2=0x7ffbb4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb4003b40 0x7ffbb4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/301807468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb4003520 con 0x7ffbb40051c0 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbbdd9b640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbb4004800 0x7ffbb4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/301807468 reap_dead start 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.784+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb40051c0 0x7ffbb400b9c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009f90 tx=0x7ffbb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff84d58ed5ca1d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0009c10 con 0x7ffbb40051c0 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc0031440 con 0x7ffbb40051c0 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbc5d9b640 1 -- 172.21.15.37:0/301807468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0031810 con 0x7ffbb40051c0 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbccce1640 1 -- 172.21.15.37:0/301807468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb40051c0 msgr2=0x7ffbb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbccce1640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb40051c0 0x7ffbb400b9c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009f90 tx=0x7ffbb4005830 comp rx=0 tx=0).stop 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbccce1640 1 -- 172.21.15.37:0/301807468 shutdown_connections 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbccce1640 1 --2- 172.21.15.37:0/301807468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb40051c0 0x7ffbb400b9c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbccce1640 1 -- 172.21.15.37:0/301807468 >> 172.21.15.37:0/301807468 conn(0x7ffbc809e380 msgr2=0x7ffbc80d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbccce1640 1 -- 172.21.15.37:0/301807468 shutdown_connections 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.785+0000 7ffbccce1640 1 -- 172.21.15.37:0/301807468 wait complete. 2024-05-10T08:50:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 Processor -- start 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 -- start start 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb40051c0 0x7ffbc8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbc81f9010 0x7ffbc81eef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbc80a23a0 0x7ffbc80a2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc80d2080 con 0x7ffbc80a23a0 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc80d3040 con 0x7ffbb40051c0 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.787+0000 7ffbccce1640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc80d2200 con 0x7ffbc81f9010 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbc80a23a0 0x7ffbc80a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbc80a23a0 0x7ffbc80a2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33580/0 (socket says 172.21.15.37:33580) 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/2788634835 learned_addr learned my addr 172.21.15.37:0/2788634835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc659c640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb40051c0 0x7ffbc8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbbdd9b640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbc81f9010 0x7ffbc81eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbc81f9010 msgr2=0x7ffbc81eef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ffbc81f9010 0x7ffbc81eef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb40051c0 msgr2=0x7ffbc8159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb40051c0 0x7ffbc8159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/2788634835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc81f5320 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbc6d9d640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbc80a23a0 0x7ffbc80a2820 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0033040 tx=0x7ffbc0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0009c10 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc0043070 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc81f5600 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc003c8b0 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.788+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc81f5bc0 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.789+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffbc80693f0 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.790+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffbc0005d10 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.790+0000 7ffbbf7fe640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffba8076300 0x7ffba80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.790+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7ffbc00b7ef0 con 0x7ffbc80a23a0 2024-05-10T08:50:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.791+0000 7ffbc659c640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffba8076300 0x7ffba80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.791+0000 7ffbbf7fe640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7ffba807c8e0 0x7ffba807ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.791+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbc00047f0 con 0x7ffba807c8e0 2024-05-10T08:50:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.791+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7ffbc00ba510 con 0x7ffbc80a23a0 2024-05-10T08:50:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.791+0000 7ffbbdd9b640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7ffba807c8e0 0x7ffba807ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.791+0000 7ffbc659c640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffba8076300 0x7ffba80787c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8001c80 tx=0x7ffbb8001b30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.791+0000 7ffbbdd9b640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7ffba807c8e0 0x7ffba807ed20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.792+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== osd.4 v2:172.21.15.82:6808/3594167095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffbc00047f0 con 0x7ffba807c8e0 2024-05-10T08:50:11.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.805+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 --> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffbc80d5f50 con 0x7ffba807c8e0 2024-05-10T08:50:11.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbbf7fe640 1 -- 172.21.15.37:0/2788634835 <== osd.4 v2:172.21.15.82:6808/3594167095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffbc80d5f50 con 0x7ffba807c8e0 2024-05-10T08:50:11.804 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:11.804 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:11.804 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7ffba807c8e0 msgr2=0x7ffba807ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6808/3594167095,v1:172.21.15.82:6809/3594167095] conn(0x7ffba807c8e0 0x7ffba807ed20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffba8076300 msgr2=0x7ffba80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7ffba8076300 0x7ffba80787c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8001c80 tx=0x7ffbb8001b30 comp rx=0 tx=0).stop 2024-05-10T08:50:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbc80a23a0 msgr2=0x7ffbc80a2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 --2- 172.21.15.37:0/2788634835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbc80a23a0 0x7ffbc80a2820 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0033040 tx=0x7ffbc0009750 comp rx=0 tx=0).stop 2024-05-10T08:50:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbc6d9d640 1 -- 172.21.15.37:0/2788634835 reap_dead start 2024-05-10T08:50:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 shutdown_connections 2024-05-10T08:50:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 >> 172.21.15.37:0/2788634835 conn(0x7ffbc809e380 msgr2=0x7ffbc80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 shutdown_connections 2024-05-10T08:50:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.806+0000 7ffbccce1640 1 -- 172.21.15.37:0/2788634835 wait complete. 2024-05-10T08:50:11.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T08:50:11.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.922+0000 7fb0b10dc640 1 Processor -- start 2024-05-10T08:50:11.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.922+0000 7fb0b10dc640 1 -- start start 2024-05-10T08:50:11.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0b10dc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0ac15f100 0x7fb0ac0d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0b10dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0ac0d5bc0 0x7fb0ac0d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0b10dc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0ac0d2c80 con 0x7fb0ac162c60 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0b10dc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb0ac0d35b0 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0b10dc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb0ac0d2f60 con 0x7fb0ac15f100 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0a259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0ac0d5bc0 0x7fb0ac0d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0a259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0ac0d5bc0 0x7fb0ac0d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33588/0 (socket says 172.21.15.37:33588) 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0a259c640 1 -- 172.21.15.37:0/777648268 learned_addr learned my addr 172.21.15.37:0/777648268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0ab59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb0ac162c60 0x7fb0ac0b4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33664/0 (socket says 172.21.15.37:33664) 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0aad9d640 1 --2- 172.21.15.37:0/777648268 >> v2:172.21.15.82:3300/0 conn(0x7fb0ac15f100 0x7fb0ac0d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0a259c640 1 -- 172.21.15.37:0/777648268 >> v2:172.21.15.82:3300/0 conn(0x7fb0ac15f100 msgr2=0x7fb0ac0d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0a259c640 1 --2- 172.21.15.37:0/777648268 >> v2:172.21.15.82:3300/0 conn(0x7fb0ac15f100 0x7fb0ac0d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0a259c640 1 -- 172.21.15.37:0/777648268 >> v1:172.21.15.37:6789/0 conn(0x7fb0ac162c60 legacy=0x7fb0ac0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0aa59c640 1 -- 172.21.15.37:0/777648268 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705587088 0 0) 0x7fb0ac0d2c80 con 0x7fb0ac162c60 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0a259c640 1 -- 172.21.15.37:0/777648268 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac0d3240 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.923+0000 7fb0aad9d640 1 --2- 172.21.15.37:0/777648268 >> v2:172.21.15.82:3300/0 conn(0x7fb0ac15f100 0x7fb0ac0d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.924+0000 7fb0a259c640 1 --2- 172.21.15.37:0/777648268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0d3a40 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb09402a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d981c7e848d3324e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.924+0000 7fb0aa59c640 1 -- 172.21.15.37:0/777648268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094037070 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.924+0000 7fb0aa59c640 1 -- 172.21.15.37:0/777648268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094032640 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.924+0000 7fb0aa59c640 1 -- 172.21.15.37:0/777648268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094032a10 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 -- 172.21.15.37:0/777648268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 msgr2=0x7fb0ac0d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/777648268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0d3a40 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb09402a330 comp rx=0 tx=0).stop 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 -- 172.21.15.37:0/777648268 shutdown_connections 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/777648268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0d3a40 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/777648268 >> v2:172.21.15.82:3300/0 conn(0x7fb0ac15f100 0x7fb0ac0d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 -- 172.21.15.37:0/777648268 >> 172.21.15.37:0/777648268 conn(0x7fb0ac09e3e0 msgr2=0x7fb0ac0d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 -- 172.21.15.37:0/777648268 shutdown_connections 2024-05-10T08:50:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.925+0000 7fb0b10dc640 1 -- 172.21.15.37:0/777648268 wait complete. 2024-05-10T08:50:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.926+0000 7fb0b10dc640 1 Processor -- start 2024-05-10T08:50:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.926+0000 7fb0b10dc640 1 -- start start 2024-05-10T08:50:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0b10dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0b10dc640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0ac15f100 0x7fb0ac0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0b10dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac162c60 0x7fb0ac152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0b10dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac15f4e0 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0b10dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac0d0d20 con 0x7fb0ac162c60 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0b10dc640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ac0d3f80 con 0x7fb0ac15f100 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33596/0 (socket says 172.21.15.37:33596) 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 -- 172.21.15.37:0/2831506447 learned_addr learned my addr 172.21.15.37:0/2831506447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0ab59e640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac162c60 0x7fb0ac152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 -- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0ac15f100 msgr2=0x7fb0ac0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0ac15f100 0x7fb0ac0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 -- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac162c60 msgr2=0x7fb0ac152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac162c60 0x7fb0ac152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:11.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 -- 172.21.15.37:0/2831506447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac0cd4c0 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.927+0000 7fb0aad9d640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0cea50 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c7f0 tx=0x7fb09c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.928+0000 7fb0a3fff640 1 -- 172.21.15.37:0/2831506447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c015070 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.928+0000 7fb0a3fff640 1 -- 172.21.15.37:0/2831506447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c007a30 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.928+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac1f8930 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.928+0000 7fb0a3fff640 1 -- 172.21.15.37:0/2831506447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c007e00 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.928+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac1f8ef0 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.929+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ac0693f0 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.929+0000 7fb0a3fff640 1 -- 172.21.15.37:0/2831506447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb09c018070 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.930+0000 7fb0a3fff640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb08c076300 0x7fb08c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.930+0000 7fb0a3fff640 1 -- 172.21.15.37:0/2831506447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7fb09c0974e0 con 0x7fb0ac0d5bc0 2024-05-10T08:50:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.930+0000 7fb0a259c640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb08c076300 0x7fb08c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.931+0000 7fb0a259c640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb08c076300 0x7fb08c0787c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb094034000 tx=0x7fb09402c000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:11.934+0000 7fb0a3fff640 1 -- 172.21.15.37:0/2831506447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fb0ac0cd4c0 con 0x7fb0ac0d5bc0 2024-05-10T08:50:12.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.129+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb0ac0b3e60 con 0x7fb08c076300 2024-05-10T08:50:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.130+0000 7fb0a3fff640 1 -- 172.21.15.37:0/2831506447 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb0ac0b3e60 con 0x7fb08c076300 2024-05-10T08:50:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T08:50:12.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb08c076300 msgr2=0x7fb08c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb08c076300 0x7fb08c0787c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb094034000 tx=0x7fb09402c000 comp rx=0 tx=0).stop 2024-05-10T08:50:12.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 msgr2=0x7fb0ac0cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0cea50 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c7f0 tx=0x7fb09c00cbf0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 shutdown_connections 2024-05-10T08:50:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fb08c076300 0x7fb08c0787c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac162c60 0x7fb0ac152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0ac15f100 0x7fb0ac0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 --2- 172.21.15.37:0/2831506447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0ac0d5bc0 0x7fb0ac0cea50 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 >> 172.21.15.37:0/2831506447 conn(0x7fb0ac09e3e0 msgr2=0x7fb0ac15e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 shutdown_connections 2024-05-10T08:50:12.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.132+0000 7fb0b10dc640 1 -- 172.21.15.37:0/2831506447 wait complete. 2024-05-10T08:50:12.142 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T08:50:12.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.251+0000 7f79d1f46640 1 Processor -- start 2024-05-10T08:50:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.251+0000 7f79d1f46640 1 -- start start 2024-05-10T08:50:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.251+0000 7f79d1f46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 0x7f79cc0d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.251+0000 7f79d1f46640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79cc162f50 con 0x7f79cc162b70 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.251+0000 7f79d1f46640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79cc0d3ee0 con 0x7f79cc0cfc50 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.251+0000 7f79d1f46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc0d1f60 con 0x7f79cc0b5a50 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79cb7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f79cc162b70 0x7f79cc0d2f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33672/0 (socket says 172.21.15.37:33672) 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79cb7fe640 1 -- 172.21.15.37:0/3365094412 learned_addr learned my addr 172.21.15.37:0/3365094412 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128445294 0 0) 0x7f79bc001110 con 0x7f79cc162b70 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79caffd640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 0x7f79cc0d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79b4003520 con 0x7f79cc162b70 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 511029712 0 0) 0x7f79b4003520 con 0x7f79cc162b70 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 msgr2=0x7f79cc0d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 0x7f79cc0d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 >> v1:172.21.15.82:6789/0 conn(0x7f79cc0cfc50 legacy=0x7f79cc0d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc0d21b0 con 0x7f79cc162b70 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f79bc001840 con 0x7f79cc162b70 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 >> v1:172.21.15.37:6789/0 conn(0x7f79cc162b70 legacy=0x7f79cc0d2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 0x7f79b40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b4003f60 0x7f79b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b4004d40 0x7f79b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc0d1f60 con 0x7f79b4003f60 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79b400baa0 con 0x7f79b4004d40 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f79b400bca0 con 0x7f79cc0b5a50 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79caffd640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b4003f60 0x7f79b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79cb7fe640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 0x7f79b40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.252+0000 7f79cbfff640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b4004d40 0x7f79b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.253+0000 7f79caffd640 1 -- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 msgr2=0x7f79b40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.253+0000 7f79caffd640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79cc0b5a50 0x7f79b40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.253+0000 7f79caffd640 1 -- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b4004d40 msgr2=0x7f79b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.253+0000 7f79caffd640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b4004d40 0x7f79b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.253+0000 7f79caffd640 1 -- 172.21.15.37:0/3365094412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b4003520 con 0x7f79b4003f60 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.253+0000 7f79caffd640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b4003f60 0x7f79b4004800 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009ac0 tx=0x7f79b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20ba58d6d190dd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0036070 con 0x7f79b4003f60 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c0031400 con 0x7f79b4003f60 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79ca7fc640 1 -- 172.21.15.37:0/3365094412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0009690 con 0x7f79b4003f60 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79d1f46640 1 -- 172.21.15.37:0/3365094412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b4003f60 msgr2=0x7f79b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79d1f46640 1 --2- 172.21.15.37:0/3365094412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b4003f60 0x7f79b4004800 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009ac0 tx=0x7f79b4005830 comp rx=0 tx=0).stop 2024-05-10T08:50:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79cbfff640 1 -- 172.21.15.37:0/3365094412 reap_dead start 2024-05-10T08:50:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79d1f46640 1 -- 172.21.15.37:0/3365094412 shutdown_connections 2024-05-10T08:50:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79d1f46640 1 -- 172.21.15.37:0/3365094412 >> 172.21.15.37:0/3365094412 conn(0x7f79cc0d5040 msgr2=0x7f79cc0d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79d1f46640 1 -- 172.21.15.37:0/3365094412 shutdown_connections 2024-05-10T08:50:12.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.254+0000 7f79d1f46640 1 -- 172.21.15.37:0/3365094412 wait complete. 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.255+0000 7f79d1f46640 1 Processor -- start 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79d1f46640 1 -- start start 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79d1f46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b4003f60 0x7f79cc0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79d1f46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79cc15d880 0x7f79cc15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79d1f46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc1f5240 0x7f79cc1f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79d1f46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc0b42f0 con 0x7f79cc1f5240 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79d1f46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc0b4170 con 0x7f79cc15d880 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79d1f46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc0d3650 con 0x7f79b4003f60 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc1f5240 0x7f79cc1f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc1f5240 0x7f79cc1f56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33616/0 (socket says 172.21.15.37:33616) 2024-05-10T08:50:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.256+0000 7f79cbfff640 1 -- 172.21.15.37:0/3547489175 learned_addr learned my addr 172.21.15.37:0/3547489175 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79caffd640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79cc15d880 0x7f79cc15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79cb7fe640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b4003f60 0x7f79cc0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79cbfff640 1 -- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b4003f60 msgr2=0x7f79cc0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79cbfff640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f79b4003f60 0x7f79cc0cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79cbfff640 1 -- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79cc15d880 msgr2=0x7f79cc15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79cbfff640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79cc15d880 0x7f79cc15dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79cbfff640 1 -- 172.21.15.37:0/3547489175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc1f5d50 con 0x7f79cc1f5240 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79cbfff640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc1f5240 0x7f79cc1f56c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f79cc06c610 tx=0x7f79c400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c401a070 con 0x7f79cc1f5240 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c4006d60 con 0x7f79cc1f5240 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4003b90 con 0x7f79cc1f5240 2024-05-10T08:50:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc1f6030 con 0x7f79cc1f5240 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.257+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc15d360 con 0x7f79cc1f5240 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.258+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79cc0693f0 con 0x7f79cc1f5240 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f79c401d070 con 0x7f79cc1f5240 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79b3fff640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79b80762d0 0x7f79b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f79c4096b20 con 0x7f79cc1f5240 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79b3fff640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f79b807c8b0 0x7f79b807ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79b807f3c0 con 0x7f79b807c8b0 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f79c409b240 con 0x7f79cc1f5240 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79cb7fe640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79b80762d0 0x7f79b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.259+0000 7f79caffd640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f79b807c8b0 0x7f79b807ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.260+0000 7f79cb7fe640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79b80762d0 0x7f79b8078790 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0012b0 tx=0x7f79bc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.260+0000 7f79caffd640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f79b807c8b0 0x7f79b807ecf0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.261+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== osd.5 v2:172.21.15.82:6800/3184821053 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79b807f3c0 con 0x7f79b807c8b0 2024-05-10T08:50:12.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.274+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 --> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f79cc0d0aa0 con 0x7f79b807c8b0 2024-05-10T08:50:12.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.274+0000 7f79b3fff640 1 -- 172.21.15.37:0/3547489175 <== osd.5 v2:172.21.15.82:6800/3184821053 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f79cc0d0aa0 con 0x7f79b807c8b0 2024-05-10T08:50:12.273 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:12.273 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:12.273 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f79b807c8b0 msgr2=0x7f79b807ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6800/3184821053,v1:172.21.15.82:6801/3184821053] conn(0x7f79b807c8b0 0x7f79b807ecf0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79b80762d0 msgr2=0x7f79b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f79b80762d0 0x7f79b8078790 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0012b0 tx=0x7f79bc009040 comp rx=0 tx=0).stop 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc1f5240 msgr2=0x7f79cc1f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 --2- 172.21.15.37:0/3547489175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc1f5240 0x7f79cc1f56c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f79cc06c610 tx=0x7f79c400fd40 comp rx=0 tx=0).stop 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79cbfff640 1 -- 172.21.15.37:0/3547489175 reap_dead start 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 shutdown_connections 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 >> 172.21.15.37:0/3547489175 conn(0x7f79cc0d5040 msgr2=0x7f79cc161c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 shutdown_connections 2024-05-10T08:50:12.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.275+0000 7f79d1f46640 1 -- 172.21.15.37:0/3547489175 wait complete. 2024-05-10T08:50:12.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T08:50:12.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.390+0000 7feff52c4640 1 Processor -- start 2024-05-10T08:50:12.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.390+0000 7feff52c4640 1 -- start start 2024-05-10T08:50:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7feff52c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feff01638e0 0x7feff00b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7feff52c4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff00b14e0 con 0x7feff006c3a0 2024-05-10T08:50:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7feff52c4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff0162e00 con 0x7feff015f0c0 2024-05-10T08:50:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7feff52c4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7feff0163450 con 0x7feff01638e0 2024-05-10T08:50:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7fefef7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feff006c3a0 0x7feff015f4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33686/0 (socket says 172.21.15.37:33686) 2024-05-10T08:50:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7fefef7fe640 1 -- 172.21.15.37:0/2783026578 learned_addr learned my addr 172.21.15.37:0/2783026578 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7fefee7fc640 1 --2- 172.21.15.37:0/2783026578 >> v2:172.21.15.82:3300/0 conn(0x7feff01638e0 0x7feff00b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.391+0000 7fefedffb640 1 -- 172.21.15.37:0/2783026578 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179308771 0 0) 0x7feff00b14e0 con 0x7feff006c3a0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.392+0000 7fefedffb640 1 -- 172.21.15.37:0/2783026578 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd8003520 con 0x7feff006c3a0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.392+0000 7fefedffb640 1 -- 172.21.15.37:0/2783026578 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657580333 0 0) 0x7feff0162e00 con 0x7feff015f0c0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.392+0000 7fefedffb640 1 -- 172.21.15.37:0/2783026578 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feff00b14e0 con 0x7feff015f0c0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.392+0000 7fefee7fc640 1 -- 172.21.15.37:0/2783026578 >> v1:172.21.15.82:6789/0 conn(0x7feff015f0c0 legacy=0x7feff00b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.392+0000 7fefee7fc640 1 -- 172.21.15.37:0/2783026578 >> v1:172.21.15.37:6789/0 conn(0x7feff006c3a0 legacy=0x7feff015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.392+0000 7fefee7fc640 1 -- 172.21.15.37:0/2783026578 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff01630e0 con 0x7feff01638e0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.392+0000 7fefee7fc640 1 --2- 172.21.15.37:0/2783026578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff01638e0 0x7feff00b6f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feff01635d0 tx=0x7fefe402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d19564c687c41c59 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7fefedffb640 1 -- 172.21.15.37:0/2783026578 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4037070 con 0x7feff01638e0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7fefedffb640 1 -- 172.21.15.37:0/2783026578 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe4032440 con 0x7feff01638e0 2024-05-10T08:50:12.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7fefedffb640 1 -- 172.21.15.37:0/2783026578 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe40327f0 con 0x7feff01638e0 2024-05-10T08:50:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7feff52c4640 1 -- 172.21.15.37:0/2783026578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff01638e0 msgr2=0x7feff00b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7feff52c4640 1 --2- 172.21.15.37:0/2783026578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff01638e0 0x7feff00b6f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feff01635d0 tx=0x7fefe402a210 comp rx=0 tx=0).stop 2024-05-10T08:50:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7feff52c4640 1 -- 172.21.15.37:0/2783026578 shutdown_connections 2024-05-10T08:50:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7feff52c4640 1 --2- 172.21.15.37:0/2783026578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff01638e0 0x7feff00b6f40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7feff52c4640 1 -- 172.21.15.37:0/2783026578 >> 172.21.15.37:0/2783026578 conn(0x7feff00b3b10 msgr2=0x7feff00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7feff52c4640 1 -- 172.21.15.37:0/2783026578 shutdown_connections 2024-05-10T08:50:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.393+0000 7feff52c4640 1 -- 172.21.15.37:0/2783026578 wait complete. 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 Processor -- start 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 -- start start 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff006c3a0 0x7feff014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feff015f0c0 0x7feff00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feff01638e0 0x7feff00c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feff006c960 con 0x7feff015f0c0 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feff006c7e0 con 0x7feff006c3a0 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.395+0000 7feff52c4640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7feff006cae0 con 0x7feff01638e0 2024-05-10T08:50:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feff015f0c0 0x7feff00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feff015f0c0 0x7feff00afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33626/0 (socket says 172.21.15.37:33626) 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 -- 172.21.15.37:0/3466455914 learned_addr learned my addr 172.21.15.37:0/3466455914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefeeffd640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff006c3a0 0x7feff014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefef7fe640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feff01638e0 0x7feff00c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 -- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feff01638e0 msgr2=0x7feff00c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feff01638e0 0x7feff00c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 -- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff006c3a0 msgr2=0x7feff014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff006c3a0 0x7feff014c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 -- 172.21.15.37:0/3466455914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff00b0360 con 0x7feff015f0c0 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefef7fe640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feff01638e0 0x7feff00c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefee7fc640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feff015f0c0 0x7feff00afe20 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fefe4000c00 tx=0x7fefe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefd77fe640 1 -- 172.21.15.37:0/3466455914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4041020 con 0x7feff015f0c0 2024-05-10T08:50:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefd77fe640 1 -- 172.21.15.37:0/3466455914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe403d620 con 0x7feff015f0c0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff01f8d80 con 0x7feff015f0c0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7fefd77fe640 1 -- 172.21.15.37:0/3466455914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4037040 con 0x7feff015f0c0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.396+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff01f9340 con 0x7feff015f0c0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.397+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff006a8f0 con 0x7feff015f0c0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.398+0000 7fefd77fe640 1 -- 172.21.15.37:0/3466455914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fefe4044020 con 0x7feff015f0c0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.399+0000 7fefd77fe640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fefdc076300 0x7fefdc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.399+0000 7fefd77fe640 1 -- 172.21.15.37:0/3466455914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7fefe40b7970 con 0x7feff015f0c0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.399+0000 7fefeeffd640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fefdc076300 0x7fefdc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.399+0000 7fefeeffd640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fefdc076300 0x7fefdc0787c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7feff0159e80 tx=0x7fefe0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.403+0000 7fefd77fe640 1 -- 172.21.15.37:0/3466455914 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fefe404b070 con 0x7feff015f0c0 2024-05-10T08:50:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.594+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7feff0068c40 con 0x7fefdc076300 2024-05-10T08:50:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.594+0000 7fefd77fe640 1 -- 172.21.15.37:0/3466455914 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7feff0068c40 con 0x7fefdc076300 2024-05-10T08:50:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T08:50:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fefdc076300 msgr2=0x7fefdc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fefdc076300 0x7fefdc0787c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7feff0159e80 tx=0x7fefe0009040 comp rx=0 tx=0).stop 2024-05-10T08:50:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feff015f0c0 msgr2=0x7feff00afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feff015f0c0 0x7feff00afe20 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fefe4000c00 tx=0x7fefe40046c0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 shutdown_connections 2024-05-10T08:50:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fefdc076300 0x7fefdc0787c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feff01638e0 0x7feff00c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feff015f0c0 0x7feff00afe20 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 --2- 172.21.15.37:0/3466455914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff006c3a0 0x7feff014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 >> 172.21.15.37:0/3466455914 conn(0x7feff00b3b10 msgr2=0x7feff0070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 shutdown_connections 2024-05-10T08:50:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.596+0000 7feff52c4640 1 -- 172.21.15.37:0/3466455914 wait complete. 2024-05-10T08:50:12.606 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T08:50:12.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.715+0000 7f9f0c845640 1 Processor -- start 2024-05-10T08:50:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.715+0000 7f9f0c845640 1 -- start start 2024-05-10T08:50:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.716+0000 7f9f0c845640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 0x7f9f080d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.716+0000 7f9f0c845640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9f080d22f0 0x7f9f080cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.716+0000 7f9f0c845640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f080cd610 con 0x7f9f080cfce0 2024-05-10T08:50:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.716+0000 7f9f0c845640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9f080d0150 con 0x7f9f080d22f0 2024-05-10T08:50:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.716+0000 7f9f0c845640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9f080d2840 con 0x7f9f0815f710 2024-05-10T08:50:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.716+0000 7f9f06d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9f080cfce0 0x7f9f0806d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33698/0 (socket says 172.21.15.37:33698) 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.716+0000 7f9f06d9d640 1 -- 172.21.15.37:0/1350249288 learned_addr learned my addr 172.21.15.37:0/1350249288 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/1350249288 >> v2:172.21.15.82:3300/0 conn(0x7f9f080d22f0 0x7f9f080cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0659c640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 0x7f9f080d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422871849 0 0) 0x7f9f080cd610 con 0x7f9f080cfce0 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ef4003520 con 0x7f9f080cfce0 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 480834731 0 0) 0x7f9ef4003520 con 0x7f9f080cfce0 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 msgr2=0x7f9f080d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 0x7f9f080d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 >> v2:172.21.15.82:3300/0 conn(0x7f9f080d22f0 msgr2=0x7f9f080cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 --2- 172.21.15.37:0/1350249288 >> v2:172.21.15.82:3300/0 conn(0x7f9f080d22f0 0x7f9f080cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f080cd880 con 0x7f9f080cfce0 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 463658086 0 0) 0x7f9f000019f0 con 0x7f9f080cfce0 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/1350249288 >> v2:172.21.15.82:3300/0 conn(0x7f9f080d22f0 0x7f9f080cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 >> v1:172.21.15.37:6789/0 conn(0x7f9f080cfce0 legacy=0x7f9f0806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef40039b0 0x7f9ef4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef4004800 0x7f9ef4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 0x7f9ef40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080d0150 con 0x7f9ef4004800 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080d2840 con 0x7f9ef40039b0 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef400b9c0 con 0x7f9f0815f710 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f0659c640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef40039b0 0x7f9ef4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef4004800 0x7f9ef4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.717+0000 7f9f06d9d640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 0x7f9ef40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f05d9b640 1 -- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 msgr2=0x7f9ef40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f0815f710 0x7f9ef40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f05d9b640 1 -- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef40039b0 msgr2=0x7f9ef4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef40039b0 0x7f9ef4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f05d9b640 1 -- 172.21.15.37:0/1350249288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef4003520 con 0x7f9ef4004800 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f0659c640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ef40039b0 0x7f9ef4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef4004800 0x7f9ef4004c80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009c90 tx=0x7f9ef4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bf028fe789874e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0036070 con 0x7f9ef4004800 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef0031400 con 0x7f9ef4004800 2024-05-10T08:50:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.718+0000 7f9f0559a640 1 -- 172.21.15.37:0/1350249288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0009860 con 0x7f9ef4004800 2024-05-10T08:50:12.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.719+0000 7f9f0c845640 1 -- 172.21.15.37:0/1350249288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef4004800 msgr2=0x7f9ef4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.719+0000 7f9f0c845640 1 --2- 172.21.15.37:0/1350249288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef4004800 0x7f9ef4004c80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009c90 tx=0x7f9ef4005830 comp rx=0 tx=0).stop 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.719+0000 7f9f06d9d640 1 -- 172.21.15.37:0/1350249288 reap_dead start 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.719+0000 7f9f0c845640 1 -- 172.21.15.37:0/1350249288 shutdown_connections 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.719+0000 7f9f0c845640 1 -- 172.21.15.37:0/1350249288 >> 172.21.15.37:0/1350249288 conn(0x7f9f080d2f20 msgr2=0x7f9f080d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.719+0000 7f9f0c845640 1 -- 172.21.15.37:0/1350249288 shutdown_connections 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.719+0000 7f9f0c845640 1 -- 172.21.15.37:0/1350249288 wait complete. 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 Processor -- start 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 -- start start 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ef4004800 0x7f9f081523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f08152e00 0x7f9f080c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f08153260 0x7f9f080c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080cf090 con 0x7f9f08152e00 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080d2b20 con 0x7f9f08153260 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f0c845640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9f080cf210 con 0x7f9ef4004800 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.721+0000 7f9f05d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f08152e00 0x7f9f080c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f08152e00 0x7f9f080c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33650/0 (socket says 172.21.15.37:33650) 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 -- 172.21.15.37:0/2128576490 learned_addr learned my addr 172.21.15.37:0/2128576490 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f06d9d640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f08153260 0x7f9f080c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f0659c640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ef4004800 0x7f9f081523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 -- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ef4004800 msgr2=0x7f9f081523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9ef4004800 0x7f9f081523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 -- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f08153260 msgr2=0x7f9f080c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f08153260 0x7f9f080c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 -- 172.21.15.37:0/2128576490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f081528f0 con 0x7f9f08152e00 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f05d9b640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f08152e00 0x7f9f080c8c40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009db0 tx=0x7f9ef0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0040020 con 0x7f9f08152e00 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef003b680 con 0x7f9f08152e00 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f080c7be0 con 0x7f9f08152e00 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0036040 con 0x7f9f08152e00 2024-05-10T08:50:12.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.722+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f080c8160 con 0x7f9f08152e00 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.723+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f08069b00 con 0x7f9f08152e00 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.724+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ef0043020 con 0x7f9f08152e00 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.724+0000 7f9efeffd640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ee80762d0 0x7f9ee8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.724+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f9ef00b7b00 con 0x7f9f08152e00 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.725+0000 7f9f0659c640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ee80762d0 0x7f9ee8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.725+0000 7f9efeffd640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f9ee807c8b0 0x7f9ee807ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.725+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ef0041ec0 con 0x7f9ee807c8b0 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.725+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f9ef00bc2a0 con 0x7f9f08152e00 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.725+0000 7f9f06d9d640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f9ee807c8b0 0x7f9ee807ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.725+0000 7f9f0659c640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ee80762d0 0x7f9ee8078790 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009c00 tx=0x7f9ef8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.725+0000 7f9f06d9d640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f9ee807c8b0 0x7f9ee807ecf0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.726+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== osd.6 v2:172.21.15.82:6824/3522580642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ef0041ec0 con 0x7f9ee807c8b0 2024-05-10T08:50:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.739+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 --> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9f080b2660 con 0x7f9ee807c8b0 2024-05-10T08:50:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9efeffd640 1 -- 172.21.15.37:0/2128576490 <== osd.6 v2:172.21.15.82:6824/3522580642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9f080b2660 con 0x7f9ee807c8b0 2024-05-10T08:50:12.738 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:12.739 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:12.739 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:12.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f9ee807c8b0 msgr2=0x7f9ee807ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6824/3522580642,v1:172.21.15.82:6825/3522580642] conn(0x7f9ee807c8b0 0x7f9ee807ecf0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ee80762d0 msgr2=0x7f9ee8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9ee80762d0 0x7f9ee8078790 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009c00 tx=0x7f9ef8009190 comp rx=0 tx=0).stop 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f08152e00 msgr2=0x7f9f080c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 --2- 172.21.15.37:0/2128576490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f08152e00 0x7f9f080c8c40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009db0 tx=0x7f9ef0004730 comp rx=0 tx=0).stop 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f06d9d640 1 -- 172.21.15.37:0/2128576490 reap_dead start 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 shutdown_connections 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 >> 172.21.15.37:0/2128576490 conn(0x7f9f080d2f20 msgr2=0x7f9f0806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 shutdown_connections 2024-05-10T08:50:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.740+0000 7f9f0c845640 1 -- 172.21.15.37:0/2128576490 wait complete. 2024-05-10T08:50:12.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T08:50:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.855+0000 7f55d6fb6640 1 Processor -- start 2024-05-10T08:50:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.855+0000 7f55d6fb6640 1 -- start start 2024-05-10T08:50:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d6fb6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55d015c340 0x7f55d0166970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d6fb6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d015c920 con 0x7f55d006e0f0 2024-05-10T08:50:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d6fb6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d015cc00 con 0x7f55d0072840 2024-05-10T08:50:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d6fb6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f55d015cee0 con 0x7f55d015c340 2024-05-10T08:50:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d4d52640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f55d006e0f0 0x7f55d00d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33704/0 (socket says 172.21.15.37:33704) 2024-05-10T08:50:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d4d52640 1 -- 172.21.15.37:0/95007648 learned_addr learned my addr 172.21.15.37:0/95007648 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d5553640 1 --2- 172.21.15.37:0/95007648 >> v2:172.21.15.37:3300/0 conn(0x7f55d015c340 0x7f55d0166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55cf7fe640 1 -- 172.21.15.37:0/95007648 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998689076 0 0) 0x7f55d015c920 con 0x7f55d006e0f0 2024-05-10T08:50:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55cf7fe640 1 -- 172.21.15.37:0/95007648 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55bc003520 con 0x7f55d006e0f0 2024-05-10T08:50:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d5553640 1 -- 172.21.15.37:0/95007648 >> v1:172.21.15.82:6789/0 conn(0x7f55d0072840 legacy=0x7f55d006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d5553640 1 -- 172.21.15.37:0/95007648 >> v1:172.21.15.37:6789/0 conn(0x7f55d006e0f0 legacy=0x7f55d00d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.856+0000 7f55d5553640 1 -- 172.21.15.37:0/95007648 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d015d1c0 con 0x7f55d015c340 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.857+0000 7f55d5553640 1 --2- 172.21.15.37:0/95007648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d015c340 0x7f55d0166970 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b5c0417dee821c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.857+0000 7f55cf7fe640 1 -- 172.21.15.37:0/95007648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8031600 con 0x7f55d015c340 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.857+0000 7f55cf7fe640 1 -- 172.21.15.37:0/95007648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c80317a0 con 0x7f55d015c340 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.857+0000 7f55cf7fe640 1 -- 172.21.15.37:0/95007648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8031b70 con 0x7f55d015c340 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.858+0000 7f55d6fb6640 1 -- 172.21.15.37:0/95007648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d015c340 msgr2=0x7f55d0166970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.858+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/95007648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d015c340 0x7f55d0166970 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c802a610 comp rx=0 tx=0).stop 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.858+0000 7f55d6fb6640 1 -- 172.21.15.37:0/95007648 shutdown_connections 2024-05-10T08:50:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.858+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/95007648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d015c340 0x7f55d0166970 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.858+0000 7f55d6fb6640 1 -- 172.21.15.37:0/95007648 >> 172.21.15.37:0/95007648 conn(0x7f55d006c3a0 msgr2=0x7f55d006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.858+0000 7f55d6fb6640 1 -- 172.21.15.37:0/95007648 shutdown_connections 2024-05-10T08:50:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.858+0000 7f55d6fb6640 1 -- 172.21.15.37:0/95007648 wait complete. 2024-05-10T08:50:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.859+0000 7f55d6fb6640 1 Processor -- start 2024-05-10T08:50:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.859+0000 7f55d6fb6640 1 -- start start 2024-05-10T08:50:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d6fb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d006e0f0 0x7f55d014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d6fb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d0072840 0x7f55d0148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d6fb6640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55d015c340 0x7f55d0137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d6fb6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0153230 con 0x7f55d0072840 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d6fb6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01530b0 con 0x7f55d006e0f0 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d6fb6640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f55d0166eb0 con 0x7f55d015c340 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d0072840 0x7f55d0148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d0072840 0x7f55d0148630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33668/0 (socket says 172.21.15.37:33668) 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55cffff640 1 -- 172.21.15.37:0/4175568016 learned_addr learned my addr 172.21.15.37:0/4175568016 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d4d52640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d006e0f0 0x7f55d014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.860+0000 7f55d5553640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55d015c340 0x7f55d0137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cffff640 1 -- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55d015c340 msgr2=0x7f55d0137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cffff640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55d015c340 0x7f55d0137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cffff640 1 -- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d006e0f0 msgr2=0x7f55d014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cffff640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d006e0f0 0x7f55d014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cffff640 1 -- 172.21.15.37:0/4175568016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d0145ab0 con 0x7f55d0072840 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55d5553640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55d015c340 0x7f55d0137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cffff640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d0072840 0x7f55d0148630 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f55b800c400 tx=0x7f55b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cd7fa640 1 -- 172.21.15.37:0/4175568016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8011790 con 0x7f55d0072840 2024-05-10T08:50:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cd7fa640 1 -- 172.21.15.37:0/4175568016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b8017070 con 0x7f55d0072840 2024-05-10T08:50:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d0145d90 con 0x7f55d0072840 2024-05-10T08:50:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55cd7fa640 1 -- 172.21.15.37:0/4175568016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8011bb0 con 0x7f55d0072840 2024-05-10T08:50:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.861+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d0146350 con 0x7f55d0072840 2024-05-10T08:50:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.862+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d00693f0 con 0x7f55d0072840 2024-05-10T08:50:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.863+0000 7f55cd7fa640 1 -- 172.21.15.37:0/4175568016 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55b801c460 con 0x7f55d0072840 2024-05-10T08:50:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.863+0000 7f55cd7fa640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55b0076300 0x7f55b00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.863+0000 7f55cd7fa640 1 -- 172.21.15.37:0/4175568016 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f55b80972e0 con 0x7f55d0072840 2024-05-10T08:50:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.863+0000 7f55d4d52640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55b0076300 0x7f55b00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.864+0000 7f55d4d52640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55b0076300 0x7f55b00787c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f55c0005880 tx=0x7f55c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:12.868+0000 7f55cd7fa640 1 -- 172.21.15.37:0/4175568016 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f55b8060d00 con 0x7f55d0072840 2024-05-10T08:50:13.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.058+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f55d015abc0 con 0x7f55b0076300 2024-05-10T08:50:13.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.059+0000 7f55cd7fa640 1 -- 172.21.15.37:0/4175568016 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55d015abc0 con 0x7f55b0076300 2024-05-10T08:50:13.057 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55b0076300 msgr2=0x7f55b00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55b0076300 0x7f55b00787c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f55c0005880 tx=0x7f55c0009040 comp rx=0 tx=0).stop 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d0072840 msgr2=0x7f55d0148630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d0072840 0x7f55d0148630 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f55b800c400 tx=0x7f55b800c8c0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 shutdown_connections 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f55b0076300 0x7f55b00787c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55d015c340 0x7f55d0137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55d0072840 0x7f55d0148630 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 --2- 172.21.15.37:0/4175568016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d006e0f0 0x7f55d014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 >> 172.21.15.37:0/4175568016 conn(0x7f55d006c3a0 msgr2=0x7f55d006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:13.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 shutdown_connections 2024-05-10T08:50:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.061+0000 7f55d6fb6640 1 -- 172.21.15.37:0/4175568016 wait complete. 2024-05-10T08:50:13.071 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T08:50:13.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T08:50:13.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.180+0000 7f9f3bbbe640 1 Processor -- start 2024-05-10T08:50:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.180+0000 7f9f3bbbe640 1 -- start start 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3bbbe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9f34073460 0x7f9f340ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3bbbe640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3406d3e0 con 0x7f9f34162d70 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3bbbe640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f34163750 con 0x7f9f3415f0d0 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3bbbe640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9f34163d10 con 0x7f9f34073460 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3a15b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9f34073460 0x7f9f340ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f39159640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9f34162d70 0x7f9f34072d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33706/0 (socket says 172.21.15.37:33706) 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3a15b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9f34073460 0x7f9f340ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33674/0 (socket says 172.21.15.37:33674) 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f39159640 1 -- 172.21.15.37:0/4001425843 learned_addr learned my addr 172.21.15.37:0/4001425843 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3a15b640 1 -- 172.21.15.37:0/4001425843 >> v1:172.21.15.82:6789/0 conn(0x7f9f3415f0d0 legacy=0x7f9f3406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3a15b640 1 -- 172.21.15.37:0/4001425843 >> v1:172.21.15.37:6789/0 conn(0x7f9f34162d70 legacy=0x7f9f34072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f3a15b640 1 -- 172.21.15.37:0/4001425843 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f34163a30 con 0x7f9f34073460 2024-05-10T08:50:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.181+0000 7f9f38958640 1 -- 172.21.15.37:0/4001425843 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881755448 0 0) 0x7f9f3406d3e0 con 0x7f9f34162d70 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.182+0000 7f9f3a15b640 1 --2- 172.21.15.37:0/4001425843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f340ae8b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009d90 tx=0x7f9f2c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e7afee8203b7e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.182+0000 7f9f38958640 1 -- 172.21.15.37:0/4001425843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c007740 con 0x7f9f34073460 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.182+0000 7f9f38958640 1 -- 172.21.15.37:0/4001425843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0078e0 con 0x7f9f34073460 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.182+0000 7f9f38958640 1 -- 172.21.15.37:0/4001425843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c007cb0 con 0x7f9f34073460 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.182+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/4001425843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 msgr2=0x7f9f340ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.183+0000 7f9f3bbbe640 1 --2- 172.21.15.37:0/4001425843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f340ae8b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009d90 tx=0x7f9f2c02a660 comp rx=0 tx=0).stop 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.183+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/4001425843 shutdown_connections 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.183+0000 7f9f3bbbe640 1 --2- 172.21.15.37:0/4001425843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f340ae8b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.183+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/4001425843 >> 172.21.15.37:0/4001425843 conn(0x7f9f340b3640 msgr2=0x7f9f340b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.183+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/4001425843 shutdown_connections 2024-05-10T08:50:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.183+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/4001425843 wait complete. 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.184+0000 7f9f3bbbe640 1 Processor -- start 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.184+0000 7f9f3bbbe640 1 -- start start 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f34159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3415f0d0 0x7f9f34149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34162d70 0x7f9f34160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3415f4b0 con 0x7f9f34073460 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3406c7b0 con 0x7f9f3415f0d0 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3415f630 con 0x7f9f34162d70 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f34159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f34159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33678/0 (socket says 172.21.15.37:33678) 2024-05-10T08:50:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 -- 172.21.15.37:0/11741602 learned_addr learned my addr 172.21.15.37:0/11741602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f39159640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3415f0d0 0x7f9f34149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3a15b640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34162d70 0x7f9f34160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 -- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34162d70 msgr2=0x7f9f34160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f34162d70 0x7f9f34160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 -- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3415f0d0 msgr2=0x7f9f34149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3415f0d0 0x7f9f34149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 -- 172.21.15.37:0/11741602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3415fc00 con 0x7f9f34073460 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3995a640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f34159af0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c480 tx=0x7f9f3000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f300052d0 con 0x7f9f34073460 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f30005470 con 0x7f9f34073460 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3415fee0 con 0x7f9f34073460 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30012870 con 0x7f9f34073460 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.185+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f341604a0 con 0x7f9f34073460 2024-05-10T08:50:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.186+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f340693f0 con 0x7f9f34073460 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.187+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9f30012a10 con 0x7f9f34073460 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.187+0000 7f9f2a7fc640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9f18076300 0x7f9f180787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f9f30097130 con 0x7f9f34073460 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f39159640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9f18076300 0x7f9f180787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f2a7fc640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f9f1807c8e0 0x7f9f1807ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f1807f3f0 con 0x7f9f1807c8e0 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) ==== 24+0+0 (secure 0 0 0) 0x7f9f3009e050 con 0x7f9f34073460 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f3a15b640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f9f1807c8e0 0x7f9f1807ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f39159640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9f18076300 0x7f9f180787c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9f34072f60 tx=0x7f9f24007e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.188+0000 7f9f3a15b640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f9f1807c8e0 0x7f9f1807ed20 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.189+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== osd.7 v2:172.21.15.82:6816/1827186019 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f1807f3f0 con 0x7f9f1807c8e0 2024-05-10T08:50:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.202+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 --> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9f3406d930 con 0x7f9f1807c8e0 2024-05-10T08:50:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f2a7fc640 1 -- 172.21.15.37:0/11741602 <== osd.7 v2:172.21.15.82:6816/1827186019 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9f3406d930 con 0x7f9f1807c8e0 2024-05-10T08:50:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-10T08:50:13.202 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T08:50:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-10T08:50:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f9f1807c8e0 msgr2=0x7f9f1807ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6816/1827186019,v1:172.21.15.82:6817/1827186019] conn(0x7f9f1807c8e0 0x7f9f1807ed20 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9f18076300 msgr2=0x7f9f180787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f9f18076300 0x7f9f180787c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9f34072f60 tx=0x7f9f24007e40 comp rx=0 tx=0).stop 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 msgr2=0x7f9f34159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 --2- 172.21.15.37:0/11741602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f34073460 0x7f9f34159af0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c480 tx=0x7f9f3000c940 comp rx=0 tx=0).stop 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3a15b640 1 -- 172.21.15.37:0/11741602 reap_dead start 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 shutdown_connections 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 >> 172.21.15.37:0/11741602 conn(0x7f9f340b3640 msgr2=0x7f9f3415e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 shutdown_connections 2024-05-10T08:50:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.203+0000 7f9f3bbbe640 1 -- 172.21.15.37:0/11741602 wait complete. 2024-05-10T08:50:13.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T08:50:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.318+0000 7f50e66c8640 1 Processor -- start 2024-05-10T08:50:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.318+0000 7f50e66c8640 1 -- start start 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.319+0000 7f50e66c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00d3cd0 0x7f50e00cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.319+0000 7f50e66c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e00d3330 con 0x7f50e00c9ee0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.319+0000 7f50e66c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e00d2170 con 0x7f50e01629a0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.319+0000 7f50e66c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f50e00d2450 con 0x7f50e00d3cd0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.319+0000 7f50e4c65640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50e00c9ee0 0x7f50e00d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33712/0 (socket says 172.21.15.37:33712) 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.319+0000 7f50e4c65640 1 -- 172.21.15.37:0/1979704758 learned_addr learned my addr 172.21.15.37:0/1979704758 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.319+0000 7f50df7fe640 1 --2- 172.21.15.37:0/1979704758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00d3cd0 0x7f50e00cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.320+0000 7f50deffd640 1 -- 172.21.15.37:0/1979704758 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817057203 0 0) 0x7f50e00d3330 con 0x7f50e00c9ee0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.320+0000 7f50deffd640 1 -- 172.21.15.37:0/1979704758 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50cc003520 con 0x7f50e00c9ee0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.320+0000 7f50deffd640 1 -- 172.21.15.37:0/1979704758 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678758670 0 0) 0x7f50e00d2170 con 0x7f50e01629a0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.320+0000 7f50deffd640 1 -- 172.21.15.37:0/1979704758 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e00d3330 con 0x7f50e01629a0 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.320+0000 7f50df7fe640 1 -- 172.21.15.37:0/1979704758 >> v1:172.21.15.82:6789/0 conn(0x7f50e01629a0 legacy=0x7f50e00d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.320+0000 7f50df7fe640 1 -- 172.21.15.37:0/1979704758 >> v1:172.21.15.37:6789/0 conn(0x7f50e00c9ee0 legacy=0x7f50e00d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.320+0000 7f50df7fe640 1 -- 172.21.15.37:0/1979704758 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e00d2730 con 0x7f50e00d3cd0 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50df7fe640 1 --2- 172.21.15.37:0/1979704758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00d3cd0 0x7f50e00cfca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50c80097d0 tx=0x7f50c802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84dccf94e60f5240 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50deffd640 1 -- 172.21.15.37:0/1979704758 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8037070 con 0x7f50e00d3cd0 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50deffd640 1 -- 172.21.15.37:0/1979704758 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c802ae50 con 0x7f50e00d3cd0 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50deffd640 1 -- 172.21.15.37:0/1979704758 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8032640 con 0x7f50e00d3cd0 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50e66c8640 1 -- 172.21.15.37:0/1979704758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00d3cd0 msgr2=0x7f50e00cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50e66c8640 1 --2- 172.21.15.37:0/1979704758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00d3cd0 0x7f50e00cfca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50c80097d0 tx=0x7f50c802a100 comp rx=0 tx=0).stop 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50e66c8640 1 -- 172.21.15.37:0/1979704758 shutdown_connections 2024-05-10T08:50:13.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50e66c8640 1 --2- 172.21.15.37:0/1979704758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00d3cd0 0x7f50e00cfca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50e66c8640 1 -- 172.21.15.37:0/1979704758 >> 172.21.15.37:0/1979704758 conn(0x7f50e00d4fe0 msgr2=0x7f50e00d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50e66c8640 1 -- 172.21.15.37:0/1979704758 shutdown_connections 2024-05-10T08:50:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.321+0000 7f50e66c8640 1 -- 172.21.15.37:0/1979704758 wait complete. 2024-05-10T08:50:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.323+0000 7f50e66c8640 1 Processor -- start 2024-05-10T08:50:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.323+0000 7f50e66c8640 1 -- start start 2024-05-10T08:50:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e66c8640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00c9ee0 0x7f50e00b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e66c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50e00d3cd0 0x7f50e00ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e66c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e01629a0 0x7f50e00b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e66c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50e00cf440 con 0x7f50e00d3cd0 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e66c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50e00cf2c0 con 0x7f50e01629a0 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e66c8640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f50e00d2dc0 con 0x7f50e00c9ee0 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50e00d3cd0 0x7f50e00ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50e00d3cd0 0x7f50e00ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33680/0 (socket says 172.21.15.37:33680) 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 -- 172.21.15.37:0/4264898989 learned_addr learned my addr 172.21.15.37:0/4264898989 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50dffff640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00c9ee0 0x7f50e00b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e4c65640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e01629a0 0x7f50e00b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 -- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00c9ee0 msgr2=0x7f50e00b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00c9ee0 0x7f50e00b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 -- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e01629a0 msgr2=0x7f50e00b9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e01629a0 0x7f50e00b9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 -- 172.21.15.37:0/4264898989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e01f9980 con 0x7f50e00d3cd0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e4c65640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e01629a0 0x7f50e00b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50df7fe640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50e00d3cd0 0x7f50e00ce910 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f50c802a140 tx=0x7f50c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50dcff9640 1 -- 172.21.15.37:0/4264898989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8041070 con 0x7f50e00d3cd0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50dcff9640 1 -- 172.21.15.37:0/4264898989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c803c460 con 0x7f50e00d3cd0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50dcff9640 1 -- 172.21.15.37:0/4264898989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8037040 con 0x7f50e00d3cd0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.324+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e00cdb50 con 0x7f50e00d3cd0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.325+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e00ce110 con 0x7f50e00d3cd0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.325+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e00d2170 con 0x7f50e00d3cd0 2024-05-10T08:50:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.326+0000 7f50dcff9640 1 -- 172.21.15.37:0/4264898989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f50c8044070 con 0x7f50e00d3cd0 2024-05-10T08:50:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.327+0000 7f50dcff9640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f50c00762d0 0x7f50c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.327+0000 7f50dcff9640 1 -- 172.21.15.37:0/4264898989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f50c80b7ba0 con 0x7f50e00d3cd0 2024-05-10T08:50:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.327+0000 7f50dffff640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f50c00762d0 0x7f50c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.328+0000 7f50dffff640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f50c00762d0 0x7f50c0078790 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f50d00015b0 tx=0x7f50d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.331+0000 7f50dcff9640 1 -- 172.21.15.37:0/4264898989 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f50e00d2170 con 0x7f50e00d3cd0 2024-05-10T08:50:13.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.522+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f50e00cb8e0 con 0x7f50c00762d0 2024-05-10T08:50:13.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.524+0000 7f50dcff9640 1 -- 172.21.15.37:0/4264898989 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50e00cb8e0 con 0x7f50c00762d0 2024-05-10T08:50:13.522 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f50c00762d0 msgr2=0x7f50c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f50c00762d0 0x7f50c0078790 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f50d00015b0 tx=0x7f50d0009040 comp rx=0 tx=0).stop 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50e00d3cd0 msgr2=0x7f50e00ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50e00d3cd0 0x7f50e00ce910 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f50c802a140 tx=0x7f50c80046c0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 shutdown_connections 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f50c00762d0 0x7f50c0078790 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e01629a0 0x7f50e00b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50e00d3cd0 0x7f50e00ce910 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 --2- 172.21.15.37:0/4264898989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f50e00c9ee0 0x7f50e00b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 >> 172.21.15.37:0/4264898989 conn(0x7f50e00d4fe0 msgr2=0x7f50e00d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 shutdown_connections 2024-05-10T08:50:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.525+0000 7f50e66c8640 1 -- 172.21.15.37:0/4264898989 wait complete. 2024-05-10T08:50:13.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:50:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.640+0000 7f8f6d546640 1 Processor -- start 2024-05-10T08:50:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.640+0000 7f8f6d546640 1 -- start start 2024-05-10T08:50:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f6d546640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f6d546640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f680c9ee0 0x7f8f680d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f6d546640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f680d3330 con 0x7f8f681629a0 2024-05-10T08:50:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f6d546640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8f680d2170 con 0x7f8f680c9ee0 2024-05-10T08:50:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f6d546640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8f680d2450 con 0x7f8f680d3cd0 2024-05-10T08:50:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f677fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f680c9ee0 0x7f8f680d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f677fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f680c9ee0 0x7f8f680d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33690/0 (socket says 172.21.15.37:33690) 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f677fe640 1 -- 172.21.15.37:0/821651295 learned_addr learned my addr 172.21.15.37:0/821651295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f66ffd640 1 --1- 172.21.15.37:0/821651295 >> v1:172.21.15.37:6789/0 conn(0x7f8f681629a0 0x7f8f680d35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33726/0 (socket says 172.21.15.37:33726) 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f667fc640 1 --2- 172.21.15.37:0/821651295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f677fe640 1 -- 172.21.15.37:0/821651295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 msgr2=0x7f8f680cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f677fe640 1 --2- 172.21.15.37:0/821651295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f677fe640 1 -- 172.21.15.37:0/821651295 >> v1:172.21.15.37:6789/0 conn(0x7f8f681629a0 legacy=0x7f8f680d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f677fe640 1 -- 172.21.15.37:0/821651295 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f680d2730 con 0x7f8f680c9ee0 2024-05-10T08:50:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.641+0000 7f8f667fc640 1 --2- 172.21.15.37:0/821651295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.642+0000 7f8f677fe640 1 --2- 172.21.15.37:0/821651295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f680c9ee0 0x7f8f680d01e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009e50 tx=0x7f8f6002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9326bfaf5d4f2a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.642+0000 7f8f65ffb640 1 -- 172.21.15.37:0/821651295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60036070 con 0x7f8f680c9ee0 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.642+0000 7f8f65ffb640 1 -- 172.21.15.37:0/821651295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f60031600 con 0x7f8f680c9ee0 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.642+0000 7f8f65ffb640 1 -- 172.21.15.37:0/821651295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600319d0 con 0x7f8f680c9ee0 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 -- 172.21.15.37:0/821651295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f680c9ee0 msgr2=0x7f8f680d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 --2- 172.21.15.37:0/821651295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f680c9ee0 0x7f8f680d01e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009e50 tx=0x7f8f6002a5f0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 -- 172.21.15.37:0/821651295 shutdown_connections 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 --2- 172.21.15.37:0/821651295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f680c9ee0 0x7f8f680d01e0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 --2- 172.21.15.37:0/821651295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 -- 172.21.15.37:0/821651295 >> 172.21.15.37:0/821651295 conn(0x7f8f680d4fe0 msgr2=0x7f8f680d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 -- 172.21.15.37:0/821651295 shutdown_connections 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.643+0000 7f8f6d546640 1 -- 172.21.15.37:0/821651295 wait complete. 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.644+0000 7f8f6d546640 1 Processor -- start 2024-05-10T08:50:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.644+0000 7f8f6d546640 1 -- start start 2024-05-10T08:50:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f6d546640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f680c9ee0 0x7f8f6815d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f6d546640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f6d546640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f681629a0 0x7f8f680a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f6d546640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f680cf440 con 0x7f8f681629a0 2024-05-10T08:50:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f6d546640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f680cf2c0 con 0x7f8f680c9ee0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f6d546640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8f680d2dc0 con 0x7f8f680d3cd0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f681629a0 0x7f8f680a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f681629a0 0x7f8f680a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33702/0 (socket says 172.21.15.37:33702) 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 -- 172.21.15.37:0/2006583107 learned_addr learned my addr 172.21.15.37:0/2006583107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 -- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 msgr2=0x7f8f680a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f667fc640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f66ffd640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f680c9ee0 0x7f8f6815d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 -- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f680c9ee0 msgr2=0x7f8f6815d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f680c9ee0 0x7f8f6815d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.645+0000 7f8f677fe640 1 -- 172.21.15.37:0/2006583107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f680a2440 con 0x7f8f681629a0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.646+0000 7f8f677fe640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f681629a0 0x7f8f680a1be0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8f60034040 tx=0x7f8f60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.646+0000 7f8f4f7fe640 1 -- 172.21.15.37:0/2006583107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60036050 con 0x7f8f681629a0 2024-05-10T08:50:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.646+0000 7f8f4f7fe640 1 -- 172.21.15.37:0/2006583107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f60042070 con 0x7f8f681629a0 2024-05-10T08:50:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.646+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f680cc8f0 con 0x7f8f681629a0 2024-05-10T08:50:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.646+0000 7f8f4f7fe640 1 -- 172.21.15.37:0/2006583107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60007bd0 con 0x7f8f681629a0 2024-05-10T08:50:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.646+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6815d990 con 0x7f8f681629a0 2024-05-10T08:50:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.647+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f680693f0 con 0x7f8f681629a0 2024-05-10T08:50:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.647+0000 7f8f4f7fe640 1 -- 172.21.15.37:0/2006583107 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8f60047460 con 0x7f8f681629a0 2024-05-10T08:50:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.648+0000 7f8f4f7fe640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8f540762d0 0x7f8f54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.648+0000 7f8f4f7fe640 1 -- 172.21.15.37:0/2006583107 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f8f600b8480 con 0x7f8f681629a0 2024-05-10T08:50:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.648+0000 7f8f66ffd640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8f540762d0 0x7f8f54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.649+0000 7f8f66ffd640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8f540762d0 0x7f8f54078790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8f6815dcf0 tx=0x7f8f58009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.652+0000 7f8f4f7fe640 1 -- 172.21.15.37:0/2006583107 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8f60081f30 con 0x7f8f681629a0 2024-05-10T08:50:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.839+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f680b6640 con 0x7f8f540762d0 2024-05-10T08:50:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.841+0000 7f8f4f7fe640 1 -- 172.21.15.37:0/2006583107 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13461 (secure 0 0 0) 0x7f8f680b6640 con 0x7f8f540762d0 2024-05-10T08:50:13.839 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:50:13.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8f540762d0 msgr2=0x7f8f54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8f540762d0 0x7f8f54078790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8f6815dcf0 tx=0x7f8f58009040 comp rx=0 tx=0).stop 2024-05-10T08:50:13.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f681629a0 msgr2=0x7f8f680a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f681629a0 0x7f8f680a1be0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8f60034040 tx=0x7f8f60004a40 comp rx=0 tx=0).stop 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 shutdown_connections 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f8f540762d0 0x7f8f54078790 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f681629a0 0x7f8f680a1be0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f680d3cd0 0x7f8f680a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 --2- 172.21.15.37:0/2006583107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f680c9ee0 0x7f8f6815d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 >> 172.21.15.37:0/2006583107 conn(0x7f8f680d4fe0 msgr2=0x7f8f6806d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 shutdown_connections 2024-05-10T08:50:13.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:13.842+0000 7f8f6d546640 1 -- 172.21.15.37:0/2006583107 wait complete. 2024-05-10T08:50:13.852 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2024-05-10T08:50:13.470928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262548,"kb_used_data":13096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712172,"statfs":{"total":773094113280,"available":772825264128,"internally_reserved":0,"allocated":13410304,"data_stored":6876592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388625,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-32,"num_read_kb":-13,"num_write":-29,"num_write_kb":-8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.844840"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":302,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-05-10T08:50:05.632774+0000","last_change":"2024-05-10T08:40:13.191600+0000","last_active":"2024-05-10T08:50:05.632774+0000","last_peered":"2024-05-10T08:50:05.632774+0000","last_clean":"2024-05-10T08:50:05.632774+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:50:05.632774+0000","last_undegraded":"2024-05-10T08:50:05.632774+0000","last_fullsized":"2024-05-10T08:50:05.632774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T08:40:11.674138+0000","last_clean_scrub_stamp":"2024-05-10T08:40:11.674138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:37.661750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2121728,"data_stored":1302350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2121728,"data_stored":1302350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:50:13.855 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T08:40:11.674138+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=8, tm_min=40, tm_sec=11, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=8, tm_min=50, tm_sec=8, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T08:50:13.855 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T08:50:24.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:50:24.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:50:33.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T08:50:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.974+0000 7fc1b08a0640 1 Processor -- start 2024-05-10T08:50:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.974+0000 7fc1b08a0640 1 -- start start 2024-05-10T08:50:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1b08a0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1ac1629b0 0x7fc1ac06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1b08a0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ac06e110 con 0x7fc1ac070d20 2024-05-10T08:50:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1b08a0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ac06e3f0 con 0x7fc1ac0b2490 2024-05-10T08:50:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1b08a0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc1ac070a40 con 0x7fc1ac1629b0 2024-05-10T08:50:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1aa59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1ac1629b0 0x7fc1ac06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1aad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc1ac070d20 0x7fc1ac0afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51882/0 (socket says 172.21.15.37:51882) 2024-05-10T08:50:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1aad9d640 1 -- 172.21.15.37:0/2466699621 learned_addr learned my addr 172.21.15.37:0/2466699621 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1aa59c640 1 -- 172.21.15.37:0/2466699621 >> v1:172.21.15.82:6789/0 conn(0x7fc1ac0b2490 legacy=0x7fc1ac070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1aa59c640 1 -- 172.21.15.37:0/2466699621 >> v1:172.21.15.37:6789/0 conn(0x7fc1ac070d20 legacy=0x7fc1ac0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1aa59c640 1 -- 172.21.15.37:0/2466699621 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ac06e6d0 con 0x7fc1ac1629b0 2024-05-10T08:50:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.975+0000 7fc1a9d9b640 1 -- 172.21.15.37:0/2466699621 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610826966 0 0) 0x7fc1ac06e110 con 0x7fc1ac070d20 2024-05-10T08:50:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.976+0000 7fc1aa59c640 1 --2- 172.21.15.37:0/2466699621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac06eed0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0097a0 tx=0x7fc19c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fa12a851d90a2f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.976+0000 7fc1a9d9b640 1 -- 172.21.15.37:0/2466699621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c037070 con 0x7fc1ac1629b0 2024-05-10T08:50:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.976+0000 7fc1a9d9b640 1 -- 172.21.15.37:0/2466699621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c032440 con 0x7fc1ac1629b0 2024-05-10T08:50:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.976+0000 7fc1a9d9b640 1 -- 172.21.15.37:0/2466699621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c032810 con 0x7fc1ac1629b0 2024-05-10T08:50:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.977+0000 7fc1b08a0640 1 -- 172.21.15.37:0/2466699621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 msgr2=0x7fc1ac06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.977+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/2466699621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac06eed0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0097a0 tx=0x7fc19c02a1e0 comp rx=0 tx=0).stop 2024-05-10T08:50:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.977+0000 7fc1b08a0640 1 -- 172.21.15.37:0/2466699621 shutdown_connections 2024-05-10T08:50:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.977+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/2466699621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac06eed0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.977+0000 7fc1b08a0640 1 -- 172.21.15.37:0/2466699621 >> 172.21.15.37:0/2466699621 conn(0x7fc1ac0b49d0 msgr2=0x7fc1ac0b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.977+0000 7fc1b08a0640 1 -- 172.21.15.37:0/2466699621 shutdown_connections 2024-05-10T08:50:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.977+0000 7fc1b08a0640 1 -- 172.21.15.37:0/2466699621 wait complete. 2024-05-10T08:50:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 Processor -- start 2024-05-10T08:50:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 -- start start 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1ac070d20 0x7fc1ac0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1ac0b2490 0x7fc1ac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ac06f410 con 0x7fc1ac1629b0 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ac06dec0 con 0x7fc1ac070d20 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.979+0000 7fc1b08a0640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ac0b03c0 con 0x7fc1ac0b2490 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac0cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37800/0 (socket says 172.21.15.37:37800) 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 -- 172.21.15.37:0/800712268 learned_addr learned my addr 172.21.15.37:0/800712268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aa59c640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1ac070d20 0x7fc1ac0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1a1d9b640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1ac0b2490 0x7fc1ac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 -- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1ac0b2490 msgr2=0x7fc1ac0b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1ac0b2490 0x7fc1ac0b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 -- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1ac070d20 msgr2=0x7fc1ac0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1ac070d20 0x7fc1ac0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 -- 172.21.15.37:0/800712268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ac0cf5e0 con 0x7fc1ac1629b0 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1aad9d640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac0cd450 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c7d0 tx=0x7fc1a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1a37fe640 1 -- 172.21.15.37:0/800712268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4018070 con 0x7fc1ac1629b0 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1a37fe640 1 -- 172.21.15.37:0/800712268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a400a5e0 con 0x7fc1ac1629b0 2024-05-10T08:50:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1a37fe640 1 -- 172.21.15.37:0/800712268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400aa10 con 0x7fc1ac1629b0 2024-05-10T08:50:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ac0cf8c0 con 0x7fc1ac1629b0 2024-05-10T08:50:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.980+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ac0cfe80 con 0x7fc1ac1629b0 2024-05-10T08:50:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.981+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ac0693f0 con 0x7fc1ac1629b0 2024-05-10T08:50:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.982+0000 7fc1a37fe640 1 -- 172.21.15.37:0/800712268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc1a400abb0 con 0x7fc1ac1629b0 2024-05-10T08:50:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.983+0000 7fc1a37fe640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc18c0762d0 0x7fc18c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.983+0000 7fc1a37fe640 1 -- 172.21.15.37:0/800712268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7fc1a4096b40 con 0x7fc1ac1629b0 2024-05-10T08:50:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.983+0000 7fc1aa59c640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc18c0762d0 0x7fc18c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.983+0000 7fc1aa59c640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc18c0762d0 0x7fc18c078790 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc19c034000 tx=0x7fc19c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:33.987+0000 7fc1a37fe640 1 -- 172.21.15.37:0/800712268 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc1a405fe70 con 0x7fc1ac1629b0 2024-05-10T08:50:34.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.174+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 --> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1ac076460 con 0x7fc18c0762d0 2024-05-10T08:50:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.175+0000 7fc1a37fe640 1 -- 172.21.15.37:0/800712268 <== mgr.4109 v2:172.21.15.82:6832/2336330207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7fc1ac076460 con 0x7fc18c0762d0 2024-05-10T08:50:34.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc18c0762d0 msgr2=0x7fc18c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc18c0762d0 0x7fc18c078790 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc19c034000 tx=0x7fc19c02e000 comp rx=0 tx=0).stop 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 msgr2=0x7fc1ac0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac0cd450 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c7d0 tx=0x7fc1a400cc90 comp rx=0 tx=0).stop 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 shutdown_connections 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fc18c0762d0 0x7fc18c078790 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1ac1629b0 0x7fc1ac0cd450 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc1ac0b2490 0x7fc1ac0b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 --2- 172.21.15.37:0/800712268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1ac070d20 0x7fc1ac0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 >> 172.21.15.37:0/800712268 conn(0x7fc1ac0b49d0 msgr2=0x7fc1ac0afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 shutdown_connections 2024-05-10T08:50:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.177+0000 7fc1b08a0640 1 -- 172.21.15.37:0/800712268 wait complete. 2024-05-10T08:50:34.187 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-05-10T08:50:33.474992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262532,"kb_used_data":13096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712188,"statfs":{"total":773094113280,"available":772825280512,"internally_reserved":0,"allocated":13410304,"data_stored":6876592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002400"},"pg_stats":[{"pgid":"1.0","version":"122'74","reported_seq":314,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-05-10T08:50:14.429316+0000","last_change":"2024-05-10T08:50:14.429316+0000","last_active":"2024-05-10T08:50:14.429316+0000","last_peered":"2024-05-10T08:50:14.429316+0000","last_clean":"2024-05-10T08:50:14.429316+0000","last_became_active":"2024-05-10T08:40:13.190628+0000","last_became_peered":"2024-05-10T08:40:13.190628+0000","last_unstale":"2024-05-10T08:50:14.429316+0000","last_undegraded":"2024-05-10T08:50:14.429316+0000","last_fullsized":"2024-05-10T08:50:14.429316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'74","last_scrub_stamp":"2024-05-10T08:50:14.429209+0000","last_deep_scrub":"122'74","last_deep_scrub_stamp":"2024-05-10T08:50:14.429209+0000","last_clean_scrub_stamp":"2024-05-10T08:50:14.429209+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:30:23.679102+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2121728,"data_stored":1302350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1527808,"data_stored":711982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2121728,"data_stored":1302350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T08:50:34.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T08:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.292+0000 7f2bbd233640 1 Processor -- start 2024-05-10T08:50:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.292+0000 7f2bbd233640 1 -- start start 2024-05-10T08:50:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bbd233640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2bb8160d00 0x7f2bb81610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bbd233640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d00c0 0x7f2bb815d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bbd233640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb8161620 con 0x7f2bb80d0520 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bbd233640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb80ce9e0 con 0x7f2bb8160d00 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bbd233640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb80cddd0 con 0x7f2bb80d00c0 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2bb8160d00 0x7f2bb81610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb759e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2bb80d0520 0x7f2bb815d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51886/0 (socket says 172.21.15.37:51886) 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2bb8160d00 0x7f2bb81610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37806/0 (socket says 172.21.15.37:37806) 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb759e640 1 -- 172.21.15.37:0/778494123 learned_addr learned my addr 172.21.15.37:0/778494123 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2baffff640 1 --2- 172.21.15.37:0/778494123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d00c0 0x7f2bb815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb6d9d640 1 -- 172.21.15.37:0/778494123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d00c0 msgr2=0x7f2bb815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb6d9d640 1 --2- 172.21.15.37:0/778494123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d00c0 0x7f2bb815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb6d9d640 1 -- 172.21.15.37:0/778494123 >> v1:172.21.15.37:6789/0 conn(0x7f2bb80d0520 legacy=0x7f2bb815d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2bb6d9d640 1 -- 172.21.15.37:0/778494123 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb80ce0b0 con 0x7f2bb8160d00 2024-05-10T08:50:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.293+0000 7f2baffff640 1 --2- 172.21.15.37:0/778494123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d00c0 0x7f2bb815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T08:50:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.294+0000 7f2bb6d9d640 1 --2- 172.21.15.37:0/778494123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb8160d00 0x7f2bb81610e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80097a0 tx=0x7f2ba802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b57afec267cec6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.294+0000 7f2bb659c640 1 -- 172.21.15.37:0/778494123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8037070 con 0x7f2bb8160d00 2024-05-10T08:50:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.294+0000 7f2bb659c640 1 -- 172.21.15.37:0/778494123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8032440 con 0x7f2bb8160d00 2024-05-10T08:50:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.294+0000 7f2bb659c640 1 -- 172.21.15.37:0/778494123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8032810 con 0x7f2bb8160d00 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 -- 172.21.15.37:0/778494123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb8160d00 msgr2=0x7f2bb81610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 --2- 172.21.15.37:0/778494123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb8160d00 0x7f2bb81610e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80097a0 tx=0x7f2ba802a210 comp rx=0 tx=0).stop 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 -- 172.21.15.37:0/778494123 shutdown_connections 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 --2- 172.21.15.37:0/778494123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d00c0 0x7f2bb815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 --2- 172.21.15.37:0/778494123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb8160d00 0x7f2bb81610e0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 -- 172.21.15.37:0/778494123 >> 172.21.15.37:0/778494123 conn(0x7f2bb80d2e90 msgr2=0x7f2bb80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 -- 172.21.15.37:0/778494123 shutdown_connections 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.295+0000 7f2bbd233640 1 -- 172.21.15.37:0/778494123 wait complete. 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.296+0000 7f2bbd233640 1 Processor -- start 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.296+0000 7f2bbd233640 1 -- start start 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bbd233640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb80d00c0 0x7f2bb80b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bbd233640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d0520 0x7f2bb81f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bbd233640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb8160d00 0x7f2bb81573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bbd233640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80cda60 con 0x7f2bb80d00c0 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bbd233640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80ce670 con 0x7f2bb8160d00 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bbd233640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb80d1a70 con 0x7f2bb80d0520 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb80d00c0 0x7f2bb80b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb80d00c0 0x7f2bb80b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37816/0 (socket says 172.21.15.37:37816) 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 -- 172.21.15.37:0/3942580116 learned_addr learned my addr 172.21.15.37:0/3942580116 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb759e640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb8160d00 0x7f2bb81573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2baffff640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d0520 0x7f2bb81f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 -- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d0520 msgr2=0x7f2bb81f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d0520 0x7f2bb81f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 -- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb8160d00 msgr2=0x7f2bb81573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb8160d00 0x7f2bb81573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 -- 172.21.15.37:0/3942580116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb80b7b10 con 0x7f2bb80d00c0 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb759e640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb8160d00 0x7f2bb81573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.297+0000 7f2bb6d9d640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb80d00c0 0x7f2bb80b6c00 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80098c0 tx=0x7f2ba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.298+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8041070 con 0x7f2bb80d00c0 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.298+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba803c930 con 0x7f2bb80d00c0 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.298+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb80b7270 con 0x7f2bb80d00c0 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.298+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8037040 con 0x7f2bb80d00c0 2024-05-10T08:50:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.298+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb80b7830 con 0x7f2bb80d00c0 2024-05-10T08:50:34.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.299+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb80693f0 con 0x7f2bb80d00c0 2024-05-10T08:50:34.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.299+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ba8044070 con 0x7f2bb80d00c0 2024-05-10T08:50:34.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.300+0000 7f2baf7fe640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b980762d0 0x7f2b98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.300+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7f2ba80b80a0 con 0x7f2bb80d00c0 2024-05-10T08:50:34.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.300+0000 7f2baffff640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b980762d0 0x7f2b98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.301+0000 7f2baffff640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b980762d0 0x7f2b98078790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2bb815c390 tx=0x7f2ba0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:34.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.304+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2ba8081b50 con 0x7f2bb80d00c0 2024-05-10T08:50:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.495+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f2bb806d140 con 0x7f2bb80d00c0 2024-05-10T08:50:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.498+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f2ba8081450 con 0x7f2bb80d00c0 2024-05-10T08:50:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.500+0000 7f2baf7fe640 1 -- 172.21.15.37:0/3942580116 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2ba8080f60 con 0x7f2bb80d00c0 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b980762d0 msgr2=0x7f2b98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b980762d0 0x7f2b98078790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2bb815c390 tx=0x7f2ba0008040 comp rx=0 tx=0).stop 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb80d00c0 msgr2=0x7f2bb80b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb80d00c0 0x7f2bb80b6c00 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80098c0 tx=0x7f2ba80046c0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 shutdown_connections 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7f2b980762d0 0x7f2b98078790 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb8160d00 0x7f2bb81573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2bb80d0520 0x7f2bb81f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 --2- 172.21.15.37:0/3942580116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bb80d00c0 0x7f2bb80b6c00 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 >> 172.21.15.37:0/3942580116 conn(0x7f2bb80d2e90 msgr2=0x7f2bb8159210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:34.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 shutdown_connections 2024-05-10T08:50:34.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.501+0000 7f2bbd233640 1 -- 172.21.15.37:0/3942580116 wait complete. 2024-05-10T08:50:34.511 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T08:50:34.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T08:50:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.616+0000 7fe15ff46640 1 Processor -- start 2024-05-10T08:50:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.616+0000 7fe15ff46640 1 -- start start 2024-05-10T08:50:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15ff46640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1581629b0 0x7fe15806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15ff46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1580b2490 0x7fe158070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15ff46640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15806e110 con 0x7fe158070d20 2024-05-10T08:50:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15ff46640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe15806dec0 con 0x7fe1581629b0 2024-05-10T08:50:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15ff46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe15806e3f0 con 0x7fe1580b2490 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15d4e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1580b2490 0x7fe158070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15dce2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1581629b0 0x7fe15806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15d4e1640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1580b2490 0x7fe158070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.37:34104/0 (socket says 172.21.15.37:34104) 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.617+0000 7fe15d4e1640 1 -- 172.21.15.37:0/2435730058 learned_addr learned my addr 172.21.15.37:0/2435730058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.618+0000 7fe15dce2640 1 -- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1580b2490 msgr2=0x7fe158070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.618+0000 7fe15dce2640 1 --2- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1580b2490 0x7fe158070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.618+0000 7fe15dce2640 1 -- 172.21.15.37:0/2435730058 >> v1:172.21.15.82:6789/0 conn(0x7fe158070d20 legacy=0x7fe1580afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.618+0000 7fe15dce2640 1 -- 172.21.15.37:0/2435730058 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15806e6d0 con 0x7fe1581629b0 2024-05-10T08:50:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.618+0000 7fe15d4e1640 1 --2- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1580b2490 0x7fe158070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15dce2640 1 --2- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1581629b0 0x7fe15806eed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1540097a0 tx=0x7fe15402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50be242b2379ced9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15cce0640 1 -- 172.21.15.37:0/2435730058 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154037070 con 0x7fe1581629b0 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15cce0640 1 -- 172.21.15.37:0/2435730058 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe154032440 con 0x7fe1581629b0 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15cce0640 1 -- 172.21.15.37:0/2435730058 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154032830 con 0x7fe1581629b0 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 -- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1581629b0 msgr2=0x7fe15806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 --2- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1581629b0 0x7fe15806eed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1540097a0 tx=0x7fe15402a180 comp rx=0 tx=0).stop 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 -- 172.21.15.37:0/2435730058 shutdown_connections 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 --2- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1580b2490 0x7fe158070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 --2- 172.21.15.37:0/2435730058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1581629b0 0x7fe15806eed0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 -- 172.21.15.37:0/2435730058 >> 172.21.15.37:0/2435730058 conn(0x7fe1580b49d0 msgr2=0x7fe1580b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 -- 172.21.15.37:0/2435730058 shutdown_connections 2024-05-10T08:50:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.619+0000 7fe15ff46640 1 -- 172.21.15.37:0/2435730058 wait complete. 2024-05-10T08:50:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 Processor -- start 2024-05-10T08:50:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 -- start start 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe158070d20 0x7fe1580c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1580b2490 0x7fe15814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1581629b0 0x7fe15814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe158070870 con 0x7fe158070d20 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe15806f410 con 0x7fe1580b2490 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15ff46640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe1580709f0 con 0x7fe1581629b0 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15dce2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe158070d20 0x7fe1580c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.621+0000 7fe15dce2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe158070d20 0x7fe1580c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37820/0 (socket says 172.21.15.37:37820) 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15dce2640 1 -- 172.21.15.37:0/1039684877 learned_addr learned my addr 172.21.15.37:0/1039684877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15d4e1640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1580b2490 0x7fe15814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15e4e3640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1581629b0 0x7fe15814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15dce2640 1 -- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1581629b0 msgr2=0x7fe15814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15dce2640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1581629b0 0x7fe15814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15dce2640 1 -- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1580b2490 msgr2=0x7fe15814d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15dce2640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1580b2490 0x7fe15814d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15dce2640 1 -- 172.21.15.37:0/1039684877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1580d0330 con 0x7fe158070d20 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15d4e1640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1580b2490 0x7fe15814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15dce2640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe158070d20 0x7fe1580c9230 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe154035040 tx=0x7fe1540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe14e7fc640 1 -- 172.21.15.37:0/1039684877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154041030 con 0x7fe158070d20 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe14e7fc640 1 -- 172.21.15.37:0/1039684877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe154030580 con 0x7fe158070d20 2024-05-10T08:50:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1580cd510 con 0x7fe158070d20 2024-05-10T08:50:34.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe14e7fc640 1 -- 172.21.15.37:0/1039684877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154037040 con 0x7fe158070d20 2024-05-10T08:50:34.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.622+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1580c68a0 con 0x7fe158070d20 2024-05-10T08:50:34.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.623+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1580693f0 con 0x7fe158070d20 2024-05-10T08:50:34.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.624+0000 7fe14e7fc640 1 -- 172.21.15.37:0/1039684877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe154044070 con 0x7fe158070d20 2024-05-10T08:50:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.624+0000 7fe14e7fc640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe13c0762d0 0x7fe13c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T08:50:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.624+0000 7fe14e7fc640 1 -- 172.21.15.37:0/1039684877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5507+0+0 (secure 0 0 0) 0x7fe1540b7d20 con 0x7fe158070d20 2024-05-10T08:50:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.625+0000 7fe15d4e1640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe13c0762d0 0x7fe13c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T08:50:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.625+0000 7fe15d4e1640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe13c0762d0 0x7fe13c078790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe148009630 tx=0x7fe148009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T08:50:34.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.629+0000 7fe14e7fc640 1 -- 172.21.15.37:0/1039684877 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe154080fc0 con 0x7fe158070d20 2024-05-10T08:50:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.859+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe15815fa90 con 0x7fe158070d20 2024-05-10T08:50:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.860+0000 7fe14e7fc640 1 -- 172.21.15.37:0/1039684877 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+3869 (secure 0 0 0) 0x7fe1540852c0 con 0x7fe158070d20 2024-05-10T08:50:34.859 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-10T08:50:34.859 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":113,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2241791228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2241791228},{"type":"v1","addr":"172.21.15.82:6836","nonce":2241791228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3652753409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3652753409},{"type":"v1","addr":"172.21.15.82:6837","nonce":3652753409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3818720199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3818720199},{"type":"v1","addr":"172.21.15.37:6834","nonce":3818720199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/630735333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":630735333},{"type":"v1","addr":"172.21.15.37:6835","nonce":630735333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[]} 2024-05-10T08:50:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 113 2024-05-10T08:50:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe13c0762d0 msgr2=0x7fe13c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe13c0762d0 0x7fe13c078790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe148009630 tx=0x7fe148009240 comp rx=0 tx=0).stop 2024-05-10T08:50:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe158070d20 msgr2=0x7fe1580c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T08:50:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe158070d20 0x7fe1580c9230 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe154035040 tx=0x7fe1540046c0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 shutdown_connections 2024-05-10T08:50:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:6832/2336330207,v1:172.21.15.82:6833/2336330207] conn(0x7fe13c0762d0 0x7fe13c078790 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe1581629b0 0x7fe15814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1580b2490 0x7fe15814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 --2- 172.21.15.37:0/1039684877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe158070d20 0x7fe1580c9230 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T08:50:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 >> 172.21.15.37:0/1039684877 conn(0x7fe1580b49d0 msgr2=0x7fe158160050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T08:50:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 shutdown_connections 2024-05-10T08:50:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-10T08:50:34.862+0000 7fe15ff46640 1 -- 172.21.15.37:0/1039684877 wait complete. 2024-05-10T08:50:34.872 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-10T08:50:34.872 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T08:50:34.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T08:50:34.872 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:34.881 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T08:50:34.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T08:50:34.881 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:34.931 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T08:50:34.931 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T08:50:34.931 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:34.942 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T08:50:34.943 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T08:50:34.943 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:34.994 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T08:50:34.994 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T08:50:34.995 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T08:50:34.995 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.021 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T08:50:35.021 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T08:50:35.021 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.095 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T08:50:35.095 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T08:50:35.095 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.159 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T08:50:35.159 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T08:50:35.159 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.230 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T08:50:35.231 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T08:50:35.231 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.265 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T08:50:35.265 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T08:50:35.265 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.332 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T08:50:35.333 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T08:50:35.333 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.399 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T08:50:35.399 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T08:50:35.399 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.470 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T08:50:35.470 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T08:50:35.471 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T08:50:35.471 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.496 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T08:50:35.497 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T08:50:35.497 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.539 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T08:50:35.539 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T08:50:35.539 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T08:50:35.539 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.551 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T08:50:35.551 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T08:50:35.551 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.592 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T08:50:35.592 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T08:50:35.592 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T08:50:35.645 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T08:50:35.645 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T08:50:35.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-05-10T08:50:35.686 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:44:14.323232+0000 mds.c (mds.0) 1 : cluster [WRN] Corrupt dentry 'file_to_be_damaged' in dir frag 0x10000000000: Invalid tag char 'd' pos 0: Malformed input [buffer:3](/subdir) 2024-05-10T08:50:35.686 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-05-10T08:50:35.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-05-10T08:50:35.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-05-10T08:50:35.836 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-10T08:45:49.330259+0000 mds.c (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-05-10T08:50:35.837 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:50:35.837 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T08:50:36.023 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:50:36.023 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T08:50:36.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:50:36.148 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T08:50:36.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:50:36.213 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T08:50:36.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:50:36.262 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T08:50:36.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:50:36.420 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T08:50:36.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:50:36.514 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T08:50:36.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:50:36.557 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T08:50:36.664 INFO:tasks.ceph:Archiving mon data... 2024-05-10T08:50:36.665 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/data/mon.a.tgz 2024-05-10T08:50:36.665 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-05-10T08:50:36.682 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.76TjYd4Yej 2024-05-10T08:50:36.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.76TjYd4Yej 2024-05-10T08:50:36.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.76TjYd4Yej 2024-05-10T08:50:36.933 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.76TjYd4Yej is 445KB 2024-05-10T08:50:37.003 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.76TjYd4Yej 2024-05-10T08:50:37.019 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/data/mon.b.tgz 2024-05-10T08:50:37.019 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-05-10T08:50:37.035 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.WQLYvynetk 2024-05-10T08:50:37.035 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WQLYvynetk 2024-05-10T08:50:37.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.WQLYvynetk 2024-05-10T08:50:37.282 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.WQLYvynetk is 463KB 2024-05-10T08:50:37.352 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.WQLYvynetk 2024-05-10T08:50:37.367 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/data/mon.c.tgz 2024-05-10T08:50:37.367 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-05-10T08:50:37.422 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.ufOTHOVmBf 2024-05-10T08:50:37.422 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ufOTHOVmBf 2024-05-10T08:50:37.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.ufOTHOVmBf 2024-05-10T08:50:37.659 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.ufOTHOVmBf is 463KB 2024-05-10T08:50:37.728 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.ufOTHOVmBf 2024-05-10T08:50:37.743 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T08:50:37.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T08:50:37.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T08:50:37.829 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T08:50:37.864 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T08:50:37.864 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T08:50:37.866 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/remote/smithi037/crash 2024-05-10T08:50:37.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T08:50:37.897 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/remote/smithi082/crash 2024-05-10T08:50:37.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T08:50:37.928 INFO:tasks.ceph:Shutting down logrotate 2024-05-10T08:50:37.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:50:37.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T08:50:38.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T08:50:38.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T08:50:38.070 INFO:tasks.ceph:Compressing logs... 2024-05-10T08:50:38.070 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T08:50:38.089 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T08:50:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74059.log 2024-05-10T08:50:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44153.log 2024-05-10T08:50:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50775.log 2024-05-10T08:50:38.152 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42150.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35510.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.1.42150.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42150.log.gz 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35602.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35510.log.gz -5 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35602.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35602.log.gz 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35554.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42550.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35554.log.gz 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.3.42550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42550.log.gz 2024-05-10T08:50:38.153 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42554.log 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.3.42554.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.3.42554.log.gz 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35722.log: /var/log/ceph/ceph-mon.c.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2024-05-10T08:50:38.154 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35430.log 2024-05-10T08:50:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35470.log 2024-05-10T08:50:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35430.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35430.log.gz 2024-05-10T08:50:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35682.log 2024-05-10T08:50:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35470.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35470.log.gz 2024-05-10T08:50:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35642.log 2024-05-10T08:50:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35682.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35682.log.gz 2024-05-10T08:50:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-10T08:50:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.35642.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35642.log.gz 2024-05-10T08:50:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-10T08:50:38.196 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42155.log 2024-05-10T08:50:38.216 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.1.42155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42155.log.gz 2024-05-10T08:50:38.243 INFO:teuthology.orchestra.run.smithi082.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-10T08:50:38.276 INFO:teuthology.orchestra.run.smithi082.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-10T08:50:38.276 INFO:teuthology.orchestra.run.smithi082.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-10T08:50:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.74059.log: /var/log/ceph/ceph-client.admin.44153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51235.log 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74059.log.gz 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50775.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44153.log.gz 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44893.log 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44405.log 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50775.log.gz 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.44893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68601.log 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44893.log.gz 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68643.log 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57480.log 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68685.log 2024-05-10T08:50:38.370 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0%/var/log/ceph/ceph-client.admin.68643.log: -- replaced with /var/log/ceph/ceph-client.admin.44405.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68601.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40993.log 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68643.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57738.log 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68685.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71131.log 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57480.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40993.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73933.log 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71496.log 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73933.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.71131.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46339.log 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57738.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73933.log.gz 2024-05-10T08:50:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61337.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62259.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46339.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49976.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.71496.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43236.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61337.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49976.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65634.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41694.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.62259.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43236.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42977.log 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65634.log.gz 2024-05-10T08:50:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46255.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60254.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41694.log.gz 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47307.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42977.log.gz 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46255.log.gz 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.60254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73017.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60254.log.gz 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57654.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73017.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47307.log.gz 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.70310.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73017.log.gz 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67650.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68413.log 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57654.log.gz 2024-05-10T08:50:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67650.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.70310.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67650.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58840.log 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68413.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58840.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55618.log 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58840.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69940.log 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68517.log 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55618.log.gz 2024-05-10T08:50:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59702.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.69940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69940.log.gz 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73555.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67818.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68517.log.gz 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61637.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73555.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59702.log.gz 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71580.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73555.log.gz 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61637.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67818.log.gz 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42851.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.61637.log.gz 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73292.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44321.log: /var/log/ceph/ceph-client.admin.42851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57288.log 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2024-05-10T08:50:38.375 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42851.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50566.log 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.71580.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73292.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57288.log: /var/log/ceph/ceph-client.admin.47806.log 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.50566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55395.log 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50566.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57288.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47806.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45027.log 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55395.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53139.log 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45027.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gz 2024-05-10T08:50:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60612.log 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45027.log.gz 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.53139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62522.log 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53139.log.gz 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41257.log 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55702.log 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.60612.log.gz 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55744.log 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.62522.log.gz 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41257.log.gz 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54110.log 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55702.log: /var/log/ceph/ceph-client.admin.55744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45689.log 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55702.log.gz 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54110.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55744.log.gz 2024-05-10T08:50:38.377 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42767.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54110.log.gz 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73513.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45689.log.gz 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42767.log.gz 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58677.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44569.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73513.log.gz 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64873.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58677.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49169.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58677.log.gz 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46670.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62924.log 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64873.log.gz 2024-05-10T08:50:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46670.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49169.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63501.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46670.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58146.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63982.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.62924.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2%/var/log/ceph/ceph-client.0.58146.log: -- replaced with /var/log/ceph/ceph-client.admin.63501.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57954.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58146.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55351.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57954.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63982.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55351.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57954.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56542.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55351.log.gz 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58635.log 2024-05-10T08:50:38.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67734.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56542.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55530.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58635.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55936.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55530.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67734.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70121.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55530.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59656.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55936.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53852.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59656.log: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70121.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72788.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59656.log.gz 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52362.log 2024-05-10T08:50:38.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51087.log 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53852.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52629.log 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.72788.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52362.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.51087.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49337.log 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52503.log 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51087.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52629.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62134.log 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49337.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61788.log 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52503.log: /var/log/ceph/ceph-client.admin.62134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72620.log 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52503.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61788.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62134.log.gz 2024-05-10T08:50:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48515.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62776.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72620.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61788.log.gz 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51371.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72620.log.gz 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48515.log.gz 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.62776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73249.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62776.log.gz 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51371.log.gz 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67176.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73249.log.gz 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70419.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47479.log: /var/log/ceph/ceph-client.admin.67176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52275.log 2024-05-10T08:50:38.382 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71174.log 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70419.log.gz 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.67176.log.gz 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49806.log 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71174.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52275.log.gz 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47736.log 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49806.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.71174.log.gz 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49806.log.gz 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50849.log 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47736.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48001.log 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.47736.log.gz 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51977.log 2024-05-10T08:50:38.383 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50849.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.48001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53135.log 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48001.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42683.log 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51977.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.53135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54425.log 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53135.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66920.log 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42683.log: /var/log/ceph/ceph-client.admin.54425.log: gzip 88.7% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42683.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.68853.log 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54425.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66335.log 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.66920.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66335.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68853.log.gz 2024-05-10T08:50:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65515.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55222.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.66335.log.gz 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62858.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63814.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65515.log.gz 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55222.log.gz 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53268.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63814.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62858.log.gz 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71211.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63814.log.gz 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.62320.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51455.log 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53268.log.gz 2024-05-10T08:50:38.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51893.log 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53786.log 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.71211.log.gz 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51455.log.gz 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51893.log.gz 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64199.log 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64024.log 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64199.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53786.log.gz 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65592.log 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64199.log.gz 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73387.log 2024-05-10T08:50:38.386 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64024.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62072.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65592.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58142.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62072.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73387.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56684.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62072.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.58142.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58142.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60984.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56684.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68769.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62434.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60984.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60734.log 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68769.log.gz 2024-05-10T08:50:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52797.log 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62434.log: /var/log/ceph/ceph-client.admin.60734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41736.log 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62434.log.gz 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60734.log.gz 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63543.log 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52797.log.gz 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45605.log 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41736.log.gz 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63543.log: /var/log/ceph/ceph-client.admin.45605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63543.log.gz 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43061.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45605.log.gz 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43238.log 2024-05-10T08:50:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47521.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47689.log 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gz 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43238.log.gz 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58467.log 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41904.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47689.log.gz 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54467.log 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43239.log 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54467.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58467.log.gz 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61595.log 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54467.log.gz 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49720.log 2024-05-10T08:50:38.389 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43239.log.gz 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54299.log 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65372.log 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61595.log.gz 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54299.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49720.log.gz 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54341.log 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54299.log.gz 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.65372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59828.log 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65372.log.gz 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74017.log 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66242.log 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59828.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54341.log.gz 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.74017.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.59828.log.gz 2024-05-10T08:50:38.390 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63898.log 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74017.log.gz 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58551.log 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66242.log.gz 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59050.log/var/log/ceph/ceph-client.admin.63898.log: 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58551.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63898.log.gz 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55786.log 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59050.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58551.log.gz 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74160.log 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55786.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59050.log.gz 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53744.log 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55786.log.gz 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.74160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59954.log 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53744.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74160.log.gz 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53420.log 2024-05-10T08:50:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59954.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53744.log.gz 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59954.log.gz 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.53420.log: --verbose -- /var/log/ceph/ceph-client.admin.55660.log 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55660.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53420.log.gz 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46381.log 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56596.log 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55660.log.gz 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46004.log: /var/log/ceph/ceph-client.admin.46381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70549.log 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56596.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46381.log.gz 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62392.log 2024-05-10T08:50:38.392 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56596.log.gz/var/log/ceph/ceph-client.admin.70549.log: 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69359.log 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62392.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.69359.log: 88.5% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62392.log.gz -- replaced with /var/log/ceph/ceph-client.admin.70549.log.gz 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69359.log.gz 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43574.log 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56980.log 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43574.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45647.log 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43574.log.gz 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44195.log 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.56980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56980.log.gz 2024-05-10T08:50:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66639.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44195.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45647.log.gz 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50937.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44195.log.gz 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66639.log: /var/log/ceph/ceph-client.admin.50937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57846.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42332.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.66639.log.gz 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50699.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50937.log.gz 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63627.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42893.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50699.log: /var/log/ceph/ceph-client.admin.63627.log: gzip -5 --verbose 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50699.log.gz 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.63459.log 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57846.log.gz 2024-05-10T08:50:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42893.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63627.log.gz 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51809.log 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42893.log.gz 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52152.log 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51809.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63459.log.gz 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50270.log 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51809.log.gz 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59744.log 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52152.log: /var/log/ceph/ceph-client.admin.50270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49678.log 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52152.log.gz 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50270.log.gz 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2024-05-10T08:50:38.395 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59744.log.gz 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53364.log 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49678.log: /var/log/ceph/ceph-client.admin.46171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72891.log 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49678.log.gz 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46586.log 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72891.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.53364.log.gz 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57372.log 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72891.log.gz 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46586.log.gz 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52587.log 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47563.log: /var/log/ceph/ceph-client.admin.57372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63585.log 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2024-05-10T08:50:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52587.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52587.log.gz 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57372.log.gz 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43019.log 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63585.log.gz 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64987.log 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.43019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72746.log 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43019.log.gz 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65713.log 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64987.log.gz 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73471.log 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72746.log.gz 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65713.log.gz 2024-05-10T08:50:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55306.log 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73471.log: /var/log/ceph/ceph-client.admin.35543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73471.log.gz 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55306.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60062.log 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46543.log 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55306.log.gz/var/log/ceph/ceph-client.admin.43813.log: 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60062.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73975.log 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60062.log.gz 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68559.log 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46543.log: /var/log/ceph/ceph-client.admin.73975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47437.log 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46543.log.gz 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68559.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.73975.log.gz --verbose 2024-05-10T08:50:38.398 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.71248.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68559.log.gz 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47437.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71248.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71248.log.gz 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44111.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2%/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49934.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67608.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64281.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44111.log.gz 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49934.log.gz/var/log/ceph/ceph-client.admin.67608.log: 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57588.log 2024-05-10T08:50:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64281.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67608.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64281.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68123.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73334.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68123.log: /var/log/ceph/ceph-client.admin.73334.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57588.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68123.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.73334.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54738.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46958.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60876.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54738.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46958.log.gz 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58882.log 2024-05-10T08:50:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60876.log: /var/log/ceph/ceph-client.admin.49596.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60876.log.gz 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59786.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58882.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62157.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59786.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58882.log.gz 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64789.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59786.log.gz 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62780.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64789.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64789.log.gz 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44279.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.62157.log.gz/var/log/ceph/ceph-client.0.62780.log: 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62780.log.gz 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73891.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74120.log 2024-05-10T08:50:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73891.log: /var/log/ceph/ceph-client.admin.44279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69363.log 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73891.log.gz 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.74120.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44279.log.gz 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74120.log.gz 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59432.log 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.69363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69363.log.gz 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59996.log 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51497.log 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5%/var/log/ceph/ceph-client.admin.59996.log: -- replaced with /var/log/ceph/ceph-client.admin.59432.log.gz 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72577.log 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51497.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59996.log.gz 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35912.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70807.log 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2024-05-10T08:50:38.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72577.log: -- replaced with /var/log/ceph/ceph-client.admin.51497.log.gz 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50060.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72577.log.gz 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.70807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70807.log.gz 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48626.log 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50060.log.gz 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54948.log 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48626.log.gz 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45342.log 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48392.log: /var/log/ceph/ceph-client.admin.54948.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54948.log.gz 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69944.log 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52713.log 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.2.45342.log: /var/log/ceph/ceph-client.0.69944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66508.log 2024-05-10T08:50:38.403 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45342.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69944.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50850.log 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52713.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58509.log 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66508.log: /var/log/ceph/ceph-client.admin.50850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71430.log 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58509.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50850.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58509.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66508.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63417.log 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65905.log 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43240.log 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.65905.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.71430.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% 0.0% -- replaced with /var/log/ceph/ceph-client.0.65905.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63417.log.gz 2024-05-10T08:50:38.404 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65114.log 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70615.log 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5%/var/log/ceph/ceph-client.admin.65114.log: -- replaced with /var/log/ceph/ceph-client.admin.43240.log.gz 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66737.log 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.70615.log: -- /var/log/ceph/ceph-client.admin.58425.log 90.8% -- replaced with /var/log/ceph/ceph-client.admin.65114.log.gz 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70615.log.gz 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52457.log 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55264.log 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9%/var/log/ceph/ceph-client.admin.58425.log: -- replaced with /var/log/ceph/ceph-client.admin.66737.log.gz 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52457.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58425.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.65368.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52457.log.gz 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55264.log: gzip -5 --verbose -- 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55264.log.gz 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.55488.log 2024-05-10T08:50:38.405 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.65368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65368.log.gz 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70231.log 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70231.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55488.log.gz 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68979.log 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70231.log.gz 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71899.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41436.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68979.log.gz 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67986.log 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41436.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71899.log.gz 2024-05-10T08:50:38.406 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41436.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50312.log 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67986.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43576.log 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45479.log: /var/log/ceph/ceph-client.admin.50312.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50312.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55576.log 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43576.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46915.log 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67692.log 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55576.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59390.log 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52233.log 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46915.log.gz 2024-05-10T08:50:38.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67692.log: /var/log/ceph/ceph-client.admin.59390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55141.log 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59390.log.gz 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67692.log.gz 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52233.log: gzip -5 --verbose -- 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52233.log.gz 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.51413.log 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65030.log 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55141.log.gz 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51021.log 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42809.log 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65030.log.gz/var/log/ceph/ceph-client.admin.51021.log: 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71793.log 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8%/var/log/ceph/ceph-client.admin.42809.log: -- replaced with /var/log/ceph/ceph-client.admin.51021.log.gz 2024-05-10T08:50:38.408 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43241.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42809.log.gz/var/log/ceph/ceph-client.admin.71793.log: 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47997.log 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71793.log.gz 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52839.log 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71751.log 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.47997.log: /var/log/ceph/ceph-client.admin.52839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53678.log 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47997.log.gz 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71751.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52839.log.gz 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71751.log.gz 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72848.log 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53678.log: /var/log/ceph/ceph-client.admin.44363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72848.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2024-05-10T08:50:38.409 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72848.log.gz 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46297.log 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41215.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gz 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71054.log 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46297.log.gz 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63772.log 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56726.log 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71054.log: /var/log/ceph/ceph-client.admin.63772.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71054.log.gz 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63772.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53486.log 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51623.log 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53486.log: /var/log/ceph/ceph-client.admin.56726.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56726.log.gz 2024-05-10T08:50:38.410 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53486.log.gz 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52881.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71538.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51623.log: /var/log/ceph/ceph-client.admin.52881.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51623.log.gz 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64621.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52881.log.gz 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58593.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64621.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64621.log.gz 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.71538.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47042.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71285.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58593.log.gz 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72441.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71285.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47042.log.gz 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71285.log.gz 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59870.log 2024-05-10T08:50:38.411 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64915.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59870.log: /var/log/ceph/ceph-client.admin.72441.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72441.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59870.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72662.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70366.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64915.log: /var/log/ceph/ceph-client.admin.72662.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64915.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72662.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51851.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73207.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51851.log: /var/log/ceph/ceph-client.admin.70366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70366.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51851.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56445.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66878.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73207.log: /var/log/ceph/ceph-client.admin.56445.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73207.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67265.log 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56445.log.gz 2024-05-10T08:50:38.412 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52072.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66878.log: /var/log/ceph/ceph-client.admin.67265.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66878.log.gz 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58966.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.67265.log.gz 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46628.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52072.log.gz 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58966.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61896.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49850.log: /var/log/ceph/ceph-client.admin.46628.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46628.log.gz 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gz 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41339.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47212.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61896.log: /var/log/ceph/ceph-client.admin.41339.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41339.log.gz 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61896.log.gz 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72534.log 2024-05-10T08:50:38.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50228.log 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47212.log.gz 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64705.log 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50228.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72534.log.gz 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50228.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62217.log 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56306.log 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62217.log: /var/log/ceph/ceph-client.admin.64705.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64705.log.gz 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68727.log 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56306.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56306.log.gz 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60450.log 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.62217.log.gz 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60830.log 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60450.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68727.log.gz 2024-05-10T08:50:38.414 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60450.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41610.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59008.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60830.log: /var/log/ceph/ceph-client.admin.41610.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60830.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41610.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70507.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59572.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70507.log: /var/log/ceph/ceph-client.admin.59008.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59008.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70507.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56468.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59572.log: /var/log/ceph/ceph-client.admin.48315.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59572.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61487.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.56468.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66423.log 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61487.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48315.log.gz 2024-05-10T08:50:38.415 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61487.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72157.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64831.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66423.log: /var/log/ceph/ceph-client.0.72157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72157.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64747.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64831.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66423.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64831.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64579.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61421.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64747.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54696.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61421.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64579.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61421.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43570.log 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54044.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54696.log.gz 2024-05-10T08:50:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.0.61176.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65072.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43570.log: /var/log/ceph/ceph-client.0.61176.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43570.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61176.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67944.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70803.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65072.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50144.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67944.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.70803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54906.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70803.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58332.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50144.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49024.log 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58332.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54906.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58332.log.gz 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.417 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51665.log 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48898.log 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49024.log.gz 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67524.log 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48898.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51665.log.gz 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48898.log.gz 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51110.log 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67482.log 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67524.log: /var/log/ceph/ceph-client.admin.51110.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67524.log.gz 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57546.log 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51110.log.gz 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68895.log 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57546.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67482.log.gz 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57546.log.gz 2024-05-10T08:50:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67439.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49127.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68895.log: /var/log/ceph/ceph-client.admin.67439.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68895.log.gz 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67439.log.gz 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69609.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51767.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49127.log: /var/log/ceph/ceph-client.admin.69609.log: 88.2% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69609.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49127.log.gz 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47605.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51767.log: /var/log/ceph/ceph-client.admin.53636.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51767.log.gz 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56128.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56638.log 2024-05-10T08:50:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47605.log: /var/log/ceph/ceph-client.0.56128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56128.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47605.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53936.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56638.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49421.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49253.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53936.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72704.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54551.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49421.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57912.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72704.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54551.log.gz 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71857.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59187.log 2024-05-10T08:50:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57912.log: /var/log/ceph/ceph-client.admin.71857.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57912.log.gz 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41838.log 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71857.log.gz 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53570.log 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59187.log: /var/log/ceph/ceph-client.admin.41838.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59187.log.gz 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41838.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64119.log 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48589.log 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64119.log: /var/log/ceph/ceph-client.admin.53570.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64119.log.gz 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61529.log 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48589.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53570.log.gz 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48589.log.gz 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58924.log 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58924.log: /var/log/ceph/ceph-client.admin.61529.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58924.log.gz 2024-05-10T08:50:38.421 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69021.log 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2%/var/log/ceph/ceph-client.admin.43242.log: -- replaced with /var/log/ceph/ceph-client.admin.61529.log.gz 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73681.log 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60667.log 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73681.log: /var/log/ceph/ceph-client.admin.69021.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73681.log.gz 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69021.log.gz 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58737.log 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59521.log 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58737.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60667.log.gz 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58737.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29516.log 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54002.log 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59521.log.gz 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.29516.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29516.log.gz 2024-05-10T08:50:38.422 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57145.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71697.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54002.log.gz 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59912.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71697.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57145.log.gz 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71697.log.gz 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51329.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65180.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59912.log: /var/log/ceph/ceph-client.admin.51329.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59912.log.gz 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56124.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43563.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65180.log: /var/log/ceph/ceph-client.0.56124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56124.log.gz 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65180.log.gz 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44888.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2024-05-10T08:50:38.423 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43563.log.gz 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.44888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44888.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72975.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72153.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49379.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.72153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72153.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72975.log.gz 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60527.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43815.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49379.log: /var/log/ceph/ceph-client.admin.60527.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49379.log.gz 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60527.log.gz 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69105.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43815.log: /var/log/ceph/ceph-client.admin.43579.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43815.log.gz 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64453.log 2024-05-10T08:50:38.424 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66681.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64453.log: /var/log/ceph/ceph-client.admin.69105.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64453.log.gz 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.69105.log.gz 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74202.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66681.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66681.log.gz 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56792.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.74202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71407.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74202.log.gz 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56792.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56792.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64537.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71407.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71407.log.gz 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55446.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63856.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64537.log.gz 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60918.log 2024-05-10T08:50:38.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63856.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55446.log.gz 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63856.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41568.log 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63687.log 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41568.log: /var/log/ceph/ceph-client.admin.60918.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41568.log.gz 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60918.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48982.log 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66597.log 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63687.log.gz 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42564.log 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66597.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48982.log.gz 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.66597.log.gz 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73807.log 2024-05-10T08:50:38.426 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67092.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73807.log: /var/log/ceph/ceph-client.admin.42564.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73807.log.gz 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68811.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67092.log: /var/log/ceph/ceph-client.admin.46423.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.67092.log.gz 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46750.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50186.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68811.log: /var/log/ceph/ceph-client.admin.46750.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68811.log.gz 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46750.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52755.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69171.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52755.log: /var/log/ceph/ceph-client.admin.50186.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50186.log.gz 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52755.log.gz 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50102.log 2024-05-10T08:50:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61994.log 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69171.log: /var/log/ceph/ceph-client.admin.50102.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69171.log.gz 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50102.log.gz 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54864.log 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61994.log: /var/log/ceph/ceph-client.admin.54864.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61994.log.gz 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54864.log.gz 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54609.log 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67004.log 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54609.log: /var/log/ceph/ceph-client.admin.45521.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54609.log.gz 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59267.log 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66832.log 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59267.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.67004.log.gz 2024-05-10T08:50:38.428 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59267.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59348.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47168.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66832.log.gz 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59348.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59348.log.gz 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47000.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54780.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47168.log: /var/log/ceph/ceph-client.admin.47000.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47168.log.gz 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47000.log.gz 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67902.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48940.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67902.log: /var/log/ceph/ceph-client.admin.54780.log: 89.1% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54780.log.gz 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67902.log.gz 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49516.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55870.log 2024-05-10T08:50:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48940.log: /var/log/ceph/ceph-client.admin.49516.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48940.log.gz 87.6% 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49516.log.gz 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68326.log 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62480.log 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55870.log: /var/log/ceph/ceph-client.admin.68326.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68326.log.gz 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55870.log.gz 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56984.log 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52947.log 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62480.log: /var/log/ceph/ceph-client.0.56984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56984.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62480.log.gz 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47391.log 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64663.log 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52947.log: /var/log/ceph/ceph-client.admin.47391.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52947.log.gz 2024-05-10T08:50:38.430 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47391.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53311.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63186.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53311.log: /var/log/ceph/ceph-client.admin.64663.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53311.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64663.log.gz 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67776.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65657.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63186.log: /var/log/ceph/ceph-client.admin.67776.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63186.log.gz 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50570.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67776.log.gz 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65657.log: /var/log/ceph/ceph-client.0.50570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50570.log.gz 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65657.log.gz 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50378.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43243.log 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2024-05-10T08:50:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64495.log 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43243.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50378.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43243.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56383.log 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68203.log 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64495.log: /var/log/ceph/ceph-client.admin.56383.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64495.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69686.log 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56383.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66574.log 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68203.log: /var/log/ceph/ceph-client.admin.69686.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68203.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66165.log 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69686.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47647.log 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66574.log: /var/log/ceph/ceph-client.admin.66165.log: 88.3% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66574.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66165.log.gz 2024-05-10T08:50:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50722.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47647.log: -- /var/log/ceph/ceph-client.admin.47256.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47647.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71341.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50722.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47256.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42725.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54822.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42725.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71341.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42725.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63010.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67860.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54822.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41385.log 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67860.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67860.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63010.log.gz 2024-05-10T08:50:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64323.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50018.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41385.log.gz 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50018.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64323.log.gz 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50018.log.gz 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43913.log: /var/log/ceph/ceph-client.admin.45926.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60788.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42641.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43912.log: /var/log/ceph/ceph-client.admin.60788.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60788.log.gz 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63281.log 2024-05-10T08:50:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60589.log/var/log/ceph/ceph-client.admin.42641.log: 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42641.log.gz 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60589.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63281.log.gz 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60589.log.gz 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57438.log 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52671.log 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44237.log: /var/log/ceph/ceph-client.admin.57438.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57438.log.gz 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49762.log 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51539.log 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52671.log: /var/log/ceph/ceph-client.admin.49762.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52671.log.gz 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63730.log 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49762.log.gz 2024-05-10T08:50:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52317.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51539.log: /var/log/ceph/ceph-client.admin.63730.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63730.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51539.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54654.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43914.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52317.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54654.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43914.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54654.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43914.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49892.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64409.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.49892.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43575.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64409.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64409.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69063.log 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43575.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43575.log.gz 2024-05-10T08:50:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73849.log 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69063.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69063.log.gz 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73849.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73849.log.gz 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69752.log 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47349.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52545.log 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69752.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69752.log.gz 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57804.log 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52545.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52545.log.gz 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73765.log 2024-05-10T08:50:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57804.log.gz 2024-05-10T08:50:38.438 INFO:teuthology.orchestra.run.smithi082.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-10T08:50:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68937.log 2024-05-10T08:50:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73765.log.gz 2024-05-10T08:50:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59092.log 2024-05-10T08:50:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68937.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68937.log.gz 2024-05-10T08:50:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59092.log.gz 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68475.log 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59477.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73429.log 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68475.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68475.log.gz 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72933.log 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73429.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.73429.log.gz 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48856.log 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.72933.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72933.log.gz 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48856.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48856.log.gz 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45346.log 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43915.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2024-05-10T08:50:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73597.log 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.2.45346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45346.log.gz 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48772.log 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73597.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73597.log.gz 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48454.log 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48772.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48772.log.gz 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41526.log 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48454.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48454.log.gz 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48552.log 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41526.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41526.log.gz 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58222.log 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48552.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48552.log.gz 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70461.log 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58222.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.58222.log.gz 2024-05-10T08:50:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65901.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70461.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70461.log.gz 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.65901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65901.log.gz 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42935.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49295.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63375.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42935.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42935.log.gz 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51725.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63375.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63375.log.gz 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61703.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51725.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51725.log.gz 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61271.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61703.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61703.log.gz 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-05-10T08:50:38.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61271.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61271.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73723.log 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41173.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68284.log 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73723.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73723.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63078.log 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68284.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68284.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42506.log 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63078.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63078.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67005.log 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42506.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42506.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46831.log 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67005.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.67005.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54383.log 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46831.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46831.log.gz 2024-05-10T08:50:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47084.log 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54383.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54383.log.gz 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67397.log 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47084.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47084.log.gz 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51581.log 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67397.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67397.log.gz 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66336.log 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51581.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51581.log.gz 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55061.log 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66336.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66336.log.gz 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68028.log 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55061.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55061.log.gz 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68368.log 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68028.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68028.log.gz 2024-05-10T08:50:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68368.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68368.log.gz 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41652.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45773.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73639.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41652.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41652.log.gz 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73639.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73639.log.gz 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gz 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54205.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41482.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66790.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54205.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54205.log.gz 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63120.log 2024-05-10T08:50:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66790.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66790.log.gz 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43237.log 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63120.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63120.log.gz 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63940.log 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43237.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43237.log.gz 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62588.log 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63940.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63940.log.gz 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60250.log 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62588.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62588.log.gz 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.61172.log 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.60250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60250.log.gz 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71965.log 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.61172.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58780.log 2024-05-10T08:50:38.471 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.0.61172.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57222.log 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71965.log: /var/log/ceph/ceph-client.admin.58780.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58780.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71965.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51935.log 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51935.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.57222.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51935.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59614.log 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67566.log 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59614.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59614.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49211.log 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64365.log 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67566.log: /var/log/ceph/ceph-client.admin.49211.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67566.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49211.log.gz 2024-05-10T08:50:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35813.log 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43911.log 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64365.log.gz 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61854.log 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35813.log.gz 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67242.log 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61854.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43911.log.gz 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54509.log 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61854.log.gz 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67242.log: /var/log/ceph/ceph-client.admin.54509.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67242.log.gz 2024-05-10T08:50:38.473 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54509.log.gz 2024-05-10T08:50:38.474 INFO:teuthology.orchestra.run.smithi037.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-10T08:50:38.544 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-10T08:50:39.081 INFO:teuthology.orchestra.run.smithi037.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-10T08:50:39.369 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-10T08:50:39.379 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-10T08:50:39.410 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-10T08:50:39.425 INFO:teuthology.orchestra.run.smithi082.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-10T08:50:39.452 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-10T08:50:39.454 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-05-10T08:50:39.454 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m1.329s 2024-05-10T08:50:39.454 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m5.806s 2024-05-10T08:50:39.454 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m0.213s 2024-05-10T08:50:39.515 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-10T08:50:39.526 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-10T08:50:39.794 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-10T08:50:39.796 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-10T08:50:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m1.694s 2024-05-10T08:50:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m6.844s 2024-05-10T08:50:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.561s 2024-05-10T08:50:39.796 INFO:tasks.ceph:Archiving logs... 2024-05-10T08:50:39.796 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/remote/smithi037/log 2024-05-10T08:50:39.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T08:50:41.168 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/remote/smithi082/log 2024-05-10T08:50:41.169 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T08:50:42.008 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T08:50:42.018 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T08:50:42.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T08:50:42.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T08:50:42.110 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T08:50:42.119 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T08:50:42.119 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T08:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T08:50:42.137 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-05-10T08:50:42.139 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-05-10T08:50:42.142 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T08:50:42.143 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-05-10T08:50:42.143 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +357us[ +352us] +/- 67ms 2024-05-10T08:50:42.143 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -849us[ -849us] +/- 58ms 2024-05-10T08:50:42.143 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +789us[ +783us] +/- 74ms 2024-05-10T08:50:42.143 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:50:42.144 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T08:50:42.144 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-10T08:50:42.145 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +346us[ +344us] +/- 67ms 2024-05-10T08:50:42.145 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -869us[ -869us] +/- 58ms 2024-05-10T08:50:42.145 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +780us[ +780us] +/- 74ms 2024-05-10T08:50:42.145 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T08:50:42.145 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T08:50:42.205 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T08:50:42.205 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T08:50:42.214 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T08:50:42.304 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T08:50:42.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T08:50:42.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:50:42.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T08:50:42.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:50:42.435 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T08:50:42.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T08:50:42.453 INFO:teuthology.task.internal:Duration was 1076.187417 seconds 2024-05-10T08:50:42.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T08:50:42.462 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T08:50:42.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T08:50:42.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T08:50:42.504 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T08:50:42.516 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T08:50:42.768 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T08:50:42.769 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-05-10T08:50:42.769 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T08:50:42.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T08:50:42.830 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T08:50:42.874 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T08:50:42.874 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T08:50:42.877 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T08:50:42.940 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T08:50:42.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T08:50:42.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T08:50:43.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T08:50:43.094 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T08:50:43.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T08:50:43.120 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T08:50:43.145 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T08:50:43.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T08:50:43.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T08:50:43.185 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-05-10T08:50:43.208 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-05-10T08:50:43.222 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T08:50:43.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:50:43.254 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T08:50:43.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T08:50:43.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T08:50:43.288 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T08:50:43.288 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/remote/smithi037 2024-05-10T08:50:43.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T08:50:43.331 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073/remote/smithi082 2024-05-10T08:50:43.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T08:50:43.364 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T08:50:43.364 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T08:50:43.367 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T08:50:43.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T08:50:43.426 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T08:50:43.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T08:50:43.435 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T08:50:43.436 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T08:50:43.439 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T08:50:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: 265566 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 08:50 /home/ubuntu/cephtest 2024-05-10T08:50:43.471 INFO:teuthology.orchestra.run.smithi082.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 08:50 /home/ubuntu/cephtest 2024-05-10T08:50:43.472 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T08:50:43.483 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T08:50:43.504 INFO:teuthology.nuke:Checking targets against current locks 2024-05-10T08:50:43.529 DEBUG:teuthology.nuke:shortname: smithi037 2024-05-10T08:50:43.529 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T08:50:43.553 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 08:23:17.371320', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOcUkZbUa+MoBbiCA6aOmMuS2Mj9ec8CbVCXdupKx+eM9fZNi1YLCK64kADA9N0O2nlR3HHbre6XsapUnxYRsI='} 2024-05-10T08:50:43.554 DEBUG:teuthology.nuke:shortname: smithi082 2024-05-10T08:50:43.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T08:50:43.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_08:11:49-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7701073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 08:23:17.373214', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOe8oDvRwfdClHI9t/UpsXBfVBtq0rv0KO2+FENtP18U1VHd5hUbv5MwBhflZ2e/Scep5l5aXTlqvpjegSCarBc='} 2024-05-10T08:50:43.607 INFO:teuthology.orchestra.console.smithi037:Power off 2024-05-10T08:50:43.607 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T08:50:43.631 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2024-05-10T08:50:43.631 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T08:50:43.646 INFO:teuthology.orchestra.console.smithi082:Power off 2024-05-10T08:50:43.646 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T08:50:43.654 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-05-10T08:50:43.673 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-05-10T08:50:43.673 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T08:50:43.695 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-05-10T08:50:47.655 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T08:50:47.696 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T08:50:47.765 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-05-10T08:50:47.805 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-05-10T08:50:51.766 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T08:50:51.806 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T08:50:51.876 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-05-10T08:50:51.916 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-05-10T08:50:51.976 INFO:teuthology.orchestra.console.smithi037:Power off completed 2024-05-10T08:50:55.917 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T08:50:56.026 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-05-10T08:50:56.127 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-05-10T08:50:56.231 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 1076.187417268753 failure_reason: '"2024-05-10T08:45:49.330259+0000 mds.c (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir)" in cluster log' flavor: default owner: scheduled_dparmar@teuthology success: false 2024-05-10T08:50:56.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T08:50:56.307 INFO:teuthology.run:FAIL